Machine Learning Computer Science

23 个科学问题 · 计算机 Computer Science

本页目录

随机森林和梯度提升树为什么在表格数据上特别好用?

Why are random forests and gradient boosting especially effective on tabular data?

随机森林由大量决策树组成,训练时随机选特征和样本以减少过拟合、用投票集成;梯度提升则串行地让新树专门纠正前一轮的残差,往往精度更高。Breiman 在 2001 年提出随机森林,Friedman 在 2001 年提出梯度提升。
A random forest combines many decision trees trained on random feature and sample subsets, voting to reduce overfitting; gradient boosting serially adds trees that correct the previous round's residuals, often achieving higher accuracy. Breiman proposed random forests in 2001 and Friedman gradient boosting in 2001.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 已核验 · Verified 2026-11-04 · 2 条独立证据
来源 · Source

Breiman《随机森林》(Machine Learning, 2001);Friedman《梯度提升机》(2001);Chen《XGBoost》(2016)

Breiman, 'Random Forests' (Machine Learning, 2001); Friedman, 'Greedy Function Approximation' (2001); Chen, 'XGBoost' (2016)

#随机森林 #梯度提升 #决策树 #集成

偏差-方差权衡(bias-variance tradeoff)描述了什么现象?

What phenomenon does the bias-variance tradeoff describe?

偏差-方差权衡指出模型总误差可分解为偏差(欠拟合、假设过简)与方差(过拟合、对训练数据敏感)之和,并常加上不可约噪声。一味降低偏差往往抬高方差,反之亦然,因此需要在二者间取得平衡。该框架由杰曼等人在 1992 年系统阐述,是理解模型泛化的重要视角。
The bias-variance tradeoff decomposes a model's total error into bias (underfitting from an overly simple hypothesis) and variance (overfitting from sensitivity to training data), plus irreducible noise. Reducing bias often raises variance and vice versa, so a balance must be struck. Systematized by Geman et al. in 1992, it is a key lens for understanding generalization.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 已核验 · Verified 2026-10-04 · 2 条独立证据
来源 · Source

Geman 等 1992;Hastie 等《统计学习基础》(ESL)

Geman et al. (1992); Hastie et al., The Elements of Statistical Learning (ESL)

#偏差方差权衡 #泛化 #欠拟合 #过拟合

反向传播(backpropagation)在神经网络训练中起什么作用?

What role does backpropagation play in training neural networks?

反向传播是一种利用链式法则高效计算损失函数对各参数梯度的算法,使多层网络得以用梯度下降更新权重。它由鲁梅尔哈特、辛顿与威廉姆斯在 1986 年系统阐明,是深度网络训练得以可行的关键。没有它,深层网络参数众多时无法有效学习。
Backpropagation efficiently computes the gradient of the loss with respect to every parameter via the chain rule, enabling gradient descent to update weights in multi-layer networks. Systematized by Rumelhart, Hinton, and Williams in 1986, it is the key that makes training deep networks feasible. Without it, the vast parameter count of deep networks could not be learned effectively.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 已核验 · Verified 2026-10-04
来源 · Source

Rumelhart, Hinton & Williams 1986;Goodfellow 等《深度学习》

Rumelhart, Hinton & Williams (1986); Goodfellow et al., Deep Learning

#反向传播 #梯度下降 #链式法则 #神经网络

Transformer 模型与自注意力(self-attention)机制是什么?

What are Transformer models and the self-attention mechanism?

Transformer 是 2017 年由瓦斯瓦尼等人在《Attention Is All You Need》中提出的网络架构,完全基于自注意力机制而摒弃了循环与卷积。自注意力让序列中每个位置直接关注所有其他位置并加权聚合,从而高效捕捉长距离依赖且易于并行训练。它成为 GPT、BERT 等现代大语言模型的基石。
The Transformer is an architecture proposed by Vaswani et al. in 2017 in 'Attention Is All You Need', built entirely on self-attention and discarding recurrence and convolution. Self-attention lets every position in a sequence directly attend to all others and aggregate them with weights, capturing long-range dependencies efficiently and training in parallel. It underpins modern large language models such as GPT and BERT.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 来源待核验 · Source pending review
来源 · Source

出处备注:此条未指向带版次的可引用著作(通识性内容、机构文件或未展开的英文书名),本库不提供独立书目出处;如需精确引用,需由编辑补全具体篇目与版次。

Vaswani 等 2017(NeurIPS);Google Research

Vaswani et al. (2017), NeurIPS; Google Research

#Transformer #自注意力 #大语言模型 #瓦斯瓦尼

什么是迁移学习?

What is transfer learning?

迁移学习是把在一个任务(通常是大数据集)上训练好的模型知识,迁移到数据较少的相关任务上。例如用大规模图像模型做起点,再微调以识别特定类型的图片。它能显著减少所需标注数据和训练时间。
Transfer learning takes knowledge from a model trained on one task, usually a large dataset, and applies it to a related task with less data. For example, start from a large-scale image model and fine-tune it to recognize a specific type of image. It can greatly reduce required labeled data and training time.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 已核验 · Verified 2026-08-23 · 2 条独立证据
来源 · Source

Russell & Norvig,《Artificial Intelligence: A Modern Approach》第4版,Pearson,2020

S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 4th ed., Pearson, 2020

#迁移学习 #微调 #预训练

什么是支持向量机(SVM)?

What is a support vector machine (SVM)?

支持向量机是一种经典的监督学习模型,目标是找到一条能最大化类间间隔的分割边界(最大间隔超平面)。它通过核技巧把数据映射到高维空间以处理非线性问题。在小样本高维分类任务中曾有很强表现。
A support vector machine is a classic supervised model that finds a decision boundary maximizing the margin between classes, the maximum-margin hyperplane. With kernel tricks it maps data to higher dimensions to handle non-linear problems. It performed strongly on small-sample, high-dimensional classification before deep learning.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 来源待核验 · Source pending review
来源 · Source

出处备注:此条未指向带版次的可引用著作(通识性内容、机构文件或未展开的英文书名),本库不提供独立书目出处;如需精确引用,需由编辑补全具体篇目与版次。

统计学习经典模型(Vapnik)

Classic statistical learning model (Vapnik)

#支持向量机 #分类 #核技巧

关联规则挖掘中,FP-Growth 相比 Apriori 是如何做到不生成候选频繁项集的?为什么支持度阈值越低它的优势越大?

In association rule mining, how does FP-Growth manage to mine frequent itemsets without generating candidates the way Apriori does, and why does its edge widen as the support threshold drops?

Apriori 逐层迭代:由 k-频繁集拼出海量候选 (k+1)-项集并逐一扫描数据库验证,支持度一低候选数就组合爆炸。FP-Growth 只扫两遍数据,把各事务的频繁项按支持度降序压入共享前缀的前缀树,再对每个频繁项提取条件模式基,递归构建更小的条件树直接产出频繁模式,全程无需验证候选集,故低阈值下明显更快。
Apriori iterates level by level: it joins k-frequent itemsets into enormous numbers of candidate (k+1)-itemsets and rescans the database to verify each one; lowering the support threshold makes candidates explode combinatorially. FP-Growth scans the data twice, compresses transactions into a prefix tree whose frequent-item paths are shared and support-sorted, then extracts a conditional pattern base per frequent item and recursively builds smaller conditional trees that grow frequent patterns directly—no candidate set is ever generated or verified—so its edge keeps widening as the support threshold drops.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 已核验 · Verified 2026-11-03
来源 · Source

Jiawei Han、Jian Pei、Yiwen Yin,《Mining Frequent Patterns without Candidate Generation》,ACM SIGMOD 国际会议论文集,2000年,第1–12页,DOI: 10.1145/335191.335372

J. Han, J. Pei, Y. Yin, Mining Frequent Patterns without Candidate Generation, Proc. ACM SIGMOD Int'l Conference on Management of Data, 2000, pp. 1-12, DOI: 10.1145/335191.335372.

#关联规则 #频繁模式 #FP-Growth

批归一化为什么能显著加速深度网络的训练?它最初基于内部分布偏移的解释后来为何被修正?

Why does batch normalization markedly accelerate deep-network training, and why was its original internal-covariate-shift explanation later revised?

它在每个小批次内把各层输入按特征重新拉回零均值、单位方差,再用可学习的缩放与平移恢复表达能力,使训练对初始化和学习率不敏感、可用更大步长。机理上真正的收益来自优化曲面的平滑:BN 让损失对参数的梯度变化更平缓,改善了梯度的利普希茨性质。原论文将提速归因于抑制内部协变量偏移,但后续实验表明同等偏移而无 BN 并不会拖慢训练,这一解释已被修正。
Within each mini-batch it re-centers layer inputs to zero mean and unit variance per feature, then restores expressive power through learnable scale and shift, making training less sensitive to initialization and learning rate so larger steps become safe. The genuine benefit comes from smoothing the optimization landscape: BN makes gradients vary more gently with the parameters, improving their Lipschitzness. The original paper credited the speedup to suppressing internal covariate shift, yet later experiments showed the same shift without BN does not slow training, so that account has been revised.
难度 专业 · 适合 小学高段(9-12) CC BY 4.0 · 已核验 · Verified 2026-10-03
来源 · Source

S. Ioffe 与 C. Szegedy,Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift,ICML 2015;S. Santurkar 等,NeurIPS 2018

S. Ioffe and C. Szegedy, Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, ICML 2015; S. Santurkar et al., How Does Batch Normalization Help Optimization?, NeurIPS 2018

#批归一化 #内部协变量偏移 #优化曲面平滑

反向传播算法是怎样让多层神经网络学会调整权重的?

How does backpropagation let a multi-layer neural network learn its weights?

反向传播用链式法则把输出误差从最后一层逐层向前算出每个权重的梯度,再沿梯度下降方向微调权重以减小误差。Rumelhart、Hinton 与 Williams 在 1986 年系统阐述,Werbos 早在 1974 年已提出其数学基础。
Backpropagation uses the chain rule to propagate output error backward layer by layer, computing each weight's gradient, then nudges weights downhill by gradient descent to shrink error. Rumelhart, Hinton, and Williams formalized it in 1986; Werbos laid the math in 1974.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 已核验 · Verified 2026-11-03
来源 · Source

Rumelhart、Hinton 与 Williams《反向传播学习》(Nature, 1986);Werbos《反向传播博士论文》(1974)

Rumelhart, Hinton & Williams, 'Learning representations by back-propagating errors' (Nature, 1986); Werbos, 'Backpropagation' (PhD thesis, 1974)

#反向传播 #梯度下降 #链式法则 #神经网络

什么是 Transformer 模型?

What is the Transformer model?

Transformer 是 2017 年提出的一种神经网络结构,完全基于自注意力机制来捕捉序列中任意位置的长程依赖,抛弃了循环结构。它奠定了 GPT、BERT 等大模型的基础。
The Transformer, proposed in 2017, is a neural architecture built entirely on self-attention to capture long-range dependencies anywhere in a sequence, discarding recurrence. It underpins large models such as GPT and BERT.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 已核验 · Verified 2026-11-03
来源 · Source

Vaswani 等 2017 年论文《Attention Is All You Need》

Vaswani et al., Attention Is All You Need (2017)

#Transformer #自注意力 #大模型

支持向量机(SVM)是怎样找到那道『最宽间隔』的分界线的?

How does a support vector machine find the widest-margin separating boundary?

SVM 在两类样本间寻找使间隔最大化的超平面,只有少数最靠近边界的『支持向量』决定最终位置;通过核技巧还能把非线性问题映射到高维空间再线性可分。Cortes 与 Vapnik 在 1995 年提出这一方法。
An SVM seeks the hyperplane that maximizes the margin between classes; only the few nearest 'support vectors' determine its position. A kernel trick maps non-linear problems into a higher dimension where they become linearly separable. Cortes and Vapnik introduced it in 1995.
难度 专业 · 适合 高中(15-18) CC BY 4.0 · 已核验 · Verified 2026-11-03
来源 · Source

Cortes 与 Vapnik《支持向量网络》(Machine Learning, 1995);Vapnik《统计学习理论》

Cortes & Vapnik, 'Support-Vector Networks' (Machine Learning, 1995); Vapnik, 'Statistical Learning Theory'

#SVM #最大间隔 #支持向量 #核技巧

k-means 聚类是怎么自动把数据点分成几堆的?

How does k-means clustering automatically group data points into clusters?

k-means 先随机选 k 个中心点,反复执行『把点分到最近的中心』和『用各簇均值更新中心』两步直到稳定,使簇内平方误差最小。Lloyd 在 1982 年给出算法描述,MacQueen 在 1967 年提出雏形。
k-means starts with k random centers and iteratively assigns each point to the nearest center then recomputes centers as cluster means, until stable, minimizing within-cluster squared error. Lloyd described the algorithm in 1982; MacQueen proposed the early form in 1967.
难度 进阶 · 适合 高中(15-18) CC BY 4.0 · 已核验 · Verified 2026-11-04
来源 · Source

Lloyd,《Least squares quantization in PCM》,IEEE Transactions on Information Theory,1982 (DOI: 10.1109/tit.1982.1056489);MacQueen《基于质心分类》(1967)

Lloyd, 'Least squares quantization in PCM', IEEE Transactions on Information Theory, 1982, DOI: 10.1109/tit.1982.1056489; MacQueen, 'Some methods for classification' (1967)

#k-means #聚类 #质心 #迭代

什么是决策树?

What is a decision tree?

决策树通过一系列「是/否」问题把数据不断分割,最终落到某个叶节点给出预测,形似一棵倒长的树。它直观易解释,常用于分类和回归。随机森林则是把众多决策树组合以提升效果。
A decision tree splits data repeatedly through a series of yes/no questions until a leaf node gives a prediction, resembling an upside-down tree. It is intuitive and interpretable, used for both classification and regression. A random forest combines many decision trees to improve performance.
难度 进阶 · 适合 初中(12-15) CC BY 4.0 · 已核验 · Verified 2026-08-23 · 2 条独立证据
来源 · Source

Russell & Norvig,《Artificial Intelligence: A Modern Approach》第4版,Pearson,2020

S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 4th ed., Pearson, 2020

#决策树 #分类 #随机森林

什么是监督学习?

What is supervised learning?

监督学习用带标注的样本(输入配上正确答案)训练模型,使模型学会从输入预测输出,如用大量带标签的猫狗照片学会分类。常见任务有分类与回归。
Supervised learning trains a model on labeled examples (inputs paired with correct answers) so it learns to predict outputs from inputs, like classifying cats versus dogs from many labeled photos. Typical tasks are classification and regression.
难度 进阶 · 适合 初中(12-15) CC BY 4.0 · 已核验 · Verified 2026-11-02
来源 · Source

《机器学习》(周志华)

Machine Learning (Zhou Zhihua)

#监督学习 #标注数据 #分类

什么是聚类?

What is clustering?

聚类是无监督学习的一种,把相似的数据点自动归为同一组,而不需要预先标注类别。K-means 是最常见的方法,它把数据划分成 K 个簇。聚类广泛用于市场分群、异常检测和图像分割。
Clustering is a form of unsupervised learning that automatically groups similar data points together without pre-labeled categories. K-means is the most common method, partitioning data into K clusters. It is widely used for market segmentation, anomaly detection, and image segmentation.
难度 进阶 · 适合 初中(12-15) CC BY 4.0 · 已核验 · Verified 2026-08-23 · 2 条独立证据
来源 · Source

Russell & Norvig,《Artificial Intelligence: A Modern Approach》第4版,Pearson,2020

S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 4th ed., Pearson, 2020

#聚类 #K-means #无监督

什么是过拟合(overfitting)?常用哪些方法防止它?

What is overfitting, and what common methods prevent it?

过拟合指模型在训练数据上表现极好、却在新数据上很差,因为它记住了噪声而非规律。常用对策包括交叉验证来估计真实泛化能力、用正则化惩罚模型复杂度、以及增加训练数据或提前停止训练。本质上是在拟合能力与泛化能力之间做权衡。
Overfitting occurs when a model performs extremely well on training data but poorly on new data because it memorized noise rather than the underlying pattern. Common remedies include cross-validation to estimate true generalization, regularization to penalize complexity, and adding training data or early stopping. The essence is trading fitting power for generalization.
难度 进阶 · 适合 初中(12-15) CC BY 4.0 · 已核验 · Verified 2026-10-04 · 2 条独立证据
来源 · Source

Hastie、Tibshirani 与 Friedman,《The Elements of Statistical Learning》第2版, Springer, 2009; C. M. Bishop,《Pattern Recognition and Machine Learning》, Springer, 2006

T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning, 2nd ed., Springer, 2009; C. M. Bishop, Pattern Recognition and Machine Learning, Springer, 2006

#过拟合 #交叉验证 #正则化 #泛化

什么是过拟合?

What is overfitting?

过拟合指模型在训练数据上表现极好,却无法泛化到新数据,相当于「死记硬背」了训练样本。常见原因包括模型太复杂或训练数据太少。常用正则化、早停和增加数据等方法缓解。
Overfitting occurs when a model performs extremely well on training data but fails to generalize to new data, as if it memorized the samples. Common causes are an overly complex model or too little training data. It is mitigated by regularization, early stopping, and adding more data.
难度 进阶 · 适合 初中(12-15) CC BY 4.0 · 已核验 · Verified 2026-08-23 · 2 条独立证据
来源 · Source

Russell & Norvig,《Artificial Intelligence: A Modern Approach》第4版,Pearson,2020

S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 4th ed., Pearson, 2020

#过拟合 #泛化 #正则化

训练神经网络时,随机梯度下降加上动量项为什么能收敛更快、还不容易来回震荡?

When training neural networks, why does adding a momentum term to stochastic gradient descent converge faster and resist oscillation?

动量把过去多步的更新方向按衰减系数累积起来,再叠加到当前步长上。梯度方向持续一致时速度越滚越大,等效放大了有效步长;而在高曲率峡谷两侧来回变号的梯度分量则相互抵消,震荡被平均掉。它相当于对梯度序列做指数加权平均的低通滤波,让优化轨迹既快又稳。
Momentum accumulates past update directions into a velocity with a decay factor and adds it to the current step. Where gradients keep pointing the same way the velocity grows, enlarging the effective step size; where gradients flip sign across the walls of a high-curvature ravine those components cancel out and the zigzag is averaged away. It acts as a low-pass filter over the gradient sequence, making the trajectory both fast and stable.
难度 进阶 · 适合 初中(12-15) CC BY 4.0 · 来源待核验 · Source pending review
来源 · Source

出处备注:此条未指向带版次的可引用著作(通识性内容、机构文件或未展开的英文书名),本库不提供独立书目出处;如需精确引用,需由编辑补全具体篇目与版次。

B. T. Polyak,USSR Computational Mathematics and Mathematical Physics 第4卷第5期,1964年;I. Sutskever 等,On the Importance of Initialization and Momentum in Deep Learning,ICML 2013

B. T. Polyak, USSR Computational Mathematics and Mathematical Physics 4(5), 1-17 (1964); I. Sutskever et al., On the Importance of Initialization and Momentum in Deep Learning, ICML 2013

#动量优化 #随机梯度下降 #指数加权平均

监督学习与无监督学习有什么不同?

What is the difference between supervised and unsupervised learning?

监督学习使用带标签的数据训练模型去预测或分类(如用带『猫/狗』标签的图片学分类);无监督学习面对的是无标签数据,目标是发现内在结构,如聚类或降维。二者区别核心在于训练时是否提供『标准答案』。半监督和强化学习则介于或超出这两类范式。
Supervised learning trains on labeled data to predict or classify (e.g., learning from images tagged 'cat' or 'dog'), while unsupervised learning works on unlabeled data to discover intrinsic structure such as clusters or reduced dimensions. The core difference is whether training provides a ground-truth answer. Semi-supervised and reinforcement learning lie between or beyond these two paradigms.
难度 进阶 · 适合 小学高段(9-12) CC BY 4.0 · 已核验 · Verified 2026-10-04 · 2 条独立证据
来源 · Source

Bishop《模式识别与机器学习》;Hastie 等《统计学习基础》(ESL)

Bishop, Pattern Recognition and Machine Learning; Hastie et al., The Elements of Statistical Learning (ESL)

#监督学习 #无监督学习 #聚类 #标签

什么是无监督学习?

What is unsupervised learning?

无监督学习面对没有标注的数据,目标是发现其中隐藏的结构,如把相似样本聚成簇(聚类)或把高维数据压缩到低维(降维)。常见算法有 K-means 和主成分分析。
Unsupervised learning works on unlabeled data to uncover hidden structure, such as grouping similar samples into clusters or compressing high-dimensional data to lower dimensions. Common algorithms include K-means and principal component analysis.
难度 进阶 · 适合 初中(12-15) CC BY 4.0 · 已核验 · Verified 2026-11-02
来源 · Source

《机器学习》(周志华)

Machine Learning (Zhou Zhihua)

#无监督学习 #聚类 #降维

什么是深度学习?

What is deep learning?

深度学习是机器学习的一个分支,使用多层(很深)的神经网络从数据中提取由浅入深的特征。它在图像、语音、语言等任务上取得了突破性成果。其发展得益于大数据和 GPU 算力的提升。
Deep learning is a branch of machine learning that uses multi-layer (very deep) neural networks to extract features from shallow to deep. It has achieved breakthrough results in image, speech, and language tasks. Its progress is thanks to big data and GPU computing power.
难度 入门 · 适合 大众 CC BY 4.0 · 已核验 · Verified 2026-08-23 · 2 条独立证据
来源 · Source

Russell & Norvig,《Artificial Intelligence: A Modern Approach》第4版,Pearson,2020

S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 4th ed., Pearson, 2020

#深度学习 #神经网络 #特征

什么是「训练」一个模型?

What does it mean to train a model?

训练就是让模型从大量例子中不断调整内部参数,使它对类似新问题也能给出正确答案的过程。好比学生通过大量练习掌握规律。训练得越多、数据越好,模型通常越准确,但也可能学过头。
Training is the process of letting a model repeatedly adjust its internal parameters from many examples so it can answer similar new questions correctly, like a student mastering patterns through practice. More and better training data usually means higher accuracy, though it can also overlearn.
难度 入门 · 适合 大众 CC BY 4.0 · 已核验 · Verified 2026-10-04
来源 · Source

Goodfellow, I., Bengio, Y. 与 Courville, A. (2016). 《深度学习》. MIT Press.

Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep Learning. MIT Press.

#训练 #模型 #学习

机器是怎么学习的?

How do machines learn?

机器学习就像小朋友看很多例子来认字:给它看成千上万张苹果的照片,并告诉它这是苹果,它就慢慢学会认苹果。看得越多、答对越多,它就学得越好。
Machine learning is like a child learning to read from examples: show it thousands of apple photos labeled this is an apple, and it gradually learns to recognize apples. The more it sees and the more it gets right, the better it learns.
难度 入门 · 适合 幼儿(3-6) CC BY 4.0 · 已核验 · Verified 2026-11-02
来源 · Source

《机器学习》(周志华)

Machine Learning (Zhou Zhihua)

#机器学习 #例子 #训练