It gives the whole overview about prediction functions, feature extraction, learning algorithms, performance evaluation, cross-validation, sample bias, nonstationarity, overfitting, and hyperparameter tuning.
它给出了预测函数,特征提取,学习算法,性能评估,交叉验证,样本偏差,非平稳性,过度拟合和超参数调整的整体观点。
Built-in Best Practices With this initial release, we also provide scripts to generate a number of data-sets widely used in the research community1, a handful of models2, a number of hyperparameter configurations, and a well-performing implementation of other important tricks of the trade.
内置最佳做法 通过这个初始版本,我们还提供了脚本,以生成大量在研究社区中广泛使用的数据集1 、少量模型2 、大量超参数配置以及其他重要诀窍的高性能实现。
The hyperparameter is the inverse variance (precision) of the Gaussian density function.
超参数是高斯密度函数的逆方差(精度)。
Adadelta has no learning rate hyperparameter, it uses an EWMA on the squares of elements in the variation of the independent variable to replace the learning rate.
AdaDelta算法没有学习率超参数,它通过使用有关自变量更新量平方的指数加权移动平均的项来替代RMSProp算法中的学习率。
Note that the number of topics is a hyperparameter that must be chosen in advance and is not estimated from the data.
值得注意的是,模型的主题数量是一个超参数,必须提前设置而不是从数据中估计。
The only possible value equals the value that is entered to this Location hyperparameter.
这唯一的可能值等于为该"位置"超参数输入的值。
Completed the Week 1 of Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization.
完成改进深度神经网络第1周内容:参数调整,正则化和优化。
When we set the momentum hyperparameter momentum to 0.5, it can be treated as a mini-batch SGD: the mini-batch gradient here is the weighted average of twice the mini-batch gradient of the last two time steps.
我们先将动量超参数momentum设 0.5,这时可以看成是特殊的小批量随机梯度下降:其小批量随机梯度为最近 2 个时间步的 2 倍小批量梯度的加权平均。
What parameters can use grid search? Perhaps there are grids of standard hyperparameter values that you can enumerate to find good configurations, then repeat the process with finer and finer grids.
哪些参数可以使用网格搜索?也许有一些标准超参数网格值,你可以拿来赋值,从而发现好的参数设置,重复这一过程,不断精调网格。
In Gluon, we only need to use momentum to define the momentum hyperparameter in the Trainer instance to implement momentum.
在Gluon中,只需要在Trainer实例中通过momentum来指定动量超参数即可使用动量法。