Hyperparameter
Definition
The term hyperparameter is used for something that is not a model parameter but broadly affects the final result of the learning algorithm and its ability to perform well on new test data.
Types of hyperparameters
| Hyperparameter type | Stage at which it appears |
|---|---|
| model hyperparameter | model selection |
| cost function hyperparameter | cost function selection |
| regularization hyperparameter | regularization |
| learning algorithm hyperparameter | learning algorithm |