Model selection

The term model selection may refer to any of these:

• Model type selection: Deciding the type of model to use, e.g., deciding between logistic regression and support vector machines.
• Hyperparameter optimization, specifically optimization of the regularization hyperparameter.

Although quite different, feature selection and cost function selection also bear some relation with model selection.