We will focus on the penalized empirical risk, where the penalty may be deterministic (as BIC or ICL) or estimated with data (as the slope heuristic).
The goal is to understand why model selection may be useful and to know the basic criterion to do it.
When estimating parameters in a statistical model, sharp calibration is important to get optimal performances. In this course, we will focus on the selection of estimators with respect to the data. Particularly, we will consider calibration of parameters (e.g., regularization parameter for minimization of regularized empirical risk, like Lasso or Ridge estimators) and model selection (where each estimator minimizes the empirical risk on a specified model, as mixture models with several number of clusters).Prerequisites
Basic knowledges in probability and statistics
CC : reading of a research paper
Exam1 : test
Exam 2 : test or oral
N1 = 50% CC + 50% Exam1
N2 = 100% Exam2
The exam is given in english only
The course exists in the following branches:
Course ID : WMM9AM24
You can find this course among all other courses.
Date of update July 11, 2018