Optimal model selection: stepwise procedures (elimination, addition of variables, stepwise regression, etc), methods based on information criteria (AIC, BIC), use of multiple criterion (min SSE, min SAE, MMAE).
Model selection with penalized techniques: Ridge Regression, LASSO, Post-LASSO, regression with elastic Net method.
Generalized Linear Models (GLM), Generalized Additive Models (GAM).
Qualitative response regression models (1): Linear Probability Model (LPM), Logit, Glogit, Probit, Tobit models. Poisson regression model.