AUEB Library - Digital Repository

PYXIDA Institutional Repository
and Digital Library

Username
Password

Collections :	Ιδρυματικό Αποθετήριο ΟΠΑ / AUEB Institutional Repository Σχολή Επιστημών και Τεχνολογίας της Πληροφορίας / School of Informatics Τμήμα Στατιστικής / Department of Statistics Μεταπτυχιακές Εργασίες / Postgraduate dissertations

Title :	Bayesian variable selection and shrinkage using Lasso methods

Alternative Title :	Μπεϋζιανά μοντέλα επιλογής και συρρίκνωσης μεταβλητών με τη χρήση μεθόδων lasso

Creator :	Katsarps, Michail

Contributor :	Ntzoufras, Ioannis (Επιβλέπων καθηγητής) Athens University of Economics and Business, Department of Statistics (Degree granting institution)

Type :	Text

Extent :	108 p.

Language :	en

Abstract :	Least squares method is the usual way of treating a multiple regression problem. But not all available predictors are meaningful for the response variable. Poor performance in terms of prediction accuracy and interpretation are problems arising when overfitting the data. Variable selection methods improve interpretation and prediction by producing models of lower dimension, while shrinkage techniques reduce the variance of predicted values by shrinking predictors’ coefficients towards zero.LASSO performs both shrinkage and variable selection by shrinking some coefficients towards zero and setting others exactly equal to zero. A tuning parameter is involved, which controls the shrinkage procedure while k-fold Cross Validation is used to specify its optimal value. Additionally, the lasso estimates can be defined as a Bayesian posterior mode when regression coefficients are placed under independent double-exponential (Laplace) priors.

Abstract :

Least squares method is the usual way of treating a multiple regression problem. But not all available predictors are meaningful for the response variable. Poor performance in terms of prediction accuracy and interpretation are problems arising when overfitting the data. Variable selection methods improve interpretation and prediction by producing models of lower dimension, while shrinkage techniques reduce the variance of predicted values by shrinking predictors’ coefficients towards zero.LASSO performs both shrinkage and variable selection by shrinking some coefficients towards zero and setting others exactly equal to zero. A tuning parameter is involved, which controls the shrinkage procedure while k-fold Cross Validation is used to specify its optimal value. Additionally, the lasso estimates can be defined as a Bayesian posterior mode when regression coefficients are placed under independent double-exponential (Laplace) priors.

Subject :	Lasso methods Bayesian model Variables

Date Created :	29-04-2016

Licence :

File: Katsaros_2016.pdf

Type: application/pdf

Login