License: 
Creative Commons Attribution 3.0 Unported license (CC BY 3.0)
When quoting this document, please refer to the following
DOI: 10.4230/LIPIcs.WABI.2018.17
URN: urn:nbn:de:0030-drops-93199
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2018/9319/
Chrétien, Stéphane ;
Guyeux, Christophe ;
Moulin, Serge
l1-Penalised Ordinal Polytomous Regression Estimators with Application to Gene Expression Studies
Abstract
Qualitative but ordered random variables, such as severity of a pathology, are of paramount importance in biostatistics and medicine. Understanding the conditional distribution of such qualitative variables as a function of other explanatory variables can be performed using a specific regression model known as ordinal polytomous regression. Variable selection in the ordinal polytomous regression model is a computationally difficult combinatorial optimisation problem which is however crucial when practitioners need to understand which covariates are physically related to the output and which covariates are not. One easy way to circumvent the computational hardness of variable selection is to introduce a penalised maximum likelihood estimator based on some well chosen non-smooth penalisation function such as, e.g., the l_1-norm. In the case of the Gaussian linear model, the l_1-penalised least-squares estimator, also known as LASSO estimator, has attracted a lot of attention in the last decade, both from the theoretical and algorithmic viewpoints. However, even in the Gaussian linear model, accurate calibration of the relaxation parameter, i.e., the relative weight of the penalisation term in the estimation cost function is still considered a difficult problem that has to be addressed with caution. In the present paper, we apply l_1-penalisation to the ordinal polytomous regression model and compare several hyper-parameter calibration strategies. Our main contributions are: (a) a useful and simple l_1 penalised estimator for ordinal polytomous regression and a thorough description of how to apply Nesterov's accelerated gradient and the online Frank-Wolfe methods to the problem of computing this estimator, (b) a new hyper-parameter calibration method for the proposed model, based on the QUT idea of Giacobino et al. and (c) a code which can be freely used that implements the proposed estimation procedure.
BibTeX - Entry
@InProceedings{chrtien_et_al:LIPIcs:2018:9319,
author = {St{\'e}phane Chr{\'e}tien and Christophe Guyeux and Serge Moulin},
title = {{l1-Penalised Ordinal Polytomous Regression Estimators with Application to Gene Expression Studies}},
booktitle = {18th International Workshop on Algorithms in Bioinformatics (WABI 2018)},
pages = {17:1--17:13},
series = {Leibniz International Proceedings in Informatics (LIPIcs)},
ISBN = {978-3-95977-082-8},
ISSN = {1868-8969},
year = {2018},
volume = {113},
editor = {Laxmi Parida and Esko Ukkonen},
publisher = {Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik},
address = {Dagstuhl, Germany},
URL = {http://drops.dagstuhl.de/opus/volltexte/2018/9319},
URN = {urn:nbn:de:0030-drops-93199},
doi = {10.4230/LIPIcs.WABI.2018.17},
annote = {Keywords: LASSO, ordinal polytomous regression, Quantile Universal Threshold, Frank-Wolfe algorithm, Nesterov algorithm}
}
|
Keywords: |
|
LASSO, ordinal polytomous regression, Quantile Universal Threshold, Frank-Wolfe algorithm, Nesterov algorithm |
|
Collection: |
|
18th International Workshop on Algorithms in Bioinformatics (WABI 2018) |
|
Issue Date: |
|
2018 |
|
Date of publication: |
|
02.08.2018 |
