Multiclass-penalized logistic regression

Didier Nibbering, Trevor J. Hastie

Research output: Contribution to journalArticleResearchpeer-review

4 Citations (Scopus)

Abstract

A multinomial logistic regression model that penalizes the number of class-specific parameters is proposed. The number of parameters in a standard multinomial regression model increases linearly with the number of classes and number of explanatory variables. The multiclass-penalized regression model clusters parameters together by penalizing the differences between class-specific parameter vectors, instead of penalizing the number of explanatory variables. The model provides interpretable parameter estimates, even in settings with many classes. An algorithm for maximum likelihood estimation in the multiclass-penalized regression model is discussed. Applications to simulated and real data show in- and out-of-sample improvements in performance relative to a standard multinomial regression model.

Original languageEnglish
Article number107414
Number of pages16
JournalComputational Statistics and Data Analysis
Volume169
DOIs
Publication statusPublished - May 2022

Keywords

  • Lasso
  • Multinomial logistic regression
  • Parameter clustering

Cite this