Regularising non-linear models using feature side-information

Mollaysa, Amina (Haute école de gestion de Genève, HES-SO // Haute Ecole Spécialisée de Suisse Occidentale) ; Strasser,Pablo (Haute école de gestion de Genève, HES-SO // Haute Ecole Spécialisée de Suisse Occidentale) ; Kalousis, Alexandros (Haute école de gestion de Genève, HES-SO // Haute Ecole Spécialisée de Suisse Occidentale)

Very often features come with their own vectorial descriptions which provide detailed information about their properties. We refer to these vectorial descriptions as feature side-information. In the standard learning scenario, input is represented as a vector of features and the feature sideinformation is most often ignored or used only for feature selection prior to model fitting. We believe that feature side-information which carries information about features intrinsic property will help improve model prediction if used in a proper way during learning process. In this paper, we propose a framework that allows for the incorporation of the feature side-information during the learning of very general model families to improve the prediction performance. We control the structures of the learned models so that they reflect features’ similarities as these are defined on the basis of the side-information. We perform experiments on a number of benchmark datasets which show significant predictive performance gains, over a number of baselines, as a result of the exploitation of the side-information.


Type de conférence:
full paper
Faculté:
Economie et Services
Ecole:
HEG GE Haute école de gestion de Genève
Institut:
CRAG - Centre de Recherche Appliquée en Gestion
Classification:
Economie/gestion
Adresse bibliogr.:
Sydney, Australia, 6-11 August 2017
Date:
Sydney, Australia
6-11 August 2017
2017
Pagination:
10 p.
Publié dans
Proceedings of the 34th International Conference on Machine Learning
Ressource(s) externe(s):
Le document apparaît dans:



 Notice créée le 2017-10-18, modifiée le 2018-08-31

Fichiers:
Article - Télécharger le documentPDF
Appendix - Télécharger le documentPDF
Évaluer ce document:

Rate this document:
1
2
3
 
(Pas encore évalué)