Regularising non-linear models using feature side-information

Mollaysa, Amina (Haute école de gestion de Genève, HES-SO // Haute Ecole Spécialisée de Suisse Occidentale) ; Strasser,Pablo (Haute école de gestion de Genève, HES-SO // Haute Ecole Spécialisée de Suisse Occidentale) ; Kalousis, Alexandros (Haute école de gestion de Genève, HES-SO // Haute Ecole Spécialisée de Suisse Occidentale)

Very often features come with their own vectorial descriptions which provide detailed information about their properties. We refer to these vectorial descriptions as feature side-information. In the standard learning scenario, input is represented as a vector of features and the feature sideinformation is most often ignored or used only for feature selection prior to model fitting. We believe that feature side-information which carries information about features intrinsic property will help improve model prediction if used in a proper way during learning process. In this paper, we propose a framework that allows for the incorporation of the feature side-information during the learning of very general model families to improve the prediction performance. We control the structures of the learned models so that they reflect features’ similarities as these are defined on the basis of the side-information. We perform experiments on a number of benchmark datasets which show significant predictive performance gains, over a number of baselines, as a result of the exploitation of the side-information.


Conference Type:
full paper
Faculty:
Economie et Services
School:
HEG - Genève
Institute:
CRAG - Centre de Recherche Appliquée en Gestion
Subject(s):
Economie/gestion
Publisher:
Sydney, Australia, 6-11 August 2017
Date:
Sydney, Australia
6-11 August 2017
2017
Pagination:
10 p.
Published in
Proceedings of the 34th International Conference on Machine Learning
External resources:
Appears in Collection:



 Record created 2017-10-18, last modified 2019-04-11

Fulltext:
Article - Download fulltextPDF
Appendix - Download fulltextPDF
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)