semi supervised logistic learning based on exponential tilt mixture models

• DOI: 10.48550/arxiv.1906.07882
• Publication Date: 2020-01-01
• Authors: Xinwei Zhang; Zhiqiang Tan
• Keywords: FOS: Computer and information sciences; Computer Science - Machine Learning; Statistics - Machine Learning; Machine Learning (stat.ML); 0101 mathematics; 01 natural sciences; Machine Learning (cs.LG)

Consider semi‐supervised learning for classification, where both labelled and unlabelled data are available for training. The goal is to exploit both datasets to achieve higher prediction accuracy than just using labelled data alone. We develop a semi‐supervised logistic learning method based on exponential tilt mixture models by extending a statistical equivalence between logistic regression and exponential tilt modelling. We study maximum nonparametric likelihood estimation and derive novel objective functions that are shown to be Fisher probability consistent. We also propose regularized estimation and construct simple and highly interpretable expectation–maximization (EM) algorithms. Finally, we present numerical results that demonstrate the advantage of the proposed methods compared with existing methods.