Bayesian Neighborhood Component Analysis

Affiliation of Author(s):计算机科学与技术学院/人工智能学院/软件学院

Journal:IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS

Key Words:Bayes modeling distance metric learning label noise neighborhood component analysis

Abstract:Learning a distance metric in feature space potentially improves the performance of the K nearest neighbor classifier and is useful in many real-world applications. Many metric learning (ML) algorithms are, however, based on the point estimation of a quadratic optimization problem, which is time-consuming, susceptible to overfitting, and lacks a natural mechanism to reason with parameter uncertainty-a property useful especially when the training set is small and/or noisy. To deal with these issues, we present a novel Bayesian ML (BML) method, called Bayesian neighborhood component analysis (NCA), based on the well-known NCA method, in which the metric posterior is characterized by the local label consistency constraints of observations, encoded with a similarity graph instead of independent pairwise constraints. For efficient Bayesian inference, we explore the variational lower bound over the log-likelihood of the original NCA objective. Experiments on several publicly available data sets demonstrate that the proposed method is able to learn robust metric measures from small size data set and/or from challenging training set with labels contaminated by errors. The proposed method is also shown to outperform a previous pairwise constrained BML method.

ISSN No.:2162-237X

Translation or Not:no

Date of Publication:2018-07-01

Co-author:Tan Xiaoyang

Correspondence Author:Tan Xiaoyang,wds

Date of Publication:2018-07-01