Stella X. Yu : Papers / Google Scholar

Improving Generalization via Scalable Neighborhood Component Analysis
Zhirong Wu and Alexei A. Efros and Stella X. Yu
European Conference on Computer Vision, Munich, Germany, 10-13 September 2018
Paper | Poster | Code

Current visual recognition is dominated by the end-to-end formulation of classification problems implemented by the parametric softmax classifiers. Such formulation makes a closed world assumption with a fixed set of categories. This becomes problematic for open-set scenarios where new categories are encountered with very few examples for learning a generalizable parametric classifier. This paper adopts a non-parametric approach for visual recognition by optimizing feature embeddings instead of parametric classifiers. We use a deep neural network to learn embeddings which preserves neighborhood structures by neighborhood component analysis (NCA). Limited by its computational bottlenecks, we devise a mechanism to use an augmented memory to scale NCA for large datasets and very deep neural networks. Our experimental results show state-of-the-art results on ImageNet classification using nearest neighbor classifiers. More importantly, our feature embedding is more generalizable for new categories such as sub-category discovery and few-shot recognition. % on Action, Perception and Organization

k-nearest neighbors, large-scale object recognition, neigh- borhood component analysis, transfer learning, few-shot learning