Stella X. Yu : Papers / Google Scholar

Visual Similarity from Optimizing Feature and Memory On A Hypersphere
Xinlei Pan and Rudrasis Chakraborty and Stella X. Yu
IEEE Conference on Computer Vision and Pattern Recognition Workshop: Vision Meets Cognition, Long Beach, California, 16 June 2019
Paper | Poster

Supervised learning of classification from annotated images develops a latent feature representation that captures semantic visual similarity. We propose an unsupervised metric learning method that develops apparent visual similarity from images alone. Our method maps high-dimensional visual data onto a low-dimensional hyper-sphere and consolidate such feature representations into a visual memory representation. Optimizing the feature mapping and visual memory on a hypersphere achieves maximal discrimination among instances. Our formulation and solution is not only more principled in theory than closely related unsupervised instance discrimination algorithms, but also better in practice in terms of classification accuracy, convergence rate, and feature transferability. We also show that our learned feature can be very useful for vision-based reinforcement learning tasks to improve sample efficiency.

Unsupervised feature learning, visual memory, hypersphere