Stella X. Yu : Papers / Google Scholar

Learning Lightness from Human Judgement on Relative Reflectance
Takuya Narihira and Michael Maire and Stella X. Yu
IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, 8-10 June 2015
Paper | Poster

Abstract
We develop a new approach to inferring lightness, the perceived reflectance of surfaces, from a single image. Classic methods view this problem from the perspective of intrinsic image decomposition, where an image is separated into reflectance and shading components. Rather than reason about reflectance and shading together, we learn to directly predict lightness differences between pixels. Large-scale training from human judgement data on relative reflectance, and patch representations built using deep networks, provide the foundation for our model. Benchmarked on the Intrinsic Images in the Wild dataset, our local lightness model achieves on-par performance with the state-of-the-art global lightness model, which incorporates multiple shading/reflectance priors and simultaneous reasoning between pairs of pixels in a dense conditional random field formulation.

Keywords
intrinsic image decomposition, reflectance, lightness, deep learning