dd

Advanced Topics in Mobile Computer Vision (EECS 598-07) - Fall 2010

Instructor: Prof. Silvio Savarese

Webpage: http://www.eecs.umich.edu/~silvio/

Classroom:3433 EECS
Time: T Th 9:00am-10:30am
Office hours: by appointment

Grader: Fisher Yu (yufu at umich dot edu)

 

-------------------------------------------------------------------------------------------------------------------

EECS 598- Schedule

 

 

Notes:
-
The course will start on 9.14. Lectures on 9.7 and 9.9 are cancelled (conflict with the European Conference in Computer Vision 2010).
- Links to PDF and class material will be activated throughout the course.

Lect. Date Topic Details Background Presenters Deadlines
1 Tues 9.14 Introduction

- Introduction and course overview. Overview of projects on mobile vision. PDF

- List of project proposals

   
2 Thur 9.16 Android Plaform (I) - Overview of the Android platform. Guiding examples. PDF Android development tools Shyam Kumar  
3 Tues 9.21 Android Plaform (II) - Getting started with your Google Android: setting up an "hello world" application; PDF Android development tools Fisher Yu  
4 Thur 9.23

Android Plaform (III)

- Getting started with your Google Android: linking client with server; PDF

Android development tools

Fisher Yu

 

 
5 Tues 9.28

Detectors/descriptors

- H. Bay, T. Tuytelaars, and L. V. Gool, "SURF: Speeded Up Robust Features," in ECCV, 2006 PDF

- N. Dalal and B. Triggs. Histograms of Oriented Gradients for Human Detection. In CVPR, pages 886–893, 2005. PDF

- CHoG: Compressed Histogram of Gradients - A low bit rate feature descriptor, Chandrasekhar et al. CVPR 2009 PDF

- W.-C. Chen, Y. Xiong, J. Gao, - N. Gelfand, and R. Grzeszczuk, "Efficient Extraction of Robust Image Features on Mobile Devices," in ISMAR '07 PDF

Anush Mohan

Grace Tsai

Slides: PDF1; PDF2

 

 
6 Thur 9.30 Image matching (I)

- D. Nistér and H. Stewénius, “Scalable recognition with a vocabulary tree,” in CVPR 2006. PDF

- J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object Retrieval with Large Vocabularies and Fast Spatial Matching," CVPR, 2007. PDF

- G Takacs et al "Outdoors augmented reality on mobile phone using loxel-based visual feature organization", MIR’08 PDF

 

Sairam Sundaresan

Alok Satish Talekar

Slides: PDF

 

Submit project proposal by midnight
7 Tues 10.5 Image matching (II)

- S. Lazebnik et al, "Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories". CVPR 2006. PDF

S. Maji, A. C. Berg, and J. Malik, "Classification using intersection kernel support vector machines is efficient," in CVPR 2008. PDF

Nicholas Carlevaris-Bianco

Sid Ying-ze Bao

Slides: PDF1; PDF2

Prepare hello world application on the mobile device; demonstration time and location TBA
8 Thur 10.7 Image matching (III)

G. Schindler, M. Brown, and R. Szeliski, “City-scale location recognition,” CVPR 2007. PDF

- D. M. Chen, S. S. Tsai, V. Chandrasekhar, G. Takacs, J. Singh, and B. Girod, “Tree histogram coding for mobile image matching,” in DCC, '09. PDF

 

Srujankumar Puchakayala

Aditya Srinivasa Rao Pabbaraju

Slides: PDF

 
9 Tues 10.12

Image matching (IV)

Yang et al,  Linear Spatial Pyramid Matching Using Sparse Coding for Image Classification- CVPR 09 PDF

Wang et al, Learning Locality-constrained Linear Coding for Image Classification, CVPR, 2010 PDF

 

Byung Soo Kim

Hao Yu

Slides: PDF

 

 
10 Thur 10.14 2D shape matching

- Ling, H. and Jacobs, D. 2007. Shape Classification Using the Inner-Distance, IEEE Trans. on Patt. Anal. and Mach. Intell., 29(2):286-299. PDF

- Shirdhonkar et al "Searching the World’s Herbaria: A System for the Visual Identification of Plant Species,” ECCV 08 PDF

Chen Feng

Chunxia Li

Slides: PDF1; PDF2; PDF3

 
  Tues 10.19  

 

    Full Study Break
11 Thur 10.21 Spot light project presentations     All  
12 Tues 10.26 Object detection (I)

- P. Felzenszwalb, D. McAllester, D. Ramaman. A Discriminatively Trained, Multiscale, Deformable Part Model. CVPR 2008. PDF

- P. Felzenszwalb, R. Girshick, D. McAllester. Cascade Object Detection with Deformable Part Models. CVPR 2010 PDF

Dae Jung,

Mandar Gokhale

Slides: PDF

 
13 Thur 10.28 Object detection (II)

- A. Leibe, A. Leonardis, B Schiele, Combined object categorization and segmentation with an implicit shape model, Workshop on Statistical Learning, ECCV 04 PDF

- M. Sun, G. Bradsky, B. Xu, and S. Savarese, "Depth-Encoded Hough Voting for Joint Object Detection and Shape Recovery", Proc. of European Conference of Computer Vision, 2010 PDF

Anush Mohan

Min Sun

Slides: PDF1; PDF2

 
14 Tues 11.2 3D Object/location recognition (I)

-D. Lowe, Object recognition from local scale-invariant features. ICCV 1999. PDF

- I. Gordon and D. Lowe, Scene Modelling, Recognition and Tracking with Invariant Image Features, ISMAR 2004, PDF

- Edward Hsiao, Alvaro Collet and Martial Hebert. Making specific features less discriminative to improve point-based 3D object recognition. CVPR 2010. PDF

Grace Tsai

Alok Satish Talekar

Slides: PDF

 
15 Thur 11.4 3D Object/location recognition (II)

- Irschara et al, From Structure-from-Motion Point Clouds to Fast Location Recognition, CVPR 09 PDF

- Arth et al., Wide Area Localization on Mobile Phones, Symposium on Mixed and Augmented Reality 08, PDF

- R. Paucher and M. Turk, Location-based augmented reality on mobile phones, IWMV 09, PDF

  • RANSAC;
  • N. Snavely, S. Seitz, R. Szeliski, Modeling the world from Internet photo collections, IJCV 07 PDF
  • Agarwal et al, Building Rome in a Day
    ICCV 98, PDF

Shyam Kumar

Sairam Sundaresan

Slides: PDF

Progress report due
16 Tues 11.9 Feature/Object Tracking (I)

M. Ozuysal, P. Fua, V. Lepetit, Fast Keypoint Recognition in Ten Lines of Code, CVPR '07. PDF

- D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg. Pose tracking from natural features on mobile phones. In ISMAR’08, 2008. PDF

- Ta et al., SURFTrac: Efficient Tracking and Continuous Object Recognition using Local
Feature Descriptors, CVPR09 PDF

Chen Feng

Chunxia Li

Slides: PDF1; PDF2

 
17 Thur 11.11 no class    

 

 
18 Tues 11.16 Feature/Object Tracking (II)

- E. Rosten and T. Drummond, Machine learning for high-speed corner detection, ECCV 06 PDF

- E. Rosten and T. Drummond, Fusing Points and Lines for High Performance Tracking, ICCV 05 PDF

- G. Reitmayr and T. Drummond, Going out: Robust model based tracking for outdoor augmented reality, ISMAR 08 PDF

- Gammeter et a l, Server-side object recognition and client-side object tracking for mobile augmented reality, IWMV_10 PDF

Hao Yu

Fisher Yu

Slides: PDF1; PDF2

 
19 Thur 11.18 Scene modeling and virtual augmentation

Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: Proc
Intl. Symposium on Mixed and Augmented Reality (ISMAR’07), Nara (November 2007) PDF

G. Klein and D. Murray. Improving the agility of keyframebased SLAM. In ECCV08, 2008. PDF

G. Klein and D. Murray. Parallel tracking and mapping on a camera phone. In ISMAR’09, 2009 PDF

 

Nicholas Carlevaris-Bianco

Sid Ying-ze Bao

Slides: PDF1; PDF2

 
20 Tues 11.23 Human Tracking

Charles Bibby, Ian Reid, Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors, ECCV 08 PDF

J. C. Niebles, B. Han and L. Fei-Fei. Efficient Extraction of Human Motion Volumes by Tracking, CVPR 10; PDF

 

Wongun Choi

Slides: PDF

 
- Thur 11.25 Thanksgiving Recess      
21 Tues 11.30 Face Recognition and tagging

- Viola et al. "Detecting Pedestrians Using Patterns of Motion and Appearance", PDF

- M. Rahman, N. Kehtarnavaz, and J. Ren. A Hybrid Face Detection Approach for Real-time Deployment on Mobile Devices. In ICIP, pages 3233 –3236, Nov. 2009 PDF

-Hadid et al, Face and Eye Detection for Person Authentication in Mobile Phones, Distributed Smart Cameras, 2007, PDF

Srujankumar Puchakayala

Aditya Srinivasa Rao Pabbaraju

Slides: PDF

 
22 Thur 12.2 Face tracking

- D. Comaniciu. P. Meer, Robust Analysis of Feature Spaces: Color Image Segmentation. 1997 PDF

- G.. Bradski, Computer Vision Face Tracking For Use in a Perceptual User Interface 1998 PDF

- T Hansen, E Eriksson, Use your head: exploring face tracking for mobile interaction, CHI'06 PDF

Hao Yu

Mandar Gokhale

Dae Jung

Slides: PDF

 

 
  Tues 12.7 Final Project Presentations I link      
  Thur 12.9 Final Project Presentations III link      
  Sunday 12.19         Project final report due