Rogerio Feris Website

Research Interests

My interests span a wide range of topics in computer vision and graphics, with emphasis on visual surveillance, intelligent user interfaces, and digital photography applications. Specific research areas include semantic mid-level representations based on parts and attributes, large-scale visual learning, computational photography, and face/gesture recognition. I personally believe that many computer vision tasks can be solved by 1) methods that learn from huge amounts of data and 2) non-traditional computational imaging approaches (computational photography). In the past five years, I have been working on the award-winning IBM Smart Surveillance System. See the links below:

ABC News put our video analytics to test
How we helped to solve a high-profile case in the city of Chicago

Selected Projects

Image Ranking and Retrieval Based on Multi-Attribute Queries

(with Behjat Siddiquie and Larry Davis)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011), oral presentation (3.5% acceptance)
Attribute-based Vehicle Search in Crowded Surveillance Environments

(with Behjat Siddiquie, Yun Zhai, James Petterson, Lisa Brown and Sharath Pankanti)
ACM International Conference on Multimedia Retrieval (ICMR 2011), oral presentation.
Attribute-based People Search

(with Daniel Vaquero, Lisa Brown, Duan Tran, Arun Hampapur and Matthew Turk)
IEEE Workshop on Applications of Computer Vision(WACV'09).
See a VIDEO DEMO of our system.
Shape Classification Through Structured Learning of Matching Measures

(with Longbin Chen, Julian Mcauley, Tiberio Caetano and Matthew Turk)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09).
A Projector-Camera Setup for Geometry-Invariant Frequency Demultiplexing

(with Daniel Vaquero, Ramesh Raskar, and Matthew Turk)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09).
Characterizing the Shadow Space of Camera-Light Pairs

(with Daniel Vaquero, Ramesh Raskar, and Matthew Turk)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR'08).
Click here for more recent work related to multi-flash imaging.
IBM Smart Surveillance Solution

(with the Exploratory Computer Vision Group at IBM)
I'm currently leading face analytics and object classification research for this project.
See a VIDEO DEMO of our system and our face capture method.
Discontinuity Preserving Stereo with Small Baseline Multi-Flash Illumination

(with Longbin Chen, Matthew Turk, Ramesh Raskar, and Karhan Tan )
Accepted for publication at International Conference on Computer Vision (ICCV'05), oral presentation (3.7% acceptance).
Automatic Human Facial Illustrations with Variable Illumination

(with Alex Olwal and Matthew Turk)
This project aims to combine computer vision and graphics for interactive and automatic human facial illustrations. We will demonstrate it in the Interactive FogScreen demo, SIGGRAPH Emerging Technologies, 2005.
A Non-Photorealistic Camera: Depth Edge Detection and Stylized Rendering with Multi-Flash Imaging

(with Ramesh Raskar, Karhan Tan, Jingyi Yu and Matthew Turk)
Accepted for publication in ACM SIGGRAPH 2004 (see a VIDEO DEMO of our work)
Also accepted for Siggraph Emerging Technologies, 2004.
Exploiting Depth Discontinuities for Vision-Based Fingerspelling Recognition

(with Matthew Turk, Ramesh Raskar, Karhan Tan and Gosuke Ohashi)
IEEE Workshop on Real-time Vision for Human-Computer Interaction (in conjunction with CVPR'04), Washington DC, USA, 2004. Extended version to appear as a book chapter, Springer-Verlag press.
Specular Reflection Reduction with Multi-Flash Imaging

(with Ramesh Raskar, Karhan Tan and Matthew Turk)
IEEE Brazilian Symposium on Computer Graphics and Image Processing (Sibgrapi'04), Curitiba, Brazil, 2004. Also accepted as a Siggraph poster, 2004. Extended version to appear in Journal of Brazilian Computer Society.
Shape Enhanced Surgical Visualizations with Multi-Flash Imaging

(with Karhan Tan, James Kobler, Paul Dietz and Ramesh Raskar)
International Conference on Medical Imaging Computing and Computer Assisted Intervention (Miccai'2004), France, 2004.
Manifold Based Analysis of Facial Expressions

(with Changbo Hu, Ya Chang and Matthew Turk)
IEEE Workshop on Face Processing in Video (in conjunction with CVPR'04), Washington DC, USA, 2004. See our VIDEO demonstration. Extended version in Image and Vision Computing Journal.
Real-time View-based Face Alignment Using Active Wavelet Networks

(with Changbo Hu and Matthew Turk)
IEEE Workshop on Analysis and Modeling of Faces and Gestures (in conjunction with ICCV'03), Nice, France, 2003.
Active Wavelet Networks for Face Alignment

(with Changbo Hu and Matthew Turk)
British Machine Vision Conference (BMVC'03), Norwich, UK, 2003.
GazeMaster: Gaze-aware Videoconferencing

(with Jim Gemmell and Kentaro Toyama)
This is the project I worked at Microsoft Research (follow the link for publications)(with Longbin Chen, Julian Mcauley, Tiberio Caetano and Matthew Turk)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09).
Head Pose Tracking using Incremental Focus of Attention

(with Jim Gemmell and Kentaro Toyama)
I extended Kentaro Toyama's tracker to achieve subpixel accuray (see VIDEO).
Real-time Detection, Alignment and Recognition of Human Faces

(with Changbo Hu and Matthew Turk)
We developed a fully automatic recognition system, with evaluation on Feret database.
Hierarchical Wavelet Networks for Facial Feature Localization

(with Jim Gemmell, Kentaro Toyama and Volker Krueger)
International Conference on Automatic Face and Gesture Recognition (FG'02), Washington, DC, 2002.
Efficient Real-Time Face Tracking in Wavelet Subspace

(with Volker Krueger and Roberto Cesar)
IEEE Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-time Systems (in conjunction with ICCV'01), Vancouver, Canada, 2001. Also accepted for Real-Time Imaging Journal
This is part of my MS thesis work (which was awarded in a Brazilian nationwide competition) See our DEMO.
Locating and Tracking of Facial Landmarks Using Gabor Wavelet Networks

(with Roberto Cesar)
International Conference on Advances in Pattern Recognition (ICAPR'01), Rio de Janeiro, Brazil, 2001
See also the related PROJECT PAGE.
A Project for Face Recognition from Video Sequences Using GWN and Eigenfeature Selection

(with Teofilo Campos and Roberto Cesar)
Workshop on Artificial Intelligence and Computer Vision (WAICV'2000), Atibaia, Brazil, 2000.
Improved Face versus Non-Face Discrimination Using Fourier Descriptors through Feature Selection

(with Teofilo Campos and Roberto Cesar)
IEEE Brazilian Symposium on Computer Graphics and Image Processing (Sibgrapi'2000), Gramado, Brazil, 2000.
Detection and Tracking of Facial Features in Video Sequences

(with Teofilo Campos and Roberto Cesar)
Lecture Notes on Artificial Intelligence, vol. 1793, pp. 127-135. Proceedings of MICAI-2000, Acapulco, Mexico, 2000. Springer-Verlag press.
Eigenfaces versus Eigeneyes: First Steps Towards Performance Assessment of Representations for Face Recognition

(with Teofilo Campos and Roberto Cesar)
Lecture Notes on Artificial Intelligence, vol. 1793, pp. 193-201. Proceedings of MICAI-2000, Acapulco, Mexico, 2000. Springer-Verlag press.