Technical Papers

Faces & Hands

Monday, 22 July 9:00 AM - 10:30 AM
Session Chair: Yaser Sheikh, Carnegie Mellon University

Online Modeling For Real-Time Facial Animation

A new algorithm for real-time face tracking on commodity RGB-D sensing devices. The method requires no user-specific training or calibration, or any other form of manual assistance, thus enabling a range of new applications in performance-based facial animation and virtual interaction at the consumer level.

Sofien Bouaziz
École Polytechnique Fédérale de Lausanne

Yangang Wang
Tsinghua University

Mark Pauly
École Polytechnique Fédérale de Lausanne

3D Shape Regression for Real-Time Facial Animation

A lightweight system for real-time facial animation capture, using only a single web camera. It requires no facial markers, effectively handles fast and large motions, deals with moderate lighting/background changes, and works well both indoors and outdoors under sunlight.

Chen Cao
Zhejiang University

Yanlin Weng
Zhejiang University

Steve Lin
Microsoft Research Asia

Kun Zhou
Zhejiang University

Real-Time Facial Animation With On-the-Fly Correctives

This depth-sensor-driven facial animation framework uses a 3D tracking model that adapts on the fly to the actor's expressions. The method is based on robust 2D feature tracking and does not require any facial calibration. The tracking fidelity is superior to existing systems, especially around eyes and lips.

Hao Li
University of Southern California, Industrial Light & Magic

Jihun Yu
Industrial Light & Magic

Yuting Ye
Industrial Light & Magic

Chris Bregler
New York University, Industrial Light & Magic

Video-Based Hand Manipulation Capture Through Composite Motion Control

A novel motion-capture method that leverages physics-based motion control to acquire high-fidelity hand grasping and manipulation data from video. The paper shows the generalization of recovered motion controllers by adapting captured motion data to new objects with different properties.

Yangang Wang
Tsinghua University

Jianyuan Min
Texas A&M University

Jianjie Zhang
Texas A&M University

Yebin Liu
Tsinghua University

Qionghai Dai
Tsinghua University

Jinxiang Chai
Texas A&M University