Lightweight wrinkle synthesis for 3D facial modeling and animation

• DOI: 10.1016/j.cad.2014.08.016
• Publication Date: 2014-08-21T10:48:39Z
• Authors: Jun Li; Weiwei Xu; Zhiquan Cheng; Kai Xu; Reinhard Klein
• Keywords: 0202 electrical engineering, electronic engineering, information engineering; 02 engineering and technology

We present a lightweight non-parametric method to generate wrinkles for 3D facial modeling and animation. The key lightweight feature of the method is that it can generate plausible wrinkles using a single low-cost Kinect camera and one high quality 3D face model with details as the example. Our method works in two stages: (1) offline personalized wrinkled blendshape construction. User-specific expressions are recorded using the RGB-Depth camera, and the wrinkles are generated through example-based synthesis of geometric details. (2) Online 3D facial performance capturing. These reconstructed expressions are used as blendshapes to capture facial animations in real-time. Experiments on a variety of facial performance videos show that our method can produce plausible results, approximating the wrinkles in an accurate way. Furthermore, our technique is low-cost and convenient for common users. We present a lightweight non-parametric approach to generate wrinkles for 3D facial modeling and animation.Our method represents a convenient approach for generating plausible facial wrinkles with low-cost.Our method enables the reconstruction of captured expressions with wrinkles in real-time.