Real-time Facial Animation with Image-based Dynamic Avatars

最新推荐文章于 2024-03-22 09:44:59 发布

原创

最新推荐文章于 2024-03-22 09:44:59 发布 · 1.6k 阅读

1 ·

CC 4.0 BY-SA版权

该研究提出了一种实现实时面部动画的方法，利用基于图像的动态化身技术。通过用户头部不同姿态和表情的图像，构建头部混合形状和可变形毛发模型。在运行时，使用单摄像头面部跟踪器驱动化身，实现精细细节的实时人脸动画。包括图像预处理、脸部混合形状、可变形毛发模型、眼睛、牙齿和身体处理以及实时动画等关键步骤。

Chen Cao, Hongzhi Wu, Yanlin Weng, Tianjia Shao, Kun Zhou, "Real-time Facial Animation with Image-based Dynamic Avatars", ACM Trans. on Graphics (SIGGRAPH), 2016.

构建和使用基于图像的动态化身的pipeline：（1）image acquisition, （2）avatar construction （3） real-time animation

Overview of our pipeline. From captured images of the user that sparsely sample over head poses and expressions, we build a head blendshape and a morphable hair model to represent the corresponding coarse geometry. Other components such as eyes and teeth are expressed as billboards. During runtime, an actor can drive our avatar using a single-camera-based face tracker. The captured images are warped and blended under the guidance of the coarse geometry to generate real-time facial animation with fine-scale details.

从稀疏采样用户头部姿态和表情的捕获图