Persona: Real-Time Neural 3D Face Reconstruction for Visual Effects on Mobile Devices

ACM Siggraph 2021 Talks

Gengdai Liu, Xiaowei Zhang, Feiqiang Zhang, Yu Wei

Bigo Technology

We present Persona, a real-time human face-oriented visual effect solution on mobile devices. Persona consists of a 3D face tracker with multi-scale reconstruction models for different-level of mobile devices and a visual effect authoring tool. Our face tracker is able to reliably predict a sequence of facial and illumination parameters from a monocular video in real-time. Those parameters can then be used to develop many interesting applications. We demonstrate that our method outperforms existing state-of-the-art work about 3D face reconstruction on mobile devices and showcase results generated by our tool.