Link Search Menu Expand Document

Performance Driven Animated Faces

Here are some notes gathered to understand how to understand and create facial animations for the ARENA with blendshapes and other model formats.




How do we get models into the ARENA?

  1. Models are ASCII FBX with text file for the rigging sequence.
  2. Convert ASCII FBX -> Binary FBX with:
  3. AutoDesk FAILED?! Use this instead:
  4. Convert Binary FBX to GLTF with blendshape animations:


How do we go from landmarks to expressions?



[1] Lewis, J.P., Anjyo, K., Rhee, T., Zhang, M., Pighin, F.H., & Deng, Z. (2014). Practice and Theory of Blendshape Facial Models. Eurographics.

[2] Alkawaz, M.H., Mohamad, D.B., Basori, A.H., & Saba, T. (2015). Blend Shape Interpolation and FACS for Realistic Avatar. 3D Research, 6, 1-10.

[3] Dutreve, L., Meyer, A., & Bouakaz, S. (2008). Feature points based facial animation retargeting. Virtual Reality Software and Technology.

[4] Wu, Y., & Ji, Q. (2018). Facial Landmark Detection: A Literature Survey. International Journal of Computer Vision, 127, 115-142.