The process of generating facial models and various poses of these models is a necessary part of most present-day movies, and usually required for any interactive game which features humans as a primary character. The generation of this face data can be approached in ways varying from pure computation to pure data acquisition. Computational models are flexible but can lack realism and intuitive or simple controls, while data-driven models produce realistic faces, but necessitate the often slow and cumbersome capture of new scan data for every desired set of face attributes. Our method is a hybrid approach, which combines a relatively small set of real world facial data with a computational algorithm that learns the underlying variations in this geometric information automatically. Given a sparse data set that spans variation in viseme, face type, and expression, we are able to generate new faces that exhibit combinations of these attributes, and were never part of the original data set. We rely on user-assisted categorization of our sparse data set to associate each piece of face data with a small set of attribute contributions, and then use this categorization data as a guide for binding abstract variation to concrete parameters. This process takes the complex, subtle, and often subjective qualities associated with visemes, expressions, and face types, and correlates them to known geometric features, in order to facilitate the creation of entirely new face poses.

• Click here to download a viewer that lets you explore the space of type, expression and visemes generated with the dataset described in our paper.
  • This demo requires Windows XP or above to run. It is also a CPU-intensive application, and therefore requires a modern CPU (Pentium 4 or above) for smooth real-time deformation.
  • To run the application, double click the “proj.exe” program.

• Youtube link to video (for fullscreen viewing)

• Download a pdf of the paper here.

• Skorupski, J., Yee, J., McCoy, J., and Davis, J. 2007. Facial type, expression, and viseme generation. In ACM SIGGRAPH 2007 Posters (San Diego, California, August 05 - 09, 2007). SIGGRAPH '07. ACM, New York, NY, 34.