A survey of Shading Techniques for Facial Deformations on Sign Language Avatars

Ronan Johnson, Rosalee Wolfe


Abstract
Of the five phonemic parameters in sign language (handshape, location, palm orientation, movement and nonmanual expressions), the one that still poses the most challenges for effective avatar display is nonmanual signals. Facial nonmanual signals carry a rich combination of linguistic and pragmatic information, but current techniques have yet to portray these in a satisfactory manner. Due to the complexity of facial movements, additional considerations must be taken into account for rendering in real time. Of particular interest is the shading areas of facial deformations to improve legibility. In contrast to more physically-based, compute-intensive techniques that more closely mimic nature, we propose using a simple, classic, Phong illumination model with a dynamically modified layered texture. To localize and control the desired shading, we utilize an opacity channel within the texture. The new approach, when applied to our avatar “Paula”, results in much quicker render times than more sophisticated, computationally intensive techniques.
Anthology ID:
2020.signlang-1.17
Volume:
Proceedings of the LREC2020 9th Workshop on the Representation and Processing of Sign Languages: Sign Language Resources in the Service of the Language Community, Technological Challenges and Application Perspectives
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Eleni Efthimiou, Stavroula-Evita Fotinea, Thomas Hanke, Julie A. Hochgesang, Jette Kristoffersen, Johanna Mesch
Venue:
SignLang
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
107–112
Language:
English
URL:
https://aclanthology.org/2020.signlang-1.17
DOI:
Bibkey:
Cite (ACL):
Ronan Johnson and Rosalee Wolfe. 2020. A survey of Shading Techniques for Facial Deformations on Sign Language Avatars. In Proceedings of the LREC2020 9th Workshop on the Representation and Processing of Sign Languages: Sign Language Resources in the Service of the Language Community, Technological Challenges and Application Perspectives, pages 107–112, Marseille, France. European Language Resources Association (ELRA).
Cite (Informal):
A survey of Shading Techniques for Facial Deformations on Sign Language Avatars (Johnson & Wolfe, SignLang 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.signlang-1.17.pdf