Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Sign In to gain access to subscriptions and/or personal tools.
Language and Speech
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Theobald, B.-J.
Right arrow Articles by Boker, S. M.
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Mapping and Manipulating Facial Expression

Barry-John Theobald

University of East Anglia, Norwich, U.K., bjt{at}cmp.uea.ac.uk

Iain Matthews

Weta Digital Ltd.,Miramar, New Zealand

Michael Mangini

University of Notre Dame, Indiana, U.S.A.

Jeffrey R. Spies

University of Virginia, Charlottesville, U.S.A.

Timothy R. Brick

University of Virginia, Charlottesville, U.S.A.

Jeffrey F. Cohn

University of Pittsburgh, Pittsburgh, U.S.A.

Steven M. Boker

University of Virginia, Charlottesville, U.S.A.

Nonverbal visual cues accompany speech to supplement the meaning of spoken words, signify emotional state, indicate position in discourse, and provide back-channel feedback. This visual information includes head movements, facial expressions and body gestures. In this article we describe techniques for manipulating both verbal and nonverbal facial gestures in video sequences of people engaged in conversation. We are developing a system for use in psychological experiments, where the effects of manipulating individual components of nonverbal visual behavior during live face-to-face conversation can be studied. In particular, the techniques we describe operate in real-time at video frame-rate and the manipulation can be applied so both participants in a conversation are kept blind to the experimental conditions.

Key Words: active appearance models • expression cloning • expression mapping

Language and Speech, Vol. 52, No. 2-3, 369-386 (2009)
DOI: 10.1177/0023830909103181
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?