This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Scarborough, R. Articles by Alwan, A. Search for Related Content Social Bookmarking                         What's this?

Optical Phonetics and Visual Perception of Lexical and Phrasal Stress in English

University of Colorado, U.S.A., rebecca.scarborough{at}colorado.edu

Patricia Keating

UCLA, U.S.A.

Sven L. Mattys

University of Bristol, U.K.

Taehong Cho

Hanyang University, Korea

Abeer Alwan

UCLA, U.S.A.

In a study of optical cues to the visual perception of stress, three American English talkers spoke words that differed in lexical stress and sentences that differed in phrasal stress, while video and movements of the face were recorded. The production of stressed and unstressed syllables from these utterances was analyzed along many measures of facial movement, which were generally larger and faster in the stressed condition. In a visual perception experiment, 16 perceivers identified the location of stress in forced-choice judgments of video clips of these utterances (without audio). Phrasal stress was better perceived than lexical stress. The relation of the visual intelligibility of the prosody of these utterances to the optical characteristics of their production was analyzed to determine which cues are associated with successful visual perception. While most optical measures were correlated with perception performance, chin measures, especially Chin Opening Displacement, contributed the most to correct perception independently of the other measures. Thus, our results indicate that the information for visual stress perception is mainly associated with mouth opening movements.

Key Words: audiovisual speech • lexical stress • phrasal stress • visual prosody • visual speech perception

Language and Speech, Vol. 52, No. 2-3, 135-175 (2009)
DOI: 10.1177/0023830909103165


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?