Audiovisual speech: the role of visual cues in the perception of phones and tones

Cottrell, D., Grimsgaard, C., and Burnham, D. (2008) Audiovisual speech: the role of visual cues in the perception of phones and tones. In: Australian Journal of Psychology: combined abstracts of 2008 psychology conferences: the abstracts of the 35th Australasian experimental psychology conference (60) p. 65. From: EPC08: 35th Australasian Experimental Psychology Conference, 28-30 March 2008, Fremantle, WA, Australia.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: http://dx.doi.org/10.1080/00049530802385...
 
9


Abstract

There is evidence that visual concomitants of articulation facilitate speech perception. Specifically, the results of a study examining Cantonese phone and tone discrimination showed that Australian non-tonal language speakers were able to discriminate phones (consonants and vowels) on the basis of rigid head motion alone. Conversely, neither rigid head motion nor non-rigid face motion alone was sufficient for the visual perception of tones. However, participants in this experiment were non-tone language speakers with normal hearing. If visual information for tone is a general language phenomenon, augmentation may be graded in terms of familiarity of attending to visual cues. Thus, in order to determine the nature of the visual concomitants of tone, research needs to be conducted with people experienced in attending to visual cues. The aim of the present study was to explore the relationship between rigid and non-rigid head motion and the perception of phones and tones by using a hearing impaired population. An experiment was designed using Cantonese words to explore the visual concomitants of phones and tones across three different modalities (Audio Only, Visual Only and Auditory Visual) and three movement types (rigid, non-rigid, and combined). Preliminary results indicate the existence of visual information for phones and tones.

Item ID: 17550
Item Type: Conference Item (Poster)
ISSN: 1742-9536
Related URLs:
Additional Information:

Cottrell, D., Grimsgaard, C., and Burnham, D. (2008) Audiovisual speech: the role of visual cues in the perception of phones and tones. In: Australian Journal of Psychology, 60 (S1: Combined Abstracts of 2008 Psychology Conferences: the abstracts of the 35th Australasian experimental psychology conference): p. 65. doi: 10.1080/00049530802385541.

Date Deposited: 23 Nov 2011 06:19
FoR Codes: 17 PSYCHOLOGY AND COGNITIVE SCIENCES > 1702 Cognitive Science > 170204 Linguistic Processes (incl Speech Production and Comprehension) @ 100%
SEO Codes: 97 EXPANDING KNOWLEDGE > 970117 Expanding Knowledge in Psychology and Cognitive Sciences @ 100%
Downloads: Total: 9
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page