Universität zu Köln

Perniss, Pamela ORCID: 0000-0002-7662-3381, Vinson, David ORCID: 0000-0002-6226-3258 and Vigliocco, Gabriella ORCID: 0000-0002-7190-3659 (2020). Making Sense of the Hands and Mouth: The Role of Secondary Cues to Meaning in British Sign Language and English. Cogn. Sci., 44 (7). HOBOKEN: WILEY. ISSN 1551-6709

Full text not available from this repository.

Abstract

Successful face-to-face communication involves multiple channels, notably hand gestures in addition to speech for spoken language, and mouth patterns in addition to manual signs for sign language. In four experiments, we assess the extent to which comprehenders of British Sign Language (BSL) and English rely, respectively, on cues from the hands and the mouth in accessing meaning. We created congruent and incongruent combinations of BSL manual signs and mouthings and English speech and gesture by video manipulation and asked participants to carry out a picture-matching task. When participants were instructed to pay attention only to the primary channel, incongruent secondary cues still affected performance, showing that these are reliably used for comprehension. When both cues were relevant, the languages diverged: Hand gestures continued to be used in English, but mouth movements did not in BSL. Moreover, non-fluent speakers and signers varied in the use of these cues: Gestures were found to be more important for non-native than native speakers; mouth movements were found to be less important for non-fluent signers. We discuss the results in terms of the information provided by different communicative channels, which combine to provide meaningful information.

Item Type:	Journal Article
Creators:	Creators Email ORCID ORCID Put Code Perniss, Pamela UNSPECIFIED orcid.org/0000-0002-7662-3381 UNSPECIFIED Vinson, David UNSPECIFIED orcid.org/0000-0002-6226-3258 UNSPECIFIED Vigliocco, Gabriella UNSPECIFIED orcid.org/0000-0002-7190-3659 UNSPECIFIED
URN:	urn:nbn:de:hbz:38-327576
DOI:	10.1111/cogs.12868
Journal or Publication Title:	Cogn. Sci.
Volume:	44
Number:	7
Date:	2020
Publisher:	WILEY
Place of Publication:	HOBOKEN
ISSN:	1551-6709
Language:	English
Faculty:	Faculty of Human Sciences
Divisions:	Faculty of Human Sciences > Department Heilpädagogik und Rehabilitation
Subjects:	Education Language, Linguistics
Uncontrolled Keywords:	Keywords Language ICONIC GESTURES; NEURAL INTEGRATION; EYE GAZE; SPEECH; WORD; COMPREHENSION; HEARING; PERCEPTION; SPEAK; BEAT Multiple languages Psychology, Experimental Multiple languages
Refereed:	Yes
URI:	http://kups.ub.uni-koeln.de/id/eprint/32757