Zimmermann, Juliane T., Ellison, T. Mark ORCID: 0000-0001-7514-0612, Cangemi, Francesco ORCID: 0000-0003-1016-5178, Wehrle, Simon ORCID: 0000-0001-9715-9541, Vogeley, Kai ORCID: 0000-0002-5891-5831 and Grice, Martine ORCID: 0000-0003-4973-4059 (2024). Lookers and listeners on the autism spectrum: the roles of gaze duration and pitch height in inferring mental states. Frontiers in Communication, 9. pp. 1-17. Frontiers. ISSN 2297-900X

[thumbnail of fcomm-9-1483135.pdf] PDF
fcomm-9-1483135.pdf
Bereitstellung unter der CC-Lizenz: Creative Commons Attribution.

Download (1MB)
Identification Number:10.3389/fcomm.2024.1483135

Abstract

[Artikel-Nr.: 1483135] Although mentalizing abilities in autistic adults without intelligence deficits are similar to those of control participants in tasks relying on verbal information, they are dissimilar in tasks relying on non-verbal information. The current study aims to investigate mentalizing behavior in autism in a paradigm involving two important nonverbal means to communicate mental states: eye gaze and speech intonation. In an eye-tracking experiment, participants with ASD and a control group watched videos showing a virtual character gazing at objects while an utterance was presented auditorily. We varied the virtual character’s gaze duration toward the object (600 or 1800 ms) and the height of the pitch peak on the accented syllable of the word denoting the object. Pitch height on the accented syllable was varied by 45 Hz, leading to high or low prosodic emphasis. Participants were asked to rate the importance of the given object for the virtual character. At the end of the experiment, we assessed how well participants recognized the objects they were presented with in a recognition task. Both longer gaze duration and higher pitch height increased the importance ratings of the object for the virtual character overall. Compared to the control group, ratings of the autistic group were lower for short gaze, but higher when gaze was long but pitch was low. Regardless of an ASD diagnosis, participants clustered into three behaviorally different subgroups, representing individuals whose ratings were influenced (1) predominantly by gaze duration, (2) predominantly by pitch height, or (3) by neither, accordingly labelled “Lookers,” “Listeners” and “Neithers” in our study. “Lookers” spent more time fixating the virtual character’s eye region than “Listeners,” while both “Listeners” and “Neithers” spent more time fixating the object than “Lookers.” Object recognition was independent of the virtual character’s gaze duration towards the object and pitch height. It was also independent of an ASD diagnosis. Our results show that gaze duration and intonation are effectively used by autistic persons for inferring the importance of an object for a virtual character. Notably, compared to the control group, autistic participants were influenced more strongly by gaze duration than by pitch height.

Item Type: Article
Creators:
Creators
Email
ORCID
ORCID Put Code
Zimmermann, Juliane T.
UNSPECIFIED
UNSPECIFIED
UNSPECIFIED
Ellison, T. Mark
UNSPECIFIED
UNSPECIFIED
Cangemi, Francesco
UNSPECIFIED
UNSPECIFIED
Wehrle, Simon
UNSPECIFIED
UNSPECIFIED
Vogeley, Kai
UNSPECIFIED
UNSPECIFIED
Grice, Martine
UNSPECIFIED
UNSPECIFIED
URN: urn:nbn:de:hbz:38-817125
Identification Number: 10.3389/fcomm.2024.1483135
Journal or Publication Title: Frontiers in Communication
Volume: 9
Page Range: pp. 1-17
Number of Pages: 17
Date: 8 November 2024
Publisher: Frontiers
ISSN: 2297-900X
Language: English
Faculty: Faculty of Arts and Humanities
Faculty of Medicine
Divisions: Faculty of Medicine > Psychiatrie und Psychotherapie > Klinik und Poliklinik für Psychiatrie und Psychotherapie
Faculty of Arts and Humanities > Fächergruppe 1: Kunstgeschichte, Musikwissenschaft, Medienkultur und Theater, Linguistik, Digital Humanities > Institut für Linguistik (IfL) > Abteilung für Phonetik (PHO)
Subjects: Psychology
Language, Linguistics
Medical sciences Medicine
Uncontrolled Keywords:
Keywords
Language
autism spectrum disorder ; theory of mind ; pitch height ; eye gaze duration ; intonation ; perception and gaze behavior ; mentalizing ; adult
English
['eprint_fieldname_oa_funders' not defined]: Publikationsfonds UzK
Refereed: Yes
URI: http://kups.ub.uni-koeln.de/id/eprint/81712

Downloads

Downloads per month over past year

Altmetric

Export

Actions (login required)

View Item View Item