Universität zu Köln

Brands, Angela Mariele ORCID: 0000-0003-0422-8160, Mathar, David ORCID: 0000-0003-3411-7867 and Peters, Jan ORCID: 0000-0002-0195-5357 (2025). Signatures of Perseveration and Heuristic-Based Directed Exploration in Two-Step Sequential Decision Task Behaviour. Computational Psychiatry, 9 (1). pp. 39-62. MIT Press. ISSN 2379-6227

PDF 67ab1b5fd8331.pdf Bereitstellung unter der CC-Lizenz: Creative Commons Attribution. Download (2MB)

Abstract

Processes formalized in classic Reinforcement Learning (RL) theory, such as model-based (MB) control and exploration strategies have proven fertile in cognitive and computational neuroscience, as well as computational psychiatry. Dysregulations in MB control and exploration and their neurocomputational underpinnings play a key role across several psychiatric disorders. Yet, computational accounts mostly study these processes in isolation. The current study extended standard hybrid models of a widely-used sequential RL-task (two-step task; TST) employed to measure MB control. We implemented and compared different computational model extensions for this task to quantify potential exploration mechanisms. In two independent data sets spanning two different variants of the task, an extension of a classical hybrid RL model with a heuristic-based exploration mechanism provided the best fit, and revealed a robust positive effect of directed exploration on choice probabilities in stage one of the task. Posterior predictive checks further showed that the extended model reproduced choice patterns present in both data sets. Results are discussed with respect to implications for computational psychiatry and the search for neurocognitive endophenotypes.

Item Type:	Article
Creators:	Creators Email ORCID ORCID Put Code Brands, Angela Mariele UNSPECIFIED https://orcid.org/0000-0003-0422-8160 UNSPECIFIED Mathar, David UNSPECIFIED https://orcid.org/0000-0003-3411-7867 UNSPECIFIED Peters, Jan UNSPECIFIED https://orcid.org/0000-0002-0195-5357 UNSPECIFIED
URN:	urn:nbn:de:hbz:38-791546
Identification Number:	10.5334/cpsy.101
Journal or Publication Title:	Computational Psychiatry
Volume:	9
Number:	1
Page Range:	pp. 39-62
Date:	11 February 2025
Publisher:	MIT Press
ISSN:	2379-6227
Language:	English
Faculty:	Faculty of Human Sciences
Divisions:	Faculty of Human Sciences > Department Psychologie
Subjects:	Psychology
['eprint_fieldname_oa_funders' not defined]:	Publikationsfonds UzK
Refereed:	Yes
URI:	http://kups.ub.uni-koeln.de/id/eprint/79154