Universität zu Köln

Grisold, Thomas, Berente, Nicholas and Seidel, Stefan ORCID: 0000-0003-2083-6510 (2025). Guardrails for Human-AI Ecologies: Norm-Based Coordination and Design for Predictability. MIS Quarterly, 49 (4). pp. 1239-1266. MISRC Management Information Systems Research Center. ISSN 0276-7783

PDF 01_tr_10.25300_misq_2025_18058.pdf Bereitstellung unter der CC-Lizenz: Creative Commons Attribution Non-commercial No Derivatives. Download (1MB)

Abstract

Human-AI ecologies involve human and AI-based agents that coordinate their interactions in part by following social norms. Social norms, therefore, are important for establishing the guardrails that ensure desirable interactions in a way that is consistent with essential values, such as human safety. Managing human-AI ecologies requires specifying norms to enable coordination in known situations but also allowing for the emergence of norms to enable coordination in unspecified, unstructured situations. We integrate predictive processing theory and social norm theory to explain how existing norms are enacted and reinforced based on agents’ predictive models and how new norms emerge as agents update their predictive models in response to prediction errors in uncertain coordination scenarios. Rooted in this perspective, we develop a design theory that emphasizes design for predictability and propose a set of design principles for managers and developers to encode norms to evolve in human-AI ecologies, monitor outcomes, and intervene when necessary.

Item Type:	Article
Creators:	Creators Email ORCID ORCID Put Code Grisold, Thomas UNSPECIFIED UNSPECIFIED UNSPECIFIED Berente, Nicholas UNSPECIFIED UNSPECIFIED UNSPECIFIED Seidel, Stefan UNSPECIFIED https://orcid.org/0000-0003-2083-6510 UNSPECIFIED
Contributors:	Contribution Name Email Redactor Majchrzak, Ann UNSPECIFIED
URN:	urn:nbn:de:hbz:38-812020
Identification Number:	10.25300/MISQ/2025/18058
Journal or Publication Title:	MIS Quarterly
Volume:	49
Number:	4
Page Range:	pp. 1239-1266
Number of Pages:	28
Date:	1 December 2025
Publisher:	MISRC Management Information Systems Research Center
ISSN:	0276-7783
Language:	English
Faculty:	Faculty of Management, Economy and Social Sciences
Divisions:	Weitere Institute, Arbeits- und Forschungsgruppen > Cologne Institute for Information Systems (CIIS) Faculty of Management, Economics and Social Sciences > Business Administration > Information Systems > Professur für Wirtschaftsinformatik
Subjects:	Data processing Computer science Economics
Uncontrolled Keywords:	Keywords Language Human-AI ecology ; unstructured coordination ; social norms ; predictive processing ; design principle English
['eprint_fieldname_oa_funders' not defined]:	Publikationsfonds UzK
Refereed:	Yes
URI:	http://kups.ub.uni-koeln.de/id/eprint/81202