Universität zu Köln

Lindstadt, Rene ORCID: 0000-0002-1868-6990, Proksch, Sven-Oliver ORCID: 0000-0002-6130-6498 and Slapin, Jonathan B. (2020). When Experts Disagree: Response Aggregation and its Consequences in Expert Surveys. Polit. Sci. Res. Meth., 8 (3). S. 580 - 589. CAMBRIDGE: CAMBRIDGE UNIV PRESS. ISSN 2049-8489

Full text not available from this repository.

Abstract

Political scientists use expert surveys to assess the latent features of political actors. Experts, though, are unlikely to be equally informed and assess all actors equally well. The literature acknowledges variance in measurement quality but pays little attention to the implications of uncertainty for aggregating responses. We discuss the nature of the measurement problem in expert surveys. We then propose methods to assess the ability of experts to judge where actors stand and to aggregate expert responses. We examine the effects of aggregation for a prominent survey in the literature on party politics and EU integration. Using a Monte Carlo simulation, we demonstrate that it is better to aggregate expert responses using the median or modal response, rather than the mean.

Item Type:	Journal Article
Creators:	Creators Email ORCID ORCID Put Code Lindstadt, Rene UNSPECIFIED orcid.org/0000-0002-1868-6990 UNSPECIFIED Proksch, Sven-Oliver UNSPECIFIED orcid.org/0000-0002-6130-6498 UNSPECIFIED Slapin, Jonathan B. UNSPECIFIED UNSPECIFIED UNSPECIFIED
URN:	urn:nbn:de:hbz:38-328507
DOI:	10.1017/psrm.2018.52
Journal or Publication Title:	Polit. Sci. Res. Meth.
Volume:	8
Number:	3
Page Range:	S. 580 - 589
Date:	2020
Publisher:	CAMBRIDGE UNIV PRESS
Place of Publication:	CAMBRIDGE
ISSN:	2049-8489
Language:	English
Faculty:	Unspecified
Divisions:	Unspecified
Subjects:	no entry
Uncontrolled Keywords:	Keywords Language INTERRATER RELIABILITY; AGREEMENT Multiple languages Political Science Multiple languages
URI:	http://kups.ub.uni-koeln.de/id/eprint/32850