Universität zu Köln

Hoth, Jessica, Schwarz, Bjoern, Kaiser, Gabriele ORCID: 0000-0002-6239-0169, Busse, Andreas, König, Johannes ORCID: 0000-0003-3374-9408 and Blömeke, Sigrid ORCID: 0000-0001-6068-4932 (2016). Uncovering predictors of disagreement: ensuring the quality of expert ratings. ZDM-the international journal on mathematics education, 48 (1-2). S. 83 - 96. HEIDELBERG: Springer. ISSN 1863-9704

Full text not available from this repository.

Abstract

Rating scales are a popular item format used in many types of assessments. Yet, defining which rating is correct often represents a challenge. Using expert ratings as benchmarks is one approach to ensuring the quality of a rating instrument. In this paper, such expert ratings are analyzed in detail taking a video-based test instrument of teachers' professional competencies from a follow-up study to TEDS-M (the so-called TEDS-FU study) as an example. The paper focuses on those items that did NOT reach sufficient consensus among the experts and analyzes in depth their features by coding the experts' comments on those items and additionally considering their rating outcome. The results revealed that the item-wording and the composition of the group of experts strengthened or weakened agreement among the experts.

Item Type:	Journal Article
Creators:	Creators Email ORCID ORCID Put Code Hoth, Jessica UNSPECIFIED UNSPECIFIED UNSPECIFIED Schwarz, Bjoern UNSPECIFIED UNSPECIFIED UNSPECIFIED Kaiser, Gabriele UNSPECIFIED orcid.org/0000-0002-6239-0169 UNSPECIFIED Busse, Andreas UNSPECIFIED UNSPECIFIED UNSPECIFIED König, Johannes johannes.koenig@uni-koeln.de orcid.org/0000-0003-3374-9408 UNSPECIFIED Blömeke, Sigrid UNSPECIFIED orcid.org/0000-0001-6068-4932 UNSPECIFIED
URN:	urn:nbn:de:hbz:38-279421
DOI:	10.1007/s11858-016-0758-z
Journal or Publication Title:	ZDM-the international journal on mathematics education
Volume:	48
Number:	1-2
Page Range:	S. 83 - 96
Date:	2016
Publisher:	Springer
Place of Publication:	HEIDELBERG
ISSN:	1863-9704
Language:	English
Faculty:	Faculty of Human Sciences
Divisions:	Faculty of Human Sciences > Department Erziehungs- und Sozialwissenschaften > Institut für Allgemeine Didaktik und Schulforschung Weitere Institute, Arbeits- und Forschungsgruppen > Interdisziplinäres Zentrum für empirische LehrerInnen- und Unterrichtsforschung (IZeF)
Subjects:	Education
Uncontrolled Keywords:	Keywords Language KNOWLEDGE; CLASSROOM Multiple languages Education & Educational Research Multiple languages
Refereed:	Yes
URI:	http://kups.ub.uni-koeln.de/id/eprint/27942