Can’t Make it Better nor Worse

Pargent, Florian ; Hilbert, Sven; Eichhorn, Kathryn und Bühner, Markus (November 2019): Can’t Make it Better nor Worse. An Empirical Study About the Effectiveness of General Rules of Item Construction on Psychometric Properties. In: European Journal of Psychological Assessment, Bd. 35, Nr. 6: S. 1-9

Abstract

Some of the most popular psychological questionnaires violate general rules of item construction: precise, positively keyed items without negations, multiple aspects of content, absolute statements, or vague quantifiers. Tinvestigate if following these rules results in more desirable psychometric properties, 1,733 participants completed online either the original NEO Five-Factor Inventory, an “improved” version whose items follow the rules of item construction, or a “deteriorated” version whose items strongly violate these rules. We compared reliability estimates, item-total correlations, Confirmatory Factor Analysis (CFA) model fit, and fit to the partial credit model between the three versions. Neither of the manipulations resulted in considerable or consistent effects on any of the psychometric indices. Our results question the ability of standard analyses in test construction to distinguish good items from bad ones, as well as the effectiveness of general rules of item construction. To increase the reproducibility of psychological science, more focus should be laid on improving psychological measures.

• Dokumententyp: Zeitschriftenartikel
• Keywords: Psychometrics; item wording; psychological measurement; Five-Factor Model of personality; replication crisis
• Fakultät: Psychologie und Pädagogik > Department Psychologie > Psychologische Methodenlehre und Diagnostik
• Themengebiete: 100 Philosophie und Psychologie > 150 Psychologie
• ISSN: 1015-5759; 2151-2426
• Sprache: Englisch