Research Practices That Can Prevent an Inflation of False-Positive Rates

Murayama, Kou; Pekrun, Reinhard and Fiedler, Klaus (2014): Research Practices That Can Prevent an Inflation of False-Positive Rates. In: Personality and Social Psychology Review, Vol. 18, No. 2: pp. 107-118

Abstract

Recent studies have indicated that research practices in psychology may be susceptible to factors that increase false-positive rates, raising concerns about the possible prevalence of false-positive findings. The present article discusses several practices that may run counter to the inflation of false-positive rates. Taking these practices into account would lead to a more balanced view on the false-positive issue. Specifically, we argue that an inflation of false-positive rates would diminish, sometimes to a substantial degree, when researchers (a) have explicit a priori theoretical hypotheses, (b) include multiple replication studies in a single paper, and (c) collect additional data based on observed results. We report findings from simulation studies and statistical evidence that support these arguments. Being aware of these preventive factors allows researchers not to overestimate the pervasiveness of false-positives in psychology and to gauge the susceptibility of a paper to possible false-positives in practical and fair ways.

• Item Type: Journal article
• Form of publication: Publisher's Version
• Faculties: Psychology and Education Science > Department Psychology > Personality Psychology and Psychological Diagnostics
• Subjects: 100 Philosophy and Psychology > 150 Psychology
• ISSN: 0146-1672
• Alliance/National Licence: This publication is with permission of the rights owner freely accessible due to an Alliance licence and a national licence (funded by the DFG, German Research Foundation) respectively.
• Annotation: Article first published online: August 21, 2013
• Language: English