Survey Mode and Data Quality

Magraw-Mickelson, Zoe ; Wang, Harry und Gollwitzer, Mario (2019): Survey Mode and Data Quality. A Cross-Cultural Comparison of Careless Responding Across Three Modes. In: Academy of Management Proceedings, Bd. 2019, Nr. 1: S. 16004

Abstract

Much psychological research depends on participants’ diligence in filling out materials such as tests or surveys. However, not all participants are motivated to respond attentively, which leads to unintended issues with the quality of the data. Our question is: how do different modes of data collection - paper/pencil, computer/web-based, and smartphone - affect participants’ diligence vs. “careless responding” tendencies and, thus, the data quality? Results from prior studies suggest that different modes of data collection produce a comparable prevalence of careless responding tendencies. However, as technology develops and data are collected with increasingly diverse populations, this question needs to be readdressed and taken further by looking at cultural differences. The present research examined the effect of survey mode on careless responding across three waves in a repeated-measures design. Following recommendations in the literature, we computed a careless responding index as a composite of eight indicators that capture aspects of a participant’s inattentiveness. In a sample of working adults from China, we found that participants were significantly more careless when completing computer/web-based survey materials than in paper/pencil mode. In a sample of German students, participants were significantly more careless when completing the paper/pencil mode compared to the smartphone mode. In a sample of Chinese-speaking students, we found no difference between the modes. This paper will discuss why these results deviate from past findings that investigated study modes and hypothesize about potential cross-cultural differences.

• Dokumententyp: Zeitschriftenartikel
• Fakultät: Psychologie und Pädagogik > Department Psychologie > Sozialpsychologie
• Themengebiete: 100 Philosophie und Psychologie > 150 Psychologie
• Sprache: Englisch