Designing a Digital Flash Reading Test for Data-Based Decisions in Inclusive Classrooms: Duration and Word Length as Difficulty-Generating-Item Characteristics

Zellner, Judith ; Ebenbeck, Nikola und Gebhardt, Markus (2025): Designing a Digital Flash Reading Test for Data-Based Decisions in Inclusive Classrooms: Duration and Word Length as Difficulty-Generating-Item Characteristics. In: Education Sciences, Bd. 15, Nr. 1, 5

Abstract

Standardized assessment tools are essential for informed, data-driven decision-making. Reading speedily is a crucial early skill that all students should have the opportunity to develop in inclusive classrooms. To facilitate classroom-based reading diagnostics in this area of reading, we developed a flash reading test that reliably measures the performance of students with and without learning disabilities and intellectual disabilities. This test can be administered in the classroom and completed independently by students, taking only a few minutes, without requiring them to read aloud. The test is designed to provide an accurate assessment of the speed of lexical recall for all students. To evaluate the difficulty-generating-item characteristics of the new instrument, 400 primary and special school students participated in the test. The results indicate that students with low abilities and disabilities are particularly differentiated by the combination of a short display duration and short words. We provide information for test developers interested in designing similar assessments and teachers who can use this instrument to make informed decisions in the classroom.

• Dokumententyp: Zeitschriftenartikel
• Keywords: reading diagnostics; flash reading test; assessment; reading speed; inclusive teaching
• Fakultät: Psychologie und Pädagogik > Department Pädagogik und Rehabilitation > Abt. 3: Präventions-, Inklusions- und Rehabilitationsforschung
• Themengebiete: 300 Sozialwissenschaften > 370 Bildung und Erziehung
• Sprache: Englisch

Literaturliste

Afacan, K., & Wilkerson, K. L. (2022). Reading outcomes of students with intellectual disability on statewide assessments. Journal of Intellectual Disabilities, 26(2), 195–210.

Allor, J. H., Mathes, P. G., Roberts, J. K., Cheatham, J. P., & Champlin, T. M. (2010). Comprehensive reading instruction for students with intellectual disabilities: Findings from the first three years of a longitudinal study. Psychology in the Schools, 47(5), 445–466.

Al Otaiba, S., McMaster, K., Wanzek, J., & Zaru, M. W. (2023). What we know and need to know about literacy interventions for elementary students with reading difficulties and disabilities, including dyslexia. Reading Research Quarterly, 58(3), 313–332.

Bennett, K. J., Brown, K. S., Boyle, M., Racine, Y., & Offord, D. (2003). Does low reading achievement at school entry cause conduct problems? Social Science & Medicine, 56(11), 2443–2448.

Berendes, K., Schnitzler, C. D., Willmes, K., & Huber, W. (2010). Die Bedeutung von Phonembewusstheit und semantisch-lexikalischen Fähigkeiten für Schriftsprachleistungen in der Grundschule. Sprache Stimme Gehör, 34(2), e33–e41.

Blumenthal, Y. (2017). Ein Rahmenkonzept mit mehreren Förderebenen—Response to Intervention (RTI). In B. Hartke (Ed.), Handlungsmöglichkeiten schulische Inklusion: Das Rügener Modell kompakt (pp. 20–32). Verlag W. Kohlhammer. ISBN 978-3-17-033540-0

Carlson, D., Borman, G. D., & Robinson, M. (2011). A multistate district-level cluster randomized trial of the impact of data-driven reform on reading and mathematics achievement. Educational Evaluation and Policy Analysis, 33(3), 378–398.

Coltheart, M., Rastle, K., Perry, C., Langdon, R., & Ziegler, J. (2001). DRC: A dual route cascaded model of visual word recognition and reading aloud. Psychological Review, 108(1), 204–256.

Di Blasi, F. D., Buono, S., Cantagallo, C., Di Filippo, G., & Zoccolotti, P. (2019). Reading skills in children with mild to borderline intellectual disability: A cross-sectional study on second to eighth graders. Journal of Intellectual Disability Research, 63(9), 1023–1040.

Ebenbeck, N. (2023). Computerized adaptive testing in inclusive education [Doctoral dissertation, The University of Regensburg].

Ebenbeck, N., Jungjohann, J., Mühling, A., & Gebhardt, M. (2023). Die Bearbeitungsgeschwindigkeit von Kindern mit Lernschwierigkeiten als Grundlage für die Testentwicklung von Lernverlaufsdiagnostik. Zeitschrift für Heilpädagogik, 74(1), 29–37.

Ennemoser, M., Marx, P., Weber, J., & Schneider, W. (2012). Spezifische Vorläuferfertigkeiten der Lesegeschwindigkeit, des Leseverständnisses und des Rechtschreibens. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 44(2), 53–67.

Espin, C. A., van den Bosch, R. M., van der Liende, M., Rippe, R. C. A., Beutick, M., Langa, A., & Mol, S. E. (2021). A systematic review of CBM professional development materials: Are teachers receiving sufficient instruction in data-based decision-making? Journal of Learning Disabilities, 54(4), 256–268. [Google Scholar] [CrossRef] [PubMed]

Galuschka, K., & Schulte-Körne, G. (2015). Evidenzbasierte Interventionsansätze und forschungsbasierte Programme zur Förderung der Leseleistung bei Kindern und Jugendlichen mit Lesestörung—Ein systematischer Review. Zeitschrift für Erziehungswissenschaft, 18(3), 473–487.

Gebhardt, M., Heine, J.-H., & Sälzer, C. (2015). Schulische Kompetenzen von Schülerinnen und Schülern ohne sonderpädagogischen Förderbedarf im gemeinsamen Unterricht. Vierteljahresschrift für Heilpädagogik und ihre Nachbargebiete, 84(3), 246–258.

Gebhardt, M., Jungjohann, J., & Schurig, M. (2021). Lernverlaufsdiagnostik im förderorientierten Unterricht: Testkonstruktionen, Instrumente, Praxis. Ernst Reinhardt Verlag. ISBN 978-3-497-03053-8

Good, R. H., & Kaminski, R. A. (2002). Dynamic indicators of basic early literacy skills (6th ed.). Institute for the Development of Educational Achievement.

Grubb, J., & Young, E. L. (2024). Using screening data: Educators’ perceptions of a structured data review. Frontiers in Education, 9, 1306385.

Hasbrouck, J., & Tindal, G. A. (2006). Oral reading fluency norms: A valuable assessment tool for reading teachers. The Reading Teacher, 59(7), 636–644.

Heine, J.-H. (2023). Pairwise: Rasch model parameters by pairwise algorithm. (R package version 0.6.1-0).

Howell, K. W. (1982). MASI multilevel academic skills inventory: Math examiner’s manual. Charles E. Merrill Pub. Co.

Jungjohann, J., Ebenbeck, N., Liebers, K., Diehl, K., & Gebhardt, M. (2023). Das Lesescreening LES-IN für inklusive Grundschulklassen. Entwicklung und psychometrische Prüfung einer Paper-Pencil-Version als Basis für computerbasiertes adaptives Testen (CAT). Empirische Sonderpädagogik, 15(2), 141–156.

Jungjohann, J., Gegenfurtner, A., & Gebhardt, M. (2018). Systematisches Review von Lernverlaufsmessung im Bereich der frühen Leseflüssigkeit. Empirische Sonderpädagogik, 10(1), 100–118.

Keuning, T., van Geel, M., & Visscher, A. (2017). Why a data-based decision-making intervention works in some schools and not in others. Learning Disabilities Research & Practice, 32(1), 32–45.

Keuning, T., van Geel, M., Visscher, A., & Fox, J. P. (2019). Assessing and validating effects of a data-based decision-making intervention on student growth for mathematics and spelling. Journal of Educational Measurement, 56(4), 757–792.

Klauer, K. J. (2006). Erfassung des Lernfortschritts durch curriculumbasierte Messung. Heilpädagogische Forschung, 32(1), 16–26.

Lenhard, W. (2019). Leseverständnis und Lesekompetenz: Grundlagen—Diagnostik—Förderung (2nd ed.). Verlag W. Kohlhammer. ISBN 978-3-17-035020-5

Mendoza-Pinargote, R. L., & Reyes-Meza, O. B. (2022). Language learning in the reading comprehension of elementary school students. International Journal of Social Sciences, 5(2), 124–130.

Morrison, T. G., & Wilcox, B. (2020). Assessing expressive oral reading fluency. Education Sciences, 10(3), 59.

Mullis, I. V. S., & Martin, M. O. (2021). PIRLS 2021 assessment frameworks. International Association for the Evaluation of Educational Achievement.

Perfetti, C. (2007). Reading ability: Lexical quality to comprehension. Scientific Studies of Reading, 11(4), 357–383.

Pinnel, G. S. (1995). Listening to children read aloud: Data from NAEP’s Integrated Reading Performance Record (IRPR) at grade 4. National Center for Education Statistics, U.S. Department of Education, Office of Educational Research and Improvement. ISBN 978-0886851675

Praetorius, A.-K., Berner, V.-D., Zeinz, H., Scheunpflug, A., & Dresel, M. (2013). Judgment confidence and judgment accuracy of teachers in judging self-concepts of students. The Journal of Educational Research, 106(1), 64–76.

Ratz, C., & Lenhard, W. (2013). Reading skills among students with intellectual disabilities. Research in Developmental Disabilities, 34(5), 1740–1748.

Ratz, C., & Selmayr, A. (2023). Schriftsprachliche Kompetenzen. In D. Baumann, W. Dworschak, M. Kroschewski, C. Ratz, A. Selmayr, & M. Wagner (Eds.), Schülerschaft mit dem Förderschwerpunkt geistige Entwicklung II (SFGE II) (1st ed., pp. 117–134). W. Bertelsmann Verlag. ISBN 9783763967834

Ready, D. D., & Wright, D. L. (2011). Accuracy and inaccuracy in teachers’ perceptions of young children’s cognitive abilities. American Educational Research Journal, 48(2), 335–360.

Rosebrock, C., & Nix, D. (2017). Grundlagen der Lesedidaktik und der systematischen schulischen Leseförderung (4th ed.). Schneider Verlag Hohengehren. ISBN 978-3-8340-0314-0

Röthlisberger, M., Schneider, H., & Juska-Bacher, B. (2021). Lesen von Kindern mit Deutsch als Erst-und Zweitsprache—Wortschatz als limitierender Faktor. Zeitschrift für Grundschulforschung, 14(3), 359–374.

Schabmann, A., & Schmidt, B. (2009). Sind Lehrer gute Lese-Rechtschreibdiagnostiker? Der Einfluss von problematischem Schülerverhalten auf die Einschätzungen der Lesekompetenz durch Lehrkräfte. Heilpädagogische Forschung, 35(3), 133–145.

Schildkamp, K. (2019). Data-based decision-making for school improvement: Research insights and gaps. Educational Research, 61(3), 257–273.

Schildkamp, K., Karbautzki, L., & Vanhoof, J. (2014). Exploring data use practices around Europe: Identifying enablers and barriers. Studies in Educational Evaluation, 42, 15–24.

Schildkamp, K., Poortman, C., Luyten, H., & Ebbeler, J. (2017). Factors promoting and hindering data-based decision making in schools. School Effectiveness and School Improvement, 28(2), 242–258.

Schmitterer, A. M. A., & Brod, G. (2021). Which data do elementary school teachers use to determine reading difficulties in their students? Journal of Learning Disabilities, 54(5), 349–364.

Schwab, S., & Gasteiger-Klicpera, B. (2014). Förderung der Lesekompetenzen bei Kindern der zweiten Schulstufe—Evaluierung eines differenzierten Sprach-und Leseförderprogramms im Rahmen des Grundschulunterrichts. Zeitschrift für Bildungsforschung, 4(1), 63–79.

Silverman, R. D., Speece, D. L., Harring, J. R., & Ritchey, K. D. (2013). Fluency has a role in the simple view of reading. Scientific Studies of Reading, 17(2), 108–133.

Torgesen, J. K. (2002). The prevention of reading difficulties. Journal of School Psychology, 40(1), 7–26.

Voß, S. (2017). Datenbasierte Förderentscheidungen. In B. Hartke (Ed.), Handlungsmöglichkeiten schulische Inklusion: Das Rügener Modell kompakt (1st ed., pp. 33–56). Verlag W. Kohlhammer. ISBN 978-3-17-033540-0

Watkins, A. (2007). Assessment in inclusive settings: Key issues for policy and practice. European Agency for Development in Special Needs Education. ISBN 9788790591809