EyePiano: Leveraging Gaze For Reflective Piano Learning

Karolus, Jakob ; Sylupp, Johannes ; Schmidt, Albrecht und Woźniak, Paweł W. (2023): EyePiano: Leveraging Gaze For Reflective Piano Learning. ACM Designing Interactive Systems Conference (DIS) on Rebuilding and Resilience, Pittsburgh, USA, 10. - 14. Juli 2023. Byrne, Daragh; Martelaro, Nikolas; Boucher, Andy; Chatting, David; Alaou, Sarah Fdili; Fox, Sarah; Nicenboim, Iohanna und MacArthur, Cayley (eds.) : In: Proceedings of the 2023 ACM Designing Interactive Systems Conference, New York: Association for Computing Machinery. pp. 1209-1223

Abstract

Mastering skills which involve high dexterity, such as playing the piano, requires extensive guidance through personal teaching. Understanding how we can leverage data from sensor-based systems to improve the learning process, allows us to build interactive systems which effectively facilitate skill acquisition. To explore such possibilities, we developed EyePiano—a gaze-assisted tool for reflective piano playing. EyePiano guides the practice process of learning piano scores through analyzing the pianist’s gaze behavior. We based the design of EyePiano on requirements identified through interviews with piano teachers and a feasibility evaluation of gaze metrics. Our system illustrates that basic gaze metrics are sufficient to predict difficult regions for students. Thus, highlighting sections of the music piece which are particularly difficult for the pianist allows EyePiano to support piano rehearsals for students. Our work showcases the feasibility of using gaze data for reflective music education, enabling effective instrument practice.

• Item Type: Conference or Workshop Item (Paper)
• Faculties: Mathematics, Computer Science and Statistics > Computer Science
• Subjects: 000 Computer science, information and general works > 004 Data processing computer science; 300 Social sciences > 370 Education
• ISBN: 978-1-4503-9893-0
• Place of Publication: New York
• Language: English