Auditory-Motor Coupling Techniques for Movement Learning through an Immersive Rhythm-Based Serious Game

Auditory information plays a significant role in movement execution. Real-time sound feedback of movement known as sonification, and synchronization of movements to external rhythmic cues have been shown to enhance motor performance by improving coordination, increasing temporal accuracy, and strengthening movement awareness. In parallel, serious games have emerged as accessible tools for motor training, using immersive interfaces to motivate repeated practice. The present study examined the effects of four groups differing in auditory-motor coupling techniques: synchronization, sonification, combined (synchronization + sonification), and a no-sound control, on motor learning of a finger-pinch sequence using Pizzicato, an immersive rhythm-based serious game. Outcomes of interest included motor learning gains in accuracy and timing precision, reliance on auditory stimuli, and intrinsic motivation. A mixed longitudinal design was employed with 47 healthy adults (aged 17-50 years), who...Show moreAuditory information plays a significant role in movement execution. Real-time sound feedback of movement known as sonification, and synchronization of movements to external rhythmic cues have been shown to enhance motor performance by improving coordination, increasing temporal accuracy, and strengthening movement awareness. In parallel, serious games have emerged as accessible tools for motor training, using immersive interfaces to motivate repeated practice. The present study examined the effects of four groups differing in auditory-motor coupling techniques: synchronization, sonification, combined (synchronization + sonification), and a no-sound control, on motor learning of a finger-pinch sequence using Pizzicato, an immersive rhythm-based serious game. Outcomes of interest included motor learning gains in accuracy and timing precision, reliance on auditory stimuli, and intrinsic motivation. A mixed longitudinal design was employed with 47 healthy adults (aged 17-50 years), who were randomized to one of the four conditions. Participants completed a baseline assessment (pre-test), followed by three weeks of home-based training (three sessions per week), and a post-test assessment. Motor learning was operationalized as pre- to post-test changes in accuracy and timing precision, with baseline performance included as a covariate. Reliance on auditory feedback was assessed using a no-sound trial administered at post-test. Intrinsic motivation was measured using the interest/enjoyment subscale of the Intrinsic Motivation Inventory, based on pre- to post-test changes. Results revealed no statistically significant differences between groups for motor learning gains (p = .688), reliance on auditory stimuli for accuracy (p = .286) or timing precision (p = .515), or intrinsic motivation ratings (p = .720). These findings suggest that, within the present training context, auditory stimuli did not exert an additive effect on motor learning of a finger-pinch sequence training using a serious game. Instead, visuo-spatial information, task difficulty, training intensity, and individual participant characteristics may have played a more prominent role than auditory stimuli alone. Nevertheless, to our knowledge this study is the first to directly compare different auditory-motor coupling techniques within the same methodological framework. Further research is required to clarify the conditions under which auditory-motor coupling can effectively support motor learning, particularly through designs incorporating adaptive difficulty, controlled visual input, and qualitative measures.Show less

Leiden University Student Repository

Documents

In Collections

Auditory-Motor Coupling Techniques for Movement Learning through an Immersive Rhythm-Based Serious Game