Options
Controlling musical parameters in neurorehabilitation with a haptic finger tracker
Citation Link: https://doi.org/10.15480/882.18204
Publikationstyp
Conference Paper
Date Issued
2026
Sprache
English
TORE-DOI
Start Page
408
End Page
412
Citation
International Computer Music Conference, ICMC 2026
Contribution to Conference
Publisher Link
Peer Reviewed
true
Patients in neurorehabilitation often face not only severe motor impairments, but also associated psychological problems. Music therapy can make a valuable supplement to purely verbal psychotherapy, but its use is limited as patients often cannot play conventional musical instruments due to motor skill limitations. This can hinder the psychological recovery, where musical expression is essential. To address this, the Haptic Finger Tracker was developed, emerging from a project at the ligeti zentrum, Hamburg, a collaborative initiative where researchers and artists work on interdisciplinary projects. This paper describes a prototype that translates minimal finger movements into congruent sound and haptic sensations. Technically, the device uses flex sensors and an inertial measurement unit (IMU) to capture a range of small-scale finger movements. Using
the Open Sound Control (OSC) protocol, these captured gestures are then translated to control musical elements such as pitch, volume and arpeggios. Simultaneously, a vibrotactile actuator provides haptic feedback aimed at enhancing the user’s sense of engagement and embodiment. The resulting portable prototype provides patients with a creative outlet, fostering self-efficacy. This work establishes a technical foundation for future neurorehabilitative tools that utilize multisensory feedback to improve patient outcomes.
the Open Sound Control (OSC) protocol, these captured gestures are then translated to control musical elements such as pitch, volume and arpeggios. Simultaneously, a vibrotactile actuator provides haptic feedback aimed at enhancing the user’s sense of engagement and embodiment. The resulting portable prototype provides patients with a creative outlet, fostering self-efficacy. This work establishes a technical foundation for future neurorehabilitative tools that utilize multisensory feedback to improve patient outcomes.
Subjects
gesture-based musical control
finger tracking
multisensory interaction
vibrotactile feedback
DDC Class
616: Diseases
Funding(s)
Innovative Hochschule
More Funding Information
This research was funded under the Program ”Innovative Hochschule” (innovative university) by the Federal Ministry of Research, Technology and Space (BMFTR) of Germany (Grant No. 13IHS232C) and the City of Hamburg
Publication version
publishedVersion
Loading...
Name
Controlling_Musical_Parameters_in_Neurorehabilitation_with_a_Haptic_Finger_Tracker.pdf
Type
Main Article
Size
21.42 MB
Format
Adobe PDF