Skip to search boxSkip to navigationSkip to main content

Multisensory Integration Design in Music for Cochlear Implant Users

  • ,
  • Francesco Ganis
    ,
  • Razvan Paisa
    ,
  • Peter Williams
    ,
  • Stefania Serafin
  • Standford University
    ,
  • Aalborg University
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-review

Open access

Publication Information

Output type

Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-review

Original language

English

Publication milestones

  • Published - 07/06/2022

Publication status

Published - 07/06/2022

Publication IDs

  • ORCID: /0000-0003-0169-2945/work/153874113
  • Scopus: 85137719149

Host publication title

Proceedings of Sound and Music Computing Conference

Abstract

Cochlear implant (CI) users experience several challenges when listening to music. However, their hearing abilities are greatly diverse and their musical experiences may significantly vary from each other. In this research, we investigate this diversity in CI users' musical experience, preferences, and practices. We integrate multisensory feedback into their listening experiences to support the perception of specific musical features and elements. Four installations are implemented, each exploring a different sensory modality assisting or supporting CI users' listening experience. We study these installations throughout semi-structured and exploratory workshops with participants. We report the results of our process-oriented assessment of CI users' experience with music. Because the CI community is a minority participant group in music, musical instrument design frameworks and practices vary from those of hearing cultures. We share guidelines for designing multisensory integration that derived from our studies with individual CI users and specifically aimed to enrich their experiences.

Publication metrics

PlumX, opens in new tab

Citations
2
Captures
6

Related Event

Title

Sound and Music Computing Conference

Event type

Conference

Degree of recognition

International event

Date

04/06/2022 - 12/06/2022

Location

Saint-EtienneFrance