Pre-processing Channelized Music Signals for Hearing Prostheses
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Individuals with hearing loss, particularly those using cochlear implants, face challenges in perceiving and appreciating music due to the narrow frequency range and limited channels, making it difficult to distinguish and enjoy musical components like vocals and rhythm.
Innovation Solution
A method and system for pre-processing channelized music signals by extracting and weighting leading vocal, bass, and drum components, based on typical panning rules in stereo mixes, to enhance these elements relative to other instruments, creating a more accessible music experience for hearing prosthesis recipients.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If cochlear implants use narrow frequency range and limited channels to simplify device complexity, then device complexity is reduced, but music perception capability deteriorates
Solution Approach 1:
The patent applies preliminary action by pre-processing music signals before they reach the cochlear implant. The system extracts and separates musical components (vocals, rhythm, melody) in advance, then delivers them to the implant. This allows the implant to work with simplified, pre-organized signals that match its limited channels, resolving the contradiction between device simplicity and music perception capability.
Solution Approach 2:
The patent segments complex music signals into distinct musical components (vocals, rhythm, melody, harmony) that can be independently processed and delivered through the implant's limited channels. This segmentation allows the device to present organized musical information despite having fewer channels than traditional audio systems, improving music perception without increasing device complexity.
2Reliability
If cochlear implants deliver electrical stimulation to cochlea to help perceive sound, then hearing capability is improved, but music appreciation capability deteriorates due to narrow frequency range
Solution Approach 1:
The patent applies local quality by delivering different types of electrical stimulation to different regions of the cochlea based on the spectral characteristics of extracted musical components. Vocals, rhythm, and melody are delivered to specific frequency regions optimized for their temporal and spectral properties, allowing the implant to preserve music appreciation capability while maintaining reliable hearing across different musical elements.
3Ease of operation
If music signals are delivered directly to hearing prosthesis without pre-processing, then ease of operation is maintained, but music perception quality deteriorates
Solution Approach 1:
The patent implements self-service by automatically extracting and separating musical components without requiring user intervention. The system autonomously analyzes the music signal, identifies vocals, rhythm, and melody, and delivers them through appropriate channels. This maintains ease of operation while dramatically improving music perception quality, as users simply play music and the system handles all processing automatically.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for pre-processing a channelized music signal to improve perception and appreciation for a hearing prosthesis recipient. In one example, the channelized music signal is a stereo input signal. A device, such as a handheld device, hearing prosthesis, or audio cable, for example, applies a mask to a stereo input signal to extract a center-mixed component from the stereo signal and outputs an output signal comprised of a weighted combination of the extracted center-mixed component and a residual signal comprising a non-extracted part of the stereo input signal. The center-mixed component may contain components, such as leading vocals and/or drums, preferred by hearing prosthesis recipients relative to other components, such as backing vocals or other instruments.