Audio-to-Haptic Conversion for Hearing-Impaired Users
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Individuals with hearing impairments face challenges in fully experiencing audio data due to their inability to perceive certain frequency ranges, limiting their enjoyment of audio content like music, and existing mobile devices lack effective methods to convey this information through haptic feedback.
Innovation Solution
A method and system that convert audio data into haptic data by shifting high frequencies to lower frequencies and presenting them as vibrations, allowing hearing-impaired users to experience audio information through haptic feedback on mobile devices, utilizing both audio and haptic subsystems based on user-defined hearing profiles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If audio data is presented only through traditional audio output, then the full frequency range information is preserved, but hearing-impaired users cannot perceive certain frequency ranges
Solution Approach 1:
The system transforms audio frequency parameters by shifting high frequencies down to lower frequencies that hearing-impaired users can perceive. This parameter transformation allows the same audio content to be accessible to users with different hearing capabilities without losing the original information content.
Solution Approach 2:
The system introduces an intermediary processing stage between the audio source and the user's perception. This intermediary converts inaudible high frequencies into perceivable low frequencies, acting as a bridge that adapts the audio content to the user's hearing limitations.
2Reliability
If high frequencies are shifted to lower frequencies, then hearing-impaired users can perceive the information, but the original frequency fidelity is compromised
Solution Approach 1:
The system intentionally changes the frequency parameter from its original state to a transformed state that is perceivable by hearing-impaired users. This parameter change prioritizes accessibility over frequency fidelity, accepting the trade-off to make audio information accessible to users with hearing impairments.
3Productivity
If audio processing is performed in real-time, then user experience is enhanced, but computational resources are consumed
Solution Approach 1:
The audio processing is divided into distinct segments: frequency analysis, frequency shifting, and haptic conversion. This segmentation allows the system to process audio in manageable chunks, enabling real-time processing while optimizing computational resource usage through structured, modular operations.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables improved delivery of audible data to hearing-impaired users by converting high frequencies into vibrations, enhancing their experience of audio content in real-time and providing alerts or feedback through unique vibration patterns, thus overcoming the limitations of traditional audio-only feedback.
Implementation Method 1
a mobile phone may include a motor, e.g., a piezoelectric motor, for providing haptic feedback to a user of the mobile device
Data Source
AI summary
In general, in one aspect, a method performed by one or more processes executing on a computer systems includes receiving an audio signal comprising a range of audio frequencies including high frequencies and low frequencies, converting a first portion of the range of audio frequencies into haptic data, shifting a second portion of the range of audio frequencies down to lower audio frequencies, and presenting at least one of the converted first portion and the shifted second portion to a human user. Other implementations of this aspect include corresponding systems, apparatus, and computer program products.