Audio Haptic Conversion System Frequency Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current devices struggle to effectively convert audio signals into haptic effects, often resulting in background rumble during audio-rich experiences like games or media, as they lack the ability to distinguish between foreground and background audio events.
Innovation Solution
A system that analyzes audio signals, divides them into frequency regions, maps these regions to corresponding haptic frequency regions, and sends haptic signals to actuators to generate specific haptic effects, allowing for selective and nuanced vibrotactile feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the system converts all audio signals into haptic effects, then the haptic feedback coverage is improved, but background rumble increases and reduces haptic clarity
Solution Approach 1:
The audio signal is divided into multiple frequency bands (e.g., bass, mid-range, treble) using filter banks. Each frequency band is processed independently to generate haptic feedback, allowing selective conversion of only certain frequency ranges that are most suitable for haptic perception while filtering out background rumble frequencies.
Solution Approach 2:
Different processing strategies are applied to different frequency regions. Low-frequency bass signals are converted to haptic effects with higher intensity, while mid and high-frequency signals are either attenuated or converted with lower intensity, creating localized quality differences in the haptic output that match human tactile sensitivity characteristics.
2Productivity
If the system converts all audio frequencies to haptic signals, then audio-to-haptic conversion completeness is improved, but haptic signal complexity increases
Solution Approach 1:
The audio spectrum is segmented into discrete frequency bands, and only selected bands are converted to haptic signals. This segmentation reduces the overall complexity by eliminating the need to process the entire audio frequency range, while still maintaining conversion completeness for the most haptically relevant frequencies.
Solution Approach 2:
The system extracts only the most haptically relevant frequency components from the full audio signal for conversion. By taking out and processing only the essential frequency bands (primarily bass and low-mid ranges), the system achieves effective audio-to-haptic conversion without the computational burden of processing all frequencies.
3Adaptability or versatility
If the system provides haptic feedback for all audio events, then user engagement is improved, but foreground event distinguishability decreases
Solution Approach 1:
The system applies different haptic processing qualities to different audio events based on their frequency characteristics and importance. Foreground events with prominent bass frequencies receive enhanced haptic feedback with higher intensity and modulation, while background events receive reduced or muted feedback, creating local quality differences that improve event distinguishability while maintaining overall user engagement.
Solution Approach 2:
Instead of providing uniform haptic feedback for all audio events, the system applies partial action by selectively enhancing only the most important events. By concentrating haptic resources on foreground events with significant bass content, the system achieves better event distinguishability without completely abandoning background audio processing, thus maintaining balanced user engagement.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A haptic conversion system is provided that intercepts audio data, such as a digital audio signal, analyzes the audio data in frequency, and divides the analyzed audio data into one or more audio frequency regions, where each audio frequency region includes one or more audio sub-signals. The haptic conversion system further maps the one or more audio frequency regions to one or more haptic frequency regions, where each haptic frequency region includes one or more haptic signals. The haptic conversion system further maps the one or more haptic effects to one or more actuators. The haptic conversion system further sends the one or more haptic signals to one or more actuators, in order to generate one or more haptic effects.