Audio Envelope Processing for Haptic Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing haptic feedback systems in touch-enabled devices suffer from latency issues, resulting in less compelling haptic effects when synchronized with audio signals, as they struggle to accurately process and output haptic sensations in real-time.
Innovation Solution
A system and method that determine an envelope of an audio signal using methods A or B, where method A involves Fast Fourier Transform and method B involves power spectral density processing, to generate haptic effects such as texture changes, friction variations, and boundary simulations on a touch surface, synchronized with audio signals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional haptic feedback systems are used to synchronize with audio signals, then haptic effects are generated, but latency occurs resulting in less compelling haptic effects
Solution Approach 1:
The system performs preliminary processing by determining the envelope of the audio signal in advance, which allows the haptic feedback to be generated with reduced latency and improved synchronization accuracy with the audio playback
2Measurement precision
If envelope determination is performed using Fast Fourier Transform or power spectral density methods, then haptic effects are accurately correlated with audio signals, but processing complexity increases
Solution Approach 1:
The system changes the parameter representation by using envelope determination through Fast Fourier Transform or power spectral density methods, which provides accurate correlation between haptic effects and audio signals while managing processing complexity through efficient algorithm selection
Data Source
Figure 1A
Figure 1B~1C
Figure 2A~2B
AI summary
Systems and methods for generating haptic effects associated with envelopes in audio signals are disclosed. One disclosed system for outputting haptic effects includes a processor configured to: receive an audio signal (402); determine an envelope associated with the audio signal (404); determine a haptic effect based in part on the envelope (406); and output a haptic signal associated with the haptic effect (408).