Audio to Haptic Conversion Using Maximum Value Envelope Modulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies do not effectively convert audio signals into haptic effects, limiting the ability to provide tactile feedback that synchronizes with audio signals in devices like mobile devices and personal computers.
Innovation Solution
A system that intercepts audio data frames, transforms them, generates a sine carrier waveform based on the maximum value, and mixes it with the transformed data frame to create a modulated signal, which is then sent to an actuator to produce haptic effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If audio signals are converted to haptic effects using conventional methods, then haptic feedback can be provided, but the haptic effects do not synchronize precisely with the audio signals and lack realism
Solution Approach 1:
The patent transforms the audio signal processing parameters by generating a maximum value envelope from the audio data frames, then using this envelope to modulate a carrier waveform at the actuator's resonant frequency. This parameter transformation enables precise synchronization between audio and haptic effects while maintaining realistic tactile feedback.
2Device complexity
If the audio signal is directly sent to the actuator, then the system is simple, but the haptic effects do not match the audio input characteristics
Solution Approach 1:
The patent introduces an intermediary processing stage that extracts the maximum value envelope from the audio signal and uses it to modulate a carrier waveform. This intermediary transformation ensures that the haptic effects accurately reflect the audio input characteristics without requiring direct coupling between audio and haptic systems.
Solution Approach 2:
The patent utilizes mechanical vibration by generating a carrier waveform at the resonant frequency of the actuator and modulating it with the audio envelope. This approach leverages the natural vibrational properties of the actuator to produce realistic haptic effects that synchronize with the audio signal.
3Productivity
If haptic effects are generated without waveform transformation, then processing is faster, but the haptic feedback lacks realism and precision
Solution Approach 1:
The patent performs preliminary action by pre-processing the audio signal to extract the maximum value envelope before modulation. This preliminary transformation prepares the audio characteristics in advance, enabling both fast processing and realistic haptic output by separating the envelope extraction from the modulation operation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables precise and realistic haptic effects that synchronize with audio signals, enhancing the user experience by providing tactile feedback that mirrors the audio input, improving interaction and immersion in devices.
Implementation Method 1
generates a carrier waveform at a resonant frequency of an actuator
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A haptic conversion system is provided that intercepts frames of audio data, such as a digital audio signal, converts the frames into a haptic signal, and plays the created haptic signal through an actuator to produce haptic effects. The haptic signal is based on a maximum value of each audio data frame, which defines a magnitude of the haptic signal. The haptic signal is applied to the actuator configured to receive the haptic signal, where the actuator utilizes the haptic signal to generate the one or more haptic effects.