Audio-Haptic Signal Mixing to Prevent Clipping in Virtual Buttons
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing human-machine interaction (HMI) systems face challenges in providing reliable and integrated cross-modal feedback, as physical buttons are prone to reliability issues and add design constraints, while virtual buttons require additional components for audio-haptic effects.
Innovation Solution
An audio-haptic signal generator that processes audio signals based on haptic and amplifier states to mix and output combined audio-haptic signals, avoiding overdriving haptic actuators and maintaining haptic performance without the need for separate loudspeakers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If physical buttons are used for user interaction, then tactile feedback and reliability are improved, but device complexity and design constraints increase
Solution Approach 1:
The patent combines tactile haptic feedback and audio feedback into a single integrated system using one haptic actuator. The audio signal is processed and mixed with the haptic signal to drive the same actuator, creating combined audio-haptic output. This merging eliminates the need for separate physical buttons and dedicated audio components, reducing device complexity while maintaining reliability through the robustness of the integrated approach.
Solution Approach 2:
The haptic actuator is made multi-functional by enabling it to respond to both pure haptic signals and processed audio signals. The system allows the single actuator to provide both tactile feedback and audio feedback functions, replacing what would traditionally require separate physical buttons and audio output components. This universality reduces the number of components needed while maintaining the reliability of physical interaction feedback.
2Adaptability or versatility
If virtual buttons with audio-haptic feedback are implemented, then design flexibility is improved, but additional components and system complexity are required
Solution Approach 1:
The system merges audio signal processing and haptic signal generation into a single integrated pathway. The audio signal is processed through gain adjustment, time-shifting, and mixing with the haptic signal before being driven by the same haptic actuator. This combination provides design flexibility for virtual buttons while avoiding the need for separate dedicated audio output components, thereby reducing overall system complexity.
Solution Approach 2:
The haptic actuator serves multiple functions: it responds to pure haptic signals for tactile feedback, processed audio signals for audio feedback, and mixed audio-haptic signals for combined feedback. This multi-functionality enables design flexibility for various virtual button implementations while reducing the number of components required compared to traditional separate systems.
3Device complexity
If audio signal is mixed with haptic signal without processing, then system simplicity is maintained, but amplifier clipping and haptic performance degradation occur
Solution Approach 1:
The system performs preliminary processing of the audio signal before mixing it with the haptic signal. Gain adjustment is applied to the audio signal based on the characteristics of the haptic signal, and time-shifting is performed to align the audio signal with the haptic signal in time. This preliminary action prevents amplifier clipping and maintains haptic performance by ensuring the combined signal remains within operational limits.
Solution Approach 2:
The system uses feedback from the haptic signal characteristics to control the processing of the audio signal. The gain adjustment and time-shifting parameters are determined based on the instantaneous characteristics of the haptic signal, creating a feedback loop that adapts the audio signal processing to maintain optimal haptic performance and prevent clipping.
4Loss of information
If separate audio output components are added for audio-haptic feedback, then audio feedback quality is improved, but device complexity and space requirements increase
Solution Approach 1:
The haptic actuator is designed to serve dual purposes: providing tactile haptic feedback and delivering audio feedback through the same transducer. By making the actuator universal, the system eliminates the need for separate audio output components such as speakers or headphones, reducing device complexity and space requirements while still providing audible feedback through the actuator's vibration.
Solution Approach 2:
The system merges the audio feedback pathway with the haptic feedback pathway by processing the audio signal and driving it through the same haptic actuator that provides tactile feedback. This combining of pathways eliminates the need for separate audio components, reducing device complexity while maintaining audio feedback quality through the integrated audio-haptic signal processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables robust user experiences with simultaneous audio-haptic feedback for virtual buttons, enhancing reliability and design flexibility by processing audio signals to prevent amplifier clipping and maintain haptic performance.
Implementation Method 1
a haptic actuator... which may be an electrodynamic actuator such as a linear resonant actuator (LRA), or a piezo electric actuator
Implementation Method 2
the mixer is configured to mix the haptic signal and the processed audio signal and to output the mixed audio-haptic signal
Data Source
AI summary
An audio-haptic signal generator for a haptic system including an amplifier coupled to a haptic actuator is described. The audio-haptic signal generator includes an audio input configured to receive an audio signal; a haptic input configured to receive a haptic signal and a controller configured to receive to at least one of the haptic signal, an amplifier state and a haptic actuator state. A mixer is coupled to the audio input and the haptic input. The mixer has an output configured to be coupled to a haptic actuator. The controller controls the mixer to process the audio signal dependent on at least one of a characteristic of the haptic signal, an amplifier state, and a haptic actuator state. The mixer is configured to mix the haptic signal and processed audio signal on to output the mixed haptic signal and processed audio signal.