Signal Processor for Synchronizing Haptic and Audio Outputs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current haptic output systems in devices like smartphones and VR/AR devices require additional programming to synchronize haptic outputs with audio and visual effects, which is time-consuming and limits the immersive user experience for applications not initially designed with haptic capabilities.
Innovation Solution
A system comprising an audio output amplifier, a haptic output amplifier, and a signal processor that analyzes audio signals to generate synchronized haptic outputs by applying delays to ensure that audio and haptic effects are experienced simultaneously, without the need for explicit haptic programming in applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If applications are designed with explicit haptic programming, then haptic output synchronization is achieved, but development time and resource requirements increase
Solution Approach 1:
The system automatically generates haptic outputs by analyzing audio signals without requiring application developers to program haptic effects. The signal processor detects audio effects and autonomously controls the haptic output transducer, making the system self-sufficient and eliminating the need for manual haptic programming in applications.
Solution Approach 2:
The audio signal serves dual purposes: it is both the audio output and the control signal for generating haptic effects. By reusing the existing audio signal processing pipeline to drive haptic output, the system achieves multi-functionality without requiring separate haptic programming in applications.
2Adaptability or versatility
If haptic outputs are added to existing applications, then multi-sensory experience is enhanced, but programming complexity increases
Solution Approach 1:
The signal processor automatically analyzes audio signals and generates corresponding haptic control signals without requiring application developers to write haptic programming code. This self-service approach allows existing applications to gain haptic capabilities without increasing programming complexity.
Solution Approach 2:
The signal processor acts as an intermediary layer between the audio processing pipeline and the haptic output transducer. It translates audio signals into haptic control signals, shielding applications from the complexity of haptic programming while enabling rich multi-sensory experiences.
3Reliability
If delay is applied to synchronize audio and haptic signals, then synchronization accuracy is improved, but signal processing complexity increases
Solution Approach 1:
The signal processor pre-calculates and applies the appropriate delay to either the audio or haptic signal based on the inherent processing delays of each output path. By determining the required delay in advance and applying it proactively, the system achieves accurate synchronization without complex real-time adjustments.
Data Source
AI summary
The present disclosure relates to a system for providing substantially synchronised haptic and audio outputs. The system includes a signal processor which is configured to receive an audio signal from a main processor of the system and to receive a haptic signal, which may be received from the main processor, or may be retrieved from memory, or else may be generated in real-time by the signal processor. The signal processor calculates a delay to be applied to the haptic signal or the audio signal and outputs a delayed version of the audio signal and the haptic signal, or a delayed version of the haptic signal and the audio signal, to appropriate output stages.