Audio-to-Haptic Signal Processing for Transient and Low-Frequency Response

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current haptic processing systems fail to enhance user experience due to the suppression of low frequencies and inability to handle transients effectively, leading to inadequate haptic responses, especially in the absence of adequate low-frequency components and high-frequency attenuation during signal filtering.

Innovation Solution

A haptic processing system utilizing a digital signal processing chain and analytics module that includes transient detection, dynamic processors, and resonance modules to amplify suppressed frequencies, handle transients, and dynamically update parameters in real-time for improved haptic feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If audio signal is filtered to remove high frequencies, then haptic response is improved, but high-frequency components are lost

Engineering Contradiction:
Improvehaptic response qualityVSAvoidhigh-frequency components
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent segments the audio signal processing into multiple frequency bands using bandpass filters, allowing different frequency ranges to be processed independently. This enables selective enhancement of haptic-relevant low frequencies while preserving high-frequency information for audio output, resolving the contradiction between haptic response quality and high-frequency component preservation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing stage that analyzes the audio signal across multiple frequency bands and selectively routes frequencies to appropriate output channels. This intermediary layer allows high frequencies to be preserved for audio while low frequencies are enhanced for haptic response, eliminating the need to choose between the two.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If low frequencies are amplified for haptic output, then haptic experience is enhanced, but distortion may occur

Engineering Contradiction:
Improvehaptic experience qualityVSAvoidsignal distortion
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent employs dynamic processing with adjustable gain control that adapts to the input signal characteristics. The system dynamically adjusts amplification levels based on the detected signal properties, ensuring low frequencies are enhanced for haptic experience while preventing excessive amplification that would cause distortion.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements a feedback mechanism that monitors the processed signal and adjusts amplification accordingly. This feedback loop detects when amplification is approaching distortion thresholds and automatically reduces gain, maintaining high haptic experience quality without introducing harmful distortion.

Inventive Principle:
Principle #23Feedback

3Productivity

If real-time processing is implemented, then user experience is improved, but computational complexity increases

Engineering Contradiction:
Improvereal-time haptic feedbackVSAvoidsignal processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the complex real-time processing task into separate parallel frequency band processing channels. Each bandpass filter processes a specific frequency range independently, allowing the system to achieve real-time performance through parallel computation while managing overall complexity by breaking down the processing burden.

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If multiple frequency bands are processed separately, then haptic response accuracy is improved, but processing time increases

Engineering Contradiction:
Improvehaptic response accuracyVSAvoidprocessing delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent uses periodic sampling and frame-based processing where audio signals are divided into discrete time frames. Each frame is processed through the multiple frequency bands in parallel, and results are combined periodically. This approach maintains high haptic response accuracy through detailed frequency analysis while controlling processing time through efficient periodic operation.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS10854051B2Systems and methods for transient processing of an audio signal for enhanced haptic experience
Publication Date: 2020.12.01 META PLATFORMS INC
  • US10854051B2 patent drawing
  • US10854051B2 patent drawing
  • US10854051B2 patent drawing

AI summary

Systems and methods for generating a haptic output from an audio signal having a continuous stream of sampled digital audio data are provided. A haptic processing system receives the digital audio data, analyses the digital audio data for processing and extracts haptic signals for generating a haptic effect through an actuator. The method includes passing the digital audio signal on through dynamic processor(s), adjusting the dynamic range of the digital audio signal, extracting the signal envelope of the audio data, synthesising low-frequency signals from the extracted signal envelope, and enhancing the low-frequency content using a resonator. The haptic output is generated by mixing the digital audio signal with outputs from the different modules of the haptic processing system. An analytics module monitors, controls and adjusts the processing of the digital audio signal at the noise gate module, the compressor module and the envelope module to enhance the haptic output.