LFE Audio Signal Frequency Shifting for Haptic Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for providing haptic effects in electronic devices require significant time and resources for authoring haptic effects, especially for long-form content, and often result in inconsistent haptic experiences due to the need to filter and extract appropriate signal components from stereo audio data.

Innovation Solution

A method that extracts the Low-Frequency Effects (LFE) audio signal from a source audio signal and converts it into a haptic signal, which can be encoded and stored or sent in real-time to haptic output devices, allowing for automatic generation of haptic effects without the need for extensive authoring, using techniques such as pitch-shifting or frequency-shifting to align frequencies with the device's capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional haptic effect authoring methods are used for long-form content, then haptic effects can be provided to users, but significant time and resources are required for authoring and the haptic experiences are inconsistent

Engineering Contradiction:
Improveconsistency of haptic experienceVSAvoidtime required for haptic effect authoring
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical process of haptic effect authoring with an automatic audio-to-haptic conversion system. The system extracts LFE audio signals and converts them to haptic signals through frequency shifting and signal processing, eliminating the need for manual haptic effect creation while ensuring consistent results across different content.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables haptic effects to generate themselves automatically from the audio content without requiring external authoring. By processing the LFE channel and converting frequencies, the system makes the haptic effects self-generating from the source material, reducing both time and resource requirements.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If stereo audio data is filtered and extracted to generate haptic effects, then haptic feedback can be provided, but the process is complex and results in inconsistent haptic experiences

Engineering Contradiction:
Improvesimplicity of haptic effect generationVSAvoidcomplexity of signal processing
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts only the essential LFE (Low Frequency Effects) channel from the audio signal, rather than processing the entire stereo audio data. This selective extraction simplifies the overall process by focusing on the most relevant frequency range for haptic conversion, reducing computational complexity while maintaining effectiveness.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system changes the frequency parameters of the extracted LFE signal through frequency shifting to match the target haptic device's operating range. This parameter transformation simplifies the conversion process by directly mapping audio frequencies to haptic frequencies, reducing the need for complex filtering and processing.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the quality of experience by providing more immersive and consistent haptic feedback, reducing the time and effort required for content creation and improving user engagement, particularly in multimedia applications.

Implementation Method 1

using techniques such as pitch-shifting or frequency-shifting to align frequencies with the device's capabilities

Methodology Applied
Scientific EffectFrequency shifting:

Implementation Method 2

converts it into a haptic signal, which can be encoded and stored or sent in real-time to haptic output devices

Methodology Applied
Scientific EffectHaptic conversion:

Data Source

PatentEP3206109B1Low-frequency effects haptic conversion system
Publication Date: 2020.03.11 IMMERSION CORP
  • EP3206109B1 patent drawingFigure 1
  • EP3206109B1 patent drawingFigure 2
  • EP3206109B1 patent drawingFigure 3~4C

AI summary

A system is provided that produces haptic effects. The system receives an audio signal that includes a low-frequency effects audio signal. The system further extracts the low-frequency effects audio signal from the audio signal. The system further converts the low-frequency effects audio signal into a haptic signal by shifting frequencies of the low-frequency effects audio signal to frequencies within a target frequency range of a haptic output device. The system further sends the haptic signal to the haptic output device, where the haptic signal causes the haptic output device to output one or more haptic effects.