Haptic Effect Generation from Audio Signal Components

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing haptic feedback systems in touch-enabled devices suffer from latency issues, making the correlation between audio and haptic effects less compelling due to processing delays, resulting in suboptimal user experience.

Innovation Solution

A system and method that analyze audio signals to determine haptic effects by identifying components and synchronizing them with the audio, using sensors and haptic output devices to provide tactile feedback such as texture changes, friction variations, and obstacle simulations, allowing for real-time or pre-determined haptic effects to enhance the user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If haptic effects are processed and output simultaneously with audio effects, then the correlation between audio and haptic effects is improved, but latency in processing and outputting reduces the compelling nature of these effects

Engineering Contradiction:

Improvecorrelation between audio and haptic effectsVSAvoidlatency in processing and outputting

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of the audio signal to identify components that should be associated with haptic effects before the audio is fully processed. By determining haptic effects in advance based on audio component identification, the system reduces latency and improves the temporal correlation between audio and haptic outputs.

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If haptic effects are generated based on audio signal components, then the immersion and engagement of haptic experiences are improved, but the complexity of analyzing and synchronizing audio components increases

Engineering Contradiction:

Improveimmersion and engagement of haptic experiencesVSAvoidcomplexity of analyzing and synchronizing audio components

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The audio signal is segmented into distinct components (e.g., speech, music, sound effects) that can be independently analyzed and associated with appropriate haptic effects. This segmentation simplifies the overall processing by breaking down the complex audio signal into manageable parts, each with specific haptic associations.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different haptic effects are assigned to different components of the audio signal based on their specific characteristics. Speech components may receive one type of haptic effect while music components receive another, allowing for customized and immersive haptic experiences tailored to each audio component's nature.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS10388122B2Systems and methods for generating haptic effects associated with audio signals

Publication Date: 2019.08.20 IMMERSION CORP

AI summary

Systems and methods for generating haptic effects associated with audio signals are disclosed. One disclosed system for outputting haptic effects includes a processor configured to: receive an audio signal; determine a haptic effect based in part on the audio signal by: identifying one or more components in the audio signal; and determining a haptic effect associated with the one or more components; and output a haptic signal associated with the haptic effect.