Haptic Conversion System Using Audio Amplitude

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current devices lack the capability to effectively convert audio signals into haptic effects, limiting the integration of tactile feedback in multimedia experiences.

Innovation Solution

A haptic conversion system that intercepts audio data frames, calculates a maximum value, and generates a haptic signal based on this value to produce haptic effects through an actuator, utilizing a processor, memory, and modules like reverb and boombox to control the actuator's output.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If audio signals are converted into haptic effects using a haptic conversion system, then tactile feedback capability is improved, but device complexity increases

Engineering Contradiction:
Improvetactile feedback capabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a haptic conversion system that acts as an intermediary between the audio processing pipeline and the haptic actuator. This intermediary captures audio data frames, processes them through a haptic conversion module, and generates haptic signals without requiring fundamental changes to the existing audio hardware or actuator design.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The haptic conversion system is designed to work with existing audio playback infrastructure, allowing the same audio data frames used for speaker output to also drive haptic effects. This multi-functionality enables tactile feedback without adding separate audio processing pathways.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If haptic signals are generated from audio data frames, then haptic effect quality is improved, but processing time increases

Engineering Contradiction:
Improvehaptic effect qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system extracts haptic parameters from audio data frames in real-time as they are being processed for audio output. By performing the haptic conversion simultaneously with audio decoding rather than as a separate post-processing step, the system prepares haptic signals in advance without adding sequential processing delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The haptic conversion module is integrated into the existing audio processing pipeline, merging the haptic signal generation function with the audio decoding process. This consolidation allows both audio and haptic data to be prepared from the same audio frames without requiring duplicate processing.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If maximum value calculation is used to generate haptic signals, then haptic signal accuracy is improved, but computational load increases

Engineering Contradiction:
Improvehaptic signal accuracyVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system extracts only the maximum value parameter from each audio data frame for haptic signal generation, rather than processing the entire audio waveform. This extraction approach captures the essential amplitude information needed for haptic feedback while discarding redundant data, reducing computational requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The haptic conversion module transforms the audio signal by changing its parameter representation from a full waveform to a single maximum amplitude value per frame. This parameter transformation simplifies the data structure while preserving the critical information needed to drive haptic actuators effectively.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the conversion of audio signals into rich haptic experiences, enhancing user interaction by providing tactile feedback that complements audio content, improving engagement and immersion in multimedia applications.

Implementation Method 1

The system further sends the haptic signal to an actuator to generate the one or more haptic effects

Methodology Applied
Scientific EffectElectromagnetic induction: Electromagnetic Induction

Data Source

PatentUS9448626B2Sound to haptic effect conversion system using amplitude value
Publication Date: 2016.09.20 IMMERSION CORP
  • US9448626B2 patent drawing
  • US9448626B2 patent drawing
  • US9448626B2 patent drawing

AI summary

A haptic conversion system is provided that intercepts frames of audio data, such as a digital audio signal, converts the frames into a haptic signal, and plays the created haptic signal through an actuator to produce haptic effects. The haptic signal is based on a maximum value of each audio data frame, which defines a magnitude of the haptic signal. The haptic signal is applied to the actuator configured to receive the haptic signal, where the actuator utilizes the haptic signal to generate the one or more haptic effects.