Haptic Conversion System Audio Signal to Tactile Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current devices lack an effective method to convert audio signals into haptic effects, limiting the capability to provide immersive tactile feedback.

Innovation Solution

A haptic conversion system that intercepts audio data frames, transforms them, generates a sine carrier waveform, and mixes it with the transformed data frames to produce a modulated signal, which is then sent to an actuator to generate haptic effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If audio signals are converted into haptic effects using a simple direct mapping method, then the device complexity is reduced, but the haptic effect precision and realism deteriorate

Engineering Contradiction:
Improveconversion process complexityVSAvoidhaptic effect precision
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The audio signal processing is divided into multiple independent stages: generating maximum values from audio data frames, creating sine carrier waveforms from these maximum values, mixing the carrier waveforms with transformed audio data, and finally generating haptic effects. This segmentation allows each stage to be optimized independently, achieving high haptic precision without excessive overall system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Sine carrier waveforms are introduced as an intermediary element between the audio signal and the haptic effect generation. The carrier waveforms, generated from maximum values of audio frames, serve as a mediating signal that carries the essential characteristics of the original audio while being suitable for haptic transduction, thereby improving conversion precision without requiring direct complex mapping.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If complex signal processing is applied to convert audio to haptic effects, then the haptic effect realism is improved, but the processing time increases

Engineering Contradiction:
Improvehaptic effect realismVSAvoidsignal processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Maximum values of audio data frames are pre-calculated and stored before the actual haptic conversion process. These pre-computed maximum values serve as ready-to-use parameters for generating sine carrier waveforms, eliminating the need for real-time complex calculations during haptic output, thus reducing processing time while maintaining realism.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The conversion process operates on periodic audio data frames with fixed time intervals. By processing audio signals in regular frames and generating corresponding haptic effects periodically, the system achieves efficient real-time conversion with predictable processing timing, balancing realism with time efficiency.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the conversion of audio signals into precise haptic effects, enhancing the tactile feedback experience by utilizing actuators to produce realistic and immersive haptic sensations.

Implementation Method 1

The system further sends the haptic signal to an actuator to generate the one or more haptic effects

Methodology Applied
Scientific EffectElectromagnetic induction: Electromagnetic Induction

Data Source

PatentUS10431057B2Method, system, and device for converting audio signal to one or more haptic effects
Publication Date: 2019.10.01 IMMERSION CORP
  • US10431057B2 patent drawing
  • US10431057B2 patent drawing
  • US10431057B2 patent drawing

AI summary

A haptic conversion system is provided that intercepts frames of audio data, such as a digital audio signal, converts the frames into a haptic signal, and plays the created haptic signal through an actuator to produce haptic effects. The haptic signal is based on a maximum value of each audio data frame, which defines a magnitude of the haptic signal. The haptic signal is applied to the actuator configured to receive the haptic signal, where the actuator utilizes the haptic signal to generate the one or more haptic effects.