Embedding Haptic Control Signals in Audio via Pseudorandom Noise

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer game and simulation systems face challenges in providing a robust control mechanism for haptic feedback transducers without increasing costs or degrading audio quality, particularly when separate audio and control communication channels are required.

Innovation Solution

Embedding a haptic control signal in the audio signal using pseudorandom signals to create an encoded audio signal, allowing the control information to be robustly recovered with minimal processing and without degrading audio quality, and ensuring the control signal is inaudible to the user.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate audio and control communication channels are used, then control reliability is improved, but device complexity and cost increase

Engineering Contradiction:
Improvecontrol reliabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the audio signal and haptic control signal into a single audio channel by embedding the control signal within the audio signal using spread spectrum modulation. This eliminates the need for separate control communication channels while maintaining reliable control transmission to haptic feedback devices.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The audio channel is made multi-functional by simultaneously carrying both audio information and haptic control information. The spread spectrum modulation allows the same channel to serve dual purposes: delivering audio to the user and delivering control commands to haptic devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If control signal is embedded in audio signal, then device complexity is reduced, but control signal may be audible to user

Engineering Contradiction:
Improvedevice complexityVSAvoidaudible control signal
Core Design Contradiction:
Device complexityVSObject-affected harmful factors

Solution Approach 1:

The patent applies spread spectrum modulation which changes the frequency parameters of the control signal across a wide bandwidth. This frequency spreading allows the control signal to be embedded within the audio signal's frequency spectrum without creating audible artifacts, as the energy is distributed across many frequency components rather than concentrated at audible frequencies.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If control signal is embedded in audio signal, then cost is reduced, but audio quality may be degraded

Engineering Contradiction:
ImprovecostVSAvoidaudio quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by selectively embedding the control signal in specific portions of the audio signal's frequency spectrum. The spread spectrum modulation distributes the control signal energy across the frequency spectrum in a way that does not interfere with the local audio quality at any particular frequency, allowing both audio and control signals to coexist without mutual degradation.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9928728B2Scheme for embedding a control signal in an audio signal using pseudo white noise
Publication Date: 2018.03.27 SONY INTERACTIVE ENTERTAINMENT LLC
  • US9928728B2 patent drawing
  • US9928728B2 patent drawing
  • US9928728B2 patent drawing

AI summary

A method includes generating an audio signal, generating a control signal that is configured to control a haptic feedback device that is incorporated into a device for delivering audio based on the audio signal to a user, and embedding the control signal in the audio signal by using a pseudorandom signal to form an encoded audio signal. Another method includes receiving a signal that includes an audio signal having an embedded control signal, recovering the control signal from the received signal by using a pseudorandom signal, using the recovered control signal to control a haptic feedback device that is incorporated into a device for delivering audio, recovering the audio signal from the received signal, and using the recovered audio signal to generate audio in the device for delivering audio. Systems perform similar steps, and non-transitory computer readable storage mediums each store one or more computer programs.