Embedding Haptic Control Signals in Audio via Pseudo White Noise

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current headphone haptic feedback systems face challenges in providing a robust control mechanism for haptic feedback transducers, often requiring separate audio and control communication channels, which increases costs and complexity.

Innovation Solution

Embedding a haptic control signal within the audio signal in a way that it is inaudible and can be robustly recovered, sharing the audio channel to simplify design and reduce costs, using techniques such as filtering out low-frequency ranges that humans cannot hear to carry control information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate audio and control communication channels are used for haptic feedback systems, then control reliability is improved, but device complexity and cost increase

Engineering Contradiction:
Improvecontrol reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines the audio communication channel and control communication channel into a single integrated channel. The haptic control signal is embedded within the audio signal, allowing both audio playback and haptic control to be transmitted through the same wireless communication interface, thereby reducing device complexity and cost while maintaining control reliability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The audio channel is designed to serve dual purposes: delivering audio content to the user and simultaneously carrying embedded control signals for haptic feedback. This multi-functional approach eliminates the need for a separate dedicated control channel, simplifying the overall system architecture

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If separate audio and control communication channels are used, then control robustness is improved, but manufacturing cost increases

Engineering Contradiction:
Improvecontrol robustnessVSAvoidmanufacturing cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent merges the audio and control channels into one, reducing the number of required transmitters, receivers, and processing units. This consolidation directly lowers component count and manufacturing cost while the embedding technique ensures control robustness through error correction and reliable signal recovery

Inventive Principle:
Principle #5Merging (Combining)

3Device complexity

If control signal is embedded in audio signal, then device complexity is reduced, but signal recovery difficulty increases

Engineering Contradiction:
Improvesystem complexityVSAvoidsignal recovery difficulty
Core Design Contradiction:
Device complexityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent uses spreading sequences as an intermediary mechanism to embed the control signal within the audio signal. The spreading sequence modulates the control data, allowing it to be hidden within the audio spectrum. At the receiver, correlation with the known spreading sequence acts as a mediator to extract and recover the original control signal reliably, even in the presence of audio content

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms the control signal parameters by modulating them with spreading sequences and embedding them in the audio signal domain. This parameter transformation allows the control information to be conveyed through changes in the audio signal characteristics without being directly audible or interfering with audio quality

Inventive Principle:
Principle #35Parameter changes

4Manufacturing precision

If low-frequency ranges are filtered out for control information, then audio quality is preserved, but control signal bandwidth is reduced

Engineering Contradiction:
Improveaudio qualityVSAvoidcontrol signal bandwidth
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent moves the control information from the time domain to the frequency domain by using frequency-domain spreading. The control signal is embedded across the audio frequency spectrum using spreading sequences, allowing efficient utilization of available bandwidth without requiring low-frequency content, thus preserving audio quality while maintaining adequate control signal capacity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP3140718B1Scheme for embedding a control signal in an audio signal using pseudo white noise
Publication Date: 2019.01.02 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP3140718B1 patent drawingFigure 1
  • EP3140718B1 patent drawingFigure 2
  • EP3140718B1 patent drawingFigure 3A~3B

AI summary

A method includes generating an audio signal, generating a control signal that is configured to control a haptic feedback device that is incorporated into a device for delivering audio based on the audio signal to a user, and embedding the control signal in the audio signal by using a pseudorandom signal to form an encoded audio signal. Another method includes receiving a signal that includes an audio signal having an embedded control signal, recovering the control signal from the received signal by using a pseudorandom signal, using the recovered control signal to control a haptic feedback device that is incorporated into a device for delivering audio, recovering the audio signal from the received signal, and using the recovered audio signal to generate audio in the device for delivering audio. Systems perform similar steps, and non-transitory computer readable storage mediums each store one or more computer programs.