Spatial Audio Control Feedback for Headset Occlusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Physical controls in consumer devices, such as headsets and mobile phones, face challenges in providing effective audio feedback due to construction restraints and occlusion issues, leading to unpredictable and unpleasant sound experiences for users.

Innovation Solution

The implementation of spatial audio cues to generate virtual control sounds through ear-worn speakers, which can mimic or augment physical sounds, providing clear and pleasant feedback to users by simulating the location and behavior of controls like buttons, sliders, and rotary knobs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If physical controls are used in head-worn devices, then user input can be received, but control sounds become muffled or unpredictable due to occlusion and construction restraints

Engineering Contradiction:
Improvecontrol sound feedbackVSAvoidocclusion effect
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent introduces speakers as an intermediary device to generate control sounds electronically, replacing reliance on physical control sounds that are affected by occlusion. The speakers act as a mediator between the control input and the user's auditory perception, delivering clear feedback without being blocked by the ear cup or headphone structure.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical sound generation from physical controls with an electronic sound generation system. Instead of relying on mechanical components to produce audible feedback, the system uses electronic signals driven to speakers to create control sounds, substituting a mechanical acoustic system with an electroacoustic system that is not subject to occlusion effects.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If control sounds are generated through speakers, then clear feedback can be provided, but the connection between physical control location and sound may be weakened

Engineering Contradiction:
Improveaudio feedback clarityVSAvoidspatial association
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent applies local quality by generating control sounds with spatial characteristics that match the physical location of the control. Each control element has its associated sound positioned in the audio field to correspond to its physical position, creating a localized auditory experience that maintains the spatial relationship between control and feedback.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent adds a spatial dimension to the control feedback by using binaural audio techniques and virtual positioning. Instead of simply playing sounds through speakers, the system creates a three-dimensional audio space where control sounds are positioned at locations corresponding to their physical controls, adding spatial localization as an additional dimension to the feedback experience.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If spatial audio cues are used to indicate control location, then feedback can be enhanced, but system complexity increases

Engineering Contradiction:
Improvefeedback intuitivenessVSAvoidspatial audio processing
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing spatial audio parameters for each control element. Instead of performing complex spatial audio calculations in real-time during control interaction, the system prepares the spatial characteristics in advance, reducing the computational burden during actual control operations and simplifying the real-time processing requirements.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the user experience by providing clear and intuitive audio feedback that correlates with control inputs, improving usability and reducing the negative effects of occlusion and unpredictable sound propagation.

Implementation Method 1

driving ear-worn speakers with driver signals that include a control sound

Methodology Applied
Scientific EffectElectroacoustic transduction:

Implementation Method 2

spatial audio techniques allow for the perception of external sound sources by using headphones to control the sound pressure at the ears of the listener

Methodology Applied
Scientific EffectBinaural spatial perception:

Implementation Method 3

Sounds produced by physical controls can interact with other components of the device (e.g., a housing, or other members of the device) and can be unpredictable. The sounds can travel from the control through the air, and/or through various mechanical members of the device before reaching the user's ears.

Methodology Applied
Scientific EffectMechanical sound propagation: Sound

Data Source

PatentUS12079542B2Augmenting control sound with spatial audio cues
Publication Date: 2024.09.03 APPLE INC
  • US12079542B2 patent drawing
  • US12079542B2 patent drawing
  • US12079542B2 patent drawing

AI summary

A headset can include left and right ear-worn speakers and a control. In response to a control input of the control, the ear-worn speakers can be driven with driver signals that include a control sound having a virtual location determined by spatial auditory cues. The control sound can indicate a behavior of the control as a result of the control input. Other aspects are also described and claimed.