Distributed Audio Processing for Earbuds via Dynamic DSP Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Audio devices face inefficiencies in battery life and resource usage due to continuous operation of resource-intensive voice-enhancement processing modes, especially when not needed, such as in environments without wind or speakers.

Innovation Solution

Implementing selective activation and deactivation of digital signal processors (DSPs) and neural networks based on environmental conditions, such as wind presence or speaker detection, to optimize processing and power usage in audio devices like earbuds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If voice-enhancement processing modes are continuously operated, then audio quality is maintained, but battery life is reduced and power consumption increases

Engineering Contradiction:
Improveaudio qualityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system dynamically adjusts the operation state of DSPs and neural networks based on real-time environmental conditions. When wind or speaker presence is detected, voice-enhancement processing is activated; otherwise, it is deactivated to save power. This dynamic adaptation resolves the contradiction by making audio processing quality conditional on actual environmental needs rather than continuous operation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameters of audio processing by switching between different states (active/inactive) of DSPs and neural networks based on environmental parameters such as wind speed and speaker presence. This parameter change allows the system to maintain audio quality when needed while reducing power consumption when environmental conditions don't require enhancement.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If voice-enhancement processing modes are continuously operated, then audio processing capability is maintained, but resource usage increases

Engineering Contradiction:
Improveaudio processing capabilityVSAvoidresource usage
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

Instead of continuous operation, the system employs periodic environmental monitoring and conditional activation of voice-enhancement processing. The DSPs and neural networks are activated only during periods when environmental conditions (wind, speaker presence) warrant enhancement, and deactivated during periods when they don't, creating a periodic on-demand operation pattern that reduces overall resource usage while maintaining capability when needed.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses its own environmental sensors (microphones, wind sensors) to automatically detect when voice-enhancement processing is needed and activates/deactivates DSPs and neural networks accordingly. This self-service mechanism eliminates the need for continuous external control while optimizing resource usage based on actual processing needs.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If environmental condition detection is implemented, then selective processing activation is enabled, but device complexity increases

Engineering Contradiction:
Improveselective processing activationVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system uses existing multi-functional components (microphones that can detect both audio input and wind noise, sensors that serve multiple detection purposes) to enable environmental condition detection without adding dedicated separate components for each function. This universal use of existing components enables selective processing activation while minimizing the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20240292151A1Distributed audio processing for audio devices
Publication Date: 2024.08.29 APPLE INC
  • US20240292151A1 patent drawing
  • US20240292151A1 patent drawing
  • US20240292151A1 patent drawing

AI summary

Implementations of the subject technology provide systems and methods for providing distributed audio processing for audio devices. Distributed audio processing may include encoding signals from multiple microphones and/or sensors, such as at a headphone or an earbud, and decoding and processing the signals on host, source, or companion device. Distributed audio processing may also include deactivating one or more digital signal processors and/or neural networks based on an operational mode of an audio device or based on a processing capability of a companion device.