Microphone Array Orientation Audio Processing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Video telephony systems face challenges in maintaining high-quality audio communication due to static microphone and speaker configurations, leading to audio-video offset issues and increased computing and bandwidth requirements when participants reposition devices during conferencing sessions.

Innovation Solution

The system dynamically adjusts audio input and output parameters based on the orientation and position of the microphone array, using sensors and digital signal processing to optimize audio data capture and playback, reducing echo cancellation issues and bandwidth consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If static microphone and speaker configurations are used, then device structure is simple, but audio quality deteriorates when devices are repositioned during conferencing

Engineering Contradiction:

Improveaudio qualityVSAvoidmicrophone and speaker configuration

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system dynamically adjusts audio processing parameters based on the detected orientation of the display device. The microphone array and speaker output parameters are no longer static but adapt in real-time as the device is repositioned, resolving the contradiction between maintaining simple configuration and ensuring audio quality during movement

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes audio parameters (microphone array selection, equalization settings, DSP parameters, echo cancellation parameters) based on the orientation parameters detected from the display device. This allows the system to maintain audio quality by adjusting parameters according to the device's physical state without requiring complex hardware reconfiguration

Inventive Principle:

Principle #35Parameter changes

2Reliability

If all microphone inputs are processed, then audio capture quality is maintained, but computing resources and bandwidth consumption increase

Engineering Contradiction:

Improveaudio capture qualityVSAvoidcomputing resource consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

Instead of uniformly processing all microphone inputs, the system selectively processes only the audio inputs from microphones that are relevant to the current orientation. This localizes the processing effort to specific microphones based on their spatial relationship to the sound source, reducing overall computing resource consumption while maintaining audio capture quality

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The system processes only the necessary subset of microphone inputs required for optimal audio capture given the current device orientation, rather than processing all available inputs. This partial action approach reduces computing and bandwidth usage while sufficient audio quality is maintained

Inventive Principle:

Principle #16Partial or excessive action

3Adaptability or versatility

If display device is repositioned during conferencing, then user flexibility is improved, but audio-video offset issues increase

Engineering Contradiction:

Improvedevice repositioning flexibilityVSAvoidaudio-video synchronization

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The system continuously monitors the orientation of the display device and uses this feedback to dynamically adjust audio processing parameters. This closed-loop approach ensures that audio and video remain synchronized even when the device is repositioned, as the audio parameters adapt to match the new spatial configuration

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system proactively adjusts audio parameters in response to detected orientation changes before audio-video offset issues can manifest. By anticipating and pre-adjusting to spatial changes, the system maintains synchronization without requiring reactive corrections

Inventive Principle:

Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances data precision and reduces computing and bandwidth usage by constraining audio processing to only necessary inputs, providing high-quality communication experiences even when devices are repositioned during video conferencing.

Implementation Method 1

one or more sensors configured to detect an orientation of the microphone array

Methodology Applied

Scientific EffectOrientation detection:

Data Source

PatentUS11340861B2Systems, devices, and methods of manipulating audio data based on microphone orientation

Publication Date: 2022.05.24 META PLATFORMS TECHNOLOGIES LLC

AI summary

An electronic device includes a microphone array configured to capture audio data, one or more sensors configured to detect an orientation of the microphone array, and digital signal processing (DSP) logic, and an interface. The DSP logic processes, based on the orientation of the microphone array detected by the one or more sensors, the audio data captured by the microphone array to form audio input data. The interface configured to transmit the audio input data over a communications channel to be output by another electronic device.