Audio Enhancement Using Video-Based Microphone Position Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing audio enhancement techniques require predefined microphone positions, which limits flexibility and effectiveness when microphones are moved or repositioned, as they rely on pre-specified calculations for optimal audio capture and processing.

Innovation Solution

A system and method that uses video recognition to identify and determine the physical positions of multiple microphones relative to a camera, allowing for real-time adjustment of audio processing without pre-defined positions, enabling flexible microphone placement and enhanced audio capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If predefined microphone positions are used for audio enhancement, then audio processing calculations can be optimized, but flexibility and adaptability when microphones are moved or repositioned is reduced

Engineering Contradiction:

Improveaudio enhancement effectivenessVSAvoidmicrophone position flexibility

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system dynamically determines microphone positions using video image analysis rather than relying on static predefined positions. The processor continuously analyzes video frames to identify microphone locations and updates audio enhancement calculations in real-time, allowing the system to adapt when microphones are moved or repositioned during operation.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent replaces the mechanical/configuration-based position specification system with an optical/image-based detection system. Instead of manually specifying or pre-configuring microphone positions, the system uses video cameras and image processing algorithms to automatically detect and determine microphone locations, eliminating the need for physical reconfiguration or manual position entry.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual position specification is required for microphones, then setup process becomes complex and time-consuming, but position accuracy can be ensured

Engineering Contradiction:

Improvemicrophone position accuracyVSAvoidposition configuration complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs self-calibration and automatic position determination without requiring manual configuration. The processor automatically analyzes video images to identify microphones and calculate their positions, eliminating the need for operators to manually specify positions or perform complex setup procedures while maintaining accurate position data for audio enhancement.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent introduces video image analysis as an intermediary between the physical microphone positions and the audio processing system. Rather than directly specifying positions or reading physical coordinates, the system uses visual detection as a mediator to automatically determine microphone locations, simplifying the configuration process while maintaining precision.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Reliability

If microphones are placed at optimal positions for audio capture, then audio quality improves, but the system requires predefined knowledge of these positions

Engineering Contradiction:

Improveaudio capture qualityVSAvoidmicrophone position information

Core Design Contradiction:

ReliabilityVSLoss of information

Solution Approach 1:

The system performs preliminary position determination by analyzing video images before audio enhancement processing begins. The processor identifies microphone positions in advance and uses this information to configure audio enhancement algorithms, ensuring optimal audio capture quality from the start without requiring manual position specification or loss of position information.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS9832583B2Enhancement of audio captured by multiple microphones at unspecified positions

Publication Date: 2017.11.28 AVAYA INC

AI summary

Embodiments disclosed herein provide systems, methods, and computer readable media for steering a camera and enhancing audio captured by microphones at unspecified positions. In a particular embodiment, a method provides receiving audio captured by the plurality of microphones at a location and receiving video captured of a scene that includes the plurality of microphones captured by a first camera at a first camera position. The method further provides identifying the plurality of microphones in the scene and determining physical positions of the plurality of microphones at the location relative to the first camera position. The method then provides adjusting the audio based on the physical positions of the plurality of microphones.