Beamforming Microphone Array With Millimeter Wave Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current beamforming microphone arrays face challenges such as non-optimized beam forming parameters, difficulty in distinguishing voice from noise, and susceptibility to false positives, leading to suboptimal performance in audio conferencing systems.

Innovation Solution

A millimeter wave sensor system is integrated with a beamforming microphone array to determine user locations and adapt beamforming parameters, using a wave sensor system with a millimeter wave transmitter and receiver to generate a three-dimensional image of the area, and an adaptive beamforming circuit to modify beam characteristics based on user location and motion data, reducing noise and improving voice pickup.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If fixed beam positions are manually configured to cover likely seating areas, then beam coverage area is improved, but signal-to-noise ratio deteriorates due to large beam coverage positions

Engineering Contradiction:
Improvebeam coverage areaVSAvoidsignal-to-noise ratio
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system transitions from static manual beam configuration to dynamic beam adjustment. The beamforming system continuously adapts beam positions and shapes based on real-time detection of user locations and motion patterns, allowing beams to concentrate on actual users rather than covering large predetermined areas, thereby improving signal-to-noise ratio while maintaining appropriate coverage.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes beam parameters (position, shape, width) dynamically based on detected user characteristics. By adjusting these parameters in real-time according to user location and motion data, the system optimizes the balance between coverage area and signal quality, avoiding the fixed trade-off present in manual configuration.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If beam positions are manually configured during installation, then setup complexity is reduced, but adaptability to user movement deteriorates causing audio dropouts

Engineering Contradiction:
Improvesetup complexityVSAvoidadaptability to user movement
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system performs self-configuration by automatically detecting user locations and motion patterns, then autonomously adjusting beam parameters without requiring manual intervention. This eliminates the need for complex manual setup while simultaneously providing continuous adaptation to user movement, resolving both aspects of the contradiction.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements closed-loop feedback by continuously monitoring user positions and motion, then using this information to dynamically adjust beamforming parameters. This feedback mechanism enables the system to adapt to user movement automatically while keeping the initial setup simple, as the system self-optimizes during operation.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If dynamic beamforming algorithms are used to locate talking users, then adaptability to user position is improved, but false positives increase due to inability to distinguish voice from noise

Engineering Contradiction:
Improveadaptability to user positionVSAvoidfalse positive rate
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system employs multiple detection functions working together: motion detection to identify potential users, voice activity detection to confirm speaking users, and acoustic analysis to distinguish voice from noise. This multi-functional approach maintains high adaptability to user position while significantly reducing false positives through cross-validation of multiple signals.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces intermediate verification steps between motion detection and beam formation. By using voice activity detection and acoustic source analysis as intermediary checks, the system confirms that detected motion corresponds to actual voice sources before adjusting beams, thereby reducing false positives while maintaining adaptability.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Reliability

If sophisticated software is used to reduce false positives, then reliability is improved, but device complexity and cost increase

Engineering Contradiction:
Improvefalse positive reductionVSAvoidsoftware complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system replaces complex software-based false positive reduction with a hybrid approach combining simpler motion detection algorithms with dedicated acoustic sensors. By using multiple independent detection mechanisms rather than sophisticated single-algorithm processing, the system achieves reliable false positive reduction with lower overall complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The detection system is segmented into independent functional modules: motion detection, voice activity detection, acoustic source analysis, and beam control. Each module performs a specific function with relatively simple logic, and their combined output provides robust false positive reduction without requiring any single module to be overly complex.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enhances voice intelligibility and reduces noise interference by dynamically adjusting beam positions and shapes to focus on specific sound sources, improving overall audio conferencing quality.

Implementation Method 1

a wave sensor system with a millimeter wave transmitter and receiver to generate a three-dimensional image of the area

Methodology Applied
Scientific EffectRadar: Radar

Data Source

PatentUS11457309B2Millimeter wave sensor used to optimize performance of a beamforming microphone array
Publication Date: 2022.09.27 CRESTRON ELECTRONICS INC
  • US11457309B2 patent drawing
  • US11457309B2 patent drawing
  • US11457309B2 patent drawing

AI summary

A method for operating a beamforming microphone array for use in a predetermined area is provided herein, the method comprising: receiving acoustic audio signals at each of a plurality of microphones, converting the same to an electrical mic audio signal, and outputting each of the plurality of electrical mic audio signals; generating a user location data signal by a wave sensor system, and outputting the user location data signal, wherein the user location data signal includes location information of one or more people within the predetermined area; receiving both the user location data signal and plurality of echo-corrected mic audio signals at an adaptive beamforming device; and adapting one or more beams by the adaptive beamforming device based on the user location data signal and plurality of mic audio signals wherein each of the one or more beams acquires sound from one or more specific locations in the predetermined area.