Microphone Array Sound Direction Detection for Videoconference Speaker Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing television conference systems require a microphone for each attendee to display sound levels, making it cumbersome to prepare for varying numbers of participants.

Innovation Solution

An image processing apparatus using a microphone array to detect sound direction and specify the currently speaking user, generating an image signal that reflects sound levels without the need for individual microphones, by combining sound and image data to display sound levels near the user in the captured image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a microphone is provided for each attendant to display sound levels, then the sound level for each user can be accurately displayed, but the device complexity and preparation burden increase significantly

Engineering Contradiction:
Improvesound level detection accuracyVSAvoidmicrophone quantity and setup complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple microphones into a microphone array that works together as a single unit. Instead of using individual microphones for each user, the array processes sounds collectively to determine direction and sound levels, reducing the number of separate devices needed while maintaining detection accuracy

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The microphone array serves multiple functions: it detects sound levels, determines sound direction, and identifies which user is speaking. This multi-functional approach replaces the need for dedicated microphones for each user, simplifying the overall system while achieving the same goals

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If individual microphones are prepared for each user, then sound levels can be tracked per user, but the ease of operation deteriorates when the number of participants varies

Engineering Contradiction:
Improveper-user sound level trackingVSAvoidsetup convenience for varying participant numbers
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system dynamically adapts to the number of users present by using direction-of-arrival estimation. The microphone array automatically adjusts to identify and track sounds from different directions, allowing the system to handle varying numbers of participants without requiring manual reconfiguration or additional microphones

Inventive Principle:
Principle #15Dynamics

3Device complexity

If a microphone array is used instead of individual microphones, then the device complexity is reduced, but the difficulty of detecting and measuring sound direction increases

Engineering Contradiction:
Improvemicrophone system simplicityVSAvoidsound direction detection
Core Design Contradiction:
Device complexityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent replaces complex mechanical direction-finding mechanisms with signal processing algorithms. Instead of using physical mechanisms to determine sound direction, the system uses electronic signal processing on the outputs from the microphone array to estimate the direction of arrival, simplifying the physical system while achieving accurate direction detection

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables effective display of sound levels for each user during videoconferences, allowing participants to identify the speaker without the need for multiple microphones, enhancing user comfort and conference efficiency.

Implementation Method 1

a microphone array that collects sounds including the sounds output by the user

Methodology Applied
Scientific EffectSound: Sound

Data Source

PatentUS9008320B2Apparatus, system, and method of image processing, and recording medium storing image processing control program
Publication Date: 2015.04.14 RICOH CO LTD
  • US9008320B2 patent drawing
  • US9008320B2 patent drawing
  • US9008320B2 patent drawing

AI summary

An image processing apparatus receives sound signals that are respectively output by a plurality of microphones, and detects a sound arrival direction from which sounds of the sound signals are traveled. The image processing apparatus calculates a sound level of sounds output from the sound arrival direction, and causes an image that reflects the sound level of sounds output from the sound arrival direction to be displayed in vicinity of an image of a user who is outputting the sounds from the sound arrival direction.