Sound Source Tracking Camera Avoiding External Speaker Misdirection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing all-in-one video conference devices cannot connect to external speakers, leading to inconvenience when the built-in speaker is damaged, as they lack the necessary physical connections for echo cancellation and sound source tracking, causing the camera to mistakenly track the external speaker playing far-end sound.

Innovation Solution

A sound source tracking system and method using independent speakers and sound source tracking cameras, where a processor controls a communication device to send audio signals from a video conference streaming signal to both the speaker and the sound source tracking camera, allowing the camera to determine the shooting direction by comparing field sounds and audio signals, thus avoiding tracking the external speaker.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If an all-in-one video conference device is used with built-in speaker and microphone array, then sound source tracking can be achieved, but the device cannot connect to external speakers and must be sent for repair when the built-in speaker is damaged

Engineering Contradiction:
Improvesound source tracking capabilityVSAvoidspeaker connection flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system separates the sound source tracking function from the speaker by using an independent sound source tracking camera with microphone array, while the speaker can be either built-in or external. This segmentation allows the tracking capability to remain reliable while enabling flexibility in speaker selection and connection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The sound source tracking camera acts as an intermediary device that receives audio signals from the video conference system and independently performs sound source tracking. This intermediary approach allows the system to work with external speakers while maintaining accurate tracking capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the camera tracks the sound source using acoustic comparison, then it can follow the local-end speaker, but it mistakenly tracks the external speaker playing far-end sound

Engineering Contradiction:
Improvesound source position accuracyVSAvoidcamera misdirection
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system uses feedback by comparing the audio signal from the video conference system with the field sound captured by the sound source tracking camera. This feedback mechanism enables the camera to distinguish between far-end sound played by speakers and local-end speaker voices, preventing misdirection while maintaining accurate tracking.

Inventive Principle:
Principle #23Feedback

3Reliability

If physical circuits connect all modules in an all-in-one device, then integrated sound tracking is achieved, but the device complexity increases and repair becomes difficult

Engineering Contradiction:
Improveintegrated sound trackingVSAvoidmodule integration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system divides the video conference setup into independent modules: the video conference device, external speakers, and sound source tracking camera. Each module functions independently with standard audio connections, reducing overall system complexity while maintaining integrated sound tracking capability through the camera's independent processing.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables sound source tracking at a lower hardware cost, providing flexibility in hardware selection and preventing camera misdirection, even when using external speakers, thereby reducing the need for expensive device repairs.

Implementation Method 1

the sound tracking module performs an acoustic comparison procedure to filter the sound played by the built-in speaker of the video conference device

Methodology Applied
Scientific EffectAcoustic echo suppression: Echo

Data Source

PatentUS12046255B2Sound source tracking system and method thereof
Publication Date: 2024.07.23 AVER INFORMATION INC
  • US12046255B2 patent drawing
  • US12046255B2 patent drawing

AI summary

A sound source tracking method adapted to an ongoing video conference comprising: obtaining a streaming signal of the video conference from an internet; performing a video conference procedure to obtain an audio signal from the streaming signal and send the audio signal to a speaker; performing an audio tracking procedure to obtain the audio signal outputted from the video conference procedure to the communication device and send the audio signal to a sound source tracking camera; playing the audio signal to generate a far-end sound; recording a field sound comprising at least one of the far-end sound and a local-end sound; and performing a comparing procedure to determine a shooting direction of the sound source tracking camera, wherein the shooting direction is adjusted so as not to shoot the speaker when a similarity of the far-end sound and the audio signal is greater than a threshold.