Directional Sound Capture via Image-Based Object Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional sound capture systems face challenges in accurately directing microphones towards sound sources due to varying sensitivity patterns, leading to inefficient sound collection.

Innovation Solution

A method that utilizes a camera device to capture images of a scene with a light source attached to a sound source object, detects the light source's location through local light change patterns, and generates a control signal to align the microphone's sensitivity direction towards the sound source, enhancing sound capture efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the microphone's sensitivity direction is not aligned with the sound source, then the sound capture covers a wider area, but the signal-noise ratio decreases

Engineering Contradiction:
Improvesignal-noise ratioVSAvoidsound capture coverage
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The microphone's sensitivity direction is made dynamically adjustable through electronic control, allowing it to adapt its orientation to track the moving sound source object in real-time, thus maintaining optimal signal-noise ratio while following the target

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses camera-based object tracking to continuously monitor the sound source object's position and feeds this information back to adjust the microphone's sensitivity direction, creating a closed-loop system that maintains alignment between the microphone and sound source

Inventive Principle:
Principle #23Feedback

2Productivity

If the microphone's sensitivity direction is fixed, then the device complexity is reduced, but the sound capture efficiency decreases when the sound source moves

Engineering Contradiction:
Improvesound capture efficiencyVSAvoidmicrophone direction control
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

A camera-based object tracking system serves as an intermediary to detect and track the sound source object's position, providing directional information that controls the microphone's sensitivity orientation without requiring complex direct sensing in the microphone itself

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces complex mechanical direction control systems with electronic beamforming or digital signal processing techniques that can electronically steer the microphone's sensitivity direction, reducing mechanical complexity while maintaining or improving performance

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves sound capture by aligning the microphone's sensitivity direction with the sound source, resulting in higher signal-noise ratios and more effective sound emission detection.

Implementation Method 1

detecting, by a hardware processor based on a pattern of local light change across the sequence of images, the light source in the scene

Methodology Applied
Scientific EffectLight detection: Light

Implementation Method 2

A sound field is an extent of a sound wave that is captured by a microphone based on a transducer converting air pressure variation of the sound wave into an electrical signal

Methodology Applied
Scientific EffectTransducer conversion:

Data Source

PatentUS11902737B2Directional sound capture using image-based object tracking
Publication Date: 2024.02.13 HANGZHOU TARO POSITIONING TECH CO LTD
  • US11902737B2 patent drawing
  • US11902737B2 patent drawing
  • US11902737B2 patent drawing

AI summary

A method for directional sound capture. The method includes capturing, using a camera device, a sequence of images of a scene comprising a light source attached to a sound source object, detecting, by a hardware processor based on a pattern of local light change across the sequence of images, the light source in the scene, determining a direction of the sound source object by at least determining a location of the light source in at least one image of the sequence of images, transmitting, to a direction control device coupled to a microphone, a control signal to direct a sensitivity direction of the microphone towards the sound source object, and capturing, using the microphone and in response to directing the sensitivity direction of the microphone towards the sound source object, the sound emitted from the sound source object.