Sound Detector Array for Target Localization in Noisy Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional handheld gimbals equipped with cameras or smartphones struggle to capture images based on sounds from targets due to external noise interference, such as wind noise, affecting the microphone's accuracy.

Innovation Solution

A photographing control method and apparatus that utilizes multiple sound detectors to detect target sounds, determine the target's location, and control a mobile platform to position a sensor, such as a camera, accurately towards the target, while mitigating noise interference by using distance-velocity-time equations and Euler angle adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single microphone is used in a handheld gimbal, then the device structure is simple, but the sound detection accuracy deteriorates due to external noise interference

Engineering Contradiction:
Improvedevice structureVSAvoidsound detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent divides the sound detection function into multiple independent microphones (at least three) arranged in different spatial positions. Each microphone captures sound from its specific direction, and the system segments the sound field into multiple detection zones. This segmentation allows the system to distinguish target sound from background noise by comparing signals from different positions, thereby improving sound detection accuracy while maintaining relatively simple device structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines multiple microphones into a unified sound detection system that processes signals collectively. By merging the detection capabilities of multiple microphones and integrating their signals through beamforming or time difference of arrival calculations, the system achieves enhanced sound localization accuracy and noise rejection that would be impossible with a single microphone, while the combined structure remains compact enough for handheld gimbal applications.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If multiple sound detectors are used to improve target localization accuracy, then the sound detection precision is improved, but the device complexity increases

Engineering Contradiction:
Improvetarget localization accuracyVSAvoidnumber of sound detectors
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent assigns different functional roles to different microphones based on their spatial positions. Each microphone is optimized for detecting sounds from specific directions or zones, creating local detection expertise. This local quality approach allows accurate target localization with a minimal number of microphones (at least three) rather than requiring a dense array, thereby improving target localization accuracy while controlling device complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent transitions from one-dimensional sound detection (single microphone) to three-dimensional sound field analysis by strategically positioning multiple microphones in spatial dimensions. This dimensional expansion enables the system to calculate target location using time difference of arrival and signal intensity differences across multiple spatial points, achieving accurate 3D localization with a compact arrangement of microphones that doesn't significantly increase device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If the camera is manually positioned, then the operation flexibility is maintained, but the photographing efficiency deteriorates when tracking moving targets

Engineering Contradiction:
Improveoperation flexibilityVSAvoidphotographing efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent implements a feedback loop where the sound detection system continuously monitors the acoustic environment, determines target location and movement, and automatically adjusts camera positioning in real-time. This closed-loop feedback enables the system to track moving targets automatically without manual intervention, dramatically improving photographing efficiency while maintaining operation flexibility through programmable control modes that can be adjusted based on user preferences or specific shooting scenarios.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables effective image capture of targets based on sound cues, even in noisy environments, by precisely determining the target's location and orienting the sensor with improved signal-to-noise ratios and reduced orientation differences, enhancing the quality of captured images.

Implementation Method 1

determining a target location of the target according to the target sound detected using the plurality of sound detectors

Methodology Applied
Scientific EffectSound wave propagation: Sound

Data Source

PatentUS11388343B2Photographing control method and controller with target localization based on sound detectors
Publication Date: 2022.07.12 SZ DJI TECH CO LTD
  • US11388343B2 patent drawing
  • US11388343B2 patent drawing
  • US11388343B2 patent drawing

AI summary

A photographing control method includes detecting a target sound from a target using a plurality of sound detectors of a mobile platform carrying a sensor, determining a target location of the target according to the target sound detected using the plurality of sound detectors, and controlling the mobile platform based at least in part on the target location.