This invention discloses a three-dimensional stereoscopic audio-visual composite detection
system, device, and computer storage medium. The
system includes a three-dimensional stereoscopic
microphone array, a rotatable camera unit, a multi-channel
signal acquisition and
processing unit, and a
multimodal data fusion
processing module. The three-dimensional stereoscopic
microphone array consists of six arms, with four horizontal arms arranged radially in a cross shape in the horizontal plane, and two vertical arms arranged side by side in the central vertical direction; each arm contains 48 microphones, forming a three-dimensional sampling grid, with an overall
footprint of 213cm × 213cm and a height of 111cm. The rotatable camera unit is mounted at the top of the vertical arm and has a 360° horizontal and
pitch-adjustable rotation capability. The
multimodal data fusion
processing module detects and identifies targets based on
intelligent algorithms, and uses the
Time Difference of Arrival (TDOA)
algorithm to calculate the three-dimensional coordinates of the sound source, guiding the camera unit to perform visual
verification, and realizing the fusion output of the target's three-dimensional coordinates and image information. This invention can achieve audio-visual composite detection of low-altitude targets, with high positioning accuracy, strong anti-interference ability, and good real-time performance, and is suitable for fields such as UAV detection, key area defense, and border monitoring.