Control method of sound source processing system based on acoustic sensor array and image recognition

Abstract

The invention discloses a control method of a sound source processing system based on an acoustic sensor array and image recognition. The method includes the following steps of: (1) starting an acoustic and image signal mixing terminal; (2) collecting sound and image signals of a sound source, processing the sound and image signals into data packets, and sending the data packets to a transmissionmodule; (3) transmitting the data packets to an upper computer by the transmission module, and respectively creating an acoustic file and an image file by adopting a memory mapping file; (4) respectively analyzing an acoustic data frame and an image data frame into acoustic data and image data, and storing the acoustic data and the image data in the created acoustic file and image file; and (5) respectively displaying an acoustic data waveform chart and a video image through the upper computer. The scheme of the invention has the beneficial effects that the collected signals are processed intothe data packets and transmitted to the upper computer, the uniformity of signal transmission is good, a network cable is logically divided into a plurality of virtual channels to distribute and transmit different pieces of data, and the acoustic data and the image data do not affect each other in the transmission process.

Description

technical field [0001] The invention belongs to the technical field of sound source localization analysis, and in particular relates to a control method of a sound source processing system based on an acoustic sensor array and image recognition. Background technique [0002] In recent years, network technology has become more and more developed, and network technology is used in business negotiations and monitoring in public places. Network interactive platform and other fields. At present, in the sound and image comprehensive collection technology, in the same space, the sound signal in the space is collected through the acoustic sensor array. When the sound source is far away from the acoustic sensor array, the sound signal collected from the sound source has low It affects the acquisition and analysis of effective sound in the later stage. When the surrounding environment of the sound source changes greatly, it cannot be adjusted with the change of the environment, resul...

AI Technical Summary

Problems solved by technology

At present, in the sound and image comprehensive collection technology, in the same space, the sound signal in the space is collected through the acoustic sensor array. When the sound source is far away from the acoustic sensor array, the sound signal collected from the sound source has low It affects the acquisition and analysis of effective sound in the later stage. When the surrounding environment of the sound source changes greatly, it cannot be adjusted with the change of the environment, resulting in the inability to accurately obtain clear and effective sound signals. In the monitoring and management of sound sources, Effective sound acquisition and positioning of sound sources are important issues and problems that need to be solved urgently

Images