Control method of sound source processing system based on acoustic sensor array and image recognition

A technology of acoustic sensor and control method, which is applied in the parts of TV system, image communication, two-way working system, etc., which can solve the problem of inability to accurately obtain clear and error-free effective sound signals, affecting effective sound acquisition and analysis, and low sound signal clarity and other issues to achieve the effect of improving clarity, facilitating extraction and analysis, and avoiding conflicts

Active Publication Date: 2019-04-26
四川天源宏创科技有限公司
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, in the sound and image comprehensive collection technology, in the same space, the sound signal in the space is collected through the acoustic sensor array. When the sound source is far away from the acoustic sensor array, the sound signal collected from the sound source has low It affects the acquisition and analysis of effective sound in the later stage. When the surrounding environment of the sound source changes greatly, it cannot be adjusted with the change of the environment, resulting in the inability to accurately obtain clear and effective sound signals. In the monitoring and management of sound sources, Effective sound acquisition and positioning of sound sources are important issues and problems that need to be solved urgently

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Control method of sound source processing system based on acoustic sensor array and image recognition
  • Control method of sound source processing system based on acoustic sensor array and image recognition
  • Control method of sound source processing system based on acoustic sensor array and image recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] Such as figure 1 As shown, the control method of the sound source processing system based on the acoustic sensor array and image recognition of the present invention, wherein the sound source processing system includes:

[0043] The acoustic and image signal hybrid terminal is used to sense and collect the sound and image signals of the sound source and process them into data packets composed of equal-length acoustic data frames and image data frames;

[0044] The transmission module is used to transmit data packets;

[0045] The host computer is used to receive the data packet, process the acoustic data frame and image data frame in the data packet into acoustic data and image data, and obtain the acoustic data waveform diagram and video image;

[0046] The above acoustic and image signal hybrid terminals include:

[0047] The acoustic sensor array is used to sense and collect the sound signal of the sound source. There are 8 branches on the acoustic sensor array, an...

Embodiment 2

[0090] On the basis of embodiment 1, the real-time storage in step (4) can adopt the memory-mapped file of double-layer ping-pong structure, (the memory-mapped file of double-layer ping-pong structure sees Chen Jin. The data acquisition of hydrophone line array Research on key technology and transmission [D]. Tianjin: Tianjin University, 2013.) to complete the real-time storage of the data collected by the acoustic sensor array.

Embodiment 3

[0092] Such as figure 2 As shown, the main control unit transmits the acoustic data frame and the image data frame in a dual-priority manner.

[0093] When there is no conflict between the transmission of the acoustic data frame and the image data frame, the transmission is performed sequentially in sequence; when there is a conflict between the transmission of the acoustic data frame and the image data frame, the priority transmission of the acoustic data frame is set.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a control method of a sound source processing system based on an acoustic sensor array and image recognition. The method includes the following steps of: (1) starting an acoustic and image signal mixing terminal; (2) collecting sound and image signals of a sound source, processing the sound and image signals into data packets, and sending the data packets to a transmissionmodule; (3) transmitting the data packets to an upper computer by the transmission module, and respectively creating an acoustic file and an image file by adopting a memory mapping file; (4) respectively analyzing an acoustic data frame and an image data frame into acoustic data and image data, and storing the acoustic data and the image data in the created acoustic file and image file; and (5) respectively displaying an acoustic data waveform chart and a video image through the upper computer. The scheme of the invention has the beneficial effects that the collected signals are processed intothe data packets and transmitted to the upper computer, the uniformity of signal transmission is good, a network cable is logically divided into a plurality of virtual channels to distribute and transmit different pieces of data, and the acoustic data and the image data do not affect each other in the transmission process.

Description

technical field [0001] The invention belongs to the technical field of sound source localization analysis, and in particular relates to a control method of a sound source processing system based on an acoustic sensor array and image recognition. Background technique [0002] In recent years, network technology has become more and more developed, and network technology is used in business negotiations and monitoring in public places. Network interactive platform and other fields. At present, in the sound and image comprehensive collection technology, in the same space, the sound signal in the space is collected through the acoustic sensor array. When the sound source is far away from the acoustic sensor array, the sound signal collected from the sound source has low It affects the acquisition and analysis of effective sound in the later stage. When the surrounding environment of the sound source changes greatly, it cannot be adjusted with the change of the environment, resul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N7/18H04N7/10H04N7/15H04N5/92G10L25/48G10L25/51G10L21/10
CPCG10L21/10G10L25/48G10L25/51H04N5/9202H04N7/10H04N7/15H04N7/18
Inventor 陈劲刘荣佟颖关升段发阶闫磊蒋佳佳李凯凯
Owner 四川天源宏创科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products