Sound source positioning device based on microphone array sensing imaging

By adding buffer and clock synchronization functions in the acoustic imaging system, combining multi-arm spiral microphone array and PCIe bus, the problem of signal transmission deformation and loss is solved, the accuracy of sound source positioning and system performance are improved, and the efficiency is achieved. Stable acoustic imaging.

CN222105631UActive Publication Date: 2024-12-03XIANHENG INT HANGZHOU ELECTRIC MFG +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202323614415.1
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2023-12-28
Publication Date
2024-12-03
Estimated Expiration
2033-12-28

AI Technical Summary

Technical Problem

In traditional acoustic imaging systems, the signal received by the microphone array is deformed and lost due to transmission line length, voltage fluctuations or load current changes during transmission, affecting the accuracy of data and the accuracy of the sound source position judgment.

Method used

Add a signal amplification buffer between the interface conversion unit and the FPGA to ensure the stability and reliability of the signal, and realize clock synchronization of the microphone array by using the clock signal of the shared FPGA, combining the multi-arm spiral arrangement of the microphone sensor array and PCIe High-speed serial bus for data transmission.

Benefits of technology

It improves the stability of data signal transmission and the accuracy of sound source position judgment, enhances the system's performance and anti-interference ability, reduces the impact of external interference on sound source imaging, and realizes efficient and real-time acoustic imaging processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN222105631U_ABST
    Figure CN222105631U_ABST
Patent Text Reader

Abstract

The utility model aims to provide a sound source positioning device based on microphone array sensing imaging, which comprises an acoustic imaging system, a camera and a liquid crystal display (LCD), the camera and the LCD are connected with the acoustic imaging system, and the acoustic imaging system comprises a microphone array, an interface conversion unit, a field programmable gate array (FPGA) and a central processing unit (CPU). Wherein a buffer for realizing signal amplification is connected between the interface conversion unit and the FPGA, and a data signal input end and a data signal output end of the buffer are respectively connected with the interface conversion unit and the FPGA. According to the sound source positioning device, the buffer is additionally arranged between the interface conversion unit and the FPGA, so that the problems of deformation and loss of data signals in an acoustic imaging system in the transmission process can be solved, and the stability of data signal transmission and the accuracy of sound source position judgment are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The utility model relates to the field of acoustic imaging, and more specifically to the field of an array sensing acoustic imaging device. Background Art

[0002] The sound source localization device based on acoustic imaging technology uses acoustic principles and signal processing technologies to obtain the sound intensity distribution map, and combines the visible light image obtained by the camera to digitize the sound intensity distribution map and the visible light image, and fuse them into a single image, that is, superimpose the sound intensity distribution information on the corresponding position of the visible light image. The fused image is output to the LCD screen for display, and the location of the sound source can be judged more intuitively through the LCD. The sound source localization device based on acoustic imaging technology is widely used in industrial fields such as the power industry, gas detection industry, and machinery industry. The most commonly used acoustic imaging technology is a microphone array sensor imager. Its traditional implementation method is an array composed of several to more than ten microphone sensors, which is used to receive sound signals in the environment and use a single-chip microcomputer for signal data acquisition, and a DSP for signal processing. Due to the low main frequency of the single-chip microcomputer and limited IO port resources, it cannot meet the high-speed large-scale microphone array data acquisition, and the DSP has good signal processing capabilities, but it is expensive and has high power consumption. In general, the traditional implementation method has low sampling frequency, low measurement accuracy, poor scalability, and high development cost.

[0003] Patent No. CN 107371092 A discloses an acoustic imaging system based on microphone array signal processing, including: a microphone array, an FPGA and a CPU. An interface conversion unit is connected between the microphone array and the FPGA, which is used to convert the PDM format data received by the microphone into I2S format data, so as to facilitate the FPGA to perform signal acquisition and processing. The FPGA and the interface conversion unit are used to realize parallel processing of multi-channel microphone array data, thereby improving the system's ability to aggregate microphone data; and the audio data is encoded by the FPGA, so that the CPU directly processes the encoded data, thereby improving the processing speed of the CPU. The problems of low sampling frequency and high development cost in the prior art are overcome.

[0004] However, the signal received by the microphone array is converted by the interface conversion unit and then transmitted to the FPGA unit. Due to the length of the transmission line, voltage fluctuations or changes in load current, the signal may be deformed and lost, affecting the accuracy of the data, thereby causing the system's sound intensity distribution information to be incorrect, resulting in errors in the judgment of the sound source location. Utility Model Content

[0005] The utility model aims to provide a sound source localization device based on microphone array sensing imaging, so as to solve the problem of deformation and loss of data signals during transmission in acoustic imaging systems, and to improve the stability of data signal transmission and the accuracy of sound source position judgment.

[0006] The utility model is realized through the following technical solutions:

[0007] A microphone array sensing imaging device comprises an acoustic imaging system, a camera and an LCD connected to the acoustic imaging system, wherein the acoustic imaging system comprises a microphone array, an interface conversion unit, an FPGA and a CPU, and is characterized in that a buffer for signal amplification is connected between the interface conversion unit and the FPGA, and a data signal input end and an output end of the buffer are respectively connected to the interface conversion unit and the FPGA.

[0008] After the microphone array collects multiple audio signals, the interface conversion unit performs data format conversion: after the PDM format data is converted into I2S format data, the data signal is amplified by the buffer and then transmitted to the FPGA. The FPGA performs parallel processing and encoding on the multi-channel microphone array data and then passes it to the CPU for calculation to obtain a sound intensity distribution image. At the same time, the camera transmits the collected image data to the CPU, which processes the image and merges and superimposes the optical image data and the sound intensity distribution data, and transmits the superimposed image to the LCD for display. The LCD can thus more intuitively determine the location of the sound source.

[0009] The buffer is a common digital logic circuit used to amplify or reconstruct the input signal, which can improve the transmission capacity and stability of the signal. When a signal is transmitted from one digital device to another, the signal may be deformed due to the length of the transmission line, voltage fluctuations, or changes in load current. The buffer can increase the driving ability of the signal, ensure that the signal can be correctly transmitted to the next device, and improve the stability and reliability of the signal. The buffer can use the mature SNx4HC244 in the prior art. The device is an eight-bit buffer for buffering and driving data signals in digital systems. It can have 8 independent buffer channels, which can process 8-bit data signals separately. It can realize the amplification of multiple signals, and CMOS technology is used during this period, with low power consumption and high anti-interference ability, which effectively prevents the signal from being distorted by external factors.

[0010] The sound source localization device can solve the problem of data signal deformation and loss during transmission in the acoustic imaging system by adding a buffer between the interface conversion unit and the FPGA, thereby improving the stability of data signal transmission and the accuracy of sound source position judgment.

[0011] As a preferred embodiment of the present invention, the buffer further comprises a clock signal input terminal and a clock signal output terminal, which are respectively connected to the FPGA and the interface conversion unit.

[0012] The clock signal input end in the buffer is connected to the FPGA. The clock signal generated by the FPGA can simultaneously output multiple clock signals after passing through the buffer and the interface conversion unit, which are respectively used to connect to the clock inputs of the corresponding microphone sensors, thereby realizing the clock synchronization function of the microphone array.

[0013] The realization of the clock synchronization function of the microphone array can ensure that the sampling time of each microphone in the microphone array is synchronized, thereby realizing the phase alignment of the audio signal. This helps to more accurately perform sound source localization or beamforming in subsequent signal processing. In addition, clock synchronization helps to effectively fuse and process the audio signals received by multiple microphones, improve the accuracy and reliability of sound reception, and reduce system latency. At the same time, clock synchronization can reduce the sampling delay differences between audio signals on each channel, thereby reducing the overall latency of the system and improving the real-time performance and response speed of the system. Therefore, the sound source localization device realizes the clock synchronization function of the microphone array by sharing the clock signal of the FPGA, thereby helping the FPGA to efficiently process the audio signals received by the multi-route microphone array, which is beneficial to improving the performance and stability of the system.

[0014] As a preferred embodiment of the present invention, the microphone array is arranged in such a manner that a plurality of the microphone sensors are arranged in a multi-arm spiral shape with the camera as the center.

[0015] The multi-arm spiral is a special geometric shape: a shape with multiple arms or rotating lines extending outward from a central point. This shape has a wide range of applications in mathematics, geometry, and engineering. In this case, the camera is the central point, and multiple rotating lines consisting of microphone sensors are evenly arranged near the central point and extend outward.

[0016] Arranging the microphone sensors around the camera can facilitate calibration. Since the camera can usually provide accurate spatial positioning information, the microphone sensor can be accurately positioned and calibrated with the help of the camera to ensure accurate acquisition and imaging of sound signals. By arranging the microphone sensors around the camera, spatial consistency can be achieved, thereby improving the acquisition accuracy and imaging quality of sound signals.

[0017] In this case, with the camera as the center, other array arrangements are also set up for comparative experiments, including: cross arrangement, matrix arrangement, double ring array arrangement, wheel array arrangement, spiral array arrangement. The noise source is located by the mature controllable power response (SRP) algorithm in the prior art, and the noise source positioning effect of each array is compared. The experiment measured that the rectangular array has a symmetrical virtual image when locating the sound source, the cross array has a cross-shaped virtual image when locating the sound source, the line array has a line-shaped virtual image when locating the sound source, the ring array has a ring-shaped virtual image when locating the sound source, the wheel array has a gear-shaped virtual image when locating the sound source, the spiral array has an irregular scattered virtual image when locating the sound source, and the multi-arm spiral arrangement has a weaker virtual image of the sound source.

[0018] According to the above analysis, when the sound source localization algorithm is certain, the multi-arm spiral arrangement can reduce the virtual image and stray signals in the sound source imaging, improve the anti-interference ability of the system, and reduce the impact of external interference on the sound source imaging. And because the multi-arm spiral arrangement has self-similarity and recursive properties, this characteristic helps to improve the stability and accuracy of sound source imaging, so as to better restore the location and direction information of the sound source. In addition, the multi-arm spiral arrangement can achieve uniform distribution of microphone sensors in space, which helps to improve the acquisition efficiency and accuracy of sound source imaging.

[0019] Therefore, with the camera as the center, the microphone sensor array is arranged in a multi-arm spiral shape extending outward, which can achieve spatial consistency, thereby improving the acquisition accuracy and imaging quality of the sound and light signals. It can also improve the anti-interference ability of the system, reduce the impact of external interference on sound source imaging, and help improve the stability and accuracy of sound source imaging, so as to better restore the location and direction information of the sound source.

[0020] As a preferred embodiment of the present invention, two adjacent microphone sensors are combined and connected through a data line to form a dual-channel data signal that is transmitted to the interface conversion unit, and the FPGA contains a stereo audio decoder connected to the buffer and used to decode the dual-channel data signal.

[0021] Since there are a large number of sensors in the microphone array, adjacent microphone sensors are connected through data lines, and two-way data is merged into one dual-channel data to be transmitted to the interface conversion unit. Multiple groups of two-by-two adjacent sensor combinations generate multiple dual-channel data signals to be transmitted to the interface conversion unit for reception. This design can reduce the number of transmission data lines and interfaces, save wiring space, and improve the efficiency and stability of the imaging system.

[0022] The multiple dual-channel data signals are transmitted into the FPGA via the interface conversion unit and the buffer. The stereo audio decoder in the FPGA can perform data decoding on the dual-channel data signals and data separation of the two channels so as to process or output the audio data of each channel separately.

[0023] Stereo audio decoders are very common in audio processing, audio codecs, and other multimedia applications. They include logic circuits to decode and separate audio signals, as well as appropriate interface and control logic for connecting to other audio processing modules or external devices.

[0024] This acoustic imaging system forms a dual-channel data signal by combining two microphone sensors to save wiring space, and then separates the dual-channel data signal through the stereo audio decoder in the FPGA so that the audio data of each channel can be processed or output separately, thereby improving the system's operating efficiency while ensuring the accuracy of sound source positioning.

[0025] As a preferred embodiment of the present invention, the microphone array sensing imaging device comprises a plurality of the cameras and is arranged at different heights, and each camera is surrounded by the microphone array arranged in a multi-arm spiral shape.

[0026] Arranging multiple cameras at different heights can provide more dimensional environmental information, including stereoscopic perspective, depth information, etc., which is conducive to a more comprehensive understanding of the environmental scene. At the same time, multiple microphone arrays can also capture sound signals at more angles and distances. Especially in complex environments, multiple cameras arranged at different heights can be used for the reconstruction and positioning of three-dimensional scenes. Combined with the sound signals of multiple microphone arrays, more accurate sound imaging and environmental reconstruction can be achieved, improving the accuracy of sound source positioning.

[0027] In general, a microphone array sensing imaging device containing multiple cameras and arranged at different heights can obtain information in more dimensions and achieve more accurate sound imaging and environmental perception.

[0028] As a preferred embodiment of the present invention, the FPGA also contains a RAM data storage and a DMA controller connected to the RAM data storage, and the DMA controller is used to read the data in the RAM data storage and transmit the read data to the CPU.

[0029] In the FPGA, the RAM data memory is a hardware resource for storing data. The RAM in the FPGA is usually used to store temporary data, intermediate results or other data that needs to be read and written quickly. The DMA (Direct Memory Access) controller is a special hardware in a computer system that is used to transfer data between the main memory and external devices. In the FPGA, the DMA controller can be used to manage data transfer between the FPGA and external devices, such as high-speed ADC / DAC, storage devices or network interfaces. The DMA controller is added between the RAM data memory and the CPU. The data in the RAM data memory is first read and written and then transmitted to the CPU, so that the FPGA system can collect, process and transmit data more efficiently, and can reduce the workload of the CPU, thereby improving the performance and response speed of the system.

[0030] As a preferred embodiment of the present invention, the FPGA and the CPU are connected via a PCIe high-speed serial bus.

[0031] PCIe (Peripheral Component Interconnect Express) is a high-speed serial bus standard used to connect internal and external devices of a computer system, such as expansion cards, graphics cards, storage devices, and network adapters. The PCIe bus is based on serial communication and has the characteristics of high bandwidth, low latency, and scalability. It is widely used in modern computers and embedded systems. The FPGA and the CPU are connected via the PCIe high-speed serial bus to achieve high-speed data transmission and communication. By using the PCIe high-speed serial bus, the FPGA system can exchange high-speed data with the host system to support various data-intensive applications such as high-performance computing, data acquisition, and accelerated computing.

[0032] Especially for acoustic imaging systems with a large number of sensors, high-bandwidth data transmission channels can support high-speed transmission of large-scale data. For microphone array acoustic imaging systems, a large amount of sound data needs to be processed. The use of the PCIe bus can effectively transmit these data, ensuring that the system can process sound information in a timely and efficient manner. In addition, the PCIe bus has the characteristics of low latency and can quickly transfer data from the FPGA to the CPU, which is very important for real-time processing of sound signals. Low-latency data transmission can improve the response speed of the system and ensure that the acoustic imaging system can capture and process sound signals in real time. In addition, the PCIe bus adopts a point-to-point connection architecture, and each device can communicate independently without being interfered with by other devices. This means that the data transmission between the FPGA and the CPU can be carried out independently without being affected by other devices, ensuring the stability and reliability of data transmission.

[0033] In summary, data transmission between the FPGA and the CPU through the PCIe high-speed serial bus can provide a high-bandwidth, low-latency and stable communication channel, which helps the acoustic imaging system to process sound signals efficiently and in real time.

[0034] As a preferred embodiment of the present invention, the camera is an infrared camera.

[0035] The infrared camera can capture infrared light, so it can still obtain images at night or in a dark environment, so that the microphone array sensing imaging device can still more intuitively determine the location of the sound source through the collected images in a dark or night environment.

[0036] In summary, the utility model has the following beneficial effects:

[0037] 1. By adding a buffer between the interface conversion unit and the FPGA, the problem of data signal deformation and loss during transmission in the acoustic imaging system can be solved, and the stability of data signal transmission and the accuracy of sound source position judgment can be improved.

[0038] 2. By sharing the clock signal of the FPGA, the clock synchronization function of the microphone array is realized, which helps the FPGA to efficiently process the audio signals received by the multi-route microphone array, thereby improving the performance and stability of the system.

[0039] 3. With the camera as the center, the microphone sensor array is arranged in a multi-arm spiral shape extending outward, which can achieve spatial consistency, thereby improving the acquisition accuracy and imaging quality of the sound and light signals, and can improve the system's anti-interference ability and reduce the impact of external interference on sound source imaging.

[0040] 4. By forming a dual-channel data signal for collection, wiring space can be saved, and then the dual-channel data signal can be separated through the stereo audio decoder in the FPGA so that the audio data of each channel can be processed or output separately, thereby improving the system work efficiency while ensuring the accuracy of sound source positioning.

[0041] 5. A microphone array sensing imaging device containing multiple cameras and arranged at different heights can obtain information in more dimensions and achieve more accurate sound imaging and environmental perception.

[0042] 6. Data transmission between the FPGA and the CPU via the PCIe high-speed serial bus can provide a high-bandwidth, low-latency and stable communication channel, which helps the acoustic imaging system to process sound signals efficiently and in real time. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 is an overall schematic diagram of a sound source localization device;

[0044] Figure 2 It is a specific connection diagram between modules;

[0045] Figure 3 It is a multi-arm spiral array diagram;

[0046] Figure 4 It is a longitudinal combination pairing diagram of a multi-arm spiral array;

[0047] Figure 5 It is a horizontal combination pairing diagram of a multi-arm spiral array;

[0048] Figure 6 It is a diagram of a multi-arm spiral array and other arrays; A, B, C, D, E, and F represent a cross arrangement, a matrix arrangement, a wheel arrangement, a double ring arrangement, a spiral arrangement, and a multi-arm spiral arrangement respectively;

[0049] Figure 7 These are the noise source positioning effect diagrams corresponding to different arrays; a, b, c, d, e, and f represent the noise source positioning effect diagrams corresponding to the cross arrangement, matrix arrangement, wheel array arrangement, double ring array arrangement, spiral array arrangement, and multi-arm spiral arrangement, respectively. DETAILED DESCRIPTION

[0050] The utility model is further described in detail below in conjunction with the accompanying drawings.

[0051] This specific embodiment is merely an explanation of the present invention and is not a limitation of the present invention. After reading this specification, those skilled in the art may make non-creative modifications to the present embodiment as needed, but such modifications are protected by patent law as long as they are within the scope of the claims of the present invention.

[0052] like Figure 1 , 2 As shown, the clock signal clk and channel selection signal ws generated by the FPGA can be simultaneously output through a buffer and an interface conversion unit to form multiple clock inputs and dual channel selection inputs for connecting corresponding microphone sensors, thereby realizing the clock synchronization function of the microphone array and the alternating acquisition of different channel signals.

[0053] Microphone arrays such as Figure 3 As shown in the figure, the central cross point represents the camera, and the cross points arranged in a multi-arm spiral shape around it represent the microphone sensor. Figure 4 As shown, adjacent microphone sensors are connected through data lines, and two data channels are merged into one dual-channel data channel and transmitted to the interface conversion unit. Multiple groups of two adjacent sensors generate multiple dual-channel data signals and transmit them to the interface conversion unit for reception. The receiving unit of the microphone sensor has a select pin, which is used to alternately output the two channel signals based on the received channel selection signal ws. The dual-channel data signal is formed by combining two microphone sensors, thereby saving wiring space and improving the efficiency and stability of the imaging system.

[0054] After the microphone array collects multiple dual-channel audio signals, the data format is converted through the interface conversion unit: the PDM format data is converted into I2S format data, and the data signal is amplified by the buffer and transmitted to the FPGA. Adding a buffer can solve the problem of data signal deformation and loss during transmission in the acoustic imaging system, improve the stability of data signal transmission and the accuracy of sound source location judgment.

[0055] The stereo audio decoder in the FPGA can decode the dual-channel data signal and separate the data of the two channels so that the audio data of each channel can be processed or output separately. The decoded data is stored in the RAM data memory in the FPGA. The DMA controller in the FPGA first reads and writes the data in the RAM data memory and then transmits it to the CPU through the PCIe high-speed serial bus. The addition of a DMA controller allows the FPGA system to collect, process and transmit data more efficiently, and can reduce the workload of the CPU, thereby improving the performance and response speed of the system. Data transmission between the FPGA and the CPU through the PCIe high-speed serial bus can provide a high-bandwidth, low-latency and stable communication channel, which helps the acoustic imaging system to process sound signals efficiently and in real time.

[0056] The CPU receives the encoded multi-channel microphone array data transmitted by the FPGA and performs calculations to obtain a sound intensity distribution image. At the same time, the camera transmits the collected image data to the CPU, which processes the image and fuses and superimposes the optical image data and the sound intensity distribution data, and transmits the superimposed image to the LCD for display. The LCD can be used to more intuitively determine the location of the sound source.

[0057] The camera may be an infrared camera that can capture infrared light, so it can still capture images at night or in a dark environment, so that the microphone array sensing imaging device can still more intuitively determine the location of the sound source through the captured images in a dark or night environment.

[0058] In another embodiment of the present invention, the layout diagram of the combination of two microphone sensors arranged in a multi-arm spiral shape can also be as follows: Figure 5 As shown, the sensors closest to the end point in each rotating line form a primary circle, and pairs are paired in the circle. If the layout is an odd number due to the location area restriction, the single sensor with more pairs is paired with the sensor combination in the next adjacent secondary circle. The purpose of pairing two by two to form a dual-channel data signal is mainly to save wiring space and improve efficiency and stability, and has no effect on the overall array structure. The specific combination layout diagram can be adaptively adjusted according to the specific situation on site.

[0059] In another embodiment of the utility model, the microphone array sensing imaging device contains multiple cameras and is arranged at different heights, and each camera is surrounded by a microphone array arranged in a multi-arm spiral shape. Multiple cameras arranged at different heights can provide more dimensional environmental information, including stereoscopic viewing angles, depth information, etc., which is conducive to a more comprehensive understanding of the environmental scene. At the same time, multiple microphone arrays can also capture sound signals at more angles and distances. Especially in complex environments, multiple cameras arranged at different heights can be used for reconstruction and positioning of three-dimensional scenes. Combined with the sound signals of multiple microphone arrays, more accurate sound imaging and environmental reconstruction can be achieved, and the accuracy of sound source positioning can be improved.

[0060] In other embodiments of the present invention, the microphone sensor array is arranged in addition to the multi-arm spiral arrangement, and also has several other shapes of arrangements. Figure 6 As shown in the figure, A, B, C, D, E, and F represent: cross arrangement, matrix arrangement, wheel array arrangement, double ring array arrangement, spiral array arrangement, and multi-arm spiral arrangement. The noise source is located by the controlled power response (SRP) algorithm, and the noise source location effect of each formation is compared. The effect diagram of each formation locating a single sound source is shown in the figure. Figure 7As shown in a, b, c, d, e, and f, using a rectangular array to locate the sound source results in a symmetrical virtual image, using a cross array to locate the sound source results in a cross-shaped virtual image, using a line array to locate the sound source results in a line-shaped virtual image, using a ring array to locate the sound source results in a ring-shaped virtual image, using a wheel array to locate the sound source results in a gear-shaped virtual image, using a spiral array to locate the sound source results in an irregularly scattered virtual image, and the virtual image of the sound source located by a multi-arm spiral arrangement is weaker.

[0061] It can be concluded that when the sound source localization algorithm is certain, the multi-arm spiral arrangement can reduce the virtual image and stray signals in the sound source imaging, improve the anti-interference ability of the system, and reduce the impact of external interference on the sound source imaging. And because the multi-arm spiral arrangement has self-similarity and recursive properties, this characteristic helps to improve the stability and accuracy of sound source imaging, so that the position and direction information of the sound source can be better restored. Therefore, with the camera as the center, the microphone sensor array is arranged in a multi-arm spiral extending outward, which can achieve spatial consistency, thereby improving the acquisition accuracy and imaging quality of the sound and light signals. And it can improve the anti-interference ability of the system, reduce the impact of external interference on sound source imaging, help improve the stability and accuracy of sound source imaging, so that the position and direction information of the sound source can be better restored.

[0062] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A sound source localization device based on microphone array sensor imaging, comprising an acoustic imaging system, a camera and an LCD connected to the acoustic imaging system, wherein the acoustic imaging system comprises a microphone array, an interface conversion unit, an FPGA and a CPU, characterized in that: A buffer for signal amplification is connected between the interface conversion unit and the FPGA, and a data signal input terminal and an output terminal of the buffer are connected to the interface conversion unit and the FPGA respectively.

2. A sound source localization device based on microphone array sensing imaging according to claim 1, characterized in that: The buffer also includes a clock signal input terminal and a clock signal output terminal, which are respectively connected to the FPGA and the interface conversion unit.

3. The sound source localization device based on microphone array sensing imaging according to claim 1, characterized in that: The microphone array is arranged in a manner that a plurality of microphone sensors are arranged in a multi-arm spiral shape with the camera as the center.

4. The sound source localization device based on microphone array sensing imaging according to claim 3, characterized in that: Two adjacent microphone sensors are combined and connected through a data line to form a dual-channel data signal that is transmitted to the interface conversion unit. The FPGA contains a stereo audio decoder connected to the buffer and used to decode the dual-channel data signal.

5. The sound source localization device based on microphone array sensing imaging according to claim 3, characterized in that: The camera system comprises a plurality of cameras arranged at different heights, and each camera is surrounded by a microphone array arranged in a multi-arm spiral shape.

6. The sound source localization device based on microphone array sensing imaging according to claim 1, characterized in that: The FPGA also contains a RAM data memory and a DMA controller connected to the RAM data memory. The DMA controller is used to read the data in the RAM data memory and transmit the read data to the CPU.

7. The sound source localization device based on microphone array sensing imaging according to claim 1, characterized in that: The FPGA and the CPU are connected via a PCIe high-speed serial bus.

8. The sound source localization device based on microphone array sensing imaging according to claim 1, characterized in that: The camera is an infrared camera.