Microphone sound source array positioning system and method

Abstract

The invention provides a microphone sound source array positioning system and method. The microphone sound source array positioning system comprises a microphone array unit, a sound wave processing unit and a sound source recognition unit, the microphone array unit comprises a microphone algorithm module and a microphone array module; the sound source identification unit comprises a sound source geometric model construction module, a sound source geometric model identification module, a sound wave radiation identification module and a sound wave radiation distinguishing module; according to the invention, the three-dimensional microphone array is matched with the analysis of the reflected sound wave path, the high-precision sound source positioning in the vehicle is realized, the three-dimensional position of the sound source is accurately positioned by analyzing the path, delay and intensity of the sound wave and reconstructing the sound wave propagation trajectory, the direction and position of the sound source can be quickly identified without an additional sensor, and the positioning accuracy of the sound source is improved. Voice sources in all directions in the vehicle are distinguished through delay detection and intensity analysis, the complex in-vehicle space is effectively dealt with, and the intelligence of in-vehicle voice interaction and in-vehicle personnel distribution perception is improved.

Description

Technical Field

[0001] The invention relates to a microphone sound source array positioning system and method, belonging to the technical field of sound source positioning. Background Art

[0002] Sound source localization technology is a technology that determines the location of a sound source in space. It can be used for noise source localization and other sound localization, such as determining the location of a speaker in a conference room. Since the time for sound signals to reach each microphone has different degrees of delay, these measured sound signals are processed by algorithms to obtain information such as the arrival direction (including azimuth, pitch angle) and distance of the sound source point relative to the microphone. Microphone array; The in-car sound source positioning is mostly performed through microphone arrays and sensors. A microphone array is an array formed by a group of omnidirectional microphones located at different positions in space and arranged in a certain shape. It is a device for spatial sampling of spatially propagated sound signals. When using this method to identify in-car sound sources, it is limited by the accuracy of plane positioning and is not convenient for distinguishing voice sources at different locations in the car. When dealing with complex in-car spaces, the positioning accuracy is insufficient and the positioning system has low adaptability because the in-car space is relatively small and the reflected sound waves are obvious. In order to solve the above technical problems, a microphone sound source array positioning system and method are proposed. Summary of the invention

[0003] In view of this, the present invention provides a microphone sound source array positioning system and method to solve or alleviate the technical problems existing in the prior art and at least provide a beneficial option.

[0004] The technical solution of the present invention is implemented as follows: a microphone sound source array positioning system, comprising a microphone array unit, a sound wave processing unit and a sound source identification unit; The microphone array unit includes a microphone algorithm module and a microphone array module, the sound wave processing unit includes a sound wave path analysis unit and a sound wave trajectory construction unit, and the sound source identification unit includes a sound source geometric model construction module, a sound source geometric model identification module, a sound wave radiation identification module and a sound wave radiation distinction module; Among them, the sound wave path analysis unit includes a sound wave path analysis module, a sound wave delay analysis module and a sound wave intensity analysis module, and the sound wave trajectory construction unit includes a reflection simulation module, a sound wave simulation module and a sound source localization module.

[0005] Further preferably, the microphone array module is composed of multiple microphones, a converter, a controller and a signal transmitter, the microphone is used to sample audio and convert the audio into an electrical signal, the converter is connected to the microphone and is used to convert the electrical signal from an analog signal form to a digital signal form, the controller is connected to the converter, and the signal transmitter is used to transmit the signal.

[0006] Further preferably, the reflection simulation module is used to simulate the reflection trajectory of the sound wave, and the sound wave simulation module is used to simulate the reflection path of the sound wave in the car, and the sound source position is reversed through the reflection path in cooperation with the sound source localization module.

[0007] Further preferably, the sound wave path analysis unit analyzes the path, delay and intensity of the sound wave, cooperates with the sound wave trajectory construction unit to reconstruct the propagation trajectory of the sound wave, and accurately locates the three-dimensional position of the sound source.

[0008] A microphone sound source array positioning method comprises the following steps: S1. Construct the interior reflection model of the vehicle; S2, installing a three-dimensional microphone array; S3, receiving reflected sound waves; S4, analyzing reflected sound waves; S5, construct the sound wave propagation trajectory; S6, locate the three-dimensional position of the sound source; S7, sound source distinction; S8. Quickly identify the sound source.

[0009] Further preferably, in S1, a reflection model inside the vehicle is constructed according to the distribution of objects inside the vehicle and the installation positions of the three-dimensional microphones, and physical constraints are added to the reflection model to simulate the sound wave reflection performance of each position inside the vehicle.

[0010] Further preferably, in S5, when constructing the sound wave propagation trajectory, the sound wave propagation trajectory is reconstructed according to the path, delay and intensity analysis results of the sound wave, and after reconstruction, the propagation of the sound wave is simulated in the in-vehicle reflection model to improve the accuracy of the sound wave propagation trajectory.

[0011] Further preferably, in S6, when locating the three-dimensional position of the sound source, the position of the sound source is inferred based on the sound wave reflection simulation result, and the position of the sound source in the vehicle is distinguished through delay detection and intensity analysis.

[0012] Further preferably, in S7, when distinguishing the sound sources, the voice sources of the main driver, the front passenger and the rear passengers in the vehicle are distinguished, and the corresponding three-dimensional coordinates are assigned to the sound sources, so as to quickly identify the locations of the same type of sound sources.

[0013] Further preferably, in S8, after receiving the reflected sound wave and analyzing it, the sound wave is compared with the known sound source, the corresponding sound source coordinates are directly obtained, the sound source position is quickly identified, and the data with the same sound source but inconsistent coordinates is updated, so that the three-dimensional coordinates of the sound source change in real time as the target moves.

[0014] The embodiment of the present invention has the following advantages due to the adoption of the above technical solution: 1. The present invention realizes high-precision sound source positioning in the car through the analysis of the path of reflected sound waves in combination with a three-dimensional microphone array. By analyzing the path, delay and intensity of the sound waves, the propagation trajectory of the sound waves is reconstructed, thereby accurately positioning the three-dimensional position of the sound source. The direction and position of the sound source can be quickly identified without additional sensors. The voice sources in various directions in the car can be distinguished through delay detection and intensity analysis, effectively coping with complex in-car spaces, and improving the intelligence of in-car voice interaction and in-car personnel distribution perception. 2. The present invention updates the three-dimensional coordinates of the corresponding sound source in real time, so that the coordinates of the sound source change in real time as the people in the car move or change, the positioning of different sound sources is more accurate, and it is convenient to record the movement of the three-dimensional coordinates of different sound sources.

[0015] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present invention will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 It is a functional module diagram of the microphone sound source array positioning system in the present invention; Figure 2 The figure is a flow chart of the method for positioning the microphone sound source array in the present invention.

[0018] Figure numerals: 10, microphone array unit; 11, microphone algorithm module; 12, microphone array module; 20, sound wave processing unit; 21, sound wave path analysis unit; 22, sound wave path analysis module; 23, sound wave delay analysis module; 24, sound wave intensity analysis module; 25, sound wave trajectory construction unit; 26, reflection simulation module; 27, sound wave simulation module; 28, sound source localization module; 30, sound source identification unit; 31, sound source geometric model construction module; 32, sound source geometric model identification module; 33, sound wave radiation identification module; 34, sound wave radiation distinction module. DETAILED DESCRIPTION

[0019] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present invention. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.

[0020] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0021] like Figure 1 As shown, an embodiment of the present invention provides a microphone sound source array positioning system, including a microphone array unit 10, a sound wave processing unit 20 and a sound source identification unit 30; The microphone array unit 10 includes a microphone algorithm module 11 and a microphone array module 12, the sound wave processing unit 20 includes a sound wave path analysis unit 21 and a sound wave trajectory construction unit 25, and the sound source identification unit 30 includes a sound source geometric model construction module 31, a sound source geometric model identification module 32, a sound wave radiation identification module 33 and a sound wave radiation distinction module 34; The acoustic wave path analysis unit 21 is composed of an acoustic wave path analysis module 22 , an acoustic wave delay analysis module 23 and an acoustic wave intensity analysis module 24 , and the acoustic wave trajectory construction unit 25 is composed of a reflection simulation module 26 , an acoustic wave simulation module 27 and a sound source localization module 28 .

[0022] In one embodiment, the microphone array module 12 is composed of multiple microphones, a converter, a controller and a signal transmitter. The microphone is used to sample audio and convert the audio into an electrical signal. The converter is connected to the microphone and is used to convert the electrical signal from an analog signal form to a digital signal form. The controller is connected to the converter, and the signal transmitter is used to transmit the signal.

[0023] In one embodiment, the reflection simulation module 26 is used to simulate the reflection trajectory of the sound wave, and the sound wave simulation module 27 is used to simulate the reflection path of the sound wave in the car, and the sound source position is reversed through the reflection path in cooperation with the sound source localization module 28.

[0024] In one embodiment, the sound wave path analysis unit 21 analyzes the path, delay and intensity of the sound wave, cooperates with the sound wave trajectory construction unit 25 to reconstruct the propagation trajectory of the sound wave, and accurately locates the three-dimensional position of the sound source.

[0025] like Figure 2 As shown, an embodiment of the present invention also provides a microphone sound source array positioning method, comprising the following steps: S1. Construct an in-car reflection model based on the distribution of objects in the car and the installation position of the three-dimensional microphone. Add physical constraints to the reflection model to simulate the sound wave reflection performance at various positions in the car. S2, installing a three-dimensional microphone array; S3, receiving reflected sound waves; S4, analyzing reflected sound waves; S5, constructing a sound wave propagation trajectory, reconstructing the sound wave propagation trajectory according to the sound wave path, delay and intensity analysis results, simulating the propagation of the sound wave in the in-vehicle reflection model after reconstruction, and improving the accuracy of the sound wave propagation trajectory; S6. Locate the three-dimensional position of the sound source, infer the position of the sound source based on the sound wave reflection simulation results, and distinguish the position of the sound source in the car through delay detection and intensity analysis; S7, sound source differentiation, distinguishing the voice sources of the main driver, co-driver and rear passengers in the car, and assigning corresponding three-dimensional coordinates to the sound sources, so as to quickly identify the location of the same type of sound sources; S8. Quickly identify the sound source. After receiving and analyzing the reflected sound wave, compare the sound wave with the known sound source, directly obtain the corresponding sound source coordinates, quickly identify the sound source position, and update the data with the same sound source but inconsistent coordinates, so that the three-dimensional coordinates of the sound source change in real time as the target moves.

[0026] In one embodiment, in S8, the change of the three-dimensional coordinates of the sound source is recorded, and the sound source is matched after the change, so as to obtain the movement record of the person in the car.

[0027] When the present invention is working, a three-dimensional microphone array is installed at a corresponding position in the vehicle, a reflection model in the vehicle is constructed according to the distribution of objects in the vehicle and the installation position of the three-dimensional microphone, physical constraints are added to the reflection model to simulate the sound wave reflection performance of each position in the vehicle, the reflected sound wave is received by the three-dimensional microphone array, and the reflected sound wave is analyzed by the microphone sound source array positioning system, and the sound wave propagation trajectory is reconstructed according to the path, delay and intensity analysis results of the sound wave. After the reconstruction, the propagation of the sound wave is simulated in the reflection model in the vehicle to improve the accuracy of the sound wave propagation trajectory, the sound source position is inferred according to the sound wave reflection simulation result, and the voice sources of the main driver, the co-driver and the rear passengers in the vehicle are distinguished through delay detection and intensity analysis, and the corresponding three-dimensional coordinates are assigned to the sound source, so as to quickly identify the location of the same type of sound source, after receiving the reflected sound wave and analyzing and processing it, the sound wave is compared with the known sound source, the corresponding sound source coordinates are directly obtained, the sound source position is quickly identified, and the data with the same sound source but inconsistent coordinates are updated, so that the three-dimensional coordinates of the sound source change in real time with the movement of the target.

[0028] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of various changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A microphone sound source array positioning system, characterized in that: It comprises a microphone array unit (10), a sound wave processing unit (20) and a sound source identification unit (30); The microphone array unit (10) comprises a microphone algorithm module (11) and a microphone array module (12); the sound wave processing unit (20) comprises a sound wave path analysis unit (21) and a sound wave trajectory construction unit (25); and the sound source identification unit (30) comprises a sound source geometric model construction module (31), a sound source geometric model identification module (32), a sound wave radiation identification module (33) and a sound wave radiation distinction module (34); The sound wave path analysis unit (21) comprises a sound wave path analysis module (22), a sound wave delay analysis module (23) and a sound wave intensity analysis module (24), and the sound wave trajectory construction unit (25) comprises a reflection simulation module (26), a sound wave simulation module (27) and a sound source localization module (28).

2. A microphone sound source array positioning system according to claim 1, characterized in that: The microphone array module (12) is composed of a plurality of microphones, a converter, a controller and a signal transmitter. The microphone is used to sample audio and convert the audio into an electrical signal. The converter is connected to the microphone and is used to convert the electrical signal from an analog signal form to a digital signal form. The controller is connected to the converter. The signal transmitter is used to transmit the signal.

3. The microphone sound source array positioning system according to claim 1, characterized in that: The reflection simulation module (26) is used to simulate the reflection trajectory of the sound wave, and the sound wave simulation module (27) is used to simulate the reflection path of the sound wave in the vehicle, and the sound source position is reversed through the reflection path in cooperation with the sound source positioning module (28).

4. The microphone sound source array positioning system according to claim 1, characterized in that: The sound wave path analysis unit (21) analyzes the path, delay and intensity of the sound wave, and cooperates with the sound wave trajectory construction unit (25) to reconstruct the propagation trajectory of the sound wave, thereby accurately locating the three-dimensional position of the sound source.

5. A microphone sound source array positioning method, characterized in that: The following steps are involved: S1. Construct the interior reflection model of the vehicle; S2, installing a three-dimensional microphone array; S3, receiving reflected sound waves; S4, analyzing reflected sound waves; S5, construct the sound wave propagation trajectory; S6, locate the three-dimensional position of the sound source; S7, sound source distinction; S8. Quickly identify the sound source.

6. A microphone sound source array positioning method according to claim 5, characterized in that: In S1, a reflection model inside the vehicle is constructed according to the distribution of objects inside the vehicle and the installation positions of three-dimensional microphones, and physical constraints are added to the reflection model to simulate the sound wave reflection performance of each position inside the vehicle.

7. The microphone sound source array positioning method according to claim 5, characterized in that: In the S5, when constructing the sound wave propagation trajectory, the sound wave propagation trajectory is reconstructed according to the path, delay and intensity analysis results of the sound wave. After the reconstruction, the propagation of the sound wave is simulated in the in-vehicle reflection model to improve the accuracy of the sound wave propagation trajectory.

8. The microphone sound source array positioning method according to claim 5, characterized in that: In S6, when locating the three-dimensional position of the sound source, the position of the sound source is inferred based on the sound wave reflection simulation result, and the position of the sound source in the vehicle is distinguished through delay detection and intensity analysis.

9. The microphone sound source array positioning method according to claim 5, characterized in that: In the above S7, when distinguishing the sound sources, the voice sources of the main driver, the front passenger and the rear passengers in the vehicle are distinguished, and the corresponding three-dimensional coordinates are assigned to the sound sources, so as to quickly identify the locations of the same type of sound sources.

10. The microphone sound source array positioning method according to claim 5, characterized in that: In S8, after receiving and analyzing the reflected sound wave, the sound wave is compared with the known sound source, the corresponding sound source coordinates are directly obtained, the sound source position is quickly identified, and the data with the same sound source but inconsistent coordinates are updated, so that the three-dimensional coordinates of the sound source change in real time as the target moves.

Images