Performance test method of sound source imaging system and related device
By using two test sound sources in the sound source imaging system in the sound source imaging system, the detection results of the sound source imaging system are obtained, and the problem of difficulty in evaluating the positioning accuracy of multiple sound sources in the prior art is solved. Accurate performance evaluation of the sound source imaging system in a multi-sound source environment is achieved.
Patent Information
- Application Number
- CN202310619029.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-26
- Publication Date
- 2024-11-26
AI Technical Summary
Existing sound source imaging systems are difficult to accurately judge the accuracy of multi-sound source positioning, and cannot effectively evaluate the positioning accuracy of multiple sound sources in practical applications.
Two test sound sources are used to maintain a first preset distance from the sound source imaging system, and have the same pitch angle but different azimuth angles relative to the sound source imaging system. The detection of the test sound source is obtained through the data acquisition module and the data processing module. As a result, it is determined whether the resolution accuracy of the sound source imaging system meets the requirements.
Through the detection results of the two test sound sources, it is intuitively and convenient to judge whether the positioning of the sound source imaging system for multiple sound sources is accurate, which improves the performance evaluation efficiency and accuracy of the sound source imaging system in a multi-sound source environment.
Smart Images

Figure CN119024257A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a performance testing method and related devices for a sound source imaging system. Background Art
[0002] The sound source imaging system is used to measure the sound field distribution within a certain range through a microphone array to measure the location of the object emitting the sound and display an intuitive image in the form of a cloud map. With the rapid development of sound source imaging technology, the accuracy of sound source positioning by the sound source imaging system has become the focus of users.
[0003] At present, the sound source imaging system is mainly used to measure the test sound source at a specific position to obtain the measured value of the test sound source at the position, and the measured value is compared with the actual standard value of the corresponding position to determine the accuracy of the sound source positioning of the sound source imaging system. However, this method cannot determine the accuracy of the sound source imaging system in locating multiple sound sources in actual applications. Summary of the invention
[0004] The main technical problem solved by the present application is to provide a performance testing method and related devices for a sound source imaging system, which can efficiently and accurately determine whether the sound source imaging system accurately locates multiple sound sources.
[0005] In order to solve the above technical problems, a technical solution adopted in the present application is: to provide a performance test method for a sound source imaging system, including: making two test sound sources have a first preset distance from the sound source imaging system respectively; wherein the two test sound sources have the same first preset pitch angle relative to the sound source imaging system, the two test sound sources have different first preset azimuth angles relative to the sound source imaging system, and the absolute value of the difference between the two first preset azimuth angles is 180°; making the two test sound sources emit sound waves of a first preset frequency and a first preset sound pressure level at the same time, and the sound source imaging system obtains a first detection result of the two test sound sources; wherein the first detection result includes a first test pitch angle and a first test azimuth angle of the corresponding test sound source; based on the first detection results of the two test sound sources, and the corresponding first preset pitch angle and first preset azimuth angle, determining whether the resolution accuracy of the sound source imaging system meets the corresponding requirements.
[0006] In order to solve the above technical problems, another technical solution adopted in the present application is: to provide a performance testing device for a sound source imaging system, comprising: a data acquisition module and a data processing module connected to each other; when two test sound sources are respectively at a first preset distance from the sound source imaging system, and the two test sound sources simultaneously emit sound waves of a first preset frequency and a first preset sound pressure level, the data acquisition module is used to acquire first detection results of the two test sound sources; wherein the two test sound sources respectively have the same first preset pitch angle relative to the sound source imaging system, the two test sound sources have different first preset azimuth angles relative to the sound source imaging system, and the absolute value of the difference between the two first preset azimuth angles is 180°; the data processing module is used to determine whether the resolution accuracy of the sound source imaging system meets the corresponding requirements based on the first detection results of the two test sound sources, and the corresponding first preset pitch angle and first preset azimuth angle.
[0007] To solve the above technical problems, another technical solution adopted in the present application is: to provide an electronic device, comprising a memory and a processor coupled to each other, wherein the memory stores program instructions, and the processor is used to execute the program instructions to implement the performance testing method of the sound source imaging system described in the above technical solution.
[0008] In order to solve the above technical problems, another technical solution adopted in the present application is: providing a computer-readable storage medium storing program instructions that can be executed by a processor, wherein the program instructions are used to implement the performance testing method of the sound source imaging system described in the above technical solution.
[0009] The above scheme obtains the first detection results of the sound source imaging system on the two test sound sources by making the two test sound sources have different first azimuth angles relative to the sound source imaging system. Based on the first detection results of the two test sound sources and the actual position information of each test sound source, it is judged whether the sound source imaging system meets the corresponding requirements. The method uses the test results of the two test sound sources to represent the imaging effect of the sound source imaging system on multiple sound sources in actual applications, and intuitively and conveniently judges whether the sound source imaging system accurately locates multiple sound sources. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:
[0011] Figure 1 is a schematic diagram of an implementation of a microphone array coordinate system of the present application;
[0012] Figure 2 It is a flow chart of an implementation method of a performance test method of a sound source imaging system of the present application;
[0013] Figure 3 It is a schematic diagram of the sound source imaging system and the test sound source corresponding to step S101.
[0014] Figure 4 It is a flow chart of another implementation method of the performance testing method of the sound source imaging system of the present application;
[0015] Figure 5 is a schematic diagram of an implementation of a sound source imaging system and a test sound source in step S201;
[0016] Figure 6 is a schematic diagram of another embodiment of a sound source imaging system and a test sound source;
[0017] Figure 7 It is a structural schematic diagram of an implementation method of a performance testing device of a sound source imaging system of the present application;
[0018] Figure 8 It is a structural schematic diagram of an implementation method of a sound source imaging system of the present application;
[0019] Fig. 9 This is a schematic diagram of the structure of an embodiment of the electronic device of the present application.
[0020] Fig.10 It is a structural schematic diagram of an implementation method of a computer-readable storage medium of the present application. DETAILED DESCRIPTION
[0021] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0022] The present application proposes a performance test method for a sound source imaging system, which specifically obtains the test results of the sound source imaging system for the test sound source to determine whether the sound source imaging system meets the corresponding requirements. Before the test, the sound source imaging system and / or the test sound source should be in an ideal test environment. The ideal test environment includes outdoor environment and indoor environment. The ambient temperature of the outdoor environment should be between -10°C and 50°C, the relative humidity should be between 30% and 85%, and closed obstructions should be avoided during the test to prevent the test from being affected. In addition, if the test is conducted outdoors, it is preferred to conduct the test in a sunny weather environment with a wind speed of less than 5m / s; or, when the test is conducted under special gas phase conditions, necessary measures should be taken to ensure the accuracy of the test, and the measures taken during the test and the specific meteorological conditions at the time should be recorded at the same time. The indoor environment should choose a relatively quiet indoor place, and the background noise should not be higher than 25dB. The frequencies of the ideal test sound source include a low frequency range and a high frequency range, the low frequency range is 1kHz to 20kHz, and the high frequency range is 20kHz to 60kHz; and the maximum playable sound pressure level of the ideal test sound source should be greater than or equal to 94dB.
[0023] In addition, in order to accurately and intuitively describe the location information of the sound source imaging system and the test sound source during the test, this application constructs a camera coordinate system with the center of the microphone array in the sound source imaging system as the origin to mark the coordinates of the observed object relative to the microphone array. Figure 1 , Figure 1 This is a schematic diagram of an embodiment of the microphone array coordinate system of the present application. In response to the sound source imaging system including a camera for collecting environmental images and a microphone array for collecting sound signals, a microphone array coordinate system is constructed with the center of the microphone array of the sound source imaging system as the coordinate origin O. Among them, the microphone array coordinate system includes an x-axis, a y-axis and a z-axis, the x-axis passes through the coordinate origin O and is parallel to the ground, the y-axis passes through the coordinate origin O and is perpendicular to the x-axis and the ground at the same time, and the z-axis passes through the coordinate origin O and is perpendicular to the plane where the x-axis and y-axis are located. In addition, in response to the existence of any point P in space, the projection P' of point P on the plane where the x-axis and y-axis are located is obtained, and the angle φ between OP' and the positive semi-axis of the x-axis is taken as the horizontal angle of point P relative to the microphone array coordinate system; and the angle θ between OP and the positive semi-axis of the z-axis is taken as the pitch angle of point P relative to the microphone array coordinate system, that is, it is considered that point P has a horizontal angle φ and a pitch angle θ relative to the sound source imaging system. In addition, it should be noted that the center of the camera lens in the sound source imaging system is the same as the center of the microphone array, that is, the center of the camera lens is located at the origin of the constructed microphone array coordinate system, so that the image information at any position obtained by the camera in the sound source imaging system corresponds to the sound information at that position collected by the microphone. Among them, the microphone array is a system composed of multiple microphones with a certain spatial topological structure, which samples and filters the spatial characteristics of the acoustic signal.
[0024] See also Figure 2 , Figure 2 1 is a flow chart of an embodiment of a performance test method of a sound source imaging system of the present application, the method comprising:
[0025] S101: Make the two test sound sources have a first preset distance from the sound source imaging system, wherein the two test sound sources have the same first preset elevation angle relative to the sound source imaging system, the two test sound sources have different first preset azimuth angles relative to the sound source imaging system, and the absolute value of the difference between the two first preset azimuth angles is 180°.
[0026] Specifically, preferably in an indoor environment, two test sound sources are set so that each test sound source maintains a first preset distance from the sound source imaging system, that is, the distance between each test sound source and the coordinate origin of the camera coordinate system is the first preset distance. In addition, each test sound source has the same first preset pitch angle relative to the sound source imaging system. In addition, the two test sound sources have different first preset azimuth angles relative to the sound source imaging system, and the absolute value of the difference between the first preset azimuth angles corresponding to the two test sound sources is 180°.
[0027] In one specific embodiment, see Figure 3 , Figure 3 Schematic diagram of the sound source imaging system and the test sound source corresponding to step S101. Specifically, a plurality of positions P1, P2, P3...P8 are set at a first preset distance r0 from the sound source imaging system, and the first preset pitch angle θ0 corresponding to each position is the same. Among them, the coordinates of P1 are (r0, θ0, 270°), the coordinates of P2 are (r0, θ0, 315°), the coordinates of P3 are (r0, θ0, 0°), the coordinates of P4 are (r0, θ0, 45°), the coordinates of P5 are (r0, θ0, 90°), the coordinates of P6 are (r0, θ0, 135°), the coordinates of P7 are (r0, θ0, 180°), and the coordinates of P8 are (r0, θ0, 225°). Taking P1 and P5 as examples, these two positions are at a first preset distance r0 from the sound source imaging system, and P1 and P5 have the same first preset pitch angle θ0 relative to the sound source imaging system. Among them, the first preset azimuth angle of P1 is 270°, and the first preset azimuth angle of P5 is 90°. Therefore, in order to keep the absolute value of the difference between the first preset azimuth angles corresponding to the two test sound sources at 180°, in step S101, one of the test sound sources can be set at P1 and the other test sound source can be set at P5; or one of the test sound sources can be set at P2 and the other test sound source can be set at P6, and so on.
[0028] Optionally, in this specific embodiment, eight positions are evenly set at the first preset distance r0 from the sound source imaging system, and the first preset azimuth angles corresponding to adjacent positions differ by 45°, and the first preset distance r0 is 2m, and the first preset elevation angle θ0 corresponding to each position is 5°. However, in other embodiments, other numbers of positions may be set according to actual conditions, for example, 10 positions are set at the first preset distance r0 from the sound source imaging system, and the first preset azimuth angles corresponding to adjacent positions differ by 36°; and the first preset distance r0 may also be other, such as 1m, 3m or 4m, etc.; the first preset elevation angle θ0 may also be other, such as 3°, 4°, 6° or 7°, etc. It should be noted that it is preferred to set the first preset azimuth difference corresponding to adjacent positions to a factor of 180°, so as to help obtain multiple sets of position pairs within the azimuth range of 0° to 360°, and the first preset azimuths corresponding to the two positions in each position pair differ by 180°; in addition, the distance between the center of the circle where the multiple positions are located and each position should be less than a threshold, which can be the distance between the origin of the camera coordinate system and the ground, that is, when the first preset distance r0 is large, an appropriate first preset pitch angle θ0 is set to prevent the distance between the center of the circle where the multiple positions are located and some positions from exceeding the threshold.
[0029] S102: The two test sound sources are caused to emit sound waves of a first preset frequency and a first preset sound pressure level simultaneously, and the sound source imaging system obtains a first detection result of the two test sound sources, wherein the first detection result includes a first test pitch angle and a first test azimuth angle corresponding to the test sound source.
[0030] Specifically, the two test sound sources are made to emit sound waves of the first preset frequency and the first preset sound pressure level at the same time. The sound pressure level is 10 times the common logarithm of the ratio of the square of the current sound pressure to the square of the reference sound pressure. The calculation process between the sound pressure level and the sound pressure can refer to the prior art and will not be elaborated in detail here; the first preset frequency is 1kHz, and the first preset sound pressure level is 64dB. Furthermore, the sound source imaging system is made to collect data from the test sound source, and the collected data is processed to obtain the first detection results for the two test sound sources.
[0031] Specifically, the microphone array in the sound source imaging system collects sound waves emitted by the two test sound sources, and the sound source imaging system processes the collected sound waves so that different sound pressure level values at different positions in the environment are displayed in the form of a heat map in the environment image obtained by the camera, so as to generate a sound source image for representing the distribution of the sound field in the display space, and the sound source image includes the first test pitch angle and the first test azimuth angle respectively corresponding to the two test sound sources determined by sound source positioning.
[0032] On the other hand, the sound source imaging system determines the position of the sound-emitting object and determines the first test azimuth and the first test elevation of the test sound source in the microphone array coordinate system through the sound pressure level distribution. The sound pressure level distribution is the distribution formed by decomposing the acoustic signal detected by the acoustic sensor into different azimuths and elevations. In addition, the above-mentioned heat map is a data visualization technology that uses two-dimensional colors to display the spatial distribution of sound size. For example, darker colors are used to display areas with higher sound pressure levels in the space, and lighter colors are used to display areas with lower sound pressure levels in the space.
[0033] Optionally, in the actual test process, the first preset frequency may also be other, such as 2kHz, 5kHz, 10kHz, 20kHz or 30kHz, etc.; the first preset sound pressure level may also be other, such as 50dB, 55dB, 60dB or 65dB, etc.
[0034] S103: Determine whether the resolution accuracy of the sound source imaging system meets corresponding requirements based on the first detection results of the two test sound sources, and the corresponding first preset pitch angle and first preset azimuth angle.
[0035] Specifically, in response to the first detection result of one of the test sound sources including the first test pitch angle and the first test azimuth angle, and the corresponding preset position at the location of the test sound source including the first preset pitch angle and the first preset azimuth angle, the first difference between the first test pitch angle and the first preset pitch angle corresponding to the test sound source, and the second difference between the first test azimuth angle and the first preset azimuth angle are obtained, and the test position accuracy of the sound source imaging system for the test sound source can be intuitively represented by the first difference and the second difference. In response to the absolute value of the first difference and the absolute value of the second difference corresponding to each test sound source being less than or equal to the resolution threshold, it is determined that the resolution accuracy of the sound source imaging system meets the corresponding requirements. Among them, in this embodiment, the resolution threshold is 10°, that is, in response to the absolute value of the first difference and the absolute value of the second difference of each test sound source being less than or equal to 10°, it is determined that the resolution accuracy of the sound source imaging system meets the corresponding requirements. Optionally, in other embodiments, the corresponding resolution threshold can also be set according to actual conditions, such as 8°, 9° or 11°.
[0036] In a specific implementation, please continue to refer to Figure 3 In response to the image containing multiple position pairs, such as P1 and P5, P2 and P6, P3 and P7, P4 and P8, a first detection result of the sound source imaging system for two test sound sources located at each position pair is obtained. In response to the absolute value of the first difference and the absolute value of the second difference corresponding to each first detection result being less than or equal to the resolution threshold, it is determined that the resolution accuracy of the sound source imaging system meets the corresponding requirements.
[0037] In addition, it should be noted that if the first detection result of the two test sound sources obtained by the sound source imaging system does not satisfy the requirements of including the first test pitch angle and the first test azimuth angle corresponding to each test sound source, that is, the two test sound sources cannot be distinguished in the obtained first detection structure or the two test sound sources overlap into one test sound source, and the first detection result only includes the first test pitch angle and the first test azimuth angle corresponding to the overlapping test sound source, then it is determined that the resolution accuracy of the sound source imaging system does not meet the corresponding requirements.
[0038] The present application obtains the first detection results of the sound source imaging system on the two test sound sources by making the two test sound sources have different first azimuth angles relative to the sound source imaging system. Based on the first detection results of the two test sound sources and the actual position information of each test sound source, it is judged whether the sound source imaging system meets the corresponding requirements. The method uses the test results of the two test sound sources to represent the imaging effect of the sound source imaging system on multiple sound sources in actual applications, and intuitively and conveniently judges whether the sound source imaging system accurately locates multiple sound sources.
[0039] In another embodiment, the performance testing method of the sound source imaging system proposed in the present application further includes: determining whether the imaging range of the sound source imaging system meets corresponding requirements.
[0040] Specifically, see Figure 4 , Figure 4 This is a flow chart of another embodiment of the performance test method of the sound source imaging system of the present application. This embodiment specifically includes:
[0041] S201: Determine a first preset position, a second preset position, a third preset position, and a fourth preset position that have a second preset distance from a sound source imaging system.
[0042] Specifically, preferably in an indoor environment, a first preset position, a second preset position, a third preset position and a fourth preset position are determined. The absolute value of the difference between the first preset position and the second preset position relative to the second preset azimuth of the sound source imaging system, and the absolute value of the difference between the third preset position and the fourth preset position relative to the second preset azimuth of the sound source imaging system are both 180°, the first preset position and the second preset position relative to the second preset elevation of the sound source imaging system are a first angle, and the third preset position and the fourth preset position relative to the second preset elevation of the sound source imaging system are a second angle.
[0043] In one specific embodiment, see Figure 5 , Figure 5Schematic diagram of an implementation of a sound source imaging system and a test sound source in step S201. Specifically, the first preset position P1, the second preset position P2, the third preset position P3 and the fourth preset position P4 are determined, and the intersection of the line connecting the first preset position P1 and the second preset position P2 and the line connecting the third preset position P3 and the fourth preset position P4 is located on the z-axis of the microphone array coordinate system, that is, the first preset position P1, the second preset position P2, the third preset position P3 and the fourth preset position P4 are located in the same plane, and the center of the plane is located on the z-axis of the microphone array coordinate system. The second preset pitch angles of the first preset position P1 and the second preset position P2 are both 20°, that is, the above-mentioned first angle is 20°. The second preset pitch angles of the third preset position P3 and the fourth preset position P4 are 30°, that is, the above-mentioned second angle is 30°. It should be noted that since the second preset pitch angles of the first preset position P1 and the second preset position P2 are different from the second preset pitch angles of the third preset position P3 and the fourth preset position P4, the second preset distances of the first preset position P1 and the second preset position P2 relative to the sound source imaging system are also different from the second preset distances of the third preset position P3 and the fourth preset position P4 relative to the sound source imaging system.
[0044] Optionally, in this embodiment, the distance from the center of the plane where the first preset position P1, the second preset position P2, the third preset position P3 and the fourth preset position P4 are located to the microphone array coordinate system is set to 2m. Of course, in other embodiments, the distance from the center of the plane where the first preset position P1, the second preset position P2, the third preset position P3 and the fourth preset position P4 are located to the microphone array coordinate system may also be other, such as 1m, 3m or 4m.
[0045] S202: The test sound source emits sound waves of a second preset frequency and a second preset sound pressure level at the first preset position, the second preset position, the third preset position and the fourth preset position, respectively, so that the sound source imaging system obtains a second detection result corresponding to the test sound source.
[0046] For details, please continue to see Figure 5 In response to the test sound source moving from the first preset position P1 to the second preset position P2, the third preset position P3 and the fourth preset position P4 in sequence in step S201, the test sound source emits a sound wave of a second preset frequency and a second preset sound pressure level at each position. The second preset frequency is the same as the first preset frequency, and the second preset sound pressure level is the same as the first preset sound pressure level.
[0047] Further, the sound source imaging system obtains a second detection result corresponding to the test sound source at each position. Obtaining the second detection result of the test sound source at the current position helps to determine whether the test result of the sound source imaging system for the current test sound source is accurate. The second detection result includes a fourth test pitch angle and a fourth test azimuth angle of the test sound source at the corresponding position.
[0048] S203: Determine whether the imaging range of the sound source imaging system meets corresponding requirements based on all second preset pitch angles and corresponding second detection results.
[0049] Specifically, in response to the fourth test pitch angle and the fourth test azimuth angle corresponding to the corresponding test sound source included in the second detection result, a first sum value θ of the fourth test pitch angle corresponding to the test sound source at the first preset position P1 and the second preset position P2 is obtained, and a second sum value φ of the fourth test pitch angle of the test sound source at the third preset position P3 and the fourth preset position P4 is obtained. In response to the first sum value θ being greater than or equal to the first imaging range threshold, and the second sum value φ being greater than or equal to the second imaging range threshold, it is determined that the imaging range of the sound source imaging system meets the corresponding requirements. Among them, the first imaging range threshold is 40°, and the second imaging range threshold is 60°.
[0050] Optionally, in another embodiment, in response to the above-mentioned second detection result also including the sound source image generated by the sound source imaging system, the present application determines whether the imaging range of the sound source imaging system meets the corresponding requirements, and may also include: detecting all sound source images, and in response to all sound source images including a single bright spot and the fourth test pitch angle and the fourth test azimuth angle of the corresponding test sound source, determining that the imaging range of the sound source imaging system meets the corresponding requirements.
[0051] In another embodiment, the performance testing method of the sound source imaging system proposed in the present application further includes: determining whether the imaging response time of the sound source imaging system meets corresponding requirements.
[0052] Specifically, preferably in an indoor environment, a third preset distance is provided between the test sound source and the sound source imaging system. The test sound source has a third preset pitch angle and a third preset azimuth angle relative to the sound source imaging system. In this embodiment, the third preset distance is the same as the first preset distance mentioned in the above embodiment, both of which are 2m; and the third preset pitch angle and the third preset azimuth angle are both 0°, that is, the test sound source is facing the sound source imaging system. By facing the test sound source directly to the sound source imaging system, it is helpful for the sound source imaging system to collect the sound signal of the test sound source.
[0053] Furthermore, the test sound source is made to emit a sound wave of a third preset frequency and a third preset sound pressure level, and the first moment when the sound source imaging system starts the sound source imaging test and the second moment when the sound source imaging system generates the sound source image are obtained. The third preset frequency is the same as the first preset frequency in the above embodiment, and the third preset sound pressure level is the same as the first preset sound pressure level in the above embodiment.
[0054] In a specific implementation, a first moment when a test is started and recorded by a sound source imaging system, and a second moment when a sound source image is generated and recorded by the sound source imaging system are acquired.
[0055] In another specific embodiment, the display interface and the control interface of the sound source imaging system are photographed by a camera device to obtain multiple first images. The first moment and the second moment are determined by processing the multiple first images. Specifically, in response to the start test button of the control interface in the current first image being triggered, the moment corresponding to the current first image is taken as the first moment; in response to the sound source image appearing on the display interface in the current first image, the moment corresponding to the current first image is taken as the second moment. Among them, it can be determined by image detection whether the start test button in the current image is triggered and whether the sound source image appears on the display interface in the current image. In addition, in order to ensure the accuracy of the collected information, in this specific embodiment, the shooting frequency of the camera device is not less than 30fps.
[0056] In another specific embodiment, in response to the camera having an audio acquisition function, after the test sound source emits a sound wave, the moment when the camera first acquires the sound wave is taken as the first moment; and the moment when the sound source image first appears in the photo of the sound source imaging system display interface taken by the camera is taken as the second moment. In order to ensure the accuracy of the acquired information, in this specific embodiment, the camera frequency of the camera is not less than 30fps, and the audio sampling rate is not less than 20kHz.
[0057] Furthermore, an imaging response time is obtained based on the first moment and the second moment. Specifically, the second moment is subtracted from the first moment to obtain the imaging response time, and the imaging speed of the sound source imaging system is intuitively described by the imaging response time. The imaging response time is compared with the first preset time. In response to the imaging response time being less than or equal to the first preset time, it is determined that the imaging response time of the sound source imaging system meets the corresponding requirements. Among them, the first preset time is 200ms. Optionally, in other embodiments, the first preset time may also be other, such as 150ms or 250ms.
[0058] In another embodiment, the performance testing method of the sound source imaging system proposed in the present application further includes: determining whether the positioning accuracy of the sound source imaging system meets corresponding requirements.
[0059] First, in an indoor environment, a fourth preset distance is set between the test sound source and the sound source imaging system. The test sound source has a fourth preset pitch angle and a fourth preset azimuth relative to the sound source imaging system. In this embodiment, the fourth preset pitch angle and the fourth preset azimuth are both 0°, that is, the test sound source is facing the sound source imaging system. In addition, in this embodiment, it is preferred to conduct the test in an indoor environment, and the fourth preset distance can be 2m; of course, in other test scenarios, the fourth preset distance can also be 1m, 3m, 4m or 6m, etc.
[0060] Further, the test sound source is made to emit a sound wave of a fourth preset frequency and a fourth preset sound pressure level. The fourth preset frequency is the same as the first preset frequency in the above embodiment, and the fourth preset sound pressure level is the same as the first preset sound pressure level in the above embodiment. The sound source imaging system obtains a third detection result of the test sound source until a first preset number of third detection results are obtained. The third detection result includes a second test pitch angle and a second test azimuth angle corresponding to the test sound source.
[0061] Specifically, the first preset number is 1000. After the test sound source emits the corresponding sound wave, 1000 frames of sound source images generated by the sound source imaging system collected by the camera are continuously acquired, thereby obtaining 1000 sets of third detection results. Of course, in other implementation scenarios, the first preset number may also be other values such as 800, 900 or 1100.
[0062] Further, based on all fourth preset pitch angles and fourth preset azimuth angles and the third detection result, it is determined whether the sound source positioning accuracy of the sound source imaging system meets the corresponding requirements. Specifically, the pitch angle mean of all second test pitch angles and the azimuth angle mean of all second test azimuth angles are obtained, the fifth difference between the fourth preset pitch angle and the pitch angle mean, and the sixth difference between the fourth preset azimuth angle and the azimuth mean are obtained, and in response to the absolute value of the fifth difference and the absolute value of the sixth difference being less than the positioning accuracy threshold, it is determined that the positioning accuracy of the sound source imaging system meets the corresponding requirements. Among them, the above positioning accuracy threshold is 3°. Of course, in other embodiments, the above positioning accuracy threshold may also be other, such as 1°, 2° or 4°, etc. In this embodiment, by placing the test sound source directly opposite the sound source imaging system, according to the actual position information of the test sound source and the test position information, it is more convenient to judge whether the positioning accuracy of the sound source imaging system for the test sound source meets the requirements.
[0063] Optionally, in other embodiments, in response to the third detection result obtained also including the sound source center test coordinates, judging whether the positioning accuracy of the sound source imaging system meets the corresponding requirements includes: obtaining the first angle between the sound source center test coordinates corresponding to each third detection result and the preset coordinates of the test sound source, calculating the average value of all first angles to obtain the angle average value, comparing the angle average value with the positioning accuracy threshold, and if the angle average value is less than the positioning accuracy threshold, then judging that the positioning accuracy of the sound source imaging system meets the corresponding requirements. The specific value of the above positioning accuracy threshold can refer to the above corresponding embodiment.
[0064] In another embodiment, the performance testing method of the sound source imaging system proposed in the present application further includes: determining whether the repeatability of the sound source imaging system meets corresponding requirements.
[0065] Specifically, in an indoor environment, a fifth preset distance is set between the test sound source and the sound source imaging system. The test sound source has a fifth preset elevation angle and a fifth preset azimuth angle relative to the sound source imaging system. In this embodiment, the fifth preset distance is the same as the first preset distance mentioned in the above embodiment, both of which are 2m; the fifth preset elevation angle and the fifth preset azimuth angle are both 0°, that is, the test sound source is facing the sound source imaging system.
[0066] Further, the test sound source emits a sound wave of a fifth preset frequency and a fifth preset sound pressure level. The fifth preset frequency is the same as the first preset frequency in the above embodiment, and the fifth preset sound pressure level is the same as the first preset sound pressure level in the above embodiment. The sound source imaging system continuously obtains a fourth detection result of the test sound source until a second preset number of fourth detection results are obtained. The fourth detection result includes a third test pitch angle and a third test azimuth angle corresponding to the test sound source.
[0067] Specifically, in response to the second preset number being 1000, 1000 frames of sound source images generated by the sound source imaging system and continuously captured by the camera are acquired, thereby obtaining 1000 sets of fourth detection results. Of course, the second preset number may also be other, such as 800, 900 or 1100.
[0068] Further, a test pitch angle standard deviation is obtained based on the third test pitch angles corresponding to all fourth detection results, and a test azimuth angle standard deviation is obtained based on the third test azimuth angles corresponding to all fourth detection results. Specifically, the standard deviation of all third test pitch angles obtained is calculated to obtain the test pitch angle standard deviation, and the standard deviation of all third test azimuth angles obtained is calculated to obtain the test azimuth angle standard deviation. The calculation formula of the standard deviation is as follows:
[0069]
[0070] Among them, σ represents the standard deviation of the measured sample data, X i represents the sample value of the i-th measurement, represents the average value of the sample data, and N represents the number of measurements.
[0071] Further, in response to the test pitch angle standard deviation and the test azimuth angle standard deviation being less than or equal to the repeatability threshold, it is determined that the sound source imaging system meets the corresponding repeatability test requirements. The repeatability threshold is 0.03°. Optionally, in other embodiments, the repeatability threshold may also be other, such as 0.01°, 0.02° or 0.04°, etc. This embodiment obtains multiple groups of fourth detection results to intuitively represent the stability of the sound source imaging system under continuous operation.
[0072] In another embodiment, the performance testing method of the sound source imaging system proposed in the present application further includes: determining whether the sound source imaging system meets the corresponding sound pressure level test requirements.
[0073] In one implementation scenario, in an indoor environment, a sixth preset distance is set between the test sound source and the sound source imaging system, and the sixth preset distance is the same as the first preset distance mentioned in the above embodiment. The test sound source has a sixth preset elevation angle and a sixth preset azimuth angle relative to the sound source imaging system, and the sixth preset elevation angle and the sixth preset azimuth angle are both 0°, that is, the test sound source is facing the sound source imaging system.
[0074] Further, the sound waves emitted by the test sound source are kept at the sixth preset frequency, the sixth preset sound pressure level of the test sound source is changed from the first value to the second value, and the sixth preset sound pressure level of the test sound source is changed from the second value to the third value, to obtain the minimum imaging sound pressure level and the maximum imaging sound pressure level of the sound source imaging system for the test sound source. The sixth preset frequency is the same as the first preset frequency mentioned in the above embodiment, the first value is 90, the second value is 20, and the third value is 100.
[0075] Specifically, in response to the test sound source being directly facing the sound source imaging system and the test sound source being at a sixth preset distance from the sound source imaging system, the sound pressure level of the test sound source is smoothly reduced from 90dB to 20dB at an appropriate change speed, and the imaging condition of the display interface of the sound source imaging system is acquired in real time, and the minimum imaging sound pressure level is obtained through the imaging condition of the display interface; and, the sound pressure level of the test sound source is smoothly increased from 20dB to 100dB at an appropriate change speed, and the imaging condition of the display interface of the sound source imaging system is acquired in real time, and the maximum imaging sound pressure level is obtained through the imaging condition of the display interface.
[0076] In a specific embodiment, in the process of reducing the sixth preset sound pressure level of the test sound source from the first value to the second value, the third moment corresponding to the final appearance of the sound source image on the display interface recorded by the sound source imaging system is obtained, and in response to the sound source image no longer appearing in the display interface of the sound source imaging system within a third preset time after the third moment, the sound pressure level value of the test sound source corresponding to the third moment is obtained and used as the minimum imaging sound pressure level; and, in the process of increasing the sixth preset sound pressure level of the test sound source from the second value to the third value, the fourth moment when the sound source image disappears in the display interface recorded by the sound source imaging system is obtained, and in response to the sound source image no longer appearing in the display interface within a fourth preset time after the fourth moment, the sound pressure level value of the test sound source corresponding to the fourth moment is obtained and used as the maximum imaging sound pressure level.
[0077] Optionally, the display interface of the sound source imaging system can also be photographed by a camera device to obtain multiple second images. By processing the multiple second images, a third moment at which the sound source image disappears from the display interface of the sound source imaging system in the process of reducing the sixth preset sound pressure level of the test sound source from the first value to the second value is obtained; and a fourth moment at which the sound source image disappears in the process of increasing the sixth preset sound pressure level of the test sound source from the second value to the third value. In response to the sound source image no longer appearing in the display interface of the corresponding second image within the third preset time after the third moment, the sound pressure level value of the test sound source corresponding to the third moment is obtained and used as the minimum imaging sound pressure level; and in response to the sound source image no longer appearing in the display interface of the corresponding second image within the fourth preset time after the fourth moment, the sound pressure level value of the test sound source corresponding to the fourth moment is obtained and used as the minimum imaging sound pressure level. Among them, a decibel recorder can be set near the test sound source to record the sound pressure level value of the test sound source in real time.
[0078] Further, in response to the minimum imaging sound pressure level being less than or equal to the preset minimum sound pressure level, and the maximum imaging sound pressure level being greater than or equal to the preset maximum sound pressure level, it is determined that the sound source imaging system meets the corresponding sound pressure level test requirements. Wherein, in this embodiment, the preset minimum sound pressure level is 25dB, and the preset maximum sound pressure level is 90dB, then when the minimum imaging sound pressure level is less than or equal to 25dB, and the maximum imaging sound pressure level is greater than or equal to 90dB, it is determined that the sound source imaging system meets the corresponding requirements for the sound pressure level test range of the sound source.
[0079] In another embodiment, the performance testing method of the sound source imaging system proposed in the present application further includes: determining whether the sound source imaging system meets the corresponding imaging distance requirements.
[0080] In one implementation scenario, the test is conducted in an outdoor environment, the seventh preset pitch angle and the seventh preset azimuth angle of the test sound source relative to the sound source imaging system are kept unchanged, and the sound waves emitted by the test sound source are kept at the seventh preset frequency and the seventh preset sound pressure level. Wherein, the seventh preset pitch angle and the seventh preset azimuth angle are both 0°, the seventh preset frequency is the same as the first preset frequency, and the seventh preset sound pressure level is the same as the first preset sound pressure level.
[0081] Further, the seventh preset distance between the test sound source and the sound source imaging system is uniformly increased from the fourth value to obtain the minimum imaging distance and the maximum imaging distance of the sound source imaging system for the test sound source. Specifically, the fourth value is 1, that is, the test sound source is obtained at an appropriate speed from 1m away from the sound source imaging system, and the image of the display interface of the sound source imaging system at this time is obtained. In response to the appearance of the sound source image in the display interface of the sound source imaging system, the test sound source is uniformly moved in the direction away from the sound source imaging system. In response to the disappearance of the sound source image in the display interface of the sound source imaging system, the seventh preset distance between the test sound source and the sound source imaging system at this time is used as the maximum imaging distance. Among them, the process of the test sound source moving at a uniform speed in the direction away from the sound source imaging system is: moving 0.5m every same time. Optionally, the above-mentioned fourth value can also be other, such as 2, 3 or 4, etc.; the distance moved by the test sound source each time can also be other, such as 0.3m, 0.4m, 0.6m or 1m, etc.
[0082] Further, in response to the maximum imaging distance being greater than or equal to the preset maximum distance, the sound source imaging system is determined to meet the corresponding imaging distance requirements. Wherein, the preset maximum distance is 40m, then when the maximum imaging distance is greater than or equal to 40m, it is determined that the distance test range of the sound source imaging system for the sound source meets the corresponding requirements.
[0083] In another embodiment, the performance testing method of the sound source imaging system proposed in the present application further includes: determining whether the sound source imaging system meets the requirements of the video frame rate and the continuous working time.
[0084] In one implementation scenario, the sound source imaging system is made to perform a video recording operation, and the display frame rate of the sound source imaging is obtained. Specifically, the test sound source is located within the test range of the sound source imaging system, and emits a sound wave of an eighth preset frequency and an eighth preset sound pressure level. Among them, the eighth preset frequency is 1kHz, and the eighth preset sound pressure level is 50dB. Of course, in other implementations, the eighth preset frequency may also be other, such as 2kHz, 3kHz or 10kHz, etc.; the eighth preset sound pressure level may also be other, such as 45dB, 55dB or 60dB, etc.
[0085] Furthermore, the sound source imaging system is made to record, and the video data recorded by the sound source imaging system is obtained, and the corresponding frame rate detection result is obtained based on the video data, and the frame rate detection result includes the display frame rate of the video data. Specifically, the video data is input into the frame rate detection device, and the frame rate detection result of the frame rate detection device for the video data is obtained. In response to the frame rate detection result being greater than or equal to the preset frame rate, it is determined that the sound source imaging system meets the recording frame rate requirement. Among them, in this embodiment, the preset frame rate is 25. Of course, in other embodiments, the corresponding preset frame rate can also be set according to actual needs, such as 20 or 30.
[0086] In another implementation scenario, the step of determining whether the sound source imaging system meets the continuous working time requirement includes: disconnecting the charging power supply after the sound source imaging system is fully charged, and obtaining the first working time of the sound source imaging system in the camera mode and the second working time in the video recording mode. Specifically, in response to disconnecting the charging power supply after the sound source imaging system is fully charged, and immediately placing it in the camera mode, the time between disconnecting the power supply and exhausting the power supply of the sound source imaging system is taken as the first working time; and the second working time of the sound source imaging system in the video recording mode is obtained in the above manner. In response to the first working time and the second working time being greater than or equal to the preset working time, it is determined that the sound source imaging system meets the continuous working time requirement. Among them, the sound source imaging system can be made to take pictures at intervals in the camera mode to simulate the state of the sound source imaging system in actual work. In addition, the above preset working time is 4 hours. Of course, in other embodiments, the preset working time can also be set according to actual conditions, such as 4.5 hours or 5 hours.
[0087] In another embodiment, the performance testing method of the sound source imaging system proposed in the present application further includes: determining whether the sound source imaging system meets corresponding functional requirements.
[0088] Specifically, the functions of the sound source imaging system are tested. The functions of the sound source imaging system include at least one of a sensor detection function, a heat map preview function, a heat map color band adjustment function, a sound source imaging function, a sound source localization function, a frequency adjustment function, a sound pressure level adjustment function, a sound source imaging range adjustment function, a time-frequency graph display function, a sound source switching function, a shooting and / or recording function, a recording function, and a playback function. In response to the sound source imaging system having all of the above functions, and the sound source imaging system being able to use all of the above functions normally without being connected to the network, it is determined whether the sound source imaging system meets the corresponding functional requirements.
[0089] Before testing whether the sound source imaging system meets the corresponding functional requirements, the test sound source is located at a specified position, and the sound waves of the ninth preset frequency and the ninth preset sound pressure level of the test sound source are made. The above-mentioned specified position is directly opposite to the sound source imaging system, and there is a ninth preset distance between the test sound source imaging system, and the ninth preset distance can be 2m. In addition, the above-mentioned ninth preset frequency is the same as the first preset frequency, and the ninth preset sound pressure level is the same as the first preset sound pressure level. Optionally, in other embodiments, the ninth preset distance can also be other such as 1m, 3m or 4m; the specific position of the test sound source can be set according to actual conditions, such as directly opposite to the sound source imaging system.
[0090] In a specific implementation, the sound source imaging system is made to test the test sound source, and the display interface of the sound source imaging system is obtained. In response to the display interface showing a thermal map corresponding to the test sound source before the sound source imaging system takes a photo or records a video, the sound source imaging system is determined to have a thermal map preview function. In addition, in response to the display interface showing a single, localized bright spot, and simultaneously showing the azimuth and elevation angle of the center of the bright spot, the sound source imaging system is determined to have sound source imaging and sound source localization functions.
[0091] In a specific embodiment, in response to the sound source imaging system supporting the display of the thermal map of the test sound source by changing different colors, it is determined that the sound source imaging system has the function of adjusting the color band of the thermal map. Specifically, the sound source imaging system is made to display the thermal map according to the preset color, and the test thermal map formed by the sound source imaging system for the test sound source is obtained, and by comparing the test thermal map with the preset color, it is determined whether the preset color corresponds to the color of the test thermal map. For example, after setting the preset colors to red and blue, the test thermal map of the test sound source by the sound source imaging system is obtained. If the position with a larger sound pressure level in the test thermal map is displayed as red, and the position with a smaller sound pressure level is displayed as blue, it is considered that the preset color corresponds to the color of the thermal map, and the sound source imaging system has the function of adjusting the color band of the thermal map. Further, the preset color is changed, and the test thermal map of the test sound source by the sound source imaging system is re-acquired. In response to the color in the re-acquired test thermal map corresponding to the changed preset color, it is determined that the sound source imaging system has the function of adjusting the color band of the thermal map. It should be noted that, in actual applications, the heat map generated by the sound source imaging system is represented by multiple colors, and each color corresponds to the sound pressure level within a specific range.
[0092] In a specific embodiment, in response to the sound source imaging system being provided with a corresponding optimal imaging frequency, and when the optimal imaging frequency of the sound source imaging system is changed, the sound source image generated by the sound source imaging system is changed accordingly, and the sound source imaging system is determined to have a frequency adjustment function. Specifically, when the center frequency of the test sound source is 10kHz, the sound source images generated by the sound source imaging system at the optimal imaging frequencies of 5kHz, 10kHz and 15kHz are obtained, and the generated sound source images are compared. In response to the sound source image corresponding to the optimal imaging frequency of 10kHz being the clearest, the sound source imaging system is determined to have a frequency adjustment function.
[0093] Alternatively, in response to the sound source imaging system being set with a corresponding imaging frequency range and changing the imaging frequency range, when the center frequency of the test sound source is within the imaging frequency range, the sound source imaging system generates a thermal map of the test sound source, and it is determined that the sound source imaging system has a frequency adjustment function.
[0094] For example, when the center frequency of the test sound source is 1kHz, the imaging frequency range of the sound source imaging system is set to 2kHz to 3kHz, the sound source image of the test sound source obtained by the sound source imaging system within the imaging frequency range is obtained, the sound source image is detected, and a clear sound source thermal map is obtained in the sound source image; and after the imaging frequency range is changed to 0.5kHz to 1.5kHz, the sound source image generated by the sound source imaging system is obtained, and a clear thermal map is detected in the sound source image; based on the above, it is determined that the sound source imaging system has a frequency adjustment function. It should be noted that the examples given in this application are only for illustration purposes. In actual applications, the specific values can be changed as needed.
[0095] In another specific embodiment, in response to the sound source imaging system being provided with a corresponding imaging sound pressure level range, when the sound pressure level of the test sound source is within the imaging sound pressure level range, the sound source imaging system generates a thermal map of the test sound source; and when the sound pressure level of the test sound source is outside the imaging sound pressure level range, the sound source imaging system does not generate a thermal map corresponding to the test sound source, then it is determined that the sound source imaging system has a sound pressure level adjustment function.
[0096] For example, in response to the sound source imaging system being able to perform sound source imaging on a sound source with a sound pressure level between 25dB and 120dB, making the sound pressure level of the test sound source 40dB, and making the imaging sound pressure level range of the sound source imaging system 50dB to 100dB, obtaining a sound source image of the test sound source obtained by the sound source imaging system within the imaging sound pressure level range, detecting the sound source image, and obtaining a sound source thermal map in which no clear sound source appears in the sound source image; and, after changing the imaging sound pressure level range to 30dB to 100dB, obtaining a sound source image generated by the sound source imaging system, and detecting a clear thermal map in the sound source image; based on the above, it is determined that the sound source imaging system has the sound pressure level adjustment function.
[0097] In another specific embodiment, in response to the sound source imaging system being provided with a corresponding adjustable imaging range, when the test sound source is located within the adjustable imaging range, the sound source imaging system generates a thermal map of the test sound source; and when the sound pressure level of the test sound source is outside the adjustable imaging range, the sound source imaging system does not generate a thermal map corresponding to the test sound source, then it is determined that the sound source imaging system has an imaging range adjustment function. The specific test process can refer to the above corresponding implementation mode and will not be elaborated in detail here. It should be noted that the above adjustable imaging range includes a maximum pitch angle and a maximum distance, the maximum distance being the distance between the sound source and the sound source imaging system, and the adjustable imaging range does not exceed the maximum imaging range of the sound source imaging system.
[0098] In another specific embodiment, in response to obtaining a time-frequency diagram generated by the display interface of the sound source imaging system, it is determined that the sound source imaging system has the function of displaying the time-frequency diagram. Specifically, the display interface of the sound source imaging system can be obtained, and image detection can be performed on the display interface to determine whether the display interface contains the corresponding time-frequency diagram. If it does, the sound source imaging system has the function of displaying a video image to help adjust the optimal imaging frequency of the sound source imaging system based on the information displayed by the time-frequency diagram. The above-mentioned time-frequency diagram includes the Fourier analysis results of the test sound source collected during the time interval when the sound source imaging system collects the test sound source, that is, including the corresponding time, frequency and sound pressure level.
[0099] In another specific embodiment, at least two test sound sources are located within the imaging range of the sound source imaging system, and a sound source image obtained by the sound source imaging system in a single sound source mode and a sound source image obtained by the sound source imaging system in a multi-sound source mode are obtained. The sound source images are identified, and in response to the appearance of only a single bright spot in the sound source image in the single sound source mode and the appearance of multiple bright spots in the sound source image in the multi-sound source mode, it is determined that the sound source imaging system has a sound source switching function.
[0100] In another specific embodiment, the sound source imaging system is enabled to take photos and / or record videos of the test sound source, and in response to obtaining the corresponding sound source images and / or video data stored by the sound source imaging system, it is determined that the sound source imaging system has the photographing and / or recording function.
[0101] In another specific embodiment, the sound source imaging system is made to take photos and record videos of the test sound source. After the sound source imaging system saves the generated images and video data, the sound source imaging system is made to display the saved images, obtain the display interface of the sound source imaging system, and determine whether the sound source imaging system has a recording function based on the display interface. Specifically, a third image of the display interface captured by the camera is obtained, and the third image is image detected. In response to the third image containing the image of the test sound source saved by the sound source imaging system, it is determined that the sound source imaging system has a recording function. In addition, the sound source imaging system is made to play back the saved video data, and the display interface and sound information of the sound source imaging system are obtained in real time. In response to the display interface displaying the saved video data in real time and the sound source imaging system playing the audio data corresponding to the video data in real time, it is determined that the sound source imaging system has a playback function. Specifically, the detection video of the display interface of the sound source imaging system recorded by the camera is obtained, and the detection video is identified. If the detection video contains the video data and the corresponding audio data saved by the sound source imaging system, it is determined that the sound source imaging system has a playback function.
[0102] In another specific embodiment, the sound source imaging system is made to continuously test the test sound source for a fifth preset time, and based on the display of the display interface of the sound source imaging system, it is determined whether the sensor detection function is available. The fifth preset time is 10 minutes. Specifically, in response to any sensor of the sound source imaging system being damaged, such as a microphone, etc., the display of the display interface of the sound source imaging system is obtained. If a prompt mark indicating the abnormality of the corresponding sensor appears on the display interface, it is determined that the sound source imaging system has the sensor detection function. Alternatively, in response to the sound source imaging system continuously testing the test sound source for the fifth preset time, and any sensor of the sound source imaging system is damaged, the sound source imaging system is subjected to sound signal collection. If a sensor abnormality prompt sound emitted by the sound source signal is obtained, it is determined that the sound source imaging system has the sensor detection function. Optionally, in other embodiments, the fifth preset time may also be other, such as 9 minutes or 11 minutes.
[0103] Optionally, in response to the sound source imaging system supporting sensor detection, the present specific embodiment may also pre-damage a first number of sensors in the sound source imaging system, so that the sound source imaging system is in a sensor detection state, and obtain the operation result of the sound source imaging system. If the operation result includes all the damaged sensors identified and the alarm issued by the sound source imaging system, it is determined that the sound source imaging system has a sensor detection function, and the sensor detection function meets the corresponding requirements. Among them, in response to the sound source imaging system issuing an alarm in response to the damage of sensors greater than the number threshold, the above-mentioned first number can be set to be greater than the number threshold during the above-mentioned test process to detect whether the alarm function of the sound source imaging system meets the requirements.
[0104] In another embodiment, the performance testing method of the sound source imaging system proposed in the present application further includes: determining whether the sound source imaging system meets the corresponding positioning accuracy requirements.
[0105] Specifically, due to the high positioning accuracy of the sound source imaging system, the test positions of the sound sources measured at different observation points should be consistent when converted to the current space. In this embodiment, the sound source imaging system is located at the first observation point and the second observation point, respectively, and the tenth detection result of the sound source imaging system for the test sound source at the first observation point and the eleventh detection result of the sound source imaging system for the test sound source at the second observation point are obtained respectively. Among them, the test sound source is at the tenth preset distance from the first observation point, and the test sound source emits a sound wave of the tenth preset frequency and the tenth preset sound pressure level. The tenth preset frequency is the same as the first preset frequency in the above embodiment, and the tenth preset sound pressure level is the same as the first preset sound pressure level in the above embodiment. In addition, the above tenth detection result includes the tenth test pitch angle and the tenth test azimuth angle corresponding to the test sound source, and the eleventh detection result includes the eleventh test pitch angle and the eleventh test azimuth angle corresponding to the test sound source.
[0106] Furthermore, based on the above-mentioned tenth detection result and eleventh detection result, the test position of the test sound source in the current space is determined, and based on the first observation point, the second observation point and the test position, the first angle of the first observation point relative to the test position and the second observation point is determined, and the second angle of the second observation point relative to the test position and the first observation point is determined.
[0107] Further, a test distance between the test sound source and the first observation point is determined according to the distance between the first observation point and the second observation point and the first angle and the second angle. The absolute value of the difference between the test distance and the tenth preset distance is taken as the twelfth detection result, and in response to the twelfth detection result being less than the distance threshold, it is determined that the sound source imaging system meets the corresponding positioning accuracy requirement.
[0108] In one specific embodiment, see Figure 6, Figure 6 It is a schematic diagram of another embodiment of the sound source imaging system and the test sound source. In this specific embodiment, the sound source imaging system is located at the first observation point O1, and the test sound source is located at S away from the first observation point O1, and the first observation point O1 is 10m away from S, and the tenth test result of the sound source imaging system for the test sound source at the current moment is obtained; the sound source imaging system is moved to the second observation point O2, and the eleventh test result measured by the sound source imaging system is obtained. According to the tenth test result, the virtual positioning line segment O1S of the test sound source relative to the first observation point O1 is determined, and the first angle α between O1S and O1O2 is obtained; according to the eleventh test result, the virtual positioning line segment O2S of the test sound source relative to the second observation point O2 is determined, and the second angle β between O2S and O1O2 is obtained.
[0109] Furthermore, based on the characteristics of the triangle, the twelfth detection result is calculated using the following formula:
[0110] d = sinβ×L / sin[π-(α+β)]
[0111] D=|d-10|
[0112] Wherein, d represents the test distance, L represents the distance between the first observation point O1 and the second observation point O2, and D represents the twelfth detection result.
[0113] Furthermore, the twelfth detection result is compared with the distance threshold, and if the twelfth detection result is less than the distance threshold, it is determined that the sound source imaging system meets the corresponding positioning accuracy requirement. The distance threshold may be 0.1m, 0.2m or 0.3m, etc.
[0114] In another embodiment, in response to the sound source imaging system meeting the requirements corresponding to all the above embodiments, the performance of the sound source imaging system is determined to meet the standard; that is, when the resolution accuracy, imaging range, imaging response time, sound source positioning accuracy, and repeatability of the sound source imaging system meet the corresponding requirements, and also meet the sound pressure level test requirements, imaging distance requirements, video frame rate requirements, continuous working time requirements, functional requirements, and positioning accuracy requirements, the performance of the sound source imaging system is determined to meet the standard. Alternatively, in response to the sound source imaging system meeting the requirements corresponding to some of the above embodiments, the performance of the sound source imaging system is determined to meet the standard.
[0115] Optionally, in other embodiments, a corresponding score is set for each test requirement. When the sound source imaging system meets the test requirement, the sound source imaging system is assigned the score; when the requirement is not met, the sound source imaging system is not assigned the score. After all tests are performed on the sound source imaging system, all scores assigned to the sound source system are added to obtain a total performance score of the sound source imaging system, and whether the sound source imaging system meets the standard is determined based on the total performance score of the sound source imaging system. For example, after all tests are performed on the sound source imaging system, the sound source imaging system meets five requirements, and the score corresponding to each test is 10 points. The total performance score of the sound source imaging system is 50 points. If the 50 points are greater than or equal to the score threshold, it is determined that the performance of the sound source imaging system meets the standard. Among them, the score threshold can be set according to actual conditions, and this application is not limited to this. Optionally, different scores can be set for different tests. For example, the resolution accuracy of the sound source imaging system is an important indicator for determining whether the sound source imaging system meets the performance requirements, and a higher score is set for the resolution accuracy test.
[0116] See also Figure 7 , Figure 7 The present invention is a schematic diagram of a performance test device for a sound source imaging system of the present invention. The performance test device is used to control the sound source imaging system and test the sound source to implement the performance test method for the sound source imaging system mentioned in any of the above embodiments. The performance test device specifically includes a system end 10 and a sound source end 20.
[0117] Specifically, the system end 10 includes a first mounting portion 11, a first support body 12, a first driving wheel 13 and a first controller 14. The first mounting portion 11 is used to fix the sound source imaging system; the first support body 12 is used to support the first mounting portion 11, and the height of the first support body 12 is adjustable so that the sound source imaging system after installation reaches a suitable height; the first driving wheel 13 is used to drive the system end 10 to move to a specified position to test the test sound source; the first controller 14 is used to control the entire system end 10 to test the sound source imaging system.
[0118] In one implementation scenario, the system end 10 further includes a mechanical arm (not shown), and the first controller 14 controls the movement of the mechanical arm to call the corresponding sound source imaging system to perform the corresponding function. For example, when testing whether the resolution accuracy of the sound source imaging system meets the corresponding requirements, the first controller 14 controls the movement of the mechanical arm to click the sound source imaging button corresponding to the sound source imaging system, thereby obtaining the corresponding first detection result; or, in response to testing whether the first working time of the sound source imaging system in the camera mode meets the corresponding requirements, the first controller 14 controls the mechanical arm to click the above-mentioned sound source imaging button every preset time to simulate the scene of the sound source imaging system in actual use.
[0119] In another implementation scenario, the system end 10 also includes a high-speed camera (not shown), which is facing the display interface of the sound source imaging system, and the high-speed camera is coupled to the first controller 14, so that the first controller 14 obtains the picture or video taken by the high-speed camera, and analyzes the picture or video to obtain the corresponding test result. For example, when testing whether the imaging response time of the imaging system meets the corresponding requirements, the first controller 14 controls the high-speed camera to record the display interface of the sound source imaging system, and analyzes the obtained video to obtain the first moment when the sound source imaging system starts the sound source imaging test and the second moment when the sound source imaging system generates the sound source image; and the first controller 14 determines whether the imaging response time of the sound source imaging system meets the requirements based on the first moment and the second moment.
[0120] Please continue reading Figure 7 The sound source end 20 includes a second mounting portion 21, a second support body 22, a second driving wheel 23 and a second controller 24. The second mounting portion 21 is used to test the sound source; the second support body 22 is used to support the second mounting portion 21, and the height of the second support body 22 is adjustable so that the second mounting portion 21 reaches a suitable height; the second driving wheel 23 is used to drive the sound source end 20 to move to a specified position to cooperate with the test of the sound source imaging system; the second controller 24 is used to control the entire sound source end 20.
[0121] In one implementation scenario, the second controller 24 is coupled to the first controller 14 so that the second controller 24 cooperates with the first controller 14 to control the corresponding system end 10 and sound source end 20 to work, so as to implement the test of the sound source imaging system.
[0122] In addition, it should be noted that Figure 7 The second mounting portion 21 is only schematically drawn in the figure, but in actual application, the second mounting portion 21 can be a disk or have multiple mounting ends. When it is a disk, multiple test sound sources are arranged on the disk; when it includes multiple mounting ends, at least some of the mounting ends are provided with test sound sources. The second controller 24 cooperates with the tests of different items by controlling at least some of all the test sound sources to work or adjusting the frequency and / or sound pressure level of at least some of the test sound sources.
[0123] See also Figure 8 , Figure 8 The structure diagram of an embodiment of a performance test device of a sound source imaging system of the present application is shown in FIG. The sound source imaging system 100 comprises a data acquisition module 30 and a data processing module 40 which are connected to each other.
[0124] Specifically, the data acquisition module 30 includes a sound signal acquisition submodule 31, which is composed of a microphone array sensor. When the two test sound sources are respectively at a first preset distance from the sound source imaging system, and the two test sound sources simultaneously emit sound waves of a first preset frequency and a first preset sound pressure level, the sound signal acquisition submodule 31 is used to acquire the first detection results of the two test sound sources; wherein the two test sound sources respectively have the same first preset pitch angle relative to the sound source imaging system, the two test sound sources have different first preset azimuth angles relative to the sound source imaging system, and the absolute value of the difference between the two first preset azimuth angles is 180°.
[0125] In one implementation scenario, the data acquisition module 30 further includes an image acquisition submodule 32, a distance measurement submodule 33, and an environment perception monitoring submodule 34. The image acquisition submodule 32 is used to obtain real-time images within the imaging range of the sound source imaging system. The distance measurement submodule 33 is used to obtain the actual distance of the test sound source measured by the sound source imaging system. The environment perception monitoring submodule 34 is used to obtain information such as air humidity, temperature, and pressure of the environment obtained by the sound source imaging system.
[0126] In another implementation scenario, the data acquisition module 30 further includes an operating system submodule 35, and the operating system submodule 35 is used to schedule the operation of each module in the performance test device of the sound source imaging system.
[0127] Please continue reading Figure 8 The data processing module 40 is used to determine whether the resolution accuracy of the sound source imaging system meets the corresponding requirements based on the first detection results of the two test sound sources, and the corresponding first preset pitch angle and first preset azimuth angle.
[0128] In one implementation scenario, the data processing module 40 also includes a sound data acquisition submodule 41, a sound source positioning submodule 42, a heat map generation submodule 43 and a data transmission and control submodule 44. Specifically, the sound data acquisition submodule 41 is used to convert the format of the sound signal collected by the sound signal collection submodule 31. The sound source positioning submodule 42 is used to process the sound signal and calculate the relative size of the sound pressure level at different azimuths and pitch angles in the camera coordinate system. The heat map generation submodule 43 is used to convert the sound pressure level distribution generated by the sound source positioning submodule 42 into color blocks of varying depths according to strength. Among them, the larger the sound pressure level value, the darker the color of the color block. The data transmission and control submodule 44 is used for data transmission between each submodule, and stores the relevant data generated by the operation of each submodule.
[0129] In addition, in another embodiment, the sound source imaging system 100 further includes an application module 50 , which is connected to the data processing module 40 and the data acquisition module 30 and is used to obtain detection results of the functions of the sound source imaging system.
[0130] In one implementation scenario, the application module 50 includes a frequency adjustment submodule 51, a sound source imaging photo / recording submodule 52, a sound source imaging display submodule 53, and a history record and details submodule 54. Specifically, the frequency adjustment submodule 51 is used to adjust the imaging frequency of the sound source imaging system. The sound source imaging photo / recording submodule 52 is used to obtain a thermal map or video captured or recorded by the sound source imaging system. The sound source imaging display submodule 53 is used to obtain a sound source imaging thermal map generated and displayed in real time by the sound source imaging system. The history record and details submodule 54 is used to obtain relevant information of the sound source imaging system under the query function, including date, test location, sensor status, etc.
[0131] See also Fig. 9 , Fig. 9 This is a structural diagram of an embodiment of an electronic device of the present application, and the electronic device includes a memory 60 and a processor 70 coupled to each other, and the memory 60 stores program instructions, and the processor 70 is used to execute the program instructions to implement the steps of the emotion recognition method in the above embodiment. Specifically, the electronic device includes but is not limited to: a desktop computer, a laptop computer, a tablet computer, a server, etc., which are not limited here. In addition, the processor 70 can also be called a CPU (Center Processing Unit). The processor 70 may be an integrated circuit chip with signal processing capabilities. The processor 70 can also be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field-programmable gate array (Field-Programmable Gate Array, FPGA), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. In addition, the processor 70 can be implemented by an integrated circuit chip.
[0132] See also Fig.10 , Fig.10 This is a structural diagram of an embodiment of a computer-readable storage medium proposed in the present application. The computer-readable storage medium 80 stores program instructions 90 that can be executed by a processor, and the program instructions 90 are used to implement the emotion recognition method in any of the above embodiments.
[0133] The above description is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A performance test method for a sound source imaging system, characterized in that: include: The two test sound sources are respectively at a first preset distance from the sound source imaging system; wherein the two test sound sources respectively have the same first preset elevation angle relative to the sound source imaging system, the two test sound sources have different first preset azimuth angles relative to the sound source imaging system, and the absolute value of the difference between the two first preset azimuth angles is 180°; The two test sound sources are caused to emit sound waves of a first preset frequency and a first preset sound pressure level simultaneously, and the sound source imaging system obtains a first detection result of the two test sound sources; wherein the first detection result includes a first test pitch angle and a first test azimuth angle corresponding to the test sound source; Based on the first detection results of the two test sound sources, and the corresponding first preset pitch angle and the first preset azimuth angle, it is determined whether the resolution accuracy of the sound source imaging system meets the corresponding requirements.
2. The method according to claim 1, characterized in that The step of determining whether the resolution accuracy of the sound source imaging system meets corresponding requirements based on the first detection results of the two test sound sources, and the corresponding first preset pitch angle and first preset azimuth angle comprises: Obtaining a first difference between the first test elevation angle and the first preset elevation angle, and a second difference between the first test azimuth angle and the first preset azimuth angle of each test sound source; In response to the absolute value of the first difference and the absolute value of the second difference of each of the test sound sources being less than or equal to a resolution threshold, it is determined that the resolution accuracy of the sound source imaging system meets the corresponding requirement.
3. The method according to claim 1, characterized in that Also includes: Determine a first preset position, a second preset position, a third preset position, and a fourth preset position that have a second preset distance from the sound source imaging system; wherein an absolute value of a difference between the first preset position and the second preset position relative to a second preset azimuth angle of the sound source imaging system, and an absolute value of a difference between the third preset position and the fourth preset position relative to a second preset azimuth angle of the sound source imaging system are both 180°, a first angle is set for the first preset position and the second preset position relative to a second preset elevation angle of the sound source imaging system, and a second angle is set for the third preset position and the fourth preset position relative to the second preset elevation angle of the sound source imaging system; The test sound source emits sound waves of a second preset frequency and a second preset sound pressure level at the first preset position, the second preset position, the third preset position, and the fourth preset position, respectively, so that the sound source imaging system obtains a second detection result corresponding to the test sound source; Based on all the second preset pitch angles and the corresponding second detection results, it is determined whether the imaging range of the sound source imaging system meets the corresponding requirements.
4. The method according to claim 1, characterized in that: Also includes: A third preset distance is set between the test sound source and the sound source imaging system; wherein the test sound source has a third preset elevation angle and a third preset azimuth angle relative to the sound source imaging system; The test sound source emits a sound wave of a third preset frequency and a third preset sound pressure level, and obtains a first moment when the sound source imaging system starts to perform a sound source imaging test and a second moment when the sound source imaging system generates a sound source image; Obtaining an imaging response time based on the first moment and the second moment; In response to the imaging response time being less than or equal to the first preset time, it is determined that the imaging response time of the sound source imaging system meets the corresponding requirement.
5. The method according to claim 1, characterized in that Also includes: A fourth preset distance is set between the test sound source and the sound source imaging system; wherein the test sound source has a fourth preset elevation angle and a fourth preset azimuth angle relative to the sound source imaging system; The test sound source is caused to emit a sound wave of a fourth preset frequency and a fourth preset sound pressure level, and the sound source imaging system obtains a third detection result of the test sound source until a first preset number of third detection results are obtained; wherein the third detection result includes a second test pitch angle and a second test azimuth angle corresponding to the test sound source; Based on all the fourth preset pitch angles and the fourth preset azimuth angles and the third detection result, it is determined whether the sound source localization accuracy of the sound source imaging system meets the corresponding requirements.
6. The method according to claim 1, characterized in that Also includes: The test sound source and the sound source imaging system have a fifth preset distance; wherein the test sound source has a fifth preset elevation angle and a fifth preset azimuth angle relative to the sound source imaging system; The test sound source is caused to emit a sound wave of a fifth preset frequency and a fifth preset sound pressure level, and the sound source imaging system obtains a fourth detection result of the test sound source every second preset time until a second preset number of fourth detection results are obtained; wherein the fourth detection result includes a third test pitch angle and a third test azimuth angle corresponding to the test sound source; Obtaining a test pitch angle standard deviation based on the third test pitch angles corresponding to all the fourth detection results, and obtaining a test azimuth angle standard deviation based on the third test azimuth angles corresponding to all the fourth detection results; In response to the test pitch angle standard deviation and the test azimuth angle standard deviation being both less than or equal to a repeatability threshold, it is determined that the sound source imaging system meets the corresponding repeatability test requirements.
7. The method according to claim 1, characterized in that Also includes: A sixth preset distance is set between the test sound source and the sound source imaging system; wherein the test sound source has a sixth preset elevation angle and a sixth preset azimuth angle relative to the sound source imaging system; Maintaining a sixth preset frequency of the sound wave emitted by the test sound source, changing a sixth preset sound pressure level of the test sound source from a first value to a second value, and changing a sixth preset sound pressure level of the test sound source from the second value to a third value, and obtaining a minimum imaging sound pressure level and a maximum imaging sound pressure level of the sound source imaging system for the test sound source; In response to the minimum imaging sound pressure level being less than or equal to a preset minimum sound pressure level, and the maximum imaging sound pressure level being greater than or equal to a preset maximum sound pressure level, it is determined that the sound source imaging system meets the corresponding sound pressure level test requirements.
8. The method according to claim 1, characterized in that Also includes: Maintaining a seventh preset elevation angle and a seventh preset azimuth angle of the test sound source relative to the sound source imaging system, and maintaining the sound waves emitted by the test sound source at a seventh preset frequency and a seventh preset sound pressure level; Increasing a seventh preset distance between the test sound source and the sound source imaging system from a fourth value to a fifth value, and obtaining a minimum imaging distance and a maximum imaging distance of the sound source imaging system for the test sound source; In response to the minimum imaging distance being less than or equal to a preset minimum distance, and the maximum imaging distance being greater than or equal to a preset maximum distance, it is determined that the sound source imaging system meets the corresponding imaging distance requirement.
9. The method according to claim 1, characterized in that: Also includes: Enable the sound source imaging system to perform a video recording operation and obtain a display frame rate of the sound source imaging system; After the sound source imaging system is fully charged, a charging power source is disconnected to obtain a first working time of the sound source imaging system in a photographing mode and a second working time of the sound source imaging system in a video recording mode; In response to the display frame rate, the first operating time and the second operating time being greater than or equal to corresponding thresholds, it is determined that the sound source imaging system meets corresponding requirements.
10. The method according to claim 1, characterized in that Before the step of making the two test sound sources have a first preset distance from the sound source imaging system, the method includes: The functions of the sound source imaging system are tested; wherein the functions include at least one of a sensor detection function, a thermal map preview function, a thermal map color band adjustment function, a sound source imaging function, a sound source localization function, a frequency adjustment function, a sound pressure level adjustment function, a sound source imaging range adjustment function, a time-frequency diagram display function, a sound source switching function, a shooting and / or recording function, a recording function, and a playback function.
11. A performance test device for a sound source imaging system, characterized in that: include: Interconnected data acquisition modules and data processing modules; When two test sound sources are respectively at a first preset distance from the sound source imaging system, and the two test sound sources simultaneously emit sound waves of a first preset frequency and a first preset sound pressure level, the data acquisition module is used to acquire first detection results of the two test sound sources; wherein the two test sound sources respectively have the same first preset pitch angle relative to the sound source imaging system, the two test sound sources have different first preset azimuth angles relative to the sound source imaging system, and the absolute value of the difference between the two first preset azimuth angles is 180°; The data processing module is used to determine whether the resolution accuracy of the sound source imaging system meets the corresponding requirements based on the first detection results of the two test sound sources, and the corresponding first preset pitch angle and the first preset azimuth angle.
12. The testing device according to claim 11, characterized in that: Also includes: The application module is connected to the data processing module and the data acquisition module, and is used to obtain the detection result of the function of the sound source imaging system.
13. An electronic device, characterized in that: It comprises a memory and a processor coupled to each other, wherein the memory stores program instructions, and the processor is used to execute the program instructions to implement the performance testing method of the sound source imaging system according to any one of claims 1 to 10.
14. A computer-readable storage medium, characterized in that: Program instructions that can be executed by a processor are stored, and the program instructions are used to implement the performance testing method of the sound source imaging system according to any one of claims 1 to 10.
