Method and device for defining imaging dynamic range of sound source signal
By generating and analyzing the peak matrix of the audio data matrix, determining the imaging dynamic range of the sound source signal, the imaging accuracy problem caused by improper dynamic range setting is solved, and the accuracy of noise removal and sound source positioning is achieved.
Patent Information
- Application Number
- CN202510779080.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-12
- Publication Date
- 2025-07-18
- Estimated Expiration
- 2045-06-12
AI Technical Summary
In the existing acoustic imaging technology, improper dynamic range setting causes the loud source signal to cover the small source signal or noise point imaging, affecting the imaging accuracy and effect.
By acquiring continuous audio data, an acoustic imaging algorithm is used to generate an audio data matrix, calculate the mean matrix and filter out the peak matrix, determine the imaging range value based on the peak matrix position information, eliminate noise interference, and improve the accuracy of sound source positioning.
Effectively determine the imaging dynamic range of the sound source signal, eliminate noise interference, improve the accuracy of sound source positioning, and ensure the effective display of the low-sound source signal.
Smart Images

Figure CN120340522A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the technical field of sound source imaging, and particularly relates to a method and device for defining the imaging dynamic range of sound source signals. Background Art
[0002] An acoustic imager is a measurement technology based on a microphone array. By measuring the signal phase differences of sound waves arriving at each microphone within a certain space, and determining the position of the sound source and measuring the amplitude of the sound source according to the phased array principle, the distribution of the sound source in space is finally displayed in the form of an image. In the image, the maximum difference between the colors of the sound image cloud map can be expressed as the imaging dynamic range, and this dynamic range limits the final imaging effect of the sound source signal.
[0003] However, in the actual imaging process, when there are multiple sound source signals, if the dynamic range is set too small, it is easy for the large sound source signal to cover the small sound source signal, resulting in the defect that the small sound source signal cannot be effectively displayed; when the sound source signal is small, if the dynamic range is set too large, it is easy for noise points to be imaged, thus affecting the overall imaging accuracy. Summary of the Invention
[0004] To solve the above-mentioned technical problems that when there are multiple sound source signals, if the dynamic range is set too small, it is easy for the large sound source signal to cover the small sound source signal, resulting in the defect that the small sound source signal cannot be effectively displayed; when the sound source signal is small, if the dynamic range is set too large, it is easy for noise points to be imaged, thus affecting the overall imaging accuracy, etc., this application proposes a method and device for defining the imaging dynamic range of sound source signals, and its technical solutions are as follows: In a first aspect, an embodiment of this application provides a method for defining the imaging dynamic range of sound source signals, including: Obtain n groups of consecutive audio data, and obtain an audio data matrix corresponding to each group of audio data based on an acoustic imaging algorithm; Calculate the mean value of the n groups of audio data matrices to obtain a first mean value matrix, screen out all elements in the first mean value matrix whose values are greater than a preset first constant, and use the set of all elements and the position information of each element in the first mean value matrix as the first mean peak matrix; Screen out all elements in the nth group of audio data matrices whose values are greater than a preset second constant, and use the set of all elements and the position information of each element in the nth group of audio data matrices as the second mean peak matrix; When the same position information is not found in the first mean peak matrix and the second mean peak matrix, determine that the imaging range value corresponding to the nth group of audio data is a preset range value, and display the nth group of audio data according to the preset range value; When the same position information is found in the first mean peak matrix and the second mean peak matrix, a mean element consistent with the same position information is determined in the first mean matrix, and an imaging range value corresponding to the nth group of audio data is obtained based on the mean element.
[0005] In an alternative solution of the first aspect, obtaining the imaging range value corresponding to the nth group of audio data based on the mean element includes: Calculating the variance of the first mean matrix according to the mean element, all elements in the first mean matrix, and the number of all elements; Performing a mean calculation on the nth group of audio data matrix to obtain the mean of the nth group of audio data matrix, and calculating the standard deviation of the nth group of audio data matrix according to the mean of the nth group of audio data matrix, all elements in the nth group of audio data matrix, and the number of all elements; wherein, the number of all elements in the first mean matrix is equal to the number of all elements in the nth group of audio data matrix; Substituting the variance of the first mean matrix, the mean of the nth group of audio data matrix, and the standard deviation of the nth group of audio data matrix into a preset test formula to obtain a first verification value; Querying a second verification value in a t critical value table according to the number of all elements in the nth group of audio data matrix and a preset significance level parameter; When the absolute value of the first verification value is greater than the second verification value, determining the imaging range value corresponding to the nth group of audio data as a preset range value, and displaying the nth group of audio data according to the preset range value.
[0006] In another alternative solution of the first aspect, after querying the second verification value in the t critical value table according to the number of all elements in the nth group of audio data matrix and the preset significance level parameter, it further includes: When the absolute value of the first verification value is less than or equal to the second verification value, determining the two elements with the largest values in the first mean peak matrix; Taking the absolute value of the difference between the two elements with the largest values as the imaging range value corresponding to the nth group of audio data, and displaying the nth group of audio data according to the imaging range value corresponding to the nth group of audio data.
[0007] In another alternative solution of the first aspect, the method further includes: Obtaining the (n + 1)th group of audio data, and obtaining an audio data matrix corresponding to the (n + 1)th group of audio data based on an acoustic imaging algorithm; Performing a mean calculation on the (n + 1) groups of audio data matrices to obtain a second mean matrix, screening out all elements in the second mean matrix whose values are greater than a preset first constant, and taking the set of all elements and the position information of each element corresponding in the second mean matrix as a third mean peak matrix; In the (n + 1)-th group of audio data matrices, all elements with values greater than a preset second constant are selected, and the set of all elements and the position information corresponding to each element in the n-th group of audio data matrices is used as the fourth mean peak matrix; When the same position information is not found in the third mean peak matrix and the fourth mean peak matrix, it is determined that the imaging range value corresponding to the (n + 1)-th group of audio data is the preset range value, and the (n + 1)-th group of audio data is displayed according to the preset range value.
[0008] In another alternative solution of the first aspect, the method further includes: When it is detected that the number of signal images displayed by the n-th group of audio data exceeds a preset number threshold, a warning message corresponding to the preset number threshold is sent.
[0009] In a second aspect, an embodiment of the present application provides an imaging dynamic range definition device for sound source signals, including: A matrix generation module, configured to obtain n groups of consecutive audio data, and obtain an audio data matrix corresponding to each group of audio data based on an acoustic imaging algorithm; A first screening module, configured to calculate the mean value of the n groups of audio data matrices to obtain a first mean matrix, select all elements with values greater than a preset first constant in the first mean matrix, and use the set of all elements and the position information corresponding to each element in the first mean matrix as the first mean peak matrix; A second screening module, configured to select all elements with values greater than a preset second constant in the n-th group of audio data matrices, and use the set of all elements and the position information corresponding to each element in the n-th group of audio data matrices as the second mean peak matrix; A first processing module, configured to determine that the imaging range value corresponding to the n-th group of audio data is the preset range value and display the n-th group of audio data according to the preset range value when the same position information is not found in the first mean peak matrix and the second mean peak matrix; A second processing module, configured to, when the same position information is found in the first mean peak matrix and the second mean peak matrix, determine a mean element consistent with the same position information in the first mean matrix, and obtain the imaging range value corresponding to the n-th group of audio data according to the mean element.
[0010] In an alternative solution of the second aspect, the second processing module is specifically configured to: Calculate the variance of the first mean matrix according to the mean element, all elements in the first mean matrix, and the number of all elements; Calculate the mean of the nth group of audio data matrices to obtain the mean of the nth group of audio data matrices, and calculate the standard deviation of the nth group of audio data matrices based on the mean of the nth group of audio data matrices, all elements in the nth group of audio data matrices, and the number of all elements; where, the number of all elements in the first mean matrix is equal to the number of all elements in the nth group of audio data matrices; Substitute the variance of the first mean matrix, the mean of the nth group of audio data matrices, and the standard deviation of the nth group of audio data matrices into a preset test formula to obtain a first verification value; According to the number of all elements in the nth group of audio data matrices and a preset significance level parameter, query a second verification value in a t critical value table; When the absolute value of the first verification value is greater than the second verification value, determine that the imaging range value corresponding to the nth group of audio data is a preset range value, and display the nth group of audio data according to the preset range value.
[0011] In another optional solution of the second aspect, the second processing module is further configured to: After querying the second verification value in the t critical value table according to the number of all elements in the nth group of audio data matrices and the preset significance level parameter, When the absolute value of the first verification value is less than or equal to the second verification value, determine the two elements with the largest values in the first mean peak matrix; Take the absolute value of the difference between the two elements with the largest values as the imaging range value corresponding to the nth group of audio data, and display the nth group of audio data according to the imaging range value corresponding to the nth group of audio data.
[0012] In another optional solution of the second aspect, the apparatus further includes: Obtain the (n + 1)th group of audio data, and obtain an audio data matrix corresponding to the (n + 1)th group of audio data based on an acoustic imaging algorithm; Calculate the mean of the (n + 1) groups of audio data matrices to obtain a second mean matrix, screen out all elements in the second mean matrix whose values are greater than a preset first constant, and use the set of all elements and the position information of each element corresponding in the second mean matrix as a third mean peak matrix; Screen out all elements in the (n + 1)th group of audio data matrices whose values are greater than a preset second constant, and use the set of all elements and the position information of each element corresponding in the nth group of audio data matrices as a fourth mean peak matrix; When no identical position information is found in the third mean peak matrix and the fourth mean peak matrix, determine that the imaging range value corresponding to the (n + 1)th group of audio data is a preset range value, and display the (n + 1)th group of audio data according to the preset range value.
[0013] In yet another alternative of the second aspect, the apparatus further includes: When it is detected that the number of signal images displayed by the nth group of audio data exceeds a preset number threshold, a warning message corresponding to the preset number threshold is sent.
[0014] In a third aspect, an apparatus for defining an imaging dynamic range of a sound source signal according to an embodiment of the present application includes a processor and a memory; The processor is connected to the memory; The memory is used to store executable program code; The processor runs a program corresponding to the executable program code by reading the executable program code stored in the memory, so as to implement the method for defining the imaging dynamic range of the sound source signal provided in the first aspect or any implementation manner of the first aspect of the embodiment of the present application.
[0015] In a fourth aspect, an embodiment of the present application provides a computer storage medium. The computer storage medium stores a computer program, and the computer program includes program instructions. When the program instructions are executed by a processor, the method for defining the imaging dynamic range of the sound source signal provided in the first aspect or any implementation manner of the first aspect of the embodiment of the present application can be implemented.
[0016] In the embodiment of the present application, when performing imaging display on audio data, n groups of consecutive audio data can be acquired, and an audio data matrix corresponding to each group of audio data can be obtained based on an acoustic imaging algorithm; a first mean matrix is calculated by averaging the n groups of audio data matrices. All elements with values greater than a preset first constant are selected from the first mean matrix, and the set of all elements and the position information of each element in the first mean matrix is used as the first mean peak matrix; all elements with values greater than a preset second constant are selected from the nth group of audio data matrices, and the set of all elements and the position information of each element in the nth group of audio data matrices is used as the second mean peak matrix; when no identical position information is found in the first mean peak matrix and the second mean peak matrix, it is determined that the imaging range value corresponding to the nth group of audio data is a preset range value, and the nth group of audio data is displayed according to the preset range value; when identical position information is found in the first mean peak matrix and the second mean peak matrix, a mean element consistent with the identical position information is determined in the first mean matrix, and the imaging range value corresponding to the nth group of audio data is obtained based on the mean element. By screening the elements in the audio data matrix and determining the position information, the imaging dynamic range suitable for the audio data is determined, and the audio data is displayed according to the imaging dynamic range, so as to achieve the effect of excluding noise interference and improving the accuracy of sound source localization at the same time. Description of the Drawings
[0017] To more clearly illustrate the technical solutions in the embodiments of the present application, the accompanying drawings required for the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.
[0018] Figure 1 It is the overall flowchart of a method for defining the imaging dynamic range of a sound source signal provided by an embodiment of the present application; Figure 2 It is the schematic structural diagram of the generation of a mean peak matrix provided by an embodiment of the present application; Figure 3 It is the schematic structural diagram of a device for defining the imaging dynamic range of a sound source signal provided by an embodiment of the present application; Figure 4 It is the schematic structural diagram of another device for defining the imaging dynamic range of a sound source signal provided by an embodiment of the present application. Detailed implementation manners
[0019] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application.
[0020] In the following description, the terms "first" and "second" are only for the purpose of description and cannot be construed as indicating or implying relative importance. The following description provides multiple embodiments of the present application. Different embodiments can be replaced or combined, so the present application can also be considered to include all possible combinations of the same and / or different embodiments described. Thus, if one embodiment includes features A, B, and C, and another embodiment includes features B and D, then the present application should also be considered to include embodiments containing all other possible combinations of A, B, C, and D, although such embodiments may not be explicitly described in the following content.
[0021] The following description provides examples and does not limit the scope, applicability, or examples set forth in the claims. Changes can be made to the functions and arrangements of the described elements without departing from the scope of the content of the present application. Each example can appropriately omit, substitute, or add various processes or components. For example, the described method can be executed in a different order from the described order, and various steps can be added, omitted, or combined. In addition, the features described in some examples can be combined into other examples.
[0022] Please refer to Figure 1 , Figure 1 which shows the overall flowchart of a method for defining the imaging dynamic range of a sound source signal provided by an embodiment of the present application.
[0023] AsFigure 1 As shown in Figure 1 , the method for defining the imaging dynamic range of the sound source signal may at least include the following steps: Step 102: Obtain n sets of consecutive audio data, and based on the acoustic imaging algorithm, obtain an audio data matrix corresponding to each set of audio data.
[0024] In the embodiment of the present application, the method for defining the imaging dynamic range of the sound source signal is applied to a control terminal of a controllable acoustic imager. The control terminal can analyze and process the audio data collected by the acoustic imager to obtain an imaging range value corresponding to the sound source signal in the audio data, and display the sound source signal in the display interface of the acoustic imager in combination with the imaging range value. Among them, the imaging range value can be understood as the difference between the maximum decibel value allowed for imaging by the acoustic imager and the minimum decibel value, and the unit is generally set to dB. Different decibel differences correspond to different colors and brightness. For example, but not limited to, the larger the decibel difference, the deeper the displayed color and brightness. It can be understood that the audio data may include one or more different sound source signals. If the imaging range of each sound source signal is set too small, it is easy to cause the large sound source signal to completely cover the small sound source signal, thereby ignoring the position of the small sound source signal; if each sound source signal is small and the corresponding imaging range is set too large, noise points will also be imaged, resulting in a phenomenon of full-screen sound images.
[0025] Specifically, when imaging and displaying the audio data based on the acoustic imager, the control terminal can control the acoustic imager to obtain multiple sets of consecutive audio data (that is, n is a positive integer as mentioned above). The time interval between each set of audio data is kept consistent, and the acoustic imaging algorithm can be used to process each set of obtained audio data to obtain the corresponding audio data matrix. Among them, the acoustic imaging algorithm can also be called the DOA algorithm, which is a commonly used technical means in this field and in acoustic imagers, and will not be elaborated here.
[0026] It can be understood that the audio data matrix corresponding to each set of audio data can be expressed as an m*m matrix. For example, but not limited to, the audio data matrix corresponding to each set of audio data can be a 50*50 matrix.
[0027] Step 104: Calculate the mean value of the n sets of audio data matrices to obtain a first mean matrix. Screen out all elements in the first mean matrix whose values are greater than a preset first constant, and use the set of all elements and the position information of each element in the first mean matrix as the first mean peak matrix.
[0028] Specifically, after obtaining the audio data matrix corresponding to each group of audio data, the control terminal can calculate the mean value of all the audio data matrices to obtain a first mean matrix. The element in the x-th row and y-th column of the first mean matrix is determined by calculating the average value of the elements in the x-th row and y-th column of all the audio data matrices, and it can be specifically but not limited to being expressed by the following formula: In the above formula, AVG can correspond to the first mean matrix, can correspond to the i-th group of audio data matrices, and N can correspond to n groups of audio data matrices. It can be understood that when the audio data matrix corresponding to each group of audio data can be expressed as an m*m matrix, the first mean matrix can also be expressed as an m*m matrix.
[0029] Furthermore, after calculating the first mean matrix, the control terminal can screen out all the elements in the first mean matrix whose values are greater than a preset first constant, and determine the position information of each element in the first mean matrix, so as to use the set of all these elements and their respective position information as the first mean peak matrix. Among them, the position information corresponding to each element in the first mean peak matrix can be specifically but not limited to being represented by the subscript in the lower right corner of the element. It can be understood that the preset first constant set in the embodiment of the present application can be set according to the historical sound source signal displayed by the acoustic imager, so as to improve the effectiveness and accuracy of the imaging range value of the acoustic imager.
[0030] Reference can be made here to Figure 2 the schematic structural diagram of the generation of a mean peak matrix provided by the embodiment of the present application shown. As Figure 2 shown, x can correspond to the first mean matrix, and the first mean matrix can be expressed as a 10*10 matrix. In the embodiment of the present application, the preset first constant can be expressed as the value 25, that is, it is necessary to screen out all the elements in the first mean matrix whose values are higher than 25, and then obtain all the elements 45, 36, and 25 in the first mean peak matrix. For example but not limited to, it can be expressed as: Y=findPeaks(x,25)=[45,36,25] Next, the position information corresponding to the elements 45, 36, and 25 can be determined in the first mean matrix respectively. For example, the position information corresponding to the element 45 can be expressed as 28 (which can also be understood as the 2nd row and 8th column), the position information corresponding to the element 36 can be expressed as 77 (which can also be understood as the 7th row and 7th column), and the position information corresponding to the element 25 can be expressed as 93 (which can also be understood as the 9th row and 3rd column). Then, according to all the elements whose values are higher than 25 and the corresponding position information, the first mean peak matrix can be obtained specifically but not limited to being expressed as: [45 28, 36 77 , 25 93 It should be noted that in the above embodiments, the first mean peak matrix may correspond to a one-dimensional matrix containing three elements. However, the embodiments of the present application are not limited to the number of elements contained in the first mean peak matrix, and are not limited thereto here.
[0031] Step 106: Screen out all elements in the nth group of audio data matrices whose values are greater than a preset second constant, and use all the elements and the set of position information corresponding to each element in the nth group of audio data matrices as the second mean peak matrix.
[0032] Specifically, the control terminal can screen out all elements in the nth group of audio data matrices whose values are greater than a preset second constant, and determine the position information of each element in the nth group of audio data matrices, so as to use the set of all the elements and their corresponding position information as the second mean peak matrix. Among them, the position information corresponding to each element in the second mean peak matrix can be, but is not limited to, represented by the lower right subscript of the element. It can be understood that the nth group of audio data matrices can correspond to the latest audio data obtained by the acoustic imager at present. Screening the nth group of audio data matrices based on this can effectively ensure the effectiveness of the current imaging of the acoustic imager.
[0033] It should be noted that the preset second constant set in the embodiments of the present application can be set according to the historical sound source signals displayed by the acoustic imager, so as to improve the effectiveness and accuracy of the imaging range value of the acoustic imager, and the preset second constant can be, but is not limited to, the same as the preset first constant.
[0034] Step 108: When the same position information is not found in the first mean peak matrix and the second mean peak matrix, determine that the imaging range value corresponding to the nth group of audio data is the preset range value, and display the nth group of audio data according to the preset range value.
[0035] Specifically, after obtaining the first mean peak matrix and the second mean peak matrix respectively, the control terminal can determine whether there is the same position information in the position information corresponding to each element in the first mean peak matrix and the position information corresponding to each element in the second mean peak matrix. For example, here the first mean peak matrix can be expressed as , and the second mean peak matrix can be expressed as Taking [as an example] (the subscript in the lower right corner of the element represents the position information), the position information included in the first mean peak matrix can be respectively represented as 2, 3, 6, and 9, and the position information included in the second mean peak matrix can be respectively represented as 3, 5, and 7. Then, it can be determined that the first mean peak matrix and the second mean peak matrix have the same position information, and this same position information is represented as 3.
[0036] Possibly, when no same position information is found in the first mean peak matrix and the second mean peak matrix, it indicates that it is initially judged that the nth group of audio data does not contain a valid sound source. Then, it can be determined that the imaging range value corresponding to the nth group of audio data is the preset range value, and the acoustic imager can be controlled to image the sound source signal of the nth group of audio data on the display interface according to this preset range value. Among them, the preset range value can be understood as the range value set by the user himself or the default set range value, and it can be but is not limited to 3 dB.
[0037] Step 110: When the same position information is found in the first mean peak matrix and the second mean peak matrix, determine the mean element in the first mean matrix that is consistent with the same position information, and obtain the imaging range value corresponding to the nth group of audio data according to the mean element.
[0038] When it is detected that the same position information exists in the first mean peak matrix and the second mean peak matrix, it indicates that it is initially judged that the nth group of audio data may contain a valid sound source. Then, it can be but is not limited to verified by means of statistical analysis t-test to further accurately judge whether there is a valid sound source in the nth group of audio data.
[0039] Specifically, after the control terminal determines the same position information, it can determine the mean element corresponding to this same position information in the first mean matrix mentioned above, and substitute this mean element, all the elements in the first mean matrix, and the number of all elements into the variance calculation formula to obtain the variance of the first mean matrix. Among them, the variance calculation formula can be but is not limited to expressed as follows: In the above formula, can correspond to the variance of the first mean matrix, can correspond to the i-th element in the first mean matrix, can correspond to the mean element corresponding to this same position information in the first mean matrix, and M can correspond to the number of elements in the first mean matrix.
[0040] Further, the control terminal also calculates the mean of all elements in the nth group of audio data matrices, and substitutes the mean of the nth group of audio data matrices, all elements in the nth group of audio data matrices, and the number of all elements into the standard deviation calculation formula to obtain the standard deviation of the nth group of audio data matrices. The standard deviation calculation formula can be but is not limited to the following: In the above formula, S can correspond to the standard deviation of the nth group of audio data matrices, can correspond to the ith element in the nth group of audio data matrices, can correspond to the mean of the nth group of audio data matrices, and M can correspond to the number of elements in the nth group of audio data matrices.
[0041] Further, after calculating the standard deviation of the nth group of audio data matrices, the control terminal combines the t-test theorem and the normal distribution formula, and substitutes the variance of the first mean matrix, the mean of the nth group of audio data matrices, and the standard deviation of the nth group of audio data matrices into the preset test formula to obtain the first verification value. The preset test formula can be but is not limited to the following: In the above formula, can correspond to the first verification value, n can correspond to the number of elements in the nth group of audio data matrices, S can correspond to the standard deviation of the nth group of audio data matrices, can correspond to the mean of the nth group of audio data matrices, can correspond to the mean element corresponding to the same position information in the first mean matrix, can be understood as the chi-square variable theorem formula.
[0042] Further, the control terminal can also determine the degrees of freedom according to the number of all elements in the nth group of audio data matrices (which can be but is not limited to the difference between the number of all elements in the nth group of audio data matrices minus one), and the default preset significance level parameter (which can be but is not limited to 0.025), query the second verification value corresponding to the degrees of freedom and the preset significance level parameter in the t critical value table, and judge the magnitude of the absolute value of the second verification value and the first verification value.
[0043] Possibly, when it is detected that the absolute value of the first verification value is greater than the second verification value, it indicates that the n groups of audio data do not conform to the normal distribution, that is, the nth group of audio data does not contain a valid sound source. Furthermore, it can be determined that the imaging range value corresponding to the nth group of audio data is a preset range value, and the acoustic imager can be controlled to image the sound source signal of the nth group of audio data in the display interface according to the preset range value. Among them, the preset range value can be understood as a range value set by the user himself or a default set range value, and it can be but is not limited to 3dB.
[0044] Possibly, when it is detected that the absolute value of the first verification value is less than or equal to the second verification value, it indicates that the n groups of audio data conform to the normal distribution, that is, the nth group of audio data contains a valid sound source. Furthermore, the terminal can control to determine the two elements with the largest values in the first mean peak matrix, and use the absolute value of the difference between the two elements with the largest values as the imaging range value corresponding to the nth group of audio data, and the acoustic imager can be controlled to image the sound source signal of the nth group of audio data in the display interface according to the absolute value of the difference between the two elements with the largest values.
[0045] As an option in the embodiment of the present application, the method further includes: Obtain the (n + 1)th group of audio data, and obtain an audio data matrix corresponding to the (n + 1)th group of audio data based on the acoustic imaging algorithm; Perform a mean calculation on the (n + 1) groups of audio data matrices to obtain a second mean matrix, screen out all elements in the second mean matrix whose values are greater than the preset first constant, and use the set of all the elements and the position information of each element corresponding to the element in the second mean matrix as the third mean peak matrix; Screen out all elements in the (n + 1)th group of audio data matrices whose values are greater than the preset second constant, and use the set of all the elements and the position information of each element corresponding to the element in the nth group of audio data matrices as the fourth mean peak matrix; When the same position information is not found in the third mean peak matrix and the fourth mean peak matrix, determine that the imaging range value corresponding to the (n + 1)th group of audio data is the preset range value, and display the (n + 1)th group of audio data according to the preset range value.
[0046] Specifically, when continuously obtaining the consecutive (n + 1)th group of audio data, the control terminal can respectively obtain a third mean peak matrix and a fourth mean peak matrix in combination with the (n + 1)th group of audio data, and further determine whether there is a valid sound source in the current (n + 1)th group of audio data by comparing whether there is the same position information in the third mean peak matrix and the fourth mean peak matrix, and then determine the corresponding imaging range value. For details, reference can be made to the above embodiments and will not be elaborated here.
[0047] As another alternative in the embodiments of the present application, the method further includes: When it is detected that the number of signal images displayed by the nth group of the audio data exceeds a preset number threshold, send a warning message corresponding to the preset number threshold.
[0048] Specifically, when the control terminal detects that the number of sound source signals of the current image in the image displayed by the acoustic imager exceeds the preset number threshold, it indicates that the imaging result may be abnormal. Furthermore, the control terminal can generate a warning message corresponding to the preset number threshold, such as but not limited to generating a prompt message of "the number of images of the current sound source signal exceeds the preset number" to timely notify the staff for inspection.
[0049] Please refer to Figure 3 , Figure 3 which shows a schematic structural diagram of an imaging dynamic range definition device for sound source signals provided by the embodiments of the present application.
[0050] As Figure 3 shown, the imaging dynamic range definition device for sound source signals may at least include a matrix generation module 301, a first screening module 302, a second screening module 303, a first processing module 304, and a second processing module 305, where: The matrix generation module 301 is configured to obtain n groups of continuous audio data and obtain an audio data matrix corresponding to each group of audio data based on an acoustic imaging algorithm; The first screening module 302 is configured to calculate the mean value of the n groups of audio data matrices to obtain a first mean matrix, screen out all elements with values greater than a preset first constant in the first mean matrix, and use the set of all elements and the position information of each element in the first mean matrix corresponding thereto as the first mean peak matrix; The second screening module 303 is configured to screen out all elements with values greater than a preset second constant in the nth group of audio data matrices, and use the set of all elements and the position information of each element in the nth group of audio data matrices corresponding thereto as the second mean peak matrix; The first processing module 304 is configured to, when the same position information is not found in the first mean peak matrix and the second mean peak matrix, determine that the imaging range value corresponding to the nth group of audio data is a preset range value, and display the nth group of audio data according to the preset range value; The second processing module 305 is configured to, when the same position information is found in the first mean peak matrix and the second mean peak matrix, determine a mean element in the first mean matrix that is consistent with the same position information, and obtain the imaging range value corresponding to the nth group of audio data according to the mean element.
[0051] In some possible embodiments, the second processing module is specifically configured to: Calculate the variance of the first mean matrix according to the mean element, all elements in the first mean matrix, and the number of all elements; Perform a mean calculation on the nth group of audio data matrices to obtain the mean of the nth group of audio data matrices, and calculate the standard deviation of the nth group of audio data matrices according to the mean of the nth group of audio data matrices, all elements in the nth group of audio data matrices, and the number of all elements; wherein, the number of all elements in the first mean matrix is equal to the number of all elements in the nth group of audio data matrices; Substitute the variance of the first mean matrix, the mean of the nth group of audio data matrices, and the standard deviation of the nth group of audio data matrices into a preset test formula to obtain a first verification value; Query a second verification value in the t critical value table according to the number of all elements in the nth group of audio data matrices and a preset significance level parameter; When the absolute value of the first verification value is greater than the second verification value, determine the imaging range value corresponding to the nth group of audio data as a preset range value, and display the nth group of audio data according to the preset range value.
[0052] In some possible embodiments, the second processing module is further configured to: After querying the second verification value in the t critical value table according to the number of all elements in the nth group of audio data matrices and the preset significance level parameter, When the absolute value of the first verification value is less than or equal to the second verification value, determine the two elements with the largest values in the first mean peak matrix; Use the absolute value of the difference between the two elements with the largest values as the imaging range value corresponding to the nth group of audio data, and display the nth group of audio data according to the imaging range value corresponding to the nth group of audio data.
[0053] In some possible embodiments, the apparatus further includes: Obtain the (n + 1)th group of audio data, and obtain an audio data matrix corresponding to the (n + 1)th group of audio data based on an acoustic imaging algorithm; Perform a mean calculation on the (n + 1) groups of audio data matrices to obtain a second mean matrix, screen out all elements in the second mean matrix whose values are greater than a preset first constant, and use the set of all elements and the position information of each element corresponding in the second mean matrix as a third mean peak matrix; Screen out all elements in the (n + 1)th group of audio data matrices whose values are greater than a preset second constant, and use the set of all elements and the position information of each element corresponding in the nth group of audio data matrices as a fourth mean peak matrix; When the same position information is not found in the third mean peak matrix and the fourth mean peak matrix, determine that the imaging range value corresponding to the (n + 1)-th group of audio data is a preset range value, and display the (n + 1)-th group of audio data according to the preset range value.
[0054] In some possible embodiments, the apparatus further includes: When it is detected that the number of signal images displayed by the n-th group of audio data exceeds a preset number threshold, send a warning message corresponding to the preset number threshold.
[0055] Those skilled in the art can clearly understand that the technical solutions of the embodiments of the present application can be implemented by means of software and / or hardware. The "units" and "modules" in this specification refer to software and / or hardware that can independently complete or cooperate with other components to complete specific functions, where the hardware can be, for example, a Field-Programmable Gate Array (FPGA), an Integrated Circuit (IC), etc.
[0056] Please refer to Figure 4 , Figure 4 which shows a schematic structural diagram of another apparatus for defining the imaging dynamic range of a sound source signal provided by an embodiment of the present application.
[0057] As Figure 4 shown, the apparatus 400 for defining the imaging dynamic range of a sound source signal may include at least one processor 401, at least one network interface 404, a user interface 403, a memory 405, and at least one communication bus 402.
[0058] Among them, the communication bus 402 can be used to implement the connection and communication of the above-mentioned various components.
[0059] Among them, the user interface 403 may include keys, and the optional user interface may further include a standard wired interface and a wireless interface.
[0060] Among them, the network interface 404 may include, but is not limited to, a Bluetooth module, an NFC module, a Wi-Fi module, etc.
[0061] Among them, the processor 401 may include one or more processing cores. The processor 401 is connected to various parts within the imaging dynamic range definition device 400 of the sound source signal through various interfaces and lines. By running or executing instructions, programs, code sets, or instruction sets stored in the memory 405, and by invoking the data stored in the memory 405, it executes various functions of the imaging dynamic range definition device 400 for routing the sound source signal and processes data. Optionally, the processor 401 may be implemented in at least one hardware form of DSP, FPGA, or PLA. The processor 401 may integrate one or a combination of several of CPU, GPU, and modem, etc. Among them, the CPU mainly processes the operating system, user interface, application programs, etc.; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 401 and may be implemented separately by a single chip.
[0062] Among them, the memory 405 may include RAM and may also include ROM. Optionally, the memory 405 includes a non-transitory computer-readable medium. The memory 405 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 405 may include a program storage area and a data storage area. Among them, the program storage area may store instructions for implementing the operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store the data involved in the above-mentioned various method embodiments. Optionally, the memory 405 may also be at least one storage device located far from the aforementioned processor 401. As Figure 4 shown, the memory 405 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an imaging dynamic range definition application program for the sound source signal.
[0063] Specifically, the processor 401 may be used to call the imaging dynamic range definition application program stored in the memory 405 and specifically perform the following operations: Obtain n sets of consecutive audio data, and obtain an audio data matrix corresponding to each set of audio data based on the acoustic imaging algorithm; Perform a mean calculation on the n sets of audio data matrices to obtain a first mean matrix, screen out all elements in the first mean matrix whose values are greater than a preset first constant, and use the set of all elements and the position information of each element in the first mean matrix as the first mean peak matrix; Screen out all elements in the nth set of audio data matrices whose values are greater than a preset second constant, and use the set of all elements and the position information of each element in the nth set of audio data matrices as the second mean peak matrix; When the same position information is not found in the first mean peak matrix and the second mean peak matrix, determine that the imaging range value corresponding to the nth group of audio data is a preset range value, and display the nth group of audio data according to the preset range value; When the same position information is found in the first mean peak matrix and the second mean peak matrix, determine the mean element in the first mean matrix that is consistent with the same position information, and obtain the imaging range value corresponding to the nth group of audio data according to the mean element.
[0064] In some possible embodiments, obtaining the imaging range value corresponding to the nth group of audio data according to the mean element includes: Calculate the variance of the first mean matrix according to the mean element, all elements in the first mean matrix, and the number of all elements; Perform a mean calculation on the nth group of audio data matrix to obtain the mean of the nth group of audio data matrix, and calculate the standard deviation of the nth group of audio data matrix according to the mean of the nth group of audio data matrix, all elements in the nth group of audio data matrix, and the number of all elements; wherein, the number of all elements in the first mean matrix is equal to the number of all elements in the nth group of audio data matrix; Substitute the variance of the first mean matrix, the mean of the nth group of audio data matrix, and the standard deviation of the nth group of audio data matrix into a preset test formula to obtain a first verification value; Query a second verification value in the t critical value table according to the number of all elements in the nth group of audio data matrix and a preset significance level parameter; When the absolute value of the first verification value is greater than the second verification value, determine that the imaging range value corresponding to the nth group of audio data is a preset range value, and display the nth group of audio data according to the preset range value.
[0065] In some possible embodiments, after querying the second verification value in the t critical value table according to the number of all elements in the nth group of audio data matrix and a preset significance level parameter, it further includes: When the absolute value of the first verification value is less than or equal to the second verification value, determine the two elements with the largest values in the first mean peak matrix; Take the absolute value of the difference between the two elements with the largest values as the imaging range value corresponding to the nth group of audio data, and display the nth group of audio data according to the imaging range value corresponding to the nth group of audio data.
[0066] In some possible embodiments, it further includes: Obtain the (n + 1)th group of audio data, and obtain an audio data matrix corresponding to the (n + 1)th group of audio data based on an acoustic imaging algorithm; Calculate the mean value of n + 1 groups of audio data matrices to obtain a second mean matrix. Screen out all elements in the second mean matrix whose values are greater than a preset first constant, and use the set of all elements and the position information of each element in the second mean matrix as a third mean peak matrix; Screen out all elements in the (n + 1)-th group of audio data matrices whose values are greater than a preset second constant, and use the set of all elements and the position information of each element in the n-th group of audio data matrices as a fourth mean peak matrix; When no identical position information is found in the third mean peak matrix and the fourth mean peak matrix, determine that the imaging range value corresponding to the (n + 1)-th group of audio data is a preset range value, and display the (n + 1)-th group of audio data according to the preset range value.
[0067] In some possible embodiments, it further includes: When it is detected that the number of signal images displayed by the n-th group of audio data exceeds a preset number threshold, send a warning message corresponding to the preset number threshold.
[0068] This application also provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the steps of the above method are implemented. Among them, the computer-readable storage medium may include, but is not limited to, any type of disk, including floppy disks, optical discs, DVDs, CD-ROMs, micro drives, and magneto-optical discs, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices, magnetic cards or optical cards, nano-systems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and / or data.
[0069] It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that this application is not limited by the described action sequence, because according to this application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0070] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0071] In several embodiments provided by this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling, direct coupling, or communication connection to each other can be through some service interfaces. The indirect coupling or communication connection of devices or units can be in an electrical or other form.
[0072] The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they can be located in one place, or they can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0073] In addition, in each embodiment of this application, each functional unit can be integrated into a processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units.
[0074] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in each embodiment of this application. And the aforementioned memory includes: USB flash drives, read-only memories (ROM), random access memories (RAM), mobile hard disks, magnetic disks, or optical discs and other media that can store program codes.
[0075] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. This program can be stored in a computer-readable memory. The memory can include: flash drives, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical discs, etc.
[0076] The above are only exemplary embodiments of the present disclosure, and the scope of the present disclosure cannot be limited thereby. That is, any equivalent changes and modifications made in accordance with the teachings of the present disclosure still fall within the scope covered by the present disclosure. Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common general knowledge or conventional technical means in the technical field not recorded in the present disclosure. The specification and examples are only regarded as exemplary, and the scope and spirit of the present disclosure are defined by the claims.
Claims
1. A method for defining the imaging dynamic range of a sound source signal, characterized in that, Including: Obtain n groups of consecutive audio data, and obtain an audio data matrix corresponding to each group of the audio data based on an acoustic imaging algorithm; Perform a mean calculation on the n groups of the audio data matrices to obtain a first mean matrix, screen out all elements in the first mean matrix whose values are greater than a preset first constant, and use the set of all the elements and the position information of each element corresponding in the first mean matrix as a first mean peak matrix; Screen out all elements in the nth group of the audio data matrices whose values are greater than a preset second constant, and use the set of all the elements and the position information of each element corresponding in the nth group of the audio data matrices as a second mean peak matrix; When no identical position information is found in the first mean peak matrix and the second mean peak matrix, determine that the imaging range value corresponding to the nth group of the audio data is a preset range value, and display the nth group of the audio data according to the preset range value; When identical position information is found in the first mean peak matrix and the second mean peak matrix, determine a mean element in the first mean matrix that is consistent with the identical position information, and obtain the imaging range value corresponding to the nth group of the audio data according to the mean element.
2. The method according to claim 1, wherein The obtaining the imaging range value corresponding to the nth group of the audio data according to the mean element includes: Calculate the variance of the first mean matrix according to the mean element, all elements in the first mean matrix, and the number of all elements; Perform a mean calculation on the nth group of the audio data matrices to obtain the mean of the nth group of the audio data matrices, and calculate the standard deviation of the nth group of the audio data matrices according to the mean of the nth group of the audio data matrices, all elements in the nth group of the audio data matrices, and the number of all elements; wherein, the number of all elements in the first mean matrix is equal to the number of all elements in the nth group of the audio data matrices; Substitute the variance of the first mean matrix, the mean of the nth group of the audio data matrices, and the standard deviation of the nth group of the audio data matrices into a preset test formula to obtain a first verification value; Query a second verification value in a t critical value table according to the number of all elements in the nth group of the audio data matrices and a preset significance level parameter; When the absolute value of the first verification value is greater than the second verification value, determine that the imaging range value corresponding to the nth group of the audio data is the preset range value, and display the nth group of the audio data according to the preset range value.
3. The method according to claim 2, wherein After querying the second verification value in the t critical value table according to the number of all elements in the nth group of the audio data matrices and the preset significance level parameter, it further includes: When the absolute value of the first verification value is less than or equal to the second verification value, determine two elements with the largest values in the first mean peak matrix; Use the absolute value of the difference between the two elements with the largest values as the imaging range value corresponding to the nth group of the audio data, and display the nth group of the audio data according to the imaging range value corresponding to the nth group of the audio data.
4. The method according to claim 1, characterized in that The method further includes: Obtain the (n + 1)-th group of audio data, and obtain an audio data matrix corresponding to the (n + 1)-th group of the audio data based on an acoustic imaging algorithm; Perform a mean calculation on the (n + 1) groups of the audio data matrices to obtain a second mean matrix, screen out all elements in the second mean matrix whose values are greater than the preset first constant, and use the set of all the elements and the position information of each element corresponding in the second mean matrix as a third mean peak matrix; Screen out all elements in the (n + 1)-th group of the audio data matrix whose values are greater than the preset second constant, and use the set of all the elements and the position information of each element corresponding in the n-th group of the audio data matrix as a fourth mean peak matrix; When no identical position information is found in the third mean peak matrix and the fourth mean peak matrix, determine that the imaging range value corresponding to the (n + 1)-th group of the audio data is a preset range value, and display the (n + 1)-th group of the audio data according to the preset range value.
5. The method according to claim 1, wherein The method further includes: When it is detected that the number of signal images displayed by the n-th group of the audio data exceeds a preset number threshold, send a warning information corresponding to the preset number threshold.
6. An imaging dynamic range defining device for a sound source signal, characterized in that, It includes: A matrix generation module, configured to obtain n groups of consecutive audio data, and obtain an audio data matrix corresponding to each group of the audio data based on an acoustic imaging algorithm; A first screening module, configured to perform a mean calculation on the n groups of the audio data matrices to obtain a first mean matrix, screen out all elements in the first mean matrix whose values are greater than a preset first constant, and use the set of all the elements and the position information of each element corresponding in the first mean matrix as a first mean peak matrix; A second screening module, configured to screen out all elements in the n-th group of the audio data matrix whose values are greater than a preset second constant, and use the set of all the elements and the position information of each element corresponding in the n-th group of the audio data matrix as a second mean peak matrix; A first processing module, configured to, when no identical position information is found in the first mean peak matrix and the second mean peak matrix, determine that the imaging range value corresponding to the n-th group of the audio data is a preset range value, and display the n-th group of the audio data according to the preset range value; A second processing module, configured to, when identical position information is found in the first mean peak matrix and the second mean peak matrix, determine a mean element in the first mean matrix that is consistent with the identical position information, and obtain the imaging range value corresponding to the n-th group of the audio data according to the mean element.
7. The device according to claim 6, characterized in that, The second processing module is specifically configured to: Calculate the variance of the first mean matrix according to the mean element, all elements in the first mean matrix, and the number of all elements; Calculate the mean of the nth group of the audio data matrix to obtain the mean of the nth group of the audio data matrix, and calculate the standard deviation of the nth group of the audio data matrix based on the mean of the nth group of the audio data matrix, all elements in the nth group of the audio data matrix, and the number of all elements; wherein, the number of all elements in the first mean matrix is equal to the number of all elements in the nth group of the audio data matrix. Substitute the variance of the first mean matrix, the mean of the nth group of the audio data matrix, and the standard deviation of the nth group of the audio data matrix into a preset test formula to obtain a first verification value. Query a second verification value in the t critical value table according to the number of all elements in the nth group of the audio data matrix and a preset significance level parameter. When the absolute value of the first verification value is greater than the second verification value, determine that the imaging range value corresponding to the nth group of the audio data is the preset range value, and display the nth group of the audio data according to the preset range value.
8. The device according to claim 7, wherein The second processing module is further configured to: After querying the second verification value in the t critical value table according to the number of all elements in the nth group of the audio data matrix and the preset significance level parameter, When the absolute value of the first verification value is less than or equal to the second verification value, determine two elements with the largest values in the first mean peak matrix. Take the absolute value of the difference between the two elements with the largest values as the imaging range value corresponding to the nth group of the audio data, and display the nth group of the audio data according to the imaging range value corresponding to the nth group of the audio data.
9. An imaging dynamic range defining device for a sound source signal, characterized in that, It includes a processor and a memory. The processor is connected to the memory. The memory is used to store executable program code. The processor runs a program corresponding to the executable program code by reading the executable program code stored in the memory to execute the steps of the method according to any one of claims 1-5.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that, Instructions are stored in the computer-readable storage medium, and when the instructions are run on a computer or a processor, the computer or the processor is caused to execute the steps of the method according to any one of claims 1-5.
Citation Information
Patent Citations
Image capturing apparatus, imaging circuit, and image capturing method
CN101031021A
Breath tracking method based on thermal imaging technology
CN107403407A
Ultrasonic image processing method and ultrasonic instrument
CN113892967A
Electrical impedance imaging method and computer readable storage medium
CN114224313A
Adaptive adjustment method, device and equipment of acoustic camera and storage medium
CN117346881A