Dynamic gain equalization method, device, equipment and product for sound equipment

Abstract

The invention discloses a dynamic gain equalization method, device, equipment and product for sound equipment, and relates to the technical field of sound processing. The method comprises the following steps: performing empirical mode decomposition processing on each field sound signal from a microphone array to obtain corresponding N intrinsic mode function components, searching at least one adjacent frequency point group according to N component center frequency points of each signal, and searching at least one adjacent frequency point group according to each adjacent frequency point group to obtain N component center frequency points of each signal; the method comprises the following steps of: determining a corresponding sound source position according to a set of intrinsic mode function components, performing dynamic gain equalization processing on each intrinsic mode function component in each set when the sound source position is judged to be in a layout area of a loudspeaker to obtain a corresponding processed intrinsic mode function component, and finally reconstructing based on a processing result to obtain a processed sound signal. And the sound signals are transmitted to the loudspeaker for on-site playing, so that a wave trap is not needed, howling phenomenon suppression on the sound signals not from the loudspeaker can be avoided, and the aim of suppressing the howling phenomenon is fulfilled.

Description

Technical Field

[0001] The present invention belongs to the technical field of sound processing, and in particular relates to a dynamic gain equalization method, device, equipment and product for sound. Background Art

[0002] Howling refers to the phenomenon that when two or more sound waves are superimposed at similar frequencies, the same phase and opposite directions during the propagation of sound, the sound becomes louder, forming a self-amplification effect. This phenomenon is particularly common in audio equipment. For example, when the distance between the speaker and the microphone is too close, the sound emitted by the speaker will be received by the microphone and amplified again, thus producing howling.

[0003] In order to avoid howling in audio equipment, measures to suppress howling are needed. Currently, howling is mainly suppressed by notch filters. However, after the howling is suppressed by the notch filters, the audio system often becomes mute, resulting in reduced audio output effect of the audio system. When the input sound signal is small, the existing audio system does not perform well in certain audio frequency bands. Although the performance can be improved by adjusting the equalization gain of the frequency band, when the signal of the frequency band increases, the pre-increased equalization gain is prone to cause distortion.

[0004] In view of the above defects, the existing patent "CN114640925A, a dynamic gain equalization system and method for audio" provides a dynamic gain equalization system and method for audio, including the following steps: detecting the first sound signal and the second sound signal before and after the notch filter to obtain the first volume, the second volume and the second frequency; processing the second sound signal to obtain the third sound signal; judging the third sound signal; when the volume of the third sound signal belongs to the preset volume range value and the frequency belongs to the preset frequency range value, directly output; when the volume of the third sound signal does not belong to the preset volume range value and / or the frequency does not belong to the preset frequency range value, the third sound signal is subjected to gain equalization processing. By detecting and comparing the sound signals before and after the notch filter, the volume value of the second sound signal is increased from the second volume to the first volume, thereby ensuring the sound playback effect; and gain processing will not be performed on all sound signals to avoid sound distortion as much as possible.

[0005] However, the above existing solutions still require a trap to suppress the howling phenomenon, and the source of the sound signal is not comprehensive when suppressing the howling phenomenon, so that the sound signal that does not come from the speaker is also suppressed, causing subsequent sound playback distortion. Therefore, how to provide a new solution for audio that can locate the sound source and perform targeted dynamic gain equalization, so that no trap is required, how to avoid suppressing the howling phenomenon of the sound signal that does not come from the speaker, and then ensure the authenticity of the subsequent sound playback, has become a topic that technicians in this field urgently need to study. Summary of the invention

[0006] The purpose of the present invention is to provide a dynamic gain equalization method, device, computer equipment, computer readable storage product and computer program product for audio, so as to solve the problem that the existing dynamic gain equalization scheme for audio still needs a notch filter to suppress howling phenomenon and lacks comprehensiveness of the sound signal source when suppressing howling phenomenon, thereby causing subsequent sound playback distortion.

[0007] In order to achieve the above object, the present invention adopts the following technical solutions: In a first aspect, a dynamic gain equalization method for an audio system is provided, comprising: Receives data from the microphone array A live sound signal, wherein the microphone array includes The live sound signals correspond one to one A microphone, represents a positive integer greater than or equal to 4; For the Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, where represents a positive integer greater than or equal to 3; For each of the on-site sound signals, according to the corresponding Intrinsic mode function components, determine the corresponding component center frequencies, where The center frequency of the components is The intrinsic mode function components correspond one to one; According to the component center frequency points, find at least one adjacent frequency point group, wherein the adjacent frequency point group contains frequency points corresponding to different sound signals The center frequency of the components, The maximum frequency difference between the center frequencies of the components is less than or equal to the preset frequency threshold. Indicates greater than or equal to 3 and less than or equal to A positive integer of ; For each adjacent frequency point group in the at least one adjacent frequency point group, according to the corresponding The center frequencies of the components correspond one to one The intrinsic mode function components and the The intrinsic mode function components correspond one to one The known layout positions of the microphones are used to determine the corresponding sound source positions, and to determine whether the sound source positions are within the layout area of ​​the loudspeakers. If so, the corresponding sound source positions are respectively The inherent mode function components are dynamically equalized to obtain the same The intrinsic mode function components correspond one to one The processed intrinsic mode function components; For each of the on-site sound signals, reconstruct the corresponding processed sound signal according to all the corresponding processed intrinsic mode function components and all the intrinsic mode function components that have not been subjected to dynamic gain equalization processing; The processed sound signals of the various on-site sound signals are transmitted to the loudspeakers for on-site playback.

[0008] Based on the above invention content, a new solution for audio that can locate the sound source and perform dynamic gain equalization in a targeted manner is provided, that is, first, for each on-site sound signal from a microphone array, an empirical mode decomposition process is performed on the corresponding signal to obtain corresponding N intrinsic mode function components, and then at least one adjacent frequency point group is found according to the central frequency points of the N components of each signal, and then for each adjacent frequency point group, the corresponding sound source position is determined, and when it is determined that the sound source position is within the layout area of ​​the loudspeaker, dynamic gain equalization process is performed on each intrinsic mode function component in the group to obtain corresponding processed intrinsic mode function components, and finally, the processed sound signal is reconstructed based on the processing result and transmitted to the loudspeaker for on-site playback, so that no trap filter is required, and the howling phenomenon suppression of the sound signal not coming from the loudspeaker can be avoided, thereby achieving the purpose of suppressing the howling phenomenon, and then the authenticity of the subsequent sound playback can be ensured, which is convenient for practical application and promotion.

[0009] In one possible design, for the Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, including: According to the preset cycle , periodically targeting the Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, where is less than or equal to the processing time required for the sound signal from the microphone array to the speaker, Represents a positive integer greater than or equal to 3.

[0010] In a possible design, according to the component center frequency points, and find at least one adjacent frequency point group, including: In the frequency domain, the above-mentioned each on-site sound signal is examined in sequence along the frequency from small to large direction. a component center frequency point, if it is found that a component center frequency point of a certain live sound signal in each of the live sound signals is located at the current frequency point and the current frequency point is not within the established frequency domain window, then a new frequency domain window is created with the current frequency point as the starting frequency point and the frequency domain width is equal to the preset frequency threshold; For each of the established frequency domain windows, determine whether the total number of frequency points of multiple component center frequency points corresponding to different sound signals in the corresponding window is greater than or equal to 3, and if so, include the multiple component center frequency points into an adjacent frequency point group, wherein the adjacent frequency point group includes the frequency points corresponding to different sound signals. The center frequency of the components, The maximum frequency difference between the center frequency points of the components is less than or equal to the preset frequency threshold, Indicates greater than or equal to 3 and less than or equal to A positive integer.

[0011] In one possible design, for each adjacent frequency point group in the at least one adjacent frequency point group, according to the corresponding The center frequencies of the components correspond one to one The intrinsic mode function components and the The intrinsic mode function components correspond one to one The known placement positions of the microphones are used to determine the corresponding sound source positions, including: For a certain adjacent frequency point group in the at least one adjacent frequency point group, determine the The center frequencies of the components correspond one to one IMF components; For the For each pair of intrinsic mode function components in the eigenmode function components, the corresponding signal propagation time difference value is calculated according to the corresponding two eigenmode function components; According to the The intrinsic mode function components correspond one to one The known layout positions of the microphones and the signal propagation time difference values ​​of the pairs of inherent mode function components are used to calculate the sound source position corresponding to the adjacent frequency point group using a time difference positioning algorithm.

[0012] In a possible design, when the microphone array is a mobile array, the information related to the microphone array is obtained as follows: The intrinsic mode function components correspond one to one The known locations of the microphones are: Receiving real-time positioning data from a wireless locator and real-time posture data from a posture sensor, wherein the wireless locator and the posture sensor are respectively bound to the microphone array; Determine the real-time positioning data and the real-time posture data The real-time position of each microphone; From the said The real-time position of the microphones is extracted and the The intrinsic mode function components correspond one to one The real-time position of each microphone is used as the known deployment position of the corresponding microphone.

[0013] In one possible design, the The inherent mode function components are dynamically equalized to obtain the same The intrinsic mode function components correspond one to one The processed intrinsic mode function components include: For the For each intrinsic modal function component in the eigenmode function components, determine whether the corresponding volume value belongs to the preset volume range. If so, do not perform dynamic gain equalization processing on the corresponding component. Otherwise, perform dynamic gain equalization processing on the corresponding component in the following manner to obtain the corresponding processed intrinsic modal function component: If the volume value of the intrinsic modal function component exceeds the upper limit value of the preset volume range, the intrinsic modal function component is attenuated so that the volume value of the intrinsic modal function component obtained after the attenuation processing and corresponding to the processed component is equal to the upper limit value of the preset volume range; And / or, if the volume value of the inherent modal function component is lower than the lower limit value of the preset volume range, the inherent modal function component is amplified so that the volume value of the amplified and corresponding processed inherent modal function component is equal to the lower limit value of the preset volume range.

[0014] In a second aspect, a dynamic gain equalization device for sound is provided, comprising a sound signal receiving unit, a signal decomposition processing unit, a component frequency point determination unit, an adjacent frequency point group search unit, a sound source localization and equalization processing unit, a sound signal reconstruction unit and a sound signal transmission unit; The sound signal receiving unit is used to receive the sound signal from the microphone array. A live sound signal, wherein the microphone array includes The live sound signals correspond one to one A microphone, represents a positive integer greater than or equal to 4; The signal decomposition processing unit is communicatively connected to the sound signal receiving unit, and is used for Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, where represents a positive integer greater than or equal to 3; The component frequency determination unit is communicatively connected to the signal decomposition processing unit, and is used for determining the component frequency points of each on-site sound signal according to the corresponding Intrinsic mode function components, determine the corresponding component center frequencies, where The center frequency of the components is The intrinsic mode function components correspond one to one; The adjacent frequency point group searching unit is communicatively connected to the component frequency point determining unit, and is used for determining the adjacent frequency point group according to the adjacent frequency point group searching unit. component center frequency points, find at least one adjacent frequency point group, wherein the adjacent frequency point group contains frequency points corresponding to different sound signals The center frequency of the components, The maximum frequency difference between the center frequencies of the components is less than or equal to the preset frequency threshold. Indicates greater than or equal to 3 and less than or equal to A positive integer of ; The sound source localization and equalization processing unit is respectively connected to the adjacent frequency point group search unit and the signal decomposition processing unit for each adjacent frequency point group in the at least one adjacent frequency point group according to the corresponding The center frequencies of the components correspond one to one The intrinsic mode function components and the The intrinsic mode function components correspond one to one The known layout positions of the microphones are used to determine the corresponding sound source positions, and to determine whether the sound source positions are within the layout area of ​​the loudspeakers. If so, the corresponding sound source positions are respectively The inherent mode function components are dynamically equalized to obtain the same The intrinsic mode function components correspond one to one The processed intrinsic mode function components; The sound signal reconstruction unit is communicatively connected to the sound source localization and equalization processing unit and the signal decomposition processing unit, and is used to reconstruct the corresponding processed sound signal according to all the corresponding processed intrinsic mode function components and all the intrinsic mode function components that have not been subjected to dynamic gain equalization processing for each of the on-site sound signals; The sound signal transmission unit is communicatively connected to the sound signal reconstruction unit, and is used to transmit the processed sound signals of the various on-site sound signals to the loudspeaker for on-site playback.

[0015] In a third aspect, the present invention provides a computer device, comprising a storage module, a processing module and a transceiver module which are communicatively connected in sequence, wherein the storage module is used to store a computer program, the transceiver module is used to send and receive messages, and the processing module is used to read the computer program and execute the dynamic gain equalization method as described in the first aspect or any possible design of the first aspect.

[0016] In a fourth aspect, the present invention provides a computer-readable storage product having instructions stored thereon, which, when executed on a computer, executes the dynamic gain equalization method as described in the first aspect or any possible design of the first aspect.

[0017] In a fifth aspect, the present invention provides a computer program product, comprising a computer program or instructions, which, when executed by a computer, implement the dynamic gain equalization method as described in the first aspect or any possible design of the first aspect.

[0018] Beneficial effects of the above scheme: (1) The present invention creatively provides a new solution for audio that can locate the sound source and perform dynamic gain equalization in a targeted manner, that is, first, for each live sound signal from the microphone array, the corresponding signal is subjected to empirical mode decomposition processing to obtain the corresponding N intrinsic mode function components, and then at least one adjacent frequency point group is found according to the central frequency points of the N components of each signal, and then for each adjacent frequency point group, the corresponding sound source position is determined, and when it is determined that the sound source position is within the layout area of ​​the loudspeaker, each intrinsic mode function component in the group is subjected to dynamic gain equalization processing to obtain the corresponding processed intrinsic mode function component, and finally, the processed sound signal is reconstructed based on the processing result and transmitted to the loudspeaker for live playback. In this way, no trap filter is required, and the howling phenomenon suppression of the sound signal not coming from the loudspeaker can be avoided, thereby achieving the purpose of suppressing the howling phenomenon, and further ensuring the authenticity of the subsequent sound playback, which is convenient for practical application and promotion. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0020] Figure 1 A flowchart of a dynamic gain equalization method for audio provided in an embodiment of the present application.

[0021] Figure 2 This is an example diagram of the arrangement of the microphone array provided in an embodiment of the present application.

[0022] Figure 3 This is an example diagram of the frequency domain window establishment results provided in an embodiment of the present application.

[0023] Figure 4 A schematic diagram of the structure of a dynamic gain equalization device for audio provided in an embodiment of the present application.

[0024] Figure 5 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the present invention will be briefly introduced below in combination with the drawings and the description of the embodiments or the prior art. Obviously, the following description of the structures of the drawings is only some embodiments of the present invention. For ordinary technicians in this field, other embodiments can be obtained based on these embodiments without creative work. It should be noted that the description of these embodiments is used to help understand the present invention, but does not constitute a limitation of the present invention.

[0026] It should be understood that although the terms first and second, etc. may be used herein to describe various objects, these objects should not be limited by these terms. These terms are only used to distinguish one object from another object. For example, a first object can be referred to as a second object, and similarly, a second object can be referred to as a first object without departing from the scope of the exemplary embodiments of the present invention.

[0027] It should be understood that the term "and / or" that may appear in this document is merely a description of the association relationship between associated objects, indicating that there may be three relationships. For example, A and / or B can indicate three situations: A exists alone, B exists alone, or A and B exist at the same time. For another example, A, B and / or C can indicate the existence of any one of A, B and C or any combination of them. The term " / and" that may appear in this document describes another type of association object relationship, indicating that there may be two relationships. For example, A / and B can indicate two situations: A exists alone or A and B exist at the same time. In addition, the character " / " that may appear in this document generally indicates that the previous and next associated objects are in an "or" relationship.

[0028] Example like Figures 1 to 3 As shown, the dynamic gain equalization method provided in the first aspect of this embodiment and used for audio can be, but is not limited to, executed by a computer device having certain computing resources and communicating with the microphone array and the speaker in the audio system, such as a server, a personal computer (PC, which refers to a multi-purpose computer with a size, price and performance suitable for personal use; desktops, laptops, small laptops, tablets and ultrabooks are all personal computers), a smart phone, a personal digital assistant (PDA) or a wearable device. Figure 1 As shown, the dynamic gain equalization method includes but is not limited to the following steps S1 to S7.

[0029] S1. Receives from the microphone array A live sound signal, wherein the microphone array includes The live sound signals correspond one to one A microphone, Represents a positive integer greater than or equal to 4.

[0030] In step S1, the Each microphone in the microphones is used to collect the corresponding on-site sound signal in real time, which can be achieved by using existing pickup products. The microphone array can be a fixed array or a mobile array (for example, arranged on a mobile microphone). Figure 2 As shown, the number of the microphones 100 can be, for example, 6, and they are arranged as follows: Figure 2 In addition, since the on-site sound signal is transmitted by data transmission, the on-site sound signal and other subsequent signals are all digital signals.

[0031] S2. For the Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, where Represents a positive integer greater than or equal to 3.

[0032] In step S2, since the live sound signal is mixed with the sound of the live speakers and the sounds of other live objects (such as people or musical instruments, etc.), it is necessary to perform signal decomposition to perform different dynamic gain equalization processing. The Empirical Mode Decomposition (EMD) denoising method is a commonly used denoising method. It performs empirical mode decomposition on the noisy signal, calculates the intrinsic mode functions (IMF) of each order, and then reconstructs certain IMF components to form the effect of high-pass and / or low-pass filters. Since the empirical mode decomposition denoising method believes that any complex sequence is formed by the superposition of multiple single-frequency signals, it can be decomposed into a combination of several intrinsic mode functions IMF. Assume that the live sound signal is ( represents the time variable), then The EMD decomposition formula is:

[0033] In the formula, Indicates less than or equal to A positive integer, Indicates Intrinsic mode function components (i.e. single frequency signals), In addition, the specific process of the empirical mode decomposition processing is a prior art and will not be described in detail here.

[0034] In the step S2, considering that the sound source needs to be localized later, in order to make a subsequent adjacent frequency point group correspond to a unique sound source by default (i.e., to avoid the coexistence of a primary sound source and a secondary sound source, where the primary sound source refers to a non-speaker object that emits an original sound signal of a certain specific frequency, and the secondary sound source refers to a speaker that emits a playback sound signal of the certain specific frequency), preferably, for the Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, including but not limited to: , periodically targeting the Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, where is less than or equal to the processing time required for the sound signal from the microphone array to the speaker, represents a positive integer greater than or equal to 3. Since the secondary sound source will sound later than the primary sound source, the aforementioned periodic processing can ensure that the current processed frame of live sound signal (which is a period of time The on-site sound signal) either comes from a primary sound source or from a secondary sound source, thereby ensuring that the position of the primary sound source or the secondary sound source can be located subsequently.

[0035] S3. For each of the on-site sound signals, according to the corresponding Intrinsic mode function components, determine the corresponding component center frequencies, where The center frequency of the components is The intrinsic mode function components correspond one to one.

[0036] In step S3, since the intrinsic mode function component is a single frequency signal, the spectrum of the intrinsic mode function component can be obtained by conventional signal time domain to frequency domain conversion method (such as Fourier transform method), and then the center point of the spectrum is selected as the corresponding component center frequency point.

[0037] S4. According to the respective on-site sound signals component center frequency points, find at least one adjacent frequency point group, wherein the adjacent frequency point group contains frequency points corresponding to different sound signals The center frequency of the components, The maximum frequency difference between the center frequencies of the components is less than or equal to the preset frequency threshold. Indicates greater than or equal to 3 and less than or equal to A positive integer.

[0038] In step S4, the technical idea of ​​searching the adjacent frequency point group is that the sound signals from the same sound source and arriving at different positions (i.e., the positions of different microphones) have the same or similar frequencies, so it can be inferred that different natural mode function components with the same or similar frequencies may come from the same sound source, that is, one adjacent frequency point group can correspond to one sound source by default. component center frequency points, and finding at least one adjacent frequency point group, including but not limited to the following steps S41-S42.

[0039] S41. In the frequency domain, the frequency of each on-site sound signal is examined in sequence from small to large If it is found that a component center frequency point of a certain live sound signal in each of the live sound signals is located at the current frequency point and the current frequency point is not in the established frequency domain window, a new frequency domain window is created with the current frequency point as the starting frequency point and the frequency domain width equal to the preset frequency threshold.

[0040] In step S41, the idea of ​​establishing the frequency domain window is: Among the component center frequency points, in the frequency domain, along the direction from small to large frequency, the first component center frequency point is used as the trigger starting point (i.e. Figure 3 The frequency domain window is delineated backwards from the red point in the figure, and the window width is set (it should be noted that the center frequency of the component in the window can no longer trigger the establishment of a new window, that is, it is necessary to avoid window overlap). Based on the example of 6 live sound signals (they correspond to the 6 microphones respectively), the establishment result of the frequency domain window is as follows: Figure 3 In addition, the preset frequency threshold can be preset based on historical experience.

[0041] S42. For each of the established frequency domain windows, determine whether the total number of frequency points of multiple component center frequencies corresponding to different sound signals in the corresponding window is greater than or equal to 3. If so, include the multiple component center frequencies into an adjacent frequency point group, wherein the adjacent frequency point group includes the frequency points corresponding to different sound signals. The center frequency of the components, The maximum frequency difference between the center frequency points of the components is less than or equal to the preset frequency threshold, Indicates greater than or equal to 3 and less than or equal to A positive integer.

[0042] In step S42, based on the example of six sound signals (which correspond one to one from the six microphones), as shown in FIG. Figure 3 As shown, an adjacent frequency point group including component center frequency point 1A, component center frequency point 3A and component center frequency point 6A can be obtained.

[0043] S5. For each adjacent frequency point group in the at least one adjacent frequency point group, according to the corresponding The center frequencies of the components correspond one to one The intrinsic mode function components and the The intrinsic mode function components correspond one to one The known layout positions of the microphones are used to determine the corresponding sound source positions, and to determine whether the sound source positions are within the layout area of ​​the loudspeakers. If so, the corresponding sound source positions are respectively The inherent mode function components are dynamically equalized to obtain the same The intrinsic mode function components correspond one to one The processed intrinsic mode function components.

[0044] In step S5, since one of the adjacent frequency point groups may correspond to a sound source by default, it is possible to determine whether the corresponding sound source is the speaker based on the corresponding sound source position and the positional relationship between the sound source position and the layout area of ​​the speaker. If so, dynamic gain equalization processing is performed on each inherent mode function component in the group to achieve the purpose of suppressing the howling phenomenon. Specifically, for each adjacent frequency point group in the at least one adjacent frequency point group, according to the corresponding The center frequencies of the components correspond one to one The intrinsic mode function components and the The intrinsic mode function components correspond one to one The known arrangement positions of the microphones are used to determine the corresponding sound source positions, including but not limited to the following steps S51 to S53.

[0045] S51. For a certain adjacent frequency point group in the at least one adjacent frequency point group, determine the corresponding The center frequencies of the components correspond one to one Intrinsic mode function components.

[0046] S52. For the For each pair of intrinsic mode function components in the eigenmode function components, the corresponding signal propagation time difference value is calculated according to the corresponding two intrinsic mode function components.

[0047] In step S52, since the two intrinsic mode function components are single-point frequency signals and have the same or adjacent frequencies, the signal propagation time difference value can be directly obtained based on their phase difference. In addition, it can also be obtained based on their actual peak / trough conditions. Specifically, for the For each pair of intrinsic mode function components in the eigenmode function components, the corresponding signal propagation time difference value is calculated according to the corresponding two eigenmode function components, including but not limited to the following steps S521 to S523.

[0048] S521. For the For a pair of intrinsic modal function components in the eigenmodal function components, at least one adjacent peak / trough moment group is found according to the corresponding two eigenmodal function components, wherein the adjacent peak / trough moment group includes two peak / trough moments corresponding one-to-one to the two eigenmodal function components, and the time difference between the two peak / trough moments is less than or equal to a preset time threshold.

[0049] In the step S521, the method for searching the adjacent peak / trough time group can be conventionally derived by referring to the method for searching the adjacent frequency point group, which will not be described in detail herein.

[0050] S522. For each adjacent peak / trough moment group in the at least one adjacent peak / trough moment group, calculate a corresponding time difference according to two corresponding peak / trough moments.

[0051] S523. Calculate the average value of the time difference of each adjacent peak / trough moment group to obtain the signal propagation time difference value corresponding to the pair of intrinsic mode function components.

[0052] S53. According to the The intrinsic mode function components correspond one to one The known layout positions of the microphones and the signal propagation time difference values ​​of the pairs of inherent mode function components are used to calculate the sound source position corresponding to the adjacent frequency point group using a time difference positioning algorithm.

[0053] In step S53, due to the The intrinsic mode function components correspond to different sound signals, and the different sound signals come from different microphones, so it can be determined that The intrinsic mode function components correspond one to one microphone. In addition, represents a positive integer greater than or equal to 3, so the sound source position corresponding to the adjacent frequency point group can be calculated based on the existing time difference positioning algorithm.

[0054] In step S5, considering that the microphone array is a mobile array, in order to accurately obtain the The intrinsic mode function components correspond one to one The layout positions of the microphones are preferably obtained according to the following steps S501 to S503 when the microphone array is a mobile array. The intrinsic mode function components correspond one to one The known locations of the microphones.

[0055] S501. Receive real-time positioning data from a wireless locator and real-time posture data from a posture sensor, wherein the wireless locator and the posture sensor are respectively bound to the microphone array.

[0056] In step S501, the wireless locator may, but is not limited to, use existing indoor positioning technologies based on Bluetooth or UWB (Ultra Wide Band) to obtain positioning data of the microphone array in real time, and the posture sensor may also be implemented using existing related devices.

[0057] S502. Determine the real-time positioning data and the real-time posture data according to the The real-time position of each microphone.

[0058] In step S502, the real-time position of each microphone may be conventionally derived based on existing geometric knowledge.

[0059] S503. From the The real-time position of the microphones is extracted and the The intrinsic mode function components correspond one to one The real-time position of each microphone is used as the known deployment position of the corresponding microphone.

[0060] In step S5, the layout area of ​​the speaker can be a real layout space, or a space that is extended to a certain extent based on the real layout space for the purpose of error tolerance. The specific process of the dynamic gain equalization processing can be, but is not limited to, conventionally derived based on the existing patent "CN114640925A, a dynamic gain equalization system and method for audio". Specifically, the The inherent mode function components are dynamically equalized to obtain the same The intrinsic mode function components correspond one to one The processed intrinsic mode function components include but are not limited to: For each intrinsic modal function component in the eigenmodal function components, it is determined whether the corresponding volume value belongs to the preset volume range. If so, the corresponding component is not subjected to dynamic gain equalization processing. Otherwise, the corresponding component is subjected to dynamic gain equalization processing in the following manner to obtain the corresponding processed intrinsic modal function component: if the volume value of the intrinsic modal function component exceeds the upper limit value of the preset volume range, the intrinsic modal function component is attenuated so that the volume value of the intrinsic modal function component obtained after the attenuation processing and corresponding to the processed intrinsic modal function component is equal to the upper limit value of the preset volume range; and / or, if the volume value of the intrinsic modal function component is lower than the lower limit value of the preset volume range, the intrinsic modal function component is amplified so that the volume value of the intrinsic modal function component obtained after the amplification processing and corresponding to the processed intrinsic modal function component is equal to the lower limit value of the preset volume range.

[0061] S6. For each of the on-site sound signals, reconstruct the corresponding processed sound signal according to all the corresponding processed intrinsic mode function components and all the intrinsic mode function components that have not been subjected to dynamic gain equalization processing.

[0062] In step S6, the specific process of signal reconstruction is prior art and will not be described in detail herein.

[0063] S7. Transmitting the processed sound signals of the various on-site sound signals to the speakers for on-site playback.

[0064] Therefore, based on the dynamic gain equalization method described in the aforementioned steps S1 to S7, a new solution for audio that can locate the sound source and perform dynamic gain equalization in a targeted manner is provided, that is, first, for each live sound signal from the microphone array, the corresponding signal is subjected to empirical mode decomposition processing to obtain the corresponding N intrinsic modal function components, and then at least one adjacent frequency point group is found according to the central frequency points of the N components of each signal, and then for each adjacent frequency point group, the corresponding sound source position is determined, and when it is determined that the sound source position is within the layout area of ​​the loudspeaker, each intrinsic modal function component in the group is subjected to dynamic gain equalization processing to obtain the corresponding processed intrinsic modal function component, and finally, the processed sound signal is reconstructed based on the processing result and transmitted to the loudspeaker for live playback, so that no trap filter is required, and the howling phenomenon suppression of the sound signal that does not come from the loudspeaker can be avoided, thereby achieving the purpose of suppressing the howling phenomenon, and then the authenticity of the subsequent sound playback can be ensured, which is convenient for practical application and promotion.

[0065] like Figure 4As shown, the second aspect of this embodiment provides a virtual device for implementing the dynamic gain equalization method described in the first aspect, including a sound signal receiving unit, a signal decomposition processing unit, a component frequency point determination unit, an adjacent frequency point group search unit, a sound source localization and equalization processing unit, a sound signal reconstruction unit and a sound signal transmission unit; The sound signal receiving unit is used to receive the sound signal from the microphone array. A live sound signal, wherein the microphone array includes The live sound signals correspond one to one A microphone, represents a positive integer greater than or equal to 4; The signal decomposition processing unit is communicatively connected to the sound signal receiving unit, and is used for Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, where represents a positive integer greater than or equal to 3; The component frequency determination unit is communicatively connected to the signal decomposition processing unit, and is used for determining the component frequency points of each on-site sound signal according to the corresponding Intrinsic mode function components, determine the corresponding component center frequencies, where The center frequency of the components is The intrinsic mode function components correspond one to one; The adjacent frequency point group searching unit is communicatively connected to the component frequency point determining unit, and is used for determining the adjacent frequency point group according to the adjacent frequency point group searching unit. component center frequency points, find at least one adjacent frequency point group, wherein the adjacent frequency point group contains frequency points corresponding to different sound signals The center frequency of the components, The maximum frequency difference between the center frequencies of the components is less than or equal to the preset frequency threshold. Indicates greater than or equal to 3 and less than or equal to A positive integer of ; The sound source localization and equalization processing unit is respectively connected to the adjacent frequency point group search unit and the signal decomposition processing unit for each adjacent frequency point group in the at least one adjacent frequency point group according to the corresponding The center frequencies of the components correspond one to one The intrinsic mode function components and the The intrinsic mode function components correspond one to one The known layout positions of the microphones are used to determine the corresponding sound source positions, and to determine whether the sound source positions are within the layout area of ​​the loudspeakers. If so, the corresponding sound source positions are respectively The inherent mode function components are dynamically equalized to obtain the same The intrinsic mode function components correspond one to one The processed intrinsic mode function components; The sound signal reconstruction unit is communicatively connected to the sound source localization and equalization processing unit and the signal decomposition processing unit, and is used to reconstruct the corresponding processed sound signal according to all the corresponding processed intrinsic mode function components and all the intrinsic mode function components that have not been subjected to dynamic gain equalization processing for each of the on-site sound signals; The sound signal transmission unit is communicatively connected to the sound signal reconstruction unit, and is used to transmit the processed sound signals of the various on-site sound signals to the loudspeaker for on-site playback.

[0066] The working process, working details and technical effects of the aforementioned device provided in the second aspect of this embodiment can be referred to the dynamic gain equalization method described in the first aspect, and will not be described in detail here.

[0067] like Figure 5 As shown, the third aspect of this embodiment provides a computer device for executing the dynamic gain equalization method as described in the first aspect, including a storage module, a processing module and a transceiver module that are sequentially connected in communication, wherein the storage module is used to store a computer program, the transceiver module is used to send and receive messages, and the processing module is used to read the computer program and execute the dynamic gain equalization method as described in the first aspect. For example, the storage module may include, but is not limited to, a random access memory (RAM), a read-only memory (ROM), a flash memory (Flash Memory), a first-in-first-out memory (FIFO) and / or a first-in-last-out memory (FILO), etc.; the processing module may include, but is not limited to, a microprocessor of the STM32F105 series. In addition, the computer device may also include, but is not limited to, a power module, a display screen and other necessary components.

[0068] The working process, working details and technical effects of the aforementioned computer device provided in the third aspect of this embodiment can be referred to the dynamic gain equalization method described in the first aspect, and will not be described in detail here.

[0069] In a fourth aspect of this embodiment, there is provided a computer-readable storage product storing instructions including the dynamic gain equalization method as described in the first aspect, that is, the computer-readable storage product stores instructions, and when the instructions are run on a computer, the dynamic gain equalization method as described in the first aspect is executed. The computer-readable storage product refers to a carrier for storing data, which may include but is not limited to computer-readable storage media such as floppy disks, optical disks, hard disks, flash memory, USB flash drives, and / or memory sticks (MemoryStick), and the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.

[0070] The working process, working details and technical effects of the aforementioned computer-readable storage product provided in the fifth aspect of this embodiment can be referred to the dynamic gain equalization method described in the first aspect, and will not be repeated here.

[0071] A fifth aspect of this embodiment provides a computer program product, including a computer program or instructions, wherein the computer program or instructions, when executed by a computer, implements the dynamic gain equalization method as described in the first aspect. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device.

[0072] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A dynamic gain equalization method for audio, characterized in that: include: Receives data from the microphone array A live sound signal, wherein the microphone array includes The live sound signals correspond one to one A microphone, represents a positive integer greater than or equal to 4; For the Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, where represents a positive integer greater than or equal to 3; For each of the on-site sound signals, according to the corresponding Intrinsic mode function components, determine the corresponding component center frequencies, where The center frequency of the components is The intrinsic mode function components correspond one to one; According to the component center frequency points, find at least one adjacent frequency point group, wherein the adjacent frequency point group contains frequency points corresponding to different sound signals The center frequency of the components, The maximum frequency difference between the center frequencies of the components is less than or equal to the preset frequency threshold. Indicates greater than or equal to 3 and less than or equal to A positive integer of ; For each adjacent frequency point group in the at least one adjacent frequency point group, according to the corresponding The center frequencies of the components correspond one to one The intrinsic mode function components and the The intrinsic mode function components correspond one to one The known layout positions of the microphones are used to determine the corresponding sound source positions, and to determine whether the sound source positions are within the layout area of ​​the loudspeakers. If so, the corresponding sound source positions are respectively The inherent mode function components are dynamically equalized to obtain the same The intrinsic mode function components correspond one to one The processed intrinsic mode function components; For each of the on-site sound signals, reconstruct the corresponding processed sound signal according to all the corresponding processed intrinsic mode function components and all the intrinsic mode function components that have not been subjected to dynamic gain equalization processing; The processed sound signals of the various on-site sound signals are transmitted to the loudspeakers for on-site playback.

2. The dynamic gain equalization method according to claim 1, characterized in that: For the Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, including: According to the preset cycle , periodically targeting the Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, where is less than or equal to the processing time required for the sound signal from the microphone array to the speaker, Represents a positive integer greater than or equal to 3.

3. The dynamic gain equalization method according to claim 1, characterized in that: According to the component center frequency points, and find at least one adjacent frequency point group, including: In the frequency domain, the above-mentioned each on-site sound signal is examined in sequence along the frequency from small to large direction. a component center frequency point, if it is found that a component center frequency point of a certain live sound signal in each of the live sound signals is located at the current frequency point and the current frequency point is not within the established frequency domain window, then a new frequency domain window is created with the current frequency point as the starting frequency point and the frequency domain width is equal to the preset frequency threshold; For each of the established frequency domain windows, determine whether the total number of frequency points of multiple component center frequency points corresponding to different sound signals in the corresponding window is greater than or equal to 3, and if so, include the multiple component center frequency points into an adjacent frequency point group, wherein the adjacent frequency point group includes the frequency points corresponding to different sound signals. The center frequency of the components, The maximum frequency difference between the center frequency points of the components is less than or equal to the preset frequency threshold, Indicates greater than or equal to 3 and less than or equal to A positive integer.

4. The dynamic gain equalization method according to claim 1, characterized in that: For each adjacent frequency point group in the at least one adjacent frequency point group, according to the corresponding The center frequencies of the components correspond one to one The intrinsic mode function components and the The intrinsic mode function components correspond one to one The known placement positions of the microphones are used to determine the corresponding sound source positions, including: For a certain adjacent frequency point group in the at least one adjacent frequency point group, determine the The center frequencies of the components correspond one to one IMF components; For the For each pair of intrinsic mode function components in the eigenmode function components, the corresponding signal propagation time difference value is calculated according to the corresponding two eigenmode function components; According to the The intrinsic mode function components correspond one to one The known layout positions of the microphones and the signal propagation time difference values ​​of the pairs of inherent mode function components are used to calculate the sound source position corresponding to the adjacent frequency point group using a time difference positioning algorithm.

5. The dynamic gain equalization method according to claim 1, characterized in that: When the microphone array is a mobile array, the following method is used to obtain the The intrinsic mode function components correspond one to one The known locations of the microphones are: Receiving real-time positioning data from a wireless locator and real-time posture data from a posture sensor, wherein the wireless locator and the posture sensor are respectively bound to the microphone array; Determine the real-time positioning data and the real-time posture data The real-time position of each microphone; From the said The real-time position of the microphones is extracted and the The intrinsic mode function components correspond one to one The real-time position of each microphone is used as the known deployment position of the corresponding microphone.

6. The dynamic gain equalization method according to claim 1, characterized in that: Respectively The inherent mode function components are dynamically equalized to obtain the same The intrinsic mode function components correspond one to one The processed intrinsic mode function components include: For the For each intrinsic modal function component in the eigenmode function components, determine whether the corresponding volume value belongs to the preset volume range. If so, do not perform dynamic gain equalization processing on the corresponding component. Otherwise, perform dynamic gain equalization processing on the corresponding component in the following manner to obtain the corresponding processed intrinsic modal function component: If the volume value of the intrinsic modal function component exceeds the upper limit value of the preset volume range, the intrinsic modal function component is attenuated so that the volume value of the intrinsic modal function component obtained after the attenuation processing and corresponding to the processed component is equal to the upper limit value of the preset volume range; And / or, if the volume value of the inherent modal function component is lower than the lower limit value of the preset volume range, the inherent modal function component is amplified so that the volume value of the amplified and corresponding processed inherent modal function component is equal to the lower limit value of the preset volume range.

7. A dynamic gain equalization device for audio, characterized in that: It includes a sound signal receiving unit, a signal decomposition processing unit, a component frequency point determination unit, an adjacent frequency point group search unit, a sound source positioning and equalization processing unit, a sound signal reconstruction unit and a sound signal transmission unit; The sound signal receiving unit is used to receive the sound signal from the microphone array. A live sound signal, wherein the microphone array includes The live sound signals correspond one to one A microphone, represents a positive integer greater than or equal to 4; The signal decomposition processing unit is communicatively connected to the sound signal receiving unit, and is used for Each of the live sound signals in the live sound signal is subjected to empirical mode decomposition processing to obtain the corresponding Intrinsic mode function components, where represents a positive integer greater than or equal to 3; The component frequency determination unit is communicatively connected to the signal decomposition processing unit, and is used for determining the component frequency points of each on-site sound signal according to the corresponding Intrinsic mode function components, determine the corresponding component center frequencies, where The center frequency of the components is The intrinsic mode function components correspond one to one; The adjacent frequency point group searching unit is communicatively connected to the component frequency point determining unit, and is used for determining the adjacent frequency point group according to the adjacent frequency point group searching unit. component center frequency points, find at least one adjacent frequency point group, wherein the adjacent frequency point group contains frequency points corresponding to different sound signals The center frequency of the components, The maximum frequency difference between the center frequencies of the components is less than or equal to the preset frequency threshold. Indicates greater than or equal to 3 and less than or equal to A positive integer of ; The sound source localization and equalization processing unit is respectively connected to the adjacent frequency point group search unit and the signal decomposition processing unit for each adjacent frequency point group in the at least one adjacent frequency point group according to the corresponding The center frequencies of the components correspond one to one The intrinsic mode function components and the The intrinsic mode function components correspond one to one The known layout positions of the microphones are used to determine the corresponding sound source positions, and to determine whether the sound source positions are within the layout area of ​​the loudspeakers. If so, the corresponding sound source positions are respectively The inherent mode function components are dynamically equalized to obtain the same The intrinsic mode function components correspond one to one The processed intrinsic mode function components; The sound signal reconstruction unit is communicatively connected to the sound source localization and equalization processing unit and the signal decomposition processing unit, and is used to reconstruct the corresponding processed sound signal according to all the corresponding processed intrinsic mode function components and all the intrinsic mode function components that have not been subjected to dynamic gain equalization processing for each of the on-site sound signals; The sound signal transmission unit is communicatively connected to the sound signal reconstruction unit, and is used to transmit the processed sound signals of the various on-site sound signals to the loudspeaker for on-site playback.

8. A computer device, characterized in that: It includes a storage module, a processing module and a transceiver module which are communicatively connected in sequence, wherein the storage module is used to store computer programs, the transceiver module is used to send and receive messages, and the processing module is used to read the computer program to execute the dynamic gain equalization method as described in any one of claims 1 to 6.

9. A computer readable storage product, characterized in that: The computer-readable storage product stores instructions, and when the instructions are executed on a computer, the dynamic gain equalization method according to any one of claims 1 to 6 is executed.

10. A computer program product comprising a computer program or instructions, characterized in that When the computer program or the instruction is executed by a computer, the dynamic gain equalization method according to any one of claims 1 to 6 is implemented.

Images