Acoustic processing method for directionally generating, grouping and managing sound frequency bands and eliminating and counteracting sound frequency bands

Abstract

The invention discloses an acoustic processing method for directionally generating, grouping and managing sound frequency bands and eliminating and counteracting the sound frequency bands, which comprises the following steps of: S1, carrying out AD (Analog to Digital) sampling on analog sound signals to be processed to obtain digital sound signals to be processed; s2, performing dynamic frequency band division on the to-be-processed digital sound signal to obtain a plurality of frequency band signals; s3, mapping the plurality of frequency band signals into a plurality of sound source groups; s4, each sound source group generates a directive sound signal pointing to the target area by using the sound radiation unit of the sound source group, and after the directive sound signal is synchronously transmitted to the target area, an actual mixed sound signal is formed; and S5, detecting, eliminating and counteracting a sound wave counteracting effect generated by the actual mixed sound signal in the target area. According to the method, high-quality accurate directional propagation can be realized, and the adaptability to a complex environment is enhanced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of acoustic processing, and more particularly to an acoustic processing method for directional generation of sound frequency band grouping management and elimination of cancellation. BACKGROUND

[0002] Currently, in the field of acoustic processing, effective management of sound signals and noise control have always been the focus of research. With the continuous development of audio technology, people have higher requirements for directional propagation of sound and noise elimination. In many application scenarios, such as conference rooms, theaters, and car interiors, it is necessary to accurately direct sound to specific areas, reduce interference in other areas, and eliminate the effects of sound wave cancellation to ensure sound quality.

[0003] Existing acoustic processing methods have certain limitations in sound frequency band management and noise elimination. Some traditional methods use fixed frequency band division methods, which cannot be dynamically adjusted according to the real-time changes of sound signals, resulting in poor performance when processing complex sound signals. For example, in a sound scene containing multiple frequency components and dynamic changes, fixed frequency band division may not accurately capture sound characteristics, affecting subsequent signal processing and directional propagation effects. In addition, for the detection and elimination of sound wave cancellation effects, some methods lack effective real-time monitoring and adaptive adjustment mechanisms, making it difficult to achieve stable noise elimination effects in different environments and sound conditions.

[0004] However, sound signals are complex and diverse, with frequency components, amplitudes, and phases changing over time and environment. At the same time, environmental noise, reflection, refraction, and other factors in actual application scenarios also interfere with the propagation and processing of sound. Therefore, how to implement an acoustic processing method that can dynamically divide frequency bands according to real-time changes in sound signals, accurately map frequency band signals to sound source groups, and produce high-quality directional sound signals while effectively detecting and eliminating sound wave cancellation effects is a problem that needs to be solved by those skilled in the art. SUMMARY

[0005] Therefore, the purpose of the present application is to provide an acoustic processing method for directional generation of sound frequency band grouping management and elimination of cancellation.

[0006] To achieve the above purpose, the present application adopts the following technical solutions:

[0007] In a first aspect, an acoustic processing method for directional generation of sound frequency band grouping management and elimination of cancellation is provided, comprising the following steps:

[0008] S1: AD sampling of the analog sound signal to be processed to obtain a digital sound signal to be processed;

[0009] S2: performing dynamic frequency band division on the digital sound signal to be processed to obtain a plurality of frequency band signals;

[0010] S3: mapping the plurality of frequency band signals to a plurality of sound source groups;

[0011] S4: each sound source group uses its sound radiation unit to generate a directional sound signal pointing to a target area, and after being synchronously propagated to the target area, forms an actual mixed sound signal;

[0012] S5: detecting and eliminating the sound wave cancellation effect of the actual mixed sound signal in the target area.

[0013] Preferably, S2 specifically comprises the following steps:

[0014] S21: performing frame processing on the digital sound signal to be processed using a Hanning window to obtain a windowed signal frame;

[0015] S22: performing fast Fourier transform on the windowed signal frame to obtain a complex spectrum corresponding to the windowed signal frame;

[0016] S23: calculating a power spectral density corresponding to the windowed signal frame based on the complex spectrum;

[0017] S24: mapping each frequency point in the power spectral density to a corresponding Bark frequency band;

[0018] S25: calculating the total energy of each frequency point in each Bark frequency band;

[0019] S26: calculating the relative energy difference of adjacent Bark frequency bands based on the total energy of each frequency point in each Bark frequency band;

[0020] S27: if the relative energy difference of the adjacent Bark frequency bands is greater than a preset threshold, reducing the boundary frequency value between the adjacent Bark frequency bands;

[0021] if the relative energy difference of the adjacent Bark frequency bands is less than the preset threshold, increasing the boundary frequency value between the adjacent Bark frequency bands;

[0022] S28: performing frequency band division on the digital sound signal to be processed using the reduced or increased boundary frequency value as the frequency band boundary to obtain the plurality of frequency band signals.

[0023] Preferably, S25 is implemented based on the following formula:

[0024]

[0025] Δf = f s / N

[0026] wherein E b represents the total energy of each frequency point in the bth Bark frequency band; b = 1, 2,..., B; B represents the number of Bark frequency bands; P(f) represents the power spectral density corresponding to the windowed signal frame; respectively represent the lower boundary frequency value and the upper boundary frequency value of the bth Bark frequency band; Δf represents the frequency resolution; f s represents the sampling frequency of the AD sampling; N represents the sampling frequency of the AD sampling.

[0027] Preferably, S26 is implemented based on the following formula:

[0028]

[0029] wherein E b+1 represents the total energy of each frequency point in the bth Bark frequency band; b = 1, 2,..., B; B represents the number of Bark frequency bands; P(f) represents the power spectral density corresponding to the windowed signal frame; b+1,b represents the relative energy difference between the bth Bark frequency band and the b+1th Bark frequency band; max(E b+1 ,E b ) represents the larger value of E b+1 and E b .

[0030] Preferably, S27 specifically comprises the following steps:

[0031] calculating the ratio of the relative energy difference of the adjacent Bark frequency bands to the preset threshold value;

[0032] if the relative energy difference of the adjacent Bark frequency bands is greater than the preset threshold value, reducing the boundary frequency value between the adjacent Bark frequency bands by F b+1,b hertz; wherein F b+1,b = μ b+1,b * γ b+1,b , μ b+1,b represents a preset coefficient, γ b+1,b represents the ratio of the relative energy difference of the adjacent Bark frequency bands to the preset threshold value;

[0033] if the relative energy difference of the adjacent Bark frequency bands is less than the preset threshold value, increasing the boundary frequency value between the adjacent Bark frequency bands by F b+1,b hertz.

[0034] Preferably, S3 specifically comprises the following steps:

[0035] mapping the ith frequency band signal into the ith, the ith+1th and the ith+2th sound source group, respectively; wherein i = 1, 2,..., I; I represents the number of frequency band signals obtained by S2.

[0036] Preferably, S4 specifically comprises the following steps:

[0037] Beamforming processing is performed on the frequency band signals in each sound source group to generate driving signals containing amplitude and phase information;

[0038] The driving signals are respectively delivered to each sound radiating unit in the sound source group to obtain the directional sound signals.

[0039] Preferably, S5 specifically comprises the following steps:

[0040] S51: obtaining an actual mixed sound signal of the target area by using a reference microphone;

[0041] S52: calculating a mean square error between the actual mixed sound signal and the expected sound signal;

[0042] S53: minimizing the mean square error to eliminate the cancellation effect of the sound waves.

[0043] Preferably, S53 specifically comprises the following steps:

[0044] The amplitude and phase of the driving signals are adjusted by using an adaptive filtering algorithm to minimize the mean square error.

[0045] In a second aspect, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor,

[0046] The processor implements the acoustic processing method for grouping management and cancellation of sound frequency band directional generation when executing the computer program.

[0047] According to the above technical solution, compared with the prior art, the present application provides an acoustic processing method for grouping management and cancellation of sound frequency band directional generation, which can realize high-quality accurate directional propagation and enhance adaptability to complex environments. BRIEF DESCRIPTION OF DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed in the embodiments or prior art description will be briefly introduced below. Obviously, the drawings in the following description are only embodiments of the present application, and those skilled in the art can obtain other drawings according to the provided drawings without creative labor.

[0049] Figure 1 A flowchart of an acoustic processing method for grouping management and cancellation of sound frequency band directional generation provided by the present application;

[0050] Figure 2 A flow chart of dynamic frequency band division provided by the present application;

[0051] Figure 3 A schematic diagram of an electronic device provided by the present application. DETAILED DESCRIPTION

[0052] The technical solutions in the embodiments of the present application will be clearly and completely described with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0053] In a first aspect, as shown in the accompanying drawings, Figure 1 The embodiments of the present application disclose an acoustic processing method for directional generation of sound frequency band grouping management and elimination cancellation, comprising the following steps:

[0054] S1: AD sampling is performed on a to-be-processed analog sound signal to obtain a to-be-processed digital sound signal;

[0055] S2: dynamic frequency band division is performed on the to-be-processed digital sound signal to obtain a plurality of frequency band signals;

[0056] In an embodiment, as shown in the accompanying drawings, Figure 2 S2 specifically comprises the following steps:

[0057] S21: frame processing is performed on the to-be-processed digital sound signal by using a Hanning window to obtain a windowed signal frame;

[0058] In an embodiment, the windowed signal frame is obtained based on the following formula:

[0059]

[0060] In the formula, X frame (n) represents the windowed signal frame; N represents the number of sampling points included in the Hanning window; and X(n) represents the to-be-processed digital sound signal.

[0061] S22: fast Fourier transform is performed on the windowed signal frame to obtain a complex spectrum corresponding to the windowed signal frame;

[0062] S23: power spectral density corresponding to the windowed signal frame is calculated based on the complex spectrum;

[0063] In an embodiment, the power spectral density corresponding to the windowed signal frame is obtained based on the following formula: P(f)=[Real(X(f)) 2 + Imag(X(f)) 2 ];

[0064] In the formula, P(f) represents the power spectral density corresponding to the windowed signal frame; X(f) represents the complex spectrum corresponding to the windowed signal frame; Real(X(f)) represents the real part of X(f); Imag(X(f)) represents the imaginary part of X(f).

[0065] S24: mapping each frequency point in the power spectral density to a corresponding Bark frequency band;

[0066] S25: calculating the total energy of each frequency point in each Bark frequency band;

[0067] In an embodiment, S25 is implemented based on the following formula:

[0068]

[0069] Δf = f s / N

[0070] In the formula, E b represents the total energy of each frequency point in the bth Bark frequency band; b = 1, 2, …, B; B represents the number of Bark frequency bands; P(f) represents the power spectral density corresponding to the windowed signal frame; respectively represent the lower boundary frequency value and the upper boundary frequency value of the bth Bark frequency band; Δf represents the frequency resolution; f s represents the sampling frequency of the AD sampling; N represents the sampling frequency of the AD sampling.

[0071] In an embodiment, it is assumed that there are three Bark frequency bands;

[0072] The frequency range of the 1st Bark frequency band: 0-A1 Hz; that is,

[0073] The frequency range of the 2nd Bark frequency band: A1-A2 Hz; that is,

[0074] The frequency range of the 3rd Bark frequency band: >A2 Hz; that is,

[0075] It is assumed that the frequencies of the 1st frequency point to the M1th frequency point in P(f) are within the frequency range of the 1st Bark frequency band; then the 1st frequency point to the M1th frequency point are mapped to the 1st Bark frequency band;

[0076] It is assumed that the frequencies of the M2 (i.e., M1+1)th frequency point to the M3th frequency point in P(f) are within the frequency range of the 2nd Bark frequency band; then the M2 (i.e., M1+1)th frequency point to the M3th frequency point are mapped to the 2nd Bark frequency band;

[0077] Assuming that the frequencies of the M4th (i.e. M3+1th) frequency point to the M5th frequency point in P(f) are within the frequency range of the 3rd Bark frequency band; the M4th (i.e. M3+1th) frequency point to the M5th frequency point are mapped to the 3rd Bark frequency band;

[0078] It can be understood that A1, A2, M1, M2, M3, M4 and M5 can be adjusted according to actual application scenarios.

[0079]

[0080] E1 represents the total energy of each frequency point in the 1st Bark frequency band;

[0081] E2 represents the total energy of each frequency point in the 2nd Bark frequency band;

[0082] E3 represents the total energy of each frequency point in the 3rd Bark frequency band;

[0083] P(k) represents the power spectral density value corresponding to the kth frequency point.

[0084] S26: calculating the relative energy difference of adjacent Bark frequency bands based on the total energy of each frequency point in each Bark frequency band;

[0085] In an embodiment, S26 is implemented based on the following formula:

[0086]

[0087] In the formula, E b+1 represents the total energy of each frequency point in the b+1th Bark frequency band; η b+1,b represents the relative energy difference between the b+1th Bark frequency band and the bth Bark frequency band; max(E b+1 ,E b ) represents the larger value of E b+1 and E b .

[0088] S27: if the relative energy difference of adjacent Bark frequency bands is greater than a preset threshold, reducing the boundary frequency value between adjacent Bark frequency bands;

[0089] If the relative energy difference of adjacent Bark frequency bands is less than a preset threshold, increasing the boundary frequency value between adjacent Bark frequency bands;

[0090] In an embodiment, S27 specifically includes the following steps:

[0091] calculating the ratio of the relative energy difference of adjacent Bark frequency bands to the preset threshold;

[0092] If the relative energy difference between adjacent Bark bands is greater than a preset threshold, the boundary frequency value between adjacent Bark bands is reduced by F b+1,b Hertz; wherein, F b+1,b = μ b+1,b * γ b+1,b , μ b+1,b represents a preset coefficient, and γ b+1,b represents a ratio of the relative energy difference between adjacent Bark bands to the preset threshold.

[0093] If the relative energy difference between adjacent Bark bands is less than a preset threshold, the boundary frequency value between adjacent Bark bands is increased by F b+1,b Hertz.

[0094] In an embodiment, it is assumed that three Bark bands are included;

[0095] The frequency range of the first Bark band: 0-A1 Hz; that is,

[0096] The frequency range of the second Bark band: A1-A2 Hz; that is,

[0097] The frequency range of the third Bark band: >A2 Hz; that is,

[0098] If η 2,1 (the relative energy difference between the second Bark band and the first Bark band) is greater than a preset threshold, A1 is reduced by F 2,1 Hertz;

[0099] If η 3,2 (the relative energy difference between the third Bark band and the second Bark band) is less than a preset threshold, A2 is increased by F 3,2 Hertz.

[0100] S28: The reduced or increased boundary frequency value is taken as a band boundary to perform band division on the digital sound signal to be processed, to obtain a plurality of band signals.

[0101] In an embodiment, the plurality of band signals includes three bands;

[0102] The frequency ranges of the three band signals are, in sequence:

[0103] 0, (A1-F 2,1 ) Hz;

[0104] (A1-F 2,1 ) - (A2+F 3,2 ) Hz;

[0105] (A2+F3,2 ) Hz;

[0106] S3: mapping the frequency band signals into a plurality of sound source groups;

[0107] In an embodiment, S3 specifically comprises the following steps:

[0108] mapping the i-th frequency band signal into the i-th, i+1-th and i+2-th sound source groups, respectively; wherein i = 1, 2,..., I; I represents the number of frequency band signals obtained by S2.

[0109] S4: each sound source group generates a directional sound signal pointing to the target area using its sound radiation units, and after being propagated synchronously to the target area, forms an actual mixed sound signal;

[0110] In an embodiment, S4 specifically comprises the following steps:

[0111] performing beamforming processing on the frequency band signals in each sound source group to generate a driving signal containing amplitude and phase information;

[0112] delivering the driving signal to each sound radiation unit in the sound source group to obtain the directional sound signal.

[0113] S5: detecting and eliminating the cancellation sound wave cancellation effect generated by the actual mixed sound signal in the target area.

[0114] In an embodiment, S5 specifically comprises the following steps:

[0115] S51: obtaining the actual mixed sound signal of the target area using a reference microphone;

[0116] S52: calculating the mean square error of the actual mixed sound signal and the expected sound signal;

[0117] S53: minimizing the mean square error to eliminate the cancellation sound wave cancellation effect.

[0118] In an embodiment, S53 specifically comprises the following steps:

[0119] adjusting the amplitude and phase of the driving signal using an adaptive filtering algorithm to minimize the mean square error.

[0120] In a second aspect, the present application also provides an electronic device, such as Figure 3As shown, the electronic device can include a processor 301, a communications interface 302, a memory 303 and a communications bus 304, wherein the processor 301, the communications interface 302 and the memory 303 complete the communication with each other through the communications bus 304. The processor 301 can call the logic instructions in the memory 303 to execute the acoustic processing method for grouping management and elimination of counteracting of directional generation of sound frequency band.

[0121] In addition, the logic instructions in the memory 303 described above can be realized in the form of a software function unit and sold or used as an independent product, and can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or part of the technical solutions can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the embodiments of the method of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0122] The embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple, and the related parts can be referred to the method part.

[0123] The above description of the disclosed embodiments enables a person skilled in the art to implement or use the present application. Various modifications to the embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An acoustic processing method for directional generation, grouping, and cancellation of sound frequency bands, characterized in that: The following steps are involved: S1: Perform AD sampling on the analog sound signal to be processed to obtain the digital sound signal to be processed; S2: Dynamically divide the digital sound signal to be processed into frequency bands to obtain multiple frequency band signals; S3: Mapping the plurality of frequency band signals into a plurality of sound source groups; S4: Each sound source group generates a directional sound signal directed to the target area using its sound radiation unit, and after synchronously propagating to the target area, forms an actual mixed sound signal; S5: Detect and eliminate the acoustic wave cancellation effect generated by the actual mixed sound signal in the target area.

2. The acoustic processing method for directional generation, grouping, and canceling of sound frequency bands according to claim 1, characterized in that: S2 specifically includes the following steps: S21: Using a Hanning window to perform frame processing on the digital sound signal to be processed to obtain a windowed signal frame; S22: Performing Fast Fourier Transform (FFT) on the windowed signal frame to obtain a complex spectrum corresponding to the windowed signal frame; S23: Calculate the power spectral density corresponding to the windowed signal frame based on the complex spectrum; S24: Mapping each frequency point in the power spectrum density to a corresponding Bark frequency band; S25: Calculate the total energy of each frequency point in each Bark frequency band; S26: Calculating the relative energy difference between adjacent Bark frequency bands based on the total energy of each frequency point in each Bark frequency band; S27: If the relative energy difference between the adjacent Bark frequency bands is greater than a preset threshold, lowering the boundary frequency value between the adjacent Bark frequency bands; If the relative energy difference between the adjacent Bark frequency bands is less than the preset threshold, increasing the boundary frequency value between the adjacent Bark frequency bands; S28: Divide the digital sound signal to be processed into frequency bands using the reduced or increased boundary frequency value as a frequency band boundary to obtain the plurality of frequency band signals.

3. The acoustic processing method for directional generation, grouping, and canceling of sound frequency bands according to claim 2, characterized in that: S25 is implemented based on the following formula: Where, E b represents the total energy of each frequency point in the b-th Bark frequency band; b=1, 2, ..., B; B represents the number of Bark frequency bands; P(f) represents the power spectral density corresponding to the windowed signal frame; represents the lower and upper boundary frequency values ​​of the bth Bark frequency band respectively; Δf represents the frequency resolution; f s represents the sampling frequency of the AD sampling; N represents the number of sampling points included in the Hanning window.

4. The acoustic processing method for directional generation, grouping, and canceling of sound frequency bands according to claim 3, characterized in that: S26 is implemented based on the following formula: Where, E b+1 Represents the total energy of each frequency point in the b+1th Bark frequency band; η b+1,b Indicates the relative energy difference between the b+1th Bark frequency band and the bth Bark frequency band; max(E b+1 ,E b ) means taking E b+1 and E b The larger value in .

5. The acoustic processing method for directional generation, grouping, and canceling of sound frequency bands according to claim 4, characterized in that: S27 specifically includes the following steps: Calculating the ratio of the relative energy difference between the adjacent Bark frequency bands to the preset threshold; If the relative energy difference between the adjacent Bark frequency bands is greater than the preset threshold, the boundary frequency value between the adjacent Bark frequency bands is reduced by F b+1,b Hertz; where F b+1,b =μ b+1,b *γ b+1,b , μ b+1,b Represents the preset coefficient, γ b+1,b Represents the ratio of the relative energy difference between the adjacent Bark frequency bands to the preset threshold; If the relative energy difference between the adjacent Bark frequency bands is less than the preset threshold, the boundary frequency value between the adjacent Bark frequency bands is increased by F b+1,b hertz.

6. The acoustic processing method for directional generation, grouping, and canceling of sound frequency bands according to claim 1, characterized in that: S3 specifically includes the following steps: The i-th frequency band signal is mapped to the i-th, i+1-th and i+2-th sound source groups respectively; where i=1, 2, ..., I; I represents the number of frequency band signals obtained by S2.

7. The acoustic processing method for directional generation, grouping, and canceling of sound frequency bands according to claim 1, characterized in that: S4 specifically includes the following steps: Performing beamforming processing on the frequency band signals in each sound source group to generate a driving signal containing amplitude and phase information; The driving signal is respectively transmitted to each sound radiation unit in the sound source group to obtain the directional sound signal.

8. The acoustic processing method for directional generation, grouping, and canceling of sound frequency bands according to claim 7, characterized in that: S5 specifically includes the following steps: S51: Obtaining an actual mixed sound signal of the target area using a reference microphone; S52: Calculating the mean square error between the actual mixed sound signal and the expected sound signal; S53: Minimize the mean square error to eliminate and offset the acoustic wave cancellation effect.

9. The acoustic processing method for directional generation, grouping, and canceling of sound frequency bands according to claim 8, characterized in that: S53 specifically includes the following steps: An adaptive filtering algorithm is used to adjust the amplitude and phase of the driving signal to minimize the mean square error.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the acoustic processing method for directional generation, grouping, and canceling of audio frequency bands according to any one of claims 1 to 9 is implemented.

Images