Anti-howling dynamic adjustment method based on adjustable wave beams of loudspeaker and microphone

Abstract

The invention discloses an anti-howling dynamic adjustment method based on adjustable beams of a loudspeaker and a microphone. The method comprises the following steps: step 1, determining the positions of a loudspeaker array module and a pickup microphone array module; 2, identifying the position and the range of the audience through a first beam forming module, and adjusting the sound amplification angle and the sound amplification range of a sound amplification area; 3, identifying the position of the user through a second beam forming module, and adjusting the angle and width of a pickup area; step 4, adjusting the sound amplification area and the pickup area for multiple times; when the position of the user is close to or enters the sound amplification area, the sound amplification area of the loudspeaker array module is adjusted to be far away from the pickup area; therefore, the sound amplification area and the sound pickup area are dynamically adjusted according to the position change of the user, sound pickup and sound amplification of the user are facilitated, and particularly, when the user gets close to the sound amplification area and enters the sound amplification area, the sound amplification area is adjusted to be far away from the sound pickup area, so that positive feedback of a sound amplification path is reduced, and generation of howling sound is reduced.

Description

Technical Field

[0001] The invention relates to the technology of sound amplification field, and in particular to an anti-howling dynamic adjustment method based on adjustable speaker and microphone beams. Background Art

[0002] Microphone equipment, as a sound amplification tool, is widely used in daily work areas such as conferences, broadcasting, and speeches. During the use of the microphone, the sound pickup direction of the microphone needs to be adjusted due to the different heights and positions of the users.

[0003] At present, the existing technical solution is to use a gooseneck microphone to pick up sound and cooperate with a loudspeaker to amplify the sound. The gooseneck microphone and the loudspeaker are connected by wired or wireless means. This solution requires the conference room to be constructed and arranged in advance. If it is a wired method, the arrangement is more cumbersome. In addition, when the user adjusts the pickup direction of the microphone, the connecting rod of the entire gooseneck needs to be uniformly adjusted, which is troublesome to operate and inconvenient for users.

[0004] Later, an array microphone pickup system appeared on the market. It uses a beamformer to identify the direction of the speaker and pick up the sound within the corresponding angle position, thereby achieving directional pickup of the speaker's voice by the array microphone, ensuring the quality of the speaker's voice amplification. However, the existing microphone has poor directional pickup effect. The pickup angle of the microphone after identifying the position is fixed. The pickup angle is affected by the change of the speaker's position, making it difficult for the microphone to pick up the speaker's voice after leaving the pickup angle position, resulting in some listeners unable to hear the speaker's voice, which is not conducive to the amplification of the speaker's voice, poor usability, and a small scope of application.

[0005] Therefore, it is necessary to study a new technical solution to solve the above problems. Summary of the invention

[0006] In view of this, the present invention aims to address the deficiencies in the prior art, and its main purpose is to provide an anti-howling dynamic adjustment method based on adjustable speaker and microphone beams. Through the design of each step, the sound amplification area and the sound pickup area are dynamically adjusted according to the user's position change, which is beneficial to the pickup and amplification of the user's voice. In particular, when the user's position is close to the sound amplification area, the sound amplification area is adjusted to be away from the sound pickup area to reduce the positive feedback of the sound amplification path and reduce the generation of howling sounds. It has good usability and a wide range of applications.

[0007] To achieve the above purpose, the present invention adopts the following technical solutions: A method for dynamically adjusting howling prevention based on adjustable speaker and microphone beams includes the following steps: Step 1: Start the speaker array module, the pickup microphone array module and the control module. The speaker array module plays the test audio. The pickup microphone array module picks up the test audio and feeds it back to the control module to determine the positions of the speaker array module and the pickup microphone array module. Step 2: The speaker array module identifies the position and range of the audience through the first beamforming module, and adjusts the sound amplification angle and the sound amplification range of the sound amplification area so that the sound amplification area is concentrated on the audience range; Step 3: The sound pickup microphone array module identifies the user's position through the second beam forming module, and adjusts the angle and width of the sound pickup area so that the sound pickup area focuses on the user's position; Step 4, setting the first beamforming module and the second beamforming module to repeatedly run every certain period of time, so as to identify and adjust the range and the sound amplification angle of the sound amplification area multiple times, identify the user position multiple times and adjust the angle and width of the sound pickup area according to the user position; When the user position approaches or enters the sound amplification area, the second beam forming module will identify the user position and feed it back to the control module, so that the sound amplification area of ​​the speaker array module is adjusted to be away from the sound pickup area.

[0008] As a preferred solution, a reminder device is provided to remind the user that the position is beyond the sound pickup area. The reminder device is connected to the control module. In step four, when the user position is located at the center of the sound amplification area or exceeds the center position and is away from one side of the sound pickup microphone array module, the reminder device will send a reminder signal to remind the user that sound pickup is not allowed at this position.

[0009] As a preferred solution, an environmental microphone is also provided for real-time monitoring of the sound distribution of the speaker array module. The environmental microphone is connected to the control module. In step two, the environmental microphone collects the picked up sound and feeds it back to the control module. The control module analyzes the path of the reflected sound wave according to the feedback of the environmental microphone, identifies the sound that may be transmitted to the sound pickup microphone array module, and controls and adjusts the sound direction of the sound amplification area of ​​the speaker array module.

[0010] As a preferred solution, the control module is provided with an anti-howling module. When the user's voice enters the pickup microphone array module through the pickup area and is fed back to the control module, the anti-howling module detects the feedback sound to determine whether the feedback sound has a positive feedback signal that causes the howling problem. When the anti-howling module determines that the sound does not have the problem that causes howling, the sound passes through the speaker array module and is released to the sound amplification area; when the anti-howling module determines that the sound has the problem that causes howling, the anti-howling module will suppress the howling signal in the sound and then pass through the speaker array module and release it to the sound amplification area.

[0011] Compared with the prior art, the present invention has obvious advantages and beneficial effects. Specifically, it can be seen from the above technical scheme that the present invention mainly realizes dynamic adjustment of the sound amplification area and the sound pickup area according to the position change of the user through the design of each step, which is beneficial to the pickup and amplification of the user's voice and ensures the experience effect of the audience. In particular, when the user's position is close to or enters the sound amplification area, the sound amplification area is adjusted to be away from the sound pickup area to reduce the positive feedback of the sound amplification channel, reduce the generation of howling sounds, avoid the sound after amplification from being picked up, ensure the pickup of the user's voice, and have good usability and a wide range of applications. And, the setting of the reminder device, when the user's position is beyond the range that can be picked up by the sound pickup area, the reminder device will send a reminder signal to remind the user that sound cannot be picked up at this position, so that the user can go back and be re-recognized by the second beamforming module and the sound pickup area can focus on the user's position, ensuring the pickup effect of the user's voice, improving the user's experience effect and the quality of sound pickup and amplification; Furthermore, the setting of the environmental microphone is to monitor the distribution of the sound field output by the speaker array module in real time, thereby preventing the sound of the speaker array module from being picked up by the pickup microphone array module, ensuring the pickup effect of the user's voice and the sound amplification effect in the audience area; In addition, the anti-howling module is set up to analyze the sound signal picked up by the microphone array module, and suppress the howling signal in the sound signal before passing through the speaker array module and playing it out to the sound amplification area, further ensuring the user's voice pickup effect and the sound amplification effect in the audience area.

[0012] In order to more clearly illustrate the structural features, technical means and specific purposes and functions achieved by the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a first schematic diagram of an embodiment of the present invention; Figure 2 is a second schematic diagram of an embodiment of the present invention; Figure 3 is a flow chart of an embodiment of the present invention; Figure 4 It is a flow chart of speaker playback signal processing according to an embodiment of the present invention.

[0014] Figure 5 It is a flow chart of microphone array signal processing according to an embodiment of the present invention. DETAILED DESCRIPTION

[0015] Please refer to Figures 1 to 5 As shown, it shows the specific structure of an embodiment of the present invention.

[0016] A method for dynamically adjusting howling prevention based on adjustable speaker and microphone beams includes the following steps: Step 1: Start the speaker array module, the pickup microphone array module and the control module. The speaker array module plays the test audio. The pickup microphone array module picks up the test audio and feeds it back to the control module to determine the positions of the speaker array module and the pickup microphone array module. Step 2: The speaker array module identifies the position and range of the audience through the first beamforming module, and adjusts the sound amplification angle and the sound amplification range of the sound amplification area so that the sound amplification area is concentrated on the audience range; Step 3: The sound pickup microphone array module identifies the user's position through the second beam forming module, and adjusts the angle and width of the sound pickup area so that the sound pickup area focuses on the user's position; Step 4, setting the first beamforming module and the second beamforming module to repeatedly run every certain period of time, so as to identify and adjust the range and the sound amplification angle of the sound amplification area multiple times, identify the user position multiple times and adjust the angle and width of the sound pickup area according to the user position; When the user position approaches or enters the sound amplification area, the second beam forming module will identify the user position and feed it back to the control module, so that the sound amplification area of ​​the speaker array module is adjusted to be away from the sound pickup area; Specifically, the control module is provided with an AI algorithm, the first beamforming module identifies the information of the listener's position and range and feeds it back to the control module, uses the AI ​​algorithm to calculate the optimal sound amplification angle and sound amplification range of the sound amplification area and controls the speaker array module to adjust; at the same time, the second beamforming module identifies the information of the user's position and feeds it back to the control module, uses the AI ​​algorithm to calculate the optimal angle and width of the pickup area, and controls the pickup microphone array module to adjust and make the pickup area concentrated on the user's position; in this way, through the design of each step, the directional microphone array forms a directional pickup beam to suppress the sound in the non-target direction, so as to realize the dynamic adjustment of the sound amplification area and the sound pickup area according to the user's position change, which is conducive to the pickup and amplification of the user's voice, and ensures the experience effect of the audience, especially when the user's position is close to or enters the sound amplification area, the sound amplification area is adjusted away from the sound pickup area to reduce the positive feedback of the sound amplification path, reduce the generation of howling sound, avoid the sound after amplification from being picked up, and ensure the pickup of the user's voice. At the same time, the AI ​​algorithm is used to filter the background noise and the sound in the direction of the speaker, which has good usability and a wide range of applications.

[0017] like Figure 4As shown in the figure, it is the AI ​​algorithm process of the speaker array module. The mono audio STFT is input, multiplied by the beam coefficient w to obtain the multi-channel output STFT, and then the STFT outputs the speaker playback signal. The source of the beam coefficient w can be designed in advance according to the formation, or it can be generated in real time by the AI ​​model.

[0018] like Figure 5 As shown in the figure, it is the AI ​​algorithm process of the pickup microphone array module. The multi-channel mic audio STFT is input, multiplied by the beam coefficient w and summed to obtain a single-channel output STFT, and then the I SFT output is used as the mic pickup signal; the source of the beam coefficient w can be designed in advance according to the formation, or it can be generated in real time by the AI ​​model.

[0019] Furthermore, in step four, a reminder device is provided to remind the user that the position is beyond the sound pickup area. The reminder device is connected to the control module. When the user position is located at the center of the sound amplification area or exceeds the center and is away from one side of the sound pickup microphone array module, the reminder device will send a reminder signal to remind the user that sound pickup cannot be performed at this position. In this way, the reminder device is set up so that when the user position is beyond the range that the sound pickup area can pick up, the reminder device will send a reminder signal to remind the user that sound pickup cannot be performed at this position, so that the user can walk back and be re-recognized by the second beamforming module and the sound pickup area can be concentrated on the user position, thereby ensuring the pickup effect of the user's voice and improving the user's experience and the quality of sound pickup and amplification.

[0020] In this embodiment, in step two, an environmental microphone is also provided for real-time monitoring of the sound distribution of the speaker array module. The environmental microphone is connected to the control module. The environmental microphone collects the picked up sound and feeds it back to the control module. The control module analyzes the path of the reflected sound wave according to the feedback of the environmental microphone, identifies the sound that may be transmitted to the sound pickup microphone array module, and controls and adjusts the sound direction of the sound amplification area of ​​the speaker array module. In this way, the distribution of the sound field output by the speaker array module is monitored in real time, thereby avoiding the sound of the speaker array module being picked up by the sound pickup microphone array module, thereby ensuring the pickup effect of the user's voice and the sound amplification effect of the audience area.

[0021] Furthermore, the control module is provided with an anti-howling module. When the user's voice enters the pickup microphone array module through the pickup area and is fed back to the control module, the anti-howling module detects the feedback sound to determine whether the feedback sound has a positive feedback signal that causes the howling problem. When the anti-howling module determines that the sound does not have the problem that causes howling, the sound passes through the speaker array module and is released to the sound amplification area; when the anti-howling module determines that the sound has the problem that causes howling, the anti-howling module suppresses the howling signal in the sound and then releases it to the sound amplification area through the speaker array module; in this way, the anti-howling module is set to analyze the sound signal picked up by the microphone array module, and suppress the howling signal in the sound signal and then release it to the sound amplification area through the speaker array module, which further ensures the user's voice pickup effect and the sound amplification effect of the audience area. At the same time, the AI ​​algorithm can also be used to reduce the sound of howling from the software algorithm level.

[0022] In summary, the design focus of the present invention is that it mainly realizes dynamic adjustment of the sound amplification area and the sound pickup area according to the change of the user's position through the design of each step, which is beneficial to the pickup of the user's voice and the use of sound amplification, and ensures the experience effect of the audience. In particular, when the user's position is close to or enters the sound amplification area, the sound amplification area is adjusted to be away from the sound pickup area to reduce the positive feedback of the sound amplification path, reduce the generation of howling sounds, and avoid the sound after the sound amplification from being picked up, thereby ensuring the pickup of the user's voice, having good usability and a wide range of applications; And, the setting of the reminder device, when the user's position is beyond the range that can be picked up by the sound pickup area, the reminder device will send a reminder signal to remind the user that sound cannot be picked up at this position, so that the user can go back and be re-recognized by the second beamforming module and the sound pickup area can focus on the user's position, ensuring the pickup effect of the user's voice, improving the user's experience effect and the quality of sound pickup and amplification; Furthermore, the setting of the environmental microphone is to monitor the distribution of the sound field output by the speaker array module in real time, thereby preventing the sound of the speaker array module from being picked up by the pickup microphone array module, ensuring the pickup effect of the user's voice and the sound amplification effect in the audience area; In addition, the anti-howling module is set up to analyze the sound signal picked up by the microphone array module, and suppress the howling signal in the sound signal before passing through the speaker array module and playing it out to the sound amplification area, further ensuring the user's voice pickup effect and the sound amplification effect in the audience area.

[0023] The above description is only a preferred embodiment of the present invention and does not limit the technical scope of the present invention. Therefore, any slight modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention are still within the scope of the technical solution of the present invention.

Claims

1. A dynamic adjustment method for anti-howling based on adjustable speaker and microphone beams, characterized in that: The following steps are included: Step 1: Start the speaker array module, the pickup microphone array module and the control module. The speaker array module plays the test audio. The pickup microphone array module picks up the test audio and feeds it back to the control module to determine the positions of the speaker array module and the pickup microphone array module. Step 2: The speaker array module identifies the position and range of the audience through the first beamforming module, and adjusts the sound amplification angle and the sound amplification range of the sound amplification area so that the sound amplification area is concentrated on the audience range; Step 3: The sound pickup microphone array module identifies the user's position through the second beam forming module, and adjusts the angle and width of the sound pickup area so that the sound pickup area focuses on the user's position; Step 4, setting the first beamforming module and the second beamforming module to repeatedly run every certain period of time, so as to identify and adjust the range and the sound amplification angle of the sound amplification area multiple times, identify the user position multiple times and adjust the angle and width of the sound pickup area according to the user position; When the user position approaches or enters the sound amplification area, the second beam forming module will identify the user position and feed it back to the control module, so that the sound amplification area of ​​the speaker array module is adjusted to be away from the sound pickup area.

2. According to claim 1, a method for dynamic adjustment of anti-howling based on adjustable speaker and microphone beams, characterized in that: A reminder device is also provided to remind the user that the position is beyond the sound pickup area. The reminder device is connected to the control module. In step four, when the user position is located at the center of the sound amplification area or exceeds the center position and is away from one side of the sound pickup microphone array module, the reminder device will send a reminder signal to remind the user that sound pickup cannot be performed at this position.

3. The anti-howling dynamic adjustment method based on adjustable speaker and microphone beams according to claim 1, characterized in that: An environmental microphone is also provided for real-time monitoring of the sound distribution of the speaker array module. The environmental microphone is connected to the control module. In step 2, the environmental microphone collects the picked-up sound and feeds it back to the control module. The control module analyzes the path of the reflected sound wave according to the feedback of the environmental microphone, identifies the sound that may be transmitted to the sound pickup microphone array module, and controls and adjusts the sound direction of the sound amplification area of ​​the speaker array module.

4. The anti-howling dynamic adjustment method based on adjustable speaker and microphone beams according to claim 1, characterized in that: The control module is provided with an anti-howling module. When the user's voice enters the pickup microphone array module through the pickup area and is fed back to the control module, the anti-howling module detects the feedback sound to determine whether the feedback sound has a positive feedback signal that causes the howling problem. When the anti-howling module determines that the sound does not cause howling, the sound passes through the speaker array module and is emitted to the sound amplification area; When the anti-howling module determines that the sound has a problem causing howling, the anti-howling module will suppress the howling signal in the sound and then release it to the sound amplification area through the speaker array module.

Images