A Dynamic Adjustment Method for Anti-Feedback Based on Speaker and Microphone Beam Adjustment

Abstract

This invention discloses a dynamic adjustment method for anti-feedback based on adjustable speaker and microphone beams, comprising the following steps: Step 1, determining the positions of the speaker array module and the microphone array module; Step 2, identifying the listener's position and range using a first beamforming module and adjusting the amplification angle and range of the amplification area; Step 3, identifying the user's position using a second beamforming module and adjusting the angle and width of the pickup area; Step 4, adjusting the amplification area and pickup area multiple times; when the user's position approaches or enters the amplification area, adjusting the amplification area of ​​the speaker array module to move away from the pickup area; thus, the amplification area and pickup area are dynamically adjusted according to the user's position, which is beneficial for picking up and amplifying the user's voice. In particular, when the user's position approaches or enters the amplification area, the amplification area is adjusted to move away from the pickup area to reduce positive feedback in the sound amplification path and reduce the generation of feedback sounds.

Description

Technical Field

[0001] This invention relates to the field of public address technology, and in particular to a dynamic adjustment method for anti-feedback based on adjustable beamwidth of loudspeakers and microphones. Background Technology

[0002] Microphones, as a sound amplification tool, are widely used in daily work fields such as meetings, broadcasts, and speeches. However, during the use of microphones, the microphone's pickup direction needs to be adjusted due to differences in user height and position.

[0003] Currently, the existing technical solution is to use gooseneck microphones to pick up sound and combine them with speakers to amplify the sound. The gooseneck microphones and speakers are connected via wired or wireless means. This solution requires the conference room to be set up in advance. If it is a wired method, the setup is even more complicated. In addition, when users adjust the microphone's pickup direction, they need to adjust the entire gooseneck connecting rod, which is troublesome and inconvenient for users.

[0004] Later, an array microphone pickup system appeared on the market. It uses a beamformer to identify the speaker's directional position and pick up the sound within the corresponding angle position, thereby realizing the array microphone's directional pickup of the speaker's voice and ensuring the quality of the speaker's voice amplification by the loudspeaker. However, the existing microphone directional pickup effect is not good. The pickup angle of the microphone after identifying the position is fixed. The pickup angle is affected by the speaker's position change, making it difficult for the microphone to pick up the speaker's voice after the speaker leaves the pickup angle position. As a result, some listeners cannot hear the speaker's voice, which is not conducive to the amplification of the speaker's voice. Its usability is poor and its application range is small.

[0005] Therefore, a new technical solution needs to be researched to address the above problems. Summary of the Invention

[0006] In view of this, the present invention addresses the deficiencies of the existing technology, and its main objective is to provide a dynamic adjustment method for anti-feedback based on adjustable speaker and microphone beams. Through the design of each step, the amplification area and the pickup area are dynamically adjusted according to the user's position, which is beneficial for the pickup and amplification of the user's voice. In particular, when the user moves closer to the amplification area, the amplification area is adjusted to move away from the pickup area to reduce the positive feedback of the sound amplification path and reduce the generation of feedback sound. It has good usability and a wide range of applications.

[0007] To achieve the above object, the present invention adopts the following technical solutions:

[0008] A dynamic adjustment method for anti-feedback based on adjustable speaker and microphone beamwidth includes the following steps:

[0009] Step 1: Activate the speaker array module, microphone array module, and control module. The speaker array module plays the test audio, and the microphone array module picks up the test audio and feeds it back to the control module to determine the positions of the speaker array module and microphone array module.

[0010] Step two: The speaker array module identifies the location and range of the listeners through the first beamforming module, and adjusts the amplification angle and range of the amplification area to concentrate the amplification area on the listeners' range;

[0011] Step 3: The microphone array module identifies the user's position through the second beamforming module and adjusts the angle and width of the pickup area to concentrate the pickup area on the user's position.

[0012] Step 4: Set the first beamforming module and the second beamforming module to run repeatedly at regular intervals to identify and adjust the range and angle of the amplification area multiple times, and to identify the user's position multiple times and adjust the angle and width of the pickup area according to the user's position.

[0013] When a user approaches or enters the amplification area, the second beamforming module will identify the user's position and feed it back to the control module so that the amplification area of ​​the speaker array module is adjusted to be away from the pickup area.

[0014] As a preferred embodiment, a reminder device is also provided to remind the user that they are outside the sound pickup area. The reminder device is connected to the control module. In step four, when the user is located at the center of the sound amplification area or beyond the center and away from the microphone array module, the reminder device will issue a reminder signal to remind the user that they cannot pick up sound at that location.

[0015] As a preferred embodiment, an environmental microphone is also provided for real-time monitoring of the amplification distribution of the speaker array module. The environmental microphone is connected to the control module. In step two, the environmental microphone collects the picked-up sound and feeds it back to the control module. The control module analyzes the path of the reflected sound waves based on the feedback from the environmental microphone, identifies the sound that may be transmitted to the microphone array module, and controls and adjusts the sound emission direction of the amplification area of ​​the speaker array module.

[0016] As a preferred embodiment, the control module is equipped with an anti-feedback module. When the user's voice enters the microphone array module through the pickup area, it is fed back to the control module. The anti-feedback module detects the feedback sound to determine whether there is a positive feedback signal causing the feedback problem.

[0017] When the anti-feedback module determines that the sound does not cause a feedback problem, the sound passes through the speaker array module and is amplified to the amplification area; when the anti-feedback module determines that the sound does cause a feedback problem, the anti-feedback module will suppress the feedback signal in the sound before passing through the speaker array module and amplifying to the amplification area.

[0018] Compared with the prior art, the present invention has obvious advantages and beneficial effects. Specifically, as can be seen from the above technical solution, it mainly achieves dynamic adjustment of the amplification area and the pickup area according to the user's position change through the design of each step. This is beneficial to the pickup of the user's voice and the use of amplification, and ensures the listening experience. In particular, when the user's position is close to or enters the amplification area, the amplification area is adjusted to be far away from the pickup area to reduce the positive feedback of the sound amplification path, reduce the generation of howling sound, and prevent the amplified sound from being picked up, thus ensuring the pickup of the user's voice. It has good usability and a wide range of applications.

[0019] Furthermore, the reminder device is set up so that when the user's position is outside the range that the sound pickup area can pick up, the reminder device will issue a reminder signal to remind the user that sound cannot be picked up at that position, so that the user can move back and be re-identified by the second beamforming module and the sound pickup area will focus on the user's position, ensuring the sound pickup effect of the user, improving the user experience and sound pickup and amplification quality;

[0020] Furthermore, the environmental microphone is set up to monitor the distribution of the sound field output by the speaker array module in real time, thereby preventing the sound from the speaker array module from being picked up by the microphone array module, ensuring the sound pickup effect of the user and the amplification effect of the audience area.

[0021] Furthermore, the anti-feedback module analyzes the sound signal picked up by the microphone array module, suppresses the feedback signal in the sound signal, and then passes it through the speaker array module to amplify the sound to the amplification area, further ensuring the sound pickup effect of the user and the amplification effect of the audience area.

[0022] To more clearly illustrate the structural features, technical means, and specific objectives and functions achieved by the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. Attached Figure Description

[0023] Figure 1 This is a first schematic diagram of an embodiment of the present invention;

[0024] Figure 2 This is a second schematic diagram of an embodiment of the present invention;

[0025] Figure 3 This is a flowchart of an embodiment of the present invention;

[0026] Figure 4 This is a flowchart of the speaker playback signal processing according to an embodiment of the present invention.

[0027] Figure 5 This is a flowchart of microphone array signal processing according to an embodiment of the present invention. Detailed Implementation

[0028] Please refer to Figures 1 to 5 As shown, it illustrates the specific structure of an embodiment of the present invention.

[0029] A dynamic adjustment method for anti-feedback based on adjustable speaker and microphone beamwidth includes the following steps:

[0030] Step 1: Activate the speaker array module, microphone array module, and control module. The speaker array module plays the test audio, and the microphone array module picks up the test audio and feeds it back to the control module to determine the positions of the speaker array module and microphone array module.

[0031] Step two: The speaker array module identifies the location and range of the listeners through the first beamforming module, and adjusts the amplification angle and range of the amplification area to concentrate the amplification area on the listeners' range;

[0032] Step 3: The microphone array module identifies the user's position through the second beamforming module and adjusts the angle and width of the pickup area to concentrate the pickup area on the user's position.

[0033] Step 4: Set the first beamforming module and the second beamforming module to run repeatedly at regular intervals to identify and adjust the range and angle of the amplification area multiple times, and to identify the user's position multiple times and adjust the angle and width of the pickup area according to the user's position.

[0034] When a user approaches or enters the amplification area, the second beamforming module will identify the user's position and feed it back to the control module so that the amplification area of ​​the speaker array module is adjusted to be away from the pickup area.

[0035] Specifically, the control module is equipped with an AI algorithm. The first beamforming module identifies the listener's position and range information and feeds it back to the control module. The AI ​​algorithm calculates the optimal amplification angle and range of the amplification area and controls the speaker array module to adjust accordingly. Simultaneously, the second beamforming module identifies the user's position information and feeds it back to the control module. The AI ​​algorithm calculates the optimal angle and width of the pickup area and controls the microphone array module to adjust and concentrate the pickup area on the user's position. Through the design of each step, the directional microphone array forms a directional pickup beam, suppressing sound from non-target directions. This allows the amplification area and pickup area to dynamically adjust according to the user's position, which is beneficial for picking up and amplifying the user's voice and ensuring the listener's experience. In particular, when the user's position is close to or enters the amplification area, the amplification area adjusts to move away from the pickup area to reduce positive feedback in the sound amplification path, reduce howling sound, and prevent the amplified sound from being picked up, thus ensuring the user's voice is picked up. At the same time, the AI ​​algorithm filters background noise and sound from the speaker direction, resulting in good usability and wide applicability.

[0036] like Figure 4 As shown, it is the AI ​​algorithm process of the speaker array module. The input mono audio STFT is multiplied by the beam coefficient w to obtain the multi-channel output STFT, and then the ISTFT outputs the speaker playback signal. The beam coefficient w can be obtained in advance according to the array design or generated in real time by the AI ​​model.

[0037] like Figure 5 As shown, it is the AI ​​algorithm process of the microphone array module. The input multi-channel mic audio STFT is multiplied by the beam ratio w and then summed to obtain the single-channel output STFT. Then, the ISTFT output is used as the mic pickup signal. The beam ratio w can be obtained in advance according to the array design or generated in real time by the AI ​​model.

[0038] Furthermore, in step four, a reminder device is also provided to remind the user that they are outside the sound pickup area. This reminder device is connected to the control module. When the user's position is in the center of the sound amplification area or beyond the center and away from the microphone array module, the reminder device will issue a reminder signal to remind the user that they cannot pick up sound at that position. Thus, the reminder device ensures that when the user's position is outside the range that the sound pickup area can pick up, it will issue a reminder signal to remind the user that they cannot pick up sound at that position. This allows the user to move back and be re-identified by the second beamforming module, and the sound pickup area will be focused on the user's position, ensuring the sound pickup effect and improving the user experience and sound amplification quality.

[0039] In this embodiment, in step two, an environmental microphone is also provided for real-time monitoring of the sound amplification distribution of the speaker array module. The environmental microphone is connected to the control module. The environmental microphone collects the sound it picks up and feeds it back to the control module. The control module analyzes the path of the reflected sound waves based on the feedback from the environmental microphone, identifies the sound that may be transmitted to the microphone array module, and controls and adjusts the sound output direction of the amplification area of ​​the speaker array module. In this way, the distribution of the output sound field of the speaker array module is monitored in real time, thereby preventing the sound of the speaker array module from being picked up by the microphone array module, ensuring the sound pickup effect of the user's voice and the amplification effect of the audience area.

[0040] Furthermore, the control module is equipped with an anti-feedback module. When the user's voice enters the microphone array module through the pickup area and is fed back to the control module, the anti-feedback module detects the feedback sound to determine whether the feedback sound has a positive feedback signal that causes a feedback problem.

[0041] When the anti-feedback module determines that the sound does not cause a feedback problem, the sound passes through the speaker array module and is amplified to the amplification area. When the anti-feedback module determines that the sound does cause a feedback problem, it will suppress the feedback signal in the sound before passing through the speaker array module and amplifying to the amplification area. In this way, the anti-feedback module is set up to analyze the sound signal picked up by the microphone array module, suppress the feedback signal in the sound signal before passing through the speaker array module and amplifying to the amplification area, further ensuring the sound pickup effect of the user's voice and the sound amplification effect of the audience area. At the same time, the AI ​​algorithm can also reduce the sound of feedback at the software algorithm level.

[0042] In summary, the key design feature of this invention lies in its ability to dynamically adjust the amplification area and the pickup area based on the user's position through the design of each step. This facilitates the pickup and amplification of the user's voice, ensuring a superior listening experience. In particular, when the user approaches or enters the amplification area, the amplification area is adjusted to move away from the pickup area to reduce positive feedback in the amplification path, minimize howling sounds, and prevent the amplified sound from being picked up, thus ensuring excellent user voice pickup and providing a wide range of applications.

[0043] Furthermore, the reminder device is set up so that when the user's position is outside the range that the sound pickup area can pick up, the reminder device will issue a reminder signal to remind the user that sound cannot be picked up at that position, so that the user can move back and be re-identified by the second beamforming module and the sound pickup area will focus on the user's position, ensuring the sound pickup effect of the user, improving the user experience and sound pickup and amplification quality;

[0044] Furthermore, the environmental microphone is set up to monitor the distribution of the sound field output by the speaker array module in real time, thereby preventing the sound from the speaker array module from being picked up by the microphone array module, ensuring the sound pickup effect of the user and the amplification effect of the audience area.

[0045] Furthermore, the anti-feedback module analyzes the sound signal picked up by the microphone array module, suppresses the feedback signal in the sound signal, and then passes it through the speaker array module to amplify the sound to the amplification area, further ensuring the sound pickup effect of the user and the amplification effect of the audience area.

[0046] The above description is merely a preferred embodiment of the present invention and does not constitute any limitation on the technical scope of the present invention. Therefore, any minor modifications, equivalent changes, and alterations made to the above embodiments based on the technical essence of the present invention shall still fall within the scope of the technical solution of the present invention.

Claims

1. A dynamic adjustment method for anti-feedback based on adjustable speaker and microphone beamwidth, characterized in that: It includes the following steps: Step 1: Activate the speaker array module, microphone array module, and control module. The speaker array module plays the test audio, and the microphone array module picks up the test audio and feeds it back to the control module to determine the positions of the speaker array module and microphone array module. Step two: The speaker array module identifies the location and range of the listeners through the first beamforming module, and adjusts the amplification angle and range of the amplification area to concentrate the amplification area on the listeners' range; Step 3: The microphone array module identifies the user's position through the second beamforming module and adjusts the angle and width of the pickup area to concentrate the pickup area on the user's position. Step 4: Set the first beamforming module and the second beamforming module to run repeatedly at regular intervals to identify and adjust the range and angle of the amplification area multiple times, and to identify the user's position multiple times and adjust the angle and width of the pickup area according to the user's position. It is also equipped with a reminder device to alert users when they are outside the sound pickup area and an environmental microphone to monitor the sound distribution of the speaker array module in real time. Both the reminder device and the environmental microphone are connected to the control module. When a user approaches or enters the amplification area, the second beamforming module will identify the user's position and feed it back to the control module so that the amplification area of ​​the speaker array module is adjusted to be away from the pickup area. In step two, the ambient microphone collects the sound it picks up and feeds it back to the control module. The control module analyzes the path of the reflected sound waves based on the feedback from the ambient microphone, identifies the sound that may be transmitted to the microphone array module, and controls and adjusts the sound emission direction of the amplification area of ​​the speaker array module. In step four, when the user's position is in the center of the amplification area or beyond the center and away from the microphone array module, the reminder device will issue a reminder signal to remind the user that they cannot pick up sound at that position.

2. The anti-feedback dynamic adjustment method based on adjustable speaker and microphone beams as described in claim 1, characterized in that: The control module is equipped with an anti-feedback module. When the user's voice enters the microphone array module through the pickup area, it is fed back to the control module. The anti-feedback module detects the feedback sound to determine whether there is a positive feedback signal that causes a feedback problem. When the anti-feedback module determines that the sound does not cause a feedback problem, the sound passes through the speaker array module and is amplified to the external sound amplification area; When the anti-feedback module determines that the sound has a feedback problem, it will suppress the feedback signal in the sound before passing it through the speaker array module and amplifying it to the external sound amplification area.

Images