Multi-product intelligent sound mixing method based on wireless microphone

Abstract

The invention discloses a multi-product intelligent sound mixing method with a wireless microphone as a sound amplification device A, a microphone as a sound amplification device B and a sound amplification device C used for positioning the position of a sound source to realize automatic sound mixing of the three sound amplification devices at the same time, and the method comprises the following specific steps: (1) judging whether the sound amplification device A works or not, and if the sound amplification device A works, starting the sound amplification device C; if yes, the sound amplification equipment B and the sound amplification equipment C do not amplify sound; (2) if the sound reinforcement equipment A does not work, positioning the sound source position based on the sound reinforcement equipment C, and judging whether to start the sound reinforcement equipment B for sound reinforcement; and (3) if the sound reinforcement equipment A does not work and the sound source is also far away from the sound reinforcement equipment B, starting the sound reinforcement equipment C for sound reinforcement. According to the invention, clear audio files can be picked up under the condition of multi-device sound amplification, and clean original sound is provided for subsequent playback.

Description

Technical Field

[0001] This invention relates to the field of classroom and professional audio amplification technology, and in particular to a multi-product intelligent mixing method based on a wireless microphone. Background Technology

[0002] In classrooms, conference rooms, and other environments requiring sound reinforcement, when recording with multiple sound reinforcement devices, ensuring smooth sound transitions between devices and maintaining clarity and stability without sudden changes in volume or muddiness is crucial. Many existing patented technologies focus on the same type of product, such as mixing sound from multiple identical microphones. In this case, the differences between microphones can be easily addressed by applying different weighting coefficients. However, ensuring effective sound reinforcement and recording when multiple microphones such as wireless microphones, array microphones, regular microphones, and overhead microphones are used simultaneously presents significant technical challenges.

[0003] Existing technologies sometimes simply mix audio by measuring volume from different microphones, and others use signal-to-noise ratio (SNR) for mixing. However, none of these methods specifically track the relationship between the person and the recording equipment, resulting in suboptimal mixing performance. A more effective approach requires real-time assessment of the relationship between the person and various recording devices, as well as the combined use of acoustic algorithms such as SNR, volume, sound pressure level, and VAD to achieve a truly ideal mixing effect. Summary of the Invention

[0004] The purpose of this invention is to address the shortcomings of existing technologies by proposing a multi-product intelligent mixing method based on a wireless microphone.

[0005] The objective of this invention is achieved through the following technical solution: a multi-product intelligent mixing method based on a wireless microphone, characterized in that the method uses a wireless microphone as a sound reinforcement device A, a microphone as a sound reinforcement device B, and a sound reinforcement device C for locating the sound source, to simultaneously achieve automatic mixing of the three sound reinforcement devices. The specific steps are as follows: (1) Determine whether the sound reinforcement device A is working. If the sound reinforcement device A is working, then neither the sound reinforcement device B nor the sound reinforcement device C will amplify the sound. (2) If the sound reinforcement device A is not working, then based on the location of the sound source by the sound reinforcement device C, determine whether to turn on the sound reinforcement device B for sound reinforcement. (3) If the sound reinforcement device A is not working and the sound source is far away from the sound reinforcement device B, then the sound reinforcement device C should be used for sound reinforcement.

[0006] Furthermore, the sound reinforcement device C is a hanging microphone or an array microphone.

[0007] Furthermore, in step (1), the sound reinforcement equipment B and the sound reinforcement equipment C can record audio according to the situation on site.

[0008] Furthermore, in step (1), if the sound reinforcement device A has a built-in vibration sensor, the sound reinforcement device A is used to determine whether it is working by the vibration sensor status and the signal-to-noise ratio of the signal picked up by the sound reinforcement device A.

[0009] Furthermore, in step (2), the decision to turn on the sound reinforcement device B for sound reinforcement is based on the signal-to-noise ratio of the sound reinforcement device B. The specific conditions are: if the signal-to-noise ratio of the sound reinforcement device B is higher than the threshold or the signal-to-noise ratio of the sound reinforcement device B is lower than the threshold but the signal-to-noise ratio changes slowly, then the sound reinforcement device B is turned on for sound reinforcement.

[0010] Furthermore, if ambient sound is playing, neither sound reinforcement device B nor sound reinforcement device C will amplify or record sound.

[0011] The beneficial effects of this invention are: 1. This invention provides a multi-product intelligent mixing method based on a wireless microphone, which can ensure clear audio files are picked up in the case of multi-device sound reinforcement, providing clean original sound for subsequent playback.

[0012] 2. A status judgment is introduced, which needs to prioritize the judgment of the status between the person and the sound source. The vibration sensor is used to judge the status of the wireless microphone, and the array microphone is used to locate the position of the sound source from the microphone and whether the person is close to or far from the microphone. The sound source status is added to the priority judgment to prevent the sound from switching arbitrarily and to ensure that the sound only switches after the sound source status has changed.

[0013] 3. When amplifying sound from multiple sources and multiple devices, it is necessary to carefully identify the input sound sources. Simply using mixing is not advisable, especially since array microphones themselves capture a relatively loud sound, which can easily capture the amplified sound, resulting in muddy sound. Therefore, it should be used as a last resort, when all other acquisition devices are not in operation, for amplification and recording alone. Feedback processing can also be added to prevent aliasing of the recorded sound. Attached Figure Description

[0014] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 This is a flowchart of the method of the present invention. Detailed Implementation

[0016] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described below with reference to the accompanying drawings and examples. It should be understood that the specific examples described herein are merely illustrative and not intended to limit the invention.

[0017] like Figure 1 As shown, the present invention provides a multi-product intelligent mixing method with a wireless microphone as the main component. It is an automatic mixing technology that uses a wireless microphone as the main component and three other sound reinforcement devices such as microphones, overhead microphones, and array microphones simultaneously. The wireless microphone can be set as sound reinforcement device A, the microphone as sound reinforcement device B, and the overhead microphone and array microphone are generally selected as one of them, which is sound reinforcement device C. Here, the array microphone is used as an example.

[0018] When multiple devices are present simultaneously, the preferred amplification device needs to be selected first. Generally, when a wireless microphone is on, it is the preferred device. In this case, amplification device A can both amplify sound and record, while amplification devices B and C do not amplify sound, but they will record based on the situation. When the wireless microphone is not in use, the array microphone (amplification device C) is needed to locate the sound source. If the voice is in the microphone area, the microphone is activated for amplification, and amplification device C will record as needed. When the wireless microphone is not in use and the voice is not in the microphone area, the array microphone is used for amplification. In this case, the array microphone (amplification device C) is activated for recording. That is, amplification device C only records when the wireless microphone (amplification device A) and the microphone (amplification device B) are not in use.

[0019] Intelligent mixing strategy using wireless microphone as the main amplifier: The wireless microphone needs a built-in vibration sensor. The microphone's functionality is determined by the vibration sensor's status and the signal-to-noise ratio (SNR) of the microphone's pickup signal. If the SNR is highest and the vibration sensor has a signal, the microphone is confirmed to be working, and only the microphone's audio is recorded. If the audio volume is below a threshold or the SNR is below the threshold, the microphone's vibration sensor needs to be checked. If there is a signal, the microphone continues to be the primary recording source. If there is no vibration sensor signal, the microphone and several other signals are intelligently mixed (refer to patent (CN111696515B): An Audio Mixing Method for Teaching Recording) with automatic gain control to adjust the sound. Under this mixing strategy, the microphone's pickup is prioritized. The microphone's close-range pickup results in a richer, clearer, and more stable overall sound without fluctuations. It also prevents the volume from fluctuating or the sound quality from changing due to the mixing of other acquired signals.

[0020] Intelligent mixing strategy using the microphone as the main amplifier: When the wireless microphone is not working, and both sound reinforcement devices B and C work together, the system first determines whether the user is within the microphone recording area. This is done by using the array microphone to locate the sound source's distance from the microphone and whether the user is near or far from the microphone. If the user is within the microphone recording area and the microphone's signal-to-noise ratio (SNR) is above a set threshold, microphone recording takes priority. If the user is within the microphone area but the SNR drops below the set threshold, the system continuously monitors the SNR trend. If the change is slow, microphone recording continues. Only when the SNR changes rapidly, the user is far from the microphone, and the SNR falls below the threshold of sound reinforcement device C, does intelligent mixing of the two signals begin (mixing method reference patent (CN111696515B): An audio mixing method for teaching recording). Once the microphone SNR is very low and the user is no longer within the microphone area, recording is switched to sound reinforcement device C. This mixing strategy prioritizes microphone pickup and minimizes signal mixing from sound reinforcement device C. In terms of individual sound pickup performance, sound reinforcement device A is the best, followed by sound reinforcement device B. The sound reinforcement device B, being a far-end pickup device, will have the worst performance.

[0021] When the above-mentioned audio is playing from courseware or other audio sources, it is also necessary to perform mixing and switching on the courseware audio. The specific logic is as follows: When the wireless microphone has sound, the courseware audio, microphone audio, and array microphone audio are not amplified or recorded. When the wireless microphone has no sound, but the courseware audio is playing, the microphone audio and array microphone audio are not amplified or recorded. When the courseware is not playing, refer to the mixing method described above.

[0022] Specific implementation process: 1. Wireless microphone priority determination logic condition: High signal-to-noise ratio + vibration sensing signal Or, with a moderate signal-to-noise ratio, vibration still produces a signal. Behavior: A sound reinforcement & A recording Disable device B (microphone) / C (array microphone) for amplification and recording. The presentation slides are not playing. 2. Wireless microphone unavailable → Courseware priority judgment logic condition: Wireless microphone unavailable (low signal-to-noise ratio & no vibration signal) Courseware audio playback Behavior: Play only courseware Non-amplified / recording equipment B / C 3. Courseware not playing → Environmental sound pickup strategy judgment A. The human voice is within the microphone area. Priority: Device B (microphone) High signal-to-noise ratio → Microphone amplification + recording Signal-to-noise ratio decreases: Slow change → Keep microphone recording Rapid changes and below the array microphone threshold → Mixing with C B. The voice is not in the microphone area. Use device C (array microphone) for sound amplification and recording. The above embodiments are used to explain and illustrate the present invention, but not to limit the present invention. Any modifications and changes made to the present invention within the spirit and scope of the claims shall fall within the protection scope of the present invention.

Claims

1. A wireless microphone-based multi-product intelligent mixing method, characterized in that, The method uses wireless microphone as the sound reinforcement equipment A, microphone as the sound reinforcement equipment B, and sound reinforcement equipment C for positioning the sound source position to simultaneously realize automatic mixing of three sound reinforcement equipments, and the specific steps are as follows: (1) judging whether the sound reinforcement equipment A works, if the sound reinforcement equipment A works, the sound reinforcement equipment B and the sound reinforcement equipment C do not sound; (2) if the sound reinforcement equipment A does not work, the sound source position is positioned based on the sound reinforcement equipment C, and whether the sound reinforcement equipment B is started to sound is judged; (3) if the sound reinforcement equipment A does not work, and the sound source is also far away from the sound reinforcement equipment B, the sound reinforcement equipment C is started to sound.

2. The wireless microphone-based multi-product intelligent mixing method according to claim 1, wherein, The sound reinforcement equipment C is a hanging microphone or an array microphone.

3. The wireless microphone-based multi-product intelligent mixing method according to claim 1, wherein, In step (1), the sound reinforcement equipment B and the sound reinforcement equipment C can make recording according to the on-site situation.

4. The wireless microphone-based multi-product intelligent mixing method according to claim 1, wherein, In step (1), if the sound reinforcement equipment A is provided with a vibration sensor, whether the sound reinforcement equipment A works is judged by the vibration sensor state and the signal-to-noise ratio of the sound reinforcement equipment A.

5. The wireless microphone-based multi-product intelligent mixing method according to claim 1, wherein, In step (2), whether the sound reinforcement equipment B is started to sound is judged based on the signal-to-noise ratio of the sound reinforcement equipment B, and the specific conditions are that the signal-to-noise ratio of the sound reinforcement equipment B is higher than a threshold value or the signal-to-noise ratio of the sound reinforcement equipment B is lower than the threshold value, but the signal-to-noise ratio changes slowly, then the sound reinforcement equipment B is started to sound.

6. The wireless microphone-based multi-product intelligent mixing method according to claim 1, wherein, If there is environmental sound playing, the sound reinforcement equipment B and the sound reinforcement equipment C do not sound and record.

Images