Method and device for multi-source audio mixing

Abstract

The invention discloses a method and a device for audio mixing of multiple sound sources. The method comprises the following steps: receiving sound sources from a plurality of sound source devices, and adjusting the audio volume of a plurality of audio tracks; reading sound effect configuration information for the plurality of audio tracks, and adjusting sound effects of the plurality of audio tracks according to the sound effect configuration information; and calculating a matching degree between the plurality of audio tracks and the audio scene, and carrying out sound mixing on the plurality of audio tracks according to the matching degree to generate sound mixing data. The multi-sound-source audio mixing method supports personalized multi-sound-source audio mixing volume and sound effect adjustment, can realize the multi-sound-source audio mixing method based on scene recognition, and realizes targeted audio mixing configuration for different types of audios. In this way, the individuation degree of multi-sound-source sound mixing is effectively improved, and the sound mixing complexity is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of audio processing, and in particular to a method and device for multi-source audio mixing. Background Art

[0002] With the rapid development of technologies such as artificial intelligence and machine learning, multi-source mixing has broad technical prospects in the fields of audio program production, live broadcast and conferencing, smart home, VR / AR / XR spatial audio, etc. However, multi-source mixing still faces many technical challenges: first, the scale and complexity of algorithms and models for separation and mixing of multiple audio sources are increasing; second, due to the diversity of audio content, different audio content (music, voice, sound effects, etc.) has different requirements for algorithms. Summary of the invention

[0003] The present invention provides a method and device for multi-source audio mixing, which can solve the problem that multi-source audio mixing is complex and difficult to personalize. Improving these problems will increase the personalization of multi-source audio mixing and reduce the complexity of mixing.

[0004] In one aspect of the present invention, a method for multi-source audio mixing is provided. The method comprises: receiving audio sources from multiple audio source devices, adjusting the audio volume of multiple audio tracks; reading sound effect configuration information for the multiple audio tracks, adjusting the sound effects of the multiple audio tracks according to the sound effect configuration information; and calculating the matching degree between the multiple audio tracks and the audio scene, mixing the multiple audio tracks according to the matching degree to generate mixing data.

[0005] In another aspect of the present invention, a device for multi-source audio mixing is provided. The device comprises: a mixing volume module configured to receive audio sources from multiple audio source devices and adjust the audio volume of multiple audio tracks; a mixing sound effect module configured to read sound effect configuration information for the multiple audio tracks and adjust the sound effects of the multiple audio tracks according to the sound effect configuration information; a mixing module configured to calculate the matching degree between the multiple audio tracks and the audio scene, and mix the multiple audio tracks according to the matching degree to generate mixing data; and a mixing output module configured to transmit the mixing data to a playback device.

[0006] According to the present invention, after receiving the audio sources from multiple audio source devices, the audio volume of multiple audio tracks is adjusted, the sound effect configuration information for multiple audio tracks is read, and the sound effects of the audio tracks are adjusted according to the sound effect configuration information, so as to support personalized multi-source mixing volume and sound effect adjustment. And by calculating the matching degree of multiple audio tracks and audio scenes, the multiple audio tracks are mixed according to the matching degree to generate mixing data, so as to realize the audio mixing method of multiple audio sources based on scene recognition, and realize targeted mixing configuration for different types of audio. In this way, the personalization degree of multi-source mixing is effectively improved and the mixing complexity is reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 is a flow chart of a method for multi-source audio mixing according to an embodiment of the present invention; Figure 2 A flow chart of a method for adjusting the mixing volume of multiple audio sources according to an embodiment of the present invention; Figure 3 A flowchart of a method for adjusting mixed sound effects of multiple sound sources according to an embodiment of the present invention; Figure 4 A flowchart of a method for intelligent audio mixing of multiple audio sources according to an embodiment of the present invention; Figure 5 A flowchart of a method for controlling a mixing state using an audio event according to an embodiment of the present invention; Figure 6 FIG. 4 is a schematic diagram of a device for multi-source audio mixing according to an embodiment of the present invention. DETAILED DESCRIPTION

[0008] In order to explain the technical content, achieved objectives and effects of the present invention in detail, the following is an explanation in conjunction with the implementation modes and the accompanying drawings.

[0009] In the existing technology, the scale and complexity of algorithms and models for separation and mixing of multiple audio sources are increasing, and different audio content has different requirements for algorithms, resulting in complex mixing and difficulty in personalized mixing.

[0010] In order to solve at least the above-mentioned technical problems, the present disclosure provides a method for multi-source audio mixing, which, after receiving audio sources from multiple audio source devices, adjusts the audio volume of multiple audio tracks, reads the sound effect configuration information for the multiple audio tracks, and adjusts the sound effects of the audio tracks according to the sound effect configuration information, and can support personalized multi-source mixing volume and sound effect adjustment. And by calculating the matching degree between multiple audio tracks and audio scenes, multiple audio tracks are mixed according to the matching degree to generate mixing data. In this way, according to an embodiment of the present disclosure, a scene-based multi-source audio mixing method can be implemented, and targeted mixing configurations can be made for different types of audio, effectively improving the personalization of multi-source mixing and reducing the complexity of mixing.

[0011] According to an embodiment of the present disclosure, the audio volume of multiple audio tracks can be balanced through a mixing volume module, thereby completing the function of unifying the volume for subsequent intelligent audio mixing. The mixing volume adjustment also takes into account the characteristics of the input device and the volume analysis strategy, removes some noise, and makes the mixing volume adjustment more intelligent and sound-friendly. In addition, customized fusion sound effect configurations are provided for multiple audio tracks. The fusion sound effect processing corresponding to each audio track ensures personalization and optimal sound effects, which is of great benefit to the overall audio effect. In addition, a flexible intelligent mixing strategy is implemented according to the audio scene type and the mixing strategy of multiple audio sources, which increases the personalization and flexibility of intelligent mixing. In addition, input and output change events enhance the robustness of the audio mixing module. Audio scene events enhance the personalization of the audio mixing module.

[0012] According to the embodiments of the present disclosure, a mixing sound effect module is utilized to support personalized mixing sound effect adjustment of multiple sound sources, a mixing module is utilized to implement scene-based multi-source audio intelligent mixing, and a mixing event module is utilized to improve the robustness of the mixing system.

[0013] Hereinafter, the technical solution according to the present disclosure will be described with reference to specific embodiments and in conjunction with the accompanying drawings.

[0014] Figure 1 1 is a flow chart showing a method 100 for multi-source audio mixing according to an embodiment of the present disclosure. Figure 1 The method 100 includes the following steps 102 to 104.

[0015] In step 102, audio sources from a plurality of audio source devices are received, and audio volumes of a plurality of audio tracks are adjusted.

[0016] In some embodiments, volume analysis strategies of multiple audio tracks are obtained, and the audio volume of the corresponding audio tracks is adjusted according to the volume analysis strategy. The volume analysis strategy includes at least one of environmental feedback volume control, user feedback volume control, and volume feature control, wherein environmental feedback volume control means adjusting the volume of the audio track by detecting environmental noise, user feedback volume control means adjusting the volume of the audio track by detecting human ear characteristics of the sound, and volume feature control means adjusting the volume of the audio track by analyzing the spectral characteristics of the audio. In some embodiments, the audio noise of the corresponding audio track is analyzed according to the volume analysis strategy, and the audio noise of the audio track is suppressed by audio filtering to balance the audio volume of the audio track. In this way, personalized mixing volume adjustment of multiple audio sources is supported.

[0017] In some embodiments, device characteristics of multiple audio source devices are obtained, and part of the noise of multiple audio tracks is removed according to the device characteristics. In some embodiments, the audio volumes corresponding to the multiple audio tracks are adjusted to a preset standard volume range. In this way, the volume of multiple audio sources can be standardized considering the characteristics of the audio source devices, which facilitates subsequent mixing operations.

[0018] In step 104, the sound effect configuration information for the plurality of audio tracks is read, and the sound effects of the plurality of audio tracks are adjusted according to the sound effect configuration information.

[0019] In some embodiments, the sound effect algorithm processing chain and sound effect parameters of the corresponding audio track are configured according to the sound effect configuration information, and the sound effect parameters of the audio track are adjusted through the sound effect algorithm processing chain of the audio track. The sound effect configuration information configured for the audio track is read, and each audio track is configured with independent sound effect configuration information, or several audio tracks share the same sound effect configuration information. In some embodiments, scene type information is obtained, and the sound effect parameters of multiple audio tracks are adjusted according to the scene type information and information associated with multiple audio tracks. In this way, by configuring the sound effect configuration information, the sound effect processing algorithm can be configured as little as possible to reduce the processing complexity.

[0020] In step 106, the matching degrees between the plurality of audio tracks and the audio scene are calculated, and the plurality of audio tracks are mixed according to the matching degrees to generate mixed audio data.

[0021] In some embodiments, the audio scene of the current playback environment is detected, the audio scene type is obtained, and the scene confidence of multiple audio tracks and corresponding audio scenes is calculated according to the audio scene type, so as to use the scene confidence as the matching degree. If the matching degree between the audio track and the corresponding audio scene is higher than the threshold, the audio corresponding to the audio track is mixed using a real-time thread. If the matching degree between the audio track and the corresponding audio scene is lower than the threshold, the audio corresponding to the audio track is mixed using a non-real-time thread. In this way, from the perspective of the architecture, high-value audio tasks are required to use resources in real time, and other tasks are processed as long as there are resources, thereby taking into account both the resource consumption of the audio system and the audio task processing capability.

[0022] In some embodiments, audio events of multiple audio source devices are obtained, and the mixing of multiple audio tracks is adjusted according to the audio events. The audio events include audio input change events, audio output change events, and audio scene events; wherein the audio input change events are used to control the change of audio input of multiple audio source devices, the audio output change events are used to control the change of audio output of audio output devices, and the audio scene events are used to adjust the audio data weights of multiple audio sources to adjust the matching degree of multiple audio tracks and corresponding audio scenes. In this way, the robustness of the audio mixing module is enhanced through input and output change events, and the personalization of the audio mixing module is enhanced through audio scene events.

[0023] Therefore, this embodiment uses mixing sound effects to support personalized adjustment of mixing sound effects of multiple sound sources. Intelligent mixing is used to achieve intelligent mixing of audio of multiple sound sources based on scenes. Mixing events can also be used to improve the robustness of the mixing system.

[0024] Hereinafter, application scenarios of the method and apparatus for multi-source audio mixing according to embodiments of the present invention will be described by way of examples.

[0025] Figure 2 2 is a flow chart showing a method 200 for adjusting the mixing volume of multiple audio sources according to an embodiment of the present invention. Figure 2 The method 200 includes the following steps 202 to 212.

[0026] In step 202, the connected multi-source input device is obtained. The multi-source input device includes: system sound input, microphone, Bluetooth input, guitar input, digital audio interface input, etc.

[0027] In step 204, the audio volume of the multiple audio tracks is adjusted to the standard volume range of the mixing module. The audio data comes from multiple audio source input devices, and the dynamic range of different types of audio varies greatly. In some embodiments, a normalization algorithm can be used to process the audio signal. The normalization algorithm can be RMS (root mean square) and peak algorithms to adjust the audio volume of the audio data to the standard volume range of the mixing module.

[0028] At step 206, volume analysis strategies of multiple audio tracks are obtained. In some embodiments, the volume analysis strategy includes: environmental feedback volume analysis, user feedback volume analysis, and volume feature analysis.

[0029] The environmental feedback volume analysis strategy means that the volume of the audio track is balanced by detecting the environmental noise. The user feedback volume analysis strategy means that the volume parameters are continuously adjusted by detecting the human ear characteristics of the sound. The volume feature control strategy means that a more appropriate volume analysis strategy is adopted by analyzing the spectral characteristics of the audio.

[0030] In step 208, audio noise of multiple audio tracks is calculated using a volume analysis algorithm. The volume analysis algorithm is specified by a volume analysis strategy.

[0031] At step 210, audio noise of the audio track is suppressed using an audio filter.

[0032] At step 212, the audio volume of the plurality of audio tracks is equalized. Therefore, the audio volume of multiple audio tracks is balanced through the mixing volume module to unify the volume for subsequent intelligent audio mixing. Mixing volume adjustment also takes into account the characteristics of the input device and the volume analysis strategy, which can remove some noise, making the mixing volume adjustment more intelligent and the adjusted sound more friendly.

[0033] Figure 3 FIG. 3 is a flow chart showing a method 300 for adjusting the mixing sound effects of multiple audio sources according to an embodiment of the present invention. Figure 3 , the method 300 includes the following steps 302 to 310.

[0034] In step 302, the sound effect configuration information of the multiple sound source tracks is read. Each sound track can be configured independently or in combination. Specifically, the sound effect configuration information of the multiple sound source tracks is read, and a typical sound effect configuration unit is selected for the sound source tracks, and different sound source tracks have different sound effect configuration parameters. Independent configuration means that each sound source track has independent sound effect configuration parameters, and combined configuration means that multiple sound source tracks share sound effect configuration parameters. When configured independently, the sound effect algorithm link and sound effect parameters are clearer and more readable.

[0035] In step 304, the algorithm processing chain of the audio track is configured according to the sound effect configuration information. Specifically, the sound effect processing algorithm is generally time-consuming, and the sound effect configuration in the mixing link should avoid over-configuring the sound effect processing algorithm. The algorithm processing chain of the configured audio track, for example, integrates fine-grained audio processing algorithms such as echo cancellation, voice detection, voice separation, background noise separation, beamforming, reverberation elimination, filtering, and sound compression. The algorithm processing chain needs to be closely integrated with the characteristics of the audio (experience or feature analysis) to construct a concise and effective linear or nonlinear algorithm processing chain to improve the audio quality of the audio track or indirectly improve the overall audio quality of the system.

[0036] For example, if there is a noise input source, a linear series algorithm processing chain is constructed, including noise suppression, howling detection, howling suppression, automatic gain control, etc. For example, if there is a digital music input source, a nonlinear series algorithm processing chain is constructed, including audio decoding, human voice detection, human voice separation, sound enhancement, noise suppression weakening, sound synchronization, etc.

[0037] In step 306, the sound effect parameters of the audio track are configured according to the sound effect configuration information.

[0038] In step 308, the sound effect parameters of the audio track are adjusted according to the external information feedback. Specifically, the scene type information of the scene microphone is obtained, and the sound effect parameters of the adjusted audio track are calculated by combining the scene type information and the input audio source audio track information. Then, the audio sound effects of part of the input audio source audio track are adjusted.

[0039] Audio scene types include: quiet scene, human voice scene, music scene, noisy scene, and special scene. Audio scene type information includes: audio scene type name, confidence, scene feature vector, scene feature vector length, and timestamp. The audio scene type will change dynamically over time. Using the audio scene type as the basis for adjusting the audio sound effects, and then cooperating with the audio processing algorithm, can improve the user's audio quality experience. The audio processing algorithm includes but is not limited to intelligent noise reduction, packet loss compensation, and audio super-resolution algorithms. For example: for human voice scenes, enable the human voice enhancement / reduction algorithm; for music scenes, enable the music sound effect algorithm.

[0040] In step 310 , audio data after audio effect processing of multiple audio source tracks is calculated.

[0041] Therefore, there are customized fusion sound effect configurations for multiple audio tracks. The fusion sound effect processing corresponding to each audio track ensures personalized and optimal sound effects, which is of great benefit to the overall audio effect.

[0042] Figure 4 4 is a flowchart showing a method 400 for intelligent audio mixing of multiple audio sources according to an embodiment of the present invention. Figure 4 , the method 400 includes the following steps 402 to 414.

[0043] In step 402, the audio tracks of the system's multiple audio sources are obtained.

[0044] In step 404, the standard audio data of the audio tracks of the multiple audio sources are calculated. The standard audio data includes parameters such as a unified sampling rate and a bit rate.

[0045] In step 406, the audio data of the audio tracks of the multiple audio sources are detected and the time stamps are aligned to ensure that the audio data of the different audio sources are consistent in time.

[0046] In step 408, the audio scene of the current playback environment is detected to obtain the audio scene type.

[0047] In step 410, the matching degree between the audio scene and the audio track is calculated according to the audio scene type and the mixing strategy of multiple audio sources.

[0048] The audio scene type information includes the audio scene type name, confidence, scene feature vector, scene feature vector length and timestamp. The audio scene type will change dynamically over time. Audio scene detection is to detect the audio scene type of the entire audio scene. The audio may contain multiple tracks, so the confidence of the audio scene type of different audio will be different. The scene confidence can be regarded as the matching degree between the audio scene and the audio track. This matching degree can be used to perform some personalized processing.

[0049] In step 412, audio mixing is completed based on the scene matching strategy. For audio tracks with audio scene type configuration scores higher than the threshold, real-time thread audio mixing is adopted. For audio tracks with audio scene type configuration scores lower than the threshold, general thread audio mixing is adopted.

[0050] The decision threshold is a boundary value set manually according to specific needs, which divides the configuration score from 0 to 1 (or 0 to 100) into different categories. The default is in the middle, that is, 50%, but it can be flexibly adjusted and optimized according to factors such as actual application scenarios, data distribution characteristics and decision-making goals to ensure the accuracy and effectiveness of the decision results. The threads for processing audio tasks use real-time and non-real-time, and the overall resource consumption and processing efficiency of the audio system need to be considered. From an architectural perspective, high-value audio tasks are required to use resources first, and other tasks are processed as long as there are resources, so as to take into account both the resource consumption of the audio system and the processing of audio tasks.

[0051] In step 414, the clipping of the mixing volume is calculated.

[0052] Therefore, a flexible intelligent mixing strategy is implemented according to the audio scene type and the mixing strategy of multiple audio sources, which increases the personalization and flexibility of intelligent mixing.

[0053] Figure 55 is a flow chart showing a method 500 for controlling a mixing state using an audio event according to an embodiment of the present invention. Figure 5 , the method 500 includes the following steps 502 to 510.

[0054] In step 502, audio events of a multi-source device are acquired, including audio input change events, audio output change events, and audio scene events.

[0055] In step 504, the audio input change event is used to control the mixing input of the multi-source device to make corresponding changes, for example, an input audio peripheral device is plugged in or unplugged.

[0056] In step 506, the audio output change event is used to control the mixed audio output of the multi-source device to make corresponding changes, such as when an output audio peripheral device is plugged in or unplugged.

[0057] In step 508, the audio scene event is used to adjust the audio data weight of multiple audio sources according to the audio strategy. The audio scene type is dynamically detected to form an audio scene event. The sound effects of multiple audio sources are dynamically calculated according to the dynamic audio scene type, that is, the matching degree between the audio track and the audio scene is calculated, which is equivalent to adjusting the data weight of the audio track.

[0058] In step 510, the operation state of the entire audio mixing module is controlled by using audio events. The audio events also include user audio control events.

[0059] Therefore, the robustness of the audio mixing module can be enhanced through audio input and output change events, and the personalization of the audio mixing module can be enhanced through audio scene events.

[0060] Figure 6 6 is a schematic diagram showing a device for multi-source audio mixing according to an embodiment of the present invention. The device comprises a mixing volume module 602 , a mixing sound effect module 604 , a mixing module 606 , a mixing event module 608 , and a mixing output module 610 .

[0061] The mixing volume module 602 is configured to execute a method for adjusting the mixing volume of multiple audio sources, specifically receiving audio sources from multiple audio source devices and adjusting the audio volume of multiple audio tracks.

[0062] The audio mixing and sound effect module 604 is configured to execute a method for adjusting audio mixing and sound effects of multiple audio sources, specifically, reading sound effect configuration information for multiple audio tracks, and adjusting the sound effects of the multiple audio tracks according to the sound effect configuration information.

[0063] The mixing module 606 is configured to execute an intelligent audio mixing method for multiple audio sources, specifically, to calculate the matching degree between multiple audio tracks and audio scenes, and to mix the multiple audio tracks according to the matching degree to generate mixing data.

[0064] The mixing event module 608 is configured to execute a method for controlling the mixing state using audio events, specifically obtaining audio events of multiple audio source devices, and adjusting the mixing of multiple audio tracks according to the audio events, where the audio events include at least one of an audio input change event, an audio output change event, and an audio scene event.

[0065] The audio mixing output module 610 is configured to distribute the audio mixing data after the audio mixing process to the subsequent audio module. The subsequent audio module refers to a playback device such as a multi-source audio output device or a virtual audio device.

[0066] Therefore, the modular mixing module can flexibly integrate and deploy new audio algorithms, and resolve the complexity of separating and mixing multiple audio sources through modularization and event-based methods.

[0067] In summary, the method and device for multi-source audio mixing provided by the present invention, after receiving audio sources from multiple audio source devices, adjust the audio volume of multiple audio tracks, read the sound effect configuration information for multiple audio tracks, and adjust the sound effects of the audio tracks according to the sound effect configuration information, which can support personalized multi-source mixing volume and sound effect adjustment. And by calculating the matching degree of multiple audio tracks and audio scenes, mixing multiple audio tracks according to the matching degree to generate mixing data, it is possible to implement a multi-source audio mixing method based on scene recognition, and to achieve targeted mixing configuration for different types of audio. In this way, the personalization of multi-source mixing is effectively improved and the complexity of mixing is reduced.

[0068] The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent transformations made using the contents of the present invention's specification and drawings, or directly or indirectly applied in related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for mixing multi-source audio, characterized in that: include: Receive audio sources from multiple audio source devices and adjust the audio volume of multiple audio tracks; Reading sound effect configuration information for the multiple audio tracks, and adjusting the sound effects of the multiple audio tracks according to the sound effect configuration information; as well as The matching degrees between the multiple audio tracks and the audio scene are calculated, and the multiple audio tracks are mixed according to the matching degrees to generate mixed audio data.

2. The method according to claim 1, characterized in that Adjusting the audio volume of multiple audio tracks includes: Acquire volume analysis strategies of the multiple audio tracks, and adjust the audio volume of the corresponding audio tracks according to the volume analysis strategies, wherein the volume analysis strategies include at least one of environment feedback volume control, user feedback volume control, and volume feature control, The environmental feedback volume control means adjusting the volume of the audio track by detecting environmental noise, the user feedback volume control means adjusting the volume of the audio track by detecting the human ear characteristics of the sound, and the volume feature control means adjusting the volume of the audio track by analyzing the spectral characteristics of the audio.

3. The method according to claim 2, characterized in that Adjusting the audio volume of the corresponding audio track according to the volume analysis strategy includes: Analyzing the audio noise of the corresponding audio track according to the volume analysis strategy; and Audio noise of the audio track is suppressed by audio filtering to equalize the audio volume of the audio track.

4. The method according to claim 1, characterized in that: Adjusting the audio volume of multiple audio tracks also includes: Device characteristics of the multiple audio source devices are obtained, and part of the noise of the multiple audio tracks is removed according to the device characteristics.

5. The method according to claim 1, characterized in that Adjusting the audio volume of multiple audio tracks also includes: The audio volumes corresponding to the multiple audio tracks are adjusted to a preset standard volume range.

6. The method according to claim 1, characterized in that Adjusting the sound effects of the multiple audio tracks according to the sound effect configuration information includes: Configure the sound effect algorithm processing chain and sound effect parameters of the corresponding audio track according to the sound effect configuration information; and The audio effect parameters of the audio track are adjusted through the audio effect algorithm processing chain of the audio track.

7. The method according to claim 1, characterized in that Adjusting the sound effects of the multiple audio tracks according to the sound effect configuration information further includes: Scene type information is obtained, and sound effect parameters of the multiple audio tracks are adjusted according to the scene type information and information associated with the multiple audio tracks.

8. The method according to claim 1, characterized in that Reading the sound effect configuration information for the multiple audio tracks includes: Read the sound effect configuration information configured for the audio track. Each audio track is configured with independent sound effect configuration information, or several audio tracks share the same sound effect configuration information.

9. The method according to claim 1, characterized in that: Calculating the matching degree between the multiple audio tracks and the audio scene includes: Detect the audio scene of the current playback environment and obtain the audio scene type; and The scene confidences of the multiple audio tracks and the corresponding audio scenes are calculated according to the audio scene type, so as to use the scene confidences as the matching degrees.

10. The method according to claim 9, characterized in that Mixing the multiple audio tracks according to the matching degree includes: If the matching degree between the audio track and the corresponding audio scene is higher than a threshold, the audio corresponding to the audio track is mixed using a real-time thread; If the matching degree between the audio track and the corresponding audio scene is lower than a threshold, a non-real-time thread is used to mix the audio corresponding to the audio track.

11. The method according to claim 1, characterized in that: Also includes: Acquire audio events of the multiple audio source devices, and adjust the mixing of the multiple audio tracks according to the audio events, wherein the audio events include audio input change events, audio output change events, and audio scene events. The audio input change event is used to control the change of audio input of multiple audio source devices, the audio output change event is used to control the change of audio output of audio output devices, and the audio scene event is used to adjust the audio data weights of multiple audio sources to adjust the matching degree of the multiple audio tracks and the corresponding audio scenes.

12. A device for mixing audio from multiple sources, characterized in that: include: A mixing volume module is configured to receive audio sources from multiple audio source devices and adjust the audio volume of multiple audio tracks; A sound mixing and sound effect module, configured to read the sound effect configuration information for the multiple audio tracks, and adjust the sound effects of the multiple audio tracks according to the sound effect configuration information; A mixing module, configured to calculate the matching degree between the multiple audio tracks and the audio scene, and mix the multiple audio tracks according to the matching degree to generate mixing data; as well as The audio mixing output module is configured to transmit the audio mixing data to a playback device.

13. The device according to claim 12, characterized in that Also includes: The mixing event module is configured to obtain audio events of the multiple audio source devices and adjust the mixing of the multiple audio tracks according to the audio events, wherein the audio events include at least one of an audio input change event, an audio output change event and an audio scene event.

Images