Method and device for processing multi-sound-source audio and electronic equipment

Abstract

The invention discloses a method and a device for processing multi-sound-source audio, and electronic equipment. The method comprises the following steps: acquiring audio data input by the multi-sound-source equipment through an input interface by an audio input module; the audio component and the data link module process the audio data according to the audio task, and send the processed audio data to the sound effect pre-processing module; the sound effect pre-processing module carries out sound effect adjustment according to the sound effect configuration information of the audio data to generate a sound effect pre-processing result, and sends the sound effect pre-processing result to the sound mixing module; a sound mixing module carries out sound mixing on the sound effect pre-processing result to generate a sound mixing result, and sends the sound mixing result to a sound effect post-processing module; and the sound effect post-processing module dynamically adjusts the sound mixing result to generate a sound effect post-processing result, and outputs the sound effect post-processing result to the audio output module through the output interface. And audio data is processed in a low-delay manner by using audio task fine-grained componentization, and flexible configuration and sound effect management of multi-sound-source input and output are supported.

Description

Technical Field

[0001] The present invention relates to the technical field of audio processing, and in particular to a method and device for processing multi-source audio, and an electronic device. Background Art

[0002] At present, audio technologies such as audio chip technology, advanced audio standards and advanced audio equipment for multiple audio sources are developing rapidly. Multi-source audio equipment is widely used in conference systems, smart TVs, live broadcasts, recording studios and other scenarios. Among them, multi-source audio equipment refers to equipment that can process and output multiple audio sources at the same time.

[0003] Multi-source audio devices support the simultaneous acquisition of multiple audio input channels, such as microphones, guitar inputs, digital audio interfaces, etc. This places very high demands on the audio chip's audio input capability, audio preprocessing capability, audio mixing capability, and audio effect adjustment capability. Therefore, current multi-source audio processing has problems such as long processing time. Summary of the invention

[0004] The present invention provides a method and device for processing multi-source audio, and an electronic device, which can reduce the delay of audio output and support flexible configuration and sound effect management of multi-source input and output.

[0005] In one aspect of the present invention, a method for processing multi-source audio is provided. The method comprises: obtaining audio data inputted by a multi-source device through an input interface by an audio input module; processing the audio data according to an audio task by an audio component and a data link module to send the processed audio data to a sound effect pre-processing module; adjusting the sound effect by the sound effect pre-processing module according to the sound effect configuration information of the audio data to generate a sound effect pre-processing result, and sending the sound effect pre-processing result to a mixing module; mixing the sound effect pre-processing result by the mixing module to generate a mixing result, and sending the mixing result to a sound effect post-processing module; and dynamically adjusting the mixing result by the sound effect post-processing module to generate a sound effect post-processing result, and outputting the sound effect post-processing result to an audio output module through an output interface.

[0006] In another aspect of the present invention, a device for processing multi-source audio is provided. The device includes: an audio input module, configured to obtain audio data input by a multi-source device through an input interface; an audio component and a data link module, configured to process the audio data according to an audio task to send the processed audio data to a sound effect pre-processing module; a sound effect pre-processing module, configured to adjust the sound effect according to the sound effect configuration information of the audio data to generate a sound effect pre-processing result, and send the sound effect pre-processing result to a mixing module; a mixing module, configured to mix the sound effect pre-processing result to generate a mixing result, and send the mixing result to a sound effect post-processing module; and a sound effect post-processing module, configured to dynamically adjust the mixing result to generate a sound effect post-processing result, and output the sound effect post-processing result to an audio output module through an output interface.

[0007] In another aspect of the present invention, an electronic device is provided, comprising: a memory configured to store a processor-executable program; and a processor configured to execute the program to perform the above-mentioned method for processing multi-source audio.

[0008] According to the present invention, the audio input module receives audio data input from multiple audio source devices, and uses audio tasks to process the audio data, and sequentially mixes and adjusts the audio effects through the audio effect pre-processing module, the mixing module, and the audio effect post-processing module, wherein the audio effect post-processing module can be further adjusted by perceiving the audio scene type and the output device characteristics. In this way, the audio data can be processed with low latency by utilizing the fine-grained componentization of audio tasks; the audio effect pre-processing module and the audio effect post-processing module are added before and after the mixing module, which can fully support the complex input audio effect processing of multiple audio sources and the complex output audio effect processing of multiple audio sources. On the basis of meeting the differences, the traditional mixing module can be reused, and the flexible configuration and audio effect management of multiple audio source input and output can be supported. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a flow chart of a method for processing multi-source audio according to an embodiment of the present invention; Figure 2 This is a diagram of an example of audio processing of a multi-source audio device according to an embodiment of the present invention; Figure 3 is a processing flow chart of an audio component and an audio data link module according to an embodiment of the present invention; Figure 4 is a processing flow chart of a multi-source audio input module according to an embodiment of the present invention; Figure 5 is a processing flow chart of an audio sound effect pre-processing module according to an embodiment of the present invention; Figure 6is a processing flow chart of a multi-source audio mixing module according to an embodiment of the present invention; Figure 7 is a processing flow chart of an audio sound effect post-processing module according to an embodiment of the present invention; Figure 8 is a processing flow chart of a multi-source audio output module according to an embodiment of the present invention; Fig. 9 is a structural diagram of a device for processing multi-source audio according to an embodiment of the present invention; Fig.10 4 is a structural diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0010] In order to explain the technical content, achieved objectives and effects of the present invention in detail, the following is an explanation in combination with the implementation modes and the accompanying drawings.

[0011] In the prior art, when a multi-source audio device supports the simultaneous acquisition of multiple audio input channels, there are certain technical challenges in managing and using the multi-source audio device, and there are problems such as a long multi-source audio processing time.

[0012] In order to solve at least the above-mentioned technical problems, the present disclosure provides a method for processing multi-source audio, wherein an audio input module receives audio data input by multi-source devices, and uses an audio task to process the audio data, and sequentially mixes and adjusts the audio through a sound effect pre-processing module, a mixing module, and a sound effect post-processing module, wherein the sound effect post-processing module can be further adjusted by perceiving the audio scene type and output device characteristics. In this way, the audio data can be processed with low latency by utilizing the fine-grained componentization of audio tasks; the sound effect pre-processing module and the sound effect post-processing module are added before and after the mixing module, which can fully support the complex input sound effect processing of multiple sound sources and the complex output sound effect processing of multiple sound sources. On the basis of satisfying the differences, the traditional mixing module can be reused, and the flexible configuration and sound effect management of multi-source input and output can be supported.

[0013] According to the embodiments of the present disclosure, by utilizing the component / module abstraction concept, the differences in the hardware input and output interfaces of multiple audio sources are shielded, thereby supporting flexible configuration and sound effect management of input and output. By utilizing the fine-grained componentization of audio tasks and supporting composite tasks, the low latency characteristics of the data link are supported, the input and output of heterogeneous audio devices are supported, and the flexible audio data link supports complex audio tasks. By adding an audio sound effect pre-processing module and an audio sound effect post-processing module before and after the audio mixing module, the complex input sound effect processing of multiple audio sources and the complex output sound effect processing of multiple audio sources are fully supported. On the basis of satisfying the differences, the traditional audio mixing module can be reused.

[0014] Hereinafter, the technical solution according to the present disclosure will be described with reference to specific embodiments and in conjunction with the accompanying drawings.

[0015] Figure 1 1 is a flow chart showing a method 100 for processing multi-source audio according to an embodiment of the present disclosure. Figure 1 The method 100 includes the following steps 102 to 110.

[0016] In step 102, the audio input module obtains audio data input by the multi-audio source device through the input interface.

[0017] In step 104, the audio component and the data link module process the audio data according to the audio task to send the processed audio data to the sound effect pre-processing module.

[0018] In some embodiments, an audio data chain is constructed according to the input audio data, the audio data chain is traversed to obtain an audio task, and the audio data chain distributes the audio task to an audio task processor to process the audio data. In some embodiments, the audio data chain is traversed to obtain an audio task and a composite audio task, the composite audio task is generated by linearly or nonlinearly combining the audio task, and the audio task processor distributes the audio task to the thread processing corresponding to its load. In this way, the audio task fine-grained componentization is utilized and composite tasks are supported, thereby supporting the low latency characteristics of the data link, and supporting heterogeneous audio device input and output. Flexible audio data chains support complex audio tasks.

[0019] In step 106, the sound effect pre-processing module performs sound effect adjustment according to the sound effect configuration information of the audio data to generate a sound effect pre-processing result, and sends the sound effect pre-processing result to the mixing module. In some embodiments, the sound effect configuration information corresponding to each track of the audio data is read, the algorithm processing chain and track parameters of the track are configured according to the sound effect configuration information, and the track parameters are adjusted according to the acquired external scene information. In this way, customized fusion sound effect configurations are provided for multiple audio tracks. The fusion sound effect processing corresponding to each track ensures personalized and optimal sound effects, which is of great benefit to the overall audio effect.

[0020] In step 108, the sound effect pre-processing result is mixed by the mixing module to generate a mixing result, and the mixing result is sent to the sound effect post-processing module. In some embodiments, each track of the sound effect pre-processing result is time-synchronized, and each track is subjected to sound effect processing and mixing processing to generate a mixing result.

[0021] In step 110, the sound effect post-processing module dynamically adjusts the mixing result to generate a sound effect post-processing result, and outputs the sound effect post-processing result to the audio output module through the output interface. In some embodiments, the sound effect post-processing module dynamically adjusts the mixing result according to the audio output device characteristics and the audio scene type to generate the sound effect post-processing result. In this way, an output sound effect module is added between the intelligent mixing module and the audio output module. By perceiving the audio scene type and the output device characteristics, the beneficial audio components are highlighted and the lossy audio components are suppressed in a targeted manner. The audio data processed by the sound effect post-processing module is more friendly to the audio scene type and the output device characteristics, thereby improving the user audio experience.

[0022] In some embodiments, ambient sound of the sound source device is obtained by sampling data from the sound source device, the audio scene type is analyzed through sound separation based on the ambient sound, the audio output device characteristics are obtained through the audio output module, and the mixing result is dynamically adjusted according to the audio output device characteristics and the audio scene type to generate a sound effect post-processing result, wherein the device characteristics include an interface driver for the device and a data operation method for the device.

[0023] In some embodiments, the audio output module synchronizes the audio effect post-processing result to multiple audio output devices in parallel. In some embodiments, the audio time information of multiple audio output devices is detected. If the audio time information and picture information of an audio output device are not synchronized, the corresponding audio output device is shielded when the audio output module outputs the audio effect post-processing result. In this way, the obvious audio and picture asynchronism and other problems are reduced.

[0024] Hereinafter, application scenarios of the method and apparatus for processing multi-source audio and the electronic device according to the embodiments of the present invention will be described by way of examples.

[0025] Figure 2 FIG. 2 is a diagram showing an example of audio processing of a multi-source audio device according to an embodiment of the present invention. Figure 2 The typical audio data processing workflow of multi-source audio processing needs to go through: multi-source audio input, audio sound effect pre-processing / input sound effect processing, audio mixing module processing, audio sound effect post-processing / output sound effect processing, and multi-source audio output module.

[0026] In this embodiment, the mic sound effect combination can be configured with an anti-howling algorithm, a level detection algorithm, a reverberation algorithm, a volume algorithm, etc., as well as supporting sound effect parameters. The music sound effect combination can be a level detection algorithm, a human voice separation algorithm, a volume algorithm, etc., as well as supporting sound effect parameters.

[0027] Input audio processing consumes a lot of system computing resources. Select the audio algorithm based on the input audio characteristics to avoid over-configuring the audio algorithm. For audio tracks that do not require special processing, configure the simplest audio effect (volume) to save system computing resources.

[0028] An audio sound effect pre-processing module and an audio sound effect post-processing module are added before and after the audio mixing module, which fully supports complex input sound effect processing and complex output sound effect processing of multiple sound sources. On the basis of meeting the differences, the traditional audio mixing module can be reused.

[0029] Figure 3 1 is a processing flow chart showing the audio component and the audio data link module of an embodiment of the present invention. Figure 3 , the processing process includes the following steps 302 to 312.

[0030] In step 302, multiple heterogeneous audio devices are supported to access. The audio device access mainly includes: system sound input, microphone, Bluetooth input, guitar input, digital audio interface, etc.

[0031] In step 304, the audio component supports audio tasks and composite audio tasks. The composite audio task includes a combination of multiple audio tasks and connection relationships. The composite audio task mainly includes composite audio tasks of linear combination and nonlinear combination. For example, task A→task B→task C is a linear combination, and task A→(task B+task C)→task D is a nonlinear combination. By organically constructing composite audio tasks, the system overhead of task switching can be reduced. In addition, the audio component supports independent audio tasks and composite audio tasks, and the load of audio tasks is relatively diverse, including CPU audio tasks, hardware accelerated audio tasks (NEON) and DSP audio tasks.

[0032] At step 306, a plurality of audio data chains are managed using.

[0033] In step 308, the audio data chain is traversed to obtain active audio tasks.

[0034] In step 310, the audio data chain distributes the audio task to the audio task executor. For example, for a non-CPU audio task, the audio data chain distributes it to a specific non-CPU audio thread for processing.

[0035] In step 312, multiple heterogeneous audio device outputs are supported. The audio device outputs mainly include: Bluetooth output, HDMI sound output, optical fiber output, power amplifier speaker output, etc.

[0036] Therefore, by using the component / module abstraction concept, a set of multi-source hardware input interfaces or multi-audio output interfaces (open / close / read / write / procoss / update) is defined, and then the above interfaces are implemented for specific media. The software abstract interface is unified, and the operations of the driver and hardware operations are encapsulated into the interface implementation. For users using the software abstract interface, the differences are invisible and need not be concerned. The above method shields the differences in the multi-source hardware input and output interfaces, thereby supporting flexible configuration and sound effect management of input and output. At the same time, the audio task is fine-grained componentized and supports composite tasks, thereby supporting the low latency characteristics of the data link, supporting the input and output of heterogeneous audio devices, and the flexible audio data link can also support complex audio tasks.

[0037] Figure 4 FIG. 1 is a flowchart showing the processing of the multi-source audio input module according to an embodiment of the present invention. Figure 4 , the processing process includes the following steps 402 to 412.

[0038] In step 402, the multi-source audio devices connected to the system are obtained. The multi-source audio devices include: system sound input, microphone, Bluetooth input, guitar input, digital audio interface, etc. The multi-source audio devices have different electrical characteristics, audio interface definitions, communication protocol definitions, and audio format definitions.

[0039] In step 404, audio parameters of the audio device are obtained.

[0040] In step 406, the connection status of the audio device is detected.

[0041] At step 408, the connected multi-source audio device is turned on.

[0042] In step 410, audio data is read from a multi-source audio device.

[0043] In step 412, the connected multi-source audio device is turned off.

[0044] Figure 5 1 is a processing flow chart showing the audio effect pre-processing module of an embodiment of the present invention. Figure 5 , the processing process includes the following steps 502 to 508.

[0045] In step 502, the sound effect configuration information of the multi-source audio tracks is read. Each audio can be configured independently, in combination, or cross-configured.

[0046] In step 504, the algorithm processing chain of the audio track is configured according to the sound effect configuration information. The algorithm processing chain of the audio track is preferably selected based on the audio scene type and the audio characteristics of the input device. The audio scene types include scene types, outdoor scenes, public places, meeting scenes, concert scenes, etc. The sound effect algorithms and parameters of the input devices configured for different audio scene types are significantly different.

[0047] In step 506, the sound effect parameters of the audio track are configured according to the sound effect configuration information.

[0048] In step 508, the sound effect parameters of the audio track are adjusted according to the external information feedback. According to the external information feedback refers to the audio scene type detected by the audio scene detection algorithm. When the audio scene type changes, the sound effect algorithm and sound effect parameters of the audio track need to be changed.

[0049] In this way, there are customized fusion sound effect configurations for multiple audio tracks. The fusion sound effect processing corresponding to each audio track ensures personalized and optimal sound effects, which is of great benefit to the overall audio effect.

[0050] Figure 6 1 is a flowchart showing the processing of the multi-source audio mixing module of an embodiment of the present invention. Figure 6 , the processing process includes the following steps 602 to 610.

[0051] In step 602, the audio data input from multiple audio sources is standardized, specifically, the sampling rate, bit rate and other parameters of the audio data are standardized.

[0052] In step 604, the time of multiple audio tracks is synchronized. The time stamps are aligned to ensure that the audio data of different audio sources are consistent in time.

[0053] In step 606, audio effects of the plurality of audio tracks are processed.

[0054] At step 608, a mixing process of the plurality of audio tracks is performed.

[0055] In step 610, the mixed audio data is distributed to a subsequent audio module.

[0056] In this way, it is convenient for the audio effect post-processing module to obtain the mixed audio data from the audio mixing module, so as to perform another scene-based output audio effect processing before distributing it to the audio output module.

[0057] Figure 7 1 is a processing flow chart showing the audio effect post-processing module of an embodiment of the present invention. Figure 7 , the processing process includes the following steps 702 to 712.

[0058] In step 702, the audio data mixed by the intelligent mixing module is obtained.

[0059] In step 704, the ambient sound is collected. The ambient sound can be collected by a microphone. The ambient sound can also be obtained by an audio output module to obtain audio output data as the ambient sound.

[0060] In step 706, the audio scene type is analyzed by ambient sound. Preferably, the audio scene type is obtained by a sound separation algorithm, specifically, the external ambient sound analysis audio scene algorithm is called to obtain the audio scene type through ambient sound analysis. Preferably, a hardware-accelerated external ambient sound analysis audio scene algorithm is used. Among them, the ambient sound analysis audio scene algorithm includes a CPU version, a Neon version, and an NPU version. Preferably, the Neon version and the NPU version support hardware acceleration.

[0061] In step 708, the output device characteristics are obtained through the audio output module. The output device characteristics include characteristics such as the interface driver and data operation method of the output device.

[0062] In step 710, the audio effect of the audio data is dynamically adjusted according to the audio scene type and the output device characteristics. Specifically, the audio scene type is analyzed by the ambient sound. The audio scene type is preferably obtained by a sound separation algorithm. A preset audio effect configuration is selected according to the audio scene type.

[0063] In step 712, the audio data after the audio effect processing is output.

[0064] Therefore, an audio effect post-processing module is added between the mixing module and the audio output module. By sensing the audio scene type and output device characteristics, the beneficial audio components are highlighted and the lossy audio components are suppressed. The audio data processed by the output audio effect module is more friendly to the audio scene type and output device characteristics, which improves the user audio experience.

[0065] In addition, the audio output module is constrained by the chip computing power and the complexity of the audio algorithm. The audio effect of the audio data can be dynamically adjusted according to the audio scene type and the characteristics of the output device, reducing the differences in audio output of heterogeneous hardware, ensuring low-latency audio output, and configuring audio output strategies.

[0066] Figure 8 FIG. 1 is a flowchart showing the processing of the multi-source audio output module according to an embodiment of the present invention. Figure 8 , the processing process includes the following steps 802 to 808.

[0067] In step 802, the audio output module obtains multiple audio output devices, such as headphones, Bluetooth speakers, etc.

[0068] In step 804, the audio output module obtains audio data from the audio front-end module. Here, the front-end module includes a mixing module, an equalizer module, and an audio effect rendering module, etc. The audio data is in a PCM audio format without peripheral packaging.

[0069] In step 806, the audio output module uses a high-precision synchronization source to synchronize multiple output devices. After the synchronized audio data is distributed to multiple output devices, the audio time information of the output devices is optionally detected. If there is a deviation in synchronization, obvious problems such as audio and video asynchrony and reduced sound quality will occur. If asynchrony is detected, further processing can be selected, such as shielding the output device.

[0070] In step 808, the audio output module distributes the audio data to multiple audio output devices in parallel, which can fully utilize the independence of the audio devices and the parallel processing capability of the processor to improve the data throughput of the parallel output audio.

[0071] Therefore, the audio output module passes the audio data from the application to the audio hardware, and finally outputs it through devices such as headphones and speakers.

[0072] Fig. 9 1 is a structural diagram showing a device for processing multi-source audio according to an embodiment of the present invention. Fig. 9 The device includes an audio input module 902, an audio component and data link module 904, an audio pre-processing module 906, a mixing module 908, an audio post-processing module 910 and an audio output module 912.

[0073] The audio input module 902 is configured to obtain audio data input by the multi-audio source device through an input interface.

[0074] The audio component and data link module 904 is configured to process the audio data according to the audio task to send the processed audio data to the sound effect pre-processing module.

[0075] The sound effect pre-processing module 906 is configured to perform sound effect adjustment according to the sound effect configuration information of the audio data to generate a sound effect pre-processing result, and send the sound effect pre-processing result to the mixing module.

[0076] The mixing module 908 is configured to mix the sound effect pre-processing result to generate a mixing result, and send the mixing result to the sound effect post-processing module.

[0077] The sound effect post-processing module 910 is configured to dynamically adjust the mixing result according to the characteristics of the audio output device and the audio scene type to generate a sound effect post-processing result, and output the sound effect post-processing result to the audio output module 912 through the output interface.

[0078] It should be understood that the above modules can be further configured to execute the corresponding steps or actions described in the above embodiments, which will not be described in detail here.

[0079] Fig.10 1 is a block diagram showing an electronic device 1000 according to an embodiment of the present invention. Fig.10 , the electronic device 1000 includes a memory 1002 and at least one processor 1004. The memory 1002 is configured to store information associated with audio. At least one processor 1004 is electrically coupled to the memory and configured to perform the various steps or actions of the method for processing multi-source audio as described above.

[0080] In summary, the method and device for processing multi-source audio, and the electronic device provided by the present invention receive audio data input by multi-source devices through an audio input module, and use audio tasks to process the audio data, and sequentially mix and adjust the audio effects through a sound effect pre-processing module, a mixing module, and a sound effect post-processing module, wherein the sound effect post-processing module can be used to further adjust by perceiving the audio scene type and output device characteristics. In this way, the audio data can be processed with low latency by utilizing the fine-grained componentization of audio tasks; the sound effect pre-processing module and the sound effect post-processing module are added before and after the mixing module, which can fully support the complex input sound effect processing of multiple sound sources and the complex output sound effect processing of multiple sound sources. On the basis of satisfying the differences, the traditional mixing module can be reused, and the flexible configuration and sound effect management of multi-source input and output can be supported.

[0081] The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent transformations made using the contents of the present invention's specification and drawings, or directly or indirectly applied in related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for processing multi-source audio, characterized in that: include: The audio input module obtains the audio data inputted by the multi-source device through the input interface; The audio component and the data link module process the audio data according to the audio task, so as to send the processed audio data to the sound effect pre-processing module; The sound effect pre-processing module performs sound effect adjustment according to the sound effect configuration information of the audio data to generate a sound effect pre-processing result, and sends the sound effect pre-processing result to the mixing module; The mixing module mixes the sound effect pre-processing result to generate a mixing result, and sends the mixing result to the sound effect post-processing module; as well as The sound effect post-processing module dynamically adjusts the mixing result to generate a sound effect post-processing result, and outputs the sound effect post-processing result to the audio output module through an output interface.

2. The method according to claim 1, characterized in that Processing the audio data according to the audio task by the audio component and the data link module includes: constructing an audio data chain according to the input audio data, and traversing the audio data chain to obtain an audio task; and The audio task is distributed to an audio task processor by the audio data link to process the audio data.

3. The method according to claim 2, characterized in that Traversing the audio data chain to obtain the audio task includes: traversing the audio data chain to obtain the audio task and the composite audio task, wherein the composite audio task is generated by linearly combining or nonlinearly combining the audio tasks; The step of distributing the audio task to an audio task processor to process the audio data by the audio data link includes: distributing the audio task to a thread corresponding to its load for processing by the audio task processor.

4. The method according to claim 1, characterized in that The sound effect pre-processing module performs sound effect adjustment according to the sound effect configuration information of the audio data to generate a sound effect pre-processing result, including: Reading the sound effect configuration information corresponding to each audio track of the audio data, and configuring the algorithm processing chain and audio track parameters of the audio track according to the sound effect configuration information; and Adjust the audio track parameters according to the acquired external scene information.

5. The method according to claim 4, characterized in that The mixing module mixes the sound effect pre-processing result to generate a mixing result, including: The various audio tracks of the audio effect pre-processing result are time-synchronized, and audio effect processing and mixing processing are performed on the various audio tracks to generate a mixing result.

6. The method according to claim 1, characterized in that The sound effect post-processing module dynamically adjusts the mixing result to generate a sound effect post-processing result, including: The sound effect post-processing module dynamically adjusts the mixing result according to the characteristics of the audio output device and the audio scene type to generate the sound effect post-processing result.

7. The method according to claim 6, characterized in that The audio effect post-processing module dynamically adjusts the mixing result according to the audio output device characteristics and the audio scene type to generate the audio effect post-processing result, including: Acquire the ambient sound of the sound source device through the data collected from the sound source device, and analyze the audio scene type through sound separation according to the ambient sound; Obtaining audio output device characteristics through the audio output module; and The mixing result is dynamically adjusted according to the audio output device characteristics and the audio scene type to generate a sound effect post-processing result, wherein the device characteristics include an interface driver of the device and a data operation method of the device.

8. The method according to claim 1, characterized in that Also includes: The audio output module synchronizes the sound effect post-processing results to multiple audio output devices in parallel.

9. The method according to claim 8, characterized in that Also includes: The audio time information of multiple audio output devices is detected. If the audio time information and picture information of any audio output device are not synchronized, the corresponding audio output device is shielded when the audio output module outputs the sound effect post-processing result.

10. A device for processing multi-source audio, characterized in that: include: The audio input module is configured to obtain audio data input by the multi-source device through the input interface; The audio component and the data link module are configured to process the audio data according to the audio task to send the processed audio data to the sound effect pre-processing module; A sound effect pre-processing module, configured to adjust the sound effect according to the sound effect configuration information of the audio data to generate a sound effect pre-processing result, and send the sound effect pre-processing result to the mixing module; A mixing module, configured to mix the sound effect pre-processing result to generate a mixing result, and send the mixing result to the sound effect post-processing module; as well as The sound effect post-processing module is configured to dynamically adjust the mixing result to generate a sound effect post-processing result, and output the sound effect post-processing result to the audio output module through the output interface.

11. An electronic device, characterized in that: include: a memory configured to store information associated with the audio; as well as At least one processor is electrically coupled to the memory and is configured to execute the method according to any one of claims 1 to 9.

Images