Audio data processing method and device, equipment and medium

Abstract

The invention provides an audio data processing method and device, equipment and a medium. The method comprises the following steps: acquiring respective code modules and to-be-processed audio data of various audio processing algorithms; partitioning the multiple audio processing algorithms based on respective code modules of the multiple audio processing algorithms to obtain at least one working area, so that each working area has at least one group of audio processing algorithms containing the same code module, and each group of audio processing algorithms comprises multiple audio processing algorithms; in each working area, combining a plurality of audio processing algorithms in each group of audio processing algorithms to obtain at least one target audio processing algorithm; and inputting the to-be-processed audio data into the at least one working area, and performing audio processing on the to-be-processed audio data through the at least one target audio processing algorithm in each working area to obtain target audio data. Therefore, high tone quality is kept, and the processing efficiency of the audio data is improved.

Description

Technical Field

[0001] The present application relates to the field of audio processing technology, and in particular to an audio data processing method, device, equipment and medium. Background Art

[0002] With the widespread popularity of applications such as real-time communication, online music playback, and voice recognition, the demand for real-time processing of audio data has become increasingly urgent. Not only does it require audio data to be processed and transmitted quickly to ensure the smoothness and real-time nature of the user experience, but it also places extremely high demands on sound quality. However, the audio data processing methods in related technologies often have a trade-off between processing efficiency and sound quality. Improving processing efficiency may lead to a decline in sound quality, while pursuing high sound quality will increase processing time and computational complexity. Therefore, how to effectively improve the processing efficiency of audio data while maintaining high sound quality is an urgent problem to be solved. Summary of the invention

[0003] In view of this, the present application provides an audio data processing method, apparatus, device and medium, which can effectively improve the processing efficiency of audio data while maintaining high sound quality.

[0004] In a first aspect, the present application provides an audio data processing method, comprising: obtaining code modules and audio data to be processed of respective multiple audio processing algorithms; partitioning the multiple audio processing algorithms based on the code modules of respective multiple audio processing algorithms to obtain at least one working area, so that each working area has at least one group of audio processing algorithms containing the same code module, and each group of audio processing algorithms includes multiple audio processing algorithms; within each working area, merging the multiple audio processing algorithms in each group of audio processing algorithms to obtain at least one target audio processing algorithm; inputting the audio data to be processed into at least one working area, and performing audio processing on the audio data to be processed through at least one target audio processing algorithm in each working area to obtain target audio data.

[0005] In a second aspect, the present application provides an audio data processing device, comprising: an acquisition module, used to acquire the code modules and audio data to be processed of each of the multiple audio processing algorithms; a division module, used to partition the multiple audio processing algorithms based on the code modules of the multiple audio processing algorithms to obtain at least one working area, so that each working area has at least one group of audio processing algorithms containing the same code module, and each group of audio processing algorithms includes multiple audio processing algorithms; a merging module, used to merge the multiple audio processing algorithms in each group of audio processing algorithms within each working area to obtain at least one target audio processing algorithm; a processing module, used to input the audio data to be processed into at least one working area, and perform audio processing on the audio data to be processed through at least one target audio processing algorithm in each working area to obtain target audio data.

[0006] In a third aspect, the present application provides an electronic device comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store one or more executable instructions, and the executable instructions enable the processor to execute the method of the first aspect above.

[0007] In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by one or more processors, the method of the first aspect is implemented.

[0008] In a fifth aspect, the present application provides a computer program product, comprising computer program instructions, which enable a computer to execute the method of the first aspect.

[0009] In a sixth aspect, the present application provides a computer program, which, when executed on a computer, enables the computer to execute the method of the first aspect.

[0010] The present application provides an audio data processing method, apparatus, device and medium, which partitions multiple audio processing algorithms so that each working area has at least one group of audio processing algorithms containing the same code module, and in each working area, merges multiple audio processing algorithms in each group of audio processing algorithms, and uses at least one merged target audio processing algorithm to perform audio processing on audio data to be processed, so that the processing of audio data can maintain high sound quality while avoiding the repeated execution of multiple audio processing algorithms with the same code module, thereby reducing computational redundancy and significantly improving the processing efficiency of audio data. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0012] Figure 1 It is a schematic diagram of the process of processing audio data;

[0013] Figure 2 It is a flowchart of an audio data processing method provided in an embodiment of the present application;

[0014] Figure 3 It is a schematic diagram of partitioning multiple audio processing algorithms provided by an embodiment of the present application;

[0015] Figure 4 is a schematic diagram of performing audio processing on multiple audio data slices to be processed provided by an embodiment of the present application;

[0016] Figure 5 It is a schematic diagram of a related technology provided in an embodiment of the present application and the computing power used by the present solution for audio data processing;

[0017] Figure 6 It is a schematic diagram of the structure of an audio data processing device provided in an embodiment of the present application;

[0018] Figure 7 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0019] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the embodiments of the present application should fall within the scope of protection of the embodiments of the present application.

[0020] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0021] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0022] It should also be pointed out that the terms "first\second\third" involved in the embodiments of the present application are only used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0023] In addition, the term "and / or" in the embodiments of the present application is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0024] To facilitate understanding of the technical solutions of the embodiments of the present application, the relevant technologies of the embodiments of the present application are described below. The following related technologies can be arbitrarily combined with the technical solutions of the embodiments of the present application as optional solutions, and they all belong to the protection scope of the embodiments of the present application.

[0025] In today's era of widespread popularity of multimedia applications, audio data processing technology plays a vital role. Figure 1 It is a flowchart for processing audio data. Figure 1 As shown, the process may include the following steps.

[0026] S110: Audio data input.

[0027] In the audio data input stage, the input audio data comes from a microphone, an audio file or other audio input devices.

[0028] S120: audio data processing.

[0029] In the audio data processing stage, the audio data processing is located between the audio data input and the audio data output, and the audio data is processed by connecting multiple audio processing algorithms in series. Among them, the multiple audio processing algorithms may include gain algorithms, volume algorithms, mute algorithms, mixing algorithms, filtering algorithms, delay algorithms, limiting algorithms, etc., which are not limited in the embodiments of the present application.

[0030] S130: Audio data output.

[0031] In the audio data output stage, the processed audio data can be output by playing through a speaker, saving to a file, or sending over a network.

[0032] In scenarios with high real-time requirements, such as online music playback, real-time communication, voice interaction, etc., audio data must not only be processed efficiently in a very short time, but also maintain high sound quality to meet the user's auditory experience. However, in existing audio data processing methods, multiple audio processing algorithms are connected in series, resulting in the sacrifice of sound quality in pursuit of efficient processing, and may also lead to a decrease in processing efficiency while maintaining high sound quality. Therefore, how to effectively improve the processing efficiency of audio data while maintaining high sound quality is an urgent problem to be solved.

[0033] Based on this, an embodiment of the present application provides an audio data processing method, which partitions multiple audio processing algorithms so that there is at least one group of audio processing algorithms containing the same code module in each working area, and in each working area, multiple audio processing algorithms in each group of audio processing algorithms are merged, and at least one of the merged target audio processing algorithms is used to perform audio processing on the audio data to be processed. This allows the processing of audio data to maintain high sound quality while avoiding the repeated execution of multiple audio processing algorithms with the same code module, thereby reducing computational redundancy and significantly improving the processing efficiency of audio data.

[0034] To facilitate understanding of the technical solutions of the embodiments of the present application, the technical solutions of the present application are described in detail below through specific embodiments. The above related technologies can be combined arbitrarily with the technical solutions of the embodiments of the present application as optional solutions, and they all belong to the protection scope of the embodiments of the present application. The embodiments of the present application include at least part of the following contents.

[0035] Figure 2 is a flowchart of an audio data processing method provided in an embodiment of the present application, such as Figure 2 As shown, the method may include the following steps.

[0036] S210: Obtain code modules of respective multiple audio processing algorithms.

[0037] It should be noted that, in the embodiments of the present application, the audio data processing method can be applied to an audio data processing device, or an electronic device integrated with the device. The electronic device can be implemented in various forms, for example, the electronic device can include a digital signal processor (DSP), a central processing unit (CPU), etc., which is not limited here.

[0038] It should also be noted that the code module is a key part of the audio processing algorithm, which directly reflects the main functions and core logic of the audio processing algorithm. In the field of audio processing technology, the code module usually involves complex mathematical operations, signal processing knowledge and algorithm steps, so as to achieve processing effects such as filtering, volume adjustment, delay, etc. on the input audio data to be processed.

[0039] Exemplarily, the various audio processing algorithms may include a gain algorithm, a volume algorithm, a mute algorithm, a mixing algorithm, a filtering algorithm, a delay algorithm, a limiting algorithm, etc., which is not limited in the embodiments of the present application.

[0040] S220. Partition the multiple audio processing algorithms based on their respective code modules to obtain at least one working area, so that each working area has at least one group of audio processing algorithms containing the same code module, and each group of audio processing algorithms includes multiple audio processing algorithms.

[0041] It should be noted that, when the number of working areas includes multiple, the multiple working areas can be connected in sequence. Further, different working areas can contain the same audio processing algorithm or different audio processing algorithms, which is not limited in the embodiment of the present application.

[0042] It should also be noted that the same code module refers to a basic code segment with the same or similar functions in a variety of audio processing algorithms.

[0043] Exemplarily, taking the gain algorithm, volume algorithm and mute algorithm as examples, although the functions of the three audio processing algorithms are different, the three audio processing algorithms contain the same code module, so the three audio processing algorithms can be divided into a group in a working area.

[0044] It can be understood that, in addition to at least one group of audio processing algorithms of the same code module, each working area may also contain at least one audio processing algorithm of a different code module, or may not contain any audio processing algorithm of a different code module, and the embodiments of the present application are not limited to this.

[0045] In some embodiments, partitioning multiple audio processing algorithms to obtain at least one working area may include: dividing multiple audio processing algorithms containing the same code module into one working area to obtain at least one working area; or dividing multiple audio processing algorithms included in each processing stage of the audio data to be processed into one working area to obtain at least one working area.

[0046] Among them, each processing stage of the audio data to be processed may include: at least one of: the pre-processing stage, encoding stage, decoding stage, and post-processing stage of the audio data to be processed; or at least one of the time domain processing stage, frequency domain processing stage, and time-frequency domain joint processing stage of the audio data to be processed.

[0047] It should be noted that the above scheme divides the processing stages of the audio data to be processed according to the audio processing flow and the characteristics of the audio data to be processed in the time domain and the frequency domain. It can be understood that in addition to the above division method, the processing stages of the audio data to be processed can also be divided in other ways, and the embodiments of the present application are not limited to this.

[0048] It should also be noted that, in addition to the above two partitioning methods, various audio processing algorithms can also be partitioned in other ways, which is not limited in the embodiments of the present application.

[0049] It can be understood that by dividing multiple audio processing algorithms containing the same code module into a working area, all audio processing algorithms in each working area can contain the same core code; and by dividing the multiple audio processing algorithms contained in each processing stage of the audio data to be processed into a working area, all audio processing algorithms in a working area may contain only the same core code or may contain different core codes, and the embodiments of the present application are not limited to this.

[0050] Through this method, by dividing a plurality of audio processing algorithms into at least one working area, the at least one working area is subsequently used to perform audio processing on the audio data to be processed, thereby significantly improving the efficiency of audio data processing.

[0051] For example, Figure 3 FIG. 1 is a schematic diagram of partitioning multiple audio processing algorithms provided by an embodiment of the present application. Figure 3 As shown, the audio processing algorithm 1.1, the audio processing algorithm 1.2 and the audio processing algorithm 1.3 can be divided into a working area 1, wherein the audio processing algorithm 1.1, the audio processing algorithm 1.2 and the audio processing algorithm 1.3 contain the same code module; the audio processing algorithm 2.1, the audio processing algorithm 2.2 and the audio processing algorithm 3 can be divided into a working area 2, wherein the audio processing algorithm 2.1 and the audio processing algorithm 2.2 contain the same code module; the working area 1 and the working area 2 are connected in sequence.

[0052] S230: In each working area, multiple audio processing algorithms in each group of audio processing algorithms are combined to obtain at least one target audio processing algorithm.

[0053] It should be noted that, in a working area, the types of target audio processing algorithms are the same as the number of groups of audio processing algorithms, that is, multiple audio processing algorithms in a group of audio processing algorithms can be combined into one target audio processing algorithm.

[0054] For example, Figure 3 As shown, the audio processing algorithm 1.1, the audio processing algorithm 1.2 and the audio processing algorithm 1.3 in the working area 1 can be merged to obtain the audio processing algorithm 1; the audio processing algorithm 2.1 and the audio processing algorithm 2.2 in the working area 2 can be merged to obtain the audio processing algorithm 2.

[0055] S240, obtaining audio data to be processed, inputting the audio data to be processed into at least one working area, and performing audio processing on the audio data to be processed by at least one target audio processing algorithm in each working area to obtain target audio data.

[0056] It should be noted that if a working area contains other audio processing algorithms in addition to at least one target audio processing algorithm, the at least one target audio processing algorithm and other audio processing algorithms in the working area can be used to perform audio processing on the audio data to be processed to obtain target audio data.

[0057] In some embodiments, the number of working areas includes multiple; performing audio processing on the audio data to be processed through at least one target audio processing algorithm in each working area can include: inputting the data to be processed into the first working area, performing audio processing on the audio data to be processed through at least one target audio processing algorithm in the first working area, and obtaining first initial target audio data; inputting the first initial target audio data into the second working area, performing audio processing on the first initial target audio data through at least one target audio processing algorithm in the second working area, and obtaining second initial target audio data, ..., and so on, until all working areas are processed and the target audio data is obtained.

[0058] For example, Figure 3 As shown, the audio data to be processed can be input into the working area 1, and the audio processing algorithm 1 is used to perform audio processing on the audio data to obtain the initial target audio data; then the initial target audio data is input into the working area 2, and the audio processing algorithm 2 and the audio processing algorithm 3 are used to perform audio processing on the initial target audio data to obtain the target audio data.

[0059] Through this method, compared with the related art of performing audio processing on the audio data by connecting multiple audio processing algorithms in series, audio processing is performed on the audio data by merging at least one target audio processing algorithm in each working area, which can reduce the computing power of multiple audio processing algorithms and improve the processing efficiency of audio data.

[0060] In some embodiments, the audio data to be processed is input into at least one working area, and audio processing is performed on the audio data to be processed through at least one target audio processing algorithm in each working area to obtain target audio data, which may include: if the data volume of the audio data to be processed is greater than the data volume threshold, slicing the audio data to be processed to obtain N audio data slices to be processed, where N is an integer greater than 1; the i-th audio data slice to be processed is input into at least one working area, and audio processing is performed on the i-th audio data slice to be processed through at least one target audio processing algorithm in each working area, where i is a positive integer less than or equal to N, and the initial value of i is 1; let i=i+1, repeat the above steps until i is equal to N, and obtain N target audio data slices; merge the N target audio data slices to obtain target audio data.

[0061] It should be noted that the data volume threshold can be set manually or by other means, and the embodiments of the present application are not limited to this.

[0062] For example, Figure 4 FIG. 1 is a schematic diagram of performing audio processing on multiple audio data segments to be processed provided by an embodiment of the present application. Figure 4 As shown, assuming that N is equal to 2, the first audio data slice to be processed can be input into working area 1, and the first audio data slice to be processed can be processed by audio processing algorithm 1 to obtain the first initial target audio data slice; the first initial target audio data slice can be input into working area 2, and the first initial target audio data slice can be processed by audio processing algorithm 2 and audio processing algorithm 3 to obtain the first target audio data slice. The second audio data slice to be processed can be processed similarly to the first audio data slice to obtain the second target audio data slice. The first target audio data slice and the second target audio data slice are merged to obtain the target audio data.

[0063] By this method, a large piece of audio data to be processed is cut into N suitable audio data slices to be processed, and the N audio data slices to be processed can be processed in sequence using audio processing algorithms in different working areas, thereby reducing the frequent switching of audio data to be processed, increasing the cache hit rate, and reducing the computing power consumption of multiple audio processing algorithms. For example, for a DSP with limited L1 / L2 cache, when performing audio processing on multiple audio data slices to be processed, the effect of increasing the cache hit rate is more significant.

[0064] It can be understood that in each working area, if at least one target audio processing algorithm is used each time to calculate the audio data to be processed, a lot of redundant audio data may be processed, thereby increasing the total amount of audio data processing and increasing the computing power of the target audio processing algorithm.

[0065] Based on this, in some embodiments, the audio data to be processed is input into at least one working area, and audio processing is performed on the audio data to be processed through at least one target audio processing algorithm in each working area to obtain target audio data, which may include: parsing the audio data to be processed to obtain attribute information of the audio data to be processed; inputting the audio data to be processed into at least one working area, and in each working area, optimizing at least one target audio processing algorithm based on the attribute information of the audio data to be processed to obtain at least one optimized target audio processing algorithm; audio processing is performed on the audio data to be processed through at least one optimized target audio processing algorithm in each working area to obtain target audio data.

[0066] The attribute information of the audio data to be processed includes at least one of the sound effect, sampling rate, sampling bit number, number of channels, encoding format, bit rate, and audio format of the audio data to be processed.

[0067] Furthermore, optimizing at least one target audio processing algorithm to obtain at least one optimized target audio processing algorithm may include: precision calibrating at least one target audio processing algorithm to obtain at least one precision calibrated target audio processing algorithm; and / or, if there are multiple types of target audio processing algorithms, screening the multiple target audio processing algorithms to obtain at least one screened target audio processing algorithm.

[0068] Exemplarily, when the sampling rate of the audio data to be processed is high, the accuracy of at least one target audio processing algorithm can be improved; when the sampling rate of the audio data to be processed is low, the accuracy of at least one target audio processing algorithm can be reduced.

[0069] Exemplarily, when the sampling bit number of the audio data to be processed is high, the accuracy of at least one target audio processing algorithm can be improved; when the sampling bit number of the audio data to be processed is low, the accuracy of at least one target audio processing algorithm can be reduced.

[0070] Exemplarily, when the sound effect of the audio data to be processed includes silence, and the multiple target audio processing algorithms include a silence algorithm, the silence algorithm can be removed from the multiple target audio processing algorithms to obtain at least one filtered target audio processing algorithm.

[0071] Through this method, by using the attribute information of the audio data to be processed, at least one target audio processing algorithm is optimized, so that at least one optimized target audio processing algorithm can be more matched with the audio data to be processed, thereby reducing the total amount of audio data processing and reducing the computing power of the optimized target audio processing algorithm, avoiding audio stuttering caused by insufficient chip computing power.

[0072] For example, Figure 5 Schematic diagram of a related technology provided by the embodiment of the present application and the computing power used by the present solution for audio data processing. Figure 5 As shown, on a certain DSP chip, the computing power used by the related technology using multiple audio processing algorithms to process the audio data to be processed is compared with the computing power used by the present solution using at least one target audio processing algorithm in each working area to process the audio data to be processed. It can be seen that the present solution can save about 1 / 4 of the computing power compared with the related technology. It can be understood that the present solution can significantly improve the processing efficiency of audio data while maintaining high sound quality, save computing power, and enhance system stability by dividing the working areas of multiple audio processing algorithms, slicing the audio data to be processed, and calibrating and / or screening the target audio processing algorithm.

[0073] The preferred embodiments of the present application are described in detail above in conjunction with the accompanying drawings. However, the present application is not limited to the specific details in the above embodiments. Within the technical concept of the present application, the technical solution of the present application can be subjected to a variety of simple modifications, and these simple modifications all belong to the protection scope of the present application. For example, the various specific technical features described in the above specific embodiments can be combined in any suitable manner without contradiction. In order to avoid unnecessary repetition, the present application will not further explain various possible combinations. For another example, the various different embodiments of the present application can also be arbitrarily combined, as long as they do not violate the idea of ​​the present application, they should also be regarded as the contents disclosed in the present application. For another example, the various embodiments and / or the technical features in the various embodiments described in the present application can be arbitrarily combined with the relevant technologies within the scope of the technical concept of the present application, and the technical solution obtained after the combination should also fall within the protection scope of the present application.

[0074] It should also be understood that in the various method embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0075] Based on the same inventive concept as the above embodiments, Figure 6 is a schematic diagram of the structure of an audio data processing device provided in an embodiment of the present application, such as Figure 6 As shown, the audio data processing device 600 may include an acquisition module 610, a division module 620, a merging module 630, and a processing module 640, wherein:

[0076] An acquisition module 610 is used to acquire code modules and audio data to be processed of respective audio processing algorithms;

[0077] A partitioning module 620, configured to partition the multiple audio processing algorithms based on their respective code modules to obtain at least one working area, so that each working area has at least one group of audio processing algorithms containing the same code module, and each group of audio processing algorithms includes multiple audio processing algorithms;

[0078] A merging module 630, configured to merge multiple audio processing algorithms in each group of audio processing algorithms in each working area to obtain at least one target audio processing algorithm;

[0079] The processing module 640 is used to input the audio data to be processed into at least one working area, and perform audio processing on the audio data to be processed through at least one target audio processing algorithm in each working area to obtain target audio data.

[0080] In some embodiments, the division module 620 is also used to divide multiple audio processing algorithms containing the same code module into a working area to obtain at least one working area; or, to divide multiple audio processing algorithms contained in each processing stage of the audio data to be processed into a working area to obtain at least one working area.

[0081] In some embodiments, each processing stage of the audio data to be processed includes: at least one of the pre-processing stage, encoding stage, decoding stage, and post-processing stage of the audio data to be processed; or, at least one of the time domain processing stage, frequency domain processing stage, and time-frequency domain joint processing stage of the audio data to be processed.

[0082] In some embodiments, the processing module 640 is also used to slice the audio data to be processed if the data volume of the audio data to be processed is greater than the data volume threshold, to obtain N audio data slices to be processed, where N is an integer greater than 1; input the i-th audio data slice to be processed into at least one working area, and perform audio processing on the i-th audio data slice to be processed through at least one target audio processing algorithm in each working area, where i is a positive integer less than or equal to N, and the initial value of i is 1; let i=i+1, repeat the above steps until i is equal to N, to obtain N target audio data slices; the merging module 630 is also used to merge the N target audio data slices to obtain target audio data.

[0083] In some embodiments, Figure 6 As shown, the audio data processing device 600 may further include a parsing module 650, wherein:

[0084] The parsing module 650 is used to parse the audio data to be processed to obtain attribute information of the audio data to be processed;

[0085] The processing module 640 is also used to input the audio data to be processed into at least one working area. In each working area, based on the attribute information of the audio data to be processed, at least one target audio processing algorithm is optimized to obtain at least one optimized target audio processing algorithm; audio processing is performed on the audio data to be processed through at least one optimized target audio processing algorithm in each working area to obtain target audio data.

[0086] In some embodiments, Figure 6 As shown, the audio data processing device 600 may further include a calibration module 660 and a screening module 670, wherein:

[0087] A calibration module 660 is used to perform precision calibration on at least one target audio processing algorithm to obtain at least one target audio processing algorithm after precision calibration; and / or,

[0088] The screening module 670 is used to screen the target audio processing algorithms if there are multiple types of the target audio processing algorithms, and obtain at least one screened target audio processing algorithm.

[0089] In some embodiments, the attribute information of the audio data to be processed includes at least one of the sound effect, sampling rate, sampling bit number, number of channels, encoding format, bit rate, and audio format of the audio data to be processed.

[0090] In the scheme of the embodiment of the present application, multiple audio processing algorithms are partitioned so that there is at least one group of audio processing algorithms containing the same code module in each working area, and in each working area, multiple audio processing algorithms in each group of audio processing algorithms are merged, and at least one of the merged target audio processing algorithms is used to perform audio processing on the audio data to be processed. This allows the processing of audio data to maintain high sound quality while avoiding the repeated execution of multiple audio processing algorithms with the same code module, thereby reducing computational redundancy and significantly improving the processing efficiency of audio data.

[0091] Those skilled in the art should understand that the relevant description of the above-mentioned audio data processing device in the embodiment of the present application can be understood by referring to the relevant description of the audio data processing method in the embodiment of the present application.

[0092] Figure 7 It is a structural diagram of an electronic device provided in an embodiment of the present application. The electronic device 700 may include: a processor (Processor) 710, a communication interface (Communications Interface) 720, a memory (Memory) 730 storing a program 750, and a communication bus 740.

[0093] The processor 710 , the communication interface 720 , and the memory 730 communicate with each other via the communication bus 740 .

[0094] The communication interface 720 is used to communicate with other electronic devices or servers.

[0095] The processor 710 is used to execute the program 750, and specifically can execute the relevant steps in the above method embodiment.

[0096] Specifically, the program 750 may include program code, which includes one or more executable computer operation instructions.

[0097] The processor 710 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; or may be processors of different types, such as one or more CPUs and one or more ASICs.

[0098] The memory 730 is used to store one or more executable instructions. The memory 730 may include a high-speed random access memory (RAM), and may also include a non-volatile memory (Non-Volatile Memory), such as one or more disk memories.

[0099] One or more executable instructions may be specifically used to enable the processor 710 to execute the method provided in the embodiment of the present application.

[0100] In addition, the specific implementation of each step in one or more executable instructions can refer to the corresponding description of the corresponding steps and units in the above method embodiments, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above method embodiments, which will not be repeated here.

[0101] An embodiment of the present application also provides a computer-readable storage medium for storing a computer program.

[0102] In some embodiments, the computer-readable storage medium can be applied to the electronic device in the embodiments of the present application, and when the computer program is executed by one or more processors, it implements the corresponding processes implemented by the electronic device in the various methods of the embodiments of the present application. For the sake of brevity, they are not repeated here.

[0103] An embodiment of the present application also provides a computer program product, including computer program instructions.

[0104] In some embodiments, the computer program product can be applied to the electronic device in the embodiments of the present application, and the computer program instructions enable the computer to execute the corresponding processes implemented by the electronic device in the various methods of the embodiments of the present application. For the sake of brevity, they will not be repeated here.

[0105] The embodiment of the present application also provides a computer program.

[0106] In some embodiments, the computer program can be applied to the electronic devices in the embodiments of the present application. When the computer program runs on a computer, the computer executes the corresponding processes implemented by the electronic devices in the various methods of the embodiments of the present application. For the sake of brevity, they will not be repeated here.

[0107] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of this application.

[0108] It should be noted that, in this application, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0109] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0110] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0111] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0112] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0113] The above implementation methods are only used to illustrate the embodiments of the present application, and are not limitations on the embodiments of the present application. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present application. The scope of patent protection of the embodiments of the present application should be limited by the claims.

Claims

1. An audio data processing method, characterized in that: include: Obtain the code modules and audio data to be processed of various audio processing algorithms; Based on the code modules of the multiple audio processing algorithms, the multiple audio processing algorithms are partitioned to obtain at least one working area, so that each working area has at least one group of the audio processing algorithms containing the same code module, and each group of the audio processing algorithms includes the multiple audio processing algorithms; In each of the working areas, the multiple audio processing algorithms in each group of the audio processing algorithms are combined to obtain at least one target audio processing algorithm; The audio data to be processed is input into the at least one working area, and the audio data to be processed is audio-processed by the at least one target audio processing algorithm in each working area to obtain target audio data.

2. The method according to claim 1, characterized in that Partitioning the multiple audio processing algorithms to obtain at least one working area includes: Dividing the plurality of audio processing algorithms containing the same code module into a working area to obtain the at least one working area; or, The multiple audio processing algorithms included in each processing stage of the audio data to be processed are divided into a working area to obtain the at least one working area.

3. The method according to claim 2, characterized in that Each processing stage of the audio data to be processed includes: At least one of the pre-processing stage, encoding stage, decoding stage, and post-processing stage of the audio data to be processed; or at least one of the time domain processing stage, frequency domain processing stage, and time-frequency domain joint processing stage of the audio data to be processed.

4. The method according to any one of claims 1 to 3, characterized in that The step of inputting the audio data to be processed into the at least one working area, and performing audio processing on the audio data to be processed by the at least one target audio processing algorithm in each working area to obtain the target audio data comprises: If the data volume of the audio data to be processed is greater than the data volume threshold, slicing the audio data to be processed to obtain N audio data slices to be processed, where N is an integer greater than 1; Inputting the i-th audio data slice to be processed into the at least one working area, and performing audio processing on the i-th audio data slice to be processed by the at least one target audio processing algorithm in each working area, where i is a positive integer less than or equal to N, and an initial value of i is 1; Let i=i+1, repeat the above steps until i equals N, and obtain N target audio data fragments; Merge N target audio data slices to obtain the target audio data.

5. The method according to claim 1, characterized in that The step of inputting the audio data to be processed into the at least one working area, and performing audio processing on the audio data to be processed by the at least one target audio processing algorithm in each working area to obtain target audio data includes: Parsing the audio data to be processed to obtain attribute information of the audio data to be processed; Inputting the audio data to be processed into the at least one working area, and optimizing the at least one target audio processing algorithm in each working area based on the attribute information of the audio data to be processed to obtain at least one optimized target audio processing algorithm; The audio data to be processed is audio-processed by using the at least one optimized target audio processing algorithm in each of the working areas to obtain the target audio data.

6. The method according to claim 5, characterized in that The step of optimizing the at least one target audio processing algorithm to obtain at least one optimized target audio processing algorithm includes: performing precision calibration on the at least one target audio processing algorithm to obtain at least one target audio processing algorithm after precision calibration; and / or, If the target audio processing algorithms include multiple types, the multiple target audio processing algorithms are screened to obtain at least one screened target audio processing algorithm.

7. The method according to claim 5 or 6, characterized in that: The attribute information of the audio data to be processed includes at least one of the sound effect, sampling rate, sampling bit number, number of channels, encoding format, bit rate, and audio format of the audio data to be processed.

8. An audio data processing device, characterized in that: include: An acquisition module is used to acquire the code modules and the audio data to be processed of the respective multiple audio processing algorithms; a partitioning module, configured to partition the plurality of audio processing algorithms based on the respective code modules of the plurality of audio processing algorithms to obtain at least one working area, so that each working area has at least one group of the audio processing algorithms containing the same code module, and each group of the audio processing algorithms includes the plurality of audio processing algorithms; A merging module, configured to merge the multiple audio processing algorithms in each group of the audio processing algorithms in each of the working areas to obtain at least one target audio processing algorithm; The processing module is used to input the audio data to be processed into the at least one working area, and perform audio processing on the audio data to be processed through the at least one target audio processing algorithm in each working area to obtain target audio data.

9. An electronic device, characterized in that: include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store one or more executable instructions, and the executable instructions enable the processor to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer storage medium stores a computer program, and when the computer program is executed by one or more processors, the method according to any one of claims 1 to 7 is implemented.

Images