Method and device for determining audio signal processing flow, electronic equipment and medium

Abstract

The invention provides an audio signal processing flow determination method and device, electronic equipment and a medium. The method comprises: in response to an algorithm module selection instruction, obtaining a plurality of target algorithm modules from a plurality of algorithm modules, different algorithm modules being used for performing different types of signal processing on an input audio signal; in response to an algorithm module organization instruction, organizing the plurality of target algorithm modules to obtain a signal link, the signal link being used for indicating an I / O relationship of the plurality of target algorithm modules; according to the signal link, the audio signal processing flow is determined, and the audio signal processing flow is used for indicating the sequence in which the target algorithm modules execute audio signal processing.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of signal processing technology, and in particular, to a method, device, electronic device and medium for determining an audio signal processing flow. Background Art

[0002] When processing audio signals, different audio signal processing algorithms are often used to form an audio signal processing flow to process the audio signals to obtain different audio signal processing results in order to adapt to the needs of the corresponding hardware environment (for example, two different vehicle environments, or a vehicle environment and an indoor environment, etc., generally different algorithms are required to process the same audio signal).

[0003] In the prior art, when performing audio signal processing, a fixed audio signal processing flow in the audio signal processing software is often used, that is, the existing audio signal processing software provides multiple algorithm modules in a fixed order, and the user can only adjust whether each algorithm module is used in audio signal processing through a preset switch. If used, the audio signal enters the algorithm module and is processed by the algorithm module before being output; if not used, the audio signal enters the algorithm module and is directly output without being processed by the algorithm module. However, this fixed audio signal processing flow can only use each algorithm module to process the audio signal in a fixed order, and the processing order of each algorithm module in the audio signal processing flow cannot be adjusted, which makes the flexibility of the audio signal processing flow poor. Summary of the invention

[0004] In view of this, embodiments of the present application provide a method, device, electronic device, and medium for determining an audio signal processing flow.

[0005] According to one aspect of an embodiment of the present application, a method for determining an audio signal processing flow is provided, comprising:

[0006] In response to the algorithm module selection instruction, a plurality of target algorithm modules are obtained from the plurality of algorithm modules, wherein different algorithm modules are used to perform different types of signal processing on the input audio signal;

[0007] In response to the algorithm module organization instruction, the plurality of target algorithm modules are organized to obtain a signal link, wherein the signal link is used to indicate an I / O relationship of the plurality of target algorithm modules;

[0008] The audio signal processing flow is determined according to the signal chain, wherein the audio signal processing flow is used to indicate the order in which each of the target algorithm modules performs audio signal processing.

[0009] In some optional embodiments, in response to an algorithm module selection instruction, multiple target algorithm modules are obtained from multiple algorithm modules, and then the method further includes: in response to an algorithm module configuration instruction, configuring the channel configuration information and parameter configuration information of the multiple target algorithm modules.

[0010] In some optional embodiments, the method further includes: applying for a memory for performing audio signal processing through the audio signal processing flow according to each target algorithm module and the channel configuration information and parameter configuration information configured by each target algorithm module.

[0011] In some optional embodiments, determining the audio signal processing flow according to the signal chain includes: storing the signal chain in the form of a first processing chain list, generating a second processing chain list in the form of a one-way chain list according to the first processing chain list, and determining the audio signal processing flow according to the second processing chain list.

[0012] In some optional embodiments, at least two target algorithm modules among the multiple target algorithm modules are the same algorithm modules.

[0013] In some optional embodiments, the type of the algorithm module includes: at least one of a first algorithm module, a second algorithm module, a third algorithm module and a fourth algorithm module; wherein,

[0014] The first algorithm module is used to process the single-channel audio signal into a single-channel audio signal different from the single-channel signal;

[0015] The second algorithm module is used to process a single-channel audio signal into a multi-channel audio signal;

[0016] The third algorithm module is used to process the multi-channel audio signals into a single-channel audio signal;

[0017] The fourth algorithm module is used to process the P1 channel audio signal into the P2 channel audio signal, 2≤P1<P2, and P1 and P2 are both integers;

[0018] The fifth algorithm module is used to process the Q1-channel audio signal into the Q2-channel audio signal, 2≤Q2<Q1, and Q1 and Q2 are both integers;

[0019] The sixth algorithm module is used to process the S-channel audio signal into S-channel audio signals different from the S-channel audio signal, where S≥2 and S is an integer.

[0020] According to another aspect of the embodiment of the present application, a device for determining an audio signal processing flow is provided, including:

[0021] an acquisition unit, configured to acquire a plurality of target algorithm modules from a plurality of algorithm modules in response to an algorithm module selection instruction, wherein different algorithm modules are used to perform different types of signal processing on an input audio signal;

[0022] An organizing unit, configured to organize the plurality of target algorithm modules in response to an algorithm module organizing instruction, and obtain a signal link, wherein the signal link is used to indicate an I / O relationship of the plurality of target algorithm modules;

[0023] A determination unit is used to determine the audio signal processing flow according to the signal chain, wherein the audio signal processing flow is used to indicate the order in which each of the target algorithm modules performs audio signal processing.

[0024] According to another aspect of the embodiments of the present application, an electronic device is provided, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; the memory is used to store a computer program, and the computer program enables the processor to execute the signal processing flow determination method as described in any of the preceding items.

[0025] According to another aspect of the embodiments of the present application, a computer storage medium is provided, wherein the computer storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the signal processing flow determination method according to any of the above items.

[0026] According to another aspect of the embodiments of the present application, a computer program product is provided, which includes a computer program, wherein the computer program implements any of the above signal processing flow determination methods when executed by a processor.

[0027] In the technical solution of the present application, the audio signal is no longer processed by relying on a fixed audio signal processing flow in the signal processing software. Instead, when determining the audio signal processing flow, it can respond to an algorithm module selection instruction to obtain multiple target algorithm modules from multiple algorithm modules, and then respond to an algorithm module organization instruction to organize the multiple target algorithm modules to obtain a signal link indicating the I / O relationship of the multiple target algorithm modules, and then determine the audio signal processing flow for indicating the order in which each target algorithm module performs audio signal processing based on the signal link. This makes the way in which the technical solution of this embodiment determines the audio signal processing flow more flexible, better able to meet the needs of audio signal processing, and improves the compatibility of the audio signal processing flow for different application scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0029] Figure 1 A flowchart of a method for determining an exemplary audio signal processing flow according to the present application is shown.

[0030] Figure 2 An optional schematic diagram of multiple algorithm modules in the present application is shown.

[0031] Figure 3 An optional schematic diagram of a signal chain according to the present application is shown.

[0032] Figure 4 Shown according to Figure 3 An optional audio signal processing flow determined by the signal chain in FIG.

[0033] Figure 5 A block diagram of an exemplary apparatus for determining an audio signal processing flow according to the present application is shown.

[0034] Figure 6 A block diagram of an exemplary electronic device according to the present application is shown. DETAILED DESCRIPTION

[0035] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the embodiments of the present application should fall within the scope of protection of the embodiments of the present application.

[0036] According to a first aspect of the present application, a method for determining a signal processing flow is provided. Figure 1 A flowchart of a method for determining an exemplary audio signal processing flow according to the present application is shown. Figure 1 As shown, the method for determining the audio signal processing flow includes the following steps S102, S104 and S106, specifically:

[0037] Step S102: in response to the algorithm module selection instruction, a plurality of target algorithm modules are obtained from a plurality of algorithm modules, wherein different algorithm modules are used to perform different types of signal processing on the input audio signal.

[0038] Step S104: In response to the algorithm module organization instruction, the multiple target algorithm modules are organized to obtain a signal link, wherein the signal link is used to indicate the I / O relationship of the multiple target algorithm modules.

[0039] Step S106: determining the audio signal processing flow according to the signal chain, wherein the audio signal processing flow is used to indicate the order in which each of the target algorithm modules performs audio signal processing.

[0040] In the technical solution of the present application, the audio signal is no longer processed by relying on a fixed audio signal processing flow in the signal processing software. Instead, when determining the audio signal processing flow, it can respond to an algorithm module selection instruction to obtain multiple target algorithm modules from multiple algorithm modules, and then respond to an algorithm module organization instruction to organize the multiple target algorithm modules to obtain a signal link indicating the I / O relationship of the multiple target algorithm modules, and then determine the audio signal processing flow for indicating the order in which each target algorithm module performs audio signal processing based on the signal link. This makes the way in which the technical solution of this embodiment determines the audio signal processing flow more flexible, better able to meet the needs of audio signal processing, and improves the compatibility of the audio signal processing flow for different application scenarios.

[0041] The following is a detailed description of the method for determining the audio signal processing flow in the present application. It should be understood that the following description does not constitute any limitation on the embodiments of the present application.

[0042] The method for determining the audio signal processing flow of the present application can be executed by a device for determining the audio signal processing flow, and the device for determining the audio signal processing flow may include one or more processing units, and the processing unit may include at least one chip for data processing, such as a CPU, GPU, MCU, DSP, FPGA, etc.

[0043] In the present application, the algorithm module can be used to perform signal processing on the audio signal input to the algorithm module, that is, the algorithm module is an audio signal processing algorithm module, and different algorithm modules are used to perform different types of signal processing on the input audio signal. Optionally, multiple algorithm modules in the present application can be included in an algorithm module library or an algorithm module list.

[0044] Through the audio signal processing flow determined in this solution, the audio signal obtained from the audio signal source can be processed into an audio signal that meets the needs, thereby adapting to the needs of different hardware environments. In the present application, the audio signal source can be hardware or software. For example, the audio signal to be processed can come from one or more microphones (that is, the audio signal source can be hardware), which is collected by the microphone and then passed into the audio signal processing flow for further processing; for another example, the audio signal to be processed can be an audio file obtained from one or more audio software (that is, the audio signal source can be software). Optionally, the audio signal to be processed can also be uploaded by the user. Of course, this is just an example and not a limitation of the present application.

[0045] To meet different requirements for processing audio signals, optionally, the type of algorithm module in the present application includes: at least one of a first algorithm module, a second algorithm module, a third algorithm module and a fourth algorithm module.

[0046] The first algorithm module is used to process a single-channel audio signal into a single-channel audio signal different from the single-channel signal. For example, as some examples, the first algorithm module can be used for echo cancellation processing, sound enhancement processing, noise reduction processing, filtering processing, etc. of a single-channel audio signal in a certain channel. Of course, the specific processing performed in the first algorithm module is not limited here.

[0047] The second algorithm module is used to process a single-channel audio signal into multiple-channel audio signals. For example, as some examples, in one example, a single-channel audio signal may be split into two-channel audio signals, and in another example, a single-channel audio signal may be split into four-channel audio signals; and so on. Of course, the specific processing performed in the second algorithm module is not limited here.

[0048] The third algorithm module is used to process multiple audio signals into a single audio signal. For example, in one example, two audio signals may be combined into a single audio signal, and in another example, four audio signals may be combined into a single audio signal, etc. Of course, the specific processing performed in the third algorithm module is not limited here.

[0049] The fourth algorithm module is used to process P1 audio signals into P2 audio signals, 2≤P1<P2 and P1 and P2 are both integers. Specifically, the fourth algorithm module can process multiple audio signals to obtain more audio signals. For example, as some examples, in one example, 2 audio signals can be processed into 4 audio signals, and in another example, 2 audio signals can be processed into 3 audio signals, etc. Of course, the specific processing performed in the fourth algorithm module is not limited here.

[0050] The fifth algorithm module is used to process Q1-channel audio signals into Q2-channel audio signals, 2≤Q2<Q1, and Q1 and Q2 are both integers. Specifically, the fifth algorithm module can process multiple audio signals to obtain fewer multiple audio signals. For example, as some examples, in one example, 4-channel audio signals can be processed into 2-channel audio signals, in another example, 3-channel audio signals can be processed into 2-channel audio signals, and so on. Of course, the specific processing performed in the fifth algorithm module is not limited here.

[0051] The sixth algorithm module is used to process S audio signals into S audio signals different from the S audio signals, where S≥2 and S is an integer. Specifically, the sixth algorithm module can process multiple audio signals to obtain the same number of multiple audio signals. For example, as some examples, in one example, 2 audio signals can be processed into 2 audio signals, and in another example, 4 audio signals can be processed into 4 audio signals, etc. Of course, the specific processing performed in the sixth algorithm module is not limited here.

[0052] In this application, the above-mentioned various types of algorithm modules can meet various requirements of audio signal processing. By selecting multiple target algorithm modules and organizing the multiple target algorithm modules, the audio signal processing flow can be effectively determined to realize signal processing of the audio signal.

[0053] Optionally, an embodiment of the present application can be implemented based on an audio signal processing software, which may include an algorithm module list and an editing interface, the algorithm module list including multiple algorithm modules, and a user can select multiple target algorithm modules from the multiple algorithm modules in the algorithm module list (that is, the user enters an algorithm module selection instruction), and based on the user's selection, obtain the corresponding multiple target algorithm modules from the multiple algorithm modules in the algorithm module list.

[0054] The specific implementation of step S102 is not limited in the present application. Optionally, the algorithm module selection instruction may include a drag operation instruction for a user to drag multiple target algorithm modules to a workspace in an editing interface, that is, step S102 may include: in response to a drag operation instruction for a user to drag multiple target algorithm modules from multiple algorithm modules to a workspace in an editing interface, to obtain multiple target algorithm modules from multiple algorithm modules. Based on this, it is convenient for the user to select the target algorithm modules required in the audio signal processing flow as needed, realize the custom editing of the audio signal processing flow, make the method of determining the audio signal processing flow in this embodiment more flexible, meet the needs of audio signal processing, and improve the compatibility of the audio signal processing flow for different application scenarios.

[0055] Optionally, the algorithm module can be embodied as a block style in the editing interface (can be combined with Figure 2 understand) to facilitate users to drag and drop and subsequent connection, configuration, and editing operations.

[0056] Reference Figure 2 As shown, a schematic diagram of each algorithm module (denoted as md) in the editing interface is shown, which are algorithm modules md1, md2, ..., mdn, etc. Optionally, the algorithm modules in the algorithm module list of the editing interface are not repeated. Optionally, each algorithm module can be reused. For example, if the algorithm module md4 in the algorithm module list is dragged into the workspace, the algorithm module md4 in the algorithm module list will not disappear. The algorithm module md4 in the algorithm module list can also be dragged into the workspace again, so that there are multiple algorithm modules md4 in the workspace (that is, the multiple algorithm modules md4 dragged down are all target algorithm modules), and then the multiple algorithm modules md4 can be configured in the workspace. For example, refer to Figure 3 The signal chain shown has multiple algorithm modules md4 (i.e., target algorithm modules). The situation of the remaining algorithm modules can be deduced by analogy, and will not be repeated. It should be understood that such examples are not intended to limit any embodiment of the present application.

[0057] The above optional implementation means that at least two of the multiple target algorithm modules obtained in step S102 are the same algorithm modules. Based on this, the reuse of the same algorithm module can be achieved, the flexibility in determining the audio signal processing flow in this application is improved, and the requirements of audio signal processing are met.

[0058] Of course, in other embodiments, the multiple target algorithm modules obtained in step S102 may all be different algorithm modules, depending on the requirements of audio signal processing, and are not specifically limited here.

[0059] Optionally, after step S102, the method for determining the audio signal processing flow of the present application further includes: in response to the algorithm module configuration instruction, configuring the channel configuration information and parameter configuration information of the multiple target algorithm modules. In the present application, by configuring the channel configuration information and parameter configuration information of the multiple target algorithm modules, the target algorithm module in the subsequently determined audio signal processing flow can realize the required audio signal processing function according to the channel configuration and parameter configuration, and adapt to the requirements of different hardware environments.

[0060] Specifically, the channel configuration information can be used to indicate the channel used by the target algorithm module when processing the audio signal. In the present application, the channel used in the audio signal processing process is determined according to needs. For example, if 4 audio signals are obtained through the audio signal processing process, and they need to be output from 4 speakers (such as loudspeakers) respectively, then the number of required channels is 4, so the channel configuration information of each target algorithm module can be configured to customize which channel the audio signal processed by the target algorithm module is transmitted from. The parameter configuration information can be used to indicate the parameters used by the target algorithm module when processing the audio signal. For example, if the maximum number of parameters of a certain target algorithm module is 100 (denoted as a1, a2, ..., a100), the parameter configuration information may include configuration information for configuring 10 of the parameters (such as a1, a2, ..., a10).

[0061] After obtaining multiple target algorithm modules in step S102, in step S104, the multiple target algorithm modules can be organized in response to the algorithm module organization instruction to obtain a signal link, which is used to indicate the I / O relationship of the multiple target algorithm modules. The I / O relationship of the multiple target algorithm modules is the signal input and output relationship of the multiple target algorithm modules.

[0062] The specific implementation of step S104 is not limited in the present application. Optionally, the algorithm module organization instruction may include a connection operation instruction for a user to connect multiple target algorithm modules in an editing interface, that is, step S104 includes: in response to a connection operation instruction for a user to connect multiple target algorithm modules in an editing interface, multiple target algorithm modules are organized to obtain a signal link. Based on this, it is convenient for the user to organize multiple target algorithm modules according to the needs of the audio signal processing flow and obtain a signal link, so as to determine the audio signal processing flow according to the signal link later, so that the method of determining the audio signal processing flow in this embodiment is more flexible and meets the needs of audio signal processing.

[0063] Reference Figure 3 The signal chain shown understands the above optional implementation mode. After obtaining multiple target algorithm modules from multiple algorithm modules in response to the algorithm module selection instruction in step S102, for example, in response to the drag operation instruction of the user to drag multiple target algorithm modules from the multiple algorithm modules to the workspace in the editing interface, multiple target algorithm modules can be obtained from the multiple algorithm modules (for example, at least two of the multiple target algorithm modules obtained can be the same algorithm modules; or, each of the multiple target algorithm modules obtained is a different algorithm module). The user can drag the multiple target algorithm modules to appropriate positions in the workspace, and then use connecting lines (for example) according to the needs of audio signal processing. Figure 3 The connection arrow-style connection line in the figure can use arrows to indicate the flow direction of the audio signal) connects multiple target algorithm modules (the connection operation instruction is the algorithm module organization instruction) to organize the multiple target algorithm modules, and then obtains a signal chain composed of multiple target algorithm modules. The signal chain can indicate the I / O relationship of the multiple target algorithm modules (that is, the signal input and output relationship). The user can configure each target algorithm module in the workspace. The user can first configure the channel used by the target algorithm module to process the audio signal (that is, enter the channel configuration information), and then configure the parameters of each channel (that is, enter the parameter configuration information). For example, refer to Figure 3 As shown, the target algorithm module md2 can split 2 audio signals (each arrow can represent one channel) into 4 audio signals. Then, the target algorithm module md2 configures the 4 channels and configures the parameters used for each of the 4 channels to specify which of the 4 channels the 4 audio signals are output from (refer to Figure 3 As shown, each speaker (spk1, spk2, spk3, spk4) for outputting audio signals corresponds to one channel. Figure 3 The example in can process the two audio signals obtained from the two audio signal sources into four audio signals that meet the requirements, and output them from four speakers (spk1, spk2, spk3, spk4) of four channels respectively); refer to Figure 3 As shown, there are three target algorithm modules md4, which are respectively used for signal processing of audio signals of different channels. The channels used by the three target algorithm modules md4 are configured respectively, and the parameters used for each channel are configured. The channel configuration information and parameter configuration information configured in the three target algorithm modules md4 can be at least partially different to meet the audio processing requirements. It should be understood that the above description is only used to schematically explain the embodiments of the present application and is not intended to limit the present application in any way.

[0064] In the present application, in step S106, the audio signal processing flow can be determined according to the signal link obtained in step S104. The audio signal processing flow is used to indicate the order in which each target algorithm module performs audio signal processing, thereby facilitating the processing of the audio signal according to the audio signal processing flow.

[0065] In this application, Figure 3 The signal chain obtained in the above example can determine the audio signal processing flow for indicating the order in which each target algorithm module performs audio signal processing. It should be noted that when determining the audio signal processing flow to be executed in sequence, the order of the target algorithm modules with cascade dependencies cannot be reversed, and the channel order between the target algorithm modules must be inherited (based on Figure 3Taking the signal chain in as an example, in the audio signal processing flow determined by it, the order of the target algorithm module md5 cannot be before the order of the target algorithm module md2, but can only be after the target algorithm module md2; for 4 channels, in the audio signal processing flow, the order of the target algorithm module md8 cannot be before the target algorithm modules md4, md4, md1, and md6, but can only be after the four of them), ensuring that the audio signals of each channel will not be chaotic.

[0066] For example, for Figure 3 The signal chain obtained by editing in can be obtained Figure 4 The audio signal processing flow (md7→md2→md5→md1→md4→md3→md6→md4→md4→md1→md8) in the audio signal processing flow can indicate the order in which each target algorithm module performs audio signal processing. When the audio signal is processed by the audio signal processing flow, the target algorithm modules md7, md2, md5, md1, md4, md3, md6, md4, md4, md1, and md8 can be sequentially run in the order of the target algorithm modules indicated by the audio signal processing flow to perform audio signal processing, so as to finally obtain 4 audio signals that meet the needs and are output through 4 speakers (spk1, spk2, spk3, and spk4) of 4 channels, which can meet the use requirements. Or in another optional embodiment, according to Figure 3 The audio signal processing flow determined by the signal chain may also be: md7→md2→md5→md1→md4→md4→md3→md4→md1→md6→md8.

[0067] In the embodiments of the present application, it is also noted that in the prior art, when performing audio signal processing, a fixed audio signal processing flow in the audio signal processing software is often used, that is, the existing audio signal processing software provides multiple algorithm modules in a fixed order, and the user can only adjust whether each algorithm module is used in audio signal processing through a preset switch. If used, the audio signal enters the algorithm module and is processed by the algorithm module before being output; if not used, the audio signal enters the algorithm module and is directly output without being processed by the algorithm module. In addition to only being able to use each algorithm module to process the audio signal in a fixed order, it is impossible to adjust the processing order of each algorithm module in the audio signal processing flow, which makes the flexibility of the audio signal processing flow poor. In the prior art, memory can only be applied to the system according to the maximum number of algorithm modules (including all algorithm modules used or not used), the maximum number of channels, and the maximum number of parameters in the audio signal processing flow fixed in the audio signal processing software to prevent insufficient memory resources from occurring in audio signal processing, so as to ensure the integrity of the audio signal processing when the audio signal is processed through the fixed audio signal processing flow, but this is obviously prone to waste of memory resources. In this regard, in some optional embodiments, the method for determining the audio signal processing flow of the embodiment of the present application also includes: applying for memory for performing audio signal processing through the audio signal processing flow according to each target algorithm module and the channel configuration information and parameter configuration information configured by each target algorithm module.

[0068] Based on this, in the present application, according to each target algorithm module and the channel configuration information and parameter configuration information of each target algorithm module configuration, an application for memory used to process the audio signal through the audio signal processing process can be made. This makes the audio signal processing process finally determined in the present scheme only include the target algorithm modules and channel configurations and parameter configurations required for audio signal processing, and does not include unused algorithm modules. There are no unused channel configurations and parameter configurations in the used target algorithm modules. Therefore, when applying for memory from the system when executing the audio signal processing process determined in the embodiment of the present application, it is only necessary to apply for the target algorithm modules actually required for signal processing. The memory for algorithm modules, channels and parameters is used, while the memory for unused algorithm modules, unused channels and unused parameters in used algorithm modules does not need to be applied for. This avoids the situation in the prior art where the system is requested for memory according to the maximum number of algorithm modules (including all algorithm modules used or not used), the maximum number of channels and the maximum number of parameters in a fixed audio signal processing flow. This prevents the occurrence of insufficient memory resources in signal processing, and enables dynamic application of memory while ensuring the integrity of audio signal processing when processing audio signals through the audio signal processing flow, which can significantly reduce the waste of memory resources. In addition, it can effectively improve the memory utilization of algorithm modules in embedded signal processing and reduce memory load.

[0069] Optionally, in the embodiment of the present application, the total memory applied for audio signal processing through the audio signal processing flow can be calculated according to the following formulas:

[0070]

[0071]

[0072]

[0073] Among them, M0 is used to represent the total memory, n is used to represent the total number of channels used to execute the audio signal processing process, and M 1_ is used to represent the memory of the i-th channel among n channels, p is used to represent the total number of target algorithm modules using the i-th channel, M 2_ The memory used to represent the jth target algorithm module among the p target algorithm modules using the i-th channel, q is used to represent the total number of parameters used by the jth target algorithm module among the p target algorithm modules using the i-th channel, M 3_ A memory for representing the d-th parameter among the q parameters used by the j-th target algorithm module among the p target algorithm modules using the ith channel.

[0074] The specific implementation method of step S106 is not limited in the present application. In some optional embodiments, step S106 includes: storing the signal chain in the form of a first processing linked list, generating a second processing linked list in the form of a one-way linked list according to the first processing linked list, and determining the audio signal processing flow according to the second processing linked list.

[0075] Based on this, the present application can effectively determine the audio signal processing flow. When the audio signal is processed through the audio signal processing flow, the audio signal can be processed in sequence according to the second processing linked list in the form of a one-way linked list to meet the requirements of audio signal processing.

[0076] Optionally, the configuration information (channel configuration information and parameter configuration information) of each target algorithm module in the signal chain and the information of the I / O relationship of each target algorithm module can be added to the nodes of the linked list, so that the signal chain is stored in the form of a first processing linked list, and then the actual connection order of each target algorithm module is parsed according to the first processing linked list to form a second processing linked list in the form of a one-way linked list, and finally the audio signal is processed according to the second processing linked list in the form of a one-way linked list.

[0077] In addition, the memory used for audio signal processing through the audio signal processing flow can also be directly applied for according to the second processing linked list. There will be no memory application for the algorithm modules not in the second processing linked list. When applying for memory for each target algorithm module, the required memory is applied according to the channel configuration information configured in the target algorithm module (such as the number of channels configured in the target algorithm module) and the parameter configuration information of each channel (such as the parameters configured for each channel of the target algorithm module), which can effectively reduce the waste of memory resources. It should be understood that the above description does not serve as any limitation to the present application.

[0078] It should be understood that the embodiments described above are only used to exemplarily explain the technical solutions of the present application, and are not intended to be any limitation to the present application.

[0079] It can be seen that the technical solution in the present application no longer relies on the fixed audio signal processing flow in the signal processing software to process the audio signal. Instead, when determining the audio signal processing flow, it can respond to the algorithm module selection instruction, obtain multiple target algorithm modules from multiple algorithm modules, and then respond to the algorithm module organization instruction to organize the multiple target algorithm modules to obtain a signal link for indicating the I / O relationship of the multiple target algorithm modules, and then determine the audio signal processing flow for indicating the order in which each target algorithm module performs audio signal processing based on the signal link. This makes the way the technical solution of this embodiment determines the audio signal processing flow more flexible, better meet the needs of audio signal processing, and improve the compatibility of the audio signal processing flow for different application scenarios.

[0080] In addition, in the prior art, different audio signal processing software versions need to be adapted to different hardware application scenarios, resulting in high software version maintenance costs. When the embodiments of the present application are implemented based on audio signal processing software, multiple target algorithm modules can be freely obtained according to different application scenarios, and a signal link can be built to determine the audio signal processing algorithm flow to meet the audio signal processing needs in different application scenarios. This can significantly improve the compatibility of the audio signal processing software with various application scenarios and reduce the maintenance burden of the audio signal processing software version.

[0081] Based on the same inventive concept as the above-mentioned method for determining the audio signal processing flow, according to another aspect of the embodiment of the present application, referring to Figure 5 As shown, a device 100 for determining an audio signal processing flow is provided, which includes:

[0082] An acquisition unit 102, configured to acquire a plurality of target algorithm modules from a plurality of algorithm modules in response to an algorithm module selection instruction, wherein different algorithm modules are used to perform different types of signal processing on an input audio signal;

[0083] The organizing unit 104 is used to organize the multiple target algorithm modules in response to the algorithm module organizing instruction to obtain a signal link, wherein the signal link is used to indicate the I / O relationship of the multiple target algorithm modules;

[0084] The determination unit 106 is configured to determine the audio signal processing flow according to the signal chain, wherein the audio signal processing flow is used to indicate the order in which each of the target algorithm modules performs audio signal processing.

[0085] In some optional embodiments, the apparatus 100 for determining an audio signal processing flow further includes: a configuration unit, configured to configure channel configuration information and parameter configuration information of the plurality of target algorithm modules in response to an algorithm module configuration instruction.

[0086] In some optional embodiments, the device 100 for determining the audio signal processing process also includes: an application unit, which is used to apply for memory for performing audio signal processing through the audio signal processing process according to each target algorithm module and the channel configuration information and parameter configuration information configured by each target algorithm module.

[0087] In some optional embodiments, the determination unit 106 is specifically used to: store the signal chain in the form of a first processing linked list, generate a second processing linked list in the form of a one-way linked list according to the first processing linked list, and determine the audio signal processing flow according to the second processing linked list.

[0088] In some optional embodiments, at least two target algorithm modules among the multiple target algorithm modules are the same algorithm modules.

[0089] In some optional embodiments, the type of the algorithm module includes: at least one of a first algorithm module, a second algorithm module, a third algorithm module and a fourth algorithm module; wherein,

[0090] The first algorithm module is used to process the single-channel audio signal into a single-channel audio signal different from the single-channel signal;

[0091] The second algorithm module is used to process a single-channel audio signal into a multi-channel audio signal;

[0092] The third algorithm module is used to process the multi-channel audio signals into a single-channel audio signal;

[0093] The fourth algorithm module is used to process the P1 channel audio signal into the P2 channel audio signal, 2≤P1<P2, and P1 and P2 are both integers;

[0094] The fifth algorithm module is used to process the Q1-channel audio signal into the Q2-channel audio signal, 2≤Q2<Q1, and Q1 and Q2 are both integers;

[0095] The sixth algorithm module is used to process the S-channel audio signal into S-channel audio signals different from the S-channel audio signal, where S≥2 and S is an integer.

[0096] The apparatus 100 for determining an audio signal processing flow in the embodiment of the present application has been described in detail in the aforementioned method embodiment for determining an audio signal processing flow, and therefore its related contents and beneficial effects can be understood by referring to the contents of the various optional embodiments of the aforementioned method, and will not be described in detail here.

[0097] According to another aspect of the embodiments of the present application, an electronic device is provided, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; the memory is used to store a computer program, and the computer program enables the processor to execute the signal processing flow determination method as described in any of the preceding items.

[0098] Figure 6 600 is a schematic diagram showing a structure of an optional electronic device according to an embodiment of the present application. The present application embodiment does not limit the specific implementation of the electronic device 600. Figure 6 The electronic device 600 provided in the embodiment of the present application includes: a processor 602, a communication interface 604, a memory 606, and a communication bus 608. Among them:

[0099] The processor 602 , the communication interface 604 , and the memory 606 communicate with each other via a communication bus 608 .

[0100] The communication interface 604 is used to communicate with other electronic devices or servers.

[0101] The processor 602 is used to execute the computer program 610, and specifically can execute the relevant steps in any of the aforementioned audio signal processing flow determination method embodiments.

[0102] Specifically, the computer program 610 may include program codes including computer operation instructions.

[0103] The processor 602 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.

[0104] The memory 606 is used to store the computer program 610. The memory 606 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0105] The computer program 610 may be specifically used to enable the processor 602 to execute the method for determining the audio signal processing flow in any of the aforementioned embodiments.

[0106] The specific implementation of each step in the computer program 610 can refer to the corresponding description of the corresponding steps and units in any of the above-mentioned audio signal processing flow determination method embodiments, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above-mentioned method embodiments, which will not be repeated here.

[0107] The electronic device 600 in the embodiment of the present application has been described in detail in the aforementioned method embodiment for determining the audio signal processing flow, so its related contents and beneficial effects can be understood with reference to the aforementioned method embodiment and will not be described in detail here.

[0108] According to another aspect of the embodiments of the present application, a computer storage medium is provided, wherein the computer storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the method for determining the audio signal processing flow according to any of the above items.

[0109] According to another aspect of the embodiments of the present application, a computer program product is provided, which includes a computer program, wherein the computer program implements any of the above-mentioned methods for determining the audio signal processing flow when executed by a processor.

[0110] As for the computer storage medium and computer program product embodiments, since they are basically similar to the above method embodiments, the description is relatively simple. For the relevant parts, please refer to the partial description of the above method embodiments, which will not be repeated here.

[0111] It can be understood that the above embodiments are merely experimental examples of some examples in the embodiments of the present application, and are not any limitations on the method, device, electronic device, computer storage medium, and computer program product for determining the audio signal processing flow in the embodiments of the present application.

[0112] It should be noted that the term "including" and its variations used in this article are open inclusions, that is, "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below. It should be noted that the concepts of "first", "second", etc. mentioned in this application are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0113] It should be noted that the modifications of "one" and "plurality" mentioned in the present application are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0114] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for determining an audio signal processing flow, characterized in that: include: In response to the algorithm module selection instruction, a plurality of target algorithm modules are obtained from the plurality of algorithm modules, wherein different algorithm modules are used to perform different types of signal processing on the input audio signal; In response to the algorithm module organization instruction, the plurality of target algorithm modules are organized to obtain a signal link, wherein the signal link is used to indicate an I / O relationship of the plurality of target algorithm modules; The audio signal processing flow is determined according to the signal chain, wherein the audio signal processing flow is used to indicate the order in which each of the target algorithm modules performs audio signal processing.

2. The method according to claim 1, characterized in that: In response to the algorithm module selection instruction, a plurality of target algorithm modules are obtained from the plurality of algorithm modules, and then the method further comprises: In response to the algorithm module configuration instruction, the channel configuration information and parameter configuration information of the plurality of target algorithm modules are configured.

3. The method according to claim 2, characterized in that The method further comprises: According to each target algorithm module and the channel configuration information and parameter configuration information configured by each target algorithm module, a memory for performing audio signal processing through the audio signal processing flow is applied.

4. The method according to any one of claims 1 to 3, characterized in that The step of determining the audio signal processing flow according to the signal link includes: The signal chain is stored in the form of a first processing linked list, a second processing linked list in the form of a one-way linked list is generated according to the first processing linked list, and the audio signal processing flow is determined according to the second processing linked list.

5. The method according to any one of claims 1 to 3, characterized in that: At least two target algorithm modules among the multiple target algorithm modules are the same algorithm modules.

6. The method according to any one of claims 1 to 3, characterized in that The types of the algorithm modules include: at least one of a first algorithm module, a second algorithm module, a third algorithm module and a fourth algorithm module; wherein, The first algorithm module is used to process the single-channel audio signal into a single-channel audio signal different from the single-channel signal; The second algorithm module is used to process a single-channel audio signal into a multi-channel audio signal; The third algorithm module is used to process the multi-channel audio signals into a single-channel audio signal; The fourth algorithm module is used to process the P1 channel audio signal into the P2 channel audio signal, 2≤P1<P2, and P1 and P2 are both integers; The fifth algorithm module is used to process the Q1-channel audio signal into the Q2-channel audio signal, 2≤Q2<Q1, and Q1 and Q2 are both integers; The sixth algorithm module is used to process the S-channel audio signal into S-channel audio signals different from the S-channel audio signal, where S≥2 and S is an integer.

7. A device for determining an audio signal processing flow, characterized in that: include: an acquisition unit, configured to acquire a plurality of target algorithm modules from a plurality of algorithm modules in response to an algorithm module selection instruction, wherein different algorithm modules are used to perform different types of signal processing on an input audio signal; An organizing unit, configured to organize the plurality of target algorithm modules in response to an algorithm module organizing instruction, and obtain a signal link, wherein the signal link is used to indicate an I / O relationship of the plurality of target algorithm modules; A determination unit is used to determine the audio signal processing flow according to the signal chain, wherein the audio signal processing flow is used to indicate the order in which each of the target algorithm modules performs audio signal processing.

8. An electronic device, characterized in that: include: A processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; The memory is used to store a computer program, and the computer program enables the processor to perform operations corresponding to the method according to any one of claims 1 to 6.

9. A computer storage medium, characterized in that The computer storage medium stores computer instructions, and the computer instructions are used to make a computer execute the method according to any one of claims 1-6.

10. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 6.

Images