An audio processing method and apparatus

Abstract

Disclosed are an audio processing method and device. The method can acquire a to-be-processed audio signal, determine a main chain signal and a side chain signal. The side chain signal is input into a harmonic generator to generate an odd harmonic signal and an even harmonic signal respectively. The gain of the odd harmonic signal and the gain of the even harmonic signal are determined to obtain the odd harmonic signal and the even harmonic signal after gain adjustment. The odd harmonic signal and the even harmonic signal after gain adjustment and the main chain signal are mixed to obtain an audio output signal. The method provided by the present disclosure can change the nonlinear characteristics of the to-be-processed audio signal by generating the odd harmonic signal and the even harmonic signal, and can control the proportion of the odd harmonic signal and the even harmonic signal by determining the gain of the harmonic signal, thereby achieving accurate adjustment of the harmonic structure and fine adjustment of the to-be-processed audio signal, and improving the clarity, brightness and intelligibility of the to-be-processed audio signal.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the field of audio technology, and in particular to an audio processing method and device. BACKGROUND

[0002] An audio device can record the sound of a sound producer and generate a vocal signal, and can also play the vocal signal, but due to the sound production principle of the sound producer, the components of the vocal signal are generally thin, so if the vocal signal is not processed and directly played on the audio device, the sound will often be dull and empty, the sound quality is poor, and the intelligibility is low. Therefore, the vocal signal needs to be processed by digital sound effects.

[0003] The existing processing method is to mix harmonics of the vocal signal, and the vocal signal mixed with harmonics is more abundant in listening, which can improve the sound quality and intelligibility to a certain extent. However, this kind of digital sound effect processing method cannot control the structure of the harmonics, and cannot finely adjust the vocal signal. SUMMARY

[0004] In order to solve the above technical problems, the present disclosure is proposed. Embodiments of the present disclosure provide an audio processing method and device.

[0005] According to one aspect of the present disclosure, an audio processing method is provided, comprising:

[0006] obtaining a to-be-processed audio signal, determining a main chain signal and a side chain signal;

[0007] inputting the side chain signal into a harmonic generator to generate an odd harmonic signal and an even harmonic signal, respectively;

[0008] determining a gain of the odd harmonic signal and a gain of the even harmonic signal, to obtain a gain-adjusted odd harmonic signal and a gain-adjusted even harmonic signal;

[0009] mixing the gain-adjusted odd harmonic signal and the gain-adjusted even harmonic signal with the main chain signal to obtain an audio output signal.

[0010] According to another aspect of the present disclosure, an audio processing device is provided, comprising:

[0011] a signal determination module configured to obtain a to-be-processed audio signal, and determine a main chain signal and a side chain signal;

[0012] a harmonic generation module configured to input the side chain signal determined by the signal determination module into a harmonic generator to generate an odd harmonic signal and an even harmonic signal, respectively;

[0013] a first gain module configured to determine a gain of the odd harmonic signal and a gain of the even harmonic signal, and obtain the odd harmonic signal and the even harmonic signal after gain adjustment;

[0014] a mixing module configured to mix the odd harmonic signal and the even harmonic signal after gain adjustment output by the first gain module and the main chain signal, and obtain an audio output signal.

[0015] According to yet another aspect of the present disclosure, a computer readable storage medium is provided, which stores a computer program for executing the audio processing method described above.

[0016] According to still another aspect of the present disclosure, an electronic device is provided, which comprises:

[0017] a processor;

[0018] a memory configured to store processor-executable instructions;

[0019] the processor configured to read the executable instructions from the memory and execute the instructions to implement the audio processing method described above.

[0020] The audio processing method and device provided by the embodiments of the present disclosure can obtain a to-be-processed audio signal, determine a main chain signal and a side chain signal, input the side chain signal into a harmonic generator to generate an odd harmonic signal and an even harmonic signal, determine a gain of the odd harmonic signal and a gain of the even harmonic signal, obtain the odd harmonic signal and the even harmonic signal after gain adjustment, and mix the odd harmonic signal and the even harmonic signal after gain adjustment and the main chain signal to obtain an audio output signal. The method provided by the present disclosure can change the nonlinear characteristics of the to-be-processed audio signal by generating the odd harmonic signal and the even harmonic signal, and can control the proportion of the odd harmonic signal and the even harmonic signal by determining the gain of the harmonic signal, so as to realize accurate adjustment of the harmonic structure and fine adjustment of the to-be-processed audio signal, and improve the clarity, brightness and intelligibility of the to-be-processed audio signal. BRIEF DESCRIPTION OF DRAWINGS

[0021] The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which like reference characters refer to like elements in the several views. The accompanying drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and serve to explain the principles of the present disclosure, and do not limit the present disclosure. In the drawings:

[0022] Figure 1 is a structural schematic diagram of an audio processing system provided by an exemplary embodiment of the present disclosure.

[0023] Figure 2 FIG. 1 is a flowchart of an audio processing method according to an example embodiment of the present disclosure.

[0024] Figure 3 FIG. 2 is a flowchart of high-pass filtering a side chain signal according to an example embodiment of the present disclosure.

[0025] Figure 4 FIG. 3 is a flowchart of compressing and expanding a side chain signal according to an example embodiment of the present disclosure.

[0026] Figure 5 FIG. 4 is a flowchart of generating a harmonic using a harmonic generator according to an example embodiment of the present disclosure.

[0027] Figure 6 FIG. 5 is a flowchart of symmetric clipping according to an example embodiment of the present disclosure.

[0028] Figure 7 FIG. 6 is a frequency spectrum image of a 100Hz signal after symmetric clipping according to an example embodiment of the present disclosure.

[0029] Figure 8 FIG. 7 is a dynamic range mapping function image of symmetric clipping according to an example embodiment of the present disclosure.

[0030] Figure 9 FIG. 8 is a dynamic range mapping function image of half-wave rectification according to an example embodiment of the present disclosure.

[0031] Figure 10 FIG. 9 is a frequency image of a 100Hz signal after half-wave rectification according to an example embodiment of the present disclosure.

[0032] Figure 11 FIG. 10 is a block diagram of an audio processing apparatus according to an example embodiment of the present disclosure.

[0033] Figure 12 FIG. 11 is another block diagram of an audio processing method according to an example embodiment of the present disclosure.

[0034] Figure 13 FIG. 12 is a block diagram of an electronic device according to an example embodiment of the present disclosure. DETAILED DESCRIPTION

[0035] Hereinafter, example embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. It should be apparent that the described embodiments are merely a part of the embodiments of the present disclosure, and do not limit the present disclosure, and thus the present disclosure should be understood to include all modifications, equivalents, or substitutes within the scope of the present disclosure.

[0036] It should be noted that the relative arrangement of the components and steps, numerical expressions, and numerical values set forth in these embodiments are not limiting to the scope of the present disclosure unless specifically stated otherwise.

[0037] Those skilled in the art can understand that the terms "first", "second" and the like in the embodiments of the present disclosure are only used to distinguish different steps, devices or modules and the like, neither represent any specific technical meaning nor represent the inherent logical sequence between them.

[0038] It should also be understood that in the embodiments of the present disclosure, "multiple" can refer to two or more, and "at least one" can refer to one, two or more.

[0039] It should also be understood that for any component, data or structure mentioned in the embodiments of the present disclosure, unless specifically limited or the context gives the opposite indication, it can be understood as one or more in general.

[0040] In addition, the term "and / or" in the present disclosure is only a description of the association relationship between the associated objects, which means that there can be three relationships, for example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. In addition, the character " / " in the present disclosure generally represents an "or" relationship between the front and rear associated objects.

[0041] It should also be understood that the description of the embodiments of the present disclosure focuses on the differences between the embodiments, and the same or similar parts can be referred to each other, and for the sake of brevity, they will not be repeated one by one.

[0042] At the same time, it should be understood that in order to facilitate description, the size of each part shown in the drawings is not drawn according to the actual proportional relationship.

[0043] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way limiting to the disclosure and its application or uses.

[0044] Techniques, methods, and devices known to those of ordinary skill in the relevant art can not be discussed in detail, but should be considered part of the specification where appropriate.

[0045] It should be noted that similar reference numbers and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be discussed further in subsequent drawings.

[0046] The disclosed embodiments can be applied to terminal devices, computer systems, servers, and other electronic devices, which can operate with numerous other general purpose or special purpose computing system environments or configurations. Examples of well-known terminal devices, computer systems, environments, and / or configurations that can be suitable for use with terminal devices, computer systems, servers, and other electronic devices include, but are not limited to, personal computers, server computers, thin clients, thick clients, hand-held or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, minicomputers, mainframe computers, and distributed cloud computing technology environments that include any of the above systems, and the like.

[0047] Terminal devices, computer systems, servers, and other electronic devices can be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules can include routines, programs, objects, components, logic, data structures, and the like, which perform particular tasks or implement particular abstract data types. Computer systems / servers can be practiced in distributed cloud computing environments with remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules can be located in local or remote computer system storage media including memory storage devices.

[0048] SUMMARY

[0049] An audio acquisition device (e.g., a microphone, an audio acquisition card) acquires sound in an environment to form an audio signal, the audio signal is processed by an audio processing device, the audio signal processing can change various properties of the audio signal, and then the audio signal is output by an audio output device (e.g., a speaker, etc.). For example, a person's singing voice is acquired by a microphone, and then the singing voice that can be recognized by a human ear is played by a speaker after audio signal processing. In some implementations, the processing of the audio signal can be implemented by a power amplifier, a digital mixing console, a multimedia console, a sound card, and any other software, hardware, or a combination of software and hardware.

[0050] The components of an audio signal determine the listening experience when it is played. For example, a vocal signal is an audio signal generated by an audio device collecting the sound produced by a sound producer. The vocal signal and an instrument signal generally include a fundamental signal and various harmonic components. Due to the sound production principle of the sound producer, the components of the vocal signal are generally thin, the proportion of the fundamental signal is large, and the harmonic components are very few. When the energy or order of the harmonic components in the vocal signal is too low, the listening experience will be dull and dry, the sound quality will be poor, and the intelligibility will be low. Not limited to vocal signals, other thin sounds such as instrument sounds also have such problems when played. Therefore, it is necessary to process the thin audio signals such as vocal signals with digital sound effects to increase the harmonic components in the audio signals to improve the poor listening experience.

[0051] Existing processing methods mix the harmonics of the audio signal to make the audio signal more rich in listening experience. This method can improve the sound quality and intelligibility to a certain extent. However, the specific components of the harmonic signal will also affect the listening experience of the audio signal. For example, if too many harmonics are added to the audio signal, the audio signal will be very harsh in listening experience. Therefore, it is necessary to control the structure of the harmonics in the audio signal, but the above-mentioned digital sound effect processing method cannot control the structure of the harmonics and cannot finely adjust the components of the audio signal, resulting in that the improvement of the listening experience of the audio signal is not obvious.

[0052] Exemplary system

[0053] Figure 1 is a structural schematic diagram of an audio processing system provided by an exemplary embodiment of the present disclosure. As shown in Figure 1 , the audio processing system 1 includes a collection module 101, a preprocessing module 102, a harmonic generator 103, a first gain controller 104, a mixing module 105, and an output module 106.

[0054] The collection module 101 is configured to convert a sound signal into an electrical signal to obtain an initial audio signal. The preprocessing module 102 is configured to process the initial audio signal collected by the collection module 101 to obtain a main chain signal and a side chain signal. The harmonic generator 103 is configured to generate an odd harmonic signal and an even harmonic signal based on the side chain signal. The harmonic generator 103 is also configured to control the high-low order ratio of the harmonics. The first gain controller 104 is configured to control the proportion of the odd harmonic signal and the even harmonic signal by performing gain control on the odd harmonic signal and the even harmonic signal. The mixing module 105 is configured to mix the main chain signal and the odd harmonic signal and the even harmonic signal. The output module 106 is configured to output the mixed signal.

[0055] Further, the preprocessing module 102 includes a copying unit 1021, a high-pass filtering unit 1022, a compression-expansion unit 1023, and a second gain controller 1024. The copying unit 1021 is configured to copy the initial audio signal into two identical audio signals, to obtain a main chain signal and a side chain signal, and to input the side chain signal to the high-pass filtering unit 1022. The main chain signal is configured to retain the characteristics of the initial audio signal, and in some implementations, the main chain signal can be referred to as a fundamental signal. The side chain signal can be applied to an audio processing process to generate harmonic components. The high-pass filtering unit 1022 is configured to perform high-pass filtering on the side chain signal to obtain high-frequency components in the side chain signal, and to input the high-pass filtered side chain signal to the compression-expansion unit 1023. The compression-expansion unit 1023 is configured to perform compression-expansion on the side chain signal to control the amplitude dynamic range of the side chain signal, and to input the side chain signal to the second gain controller 1024. The second gain controller 1024 is configured to perform gain control on the side chain signal to control the amplitude of the side chain signal, and to input the side chain signal to the harmonic generator 103.

[0056] The technical scheme provided by the embodiment can be implemented in any mode of software, hardware, or a combination of software and hardware. The hardware can provide sound input, and the software can be implemented by using C++ programming language, Java, etc. The present disclosure does not limit the specific implementation of hardware, software structure, and corresponding functions.

[0057] Exemplary method

[0058] Figure 2 is a flowchart of an audio processing method provided by an exemplary embodiment of the present disclosure. As shown in Figure 2 the method includes the following steps:

[0059] S201: obtaining a to-be-processed audio signal, and determining a main chain signal and a side chain signal.

[0060] The to-be-processed audio signal can be an audio signal obtained by an audio acquisition module collecting sound, for example, a vocal signal obtained by collecting the sound of a sound producer. The audio acquisition module can be a microphone, an audio acquisition card, etc. When collecting the to-be-processed audio signal, the sampling rate, the number of channels, the bit depth, and the number of frames of the to-be-processed audio signal can be selected based on actual conditions.

[0061] The step of determining the main chain signal and the side chain signal based on the to-be-processed audio signal can be copying the to-be-processed audio signal to obtain the main chain signal and the side chain signal which are completely identical. The main chain signal can be used as a fundamental signal in the embodiment, and the main chain signal is not processed in any way. Thus, the main chain signal can include the characteristics of the to-be-processed audio signal. In addition, the side chain signal can be processed by harmonic generation and gain control to obtain a side chain signal with harmonic components.

[0062] In this way, the main chain signal for preserving the characteristics of the audio signal to be processed and the side chain signal for performing various audio processing steps can be obtained.

[0063] S202: input the side chain signal into the harmonic generator to generate an odd harmonic signal and an even harmonic signal respectively.

[0064] The harmonic generator can be used to perform harmonic generation processing on the side chain signal to generate the odd harmonic signal and the even harmonic signal.

[0065] The harmonic refers to a signal with an integer multiple of the fundamental frequency. When the frequency of the harmonic signal is an odd multiple of the fundamental frequency, the harmonic is called an odd harmonic signal. For example, for a fundamental signal with a frequency of 50 Hz, the frequency of the third harmonic is three times the fundamental frequency, and the frequency of the third harmonic signal is 150 Hz. In this embodiment, the odd harmonic signal is generated by taking the side chain signal as the fundamental signal. The specific order of the odd harmonic is not limited in this embodiment and can be designed according to the actual situation. The generation method of the odd harmonic can be to perform symmetric clipping on the side chain signal by the harmonic generator to cause nonlinear distortion of the side chain signal and obtain the odd harmonic signal.

[0066] When the frequency of the harmonic signal is an even multiple of the fundamental frequency, the harmonic is called an even harmonic signal. For example, for a fundamental signal with a frequency of 50 Hz, the frequency of the second harmonic signal is twice the fundamental frequency, and the frequency of the second harmonic signal is 100 Hz. In this embodiment, the even harmonic signal is generated by taking the side chain signal as the fundamental signal. The specific order of the even harmonic is not limited in this embodiment and can be set according to the actual situation. The generation method of the even harmonic can be to perform full-wave rectification or half-wave rectification on the side chain signal by the harmonic generator to cause nonlinear distortion of the side chain signal and obtain the even harmonic signal.

[0067] It can be understood that the frequency of the side chain signal as the fundamental signal is determined by the source of the sound. For example, when the signal to be processed is a human voice signal collected by the audio acquisition module, the frequency is determined by the human body function and singing skills of the singer. When the signal to be processed is an instrument sound collected by the audio acquisition module, the frequency is determined by the sound generation principle and playing method of the instrument.

[0068] In this way, after inputting the side chain signal into the harmonic generator, the odd harmonic signal with odd harmonic components and the even harmonic signal with even harmonic components can be obtained. The odd harmonic signal and the even harmonic signal can be used to change the listening experience of the audio signal to obtain an audio signal with better listening experience.

[0069] It should be noted that the step of generating the odd harmonic signal and the even harmonic signal based on the side chain signal can be understood as a distortion phenomenon, and the degree of distortion can be determined by the harmonic generator.

[0070] S203: Determine the gain of the odd harmonic signal and the gain of the even harmonic signal, and obtain the odd harmonic signal and the even harmonic signal after gain.

[0071] For an audio signal, the amount of odd harmonic component and even harmonic component will affect the listening experience of the audio signal. Therefore, in order to control the ratio between the odd harmonic signal and the even harmonic signal, the embodiment can first determine the gain of the odd harmonic signal and the gain of the even harmonic signal before mixing the odd harmonic signal and the even harmonic signal. Specifically, the gain refers to the amplification multiple when the signal is amplified, and the gain can cause the audio signal to produce linear changes, so the gain can be used to change the linear characteristics of the audio signal. Therefore, in the embodiment, when more odd harmonic signals and fewer even harmonic signals are needed, a larger gain can be set for the odd harmonic signal, and a smaller gain relative to the gain of the odd harmonic signal can be set for the even harmonic signal, for example, the gain ratio between the odd harmonic signal and the even harmonic signal is set to 3:2. When more even harmonic signals and fewer odd harmonic signals are needed, a larger gain can be set for the even harmonic signal, and a smaller gain relative to the gain of the even harmonic signal can be set for the odd harmonic signal, for example, the gain ratio between the odd harmonic signal and the even harmonic signal is set to 2:3. The step of gain can be realized by a gain amplifier or the like. In this way, the embodiment can determine the gain of the odd harmonic signal and the gain of the even harmonic signal, and obtain the odd harmonic signal and the even harmonic signal after gain, so as to control the ratio of the odd harmonic signal and the even harmonic signal, and improve the listening experience.

[0072] S204: Mix the odd harmonic signal after gain and the even harmonic signal after gain with the main chain signal to obtain an audio output signal.

[0073] The first mixed signal can be obtained by first mixing the odd harmonic signal after gain and the even harmonic signal after gain. Then, the gain ratio between the first mixed signal and the main chain signal is determined, and the first mixed signal and the main chain signal are mixed based on the gain ratio. In the embodiment, the gain of the main chain signal is preferably set to 1, and then the gain of the first mixed signal is set based on the gain of the main chain signal.

[0074] For example, if the distortion effect of the audio output signal needs to be more obvious, a larger gain can be set for the first mixed signal during mixing, so that the audio processing effect is more obvious in the sense of hearing. If the distortion effect of the audio output signal needs to be less obvious, a smaller gain can be set for the first mixed signal during mixing, so that the audio output signal will more truly reflect the sound collected by the audio acquisition module. That is, the specific value of the gain of the first mixed signal can be designed according to actual conditions, and the embodiment does not make specific limitations thereto.

[0075] In some implementations, the embodiment can also determine the gain ratio between the gain-adjusted odd harmonic signal, the gain-adjusted even harmonic signal and the main chain signal, and then mix the gain-adjusted odd harmonic signal, the gain-adjusted even harmonic signal and the main chain signal based on the gain ratio. It can be understood that the embodiment can set a gain for the harmonic signal before and during mixing.

[0076] The audio processing method of the present disclosure can obtain a to-be-processed audio signal, determine a main chain signal and a side chain signal. The side chain signal is input into a harmonic generator to generate an odd harmonic signal and an even harmonic signal. The gain of the odd harmonic signal and the gain of the even harmonic signal are determined to obtain a gain-adjusted odd harmonic signal and a gain-adjusted even harmonic signal. The gain-adjusted odd harmonic signal and the gain-adjusted even harmonic signal are mixed with the main chain signal to obtain an audio output signal. The method provided by the present disclosure can change the nonlinear characteristics of the to-be-processed audio signal by generating the odd harmonic signal and the even harmonic signal, and can control the proportion of the odd harmonic signal and the even harmonic signal by determining the gain of the harmonic signal, so as to realize accurate adjustment of the harmonic structure and fine adjustment of the to-be-processed audio signal, and can improve the clarity, brightness and intelligibility of the to-be-processed audio signal.

[0077] Figure 3 is a flowchart of the process of high-pass filtering the side chain signal provided by an example embodiment of the present disclosure. As shown in Figure 3 based on the above-mentioned Figure 2 embodiment, the step S202 further includes the following steps before it:

[0078] S301: input the side chain signal into a high-pass filter.

[0079] The amount of high frequency components in the audio signal also affects the listening experience of the audio signal. Generally, the more high frequency components in the audio signal, the brighter the listening experience. Therefore, the present disclosure can further include a step of enhancing the high frequency components in the to-be-processed audio signal. Specifically, the present embodiment inputs the side chain signal into a high-pass filter, so that the high frequency components higher than the cutoff frequency of the high-pass filter in the side chain signal can be obtained. The high-pass filter is preferably a high-pass filter with a cutoff frequency of 1500 Hz. The specific cutoff frequency can be determined according to the components of the side chain signal in the actual situation, and the present disclosure does not make specific limitations thereto.

[0080] S302: filtering the side chain signal using a high-pass filter to obtain a signal higher than the cutoff frequency of the high-pass filter in the side chain signal.

[0081] After filtering by the high-pass filter, the signal higher than the cutoff frequency of the high-pass filter in the side chain signal can be obtained. It can be understood that this signal can be referred to as the side chain signal after high-pass filter filtering. In this way, after the high frequency components enter the audio output signal, the effect of enhancing the high frequency components in the audio output signal can be achieved, thereby improving the listening experience of the audio output signal.

[0082] Figure 4 is a flowchart of the compression and expansion of the side chain signal provided by an exemplary embodiment of the present disclosure. As shown in Figure 4 based on the above-mentioned Figure 2 embodiment, the step S202 further includes the following steps before it:

[0083] S401: inputting the side chain signal into a compression and expansion device.

[0084] The compression and expansion device is composed of a compressor and an expander. The compressor can compress the dynamic range of the signal, where the dynamic range refers to the ratio of the maximum value to the minimum value of the signal (such as an audio signal). The compressor can compress the dynamic range of the signal according to a compression coefficient, and the size of the compression parameter will affect the size of the compression degree. For example, the compression parameter of the compressor can be 0.5, and if the dynamic range of the signal before compression is 4 dB, the dynamic range of the signal after the compressor can be compressed to 2 dB according to the compression parameter 0.5.

[0085] In the present embodiment of the present disclosure, after the side chain signal is input into the compressor, the dynamic range of the side chain signal is reduced, and the difference between the peak values of the side chain signals of different amplitudes is reduced. In this way, when the side chain signal output by the compression and expansion device is applied to step S202, the distortion levels between the side chain signals of different amplitudes are comparable. The difference in distortion level depends on the original dynamic range of the side chain signal and the size of the compression parameter.

[0086] The expander can be used to expand the dynamic range of the signal, the expander can expand the dynamic range of the signal according to an expansion coefficient, and a large expansion parameter can affect the size of the expansion degree. For example, the expansion parameter of the expander can be 2, and if the dynamic range of the signal before expansion is 2dB, the dynamic range of the signal after the expander can be expanded to 4dB according to the expansion coefficient 2.

[0087] In the embodiment of the present disclosure, after the side chain signal is input to the expander, the dynamic range of the side chain signal is increased, and the difference between the peak values of different amplitude side chain signals is increased. Specifically, after expansion, the amplitude difference between the large amplitude signal and the small amplitude signal is larger than before expansion. Therefore, when the side chain signal input by the compression expander is applied in step S202, distortion is mainly concentrated on the large amplitude signal, and the distortion level of the small amplitude signal is suppressed. The distortion of the large amplitude signal is more obvious, and the distortion of the small amplitude signal is smaller. The difference in distortion level depends on the original dynamic range of the side chain signal and the size of the expansion parameter.

[0088] It should be noted that the compression expander can be determined by an algorithm related to audio compression expansion technology. Specifically, the compressor and the expander can be determined by the same algorithm, and by setting different parameters (compression parameters or expansion parameters) for the compressor and the expander, the compression or expansion of the signal can be realized. For example, the compression parameter is set to 0.5, and the expansion parameter is set to 0, so that the compression expander only compresses the signal without expansion.

[0089] It should be noted that in the embodiment of the present disclosure, the compression expander can be used to compress the side chain signal alone, or the compression expander can be used to expand the side chain signal alone, or the compression expander can be used to compress and expand the side chain signal at the same time, and the present disclosure does not make specific limitations.

[0090] Specifically, in the embodiment of the present disclosure, the compression expander gain calculation formula is:

[0091] G = min(0, CS · (CT - X), ES · (ET - X));

[0092] Wherein, G represents the compression expander gain, min represents the minimum value function, CS is the compression slope, CT is the compression threshold, X is the smoothed input signal effective value in decibels, ES is the expansion slope, and ET is the expansion threshold.

[0093] It can be understood that in the present embodiment, G can represent the compression and / or expansion gain applied to the side chain signal in decibels. X can represent the smoothed side chain signal effective value in decibels input to the compression expander.

[0094] For example, for a side chain signal with a peak of -3dB, CT can be -15, ET can be 0, CS can be 0.8, and ES can be 0. Since the expansion slope is 0, the compression expander does not expand the side chain signal. Since the compression threshold CT is -15 and the compression slope CS is 0.8, the compression expander compresses the signal with a peak greater than the compression threshold (for example, the side chain signal with a peak of -3dB) by 0.8, and then calculates the final compression expander gain through the minimum value function, which is -9.6, in other words, the peak of the side chain signal after compression expansion is compressed to -12.6dB.

[0095] S402: Adjust the amplitude dynamic range of the side chain signal using the compression expander to obtain a side chain signal with an amplitude dynamic range within a preset range.

[0096] The preset range can be a range determined according to the specific amplitude of the side chain signal and the desired distortion effect, etc. In this embodiment, the parameters (CS, CT, ES, ET) of the compression expander can be set according to the preset range.

[0097] In this way, the compression expander can adjust the amplitude dynamic range of the side chain signal, so that the difference between the peaks of signals with different amplitudes is reduced, and the amplitude dynamic range of the side chain signal is within the preset range. The relative distortion degree of signals with different amplitudes of the side chain signal can be controlled, so that the distortion levels of signal components with different amplitudes in the side chain signal are equivalent after inputting into the harmonic generator, thereby improving the listening experience of the audio output signal.

[0098] It should be noted that in the embodiments of the present disclosure, steps S401 and S402 can be performed after steps S301 and S302, specifically, the side chain signal is first filtered by the high-pass filter, and then the side chain signal output by the high-pass filter is input into the compression expander, and the side chain signal is compressed and expanded by the compression expander.

[0099] On the basis of the above Figure 2 The step S202 further includes the following steps before it:

[0100] S501: Determine the gain of the side chain signal to obtain the side chain signal after gain.

[0101] Here, the gain of the side chain signal refers to the gain before the side chain signal is input into the harmonic generator.

[0102] Since the level of distortion generated by the harmonic generator is positively correlated with the signal amplitude, the more harmonic components generated by the harmonic generator for a signal with a larger amplitude. Therefore, in this embodiment, the gain of the side chain signal can be determined, and the gain of the side chain signal is applied based on the determined gain to obtain the gain side chain signal. The step of applying gain to the side chain signal can control the amplitude of the side chain signal. The greater the gain applied to the side chain signal, the greater the amplitude of the gain side chain signal, the more harmonic components generated by the harmonic generator after the gain side chain signal passes through the harmonic generator, and the greater the distortion. Therefore, this embodiment can apply gain to the side chain signal to control the amplitude of the side chain signal, and further control the distortion of the side chain signal. The specific value of the gain can be determined according to the amplitude of the side chain signal and the desired distortion effect, and is preferably a value between 1 and 5. The gain step can be implemented by a gain amplifier or the like.

[0103] It should be noted that in the embodiments of the present disclosure, step S501 can be performed after steps S301, S302, S401 and S402. Specifically, the side chain signal is first filtered by a high-pass filter, and then the side chain signal output by the high-pass filter is input into a compander, the side chain signal is compressed and expanded by the compander, and then the gain of the side chain signal output by the compander is determined to obtain the gain side chain signal.

[0104] It should be noted that in step S202, the side chain signal input into the harmonic generator is determined based on steps S301, S302, S401, S402 and S501. After steps S301 and S302, the side chain signal is filtered by the high-frequency filter to obtain a high-frequency signal. Then, step S202 determines the odd harmonic signal and the even harmonic signal based on the high-frequency side chain signal, so the odd harmonic signal and the even harmonic signal are also high-frequency signals. High-frequency signals are specifically manifested as relatively strong in hearing. Then, in step S204, when the gain of the main chain signal is 1, the gain of the first mixed signal can be determined as a value less than 1. In this way, after the first mixed signal and the main chain signal are mixed, the obtained audio output signal will not lose the sound information originally expressed by the audio signal due to too many high-frequency signal components. For example, when the distortion effect is relatively weak and the hearing is relatively unobvious, the gain ratio of the main chain signal to the first mixed signal can be determined as 1:0.1. When the distortion effect is relatively strong and the hearing is relatively obvious, the gain ratio of the main chain signal to the first mixed signal can be determined as 1:0.8.

[0105] Figure 5 is a flowchart of generating harmonics using a harmonic generator provided by an example embodiment of the present disclosure. As shown in Figure 5 the above Figure 2Based on the illustrated embodiment, step S202 includes the following steps:

[0106] S2021: Determine the first side chain signal and the second side chain signal based on the side chain signal.

[0107] The step of determining the first side chain signal and the second side chain signal based on the side chain signal can be to copy the side chain signal to obtain the exact same first side chain signal and second side chain signal.

[0108] S2022: Input the first side chain signal and the second side chain signal into the harmonic generator.

[0109] The harmonic generator can be used to generate odd-order harmonic signals based on the first side chain signal, and also to generate even-order harmonic signals based on the second side chain signal. This makes it easy to control the ratio of odd-order to even-order harmonic signals.

[0110] S2023: Use a harmonic generator to symmetrically clip the first side chain signal to generate odd harmonic signals.

[0111] Clipping is a form of distortion that controls the signal within a threshold range and generates harmonics. Symmetrical clipping refers to clipping the amplitude symmetrically both vertically and horizontally, with the absolute values ​​of the amplitude thresholds for both vertical clipping and horizontal clipping being equal. Taking an audio signal waveform as an example, the amplitude in the waveform is generally symmetrically distributed relative to an amplitude of 0. For amplitudes above and below 0, the absolute values ​​of the clipping thresholds set for both are equal during symmetrical clipping.

[0112] In this way, the harmonic generator can clip out the amplitude of the first side chain signal that exceeds the clipping threshold, and at the same time generate odd harmonic signals based on the first side chain signal.

[0113] Figure 6 This is a schematic diagram of a symmetrical clipping process provided in an exemplary embodiment of this disclosure.

[0114] like Figure 6 As shown above, in the above Figure 2 Based on the illustrated embodiment, step S2023 includes the following steps:

[0115] S20231: Determine the symmetric clipping dynamic range mapping function for the harmonic generator.

[0116] The dynamic range mapping function for symmetrical clipping is as follows:

[0117]

[0118] Wherein, y(n) is the symmetrical clipping output signal, x(n) is the symmetrical clipping input signal, n is the sampling point sequence number, and d is the parameter for controlling the soft and hard degree of the inflection point. It can be understood that in the embodiment, y(n) contains the odd harmonic signal, and x(n) is the first side chain sub-signal.

[0119] It needs to be added that in the embodiment, y(n) contains the frequency component of the original signal (the first side chain sub-signal) and also contains the frequency component of the odd harmonic of the original signal (the odd harmonic signal). When step S204 is performed, the signal contained in y(n) can be directly involved in mixing to obtain the audio output signal.

[0120] S20232: symmetrical clipping is performed on the first side chain sub-signal according to the symmetrical clipping dynamic range mapping function to generate the odd harmonic signal, and the speed at which the amplitude of the odd harmonic signal attenuates with the order is determined by the symmetrical clipping dynamic range mapping function.

[0121] In this way, according to the symmetrical clipping dynamic range mapping function of the harmonic generator, the odd harmonic signal can be generated based on the first side chain sub-signal.

[0122] The speed at which the amplitude of the harmonic attenuates with the order affects the energy size of the low-order and high-order signals in the harmonic signal. If the harmonic amplitude attenuates faster with the increase of the frequency order, the energy of the low-order harmonic in the harmonic signal is relatively large, and if the harmonic amplitude attenuates slower with the increase of the frequency order, the energy of the high-order harmonic in the harmonic signal is relatively large. The embodiment of the present disclosure can also control the speed at which the energy of the odd harmonic signal attenuates with the order, which is specifically reflected in controlling the parameter for controlling the soft and hard degree of the inflection point of the symmetrical clipping dynamic range mapping function. When a relatively soft inflection point is used for the mapping function, the amplitude of the odd harmonic signal attenuates faster with the increase of the frequency order, and when a relatively hard inflection point is used for the mapping function, the amplitude of the odd harmonic signal attenuates slower with the increase of the frequency order. Therefore, by controlling the soft and hard degree of the inflection point, the energy distribution of different order harmonics in the odd harmonic signal can be controlled.

[0123] Figure 7 is a 100Hz signal spectrum image after symmetrical clipping provided by an example embodiment of the present disclosure. When the 100Hz signal is input to the symmetrical clipping dynamic range mapping function, an image as shown in Figure 7 can be obtained. Wherein, the horizontal coordinate of the image is the signal frequency, and the vertical coordinate of the image is the signal spectrum. As shown in Figure 7 , the frequency of point A is 300Hz, the frequency of point B is 500Hz, and the frequency of point C is 700Hz, that is, the 100Hz signal after symmetrical clipping obtains the corresponding odd harmonic signal.

[0124] Figure 8is a symmetric clipping dynamic range mapping function image provided by an example embodiment of the present disclosure. As shown in Figure 8 the horizontal coordinate is the input signal amplitude, and the vertical coordinate is the output signal amplitude. The solid line shows a symmetric clipping dynamic range mapping function image using a hard knee. For the image with the input signal amplitude range being [-0.8, -0.6], as the input signal amplitude increases, the output signal amplitude rapidly rises after the input signal amplitude is greater than a certain amplitude value. The dotted line shows a symmetric clipping dynamic range mapping function image using a soft knee. For the image with the input signal amplitude range being [-0.8, -0.6], as the input signal amplitude increases, the output signal amplitude slowly rises. Referring back to Figure 7 , the solid line shows a symmetric clipping image after using a hard knee for the symmetric clipping dynamic range mapping function, and the dotted line shows a symmetric clipping image after using a soft knee for the symmetric clipping dynamic range mapping function. As shown in Figure 7 , in the solid line image, as the frequency order increases, the odd harmonic signal decays slowly. In the dotted line image, as the frequency order increases, the odd harmonic signal decays quickly.

[0125] In this way, the proportion of high-order and low-order harmonics in the odd harmonic signal can be adjusted, and thus the fine control of the structure of the odd harmonic signal can be realized.

[0126] S2024: rectifying the second sidechain sub-signal using a harmonic generator to generate an even harmonic signal.

[0127] The rectification is a distortion form, and the rectification can cause the generation of the even harmonic. The rectification can specifically adopt full-wave rectification or half-wave rectification.

[0128] The following is an example description in the manner of half-wave rectification.

[0129] The half-wave rectification dynamic range mapping function of the harmonic generator is as follows:

[0130] y(n) = max(0, x(n));

[0131] wherein y(n) represents a half-wave rectification output signal, x(n) is a half-wave rectification input signal, max is a maximum value function, and n is a sample point serial number. It can be understood that in the present embodiment, y(n) contains an even harmonic signal, and x(n) is a second sidechain sub-signal.

[0132] It should be noted that in the present embodiment, y(n) contains the frequency components of the original signal (the second sidechain sub-signal) and the frequency components of the even harmonics of the original signal (the even harmonic signal). When performing step S204, the signals contained in y(n) can be directly involved in mixing to obtain an audio output signal.

[0133] Thus, according to the half-wave rectification dynamic range mapping function of the harmonic generator, the even harmonic signal can be generated based on the second side chain sub-signal.

[0134] Figure 9 is a half-wave rectification dynamic range mapping function image provided by an example embodiment of the present disclosure. As shown in the image, the horizontal coordinate is the input signal amplitude, and the vertical coordinate is the output signal amplitude. Figure 9 In the example shown in the image, the amplitude of the input signal varies in the range of [-1, 1], and the amplitude of the output signal after half-wave rectification varies in the range of [0, 1]. Figure 9

[0135] Figure 10 is a frequency image of a 100Hz signal after half-wave rectification provided by an example embodiment of the present disclosure. Figure 10 shows a frequency image of a 100Hz signal after half-wave rectification, where the horizontal coordinate is the signal frequency, and the vertical coordinate is the signal spectrum. As shown in the image, Figure 10 the frequency of point E is 200Hz, the frequency of point F is 400Hz, and the frequency of point G is 600Hz, that is, the even harmonic signal corresponding to the 100Hz signal is obtained after half-wave rectification.

[0136] In step S2024, the second side chain sub-signal can be half-wave rectified according to the half-wave rectification dynamic range mapping function to obtain the even harmonic signal.

[0137] Example device

[0138] Figure 11 is a structural schematic diagram of an audio processing device provided by an example embodiment of the present disclosure. The device can be used to implement all or part of the functions of the foregoing method embodiments. Specifically, the audio processing device includes a signal determination module 701, a harmonic generation module 702, a first gain module 703, and a mix module 704.

[0139] Specifically, the signal determination module 701 in the present disclosure is configured to acquire a to-be-processed audio signal, determine a main chain signal and a side chain signal.

[0140] The harmonic generation module 702 is configured to input the side chain signal determined by the signal determination module 701 into a harmonic generator to generate an odd harmonic signal and an even harmonic signal, respectively.

[0141] The first gain module 703 is configured to determine the gain of the odd harmonic signal generated by the harmonic generation module 702 and the gain of the even harmonic signal generated by the harmonic generation module 702 to obtain the odd harmonic signal and the even harmonic signal after gain.

[0142] ​The mixing module 704 is configured to mix the odd harmonic signal and the even harmonic signal output by the first gain module 703 and the main chain signal to obtain an audio output signal.

[0143] Figure 12 FIG. 6 is another structural schematic diagram of an audio processing method according to an example embodiment of the present disclosure.

[0144] Optionally, in another implementation manner of the example embodiment, as shown in Figure 12 The harmonic generation module 702 includes a sub-signal determination unit 7021, an input unit 7022, a symmetric clipping unit 7023, and a rectification unit 7024.

[0145] The sub-signal determination unit 7021 is configured to determine a first side chain sub-signal and a second side chain sub-signal according to the side chain signal.

[0146] The input unit 7022 is configured to input the first side chain sub-signal and the second side chain sub-signal determined by the sub-signal determination unit 7021 into the harmonic generator.

[0147] The symmetric clipping unit 7023 is configured to perform symmetric clipping on the first side chain sub-signal input by the input unit 7022 using the harmonic generator to generate an odd harmonic signal.

[0148] The rectification unit 7024 is configured to perform rectification on the second side chain sub-signal input by the input unit 7022 using the harmonic generator to generate an even harmonic signal.

[0149] Optionally, in another implementation manner of the example embodiment, performing symmetric clipping on the first side chain sub-signal using the harmonic generator to generate the odd harmonic signal includes:

[0150] determining a symmetric clipping dynamic range mapping function of the harmonic generator;

[0151] performing symmetric clipping on the first side chain sub-signal according to the symmetric clipping dynamic range mapping function to generate the odd harmonic signal, and a speed at which an amplitude of the odd harmonic signal attenuates with order is determined by the symmetric clipping dynamic range mapping function.

[0152] Optionally, in another implementation manner of the example embodiment, as shown in Figure 12 The apparatus provided by the example embodiment of the present disclosure can further include a first input module 705 and a high-pass filter module 706.

[0153] The first input module 705 is configured to input the side chain signal into the high-pass filter.

[0154] The high-pass filter module 706 is configured to filter the side chain signal using the high-pass filter to obtain a signal higher than a cutoff frequency of the high-pass filter in the side chain signal.

[0155] Optionally, in another implementation manner of the embodiment, as shown in Figure 12 The apparatus provided by the embodiment of the disclosure can further include a second input module 707 and a compression expansion module 708.

[0156] The second input module 707 is configured to input the side chain signal into the compression expander.

[0157] The compression expansion module 708 is configured to adjust the amplitude dynamic range of the side chain signal by using the compression expander, so as to obtain the side chain signal with the amplitude dynamic range in the preset range.

[0158] Optionally, in another implementation manner of the embodiment, as shown in Figure 12 The apparatus provided by the embodiment of the disclosure can further include a second gain module 709.

[0159] The second gain module 709 is configured to determine the gain of the side chain signal, and obtain the side chain signal after gain adjustment.

[0160] In addition, in the apparatus embodiment, as shown in Figure 11 The functions of each module correspond to the method embodiment as shown in Figure 1 For example, the signal determination module 701 is configured to perform the foregoing method step S201, the harmonic generation module 702 is configured to perform the foregoing method step S202, the gain module 703 is configured to perform the foregoing method step S203, and the mix module 704 is configured to perform the foregoing method step S204.

[0161] Exemplary electronic device

[0162] Hereinafter, the electronic device according to the embodiment of the disclosure will be described with reference to Figure 13 The electronic device can be either or both of the first device 100 and the second device 200, or a single device independent of them, which can communicate with the first device and the second device to receive the collected input signals therefrom.

[0163] Figure 13 FIG. 1 illustrates a block diagram of an electronic device according to an embodiment of the disclosure.

[0164] As shown in Figure 13 The electronic device 10 includes one or more processors 11 and a memory 12.

[0165] The processor 11 can be a central processing unit (CPU) or other forms of processing unit having data processing capability and / or instruction execution capability, and can control other components in the electronic device 10 to perform desired functions.

[0166] The memory 12 can include one or more computer program products that can include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory, for example, can include random access memory (RAM), cache memory, and / or the like. The non-volatile memory, for example, can include read-only memory (ROM), hard disk drives, flash memory, and / or the like. The computer-readable storage media can store one or more computer program instructions executable by the processor 11 to implement the audio processing method of the embodiments of the present disclosure described above and / or other desired functions. Various contents such as input signals, signal components, noise components, and the like can also be stored in the computer-readable storage media.

[0167] In one example, the electronic device 10 can further include an input device 13 and an output device 14, which are interconnected through a bus system and / or other forms of connection mechanisms (not shown).

[0168] For example, when the electronic device is the first device 100 or the second device 200, the input device 13 can be the microphone or the microphone array described above, for capturing the input signal of the sound source. When the electronic device is a standalone device, the input device 13 can be a communication network connector, for receiving the captured input signal from the first device 100 and the second device 200.

[0169] In addition, the input device 13 can further include, for example, a keyboard, a mouse, and the like.

[0170] The output device 14 can output various information including the determined distance information, direction information, and the like to the outside. The output device 14 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0171] Of course, in order to simplify, Figure 13 Only some of the components in the electronic device 10 related to the present disclosure are shown in FIG. 1, and components such as buses, input / output interfaces, and the like are omitted. In addition, the electronic device 10 can include any other appropriate components according to the specific application.

[0172] Exemplary computer program product and computer readable storage medium

[0173] In addition to the above-described method and device, an embodiment of the present disclosure can be a computer program product including computer program instructions that, when executed by a processor, cause the processor to perform the steps of the audio processing method according to various embodiments of the present disclosure described in the above "Exemplary Methods" section of the specification.

[0174] The computer program product can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computing device, partly on the user's computing device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device or entirely on the remote computing device or server. The embodiments of the present disclosure can be a computer program product, which can include a computer program tangibly embodied in a machine readable storage medium.

[0175] In addition, embodiments of the present disclosure can also be a computer readable storage medium, having stored thereon computer program instructions, which, when executed by a processor, cause the processor to perform steps of the audio processing method according to various embodiments of the present disclosure described in the above “Exemplary Method” section of the specification.

[0176] The computer readable storage medium can be any combination of one or more computer readable media. The computer readable medium can be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination of the above. More specific examples (a non-exhaustive list) of the computer readable storage medium include an electrical connection having one or more wires, a portable disc, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0177] The above describes the basic principles of the present disclosure in combination with specific embodiments, but it should be noted that the advantages, benefits, effects and the like mentioned in the present disclosure are only examples and are not limiting, and these advantages, benefits, effects and the like cannot be considered as the must-have of each embodiment of the present disclosure. In addition, the above specific details are only for the purpose of example and understanding, and are not limiting, and the above details do not limit the present disclosure to the must-have of the above specific details.

[0178] The block diagrams of devices, apparatuses, devices, and systems disclosed herein are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0179] It should also be noted that in the apparatus, devices, and methods of this disclosure, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions to this disclosure.

[0180] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.

[0181] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.

Claims

1. An audio processing method comprising: obtaining an audio signal to be processed, copying the audio signal to be processed, and determining a main chain signal and a side chain signal; inputting the side chain signal into a harmonic generator to generate an odd harmonic signal and an even harmonic signal, respectively; determining a gain of the odd harmonic signal and a gain of the even harmonic signal to obtain a gain-adjusted odd harmonic signal and a gain-adjusted even harmonic signal; mixing the gain-adjusted odd harmonic signal and the gain-adjusted even harmonic signal with the main chain signal to obtain an audio output signal; the inputting the side chain signal into the harmonic generator to generate the odd harmonic signal and the even harmonic signal, respectively, comprises: copying the side chain signal according to the side chain signal to determine a first side chain sub-signal and a second side chain sub-signal; inputting the first side chain sub-signal and the second side chain sub-signal into the harmonic generator; symmetrically clipping the first side chain sub-signal using the harmonic generator to generate the odd harmonic signal; rectifying the second side chain sub-signal using the harmonic generator to generate the even harmonic signal.

2. The audio processing method of claim 1, wherein, the symmetrically clipping the first side chain sub-signal using the harmonic generator to generate the odd harmonic signal comprises: determining a symmetric clipping dynamic range mapping function of the harmonic generator; symmetrically clipping the first side chain sub-signal according to the symmetric clipping dynamic range mapping function to generate the odd harmonic signal, wherein a speed at which an amplitude of the odd harmonic signal attenuates with order is determined by the symmetric clipping dynamic range mapping function.

3. The audio processing method of claim 1, wherein, before the inputting the side chain signal into the harmonic generator to generate the odd harmonic signal and the even harmonic signal, respectively, the method further comprises: inputting the side chain signal into a high-pass filter; filtering the side chain signal using the high-pass filter to obtain a signal higher than a cutoff frequency of the high-pass filter in the side chain signal.

4. The audio processing method of claim 1, wherein, before the inputting the side chain signal into the harmonic generator to generate the odd harmonic signal and the even harmonic signal, respectively, the method further comprises: inputting the side chain signal into a compression expander; adjusting an amplitude dynamic range of the side chain signal using the compression expander to obtain the side chain signal with an amplitude dynamic range within a preset range.

5. The audio processing method of claim 1, 3, or 4, wherein, before the inputting the side chain signal into the harmonic generator to generate the odd harmonic signal and the even harmonic signal, respectively, the method further comprises: determining a gain of the side chain signal to obtain a gain-adjusted side chain signal.

6. An audio processing apparatus comprising: a signal determination module configured to obtain an audio signal to be processed, copy the audio signal to be processed, and determine a main chain signal and a side chain signal; a harmonic generation module configured to input the side chain signal determined by the signal determination module into a harmonic generator to generate an odd harmonic signal and an even harmonic signal, respectively; a first gain module configured to determine a gain of the odd harmonic signal generated by the harmonic generation module and a gain of the even harmonic signal generated by the harmonic generation module to obtain a gain-adjusted odd harmonic signal and a gain-adjusted even harmonic signal; A mixing module is configured to mix the gain-adjusted odd-harmonic signal and even-harmonic signal output by the first gain module and the main chain signal to obtain an audio output signal. The harmonic generation module comprises: a sub-signal determination unit configured to copy the side chain signal to determine a first side chain sub-signal and a second side chain sub-signal according to the side chain signal; an input unit configured to input the first side chain sub-signal and the second side chain sub-signal determined by the sub-signal determination unit into the harmonic generator; a symmetric clipping unit configured to symmetrically clip the first side chain sub-signal input by the input unit by using the harmonic generator to generate the odd-harmonic signal; a rectification unit configured to rectify the second side chain sub-signal input by the input unit by using the harmonic generator to generate the even-harmonic signal. 7.A computer readable storage medium, the storage medium storing a computer program, the computer program being configured to execute the audio processing method of any one of claims 1-5. 8.An electronic device, the electronic device comprising: a processor; a memory configured to store executable instructions for the processor; the processor is configured to read the executable instructions from the memory and execute the instructions to implement the audio processing method of any one of claims 1-5.

Images