Audio processing method, device and equipment and computer readable storage medium

Abstract

The invention discloses an audio processing method, apparatus and device, and a computer readable storage medium. The method comprises the steps of obtaining loudspeaker data of a plurality of loudspeakers and first distance information between each loudspeaker and a listening position; determining audio equalization data based on the loudspeaker data; determining crosstalk cancellation data based on the first distance information and second distance information between the plurality of speakers; and processing the to-be-processed audio data based on the audio equalization data and the crosstalk elimination data to obtain target audio data. By adopting the method provided by the invention, the acoustic image range of the loudspeaker can be expanded, and the influence of acoustic defects in a playback environment on the playback effect can be reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of audio processing, and in particular to an audio processing method, device, equipment and computer readable storage medium. BACKGROUND

[0002] Currently, the speaker arrangement position of a display device is fixed, and due to the crosstalk interference between the speakers, the sound image range of playback will not exceed the physical boundary of the speakers. The existing method usually uses a reverberation enhancement method such as decorrelation to increase the range of the sound image, however, this method can only expand the sound image from a point to a small circular area centered on the point. SUMMARY

[0003] The embodiments of the present application provide an audio processing method, device, equipment and computer readable storage medium, which can expand the sound image range of the speaker and reduce the influence of the playback environment acoustic defects on the playback effect.

[0004] The technical solutions adopted by the present application to solve the problems are as follows:

[0005] In a first aspect, the present application provides an audio processing method, comprising:

[0006] Obtaining speaker data of a plurality of speakers and first distance information between each speaker and a listening position;

[0007] Determining audio equalization data based on the speaker data;

[0008] Determining crosstalk cancellation data based on the first distance information and second distance information between the plurality of speakers;

[0009] Processing the to-be-processed audio data based on the audio equalization data and the crosstalk cancellation data to obtain target audio data.

[0010] In some embodiments of the present application, determining the crosstalk cancellation data based on the first distance information and the second distance information between the plurality of speakers comprises:

[0011] Determining the angular aperture data of each speaker based on the first distance information and the second distance information between the plurality of speakers;

[0012] Obtaining first transfer function data from a transfer function database based on the angular aperture data of each speaker, the first transfer function data being the transfer function data in the transfer function database that matches the angular aperture data;

[0013] Determining the crosstalk cancellation data based on the first transfer function data.

[0014] In some embodiments of the present application, determining the crosstalk cancellation data based on the first transfer function data comprises:

[0015] conjugate transpose the first transfer function data to obtain second transfer function data;

[0016] determine third transfer function data based on the second transfer function data and the first transfer function data;

[0017] multiply the second transfer function data and the third transfer function data to obtain echo cancellation data.

[0018] In some embodiments of the present application, determining the third transfer function data based on the second transfer function data and the first transfer function data comprises:

[0019] multiply the second transfer function data and the first transfer function data to obtain fourth transfer function data;

[0020] perform weighted summation on the fourth transfer function data and a unit matrix to obtain fifth transfer function data;

[0021] perform inverse matrix operation on the fifth transfer function data to obtain the third transfer function data.

[0022] In some embodiments of the present application, the plurality of loudspeakers comprises a first loudspeaker and a second loudspeaker, the first distance information comprises a first distance value between the first loudspeaker and the listening position and a second distance value between the second loudspeaker and the listening position, the second distance information comprises a third distance value between the first loudspeaker and the second loudspeaker, and determining the horn angle data of each loudspeaker based on the first distance information and the second distance information between the plurality of loudspeakers comprises:

[0023] divide the third distance value by the first parameter to obtain a fourth distance value;

[0024] divide the fourth distance value by the first distance value to obtain a fifth distance value;

[0025] divide the fourth distance value by the second distance value to obtain a sixth distance value;

[0026] perform inverse sine operation on the fifth distance value to obtain the horn angle data of the first loudspeaker;

[0027] perform inverse sine operation on the sixth distance value to obtain the horn angle data of the second loudspeaker.

[0028] In some embodiments of the present application, determining the audio equalization data based on the loudspeaker data comprises:

[0029] perform minimum phase extraction on the loudspeaker data to obtain first data;

[0030] perform inverse operation on the first data to obtain second data;

[0031] The second data is subjected to complex smoothing processing to obtain audio equalization data.

[0032] In some embodiments of the present application, the to-be-processed audio data is processed based on the audio equalization data and the acoustic echo cancellation data to obtain target audio data, including:

[0033] The to-be-processed audio data is decoded to obtain decoded audio data;

[0034] The decoded audio data and the acoustic echo cancellation data are multiplied to obtain first audio data;

[0035] The first audio data is subjected to frequency domain conversion to obtain second audio data;

[0036] The second audio data and the audio equalization data are multiplied to obtain third audio data;

[0037] The third audio data is subjected to time domain conversion to obtain the target audio data.

[0038] In some embodiments of the present application, the method further includes:

[0039] Based on the head image of the listener, it is determined whether the head of the listener rotates;

[0040] When the head of the listener rotates, the Euler angle corresponding to the head of the listener is determined based on the head image;

[0041] The acoustic echo cancellation data is updated based on the Euler angle to obtain updated acoustic echo cancellation data;

[0042] The to-be-processed audio data is processed based on the audio equalization data and the updated acoustic echo cancellation data to obtain target audio data.

[0043] In some embodiments of the present application, the Euler angle corresponding to the head of the listener is determined based on the head image, including:

[0044] The head image is scaled to obtain a scaled head image;

[0045] The pixel value of the scaled head image is normalized to obtain a normalized head image;

[0046] The normalized head image is subjected to channel conversion to obtain a channel-converted head image;

[0047] The channel-converted head image is input into a pose estimation model, and the Euler angle corresponding to the head of the listener is output by the pose estimation model.

[0048] In some embodiments of the present application, the echo cancellation data is updated based on the Euler angle to obtain updated echo cancellation data, including:

[0049] The sixth transfer function data is obtained from the transfer function database based on the Euler angle, and the sixth transfer function data is the transfer function data in the transfer function database that matches the Euler angle;

[0050] The updated echo cancellation data is determined based on the sixth transfer function data.

[0051] In a second aspect, the present application provides an audio processing apparatus, including:

[0052] A data acquisition module is configured to acquire loudspeaker data of a plurality of loudspeakers and first distance information between each loudspeaker and a listening position.

[0053] A first determination module is configured to determine audio equalization data based on the loudspeaker data.

[0054] A second determination module is configured to determine echo cancellation data based on the first distance information and second distance information between the plurality of loudspeakers.

[0055] An audio processing module is configured to process the to-be-processed audio data based on the audio equalization data and the echo cancellation data to obtain target audio data.

[0056] In a third aspect, the present application further provides a display device, including:

[0057] One or more processors;

[0058] A memory; and

[0059] One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the audio processing method of any one of the first aspect.

[0060] In a fourth aspect, the present application further provides a computer readable storage medium having stored thereon a computer program, and the computer program is loaded by a processor to execute the steps in the audio processing method of any one of the first aspect.

[0061] The beneficial effects of the present application are as follows: by obtaining loudspeaker data of multiple loudspeakers and first distance information between each loudspeaker and a listening position, determining the cross-talk cancellation data based on the first distance information and second distance information between the multiple loudspeakers, and processing the to-be-processed audio data based on the cross-talk cancellation data, the cross-talk interference of the multiple loudspeakers can be eliminated, the lateral perception angle of the sound image is expanded, the sound image can be expanded beyond the physical boundary of the loudspeakers without changing the arrangement position of the loudspeakers and avoiding changing the timbre and positioning performance of the playback signal, and the expanded angle can be adjusted; determining the audio equalization data based on the loudspeaker data, and processing the to-be-processed audio data based on the audio equalization data can reduce the influence of the acoustic defects of the playback environment on the playback effect and optimize the actual listening effect of the user. BRIEF DESCRIPTION OF DRAWINGS

[0062] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative effort on the basis of these drawings.

[0063] Figure 1 is a scene schematic diagram of an audio processing system provided by an embodiment of the present application;

[0064] Figure 2 is a flowchart of one embodiment of an audio processing method provided by an embodiment of the present application;

[0065] Figure 3 is a layout schematic diagram of multiple loudspeakers in one embodiment provided by an embodiment of the present application;

[0066] Figure 4 is a flowchart of a specific embodiment of determining cross-talk cancellation data provided by an embodiment of the present application;

[0067] Figure 5 is a layout schematic diagram of multiple loudspeakers in another embodiment provided by an embodiment of the present application;

[0068] Figure 6 is a specific embodiment principle block diagram of an audio processing device provided by an embodiment of the present application;

[0069] Figure 7 is a structure schematic diagram of one embodiment of a display device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0070] With reference to the drawings and the embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments of the present application, any other embodiments obtained by a person of ordinary skill in the art without creative effort are within the scope of the present application.

[0071] In the description of the present application, the terms "first", "second", "third", etc. are used only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second", "third", etc. can explicitly or implicitly include one or more features.

[0072] In the present application, the word "exemplary" is used to mean "serving as an example, instance, or illustration". Any embodiment described as "exemplary" in the present application is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is presented to enable any person skilled in the art to make and use the present application. In the following description, for the purpose of explanation, details are set forth. It is apparent to those skilled in the art that the present application can be practiced without using these specific details. In other instances, well-known structures and processes are not described in detail in order to avoid obscuring the description of the present application. Therefore, the present application is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.

[0073] It should be noted that the method of the embodiments of the present application is executed in the display device, and the processing object of each display device exists in the form of data or information, such as time, which is essentially time information. It can be understood that if the size, quantity, position, etc. are mentioned in the subsequent embodiments, they all exist in the corresponding data for the display device to process, and the specific details are not described here.

[0074] The present application provides an audio processing method, device, equipment and computer readable storage medium, which are described in detail below.

[0075] Please refer to Figure 1 , Figure 1 The scene schematic diagram of the audio processing system provided by the embodiments of the present application can include a display device 100, and the display device 100 is integrated with an audio processing device, such as the display device in Figure 1 .

[0076] The display device 100 in the embodiments of the present application is mainly used to obtain loudspeaker data of a plurality of loudspeakers and first distance information between each loudspeaker and a listening position; determine audio equalization data based on the loudspeaker data; determine crosstalk cancellation data based on the first distance information and second distance information between the plurality of loudspeakers; and process the to-be-processed audio data based on the audio equalization data and the crosstalk cancellation data to obtain target audio data, which can eliminate crosstalk interference of the plurality of loudspeakers, expand a lateral perception angle of a sound image, and expand the sound image beyond a physical boundary of the loudspeakers without changing a loudspeaker arrangement position and avoiding changing timbre and positioning performance of a playback signal, in addition, can reduce the influence of acoustic defects of a playback environment on a playback effect and optimize actual listening effect of a user.

[0077] In the embodiments of the present application, the display device 100 can be a server, a server network or a server cluster composed of servers. For example, the display device 100 described in the embodiments of the present application includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets or a cloud server composed of a plurality of servers. The cloud server is composed of a large number of computers or network servers based on cloud computing.

[0078] It can be understood that the display device 100 used in the embodiments of the present application can be a device that includes receiving and transmitting hardware, that is, a device with receiving and transmitting hardware capable of performing bidirectional communication on a bidirectional communication link. Such a device can include a cellular or other communication device with a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. The display device 100 can be a desktop terminal or a mobile terminal, and the display device 100 can also be one of a smart television, a mobile phone, a tablet computer, a notebook computer and the like.

[0079] Those skilled in the art can understand that the display device 100 used in the embodiments of the present application can be a device that includes receiving and transmitting hardware, that is, a device with receiving and transmitting hardware capable of performing bidirectional communication on a bidirectional communication link. Such a device can include a cellular or other communication device with a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. The display device 100 can be a desktop terminal or a mobile terminal, and the display device 100 can also be one of a smart television, a mobile phone, a tablet computer, a notebook computer and the like. Figure 1 It can be understood that the display device 100 used in the embodiments of the present application can be a device that includes receiving and transmitting hardware, that is, a device with receiving and transmitting hardware capable of performing bidirectional communication on a bidirectional communication link. Such a device can include a cellular or other communication device with a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. The display device 100 can be a desktop terminal or a mobile terminal, and the display device 100 can also be one of a smart television, a mobile phone, a tablet computer, a notebook computer and the like. Figure 1 It can be understood that the display device 100 used in the embodiments of the present application can be a device that includes receiving and transmitting hardware, that is, a device with receiving and transmitting hardware capable of performing bidirectional communication on a bidirectional communication link. Such a device can include a cellular or other communication device with a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. The display device 100 can be a desktop terminal or a mobile terminal, and the display device 100 can also be one of a smart television, a mobile phone, a tablet computer, a notebook computer and the like. Figure 1 It can be understood that the display device 100 used in the embodiments of the present application can be a device that includes receiving and transmitting hardware, that is, a device with receiving and transmitting hardware capable of performing bidirectional communication on a bidirectional communication link. Such a device can include a cellular or other communication device with a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. The display device 100 can be a desktop terminal or a mobile terminal, and the display device 100 can also be one of a smart television, a mobile phone, a tablet computer, a notebook computer and the like.

[0080] In addition, as shown in FIG. 1, the audio processing system can further include a display device 100, a memory 200, a processor 300 and a communication interface 400. Figure 1 The memory 200 is used to store data, such as distance information, for example, first distance information and second distance information, and audio data, for example, to-be-processed audio data and target audio data.

[0081] It should be noted that Figure 1 The scene diagram of the audio processing system shown is only an example, and the audio processing system and the scene described in the embodiments of the present application are used to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art can know that, as the audio processing system evolves and new service scenarios appear, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.

[0082] First, an audio processing method is provided in the embodiments of the present application, the execution subject of the audio processing method is an audio processing device, the audio processing device is applied to a display device, and the audio processing method comprises the following steps: obtaining loudspeaker data of a plurality of loudspeakers and first distance information between each loudspeaker and a listening position; determining audio equalization data based on the loudspeaker data; determining crosstalk cancellation data based on the first distance information and second distance information between the plurality of loudspeakers; and processing the to-be-processed audio data based on the audio equalization data and the crosstalk cancellation data to obtain target audio data.

[0083] As Figure 2 shown, it is an embodiment flow diagram of the audio processing method in the embodiments of the present application, and the audio processing method can comprise the following steps S201-S204, which are as follows:

[0084] Step S201, obtaining loudspeaker data of a plurality of loudspeakers and first distance information between each loudspeaker and a listening position.

[0085] In the embodiments of the present application, the plurality of loudspeakers are loudspeakers arranged on a display device, the display device is a device with a display function, the display device comprises one or more of a television, a tablet computer, a vehicle-mounted display device, a projector, and an AR / VR head-mounted display, the loudspeaker is an electroacoustic transducer that converts an electrical signal (audio signal) into mechanical vibration and then radiates sound waves (sound), and is the core output unit of an audio playback system (such as a sound system, a television, a mobile phone, and a headset), and the number of the plurality of loudspeakers can be 2, 3, 4, or more.

[0086] Further, the listening position is the position of a listener, and the first distance information is used to represent the distance between the position of the listener and the position of each loudspeaker. For example, as shown in Figure 3 The display device comprises a loudspeaker 1, a loudspeaker 2, a loudspeaker 3, and a loudspeaker 4, O represents a listening position, and the first distance information comprises a distance l1 between the loudspeaker 1 and the listening position O, a distance l2 between the loudspeaker 2 and the listening position O, a distance l3 between the loudspeaker 3 and the listening position O, and a distance l4 between the loudspeaker 4 and the listening position O.

[0087] Optionally, the loudspeaker data is loudspeaker data collected by the microphone at the listening position of the user. In some embodiments, the loudspeaker data is obtained by the following steps: taking any loudspeaker in the plurality of loudspeakers as a target loudspeaker, playing a preset length of a logarithmic sine sweep signal through the target loudspeaker; after the target loudspeaker finishes playing, continuing to perform the step of taking any loudspeaker in the plurality of loudspeakers as a target loudspeaker, playing a preset length of a logarithmic sine sweep signal through the target loudspeaker, until all the loudspeakers in the plurality of loudspeakers finish playing the logarithmic sine sweep signal; and obtaining the loudspeaker data collected by the user terminal.

[0088] Further, the loudspeaker data includes a time at which the microphone of the user terminal receives the logarithmic sine sweep signal output by each loudspeaker. Based on the playing time of the logarithmic sine sweep signal and the time at which the microphone receives the logarithmic sine sweep signal output by each loudspeaker, the first distance information can be determined. The first distance information can be determined by the user terminal based on the collected loudspeaker data, and the determined first distance information can be sent to the display device through a network, Bluetooth, infrared, or the like. The first distance information can also be determined by the display device based on the loudspeaker data obtained from the user terminal, and the present embodiment does not limit this.

[0089] S202, determining audio equalization data based on the loudspeaker data.

[0090] In the present embodiment, the audio equalization data is data determined based on the loudspeaker data for equalizing the audio data to be played by each microphone. By equalizing the audio data to be played by each microphone, the influence of the acoustic defects of the playback environment on the playback effect can be reduced, and the actual listening effect of the user can be optimized.

[0091] In some embodiments, the step of determining the audio equalization data based on the loudspeaker data specifically includes: performing minimum phase extraction on the loudspeaker data to obtain first data; performing inverse operation on the first data to obtain second data; and performing complex smoothing processing on the second data to obtain the audio equalization data.

[0092] In the embodiments of the present application, the minimum phase extraction refers to a process of separating and reconstructing an equivalent system with causal stability characteristics and minimum group delay from the frequency response (or time domain response) without changing the amplitude frequency response of the original linear time-invariant system. The minimum phase extraction can be performed on the loudspeaker data based on the Hilbert transform method, the adaptive least mean square (LMS) filtering method, the energy barycenter method, or the Kalman filtering method. The impulse response of any system can be divided into a combination of a minimum phase system and an all-pass system. The loudspeaker data collected by the microphone is not a strict minimum phase system and cannot be directly operated on the inverse. The minimum phase extraction on the loudspeaker data can convert the loudspeaker data into first data that can be directly operated on the inverse.

[0093] Further, the inverse operation refers to a process of constructing a causal stable minimum phase inverse system, so that the cascade of the original system and the inverse system is equivalent to an ideal transmission system with only fixed time delay, thereby offsetting the amplitude distortion, phase distortion and time domain distortion of the signal caused by the original system. Alternatively, the inverse operation can be performed on the first data based on the pole / zero mapping method of the transfer function, the time domain reconstruction method of the Hilbert transform, or the frequency domain equalization method of the Fourier transform. The inverse operation on the first data can equalize the acoustic defects caused by environmental reflection and other factors in the propagation process from the loudspeaker to the listening position.

[0094] In the embodiments of the present application, the complex smoothing processing refers to a signal optimization process of suppressing high-frequency noise and eliminating local mutations while retaining the core characteristics (such as key frequencies and phase trends) of a complex signal containing real and imaginary parts (or amplitudes and phases), so that the real and imaginary parts (or amplitudes and phases) of the complex signal change more smoothly and continuously. Alternatively, the complex smoothing processing can be performed on the second data based on the window function weighted smoothing method, the moving average smoothing method, the amplitude-phase collaborative smoothing method of the Hilbert transform, or the time domain window function convolution smoothing method. The second data obtained by the inverse operation on the first data has a nonlinear phase, which can cause signal distortion and other nonlinear distortion phenomena. The complex smoothing processing on the second data can avoid the generation of nonlinear distortion phenomena. In some embodiments, the complex smoothing processing can be performed with 1 / 3 octave, which can eliminate the nonlinear distortion phenomena such as ringing that may occur in the middle and high frequency parts.

[0095] S203, determine the crosstalk cancellation data based on the first distance information and second distance information between the plurality of loudspeakers.

[0096] In the embodiments of the present application, the second distance information is used to represent the distance between the plurality of loudspeakers. For example, continuing to refer to Figure 3 , the plurality of loudspeakers include loudspeaker 1, loudspeaker 2, loudspeaker 3 and loudspeaker 4, and the second distance information includes the distance r1 between loudspeaker 1 and loudspeaker 4 and the distance r2 between loudspeaker 2 and loudspeaker 3. The crosstalk cancellation data is data determined based on the first distance information and the second distance information for crosstalk cancellation of the audio data to be played by the loudspeakers. Through the crosstalk cancellation of the audio data to be played by the loudspeakers by the crosstalk cancellation data, the crosstalk interference of the plurality of loudspeakers can be eliminated, the lateral perception angle of the sound image can be expanded, and in the case of not changing the arrangement position of the loudspeakers and avoiding changing the timbre and positioning performance of the playback signal, the sound image can be expanded to outside the physical boundary of the loudspeakers, and the expanded angle can be adjusted.

[0097] In some embodiments, referring to Figure 4 , the step S203 of determining the crosstalk cancellation data based on the first distance information and the second distance information between the plurality of loudspeakers can include steps S301-S303, as shown below:

[0098] S301, determine the azimuth angle data of each loudspeaker based on the first distance information and the second distance information between the plurality of loudspeakers.

[0099] In the embodiments of the present application, the azimuth angle data is the horizontal angle of each loudspeaker relative to the listening position. For example, continuing to refer to Figure 3 , the azimuth angle data of loudspeaker 4 is the included angle θ between the line connecting the listening position and loudspeaker 4 and the y-axis.

[0100] In some embodiments, the plurality of loudspeakers include a first loudspeaker and a second loudspeaker, the first distance information includes a first distance value between the first loudspeaker and the listening position and a second distance value between the second loudspeaker and the listening position, and the second distance information includes a third distance value between the first loudspeaker and the second loudspeaker. For example, referring to Figure 3 , the first loudspeaker is loudspeaker 1, the second loudspeaker is loudspeaker 4, the first distance value is l1, the second distance value is l4, and the third distance value is r2. For another example, referring to Figure 5 , the first loudspeaker is loudspeaker 1, the second loudspeaker is loudspeaker 2, the first distance value is l1, the second distance value is l2, and the third distance value is r1.

[0101] Optionally, the step of determining the azimuth data of each loudspeaker based on the first distance information and the second distance information between the plurality of loudspeakers specifically comprises: dividing the third distance value by the first parameter to obtain a fourth distance value; dividing the fourth distance value by the first distance value to obtain a fifth distance value; dividing the fourth distance value by the second distance value to obtain a sixth distance value; performing an inverse sine operation on the fifth distance value to obtain the azimuth data of the first loudspeaker; and performing an inverse sine operation on the sixth distance value to obtain the azimuth data of the second loudspeaker.

[0102] In some embodiments, referring to FIG. 1, Figure 3 As shown in FIG. 1, the first loudspeaker is loudspeaker 1, the second loudspeaker is loudspeaker 4, the first distance value is l1, the second distance value is l4, and the third distance value is r2. The calculation formula of the azimuth data of the first loudspeaker is: The calculation formula of the azimuth data of the second loudspeaker is: wherein θ1 represents the azimuth data of the first loudspeaker, and θ2 represents the azimuth data of the second loudspeaker.

[0103] In other embodiments, the parameter Figure 5 As shown in FIG. 1, the first loudspeaker is loudspeaker 1, the second loudspeaker is loudspeaker 4, the first distance value is l1, the second distance value is l4, and the third distance value is r2. The calculation formula of the azimuth data of the first loudspeaker is: The calculation formula of the azimuth data of the second loudspeaker is: wherein θ1 represents the azimuth data of the first loudspeaker, and θ2 represents the azimuth data of the second loudspeaker.

[0104] S302, acquiring first transfer function data from the transfer function database based on the azimuth data of each loudspeaker, the first transfer function data being the transfer function data in the transfer function database that matches the azimuth data.

[0105] In the embodiments of the present application, the first transfer function data is the transfer function data in the transfer function database that matches the azimuth data, and after the azimuth data of each loudspeaker is determined, the transfer function data that matches the azimuth data can be acquired from the transfer function database.

[0106] S303, determining dereverberation data based on the first transfer function data.

[0107] In some embodiments, the step of determining the dereverberation data based on the first transfer function data specifically comprises: performing conjugate transposition on the first transfer function data to obtain second transfer function data; determining third transfer function data based on the second transfer function data and the first transfer function data; and multiplying the second transfer function data and the third transfer function data to obtain the dereverberation data.

[0108] Optionally, the step of determining the third transfer function data based on the second transfer function data and the first transfer function data specifically comprises: multiplying the second transfer function data and the first transfer function data to obtain fourth transfer function data; performing weighted summation on the fourth transfer function data and a unit matrix to obtain fifth transfer function data; and performing inverse matrix operation on the fifth transfer function data to obtain the third transfer function data.

[0109] In some embodiments, the determination process of the fourth transfer function data can be represented as: C1=H H H, wherein C1 represents the fourth transfer function data, H represents the first transfer function data, H H represents the second transfer function data, and the superscript H represents conjugate transpose.

[0110] In some embodiments, the determination process of the fifth transfer function data can be represented as: C2=αH H H+λI, wherein C2 represents the fifth transfer function data, I represents a unit matrix, α represents weight information, and λ represents a regularization factor. Optionally, 0<α≤1 and 0<λ<1, for example, α=1 and λ=0.001, then C2=H H H+λI.

[0111] In some embodiments, the determination process of the third transfer function data can be represented as: C3=(αH H H+λI) -1 , for example, α=1, then C3=(H H H+λI) -1 . The determination process of the acoustic echo cancellation data can be represented as: C=(αH H H+λI) -1 H H , for example, α=1, then C=(H H H+λI) -1 H H .

[0112] S204, processing the to-be-processed audio data based on the audio equalization data and the acoustic echo cancellation data to obtain target audio data.

[0113] In the embodiments of the present application, the to-be-processed audio data is audio data that needs to be played by multiple loudspeakers, and the target audio data is the to-be-processed audio data processed by the audio equalization data and the cross-talk cancellation data. By processing the to-be-processed audio data by the cross-talk cancellation data, the cross-talk interference of the multiple loudspeakers can be eliminated, the lateral perception angle of the sound image can be expanded, the sound image can be expanded beyond the physical boundary of the loudspeakers without changing the arrangement position of the loudspeakers and avoiding changing the timbre and positioning performance of the playback signal, and the expanded angle can be adjusted. By processing the to-be-processed audio data by the audio equalization data, the influence of the acoustic defects of the playback environment on the playback effect can be reduced, and the actual listening effect of the user can be optimized.

[0114] In some embodiments, the step of processing the to-be-processed audio data based on the audio equalization data and the cross-talk cancellation data to obtain the target audio data specifically includes: decoding the to-be-processed audio data to obtain decoded audio data; multiplying the decoded audio data and the cross-talk cancellation data to obtain first audio data; performing frequency domain conversion on the first audio data to obtain second audio data; multiplying the second audio data and the audio equalization data to obtain third audio data; and performing time domain conversion on the third audio data to obtain the target audio data.

[0115] In the embodiments of the present application, decoding refers to the process of restoring the encoded and compressed digital audio data (such as MP3, FLAC, AAC, etc.) to the original digital audio stream (or analog audio signal) that can be recognized and played by hardware (such as a DAC digital-to-analog converter, a loudspeaker) through a specific algorithm. The to-be-processed audio data can be decoded by software or by a dedicated chip (such as a decoding chip or a decoding module in an SoC).

[0116] Further, frequency domain conversion refers to the process of converting the first audio data from the time domain to the frequency domain. The first audio data can be converted to the frequency domain by discrete cosine transform, cepstrum transform, discrete Fourier transform, fast Fourier transform, or the like.

[0117] In the embodiments of the present application, time domain conversion refers to the process of converting the third audio data from the frequency domain to the time domain. Optionally, the third audio data can be converted to the time domain based on inverse discrete Fourier transform, inverse fast Fourier transform, inverse discrete cosine transform, or the like.

[0118] In some embodiments, the step of processing the to-be-processed audio data based on the audio equalization data and the updated dereverberation data to obtain the target audio data comprises: decoding the to-be-processed audio data to obtain decoded audio data; performing frequency domain conversion on the decoded audio data to obtain fourth audio data; multiplying the fourth audio data and the audio equalization data to obtain fifth audio data; performing time domain conversion on the fifth audio data to obtain sixth audio data; and multiplying the sixth audio data and the updated dereverberation data to obtain the target audio data.

[0119] In some embodiments, the audio processing method further comprises: determining whether the listener's head rotates based on the head image of the listener; when the listener's head rotates, determining the Euler angle corresponding to the listener's head based on the head image; updating the dereverberation data based on the Euler angle to obtain updated dereverberation data; and processing the to-be-processed audio data based on the audio equalization data and the updated dereverberation data to obtain the target audio data. In this embodiment, the to-be-processed audio data is processed based on the audio equalization data and the updated dereverberation data, which can dynamically eliminate the interference of the multi-speaker dereverberation, expand the lateral perception angle of the sound image, and adapt to different head orientations of the listener.

[0120] In the embodiments of the present application, the head image of the listener is an image corresponding to the head of the listener. Optionally, the listener's head rotation can be determined based on a face key feature point detection method, or based on a head contour / region template matching method, or based on a deep learning head pose estimation method.

[0121] Further, the Euler angle is an angle parameter used to describe the rotation state of a rigid body (such as the head of the listener) around three orthogonal coordinate axes (which usually correspond to the three-dimensional motion dimensions of the head). In some embodiments, the step of determining the Euler angle corresponding to the listener's head based on the head image comprises: scaling the head image to obtain a scaled head image; normalizing the pixel value of the scaled head image to obtain a normalized head image; performing channel conversion on the normalized head image to obtain a channel-converted head image; and inputting the channel-converted head image into a pose estimation model to output the Euler angle corresponding to the listener's head through the pose estimation model. In this embodiment, the head image is scaled, normalized and channel-converted, and then the channel-converted head image is input into the pose estimation model for Euler angle estimation, which can improve the accuracy of the determined Euler angle. The pose estimation model outputs the Euler angle corresponding to the listener's head, which can improve the accuracy and efficiency of the determination of the Euler angle.

[0122] In the embodiments of the present application, scaling refers to adjusting the size (i.e., width and height) of the image through an algorithm, under the premise of maintaining or optimizing the visual information of the image, so that the image size meets the specific application requirements (such as adapting to the display device, reducing the storage volume, improving the subsequent processing efficiency, etc.). For example, the head image can be scaled to 256*256, so that the head image can meet the input requirements of the pose estimation model.

[0123] Further, normalization refers to a preprocessing operation of mapping the original numerical values (such as brightness, RGB channel values) of all pixels in the image to a unified and fixed numerical value interval (for example, [0, 1] or [-1, 1]) through a specific mathematical transformation. For example, the pixel values of all pixels in the head image are divided by 255. By normalizing the pixel values of the head image, the dimensional difference and numerical range fluctuation of the pixel values can be eliminated, the accuracy of the determined Euler angle can be improved, and the accuracy of the audio processing can be improved.

[0124] In the embodiments of the present application, channel conversion refers to the process of converting the original color channel mode (such as grayscale, CMYK, HSV, YUV, etc.) of the image to the RGB channel mode through a specific algorithm or rule. By converting the channels of the head image, the converted head image can be adapted to the pose estimation model, thereby improving the accuracy and stability of the Euler angle estimation.

[0125] Further, the pose estimation model is a pre-trained neural network model for determining the Euler angle corresponding to the head based on the head image. The input of the pose estimation model is the head image, and the output of the pose estimation model is the Euler angle corresponding to the head. In some embodiments, the pose estimation model uses a Wide Headpose Estimation Network (WHENet) neural network model. The Wide Headpose Estimation Network (WHENet) neural network model is based on an end-to-end head pose recognition open source library, has the characteristics of fast recognition and strong real-time performance, and has a high recognition rate, which can meet the updating requirements of the derezaing data.

[0126] In some embodiments, the step of updating the derezaing data based on the Euler angle to obtain updated derezaing data specifically includes: obtaining sixth transfer function data from the transfer function database based on the Euler angle, the sixth transfer function data being the transfer function data in the transfer function database that matches the Euler angle; and determining the updated derezaing data based on the sixth transfer function data.

[0127] In the embodiments of the present application, the step of determining the updated crosstalk cancellation data based on the sixth transfer function data is the same as the step of determining the crosstalk cancellation data based on the first transfer function data, and details can be referred to the aforementioned step of determining the crosstalk cancellation data based on the first transfer function data. To avoid repetition, the embodiments will not be described here again.

[0128] Further, the step of processing the to-be-processed audio data based on the audio equalization data and the updated crosstalk cancellation data to obtain the target audio data is the same as the aforementioned step of processing the to-be-processed audio data based on the audio equalization data and the crosstalk cancellation data to obtain the target audio data, and details can be referred to the aforementioned step of processing the to-be-processed audio data based on the audio equalization data and the crosstalk cancellation data to obtain the target audio data. The embodiments will not be described here again.

[0129] To better implement the audio processing method in the embodiments of the present application, on the basis of the audio processing method, the embodiments of the present application further provide an audio processing device, as shown in the figure, the audio processing device 600 comprises: Figure 6 As shown in the figure, the audio processing device 600 comprises:

[0130] The data acquisition module 610 is configured to acquire the loudspeaker data of the plurality of loudspeakers and the first distance information between each loudspeaker and the listening position.

[0131] The first determination module 620 is configured to determine the audio equalization data based on the loudspeaker data.

[0132] The second determination module 630 is configured to determine the crosstalk cancellation data based on the first distance information and the second distance information between the plurality of loudspeakers.

[0133] The audio processing module 640 is configured to process the to-be-processed audio data based on the audio equalization data and the crosstalk cancellation data to obtain the target audio data.

[0134] In the embodiments of the present application, by acquiring the loudspeaker data of the plurality of loudspeakers and the first distance information between each loudspeaker and the listening position, determining the crosstalk cancellation data based on the first distance information and the second distance information between the plurality of loudspeakers, and processing the to-be-processed audio data based on the crosstalk cancellation data, the crosstalk interference of the plurality of loudspeakers can be eliminated, the lateral perception angle of the sound image can be expanded, the sound image can be expanded beyond the physical boundary of the loudspeakers without changing the arrangement position of the loudspeakers and avoiding changing the timbre and positioning performance of the playback signal, and the expanded angle can be adjusted. By determining the audio equalization data based on the loudspeaker data and processing the to-be-processed audio data based on the audio equalization data, the influence of the acoustic defects of the playback environment on the playback effect can be reduced, and the actual listening effect of the user can be optimized.

[0135] In some embodiments of the present application, the first determination module 620 is specifically configured to:

[0136] performing minimum phase extraction on the loudspeaker data to obtain first data;

[0137] performing inverse operation on the first data to obtain second data;

[0138] performing complex smoothing on the second data to obtain audio equalization data.

[0139] In some embodiments of the present application, the second determination module 630 is specifically further configured to:

[0140] determine the angle data of each loudspeaker based on the first distance information and second distance information between the plurality of loudspeakers;

[0141] obtain the first transfer function data from the transfer function database based on the angle data of each loudspeaker, the first transfer function data being the transfer function data in the transfer function database that matches the angle data;

[0142] determine the crosstalk cancellation data based on the first transfer function data.

[0143] In some embodiments, the second capacity determination module 630 is specifically further configured to:

[0144] perform conjugate transpose on the first transfer function data to obtain second transfer function data;

[0145] determine third transfer function data based on the second transfer function data and the first transfer function data;

[0146] multiply the second transfer function data and the third transfer function data to obtain the crosstalk cancellation data.

[0147] In some embodiments, the second capacity determination module 630 is specifically further configured to:

[0148] multiply the second transfer function data and the first transfer function data to obtain fourth transfer function data;

[0149] perform weighted summation on the fourth transfer function data and the unit matrix to obtain fifth transfer function data;

[0150] perform inverse matrix operation on the fifth transfer function data to obtain the third transfer function data.

[0151] In some embodiments, the plurality of loudspeakers includes a first loudspeaker and a second loudspeaker, the first distance information includes a first distance value between the first loudspeaker and the listening position and a second distance value between the second loudspeaker and the listening position, the second distance information includes a third distance value between the first loudspeaker and the second loudspeaker, and the second determination module is specifically further configured to:

[0152] divide the third distance value by the first parameter to obtain a fourth distance value;

[0153] divide the fourth distance value by the first distance value to obtain a fifth distance value;

[0154] divide the fourth distance value by the second distance value to obtain a sixth distance value;

[0155] perform an inverse sine operation on the fifth distance value to obtain the opening angle data of the first loudspeaker;

[0156] perform an inverse sine operation on the sixth distance value to obtain the opening angle data of the second loudspeaker.

[0157] In some embodiments, the audio processing module 640 is specifically configured to:

[0158] decode the to-be-processed audio data to obtain decoded audio data;

[0159] multiply the decoded audio data and the acoustic echo cancellation data to obtain first audio data;

[0160] perform frequency domain conversion on the first audio data to obtain second audio data;

[0161] multiply the second audio data and the audio equalization data to obtain third audio data;

[0162] perform time domain conversion on the third audio data to obtain target audio data.

[0163] In some embodiments, the audio processing apparatus 600 further includes:

[0164] a third determination module configured to determine, based on the head image of the listener, whether the head of the listener rotates;

[0165] a fourth determination module configured to, when the head of the listener rotates, determine, based on the head image, the Euler angle corresponding to the head of the listener;

[0166] a data updating module configured to update the acoustic echo cancellation data based on the Euler angle to obtain updated acoustic echo cancellation data;

[0167] The audio processing module is further configured to process the to-be-processed audio data based on the audio equalization data and the updated acoustic echo cancellation data to obtain target audio data.

[0168] In some embodiments, the fourth determination module is specifically configured to:

[0169] scale the head image to obtain a scaled head image;

[0170] The pixel values of the scaled head image are normalized to obtain a normalized head image.

[0171] The normalized head image is channel converted to obtain a channel-converted head image.

[0172] The channel-converted head image is input into the pose estimation model, and the Euler angles corresponding to the listener's head are output by the pose estimation model.

[0173] In some embodiments, the data updating module is specifically configured to:

[0174] Based on the Euler angles, sixth transfer function data is obtained from the transfer function database, the sixth transfer function data being transfer function data in the transfer function database that matches the Euler angles.

[0175] Based on the sixth transfer function data, updated cross-talk cancellation data is determined.

[0176] Embodiments of the present application also provide a display device integrating any of the audio processing apparatuses provided by embodiments of the present application. The display device includes:

[0177] one or more processors;

[0178] a memory; and

[0179] one or more application programs, wherein the one or more application programs are stored in the memory and configured to execute, by the processor, the steps in the audio processing method in any of the audio processing method embodiments.

[0180] Embodiments of the present application also provide a display device integrating any of the audio processing apparatuses provided by embodiments of the present application. As shown in Figure 7 the structure of the display device related by embodiments of the present application is shown, specifically:

[0181] The display device can include a processor 801 with one or more processing cores, a memory 802 with one or more computer readable storage media, a power supply 803, and an input unit 804, and the like. Those skilled in the art can understand that the structure of the display device shown in Figure 7 does not constitute a limitation on the display device, and can include more or fewer components than shown, or combine certain components, or different component arrangements. Among them:

[0182] The processor 801 is the control center of the display device, connects various parts of the display device through various interfaces and lines, and performs various functions and processes data of the display device by running or executing software programs and / or modules stored in the memory 802 and calling data stored in the memory 802, thereby monitoring the display device as a whole. Optionally, the processor 801 can include one or more processing cores; preferably, the processor 801 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application program, and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 801.

[0183] The memory 802 can be used to store software programs and modules, and the processor 801 executes various functions and data processing by running the software programs and modules stored in the memory 802. The memory 802 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), and the like; the data storage area can store data created according to the use of the display device, etc. In addition, the memory 802 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. Accordingly, the memory 802 can also include a memory controller to provide access for the processor 801 to the memory 802.

[0184] The display device further includes a power supply 803 for supplying power to various components, and preferably, the power supply 803 can be logically connected to the processor 801 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The power supply 803 can also include one or more than one direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power state indicator, and any other components.

[0185] The display device can also include an input unit 804, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.

[0186] Although not shown, the display device can also include a display unit and the like, which will not be described here. Specifically, in the present embodiment, the processor 801 in the display device will load the executable file corresponding to the process of one or more than one application program into the memory 802 according to the following instructions, and run the application program stored in the memory 802 by the processor 801, thereby realizing various functions, as follows:

[0187] obtain loudspeaker data of a plurality of loudspeakers and first distance information between each loudspeaker and a listening position;

[0188] determine audio equalization data based on the loudspeaker data;

[0189] determine crosstalk cancellation data based on the first distance information and second distance information between the plurality of loudspeakers;

[0190] process the to-be-processed audio data based on the audio equalization data and the crosstalk cancellation data to obtain target audio data.

[0191] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by related hardware controlled by the instructions, which can be stored in a computer readable storage medium and loaded and executed by a processor.

[0192] To this end, the embodiments of the present application provide a computer readable storage medium, which can include a read only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc. A computer program is stored on the storage medium, and the computer program is loaded by a processor to execute the steps in any of the audio processing methods provided by the embodiments of the present application. For example, the computer program loaded by the processor can execute the following steps:

[0193] obtain loudspeaker data of a plurality of loudspeakers and first distance information between each loudspeaker and a listening position;

[0194] determine audio equalization data based on the loudspeaker data;

[0195] determine crosstalk cancellation data based on the first distance information and second distance information between the plurality of loudspeakers;

[0196] process the to-be-processed audio data based on the audio equalization data and the crosstalk cancellation data to obtain target audio data.

[0197] In the above embodiments, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the detailed description of other embodiments above, which will not be repeated here.

[0198] In specific implementation, the above various units or structures can be implemented as independent entities, or can be combined as the same or several entities, and the specific implementation of the above various units or structures can be referred to the method embodiments above, which will not be repeated here.

[0199] The specific implementation of each operation can refer to the foregoing embodiments, which will not be described here again.

[0200] The foregoing describes in detail the audio processing method, device, equipment and computer readable storage medium provided by the embodiments of the present application. The principles and implementation manners of the present application are described by applying specific examples in this paper. The foregoing embodiment description is only used to help understand the method and core idea of the present application. Meanwhile, for those skilled in the art, the specific implementation manner and application range will be changed according to the idea of the present application. In summary, the content of the specification should not be understood as a limitation of the present application.

Claims

1. An audio processing method, characterized in that, include: Acquire speaker data from multiple speakers and first distance information between each speaker and the listening position; Based on the speaker data, determine the audio equalization data; Based on the first distance information and the second distance information between the plurality of speakers, crosstalk cancellation data is determined; The audio data to be processed is obtained by processing the audio equalization data and the crosstalk cancellation data to obtain the target audio data.

2. The audio processing method according to claim 1, characterized in that, The step of determining crosstalk cancellation data based on the first distance information and the second distance information between the plurality of speakers includes: Based on the first distance information and the second distance information between the plurality of loudspeakers, the sub-angle data of each loudspeaker is determined; Based on the opening angle data of each of the loudspeakers, first transfer function data is obtained from the transfer function database, wherein the first transfer function data is the transfer function data in the transfer function database that matches the opening angle data; Based on the first transfer function data, crosstalk cancellation data is determined.

3. The audio processing method according to claim 2, characterized in that, The step of determining crosstalk cancellation data based on the first transfer function data includes: The first transfer function data is conjugate transposed to obtain the second transfer function data; Based on the second transfer function data and the first transfer function data, the third transfer function data is determined; The second transfer function data and the third transfer function data are multiplied together to obtain crosstalk cancellation data.

4. The audio processing method according to claim 3, characterized in that, The step of determining the third transfer function data based on the second transfer function data and the first transfer function data includes: Multiply the second transfer function data and the first transfer function data to obtain the fourth transfer function data; The fifth transfer function data is obtained by weighted summation of the fourth transfer function data and the identity matrix; The third transfer function data is obtained by performing an inverse matrix operation on the fifth transfer function data.

5. The audio processing method according to claim 2, characterized in that, The plurality of loudspeakers include a first loudspeaker and a second loudspeaker, the first distance information includes a first distance value between the first loudspeaker and the listening position and a second distance value between the second loudspeaker and the listening position, and the second distance information includes a third distance value between the first loudspeaker and the second loudspeaker; The step of determining the sub-angle data of each speaker based on the first distance information and the second distance information between the plurality of speakers includes: Divide the third distance value by the first parameter to obtain the fourth distance value; Divide the fourth distance value by the first distance value to obtain the fifth distance value; Divide the fourth distance value and the second distance value to obtain the sixth distance value; Perform an arcsine operation on the fifth distance value to obtain the sub-angle data of the first loudspeaker; Perform an arcsine operation on the sixth distance value to obtain the sub-angle data of the second loudspeaker.

6. The audio processing method according to claim 1, characterized in that, The step of determining audio equalization data based on the speaker data includes: Minimum phase extraction is performed on the speaker data to obtain the first data; Invert the first data to obtain the second data; The second data is subjected to complex smoothing to obtain audio equalization data.

7. The audio processing method according to claim 1, characterized in that, The process of processing the audio data to be processed based on the audio equalization data and the crosstalk cancellation data to obtain the target audio data includes: The audio data to be processed is decoded to obtain decoded audio data; The decoded audio data and the crosstalk cancellation data are multiplied together to obtain the first audio data; The first audio data is frequency domain converted to obtain the second audio data; The second audio data and the audio equalization data are multiplied to obtain the third audio data; The third audio data is time-domain converted to obtain the target audio data.

8. The audio processing method according to claim 1, characterized in that, The method further includes: Determine whether the listener's head has rotated based on the listener's head image; When the listener's head rotates, the Euler angle corresponding to the listener's head is determined based on the head image; The crosstalk cancellation data is updated based on the Euler angles to obtain the updated crosstalk cancellation data; The audio data to be processed is obtained by processing the audio equalization data and the updated crosstalk cancellation data to obtain the target audio data.

9. The audio processing method according to claim 8, characterized in that, Determining the Euler angle corresponding to the listener's head based on the head image includes: The head image is scaled to obtain a scaled head image; The pixel values ​​of the scaled head image are normalized to obtain a normalized head image. The normalized head image is subjected to channel conversion to obtain a channel-converted head image; The head image after channel conversion is input into the pose estimation model, and the pose estimation model outputs the Euler angle corresponding to the listener's head.

10. The audio processing method according to claim 8, characterized in that, The step of updating the crosstalk cancellation data based on the Euler angles to obtain updated crosstalk cancellation data includes: The sixth transfer function data is obtained from the transfer function database based on the Euler angle. The sixth transfer function data is the transfer function data in the transfer function database that matches the Euler angle. Based on the sixth transfer function data, the updated crosstalk cancellation data is determined.

11. An audio processing apparatus, characterized in that, include: The data acquisition module is used to acquire speaker data of multiple speakers and first distance information between each speaker and the listening position; The first determining module is used to determine audio equalization data based on the speaker data; The second determining module is used to determine crosstalk cancellation data based on the first distance information and the second distance information between the plurality of speakers; The audio processing module is used to process the audio data to be processed based on the audio equalization data and the crosstalk cancellation data to obtain the target audio data.

12. A display device, characterized in that, The display device includes: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the audio processing method of any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that, It stores a computer program, which is loaded by a processor to perform the steps of the audio processing method according to any one of claims 1 to 10.

Images