Audio playback method, terminal device, storage medium and program product

Abstract

The embodiment of the present application provides an audio playback method, a terminal device, a storage medium and a program product, which relates to the field of audio processing technology. The above method is applied to a terminal device, and the terminal device is configured with a left speaker, a right speaker and a plurality of bottom speakers. The method includes: parsing the audio data to obtain the channel data included in the audio data; mixing the obtained channel data to obtain the target left channel data and the target right channel data, and determining the target left surround channel data and the target right surround channel data based on the obtained channel data; controlling the left speaker to play the target left channel data, controlling the right speaker to play the target right channel data, and controlling the left and right speakers in the bottom speaker to play the target left surround channel data and the target right surround channel data respectively. The application of the scheme provided in the embodiment of the present application to play audio can bring an immersive and shocking effect to the user when the terminal device plays the audio externally.

Description

Technical Field

[0001] The present application relates to the field of audio processing technology, and in particular to an audio playback method, terminal equipment, storage medium and program product. Background Art

[0002] Mobile phones, tablet computers and other terminal devices can run a variety of applications such as audio and video APPs (Applications), game APPs, etc. When running these APPs, users usually choose to use external speakers to play audio and video and game audio. Therefore, the effect of external audio directly affects the overall experience brought to users by the terminal device. In view of this, in order to bring users an immersive and shocking effect when the terminal device plays audio externally, it is necessary to provide an audio playback solution. Summary of the invention

[0003] In view of this, the present application provides an audio playback method, a terminal device, a storage medium and a program product, so that when the device plays audio externally, it can bring an immersive and shocking effect to the user.

[0004] In a first aspect, an embodiment of the present application provides an audio playback method, which is applied to a terminal device, wherein the terminal device is configured with a left speaker, a right speaker, and a plurality of bottom speakers, and the bottom speakers are symmetrically distributed on the left and right sides, and the method includes:

[0005] Parsing the audio data to obtain channel data included in the audio data;

[0006] Performing mixing processing on the obtained channel data to obtain target left channel data and target right channel data, and determining target left surround channel data and target right surround channel data based on the obtained channel data;

[0007] The left speaker is controlled to play the target left channel data, the right speaker is controlled to play the target right channel data, and the left and right speakers of the bottom speaker are controlled to play the target left surround channel data and the target right surround channel data respectively.

[0008] In the solution provided in the embodiment of the present application, the terminal device is configured with a left speaker, a right speaker and multiple bottom speakers, and the bottom speakers are symmetrically distributed on the left and right. Based on this, when the terminal device plays audio, after obtaining the channel data included in the audio data, the channel data is mixed to obtain the target left channel data and the target right channel data, and based on the obtained channel data, the target left surround channel data and the target right surround channel data are determined. After obtaining these four channel data, the left speaker is controlled to play the target left channel data, the right speaker is controlled to play the target right channel data, and the speakers on the left and right sides of the bottom speakers are controlled to play the target left surround channel data and the target right surround channel data respectively.

[0009] Since the terminal device is generally placed on a flat surface such as a desktop, when the terminal device plays audio, the audio played by the bottom speaker will be reflected by the plane when it propagates in the air, and then the reflected audio enters the user's ears. In this way, there is a time difference between the audio played by the left and right speakers and the audio played by the bottom speaker, thereby forming a sound delay and producing an audio reverberation effect, allowing the user to hear audio with surround sound effects. In this way, the terminal device can bring an immersive and shocking effect to the user when playing audio externally.

[0010] In one embodiment of the present application, the mixing process is performed on the obtained channel data to obtain target left channel data and target right channel data, including:

[0011] Determining vocal data based on the acquired vocal tract data;

[0012] Performing mixing processing on the initial left channel data and the human voice data in the obtained channel data to obtain target left channel data;

[0013] The initial right channel data in the obtained channel data and the human voice data are mixed to obtain target right channel data.

[0014] In the solution provided by this embodiment, the initial left channel data and the human voice data are mixed, so that the data belonging to the human voice in the target left channel data is enhanced; the initial right channel data and the human voice data are mixed, so that the data belonging to the human voice in the target right channel data is enhanced, so that the target left channel data is played in the left speaker and the target right channel data is played in the right speaker, which can make the human voice in the audio played by the speakers more prominent, so that the user can clearly hear the human voice in the audio, thereby improving the user's auditory experience.

[0015] In one embodiment of the present application, determining the human voice data based on the obtained vocal channel data includes:

[0016] The initial left channel data and the initial right channel data are respectively subjected to vocal separation, and the separated data are subjected to mixing processing to obtain vocal data.

[0017] In the solution provided by the present embodiment, the initial left channel data and the initial right channel data in the obtained channel data are respectively subjected to vocal separation, and the data belonging to the human voice in the initial left channel data and the initial right channel data can be accurately separated. In this way, the separated data are mixed and the human voice data can be accurately obtained, so that the relatively accurate human voice data can be used for subsequent mixing processing, and relatively accurate target left channel data and target right channel data after enhancing the human voice can be obtained. Then, the left speaker plays the target left channel data, and the right speaker plays the target right channel data, so that the user can clearly hear the human voice, thereby improving the user's auditory experience.

[0018] In one embodiment of the present application, determining the human voice data based on the obtained vocal channel data includes:

[0019] The center channel data among the obtained channel data is determined as vocal data.

[0020] In the solution provided by this embodiment, since the audio data of the channel type corresponding to the number of channels being greater than or equal to five already includes the initial center channel data, for the audio data of the channel type corresponding to the number of channels being greater than or equal to five, after parsing the channel data contained in the audio data, the center channel data in the obtained channel data can be directly determined as vocal data, without the need to perform steps such as vocal separation and mixing processing, thereby improving the efficiency of determining vocal data and further improving the efficiency of audio playback.

[0021] In one embodiment of the present application, the mixing process of the initial left channel data and the human voice data in the obtained channel data to obtain the target left channel data includes:

[0022] Mixing the human voice data of a preset proportion with the initial left channel data in the obtained channel data to obtain target left channel data;

[0023] The mixing process is performed on the initial right channel data in the obtained channel data and the human voice data to obtain the target right channel data, including:

[0024] The human voice data of the preset ratio is mixed with the initial right channel data in the obtained channel data to obtain target right channel data.

[0025] In the solution provided in this embodiment, a preset proportion of human voice data is mixed into the initial left channel data, and a preset proportion of human voice data is mixed into the initial right channel data, rather than mixing the entire human voice data into the initial left channel data and the initial right channel data, so that the human voice and other sounds are balanced when the mixed data is played, avoiding the abruptness of the human voice, and at the same time increasing the volume of the audio played by the speaker, thereby improving the user's auditory experience. In addition, the same proportion of human voice data is mixed into the initial left channel data and the initial right channel data, so that the user can produce the effect of the human voice being centered when listening to the audio played by the speaker, further improving the user's auditory experience.

[0026] In one embodiment of the present application, determining target left surround channel data and target right surround channel data based on the obtained channel data includes:

[0027] Data below a preset frequency in the initial left channel data in the obtained channel data is filtered out, and the initial left channel data after the filtered data is delayed to obtain target left surround channel data; data below a preset frequency in the initial right channel data in the obtained channel data is filtered out, and the initial right channel data after the filtered data is delayed to obtain target right surround channel data.

[0028] In the solution provided by this embodiment, after filtering out the data below the preset frequency in the two types of data, the data with higher frequencies is retained in the obtained data, so that when the speaker plays such data, the user can hear audio with surround sound effects. In addition, after filtering out the data, the data is also delayed, so that the bottom speaker can delay the audio playback, so that there is a deviation between the time when the user hears the audio played by the left and right speakers and the time when the user hears the audio played by the bottom speaker, thereby forming a sound delay and generating an audio reverberation effect, so that the user can hear the audio with surround sound effects, so that the terminal device can also bring an immersive and shocking effect to the user when playing audio externally.

[0029] In one embodiment of the present application, determining target left surround channel data and target right surround channel data based on the obtained channel data includes:

[0030] The target left surround channel data is determined based on the initial left surround channel data in the obtained channel data, and the target right surround channel data is determined based on the initial right surround channel data in the obtained channel data.

[0031] In the solution provided by this embodiment, based on the initial left surround channel data, the target left surround channel data can be accurately determined, and based on the initial right surround channel data, the target right surround channel data can be accurately determined, thereby controlling the bottom speaker to play the target left surround channel data and the target right surround channel data, so that the user can hear audio with surround sound effects, so that the terminal device can bring an immersive and shocking effect to the user when playing audio externally.

[0032] In one embodiment of the present application, the delay processing of the initial left channel data after filtering the data includes:

[0033] Delay processing is performed on the initial left channel data after the data is filtered out according to the delay duration determined by the device parameters of the terminal device;

[0034] The delay processing of the initial right channel data after filtering the data includes:

[0035] According to the delay time, the initial right channel data after the filtered data is delayed.

[0036] In the solution provided in this embodiment, a delay duration matching the terminal device can be determined based on the device parameters of the terminal device. In this way, the initial left channel data and the initial right channel data after filtering the data are delayed according to the delay duration, and the target left surround channel data and the target right surround channel data matching the terminal device can be obtained. In this way, the bottom speaker is controlled to play the target left surround channel data and the target right surround channel data, which can produce a better audio reverberation effect, thereby improving the user's auditory experience.

[0037] In one embodiment of the present application, the delay duration is determined based on the reflection time, wherein the reflection time is: the duration from when the bottom speaker emits audio to when it receives the audio reflected by the plane on which the terminal device is placed, and the duration is determined based on the device parameters of the terminal device.

[0038] In the solution provided by this embodiment, the delay duration is determined based on the reflection time, which can ensure that the duration between the moment when the user hears the audio played by the left and right speakers and the moment when the user hears the audio played by the bottom speaker is always consistent. If the duration between these two moments is consistent, the surround sound effect produced by the audio heard by the user will also be consistent, thereby providing the user with a stable surround sound effect and improving the user's auditory experience.

[0039] In one embodiment of the present application, determining target left surround channel data based on initial left surround channel data in the obtained channel data includes:

[0040] Delaying the initial left surround channel data in the obtained channel data to obtain target left surround channel data;

[0041] The step of determining target right surround channel data based on initial right surround channel data in the obtained channel data comprises:

[0042] Delay processing is performed on initial right surround channel data in the obtained channel data to obtain target right surround channel data.

[0043] In the solution provided in this embodiment, delay processing is performed on the initial left surround channel data and the initial right surround channel data, which can enhance the surround sound effect produced by the audio emitted by the bottom speaker, thereby improving the user's auditory experience.

[0044] In one embodiment of the present application, the mixing process is performed on the obtained channel data to obtain target left channel data and target right channel data, and based on the obtained channel data, target left surround channel data and target right surround channel data are determined, including:

[0045] If the number of channels corresponding to the obtained channel data is greater than a preset number, performing channel downmixing processing on the obtained channel data to obtain channel data corresponding to a preset channel type;

[0046] The channel data obtained by the downmixing process is mixed to obtain target left channel data and target right channel data, and target left surround channel data and target right surround channel data are determined based on the channel data obtained by the downmixing process.

[0047] In the solution provided by this embodiment, when the number of channels corresponding to the obtained channel data is greater than the preset number, the obtained channel data is first downmixed into channel data corresponding to the preset channel type, and then the channel data obtained by the downmixing process is mixed, so that the target left channel data and the target right channel data can be accurately obtained. Based on the channel data obtained by the downmixing process, the target left surround channel data and the target right surround channel data can be accurately determined, so as to control the bottom speaker to play the target left surround channel data and the target right surround channel data, so that the user can hear audio with surround sound effect, so that the terminal device can bring an immersive and shocking effect to the user when playing audio externally.

[0048] Furthermore, the solution provided in this embodiment does not need to configure a conversion solution for converting the channel data included in the audio data into the above-mentioned four channel data for each channel type of audio data, thereby not occupying too many device resources of the terminal device, thereby saving the resources occupied by the terminal device for playing audio.

[0049] In one embodiment of the present application, the method further includes:

[0050] Based on the result of parsing the audio data, obtaining the channel type of the audio data;

[0051] The mixing process is performed on the obtained channel data to obtain target left channel data and target right channel data, and based on the obtained channel data, target left surround channel data and target right surround channel data are determined, including:

[0052] Determine a mixing mode corresponding to the channel type, and perform mixing processing on the obtained channel data according to the mixing mode to obtain target left channel data and target right channel data;

[0053] Determine a surround channel data acquisition method corresponding to the channel type, and determine target left surround channel data and target right surround channel data based on the acquired channel data and in accordance with the surround channel data acquisition method.

[0054] In the solution provided by the present embodiment, since there are fewer channel types of mainstream audio data, the mixing methods and surround channel data acquisition methods corresponding to multiple channel types can be predetermined. In this way, when obtaining the above-mentioned target left channel data, target right channel data, and target left surround channel data based on the target right surround channel data, the mixing method and surround channel data acquisition method corresponding to the channel type can be determined according to the channel type of the audio data, and the target left channel data, target right channel data, and target left surround channel data can be accurately obtained by using the determined mixing method and surround channel data acquisition method, so as to control the left speaker to play the target left channel data, control the right speaker to play the target right channel data, and control the left and right speakers of the bottom speaker to play the target left surround channel data and the target right surround channel data respectively, so that the user can hear the audio with surround sound effect, so that the terminal device can bring an immersive and shocking effect to the user when playing audio externally.

[0055] In a second aspect, an embodiment of the present application further provides a terminal device, the terminal device comprising: a left speaker, a right speaker, a plurality of bottom speakers, a memory for storing computer program instructions, and a processor for executing program instructions; wherein,

[0056] The bottom speakers are symmetrically distributed left and right;

[0057] When the computer program instructions are executed by the processor, the processor is triggered to execute any method described in the first aspect above.

[0058] In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any of the methods described in the first aspect above.

[0059] In a fourth aspect, an embodiment of the present application further provides a computer program product, wherein the computer program product comprises executable instructions, and when the executable instructions are executed on a computer, the computer executes any of the methods described in the first aspect above.

[0060] In the fifth aspect, an embodiment of the present application also provides a chip system, which is applied to a terminal device, wherein the terminal device is configured with a left speaker, a right speaker and multiple bottom speakers, and the bottom speakers are symmetrically distributed on the left and right. The chip system includes one or more processors, and the processor is used to call computer instructions so that the terminal device inputs audio data into the chip system, and executes any of the methods described in the first aspect above to realize audio playback.

[0061] The beneficial effects of the solutions provided by the embodiments in the second, third, fourth and fifth aspects can refer to the beneficial effects of the solutions provided by the embodiments in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0063] Figure 1 A schematic diagram of the structure of a first terminal device provided in an embodiment of the present application;

[0064] Figure 2 A software structure block diagram of a terminal device provided in an embodiment of the present application;

[0065] Figure 3a A schematic diagram of the structure of a second terminal device provided in an embodiment of the present application;

[0066] Figure 3b A schematic diagram of the structure of a third terminal device provided in an embodiment of the present application;

[0067] Figure 3c A schematic diagram of the structure of a fourth terminal device provided in an embodiment of the present application;

[0068] Figure 4A schematic diagram of a scenario of an audio playback method provided in an embodiment of the present application;

[0069] Figure 5 A schematic diagram of a flow chart of a first audio playback method provided in an embodiment of the present application;

[0070] Figure 6 A flowchart of a second audio playback method provided in an embodiment of the present application;

[0071] Figure 7 A schematic diagram of a flow chart of a third audio playback method provided in an embodiment of the present application;

[0072] Figure 8 A schematic diagram of the structure of a fifth terminal device provided in an embodiment of the present application;

[0073] Figure 9a A schematic diagram of the structure of a channel upmixing module provided in an embodiment of the present application;

[0074] Figure 9b A schematic diagram of the structure of a channel downmixing module provided in an embodiment of the present application;

[0075] Fig.10 A schematic diagram of the structure of a chip system provided in an embodiment of the present application.

[0076] Specific implementation method

[0077] In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0078] In order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first" and "second" are used to distinguish the same items or similar items with substantially the same functions and effects. For example, the first instruction and the second instruction are to distinguish different user instructions, and their order is not limited. Those skilled in the art can understand that the words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not necessarily limit them to be different.

[0079] It should be noted that, in this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0080] The audio playback solution provided in the embodiment of the present application can be applied to terminal devices such as mobile phones and tablet computers.

[0081] For example, Figure 1 The schematic diagram of the structure of the first terminal device 100 is shown. The terminal device 100 may include a processor 110, a display screen 120, a camera 130, an internal memory 140, a SIM (Subscriber Identification Module) card interface 150, a USB (Universal Serial Bus) interface 160, a charging management module 170, a power management module 171, a battery 172, a sensor module 180, a mobile communication module 190, a wireless communication module 200, a speaker module 210, an antenna 1 and an antenna 2, etc. The sensor module 180 may include a pressure sensor 180A, a fingerprint sensor 180B, a touch sensor 180C, an ambient light sensor 180D, etc.

[0082] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0083] The processor 110 may include one or more processing units, for example: the processor 110 may include a central processing unit (CPU), an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processor (NPU), etc. Among them, different processing units may be independent components or integrated into one or more processors. In some embodiments, the terminal device 100 may also include one or more processors 110. Among them, the controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. In some other embodiments, a memory may also be set in the processor 110 for storing instructions and data. Exemplarily, the memory in the processor 110 may be a cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the terminal device 100 in processing data or executing instructions.

[0084] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, a SIM card interface and / or a USB interface, etc. Among them, the USB interface 160 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 160 can be used to connect a charger to charge the terminal device 100, and can also be used to transmit data between the terminal device 100 and a peripheral device. The USB interface 160 can also be used to connect headphones to play audio through the headphones.

[0085] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is for illustrative purposes only and does not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0086] The wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 190, the wireless communication module 200, the modem processor and the baseband processor.

[0087] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0088] The terminal device 100 implements the display function through a GPU, a display screen 120, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 120 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0089] The display screen 120 is used to display images, videos, etc. The display screen 120 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include one or more display screens 120.

[0090] In some embodiments of the present application, when the display panel is made of materials such as OLED, AMOLED, FLED, etc., the above Figure 1 The display screen 120 in the embodiment can be bent. Here, the display screen 120 can be bent means that the display screen can be bent to any angle at any position and can be kept at the angle, for example, the display screen 120 can be folded in half from the middle to the left or right. It can also be folded in half from the middle to the top or bottom.

[0091] The display screen 120 of the terminal device 100 can be a flexible screen. At present, flexible screens have attracted much attention for their unique characteristics and huge potential. Compared with traditional screens, flexible screens are flexible and bendable, which can provide users with new interaction methods based on bendable characteristics and meet users' more needs for terminals. For terminals equipped with foldable displays, the foldable display screen on the terminal can be switched between a small screen in a folded form and a large screen in an unfolded form at any time. Therefore, users are using the split-screen function on terminals equipped with foldable displays more and more frequently.

[0092] The terminal device 100 can realize the shooting function through the ISP, the camera 130, the video codec, the GPU, the display screen 120 and the application processor, etc., wherein the camera 130 includes a front camera and a rear camera.

[0093] The ISP is used to process the data fed back by the camera 130. For example, when shooting, the shutter is opened, and light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can perform algorithm optimization on the noise, brightness and color of the image. The ISP can also optimize the exposure and color temperature of the shooting scene and other parameters. In some embodiments, the ISP can be set in the camera 130.

[0094] The camera 130 is used to take photos or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard red green blue (RGB), YUV or other format. In some embodiments, the terminal device 100 may include 1 or N cameras 130, where N is a positive integer greater than 1.

[0095] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the terminal device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0096] Video codecs are used to compress or decompress digital videos. The terminal device 100 may support one or more video codecs. Thus, the terminal device 100 may play or record videos in multiple coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0097] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of the terminal device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0098] The internal memory 140 can be used to store one or more computer programs, which include instructions. The processor 110 can enable the terminal device 100 to perform the audio playback method provided in some embodiments of the present application, as well as various applications and data processing, etc. by running the above instructions stored in the internal memory 140. The internal memory 140 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system; the program storage area can also store one or more applications (such as a gallery, contacts, etc.). The data storage area can store data (such as photos, contacts, etc.) created during the use of the terminal device 100. In addition, the internal memory 140 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage components, a flash memory component, a universal flash memory (Universal Flash Storage, UFS), etc. In some embodiments, the processor 110 can enable the terminal device 100 to perform the audio playback method provided in the embodiment of the present application, as well as other applications and data processing by running instructions stored in the internal memory 140, and / or instructions stored in a memory provided in the processor 110.

[0099] The internal memory 140 can be used to store the relevant programs of the audio playback method provided in the embodiment of the present application, and the processor 110 can be used to call the relevant programs of the audio playback method stored in the internal memory 140 when displaying information to execute the audio playback method of the embodiment of the present application.

[0100] The sensor module 180 may include a pressure sensor 180A, a fingerprint sensor 180B, a touch sensor 180C, an ambient light sensor 180D, and the like.

[0101] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 120. There are many types of pressure sensors 180A, for example, they can be resistive pressure sensors, inductive pressure sensors or capacitive pressure sensors. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When the force acts on the pressure sensor 180A, the capacitance between the electrodes changes, and the terminal device 100 determines the intensity of the pressure according to the change in capacitance. When the touch operation acts on the display screen 120, the terminal device 100 detects the touch operation according to the pressure sensor 180A. The terminal device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on a short message application icon, an instruction to view the short message is executed; when a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on a short message application icon, an instruction to create a new short message is executed.

[0102] The fingerprint sensor 180B is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to realize functions such as unlocking, accessing application locks, taking pictures, and answering calls.

[0103] The touch sensor 180C is also called a touch control device. The touch sensor 180C can be arranged on the display screen 120, and the touch sensor 180C and the display screen 120 form a touch screen, which is also called a touch control screen. The touch sensor 180C is used to detect a touch operation acting on or near it. The touch sensor 180C can pass the detected touch operation to the application processor to determine the type of touch event. A visual output related to the touch operation can be provided through the display screen 120. In other embodiments, the touch sensor 180C can also be arranged on the surface of the terminal device 100, and is arranged at a different position from the display screen 120.

[0104] The ambient light sensor 180D is used to sense the ambient light brightness. The terminal device 100 can adaptively adjust the brightness of the display screen 120 according to the perceived ambient light brightness. The ambient light sensor 180D can also be used to automatically adjust the white balance when shooting. The ambient light sensor 180D can also transmit the environmental information of the device to the GPU.

[0105] The ambient light sensor 180D is also used to obtain the brightness, light ratio, color temperature, etc. of the environment in which the camera 130 captures images.

[0106] The speaker module 210 may include a plurality of speakers, and the plurality of speakers are distributed on the left side, right side and bottom side of the terminal device 100, and the speakers on the bottom side are distributed symmetrically. The speakers are used to convert data signals into sound signals for playback.

[0107] Figure 2 The software structure diagram of the terminal device applicable to the embodiment of the present application is shown in FIG. The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.

[0108] The layered architecture divides the software system of the terminal device into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the software system can be divided into five layers, namely, application layer (applications), application framework layer (application framework), system library, hardware abstraction layer (HAL) and kernel layer (kernel).

[0109] The application layer can include a series of application packages. The application layer runs applications by calling the application programming interface (API) provided by the application framework layer. Figure 2 As shown, the application package may include applications such as browser, gallery, music, and video. It is understandable that the port of each of the above applications may be used to receive data.

[0110] The application framework layer provides API and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, and a DHCP (Dynamic Host Configuration Protocol) module.

[0111] The system library can include multiple functional modules, such as surface manager, 3D graphics processing library, 2D graphics engine and file library.

[0112] The hardware abstraction layer may include multiple library modules, such as display library modules and motor library modules. The terminal system may load the corresponding library modules for the device hardware, thereby enabling the application framework layer to access the device hardware.

[0113] The kernel layer is a layer between hardware and software. The kernel layer is used to drive the hardware so that the hardware works. The kernel layer at least includes display driver, audio driver, sensor driver and motor driver, etc., which are not limited by the present application embodiment. It can be understood that display driver, audio driver, sensor driver and motor driver, etc. can all be regarded as a driver node. Each of the above-mentioned driver nodes includes an interface that can be used to receive data.

[0114] First, some concepts involved in the embodiments of the present application are explained below.

[0115] Audio data is data obtained by sampling, quantizing, and encoding sounds. Each sampling of sounds can generate a set of sound data. The above audio data includes multiple sets of sound data.

[0116] The audio data includes a data header and a data body. The data header contains the audio properties of the audio data, such as the number of channels, channel type, sampling rate, sampling bit number, bit rate, etc. The data body contains multiple groups of sound data, and each group of sound data includes data of each channel collected within an acquisition cycle.

[0117] The sound channel data can be considered as independent data collected from different spatial positions when collecting sound.

[0118] Secondly, the execution entity of the audio playback solution provided in the embodiment of the present application is explained.

[0119] The executor of the audio playback solution provided in the embodiment of the present application is a terminal device such as a mobile phone and a tablet computer, and the terminal device is configured with a left speaker, a right speaker and a plurality of bottom speakers. The left speaker is located on the left side of the terminal device, the right speaker is located on the right side of the terminal device, and the bottom speaker is located on the bottom side of the terminal device. The left speaker and the right speaker may be symmetrically distributed or asymmetrically distributed, and the number of the left speakers may be one or more, and the number of the right speakers may also be one or more. The bottom speakers are symmetrically distributed left and right, and the number of the bottom speakers may be 2, 4 or other even numbers.

[0120] The above-mentioned terminal device usually supports two placement modes: horizontal screen placement and vertical screen placement. Since the above-mentioned left side, right side and bottom side are relative positions, the sides pointed to by the left side, right side and bottom side are different in different placement modes.

[0121] like Figure 3a As shown, Figure 3a A schematic diagram of the structure of a second terminal device provided in an embodiment of the present application. Figure 3aIn the embodiment, when the terminal device is placed in landscape mode, the side where the bottom side of the terminal device is located is the longer side of the terminal device, and the sides where the left and right sides of the terminal device are located are the shorter sides of the terminal device. The speakers in the terminal device are configured according to the landscape mode of the terminal device, with the bottom speaker configured on the longer side of the terminal device, the left speaker configured on the shorter left side of the terminal device, and the right speaker configured on the shorter right side of the terminal device.

[0122] like Figure 3b As shown, Figure 3b A schematic diagram of the structure of a third terminal device provided in an embodiment of the present application. Figure 3b In the embodiment, when the terminal device is placed in portrait orientation, the side where the bottom side of the terminal device is located is the shorter side of the terminal device, and the sides where the left and right sides of the terminal device are located are the longer sides of the terminal device. The speakers in the terminal device are configured according to the portrait orientation of the terminal device, with the bottom speaker configured on the shorter side of the terminal device, the left speaker configured on the longer left side of the terminal device, and the right speaker configured on the longer right side of the terminal device.

[0123] like Figure 3c As shown, Figure 3c A schematic diagram of the structure of the fourth terminal device provided in an embodiment of the present application. Figure 3c In the embodiment, each side of the terminal device is configured with speakers that are symmetrically distributed on the left and right sides. In this case, a gravity sensor can also be configured inside the terminal device, so that when the user uses the terminal device, the gravity sensor can detect the direction of gravity. The terminal device can determine the bottom side, the left side and the right side according to the direction of gravity detected by the gravity sensor, thereby determining that the speaker located on the determined bottom side is the bottom speaker, the speaker located on the determined left side is the right speaker, and the speaker located on the determined right side is the right speaker.

[0124] Next, the application scenario of the audio playback solution provided in the embodiment of the present application is described.

[0125] like Figure 4 As shown, Figure 4 A schematic diagram of a scenario of an audio playback solution provided in an embodiment of the present application. Figure 4 In the embodiment, the terminal device is placed on a desktop. When the terminal device plays audio externally, the audio played by the left and right speakers of the terminal device is directly transmitted to the user's ears, while the audio played by the bottom speaker of the terminal device is reflected by the desktop and transmitted to the user's ears.

[0126] The audio playback solution provided by this application is described below through specific embodiments.

[0127] In one embodiment of the present application, see Figure 5, a flow chart of a first audio playback method is provided. In this embodiment, the above method is applied to a terminal device, and the terminal device is configured with a left speaker, a right speaker and a plurality of bottom speakers, and the bottom speakers are symmetrically distributed on the left and right.

[0128] For the description of the terminal device, please refer to the above content and will not be repeated here.

[0129] The above audio playing method includes the following steps S501-S503.

[0130] Step S501: parse the audio data to obtain channel data included in the audio data.

[0131] Specifically, after the terminal device obtains the audio data, it can search for the data header identification field in the audio data, and then, starting from the found data header identification field, perform data parsing according to the preset data arrangement rules of the data header to obtain the audio attributes of the audio data. Among them, the audio attributes may include the number of channels, channel type, sampling rate, sampling bit number, bit rate, etc. Then, the data body identification field is searched in the audio data, and starting from the found data body identification field, the data contained in the data body of the audio data is parsed according to the above audio attributes to obtain the channel data included in the audio data, and when parsing the data contained in the data body, the channel type of the channel data included in the audio data can also be determined according to the preset data arrangement rules of the data body. The channel data parsed from the audio data can be called initial channel data.

[0132] For example, if the arrangement order of each audio attribute in the preset data arrangement rule of the above data header is: number of channels, number of sampling bits, then after the terminal device finds the data header identification field in the audio data, it can determine that the next parameter after the data header identification field is the number of channels of the audio data, such as the number of channels is 2, and it can determine that the next parameter after the number of channels is the number of sampling bits of the audio data, such as the number of sampling bits is 8. After the terminal device parses out the two audio attributes of the number of channels and the number of sampling bits of the audio data, it can search for the data body identification field in the audio data, and starting from the found data body identification field, it can determine that every 16 bits of data after the data body identification field is a group of separate sound data, and according to the preset data arrangement rule of the data body, it can determine that the first 8 bits in each group of sound data are data of one channel, such as left channel data, and the last 8 bits are data of another channel, such as right channel data, so that the initial left channel data and the initial right channel data in the audio data can be obtained.

[0133] In addition, the audio data obtained by the terminal device includes mid-high frequency channel data and may also include bass channel data. In the case where the audio data includes mid-high frequency channel data and bass channel data, when obtaining the channel data included in the audio data, only the mid-high frequency channel data included in the audio data may be obtained, or all the channel data in the audio data may be obtained.

[0134] For example, if the audio data obtained by the terminal device is 2.1 channel type audio data, the audio data includes two left and right mid-high frequency channel data and one bass channel data. In this case, when parsing the audio data, the terminal device can parse only the two mid-high frequency channel data in the audio data, or it can parse the two mid-high frequency channel data and one bass channel data in the audio data.

[0135] Step S502: performing mixing processing on the obtained channel data to obtain target left channel data and target right channel data, and determining target left surround channel data and target right surround channel data based on the obtained channel data.

[0136] Mixing processing can be understood as superimposing different channel data. When mixing processing is performed on the obtained channel data, since the obtained channel data may include the left channel data and the right channel data in the audio data, mixing processing can be performed based on the left channel data and the right channel data in the audio data to obtain target left channel data and target right channel data. In addition, when the obtained channel data also includes other channel data in the audio data, mixing processing can also be performed based on the left channel data, the right channel data and other channel data in the audio data. For example, when the obtained channel data includes the left channel data, the right channel data and the center channel data in the audio data, mixing processing can be performed based on the left channel data, the right channel data and the center channel data in the audio data.

[0137] When determining the target left surround channel data and the target right surround channel data, it can also be determined based on the left channel data and the right channel data in the audio data. When the obtained channel data also includes other channel data in the audio data, it can also be determined based on the other channel data in the audio data.

[0138] The specific implementation method of obtaining the above-mentioned target left channel data, target right channel data, target left surround channel data and target right surround channel data can be found in the subsequent embodiments, which will not be described in detail here.

[0139] Step S503: Control the left speaker to play the target left channel data, control the right speaker to play the target right channel data, and control the left and right speakers in the bottom speaker to play the target left surround channel data and the target right surround channel data respectively.

[0140] Specifically, after obtaining the above-mentioned target left channel data, target right channel data, target left surround channel data and target right surround channel data, the target left channel data can be sent to the left speaker, the target right channel data can be sent to the right speaker, the target left surround channel data can be sent to the left bottom speaker among the bottom speakers distributed symmetrically on the left and right, and the target right surround channel data can be sent to the right bottom speaker. Since the speaker is used to convert data signals into sound signals, after sending the channel data to each speaker, each speaker can convert the received channel data into sound information for playback.

[0141] As can be seen from the above, in the solution provided by this embodiment, since the terminal device is generally placed on a flat surface such as a desktop, when the terminal device plays audio, the audio played by the bottom speaker will be reflected by the plane when propagating in the air, and then the reflected audio enters the user's ear. In this way, there is a time difference between the user hearing the audio played by the left and right speakers and the audio played by the bottom speaker, thereby forming a sound delay and producing an audio reverberation effect, so that the user can hear audio with a surround sound effect, so that the terminal device can bring an immersive and shocking effect to the user when playing audio externally.

[0142] The following describes an implementation method for obtaining target left channel data and target right channel data.

[0143] In one embodiment of the present application, when mixing the obtained channel data, vocal data can be determined based on the obtained channel data, and the initial left channel data and the vocal data in the obtained channel data can be mixed to obtain target left channel data, and the initial right channel data and the vocal data in the obtained channel data can be mixed to obtain target right channel data.

[0144] Specifically, based on the obtained vocal tract data, the human voice data may be determined by using any one of the following first and second implementations.

[0145] In a first implementation, the human voice can be separated from the initial left channel data and the initial right channel data in the obtained channel data, and the separated data can be mixed to obtain the human voice data.

[0146] The audio data obtained by the terminal device may be audio data of channel types such as 2.0, 2.1, 5.0, 5.1, 7.1, etc., so the channel data obtained by parsing the audio data is multi-channel data, and the multi-channel data includes initial left channel data and initial right channel data in the audio data. After obtaining the channel data included in the audio data, the initial left channel data and initial right channel data included in the obtained channel data can be used to separate the human voice from the two channel data.

[0147] The following uses the initial left channel data as an example to illustrate the implementation method of voice separation.

[0148] For example, data having a frequency range corresponding to a human voice frequency range may be extracted from the initial left channel data, and the extracted data may be used as initial human voice data separated from the initial left channel data.

[0149] For another example, a model for vocal separation may be pre-trained, so that initial left channel data is input into the trained model, and model output data may be obtained as initial vocal data separated from the initial left channel data.

[0150] The implementation method of performing vocal separation on the initial right channel data is the same as the implementation method of performing vocal separation on the initial left channel data, which will not be described in detail here.

[0151] Since the audio data includes multiple groups of sound data, each group of sound data includes data of each channel collected at the same collection time, and the initial left channel data obtained by analysis also includes data of the left channel collected at multiple collection times. Therefore, when the initial left channel data is subjected to vocal separation to obtain the initial vocal data, the initial vocal data also includes data of the left channel collected at multiple collection times. Similarly, the initial vocal data separated from the initial right channel data also includes data of the right channel collected at multiple collection times. In view of this, when the initial vocal data separated from the initial left channel data and the initial right channel data are mixed, the data corresponding to the same collection time in the two initial vocal data can be determined, and the corresponding data can be superimposed to obtain the superimposed data as the above-mentioned vocal data.

[0152] In one embodiment of the present application, the above-mentioned human voice data can be obtained according to the following expression:

[0153] C=gain*(L+R)

[0154] Among them, C represents the above-mentioned vocal data, L represents the initial vocal data separated from the initial left channel data, R represents the initial vocal data separated from the initial right channel data, and gain represents the gain conversion of (L+R).

[0155] In this implementation, the initial left channel data and the initial right channel data in the obtained channel data are respectively separated from the human voice, and the data belonging to the human voice in the initial left channel data and the initial right channel data can be accurately separated. In this way, the separated data are mixed and the human voice data can be accurately obtained, so that the relatively accurate human voice data can be used for subsequent mixing processing, and relatively accurate target left channel data and target right channel data after enhancing the human voice can be obtained. Then, the left speaker plays the target left channel data, and the right speaker plays the target right channel data, so that the user can clearly hear the human voice, thereby improving the user's auditory experience.

[0156] In a second implementation manner, if the channel data obtained by analysis includes center channel data, the center channel data may be determined as human voice data.

[0157] For example, multiple groups of channel data can be parsed from audio data of channel types such as 5.1, 7.1 or 9.1, and the parsed multiple groups of channel data include initial center channel data. In this way, the center channel data included in the parsed channel data can be obtained, and the center channel data can be determined to be human voice data.

[0158] In the present implementation, since the audio data of the channel type corresponding to the number of channels being greater than or equal to five already includes the initial center channel data, therefore, for the audio data of the channel type corresponding to the number of channels being greater than or equal to five, after parsing the channel data contained in the audio data, the center channel data in the obtained channel data can be directly determined as vocal data, without the need to perform steps such as vocal separation and mixing processing, thereby improving the efficiency of determining vocal data and further improving the efficiency of audio playback.

[0159] The following describes an implementation method for obtaining target left channel data and target right channel data based on the human voice data after the human voice data is determined.

[0160] When mixing the initial left channel data and the vocal data, data corresponding to the same acquisition time in the initial left channel data and the vocal data can be determined, and the determined data can be superimposed to obtain superimposed data as the target left channel data.

[0161] When mixing the initial right channel data and the vocal data, data corresponding to the same acquisition time in the initial right channel data and the vocal data can be determined, and the determined data can be superimposed to obtain superimposed data as the target right channel data.

[0162] In addition, in the process of mixing the vocal data with the initial left channel data and the initial right channel data, the vocal data in the same proportion can be mixed with the initial left channel data and the initial right channel data. This implementation method can be found in subsequent embodiments and will not be described in detail here.

[0163] As can be seen from the above, in the solution provided by this embodiment, the initial left channel data and the human voice data are mixed, so that the data belonging to the human voice in the target left channel data is enhanced; the initial right channel data and the human voice data are mixed, so that the data belonging to the human voice in the target right channel data is enhanced, so that the target left channel data is played in the left speaker and the target right channel data is played in the right speaker, which can make the human voice in the audio played by the speakers more prominent, so that the user can clearly hear the human voice in the audio, thereby improving the user's auditory experience.

[0164] The following describes an implementation method for mixing the human voice data of the same proportion with the initial left channel data and the initial right channel data.

[0165] In one embodiment of the present application, when the initial left channel data and the vocal data are mixed, a preset proportion of the vocal data can be mixed into the initial left channel data to obtain the target left channel data; and when the initial right channel data and the vocal data are mixed, a preset proportion of the vocal data can be mixed into the initial right channel data to obtain the target right channel data.

[0166] The above-mentioned preset ratio can be understood as the ratio of data values.

[0167] The above preset ratio may be a ratio set manually, for example, 0.5, 0.6, etc.

[0168] Specifically, after determining the vocal data, each data value in the vocal data can be multiplied by a preset ratio to obtain vocal data of the preset ratio, and the vocal data of the preset ratio and the initial left channel data are mixed to obtain target left channel data, and the vocal data of the preset ratio and the initial right channel data are mixed to obtain target right channel data.

[0169] As can be seen from the above, in the solution provided by this embodiment, a preset proportion of vocal data is mixed into the initial left channel data, and a preset proportion of vocal data is mixed into the initial right channel data, rather than mixing the entire vocal data into the initial left channel data and the initial right channel data, so that the vocals and other sounds of the mixed data are balanced when played, avoiding the abruptness of the vocals, and at the same time increasing the volume of the audio played by the speaker, thereby improving the user's auditory experience. In addition, the same proportion of vocal data is mixed into the initial left channel data and the initial right channel data, so that the user can produce the effect of the vocals being centered when listening to the audio played by the speaker, further improving the user's auditory experience.

[0170] The following describes how to determine the target left surround channel data and the target right surround channel data through implementation mode 1 and implementation mode 2.

[0171] Implementation method 1: Data below a preset frequency in the initial left channel data in the channel data obtained by analysis can be filtered out, and the initial left channel data after filtering out the data can be delayed to obtain target left surround channel data; data below a preset frequency in the initial right channel data in the channel data obtained by analysis can be filtered out, and the initial right channel data after filtering out the data can be delayed to obtain target right surround channel data.

[0172] The preset frequency is a manually set frequency, for example, the preset frequency may be 2000 Hz, 2100 Hz, etc.

[0173] In addition, the preset frequency can be set based on the frequency range of human voice. For example, the preset frequency can be set to a frequency higher than the maximum frequency of the human voice frequency range. By setting the preset frequency higher than the maximum human voice frequency, low-frequency human voices in the obtained channel data can be filtered out, and high-frequency data can be retained. The higher the data frequency, the richer the spatial information it contains. In this way, when the speaker plays high-frequency data, it can enable the user to produce a spatial stereo surround effect.

[0174] Specifically, the channel data obtained by analysis may be multi-channel data, which includes initial left channel data and initial right channel data in the audio data. In this way, for the initial left channel data and initial right channel data included in the channel data obtained by analysis, the two channel data can be filtered and delayed respectively. After filtering the data below the preset frequency in the two data, the higher frequency data is retained in the obtained data, so that when the speaker plays such data, the user can hear the audio with surround sound effect. In addition, after filtering the data, the data is also delayed, so that the bottom speaker can delay the audio playback, so that there is a deviation between the time when the user hears the audio played by the left and right speakers and the time when the user hears the audio played by the bottom speaker, thereby forming a sound delay and generating an audio reverberation effect, so that the user can hear the audio with surround sound effect, so that the terminal device can also bring an immersive shocking effect to the user when playing the audio externally.

[0175] The following uses the initial left channel data as an example to illustrate the implementation of the above-mentioned data filtering and delay processing.

[0176] For example, data below a preset frequency in the initial left channel data may be filtered out by any of the following two implementations.

[0177] In a first implementation, a high-pass filter with a filtering frequency equal to the preset frequency may be used to filter the initial left channel data, thereby filtering out data below the preset frequency.

[0178] In the second implementation, the initial left channel data may be processed using a data filtering algorithm, a model, etc. to obtain processed data as the initial left channel data after filtering.

[0179] The following describes the implementation method of delaying the initial left channel data after filtering the data.

[0180] For example, a delay algorithm, a delay module, a delay network model, etc. may be used to delay the initial left channel data after filtering out the data to obtain target left surround channel data.

[0181] The implementation methods of filtering out data and delaying the initial right channel data are the same as the implementation methods of filtering out data and delaying the initial left channel data, and will not be repeated here.

[0182] In addition, when delaying the initial left channel data and the initial right channel data after filtering the data, the two channel data can be delayed according to a predetermined delay time. This implementation method can be found in subsequent embodiments and will not be described in detail here.

[0183] Implementation method 2: The target left surround channel data may be determined based on the initial left surround channel data in the channel data obtained by analysis, and the target right surround channel data may be determined based on the initial right surround channel data in the channel data obtained by analysis.

[0184] Specifically, the channel data obtained by analysis may be multi-channel data, which includes not only the initial left channel data and the initial right channel data in the audio data, but also the initial left surround channel data and the initial right surround channel data in the audio data. For example, there are initial left surround channel data and initial right surround channel data in the audio data of the channel types such as 5.1, 7.1, and 9.1. In this case, based on the initial left surround channel data, the target left surround channel data can be accurately determined, and based on the initial right surround channel data, the target right surround channel data can be accurately determined, so as to control the bottom speaker to play the target left surround channel data and the target right surround channel data, so that the user can hear the audio with surround sound effect, so that the terminal device can bring an immersive and shocking effect to the user when playing the audio externally.

[0185] Two implementations of determining target left surround sound channel data based on initial left surround sound channel data and determining target right surround sound channel data based on initial right surround sound channel data are described below.

[0186] In the first manner, the initial left surround channel data may be directly determined as the target left surround channel data, and the initial right surround channel data may be directly determined as the target right surround channel data.

[0187] In the second manner, the initial left surround channel data may be delayed to obtain target left surround channel data, and the initial right surround channel data may be delayed in the same manner to obtain target right surround channel data.

[0188] The implementation method of the delay processing in this implementation method can refer to the aforementioned method of delaying the initial left channel data or the initial right channel data after the filtered data is removed, and will not be repeated here.

[0189] In this manner, delay processing is performed on the initial left surround channel data and the initial right surround channel data, which can enhance the surround sound effect produced by the audio emitted by the bottom speaker, thereby improving the user's auditory experience.

[0190] The following is an explanation of the implementation manner of delaying the initial left channel data and the initial right channel data after filtering data according to the delay duration in the above implementation manner 1.

[0191] In one embodiment of the present application, when delay processing is performed on the initial left channel data after filtering the data, the initial left channel data after filtering the data can be delayed according to the delay duration determined by the device parameters of the above-mentioned terminal device; when delay processing is performed on the initial right channel data after filtering the data, the initial right channel data after filtering the data can be delayed according to the above-mentioned delay duration.

[0192] The above-mentioned device parameters may include the device placement method, the length of the bottom side of the device, the distance between different bottom side speakers, etc.

[0193] The delay time can be determined based on the device parameters of the terminal device. In addition, the delay time can also be determined in combination with the device parameters of the terminal device and other information. For example, the other information can be a common height or a recommended height of the terminal device from the plane on which the terminal device is placed when the user uses the terminal device.

[0194] In one embodiment of the present application, the delay duration may be determined based on the reflection time.

[0195] Among them, the reflection time is: the time it takes for the bottom speaker to emit audio and receive the audio reflected by the plane where the terminal device is placed, and the time is determined based on the device parameters of the terminal device.

[0196] Since the audio emitted by the bottom speaker is reflected by the plane on which the terminal device is placed and then propagated to the user, the time from the audio being emitted by the bottom speaker to the user hearing the audio emitted by the bottom speaker can be considered as: the sum of the time from the audio being emitted by the bottom speaker to the audio reaching the plane on which the terminal device is placed and the time from the audio being reflected from the plane to the user hearing the audio. Since the distance between the terminal device and the plane on which it is placed is usually much smaller than the distance between the terminal device and the user, the time from the audio being emitted from the left and right speakers to the user hearing the audio and the time from the audio being emitted from the plane on which the terminal device is placed to the user hearing the reflected audio can be considered to be the same. Therefore, the time between the moment when the user hears the audio played by the left and right speakers and the moment when the user hears the audio played by the bottom speaker is substantially equivalent to the sum of the above-mentioned reflection time and the above-mentioned delay time. In view of this, determining the delay time based on the reflection time can ensure that the time between the moment when the user hears the audio played by the left and right speakers and the moment when the user hears the audio played by the bottom speaker is always consistent. If the time between these two moments is consistent, the surround sound effect produced by the audio heard by the user will also be consistent, thereby being able to provide the user with a stable surround sound effect and improving the user's auditory experience.

[0197] When determining the reflection time based on the device parameters of the terminal device, the terminal device can be placed on the desktop according to the device parameters, and a recorder can be placed on the desktop below the terminal device. The terminal device can control the bottom speaker to emit audio, record the first moment when the bottom speaker emits the audio, and obtain the second moment when the recorder receives the audio. In this way, the second moment is subtracted from the first moment to obtain the time difference between the first moment and the second moment, which is the above-mentioned reflection time.

[0198] After determining the above reflection time, when determining the delay time according to the reflection time, if the reflection time is longer, a smaller delay time can be determined, and if the reflection time is shorter, a larger delay time can be determined.

[0199] For example, based on the reflection time, the delay duration can be determined by the following expression:

[0200] Delay duration = expected duration - reflection time

[0201] Among them, the above-mentioned expected duration can be understood as: the time duration between the moment when the user hears the audio played by the left and right speakers and the moment when the user hears the audio played by the bottom speaker during the process of the terminal device controlling the left speaker, the right speaker and the bottom speaker to play audio.

[0202] The expected duration may be a manually set duration, for example, the expected duration may be 7 ms, 8 ms, etc.

[0203] After determining the delay duration according to the reflection time, the initial left channel data after filtering out the data can be delayed according to the determined delay duration, using a delay algorithm, a delay module, a delay network model, etc. to obtain the target left surround channel data; according to the above-mentioned delay duration, the initial right channel data after filtering out the data can be delayed according to the delay algorithm, a delay module, a delay network model, etc. to obtain the target right surround channel data.

[0204] As can be seen from the above, in the solution provided by this embodiment, according to the device parameters of the terminal device, the delay duration matching the terminal device can be determined, so that the initial left channel data and the initial right channel data after filtering the data are delayed according to the delay duration, and the target left surround channel data and the target right surround channel data matching the terminal device can be obtained. In this way, the bottom speaker is controlled to play the target left surround channel data and the target right surround channel data, which can produce a better audio reverberation effect, thereby improving the user's auditory experience.

[0205] When obtaining the target left channel data, target right channel data, target left surround channel data, and target right surround channel data, in addition to applying the method provided in the above embodiment, the following method can also be used. Figure 6In the embodiment shown, steps S502A-S502B or Figure 7 In the illustrated embodiment, steps S502C-S502D are obtained.

[0206] The terminal device may obtain multiple types of audio data, so the number of channel data obtained by the terminal device through analysis may also be multiple, and the channel data that the terminal device controls each speaker to play is essentially only four types of channel data, namely, target left channel data, target right channel data, target left surround channel data, and target right surround channel data. In view of this, if a conversion scheme is configured for each type of audio data, which converts the channel data included in the audio data into the above four types of channel data, each conversion scheme needs to occupy a certain amount of device resources of the terminal device, which results in more resources being occupied by the terminal device for playing audio.

[0207] To solve the above problem, in one embodiment of the present application, see Figure 6 , a flow chart of a second audio playback method is provided. In this embodiment, the following steps S502A-S502B can be used. When the number of channels corresponding to the channel data obtained by analysis is greater than a preset number, the channel data obtained by analysis is first converted into channel data corresponding to a unified channel type, and then target left channel data, target right channel data, target left surround channel data, and target right surround channel data are obtained based on the channel data corresponding to the unified channel type.

[0208] Step S502A: If the number of channels corresponding to the obtained channel data is greater than a preset number, channel downmixing processing is performed on the obtained channel data to obtain channel data corresponding to a preset channel type.

[0209] The above-mentioned preset number and preset channel type may be manually set.

[0210] In one embodiment of the present application, the preset number is 5, and the preset channel type is a 5.0 channel type.

[0211] The channel downmixing process can be understood as obtaining new channel data by superimposing different channel data, so that the number of channel data after superimposition is less than the number of channel data before superimposition.

[0212] Specifically, if the number of channels corresponding to the channel data to be subjected to channel downmixing processing is different, the channel downmixing modes are also different. Channel downmixing modes corresponding to multiple channel numbers can be determined in advance. In this way, after determining that the number of channels corresponding to the channel data obtained by the above analysis is greater than a preset number, the channel downmixing mode corresponding to the number of channels corresponding to the channel data obtained by the analysis can be determined from the various channel downmixing modes obtained in advance according to the number of channels corresponding to the channel data obtained by the analysis. Therefore, according to the determined mode, the channel downmixing processing is performed on the channel data obtained by the analysis to obtain channel data corresponding to the preset channel type.

[0213] For example, if the number of channels corresponding to the channel data obtained by the above analysis is 7, the above preset number is 5, and the above preset channel type is a 5.0 channel type, then the channel data obtained by the analysis includes data of 7 channels: left, right, center, left surround, right surround, rear left surround, and rear right surround. When the channel data is downmixed, the left surround channel data and the rear left surround channel data of the 7 channels can be mixed, and the right surround channel data and the rear right surround channel data of the 7 channels can be mixed, so as to achieve downmixing of the 7-channel channel data into 5-channel channel data.

[0214] For another example, if the number of channels corresponding to the channel data obtained by the above analysis is 9, the above preset number is 5, and the above preset channel type is a 5.0 channel type, then the channel data obtained by the analysis includes data of 9 channels: left, right, center, left surround, right surround, rear left surround, rear right surround, front left surround, and front right surround. When the channel data is downmixed, the left surround channel data, the rear left surround channel data, and the front left surround channel data of the 9 channels can be mixed, and the right surround channel data, the rear right surround channel data, and the front right surround channel data of the 9 channels can be mixed, so as to achieve downmixing of the 9-channel channel data into 5-channel channel data.

[0215] When mixing a plurality of channel data, the ratio of each channel data may be preset, so that mixing is performed on each channel data of the preset ratio.

[0216] Step S502B: performing mixing processing on the channel data obtained by the downmixing processing to obtain target left channel data and target right channel data, and determining target left surround channel data and target right surround channel data based on the channel data obtained by the downmixing processing.

[0217] The implementation method of performing mixing processing on the channel data obtained by the downmixing processing is the same as the implementation method of performing mixing processing on the channel data obtained in the aforementioned step S502, and the implementation method of determining the target left surround channel data and the target right surround channel data based on the channel data obtained by the downmixing processing is the same as the implementation method of determining the target left surround channel data and the target right surround channel data based on the obtained channel data in the aforementioned step S502, which will not be repeated here.

[0218] As can be seen from the above, in the solution provided by this embodiment, when the number of channels corresponding to the obtained channel data is greater than the preset number, the obtained channel data is first downmixed into channel data corresponding to the preset channel type, and then the channel data obtained by the downmixing process is mixed, so that the target left channel data and the target right channel data can be accurately obtained, and based on the channel data obtained by the downmixing process, the target left surround channel data and the target right surround channel data can be accurately determined, so as to control the bottom speaker to play the target left surround channel data and the target right surround channel data, so that the user can hear audio with surround sound effect, so that the terminal device can bring an immersive and shocking effect to the user when playing audio externally.

[0219] Furthermore, the solution provided in this embodiment does not need to configure a conversion solution for converting the channel data included in the audio data into the above-mentioned four channel data for each channel type of audio data, thereby not occupying too many device resources of the terminal device, thereby saving the resources occupied by the terminal device for playing audio.

[0220] In one embodiment of the present application, see Figure 7 , a flow chart of a third audio playing method is provided. In this embodiment, the method further includes the following step S504, and the above step S502 can be implemented by the following steps S502C-S502D.

[0221] Step S504: based on the result of parsing the audio data, obtain the channel type of the audio data.

[0222] Specifically, in one embodiment, the data header of the audio data may record the channel type of the audio data. After parsing the audio data, the channel type recorded in the audio data header may be obtained.

[0223] In another manner, after the channel data included in the audio data is obtained, the number of channels corresponding to the obtained channel data may be determined, and thus the channel type of the audio data may be further determined according to the determined number of channels.

[0224] After the channel type of the audio data is determined, the above step S502 may be implemented based on the channel type through the following steps S502C-S502D.

[0225] Step S502C: determining a mixing mode corresponding to the channel type, and performing mixing processing on the obtained channel data according to the mixing mode to obtain target left channel data and target right channel data.

[0226] The channel types may be 2.0, 2.1, 5.0, 5.1, 7.1 or 9.1.

[0227] Specifically, mixing methods corresponding to multiple channel types can be determined in advance. After the channel type of the above-mentioned audio data is obtained, the mixing method corresponding to the channel type of the above-mentioned audio data can be determined from the pre-obtained mixing methods, and the obtained channel data is mixed according to the determined mixing method to obtain target left channel data and target right channel data.

[0228] For example, for a 2.0 or 2.1 channel type, the mixing method corresponding to the channel type may be mixing by separating the human voice as mentioned above.

[0229] For a 5.0 or 5.1 channel type, the mixing method corresponding to the channel type may be the mixing mentioned above by using the center channel data as vocal data.

[0230] For channel types such as 7.1 and 9.1, where the number of channels corresponding to the channel types exceeds 5, the mixing method corresponding to the channel type may be the method mentioned in the above steps S502A-S502B.

[0231] Step S502D: Determine a surround channel data acquisition method corresponding to the channel type, and determine target left surround channel data and target right surround channel data based on the acquired channel data and in accordance with the surround channel data acquisition method.

[0232] Specifically, a method for obtaining surround channel data corresponding to a plurality of channel types may be determined in advance. Thus, after obtaining the channel type of the above-mentioned audio data, the method for obtaining surround channel data corresponding to the channel type of the above-mentioned audio data may be determined from the pre-obtained method for obtaining surround channel data, thereby determining the target left surround channel data and the target right surround channel data based on the obtained channel data and in accordance with the determined method for obtaining surround channel data.

[0233] For example, for a 2.0 or 2.1 channel type, the surround channel data corresponding to the channel type may be obtained by data filtering and delay processing as mentioned above.

[0234] For 5.0 or 5.1 channel types, the surround channel data corresponding to the channel type can be obtained by directly determining the initial left surround channel data as the target left surround channel data, and directly determining the initial right surround channel data as the target right surround channel data as mentioned in the above content.

[0235] For channel types such as 7.1 and 9.1, where the number of channels corresponding to the channel types exceeds 5, the method for obtaining surround channel data corresponding to the channel types may be the method for obtaining surround channel data mentioned in steps S502A-S502B.

[0236] See also Figure 8 , provides a structural diagram of the fifth terminal device, Figure 8 The terminal device shown is configured with an audio analysis module 801, a channel upmixing module 802, a channel downmixing module 803, a left speaker 804, a right speaker 805, a first bottom side speaker 806 and a second bottom side speaker 807, wherein the first bottom side speaker 806 and the second bottom side speaker 807 are symmetrically distributed on the left and right, with the first bottom side speaker 806 on the left and the second bottom side speaker 807 on the right.

[0237] The audio parsing module 801 is used to parse the audio data to obtain the channel data included in the audio data. The channel downmixing module 803 is used to convert the channel data obtained by parsing into target left channel data, target right channel data, target left surround channel data and target right surround channel data when the channel type of the audio data is 2.0 or 2.1 channel type. The channel downmixing module 803 is used to convert the channel data obtained by parsing into target left channel data, target right channel data, target left surround channel data and target right surround channel data when the channel type of the audio data is 5.0 or 5.1 channel type.

[0238] After the terminal device obtains the target left channel data, target right channel data, target left surround channel data and target right surround channel data, it can control the left speaker 804 to play the target left channel data, control the right speaker 805 to play the target right channel data, control the first bottom speaker 806 to play the target left surround channel data, and control the second bottom speaker 807 to play the target right surround channel data.

[0239] See also Figure 9a , Figure 9a for Figure 6 A schematic diagram of the internal structure of the center channel upmixing module 802, Figure 9aIn the embodiment, the channel upmixing module 802 includes a vocal separation submodule 802A, a vocal mixing submodule 802B, and a filter delay submodule 802C. For audio data of 2.0 or 2.1 channel types, after the channel upmixing module 802 obtains the initial left channel data and the initial right channel data in the audio data, the two channel data can be input into the vocal separation submodule 802A. The vocal separation submodule 802A can perform vocal separation on the two channel data respectively, and perform mixing processing on the data separated from the two channel data, and output the vocal data. After obtaining the vocal data, the initial left channel data, the initial right channel data, and the vocal data can be input into the vocal mixing submodule 802B. The vocal mixing submodule 802B can perform mixing processing on the initial left channel data and the vocal data, and output the target left channel data. The vocal mixing submodule 802B can also perform mixing processing on the initial right channel data and the vocal data, and output the target right channel data. The channel upmixing module 802 can also input the initial left channel data and the initial right channel data into the filtering delay submodule 802C. The filtering delay submodule 802C can filter out the data below the preset frequency in the two channel data respectively, and perform delay processing on the two data after the filtered data respectively, to obtain the target left surround channel data and the target right surround channel data.

[0240] See also Figure 9b , Figure 9b for Figure 6 A schematic diagram of the internal structure of the center channel downmix module 803, Figure 9b In the embodiment, the channel downmixing module 803 includes a center channel downmixing submodule 803A. For audio data of 5.0 or 5.1 channel type, after obtaining the initial left channel data, initial right channel data, initial center channel data, initial left surround channel data and initial right surround channel data in the audio data, the channel downmixing module 803 can input the initial left channel data, initial right channel data and initial center channel data into the center channel downmixing submodule 803A. The center channel downmixing submodule 803A can mix the initial left channel data and the initial center channel data to obtain the target left channel data, and the center channel downmixing submodule 803A can also mix the initial right channel data and the initial center channel data to obtain the target right channel data. In addition, the channel downmixing module 803 can also determine the initial left surround channel data as the target left surround channel data, and determine the initial right surround channel data as the target right surround channel data.

[0241] As can be seen from the above, in the solution provided by this embodiment, since there are fewer channel types of mainstream audio data, the mixing methods and surround channel data acquisition methods corresponding to multiple channel types can be predetermined. In this way, when obtaining the above-mentioned target left channel data, target right channel data, and target left surround channel data based on the target right surround channel data, the mixing method and surround channel data acquisition method corresponding to the channel type can be determined according to the channel type of the audio data, and the target left channel data, target right channel data, and target left surround channel data can be accurately obtained by using the determined mixing method and surround channel data acquisition method, so as to control the left speaker to play the target left channel data, control the right speaker to play the target right channel data, and control the left and right speakers of the bottom speaker to play the target left surround channel data and the target right surround channel data respectively, so that the user can hear the audio with surround sound effect, so that the terminal device can bring an immersive and shocking effect to the user when playing audio externally.

[0242] Corresponding to the above-mentioned audio playback method, an embodiment of the present application also provides a terminal device for executing the above-mentioned audio playback method.

[0243] In one embodiment of the present application, see the above Figure 3a , provides a schematic diagram of the structure of a terminal device, the terminal device comprising: a left speaker, a right speaker, a plurality of bottom speakers, a memory for storing computer program instructions and a processor for executing program instructions; wherein,

[0244] The bottom speakers are symmetrically distributed left and right;

[0245] When the computer program instructions are executed by the processor, the processor is triggered to execute the audio playback solution provided by any of the above method embodiments.

[0246] As can be seen from the above, in the solution provided by this embodiment, since the terminal device is generally placed on a flat surface such as a desktop, when the terminal device plays audio, the audio played by the bottom speaker will be reflected by the plane when propagating in the air, and then the reflected audio enters the user's ear. In this way, there is a time difference between the user hearing the audio played by the left and right speakers and the audio played by the bottom speaker, thereby forming a sound delay and producing an audio reverberation effect, so that the user can hear audio with a surround sound effect, so that the terminal device can bring an immersive and shocking effect to the user when playing audio externally.

[0247] In a specific implementation, the present application further provides a computer storage medium, wherein the computer storage medium may store a program, wherein when the program is executed, the device where the computer readable storage medium is located is controlled to perform some or all of the steps in the above embodiment. The above storage medium may be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0248] In a specific implementation, an embodiment of the present application further provides a computer program product, which includes executable instructions. When the executable instructions are executed on a computer, the computer executes some or all of the steps in the above method embodiment.

[0249] like Fig.10 As shown, the present application also provides a chip system, which is applied to a terminal device 100, and the chip system includes one or more processors 1001. The processor 1001 is used to call computer instructions so that the terminal device 100 inputs the audio data to be processed into the chip system. The chip system processes the audio data based on the audio playback method provided in an embodiment of the present application and outputs the processing result to realize audio playback.

[0250] In a possible implementation, the chip system also includes input and output interfaces for inputting and outputting data.

[0251] The various embodiments of the mechanism disclosed in the present application can be implemented in hardware, software, firmware or a combination of these implementation methods. The embodiments of the present application can be implemented as a computer program or program code executed on a programmable system, which includes at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device and at least one output device.

[0252] Program code can be applied to input instructions to perform the functions described in this application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.

[0253] Program code can be implemented with high-level programming language or object-oriented programming language to communicate with the processing system. When necessary, program code can also be implemented with assembly language or machine language. In fact, the mechanism described in this application is not limited to the scope of any specific programming language. In either case, the language can be a compiled language or an interpreted language.

[0254] In some cases, the disclosed embodiments can be implemented in hardware, firmware, software or any combination thereof. The disclosed embodiments can also be implemented as instructions carried or stored on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which can be read and executed by one or more processors. For example, instructions can be distributed over a network or through other computer-readable media. Therefore, machine-readable media can include any mechanism for storing or transmitting information in a machine (e.g., computer) readable form, including but not limited to, floppy disks, optical disks, optical disks, compact disc read-only memories (Compact Disc Read Only Memory, CD-ROMs), magneto-optical disks, read-only memories, random access memories, erasable programmable read-only memories (Erasable Programmable Read Only Memory, EPROM), electrically erasable programmable read-only memories (Electrically Erasable Programmable Read Only Memory, EEPROM), magnetic cards or optical cards, flash memory, or tangible machine-readable memories for transmitting information (e.g., carrier waves, infrared signal digital signals, etc.) using the Internet in electrical, optical, acoustic or other forms of propagation signals. Accordingly, machine-readable media include any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a form readable by a machine (eg, a computer).

[0255] In the accompanying drawings, some structural or method features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be required. Instead, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the accompanying drawings of the specification. In addition, the inclusion of structural or method features in a particular figure does not mean that such features are required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.

[0256] It should be noted that the units / modules mentioned in the various device embodiments of the present application are all logical units / modules. Physically, a logical unit / module can be a physical unit / module, or a part of a physical unit / module, or can be implemented as a combination of multiple physical units / modules. The physical implementation method of these logical units / modules themselves is not the most important. The combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed by the present application. In addition, in order to highlight the innovative part of the present application, the above-mentioned device embodiments of the present application do not introduce units / modules that are not closely related to solving the technical problems proposed by the present application, which does not mean that there are no other units / modules in the above-mentioned device embodiments.

[0257] It should be noted that in the examples and description of this patent, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one" do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0258] Although the present application has been illustrated and described with reference to certain preferred embodiments thereof, it will be apparent to those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present application.

Claims

1. An audio playback method, characterized in that: Applied to a terminal device, the terminal device is configured with a left speaker, a right speaker and a plurality of bottom speakers, the bottom speakers are symmetrically distributed, and the method includes: Parsing the audio data to obtain channel data included in the audio data and the channel type of the audio data; Performing mixing processing on the obtained channel data to obtain target left channel data and target right channel data, and determining target left surround channel data and target right surround channel data based on the obtained channel data; Control the left speaker to play the target left channel data, control the right speaker to play the target right channel data, and control the left and right speakers of the bottom speaker to play the target left surround channel data and the target right surround channel data respectively; The step of determining target left surround channel data and target right surround channel data based on the obtained channel data comprises: Delaying the initial left surround channel data in the obtained channel data to obtain target left surround channel data; delaying the initial right surround channel data in the obtained channel data to obtain target right surround channel data; The mixing process is performed on the obtained channel data to obtain target left channel data and target right channel data, and based on the obtained channel data, target left surround channel data and target right surround channel data are determined, including: Determine a mixing mode corresponding to the channel type, and perform mixing processing on the obtained channel data according to the mixing mode to obtain target left channel data and target right channel data; Determine a surround channel data acquisition method corresponding to the channel type, and determine target left surround channel data and target right surround channel data based on the acquired channel data and in accordance with the surround channel data acquisition method.

2. The method according to claim 1, characterized in that The mixing process is performed on the obtained channel data to obtain target left channel data and target right channel data, including: Determining vocal data based on the acquired vocal tract data; Performing mixing processing on the initial left channel data and the human voice data in the obtained channel data to obtain target left channel data; The initial right channel data in the obtained channel data and the human voice data are mixed to obtain target right channel data.

3. The method according to claim 2, characterized in that The step of determining the human voice data based on the obtained vocal channel data comprises: Separating the initial left channel data and the initial right channel data from human voice, and performing mixing processing on the separated data to obtain human voice data; or The center channel data among the obtained channel data is determined as vocal data.

4. The method according to claim 2, characterized in that: The mixing process is performed on the initial left channel data and the human voice data in the obtained channel data to obtain target left channel data, including: Mixing the human voice data of a preset proportion with the initial left channel data in the obtained channel data to obtain target left channel data; The mixing process is performed on the initial right channel data in the obtained channel data and the human voice data to obtain the target right channel data, including: The human voice data of the preset ratio is mixed with the initial right channel data in the obtained channel data to obtain target right channel data.

5. The method according to any one of claims 1 to 4, characterized in that The step of determining target left surround channel data and target right surround channel data based on the obtained channel data comprises: Data below a preset frequency in the initial left channel data in the obtained channel data is filtered out, and the initial left channel data after the filtered data is delayed to obtain target left surround channel data; data below a preset frequency in the initial right channel data in the obtained channel data is filtered out, and the initial right channel data after the filtered data is delayed to obtain target right surround channel data.

6. The method according to claim 5, characterized in that The delay processing of the initial left channel data after filtering the data comprises: Delay processing is performed on the initial left channel data after the data is filtered out according to the delay duration determined by the device parameters of the terminal device; The delay processing of the initial right channel data after filtering the data includes: According to the delay time, the initial right channel data after the filtered data is delayed.

7. The method according to claim 6, characterized in that The delay duration is determined based on the reflection time, wherein the reflection time is: the time from when the bottom speaker emits audio to when it receives the audio reflected by the plane on which the terminal device is placed, and the duration is determined based on the device parameters of the terminal device.

8. The method according to claim 1, characterized in that The mixing process is performed on the obtained channel data to obtain target left channel data and target right channel data, and based on the obtained channel data, target left surround channel data and target right surround channel data are determined, including: If the number of channels corresponding to the obtained channel data is greater than a preset number, performing channel downmixing processing on the obtained channel data to obtain channel data corresponding to a preset channel type; The channel data obtained by the downmixing process is mixed to obtain target left channel data and target right channel data, and target left surround channel data and target right surround channel data are determined based on the channel data obtained by the downmixing process.

9. A terminal device, characterized in that: The terminal device comprises: a left speaker, a right speaker, a plurality of bottom speakers, a memory for storing computer program instructions, and a processor for executing program instructions; wherein, The bottom speakers are symmetrically distributed left and right; When the computer program instructions are executed by the processor, the processor is triggered to execute the method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 8.

11. A computer program product, characterized in that The computer program product comprises executable instructions, and when the executable instructions are executed on a computer, the computer is caused to perform the method according to any one of claims 1 to 8.

12. A chip system, characterized in that: The chip system is applied to a terminal device, which is configured with a left speaker, a right speaker and multiple bottom speakers, and the bottom speakers are symmetrically distributed on the left and right. The chip system includes one or more processors, and the processor is used to call computer instructions so that the terminal device inputs audio data into the chip system and executes the method described in any one of claims 1-8 to realize audio playback.

Images