Audio processing method, terminal equipment, wireless earphone and audio processing system
By predicting gyroscope data, the audio of wireless headphones is rendered and processed, the problem of poor audio playback effect of wireless headphones is solved, the user experience and audio effect are improved, and a stronger sense of space is achieved.
Patent Information
- Application Number
- CN202310636793.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-31
- Publication Date
- 2024-12-03
AI Technical Summary
Wireless headphones have poor audio playback effects when playing audio, resulting in poor user experience.
By rendering the audio to be processed by predicting the gyroscope data, the predicted gyroscope data is predicted based on the previous moment data of the wireless headset. It is used to achieve a head-following feeling when playing the wireless headset, avoid audio delay, and improve the audio playback effect.
It improves the audio playback effect of wireless headphones, enhances the user experience, and achieves a stronger sense of space and audio effects.
Smart Images

Figure CN119071692A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of audio processing technology, and in particular to an audio processing method, a terminal device, a wireless headset and an audio processing system. Background Art
[0002] With the development of smart mobile devices, earphones have become a must-have for people to listen to audio in their daily lives. Wireless earphones have become the mainstream earphone products due to their convenience.
[0003] When playing audio, a method usually adopted is that the terminal device obtains the audio and sends the audio to the wireless headset through wireless transmission for playing. This method has the problem of poor audio playing effect. Summary of the invention
[0004] The present application provides an audio processing method, a terminal device, a wireless headset and an audio processing system to solve the problem of poor audio playback effect.
[0005] In a first aspect, the present application provides an audio processing method, comprising: obtaining the audio to be processed at the current moment; using predicted gyroscope data to render the audio to be processed to obtain a target audio corresponding to the audio to be processed, wherein the predicted gyroscope data is obtained based on the previous moment of the current moment of the wireless headset, and the wireless headset has a head-following feeling when playing the target audio.
[0006] In one embodiment, the predicted gyroscope data is predicted in the following manner: at the previous moment, the gyroscope data and the playback delay duration of the wireless headset are obtained; and the predicted gyroscope data is predicted based on the gyroscope data and the playback delay duration.
[0007] In one embodiment, predicting predicted gyroscope data based on the gyroscope data and the playback delay duration includes: inputting the gyroscope data and the playback delay duration into a pre-trained prediction model for prediction to obtain predicted gyroscope data.
[0008] In one embodiment, the playback delay duration includes: the wireless transmission duration between the wireless headset and the terminal device; obtaining the playback delay duration includes: obtaining device information of the terminal device and headphone information of the wireless headset; based on the device information and the headphone information, determining the wireless transmission duration, and the device information and the headphone information have a preset corresponding relationship with the wireless transmission duration.
[0009] In one embodiment, the playback delay duration also includes: a preset data processing duration.
[0010] In one embodiment, the predicted gyroscope data is used to render the audio to be processed, including: obtaining target sound effect parameters of the audio to be processed; and rendering the audio to be processed using the target sound effect parameters and the predicted gyroscope data to obtain the target audio.
[0011] In one embodiment, obtaining target sound effect parameters of the audio to be processed includes: obtaining an audio playback scene selected by a user; obtaining corresponding initial sound effect parameters according to the audio playback scene; and determining target sound effect parameters based on the initial sound effect parameters.
[0012] In one embodiment, the target sound effect parameters are determined based on the initial sound effect parameters, including: obtaining corresponding sound effect adjustment parameters based on earphone information of the wireless earphone, the earphone information and the sound effect adjustment parameters having a preset corresponding relationship; and adjusting the initial sound effect parameters using the sound effect adjustment parameters to obtain the target sound effect parameters.
[0013] In one embodiment, obtaining the audio to be processed at the current moment includes: obtaining an audio file at the current moment; when the audio file is a panoramic sound audio file, decoding the audio file using a preset panoramic sound decoding method to obtain the audio to be processed.
[0014] In one embodiment, the audio file is decoded using a preset panoramic sound decoding method, including: decoding the audio file using a panoramic sound decoding method configured on hardware; and / or decoding the audio file using a panoramic sound decoding method configured on software.
[0015] In a second aspect, the present application also provides a terminal device, comprising: a memory and a processor; the memory is used to store a computer program of the processor; the processor is configured to implement the audio processing method of any one of the first aspects through the computer program.
[0016] In a third aspect, the present application provides a wireless headset, including: a memory and a processor;
[0017] a memory for storing a computer program for the processor;
[0018] The processor is configured to implement the audio processing method of the first aspect through a computer program.
[0019] In a fourth aspect, the present application provides an audio processing system, including a terminal device and a wireless headset, wherein the terminal device is wirelessly connected to the wireless headset, wherein the terminal device is used to execute any audio processing method as described in the first aspect and send target audio to the wireless headset.
[0020] In a fifth aspect, the present application provides an audio processing system, including a terminal device and a wireless headset, wherein the terminal device is wirelessly connected to the wireless headset, wherein the wireless headset is used to receive the audio to be processed sent by the terminal device and execute any audio processing method as described in the first aspect.
[0021] In a sixth aspect, the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the method of the first aspect.
[0022] In the seventh aspect, the present application provides a computer program product, including: a computer program, the computer program is stored in a readable storage medium, at least one processor of an electronic device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the electronic device executes the method of the first aspect.
[0023] The audio processing method, terminal device, wireless headset and audio processing system provided by the present application obtain the audio to be processed at the current moment; use predicted gyroscope data to render the audio to be processed to obtain the target audio corresponding to the audio to be processed, wherein the predicted gyroscope data is obtained based on the previous moment of the current moment of the wireless headset, and the wireless headset has a head-following feeling when playing the target audio. The present application can improve the audio playback effect of the wireless headset. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0025] Figure 1 An application scenario diagram of an audio processing method provided in this application;
[0026] Figure 2 An application scenario diagram of another audio processing method provided by this application;
[0027] Figure 3 A flowchart of the steps of an audio processing method provided in this application;
[0028] Figure 4 A structural block diagram of a terminal device provided for this application;
[0029] Figure 5 A flowchart of another audio processing method provided by the present application;
[0030] Figure 6 A structural block diagram of a device perception and interaction module provided in this application;
[0031] Figure 7A structural block diagram of a terminal device provided for this application;
[0032] Figure 8 This is a structural block diagram of a wireless headset provided in this application.
[0033] The above drawings show clear embodiments of the present disclosure, which will be described in more detail below. These drawings and text descriptions are not intended to limit the scope of the present disclosure in any way, but to illustrate the concepts of the present disclosure to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0034] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0035] In the related technologies, spatial audio requires the mobile phone and headphones to work together, or some independent headphone sound effect solutions. Among them, the independent headphone sound effect solution has a poor user experience due to the limited computing power of the headphone chip and the loose integration with the content.
[0036] Based on the above problems, the present application provides an audio processing method, including obtaining the audio to be processed at the current moment; using predicted gyroscope data to render the audio to be processed to obtain a target audio corresponding to the audio to be processed, wherein the predicted gyroscope data is obtained based on the previous moment of the current moment of the wireless headset, and the wireless headset has a head-following feeling when playing the target audio. The present application can improve the playback effect of the wireless headset, thereby improving the user experience.
[0037] Reference Figure 1 , which provides an application scenario of an audio processing method for the present application, wherein the present application embodiment can be applied to Figure 1 The wireless headset shown in the figure independently implements the solution of the present application in the wireless headset, thereby making the headset adaptable to various terminals. Figure 1 The wireless headset includes: an interaction module, an inertial sensor (IMU), a processing module and a transceiver module. Among them, the interaction module is used to interact with the user, such as the user's buttons, touch and voice. The inertial sensor is used to detect some inertial data of the wireless headset. The processing module adopts SOC (system-on-chip), which includes an audio processing device for inertial data processing, audio processing and wireless headset system control. The transceiver module is used to receive and send data with the terminal device using Bluetooth. Among them, the wireless headset has the function of playing panoramic audio.
[0038] Reference Figure 2 The present application provides an application scenario of an audio processing method, wherein the present application embodiment can also be applied to Figure 2 In the system consisting of the wireless headset and the terminal device shown, the wireless headset and the terminal device are jointly operated to support multi-channel audio rendering and stronger computing power, so that users can feel a stronger sense of space and experience better audio effects.
[0039] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0040] Reference Figure 3 , Figure 3 In one embodiment of the audio processing method of the present application, the audio processing method comprises the following steps:
[0041] S301, obtaining the audio to be processed at the current moment.
[0042] The audio to be processed at the current moment is the audio to be output by the wireless headset at the current moment.
[0043] In the embodiment of the present application, if the execution subject is a terminal device, the audio to be processed can be downloaded or locally stored. If the execution subject is a wireless headset, the audio to be processed can be received from the terminal device.
[0044] S302, using the predicted gyroscope data to render the audio to be processed, to obtain a target audio corresponding to the audio to be processed.
[0045] The predicted gyroscope data is obtained based on the previous moment of the current moment of the wireless headset, and the wireless headset has a head-following sense when playing the target audio.
[0046] Specifically, the predicted gyroscope data is obtained at the last moment. Specifically, a plurality of gyroscope data before the last moment can be input into a pre-trained prediction model for prediction at the last moment to obtain the predicted gyroscope data, and the predicted gyroscope data is used to render the audio to be processed at the current moment.
[0047] It can be understood that, usually when the audio to be processed is being played at the current moment, if the actual gyroscope data at the current moment is used to render the audio to be processed, audio delay will occur, affecting the audio playback effect. If the predicted gyroscope data at the current moment is obtained at the previous moment and the predicted gyroscope data is used to render the audio to be processed, delays can be avoided, and the audio playback effect and thus the user experience can be improved.
[0048] In an embodiment of the present application, by obtaining the audio to be processed at the current moment; using predicted gyroscope data to render the audio to be processed, a target audio corresponding to the audio to be processed is obtained, wherein the predicted gyroscope data is obtained based on the previous moment of the current moment of the wireless headset, and the wireless headset has a head-following feeling when playing the target audio. The present application predicts the predicted gyroscope data to be used at the current moment at the previous moment, and uses the predicted gyroscope data to render the current audio to be processed, which can improve the audio playback effect of the wireless headset.
[0049] Further, based on Figure 2 The scene, see Figure 4 The terminal device 40 provided includes: a device perception and interaction module 41, a posture prediction module 42, a panoramic sound rendering module 43 and a decoding module 44.
[0050] Among them, the device perception and interaction module 41 is used to interact with the wireless headset, and to obtain the playback delay time, gyroscope data and target sound effect parameters, and then send the playback delay time and gyroscope data to the posture prediction module 42, and send the target sound effect parameters to the panoramic sound rendering module 43. The posture prediction module 42 is used to determine the predicted gyroscope data based on the playback delay time and gyroscope data to offset the audio playback delay caused by Bluetooth and / or audio processing, so as to achieve an accurate sense of somersaults. The decoding module 44 is used to decode the audio file in the panoramic sound format to obtain the audio to be processed, and then send the audio to be processed to the panoramic sound rendering module 43. The panoramic sound rendering module 43 is used to render the audio to be processed according to the target sound effect parameters and the predicted gyroscope data to obtain the target audio.
[0051] Reference Figure 5 , Figure 5 Another embodiment of the present invention provides an audio processing method, comprising the following steps:
[0052] S501, at the last moment, obtaining gyroscope data and playback delay duration of the wireless headset.
[0053] Among them, the playback delay duration includes: the wireless transmission duration between the wireless headset and the terminal device; obtaining the playback delay duration includes: obtaining the device information of the terminal device and the headphone information of the wireless headset; based on the device information and the headphone information, determining the wireless transmission duration, and the device information and the headphone information have a preset corresponding relationship with the wireless transmission duration.
[0054] Furthermore, the playback delay duration also includes: a preset data processing duration.
[0055] Reference Figure 6 The device perception and interaction module 41 includes a Bluetooth unit, a delay measurement unit, a sound effect configuration unit and a headphone interaction unit.
[0056] Among them, the Bluetooth unit is used to establish a Bluetooth connection with the wireless headset. After successfully connecting to the wireless headset, the gyroscope data and wireless headset model of the wireless headset are obtained. The gyroscope data is the actual gyroscope data generated before the current moment. The wireless headset can be an ordinary headset, an ambient audio headset, or an ambient sound effect headset.
[0057] The delay measurement unit is used to obtain the wireless headset model obtained by the Bluetooth unit from the wireless headset, then obtain the terminal device model, and then obtain the corresponding Bluetooth delay duration according to the preset correspondence between (wireless headset model, terminal device model) and Bluetooth delay duration. If there is no preset corresponding Bluetooth delay duration for (wireless headset model, terminal device model), the default Bluetooth delay duration can be used or other methods can be used to measure the Bluetooth delay duration between the wireless headset and the terminal device.
[0058] Furthermore, the play delay duration also includes: a preset data processing duration. Then the play delay duration may be the sum of the Bluetooth delay duration and the data processing duration.
[0059] Among them, the sound effect configuration unit selects the corresponding sound effect adjustment parameters according to the type of wireless headphones (such as ordinary headphones, panoramic audio headphones or panoramic sound effect headphones), and then uses the sound effect adjustment parameters to adjust the initial sound effect parameters selected by the user to obtain the target sound effect parameters. For example, ordinary headphones use the default configuration parameters, and panoramic audio headphones or panoramic sound effect headphones select corresponding sound effect adjustment parameters through different wireless headphone models. In this application, since the speakers and other hardware of panoramic audio headphones or panoramic sound effect headphones are somewhat different, in order to achieve better sound effects, different sound effect adjustment parameters can be adopted according to the wireless headphone model.
[0060] The headset interaction unit is used to send different instructions to interact with the wireless headset according to user operations, such as switching playback scenes, resetting the gyroscope, and turning the wireless headset on or off.
[0061] S502: predicting gyroscope data according to the gyroscope data and the playback delay duration.
[0062] The method of predicting the predicted gyroscope data according to the gyroscope data and the playback delay duration includes: inputting the gyroscope data and the playback delay duration into a pre-trained prediction model for prediction to obtain the predicted gyroscope data.
[0063] Specifically, the gyroscope data obtained by the terminal device from the wireless headset is encrypted gyroscope data, so the gyroscope data needs to be verified first, such as using a cyclic redundancy check (CRC) method to verify the encrypted gyroscope data. After the verification passes, the encrypted gyroscope data is decrypted to obtain the decrypted gyroscope data. Then the decrypted gyroscope data and the playback delay duration are input into the pre-trained prediction model for prediction to obtain the predicted gyroscope data.
[0064] Further, referring to 4, the posture prediction module 42 predicts the predicted gyroscope data according to the gyroscope data and the playback delay duration. The predicted gyroscope data is used to offset the delay caused by Bluetooth and data processing, so that the target audio finally obtained can achieve an accurate somersault feeling.
[0065] In addition, this application uses the open source framework TFLite (a toolkit for deploying deep learning models on mobile and embedded devices) to transform, deploy and optimize the trained prediction model in three steps, thereby increasing the computing speed and reducing memory and video memory usage.
[0066] S503, obtaining the audio file at the current moment.
[0067] In the embodiment of the present application, what is downloaded or obtained from the local storage is an audio file, and the audio file needs to be decoded to obtain the audio to be processed.
[0068] S504: When the audio file is a panoramic audio file, a preset panoramic audio decoding method is used to decode the audio file to obtain audio to be processed.
[0069] Among them, the audio file is decoded by using a preset panoramic sound decoding method, including: decoding the audio file by using a panoramic sound decoding method configured on hardware; and / or decoding the audio file by using a panoramic sound decoding method configured on software.
[0070] Specifically, if the terminal device has integrated panoramic sound decoding mode in its hardware, the panoramic sound decoding mode configured in the hardware of the terminal device can be directly used to decode the audio file. If the terminal device does not have an integrated decoding module in its hardware, the panoramic sound decoding mode configured in the software of the terminal device can be used to decode the audio file.
[0071] S505: Obtain target sound effect parameters of the audio to be processed.
[0072] Among them, obtaining the target sound effect parameters of the audio to be processed includes: obtaining the audio playback scene selected by the user; obtaining the corresponding initial sound effect parameters according to the audio playback scene; and determining the target sound effect parameters based on the initial sound effect parameters.
[0073] In the embodiment of the present application, the corresponding relationship between the audio playback scene and the initial sound effect parameter can be preset, for example, the music playback scene is such as: movie, game, virtual reality, music, etc. Different music playback scenes correspond to initial sound effect parameters.
[0074] In one embodiment, the initial sound effect parameters may be determined as the target sound effect parameters.
[0075] In another embodiment, the target sound effect parameters are determined based on the initial sound effect parameters, including: obtaining corresponding sound effect adjustment parameters based on earphone information of the wireless earphone, the earphone information and the sound effect adjustment parameters having a preset corresponding relationship; and adjusting the initial sound effect parameters using the sound effect adjustment parameters to obtain the target sound effect parameters.
[0076] Among them, the headphone information can be a wireless headphone model, and a preset correspondence between the wireless headphone model and the sound effect adjustment parameters can be preset. After obtaining the wireless headphone model, the corresponding sound effect adjustment parameters can be obtained according to the preset correspondence, and then the sound effect adjustment parameters are used to adjust the initial sound effect parameters to obtain the target sound effect parameters. The obtained target sound effect parameters can not only meet the audio playback scenario selected by the user, but also improve the effect of playing audio using the wireless headphone.
[0077] S506, using the target sound effect parameters and the predicted gyroscope data to render the audio to be processed to obtain the target audio.
[0078] Further, refer to Figure 4 , a panoramic sound rendering module 43 is used to render the audio to be processed to obtain a target sound effect.
[0079] Specifically, after the posture prediction module 43 predicts the predicted gyroscope data, it encrypts the predicted gyroscope data, and then transmits the encrypted predicted gyroscope data to the panoramic sound rendering module 43. After receiving the encrypted predicted gyroscope data, the panoramic sound rendering module 43 decrypts the predicted gyroscope data, and then uses a preset rendering algorithm, and uses the target sound effect parameters and the predicted gyroscope data to render the audio to be processed, so that the sound effect of the audio to be processed has a sense of space, so as to restore the sound of the real three-dimensional world, provide accurate positioning capabilities and a sense of sound field hierarchy, so that users can have a realistic immersive experience, and bring an experience in audio playback scenarios such as movies, games, virtual reality, and music. The stereo, surround sound, and panoramic sound signals of this application can all have a significant improvement in the auditory experience.
[0080] The sound field of the target audio obtained by this application is wider than the ordinary sound field, the position of each sound is clearly located, the head effect is reduced, the human voice appears in front of the head, and the sound is brighter
[0081] This application can realize independent operation of the wireless headset end and support various types of terminal devices. In addition, this application can also closely link the audio to be processed, the terminal device and the wireless headset to achieve a better spatial audio experience. By predicting the predicted gyroscope data at the current moment at the previous moment, the delay caused by the wireless link (Bluetooth transmission) and / or data processing can be compensated. Wireless headphones can be used in conjunction with terminal devices or alone, and both can ensure a good spatial audio experience.
[0082] Figure 7 This is a schematic diagram of the structure of a terminal device according to an embodiment of the present application. Figure 7 As shown, the terminal device includes: a processor 71, and a memory 72 communicatively connected to the processor 71; the memory 72 stores computer execution instructions; the processor 71 executes the computer execution instructions stored in the memory 72 to implement the steps of the audio processing method in the above-mentioned method embodiments.
[0083] In the above-mentioned server, the memory 72 and the processor 71 are electrically connected directly or indirectly to realize data transmission or interaction. For example, these elements can be electrically connected to each other through one or more communication buses or signal lines, such as through a bus connection. The memory 72 stores computer-executable instructions for implementing the data access control method, including at least one software function module that can be stored in the memory 72 in the form of software or firmware. The processor 71 executes various functional applications and data processing by running the software programs and modules stored in the memory 72.
[0084] The memory 72 may be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electric erasable programmable read-only memory (EEPROM), etc. The memory 72 is used to store programs, and the processor 71 executes the programs after receiving the execution instruction. Furthermore, the software programs and modules in the above-mentioned memory 72 may also include an operating system, which may include various software components and / or drivers for managing system tasks (such as memory management, storage device control, power management, etc.), and may communicate with various hardware or software components to provide an operating environment for other software components.
[0085] The processor 71 may be an integrated circuit chip having the ability to process signals. The processor 71 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc. The methods, steps, and logic diagrams disclosed in the embodiments of the present application may be implemented or executed. The general-purpose processor may be a microprocessor or any conventional processor.
[0086] Furthermore, the processor 71 specifically includes: a decoding module and a processing module.
[0087] The decoding module is used to obtain the audio to be processed at the current moment.
[0088] The panoramic sound rendering module is used to render the audio to be processed using the predicted gyroscope data to obtain the target audio corresponding to the audio to be processed, wherein the predicted gyroscope data is obtained based on the previous moment of the current moment of the wireless headset, and the wireless headset has a head-following feeling when playing the target audio.
[0089] In one embodiment, the processor 71 also includes a device perception and interaction module, which is used to obtain the gyroscope data and playback delay duration of the wireless headset at the previous moment; the processor 71 also includes: a posture prediction module, which is used to predict the predicted gyroscope data based on the gyroscope data and the playback delay duration.
[0090] In one embodiment, when the posture prediction module is used to predict the predicted gyroscope data based on the gyroscope data and the playback delay duration, it is specifically used to input the gyroscope data and the playback delay duration into a pre-trained prediction model for prediction to obtain the predicted gyroscope data.
[0091] In one embodiment, the playback delay duration includes: the wireless transmission duration between the wireless headset and the terminal device; when obtaining the playback delay duration, the device perception and interaction module is specifically used to obtain the device information of the terminal device and the headphone information of the wireless headset; based on the device information and the headphone information, the wireless transmission duration is determined, and the device information and the headphone information have a preset corresponding relationship with the wireless transmission duration.
[0092] In one embodiment, the playback delay duration also includes: a preset data processing duration.
[0093] In one embodiment, the panoramic sound rendering module is specifically used to obtain target sound effect parameters of the audio to be processed; the audio to be processed is rendered using the target sound effect parameters and the predicted gyroscope data to obtain the target audio.
[0094] In one embodiment, when obtaining the target sound effect parameters of the audio to be processed, the panoramic sound rendering module is specifically used to: obtain the audio playback scene selected by the user; obtain the corresponding initial sound effect parameters according to the audio playback scene; and determine the target sound effect parameters based on the initial sound effect parameters.
[0095] In one embodiment, when the panoramic sound rendering module determines the target sound effect parameters based on the initial sound effect parameters, it is specifically used to obtain corresponding sound effect adjustment parameters based on the headphone information of the wireless headphones, and the headphone information and the sound effect adjustment parameters have a preset corresponding relationship; the sound effect adjustment parameters are used to adjust the initial sound effect parameters to obtain the target sound effect parameters.
[0096] In one embodiment, the decoding module is specifically used to obtain an audio file at a current moment; when the audio file is a panoramic sound audio file, the audio file is decoded using a preset panoramic sound decoding method to obtain the audio to be processed.
[0097] In one embodiment, when the decoding module adopts a preset panoramic sound decoding method to decode the audio file, it is specifically used to: decode the audio file using the panoramic sound decoding method configured on the hardware; and / or, decode the audio file using the panoramic sound decoding method configured on the software.
[0098] Figure 8 Schematic diagram of the structure of a wireless headset according to an embodiment of the present application. Figure 8As shown, the wireless headset includes: a processor 81, and a processor 82 that is communicatively connected to the processor 81; the processor 82 stores computer execution instructions; the processor 81 executes the computer execution instructions stored in the processor 82 to implement the steps of the audio processing method in the above-mentioned terminal device embodiment.
[0099] In the above client, the processor 82 and the processor 81 are electrically connected directly or indirectly to realize data transmission or interaction. For example, these elements can be electrically connected to each other through one or more communication buses or signal lines, such as through a bus connection. The memory 72 stores computer-executable instructions for implementing the data access control method, including at least one software function module that can be stored in the processor 82 in the form of software or firmware. The processor 71 executes various functional applications and data processing by running the software programs and modules stored in the processor 82.
[0100] The processor 82 may be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electric erasable programmable read-only memory (EEPROM), etc. The processor 82 is used to store programs, and the processor 81 executes the programs after receiving the execution instruction. Furthermore, the software programs and modules in the processor 82 may also include an operating system, which may include various software components and / or drivers for managing system tasks (such as memory management, storage device control, power management, etc.), and may communicate with various hardware or software components to provide an operating environment for other software components.
[0101] The processor 81 may be an integrated circuit chip having the ability to process signals. The processor 81 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc. The disclosed audio processing method, steps, and logic block diagram in the embodiments of the present application may be implemented or executed. The general-purpose processor may be a microprocessor or any conventional processor.
[0102] An embodiment of the present application also provides an audio processing system, including a terminal device and a wireless headset, wherein the terminal device is wirelessly connected to the wireless headset, wherein the terminal device is used to execute any of the above-mentioned audio processing methods and send target audio to the wireless headset.
[0103] The specific implementation contents refer to the above embodiments and will not be described in detail here.
[0104] An embodiment of the present application further provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used for any of the above-mentioned audio processing methods.
[0105] An embodiment of the present application also provides a computer program product, which includes: a computer program, which is stored in a readable storage medium, and at least one processor of an electronic device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the electronic device executes the method of any one of the above embodiments.
[0106] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the appended claims.
[0107] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.
Claims
1. An audio processing method, characterized in that: include: Get the audio to be processed at the current moment; The audio to be processed is rendered using predicted gyroscope data to obtain a target audio corresponding to the audio to be processed, wherein the predicted gyroscope data is obtained based on the previous moment of the current moment of the wireless headset, and the wireless headset has a head-following feeling when playing the target audio.
2. The audio processing method according to claim 1, characterized in that: The predicted gyroscope data is predicted in the following way: At the previous moment, obtaining gyroscope data and playback delay duration of the wireless headset; The predicted gyroscope data is predicted based on the gyroscope data and the playback delay duration.
3. The audio processing method according to claim 2, characterized in that: The predicting and obtaining the predicted gyroscope data according to the gyroscope data and the playback delay duration includes: The gyroscope data and the playback delay duration are input into a pre-trained prediction model for prediction to obtain the predicted gyroscope data.
4. The audio processing method according to claim 3, characterized in that: The playback delay duration includes: the wireless transmission duration between the wireless headset and the terminal device; obtaining the playback delay duration includes: Acquire device information of the terminal device and headset information of the wireless headset; The wireless transmission duration is determined based on the device information and the headset information, and the device information and the headset information have a preset corresponding relationship with the wireless transmission duration.
5. The audio processing method according to any one of claims 2 to 4, characterized in that: The playback delay duration also includes: a preset data processing duration.
6. The audio processing method according to any one of claims 1 to 4, characterized in that: The using the predicted gyroscope data to render the audio to be processed includes: Obtaining target sound effect parameters of the audio to be processed; The target audio effect parameters and the predicted gyroscope data are used to render the audio to be processed to obtain the target audio.
7. The audio processing method according to claim 6, characterized in that: The step of obtaining target sound effect parameters of the audio to be processed includes: Get the audio playback scene selected by the user; Acquire corresponding initial sound effect parameters according to the audio playback scenario; The target sound effect parameter is determined based on the initial sound effect parameter.
8. The audio processing method according to claim 7, characterized in that: The determining the target sound effect parameter based on the initial sound effect parameter comprises: Based on the headset information of the wireless headset, obtaining corresponding sound effect adjustment parameters, wherein the headset information and the sound effect adjustment parameters have a preset corresponding relationship; The initial sound effect parameters are adjusted using the sound effect adjustment parameters to obtain the target sound effect parameters.
9. The audio processing method according to any one of claims 1 to 4, characterized in that: The obtaining of the audio to be processed at the current moment includes: Get the audio file at the current moment; In the case where the audio file is a panoramic audio file, the audio file is decoded using a preset panoramic decoding method to obtain the audio to be processed.
10. The audio processing method according to claim 9, characterized in that: The decoding of the audio file by using a preset panoramic sound decoding method includes: Decoding the audio file using an ambient sound decoding method configured on hardware; And / or, the audio file is decoded using an ambient sound decoding method configured in the software.
11. A terminal device, characterized in that: include: Memory and processor; The memory is used to store a computer program of the processor; The processor is configured to implement the audio processing method according to any one of claims 1 to 10 through the computer program.
12. A wireless headset, characterized in that: include: Memory and processor; The memory is used to store a computer program of the processor; The processor is configured to implement the audio processing method according to any one of claims 1 to 10 through the computer program.
13. An audio processing system, characterized in that: It comprises a terminal device and a wireless headset, wherein the terminal device is wirelessly connected to the wireless headset, wherein the terminal device is used to execute the audio processing method according to any one of claims 1 to 10, and send the target audio to the wireless headset.
14. An audio processing system, characterized in that: It comprises a terminal device and a wireless headset, wherein the terminal device is wirelessly connected to the wireless headset, wherein the wireless headset is used to receive the audio to be processed sent by the terminal device and execute the audio processing method as described in any one of claims 1 to 10.
15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 10 when executed by a processor.
16. A computer program product, characterized in that include: A computer program, wherein the computer program is stored in a readable storage medium, and at least one processor of an electronic device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the electronic device executes the method as described in any one of claims 1 to 10.
