Sound effect optimization method, device and equipment and storage medium

Abstract

The application provides an audio effect optimization method and device, equipment and a storage medium, and relates to the technical field of audio, which comprises the following steps: a client acquires an audio signal triggered in a current scene, determines a target optimization strategy of the audio signal according to the current scene and an audio effect optimization strategy of the client, the audio effect optimization strategy of the client is determined according to one or more preset scenes of the client and hardware capability information of a terminal device, the hardware capability information of the terminal device is acquired through a data channel established between the client and an operating system of the terminal device, the one or more preset scenes comprise the current scene, and the audio signal is subjected to audio effect optimization through the operating system of the terminal device and an audio processing component in the terminal device according to the target optimization strategy. The client can be optimized in combination with the hardware capability of the terminal device, the audio processing component can be ensured to perform audio effect optimization according to the scene demand of the actual client, and the effect of audio effect optimization is improved.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the field of audio technology, and in particular to an audio effect optimization method and device, a terminal device, and a storage medium. BACKGROUND

[0002] Game audio refers to background music played when a specific behavior or operation occurs in an electronic game, such as an opening theme song, a battle background, a button click, various sounds of a character, special effects, and voice dialogues in the game process of a user, and the like. In the process in which a user uses a terminal device to install various game applications to enter a game, good game audio effects can improve the audio game experience of the user. Audio effect optimization refers to the enhancement of music, video, and game-related audio effects, such as spatial audio effects and high-fidelity audio effects, by an audio processing component (such as an audio processing chip and a loudspeaker) installed on a terminal device, to improve the intensity and clarity of the sound.

[0003] In the prior art, a game application determines when audio effect optimization needs to be performed according to a game scene, and audio effect optimization is performed on a game application client. Alternatively, audio effect optimization is directly performed by an audio processing component of a terminal device.

[0004] However, the audio processing component needs the hardware capability support of the terminal device in the process of playing game audio, and since the game application client does not know the hardware capability of the terminal device, it cannot perform targeted optimization according to the hardware capability of the terminal device, which may result in poor effect of audio effect optimization due to the hardware capability not being supported. In the manner of directly performing audio effect optimization by the audio processing component, the effect of audio effect optimization is also poor due to the lack of actual game scene information. SUMMARY

[0005] The present application provides an audio effect optimization method, device, terminal device, and storage medium to improve the effect of audio effect optimization.

[0006] In a first aspect, the present application provides an audio effect optimization method, comprising:

[0007] The client obtains an audio signal triggered in a current scene;

[0008] According to the current scene and an audio effect optimization strategy of the client, a target optimization strategy of the audio signal is determined, wherein the audio effect optimization strategy of the client is determined according to one or more preset scenes of the client and hardware capability information of a terminal device, the hardware capability information of the terminal device is obtained through a data channel established between the client and an operating system of the terminal device, and the one or more preset scenes include the current scene.

[0009] According to the target optimization strategy, the audio signal is subjected to sound effect optimization by an operating system of the terminal device and an audio processing component in the terminal device.

[0010] In a second aspect, the present application provides an audio effect optimization device, comprising:

[0011] An obtaining module is configured to obtain an audio signal triggered in a current scenario;

[0012] A determining module is configured to determine a target optimization strategy of the audio signal according to the current scenario and an audio effect optimization strategy of a client, wherein the audio effect optimization strategy of the client is determined according to one or more preset scenarios of the client and hardware capability information of a terminal device, the hardware capability information of the terminal device is obtained through a data channel established between the client and an operating system of the terminal device, and the one or more preset scenarios include the current scenario.

[0013] A processing module is configured to perform sound effect optimization on the audio signal according to the target optimization strategy by an operating system of the terminal device and an audio processing component in the terminal device.

[0014] In a third aspect, the present application provides a terminal device, comprising a processor and a memory, wherein the memory is configured to store a computer program, and the processor is configured to invoke and run the computer program stored in the memory to execute the method of the first aspect.

[0015] In a fourth aspect, the present application provides a computer readable storage medium configured to store a computer program, wherein the computer program enables a computer to execute the method of the first aspect.

[0016] In a fifth aspect, the present application provides a computer program product comprising a computer program, wherein the computer program is executed by a processor to implement the method of the first aspect.

[0017] In summary, in the present application, a data channel between the client and the operating system of the terminal device is established by the client, the client can obtain the hardware capability information of the terminal device through the data channel via the operating system, the client can determine the sound effect optimization strategy matched with the hardware capability of the terminal device according to one or more preset scenarios of the client and the hardware capability information of the terminal device, when the audio signal is triggered in the current scenario, the target optimization strategy of the audio signal can be determined according to the current scenario and the sound effect optimization strategy, and finally the audio signal is optimized according to the target optimization strategy through the operating system of the terminal device and the audio processing component in the terminal device. Thus, the client can be optimized in combination with the hardware capability of the terminal device, avoiding the effect of sound effect optimization caused by the hardware capability not supporting, ensuring that the audio processing component can perform sound effect optimization according to the scene demand of the actual client, improving the effect of sound effect optimization, realizing the software and hardware collaborative optimization, and making the audio experience better. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0019] Figure 1 A structural schematic diagram of a terminal device applicable to the present application;

[0020] Figure 2 A flowchart of a sound effect optimization method provided by an embodiment of the present application;

[0021] Figure 3 An interactive flowchart of a sound effect optimization method provided by an embodiment of the present application;

[0022] Figure 4 A structural schematic diagram of a sound effect optimization device provided by an embodiment of the present application;

[0023] Figure 5 A structural schematic diagram of a sound effect optimization device provided by an embodiment of the present application;

[0024] Figure 6 A structural schematic diagram of a sound effect optimization system provided by an embodiment of the present application;

[0025] Figure 7 A schematic block diagram of a terminal device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0026] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0028] For example, the terminal device in this application can be a mobile phone, a tablet computer, a personal computer (PC), a personal digital assistant (PDA), a smart watch, a netbook, a wearable terminal device, a smart TV, a vehicle-mounted device, a smart car, a smart speaker, a robot, etc. This application does not impose any special restrictions on the specific form of the terminal device.

[0029] Figure 1 A schematic diagram of the structure of a terminal device applicable to this application is shown in FIG. Figure 1 As shown, the terminal device may include one or more of the following components: a processor 110 , a memory 120 , an audio processing component 130 , and an input / output module 140 .

[0030] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the terminal device. In other embodiments of the present application, the terminal device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0031] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated into one or more processors. In some embodiments, the terminal device may also include one or more processors 110. Among them, the controller may be the nerve center and command center of the terminal device. The controller can generate an operation control signal based on the instruction opcode and timing signal to complete the control of instruction fetching and execution.

[0032] The memory 120 can be used to store one or more computer programs, which include instructions. The processor 110 can execute the above instructions stored in the memory 120, so that the terminal device performs the sound optimization method provided in the embodiment of the present application, as well as various functional applications and data processing. The memory 120 may include a program storage area and a data storage area. The program storage area may store an operating system; the program storage area may also store one or more applications (such as a gallery, contacts, etc.). The data storage area may store data created during the use of the terminal device (such as photos, contacts, etc.). In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. In some embodiments, the processor 110 can execute the instructions stored in the memory 120, and / or the instructions stored in the memory provided in the processor 110, so that the terminal device performs the sound optimization method provided in the embodiment of the present application, as well as various functional applications and data processing.

[0033] The terminal device can implement audio functions such as music playback and recording through the audio processing component 130. The audio processing component 130 may include an audio module, a speaker, a receiver, a microphone, a headphone jack, and an application processor. The audio module is used to convert digital audio information into analog audio signal output and also to convert analog audio input into digital audio signals. The audio module can also be used to encode and decode audio signals. In some embodiments, the audio module can be located within the processor 110, or some of the functional modules of the audio module can be located within the processor 110. The speaker, also known as a "horn," converts electrical audio signals into sound signals. The terminal device can listen to music or make hands-free calls through the speaker. The receiver, also known as a "handset," converts electrical audio signals into sound signals. When answering a call or receiving a voice message, the terminal device can hold the receiver close to the ear to receive the voice. The microphone, also known as a "handset" or "microphone," converts sound signals into electrical signals. When making a call or sending a voice message, the user can speak by placing their mouth close to the microphone to input the sound signal. The terminal device may be equipped with at least one microphone. In other embodiments, the terminal device may be equipped with two microphones to not only collect sound signals but also implement noise reduction. In other embodiments, the terminal device may be equipped with three, four, or more microphones to collect sound signals, reduce noise, identify sound sources, and implement directional recording. The headphone jack is used to connect wired headphones. The headphone jack can be a USB interface or other standard interface.

[0034] The input / output module 140 may include a display screen (a touch screen or a non-touch screen), which is used to receive user operations (such as touch operations or click operations) and display user interfaces of various applications.

[0035] Sound optimization refers to the enhancement of related sound effects such as music, videos, and games through the audio processing components installed on the terminal device. In related technologies, in game applications, sound optimization can be performed through the game application client (called software layer optimization), or directly through the audio processing components of the terminal device (called hardware layer optimization). Software layer optimization and hardware layer optimization are optimized separately. During software layer optimization, since the game application client does not understand the hardware capabilities of the terminal device, it is unable to perform targeted optimization based on the hardware capabilities of the terminal device, resulting in poor sound optimization results due to hardware support. When optimizing sound effects directly through audio processing components, the sound optimization effect is also poor due to the lack of actual game scene information.

[0036] In order to solve the above technical problems, the present application establishes a data channel between the client and the operating system of the terminal device. The client can obtain the hardware capability information of the terminal device through the operating system through the data channel. The client can determine the sound optimization strategy that matches the hardware capability of the terminal device based on one or more preset scenarios of the client and the hardware capability information of the terminal device. When the audio signal is triggered by the current scenario, the target optimization strategy of the audio signal can be determined based on the current scenario and the sound optimization strategy. Finally, according to the target optimization strategy, the audio signal is optimized through the operating system of the terminal device and the audio processing component in the terminal device. Therefore, the client can perform targeted optimization based on the hardware capabilities of the terminal device during optimization, avoiding the poor sound optimization effect caused by hardware capability support, ensuring that the audio processing component can optimize the sound effect according to the actual scenario requirements of the client, improving the effect of sound optimization, realizing the coordinated optimization of software and hardware, and making the audio experience better.

[0037] The technical solution of this application will be described in detail below:

[0038] Figure 2 This is a flow chart of a sound optimization method provided in an embodiment of the present application. The execution subject of this method can be an application client, such as Figure 2 As shown, the method may include:

[0039] S101: The client obtains an audio signal triggered in the current scene.

[0040] Specifically, the client monitors the audio trigger of the application and can directly obtain the current scene of the application. The audio files in the application are pre-stored.

[0041] S102. The client determines a target optimization strategy for the audio signal based on the current scene and the client's sound optimization strategy. The client's sound optimization strategy is determined based on one or more preset scenes of the client and the hardware capability information of the terminal device. The hardware capability information of the terminal device is obtained through a data channel established between the client and the operating system of the terminal device. The one or more preset scenes include the current scene.

[0042] Specifically, the sound effect optimization strategy of the client is determined based on one or more preset scenarios of the client and the hardware capability information of the terminal device, wherein the hardware capability information of the terminal device may include indication information of supporting and / or not supporting audio processing component optimization, and / or the types of audio processing component optimization that can be supported, that is, the hardware capability information of the terminal device may include at least one of four types of information: 1. indication information of not supporting audio processing component optimization; 2. indication information of supporting audio processing component optimization; 3. indication information of supporting audio processing component optimization and the types of audio processing component optimization that can be supported; 4. the types of audio processing component optimization that can be supported. For example, a 1-bit indicator can be used to indicate whether audio processing component optimization is supported and the types of audio processing component optimization that can be supported, such as: "0" indicates indication information of not supporting audio processing component optimization, and "1" indicates indication information of supporting audio processing component optimization. In this way, "1" can indicate that audio processing component optimization is supported and all preset types of audio processing component optimization are supported. For another example: "0" indicates that audio processing component optimization is not supported, "1" indicates that the type of audio processing component optimization that can be supported is azimuth audio optimization, "2" indicates that the type of audio processing component optimization that can be supported is high-fidelity audio optimization, and "3" indicates that the type of audio processing component optimization that can be supported is audio optimization under a preset target scenario. For another example, a two-digit indicator can be used to indicate whether audio processing component optimization is supported and the type of audio processing component optimization that can be supported, such as, "00" indicates that audio processing component optimization is not supported, "01" indicates that audio processing component optimization is supported and the type of audio processing component optimization that can be supported is azimuth audio optimization, "10" indicates that audio processing component optimization is supported and the type of audio processing component optimization that can be supported is high-fidelity audio optimization, and "11" indicates that audio processing component optimization is supported and the type of audio processing component optimization that can be supported is audio optimization under a preset target scenario. Optionally, the types of audio processing component optimization include azimuthal audio optimization (also known as spatial audio optimization), high-fidelity audio optimization, and audio optimization under preset target scenarios, where the audio optimization under preset target scenarios can be, for example, scenarios that require special optimization according to the application scenario, such as scenarios that emphasize heavy bass or heavy treble.

[0043] Optionally, in one practicable embodiment, the client's sound optimization strategy includes a correspondence between one or more preset scenarios of the client and the sound optimization strategy. For example, one preset scenario of the client corresponds to one sound optimization strategy. Accordingly, in S102, a target optimization strategy for the audio signal is determined based on the current scenario and the client's sound optimization strategy. Specifically, the target optimization strategy for the audio signal is determined based on the current scenario and the correspondence. The sound optimization strategy corresponding to the current scenario is determined as the target optimization strategy for the audio signal.

[0044] Optionally, in the above correspondence, the sound effect optimization strategy includes at least one of the client optimization, the audio processing component optimization, and the mixing optimization, and the mixing optimization includes the client optimization and the audio processing component optimization, that is, the mixing optimization refers to both software layer optimization and hardware layer optimization. The client optimization can be used in the case where the audio processing component optimization is not supported or the user selects in-application optimization, while the audio processing component plays the audio signal optimized by the client. The mixing optimization can be used in the case where the client optimization and the audio processing component optimization are needed to cooperate to optimize the sound effect in some scenarios, and the client optimization is performed first, and then the audio component optimization is performed.

[0045] In the above correspondence, the type of the audio processing component optimization includes azimuthal audio optimization, high-fidelity audio optimization, and audio optimization in a preset target scenario. It can be understood that, in the above correspondence, the audio processing component optimization can be any one of the azimuthal audio optimization, the high-fidelity audio optimization, and the audio optimization in a preset target scenario. Taking the client as a game application client as an example, the scenario corresponding to the azimuthal audio optimization can be a scenario in which the user needs to identify the azimuth of the audio in the game, such as the azimuth of the footsteps or gunshots of other players in a shooting game, which needs to be accurately identified through audio to enable the player to accurately identify the source of danger. The scenario corresponding to the high-fidelity audio optimization can be a scenario in which the original information of the audio needs to be highly restored, such as in-game transition audio, game CG sound effects, etc. The scenario corresponding to the mixing optimization can be a scenario in which the user has voice communication, and in this case, the audio of the game itself needs to be suppressed or attenuated as much as possible to make the user's voice clear.

[0046] Optionally, if the client is a game application client, the preset scenarios of the client include at least a game transition animation scenario, a game battle preparation scenario, a game battle scenario, and a game voice scenario. Taking the four scenarios as examples, in the correspondence between the preset scenarios of the client and the sound effect optimization strategy, the sound effect optimization strategy corresponding to the game transition animation scenario is high-fidelity audio optimization, the sound effect optimization strategy corresponding to the game battle preparation scenario is azimuthal audio optimization, the sound effect optimization strategy corresponding to the game battle scenario is audio processing component optimization, and the sound effect optimization strategy corresponding to the game voice scenario is mixing optimization.

[0047] The correspondence between the preset scenarios of the client and the sound effect optimization strategy is described as follows in Table 1:

[0048] Table 1

[0049] Pre-set scenarios for the client Corresponding sound effect optimization strategies Game cutscene scenarios High-fidelity audio optimization Game battle preparation scenarios Azimuth audio optimization Game battle scenarios Audio processing component optimization Game voice scenarios Mixing optimization

[0050] Specifically, game cutscenes typically feature exquisite visuals paired with immersive sound effects. Therefore, high-fidelity audio reproduction is essential, utilizing high-fidelity audio optimization. Game battle preparation scenes feature players approaching an enemy, requiring directional audio to quickly locate their position. Therefore, directional audio optimization is employed to enhance the audio's sense of direction. This optimization is prioritized if supported. Game battle scenes feature intense combat, preventing client-side optimization from impacting game performance. Therefore, audio latency should be minimized, and only audio processing component optimization (including directional audio optimization, high-fidelity audio optimization, and audio optimization for pre-defined target scenarios) should be performed to avoid performance degradation caused by client-side optimization. Game voice scenes feature users communicating via voice, requiring maximum clarity. Therefore, hybrid optimization—a combination of hardware and software—should be employed. For example, within the game application, background noise can be reduced while voice can be appropriately amplified. Optimization strategies to improve sound quality, such as noise reduction, can be implemented in the audio processing component through protocols. If unsupported, these optimizations can be implemented within the game application.

[0051] In this embodiment, optionally, if the sound effect optimization strategy corresponding to the current scene includes at least audio processing component optimization, such as the sound effect optimization strategy corresponding to the current scene includes audio processing component optimization and client optimization, or the sound effect optimization strategy corresponding to the current scene includes audio processing component optimization and mixed optimization, or the sound effect optimization strategy corresponding to the current scene includes audio processing component optimization, client optimization and mixed optimization, then the audio processing component optimization is determined as the target optimization strategy for the audio signal. That is, audio processing component optimization is used first. Otherwise, if the sound effect optimization strategy corresponding to the current scene does not include audio processing component optimization, it means that hardware optimization is not supported, so it is necessary to select client optimization to optimize the audio signal, then client optimization is determined as the target optimization strategy for the audio signal.

[0052] S103: The client optimizes the sound effect of the audio signal through the operating system of the terminal device and the audio processing component in the terminal device according to the target optimization strategy.

[0053] Specifically, the target optimization strategy can be any one of client optimization, audio processing component optimization, and hybrid optimization. Accordingly, in S103, the audio signal is optimized through the audio processing components in the operating system and the terminal device according to the target optimization strategy, which can be:

[0054] If the target optimization strategy is client-side optimization, client-side optimization is performed on the audio signal to obtain an optimized audio signal. The optimized audio signal is then sent to the operating system, which then runs the audio processing component based on the optimized audio signal. Specifically, the operating system receives the optimized audio signal as an audio stream and sends it to the audio processing component. The audio processing component then drives the audio processing component to play the audio.

[0055] If the target optimization policy is for audio processing component optimization, the audio signal and the target optimization policy are sent to the operating system, which then runs the audio processing component based on the audio signal and the target optimization policy. Specifically, the operating system receives the audio signal sent as an audio stream and the target optimization policy sent as a control stream, and sends the audio signal and the target optimization policy to the audio processing component. After receiving the audio signal and the target optimization policy, the audio processing component drives the audio processing component to play audio.

[0056] If the target optimization strategy is hybrid optimization, client-side optimization is performed on the audio signal, and the client-side optimized audio signal and the audio processing component optimization in the hybrid optimization are sent to the operating system, so that the operating system can run the audio processing component based on the client-side optimized audio signal and the audio processing component optimization in the hybrid optimization. Specifically, the operating system can receive the client-side optimized audio signal sent in the form of an audio stream and the audio processing component optimization sent in the form of a control stream, and send the client-side optimized audio signal and the audio processing component optimization to the audio processing component. After receiving the client-side optimized audio signal and the audio processing component optimization, the audio processing component drives the audio processing component to play audio.

[0057] Optionally, the method of this embodiment may further include a method in which the client determines a sound effect optimization strategy of the client. In one practicable manner, the method of this embodiment may further include, before S101:

[0058] S104: The client receives the hardware capability information of the terminal device sent by the operating system through the data channel.

[0059] S105: The client determines whether the terminal device supports audio processing component optimization based on the hardware capability information of the terminal device.

[0060] S106. If the terminal device supports audio processing component optimization, obtain the type of audio processing component optimization supported by the terminal device and the type of client optimization; if the terminal device does not support audio processing component optimization, obtain the type of client optimization.

[0061] Specifically, the client can preset the type of the client optimization, i.e., the client optimization has different optimization manners. Optionally, the type of the terminal device supportable audio processing component optimization and the type of the client optimization can be respectively acquired according to the indication of the type of the terminal device supportable audio processing component optimization or the indication of the type of the client optimization included in the hardware capability information of the terminal device. Optionally, if the hardware capability information of the terminal device includes the indication information that the audio processing component optimization is not supported, the hardware capability information of the terminal device can further include the indication of the type of the client optimization, and then the client can acquire the type of the client optimization according to the indication of the type of the client optimization.

[0062] Optionally, after S106, the method of the embodiment can further include:

[0063] S107, determining the correspondence between the one or more preset scenarios of the client and the type of the audio processing component optimization and / or the type of the client optimization.

[0064] S108, confirming the sound effect optimization strategy corresponding to the one or more preset scenarios according to the correspondence and storing.

[0065] Optionally, the hardware capability information includes the indication information that the audio processing component optimization is supported and / or not supported, and / or the type of the supportable audio processing component optimization, i.e., the hardware capability information of the terminal device can include four kinds of information: 1) the indication information that the audio processing component optimization is not supported; 2) the indication information that the audio processing component optimization is supported; 3) the indication information that the audio processing component optimization is supported and the type of the supportable audio processing component optimization; and 4) the type of the supportable audio processing component optimization. S105 can be specifically:

[0066] If the hardware capability information includes the indication information that the audio processing component optimization is not supported, it is determined that the terminal device does not support the audio processing component optimization.

[0067] If the hardware capability information includes the indication information that the audio processing component optimization is supported or the type of the supportable audio processing component optimization, it is determined that the terminal device supports the audio processing component optimization.

[0068] Further, in the embodiment, the data channel is a connection established between the client and the operating system, and the method of the embodiment can be before S104, and can further include:

[0069] S109, sending a connection establishment request to the operating system, for the operating system to acquire the sound effect optimization capability and the sound effect playing capability of the audio processing component of the terminal device after receiving the connection establishment request.

[0070] S110, receiving information that a connection establishment request sent by the operating system is successful, and establishing a connection with the operating system.

[0071] The processes of S109-S110 are processes of establishing a connection between the client and the operating system, and after the connection is established, the operating system can transmit the hardware capability information of the terminal device to the client through the established connection.

[0072] The sound effect optimization method provided in the embodiment can establish a data channel between the client and the operating system of the terminal device through the client, the client can obtain the hardware capability information of the terminal device through the operating system through the data channel, the client can determine a sound effect optimization strategy matched with the hardware capability of the terminal device according to one or more preset scenes of the client and the hardware capability information of the terminal device, when an audio signal is triggered in a current scene, a target optimization strategy of the audio signal can be determined according to the current scene and the sound effect optimization strategy, and finally the audio signal can be optimized through the operating system and the audio processing component in the terminal device according to the target optimization strategy. Thus, the client can be optimized in combination with the hardware capability of the terminal device, and the effect of the sound effect optimization caused by the hardware capability not supporting can be avoided, the audio processing component can be ensured to perform sound effect optimization according to the scene demand of the actual client, the effect of the sound effect optimization is improved, the software and hardware are cooperatively optimized, and the audio experience is better.

[0073] In the embodiment, the software and hardware are cooperatively optimized, the cross-influence loss caused by the respective optimization of the software and hardware is avoided, and the audio experience is better.

[0074] The sound effect optimization method provided in the embodiment will be described in detail below in combination with a specific embodiment.

[0075] Figure 3 As shown in the interactive flowchart of the sound effect optimization method provided in the embodiment of the application, Figure 3 The method provided in the embodiment can include the following steps.

[0076] S201, the client sends a connection establishment request to the operating system.

[0077] Specifically, the application client can send a connection establishment request to the operating system when the application client is initialized.

[0078] S202, after the operating system receives the connection establishment request sent by the client, if it is found that there is a sound effect interface of the client, a query request is sent to the audio processing component of the terminal device, and the query request is used to query the sound effect optimization capability and the sound effect playing capability of the audio processing component.

[0079] S203, after the audio processing component of the terminal device receives the query request, the audio processing component sends the audio effect optimization capability and the audio effect playing capability of the terminal device to the operating system.

[0080] S204, after the operating system receives the audio effect optimization capability and the audio effect playing capability of the audio processing component, the operating system sends information that the connection establishment request is received successfully to the client, and establishes a connection with the client.

[0081] The client receives the information that the connection establishment request is received successfully sent by the operating system, and establishes a connection with the operating system.

[0082] S205, the client sends a query request for querying the hardware capability information of the terminal device to the operating system.

[0083] S206, the operating system sends a query request for querying the hardware capability information of the terminal device to the audio processing component.

[0084] S207, the audio processing component sends the hardware capability information of the terminal device to the operating system.

[0085] S208, the operating system sends the hardware capability information of the terminal device to the client.

[0086] S209, the client determines whether the terminal device supports the audio processing component optimization according to the hardware capability information of the terminal device.

[0087] S210, if the terminal device supports the audio processing component optimization, the type of the audio processing component optimization that can be supported by the terminal device is obtained, and the type of the client optimization is obtained; if the terminal device does not support the audio processing component optimization, the type of the client optimization is obtained.

[0088] S211, a corresponding relationship between one or more preset scenes of the client and the type of the audio processing component optimization and / or the type of the client optimization is determined.

[0089] S212, according to the above corresponding relationship, the audio effect optimization strategy corresponding to one or more preset scenes of the client is confirmed and stored.

[0090] The audio effect optimization strategy corresponding to one or more preset scenes is confirmed, that is, the audio effect optimization strategy of the client is obtained.

[0091] Specifically, the hardware capability information includes indication information of supporting and / or not supporting the audio processing component optimization, and / or the type of the audio processing component optimization that can be supported, and S209 can be specifically:

[0092] If the hardware capability information includes the indication information of not supporting the audio processing component optimization, it is determined that the terminal device does not support the audio processing component optimization.

[0093] If the hardware capability information includes indication information of supporting audio processing component optimization or the type of audio processing component optimization that can be supported, it is determined that the terminal device supports audio processing component optimization.

[0094] S213: The client obtains the audio signal triggered by the client in the current scene.

[0095] S214: The client determines a target optimization strategy for the audio signal based on the current scenario and the client's sound optimization strategy.

[0096] Specifically, the client's sound effect optimization strategy includes the correspondence between one or more preset scenes of the client and the sound effect optimization strategy, wherein the one or more preset scenes of the client include the current scene. S214 can specifically be: the client determines the sound effect optimization strategy corresponding to the current scene based on the current scene and the correspondence, and determines the sound effect optimization strategy corresponding to the current scene as the target optimization strategy for the audio signal.

[0097] Optionally, in the above correspondence, the sound effect optimization strategy includes at least one of client optimization, audio processing component optimization and hybrid optimization, and hybrid optimization includes client optimization and audio processing component optimization, that is, hybrid optimization refers to both software layer optimization and hardware layer optimization.

[0098] S215: The client optimizes the audio effect of the audio signal through the operating system of the terminal device and the audio processing component in the terminal device according to the target optimization strategy.

[0099] Specifically, if the target optimization strategy is client-side optimization, client-side optimization is performed on the audio signal to obtain an optimized audio signal, which is then sent to the operating system, which then runs the audio processing component based on the optimized audio signal. Specifically, the operating system receives the optimized audio signal sent as an audio stream and sends the optimized audio signal to the audio processing component. After receiving the optimized audio signal, the audio processing component drives the audio processing component to play the audio.

[0100] If the target optimization policy is for audio processing component optimization, the audio signal and the target optimization policy are sent to the operating system, which then runs the audio processing component based on the audio signal and the target optimization policy. Specifically, the operating system receives the audio signal sent as an audio stream and the target optimization policy sent as a control stream, and sends the audio signal and the target optimization policy to the audio processing component. After receiving the audio signal and the target optimization policy, the audio processing component drives the audio processing component to play audio.

[0101] If the target optimization strategy is hybrid optimization, client-side optimization is performed on the audio signal, and the client-side optimized audio signal and the audio processing component optimization in the hybrid optimization are sent to the operating system, so that the operating system can run the audio processing component based on the client-side optimized audio signal and the audio processing component optimization in the hybrid optimization. Specifically, the operating system can receive the client-side optimized audio signal sent in the form of an audio stream and the audio processing component optimization sent in the form of a control stream, and send the client-side optimized audio signal and the audio processing component optimization to the audio processing component. After receiving the client-side optimized audio signal and the audio processing component optimization, the audio processing component drives the audio processing component to play audio.

[0102] Optionally, if the target optimization strategy is that no sound optimization is required, the audio processing component can be directly driven to perform audio playback.

[0103] The sound effect optimization method provided in this embodiment can enable targeted optimization in combination with the hardware capabilities of the terminal device during client optimization, avoiding poor sound effect optimization due to lack of hardware support, and ensuring that the audio processing component can optimize the sound effect according to one or more preset scenario requirements of the actual client, thereby improving the effect of sound effect optimization, realizing collaborative optimization of software and hardware, avoiding the cross-influence loss caused by the optimization of each software and hardware, and providing a better audio experience.

[0104] The following are device embodiments of the present application, which can be used to execute the above method embodiments of the present application. For details not disclosed in the device embodiments of the present application, reference can be made to the above method embodiments of the present application.

[0105] Figure 4 A structural diagram of a sound optimization device provided in an embodiment of the present application is shown as follows: Figure 4 As shown, the apparatus of this embodiment may include: an acquisition module 11, a determination module 12 and a processing module 13, wherein:

[0106] The acquisition module 11 is used to acquire the audio signal triggered in the current scene;

[0107] The determination module 12 is configured to determine a target optimization strategy for the audio signal based on the current scene and the client's sound optimization strategy. The client's sound optimization strategy is determined based on one or more preset scenes of the client and the hardware capability information of the terminal device. The hardware capability information of the terminal device is obtained through a data channel established between the client and the operating system of the terminal device. The one or more preset scenes include the current scene.

[0108] The processing module 13 is used to optimize the sound effect of the audio signal through the operating system of the terminal device and the audio processing component in the terminal device according to the target optimization strategy.

[0109] Optionally, the sound effect optimization strategy of the client comprises a corresponding relationship between one or more preset scenes of the client and the sound effect optimization strategy, and the determining module 12 is configured to: determine the sound effect optimization strategy corresponding to the current scene according to the current scene and the corresponding relationship;

[0110] determine the sound effect optimization strategy corresponding to the current scene as the target optimization strategy of the audio signal.

[0111] Optionally, the sound effect optimization strategy comprises at least one of client optimization, audio processing component optimization and hybrid optimization, the hybrid optimization comprises the client optimization and the audio processing component optimization, and the type of the audio processing component optimization comprises azimuth audio optimization, high-fidelity audio optimization and audio optimization under a preset target scene.

[0112] Optionally, the processing module 13 is configured to:

[0113] if the target optimization strategy is the client optimization, perform client optimization on the audio signal to obtain an optimized audio signal, and send the optimized audio signal to the operating system, so that the operating system runs the audio processing component according to the optimized audio signal;

[0114] if the target optimization strategy is the audio processing component optimization, send the audio signal and the target optimization strategy to the operating system, so that the operating system runs the audio processing component according to the audio signal and the target optimization strategy;

[0115] if the target optimization strategy is the hybrid optimization, perform client optimization on the audio signal, send the audio signal after the client optimization and the audio processing component optimization in the hybrid optimization to the operating system, so that the operating system runs the audio processing component according to the audio signal after the client optimization and the audio processing component optimization in the hybrid optimization.

[0116] Optionally, the client is a game application client, and the preset scenes of the client comprise at least a game cutscene scene, a game battle preparation scene, a game battle scene and a game voice scene.

[0117] in the corresponding relationship, the sound effect optimization strategy corresponding to the game cutscene scene is high-fidelity audio optimization;

[0118] the sound effect optimization strategy corresponding to the game battle preparation scene is azimuth audio optimization;

[0119] the sound effect optimization strategy corresponding to the game battle scene is audio processing component optimization;

[0120] the sound effect optimization strategy corresponding to the game voice scene is hybrid optimization.

[0121] Optionally, the determination module 12 is configured to: if the sound effect optimization strategy corresponding to the current scene includes at least audio processing component optimization, determine audio processing component optimization as the target optimization strategy for the audio signal; if the sound effect optimization strategy corresponding to the current scene does not include audio processing component optimization, determine client optimization as the target optimization strategy for the audio signal.

[0122] Optionally, the acquisition module 11 is further configured to receive hardware capability information of the terminal device sent by the operating system through a data channel;

[0123] The determination module 12 is further configured to determine whether the terminal device supports audio processing component optimization based on the hardware capability information of the terminal device.

[0124] The acquisition module 11 is also used to: if the terminal device supports audio processing component optimization, obtain the type of audio processing component optimization that the terminal device can support, and obtain the type of client optimization; if the terminal device does not support audio processing component optimization, obtain the type of client optimization.

[0125] Optionally, the determining module 12 is further configured to:

[0126] Determining a correspondence between one or more preset scenarios of the client and a type of audio processing component optimization and / or a type of client optimization;

[0127] According to the corresponding relationship, the sound effect optimization strategy corresponding to one or more preset scenes is confirmed and stored.

[0128] Optionally, the hardware capability information includes indication information of support and / or non-support of audio processing component optimization, and / or types of supported audio processing component optimization. The determination module 12 is specifically configured to:

[0129] If the hardware capability information includes indication information that the audio processing component optimization is not supported, determining that the terminal device does not support the audio processing component optimization;

[0130] If the hardware capability information includes indication information of supporting audio processing component optimization or the type of audio processing component optimization that can be supported, it is determined that the terminal device supports audio processing component optimization.

[0131] Optionally, the data channel is a connection established between the client and the operating system.

[0132] The device provided in the embodiment of the present application can execute the above method embodiment. Its specific implementation principles and technical effects can be found in the above method embodiment, and this embodiment will not be repeated here.

[0133] Figure 5 A structural diagram of a sound optimization device provided in an embodiment of the present application is shown as follows: Figure 5As shown, the device of this embodiment is Figure 4 On the basis of the device shown, it can further include: a sending module 14, which is used to send a connection establishment request to the operating system, so that the operating system obtains the sound optimization capability and sound effect playback capability of the audio processing component of the terminal device after receiving the connection establishment request; the acquisition module 11 is also used to receive the information of successful reception of the connection establishment request sent by the operating system, and the processing module 13 is also used to establish a connection with the operating system.

[0134] The device provided in the embodiment of the present application can execute the above method embodiment. Its specific implementation principles and technical effects can be found in the above method embodiment, and this embodiment will not be repeated here.

[0135] Figure 6 A schematic diagram of the structure of a sound optimization system provided in an embodiment of the present application is shown as follows: Figure 6 As shown, the sound effect optimization system in this embodiment includes a client, an operating system, and an audio processing component, all of which are located in the same terminal device. The client may include a sound effect triggering module 21, a first sound effect optimization module 22, and a first control module 23. The operating system may include a second sound effect optimization module 24 and a second control module 25. The audio processing component may include a driver module 26 and a playback module 27.

[0136] Among them, the sound effect trigger module 21 is used to monitor the audio trigger of the application (such as a game application), obtain the audio signal triggered by the client in the current scene, and notify the first control module 23 to determine the target optimization strategy of the audio signal according to the current scene and the sound effect optimization strategy of the client. The first control module 23 is used to obtain the hardware capability information of the terminal device through the operating system, specifically, it can be to obtain the hardware capability information of the terminal device through the data channel established between the client and the operating system of the terminal device. Then, the client's sound effect optimization strategy is determined according to one or more preset scenes of the client and the hardware capability information of the terminal device, and the target optimization strategy of the audio signal is determined according to the current scene and the sound effect optimization strategy of the client.

[0137] The first sound effect optimization module 22 is used to optimize the sound effect of the audio signal through the audio processing components in the operating system and the terminal device according to the target optimization strategy.

[0138] Optionally, the first sound effect optimization module 22 is specifically configured to: if the target optimization strategy is client optimization, perform client optimization on the audio signal to obtain an optimized audio signal, and send the optimized audio signal to the operating system so that the operating system runs the audio processing component according to the optimized audio signal;

[0139] If the target optimization strategy is audio processing component optimization, the audio signal and the target optimization strategy are sent to the operating system so that the operating system runs the audio processing component according to the audio signal and the target optimization strategy;

[0140] If the target optimization strategy is hybrid optimization, the audio signal is optimized on the client side, and the audio signal after client optimization and the audio processing component in the hybrid optimization are optimized and sent to the operating system, so that the operating system can optimize the operation of the audio processing component based on the audio signal after client optimization and the audio processing component in the hybrid optimization.

[0141] The second control module 25 in the operating system is used to communicate with the client and the audio processing component, receiving hardware capability information of the terminal device from the audio processing component and sending the hardware capability information of the terminal device to the first control module 23 of the client. The second control module 25 is also used to receive the target optimization policy sent by the client and send the sound effect optimization instruction containing the target optimization policy to the second sound effect optimization module 24. The second sound effect optimization module 24 is used to receive the sound effect optimization instruction containing the target optimization policy and send the sound effect optimization instruction containing the target optimization policy to the driver module 26 of the sound effect processing component.

[0142] The driver module 26 in the sound processing component is used to communicate with the second control module 25 of the operating system, sending the hardware capability information of the terminal device to the second control module 25. It is also used to receive the sound optimization instruction carrying the target optimization strategy sent by the second sound optimization module 24, optimize the sound effects according to the sound optimization instruction carrying the target optimization strategy, and drive the playback module 27 to play the audio after the sound effect optimization. The playback module 27 is used to receive the instructions and audio signals from the driver module 26 and play the audio.

[0143] Figure 7 It is a schematic block diagram of a terminal device provided in an embodiment of the present application.

[0144] like Figure 7 As shown, the terminal device 700 may include:

[0145] The memory 710 and the processor 720 are configured to store computer programs and transmit the program code to the processor 720. In other words, the processor 720 can call and run the computer program from the memory 710 to implement the method in the embodiment of the present application.

[0146] For example, the processor 720 may be configured to execute the above method embodiments according to instructions in the computer program.

[0147] In some embodiments of the present application, the processor 720 may include but is not limited to:

[0148] A general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, etc.

[0149] In some embodiments of the present application, the memory 710 includes, but is not limited to:

[0150] volatile memory and / or non-volatile memory. The non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM), which is used as the external cache. By way of example, and not limitation, many forms of RAM are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DR RAM).

[0151] In some embodiments of the present application, the computer program can be divided into one or more modules, which are stored in the memory 710 and executed by the processor 720 to complete the method provided by the present application. The one or more modules can be a series of computer program instruction segments capable of completing a specific function, which are used to describe the execution process of the computer program in the terminal device.

[0152] As shown in Figure 7 , the terminal device can further include:

[0153] The transceiver 730 may be connected to the processor 720 or the memory 710 .

[0154] The processor 720 may control the transceiver 730 to communicate with other devices. Specifically, the processor 720 may send information or data to other devices or receive information or data sent by other devices. The transceiver 730 may include a transmitter and a receiver. The transceiver 730 may further include one or more antennas.

[0155] It should be understood that the various components in the terminal device are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.

[0156] The present application also provides a computer storage medium having a computer program stored thereon, which, when executed by a computer, enables the computer to perform the method of the above-mentioned method embodiment. In other words, the present application also provides a computer program product containing instructions, which, when executed by a computer, enables the computer to perform the method of the above-mentioned method embodiment.

[0157] The present application also provides a computer program product, including a computer program, which implements the sound effect optimization method in the above embodiment when executed by a processor.

[0158] When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid state drive (SSD)).

[0159] Those skilled in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0160] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules is only a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0161] Modules described as separate components may or may not be physically separate, and components displayed as modules may or may not be physical modules, i.e., they may be located in one place or distributed across multiple network elements. Some or all of the modules may be selected based on actual needs to achieve the purpose of the present embodiment. For example, the functional modules in the various embodiments of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module.

[0162] The above is only a specific embodiment of the present application, but the scope of protection of the present application is not limited to this. Any changes or substitutions that can be easily conceived by any person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A sound effect optimization method, characterized in that: The method comprises: The client obtains the audio signal triggered in the current scene; determining a target optimization strategy for the audio signal based on the current scene and the sound effect optimization strategy of the client; the sound effect optimization strategy of the client is determined based on one or more preset scenes of the client and hardware capability information of a terminal device, the hardware capability information of the terminal device being obtained via a data channel established between the client and an operating system of the terminal device, the one or more preset scenes including the current scene; According to the target optimization strategy, optimizing the sound effect of the audio signal through the operating system of the terminal device and the audio processing component in the terminal device; The step of optimizing the audio signal according to the target optimization strategy by using the audio processing components in the operating system and the terminal device includes: If the target optimization strategy is client optimization, performing client optimization on the audio signal to obtain an optimized audio signal, and sending the optimized audio signal to the operating system so that the operating system runs the audio processing component according to the optimized audio signal; If the target optimization strategy is audio processing component optimization, sending the audio signal and the target optimization strategy to the operating system, so that the operating system runs the audio processing component according to the audio signal and the target optimization strategy; If the target optimization strategy is hybrid optimization, client optimization is performed on the audio signal, and the client-optimized audio signal and the audio processing component in the hybrid optimization are optimized and sent to the operating system, so that the operating system can optimize and run the audio processing component based on the client-optimized audio signal and the audio processing component in the hybrid optimization.

2. The method according to claim 1, characterized in that The sound effect optimization strategy of the client includes a correspondence between one or more preset scenarios of the client and the sound effect optimization strategy; The determining of the target optimization strategy for the audio signal according to the current scenario and the sound effect optimization strategy of the client includes: Determining a sound effect optimization strategy corresponding to the current scene according to the current scene and the corresponding relationship; The sound effect optimization strategy corresponding to the current scene is determined as the target optimization strategy for the audio signal.

3. The method according to claim 2, characterized in that The sound effect optimization strategy includes the client optimization, the audio processing component optimization and the hybrid optimization. The hybrid optimization includes the client optimization and the audio processing component optimization. The types of audio processing component optimization include azimuthal audio optimization, high-fidelity audio optimization and audio optimization under preset target scenarios.

4. The method according to claim 3, characterized in that The client is a game application client, and the preset scenes of the client include at least a game cut-scene scene, a game battle preparation scene, a game battle scene, and a game voice scene; In the corresponding relationship, the sound effect optimization strategy corresponding to the game cutscene scene is the high-fidelity audio optimization; The sound effect optimization strategy corresponding to the game battle preparation scene is the directional audio optimization; The sound effect optimization strategy corresponding to the game battle scene is to optimize the audio processing component; The sound effect optimization strategy corresponding to the game voice scene is the hybrid optimization.

5. The method according to claim 3, characterized in that Determining the sound effect optimization strategy corresponding to the current scene as the target optimization strategy for the audio signal includes: If the sound effect optimization strategy corresponding to the current scene includes at least audio processing component optimization, then determining the audio processing component optimization as the target optimization strategy for the audio signal; If the sound effect optimization strategy corresponding to the current scene does not include audio processing component optimization, client optimization is determined as the target optimization strategy for the audio signal.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: receiving, via the data channel, hardware capability information of the terminal device sent by the operating system; Determining whether the terminal device supports audio processing component optimization according to the hardware capability information of the terminal device; If the terminal device supports audio processing component optimization, the type of audio processing component optimization supported by the terminal device is obtained, as well as the type of client optimization; if the terminal device does not support audio processing component optimization, the type of client optimization is obtained.

7. The method according to claim 6, characterized in that The method further comprises: Determining a correspondence between one or more preset scenarios of the client and a type of optimization of the audio processing component and / or a type of optimization of the client; According to the corresponding relationship, the sound effect optimization strategy corresponding to the one or more preset scenes is confirmed and stored.

8. The method according to claim 6, characterized in that The hardware capability information includes indication information of support and / or non-support of audio processing component optimization, and / or types of supportable audio processing component optimization. The determining whether the terminal device supports audio processing component optimization based on the hardware capability information of the terminal device includes: If the hardware capability information includes the indication information of not supporting audio processing component optimization, determining that the terminal device does not support audio processing component optimization; If the hardware capability information includes the indication information of supporting audio processing component optimization or the type of supportable audio processing component optimization, it is determined that the terminal device supports audio processing component optimization.

9. The method according to any one of claims 1 to 5, characterized in that The data channel is a connection established between the client and the operating system, and the method further includes: Sending a connection establishment request to the operating system, so that the operating system obtains the sound effect optimization capability and sound effect playback capability of the audio processing component of the terminal device after receiving the connection establishment request; Receive information indicating successful reception of the connection establishment request sent by the operating system, and establish a connection with the operating system.

10. A sound effect optimization device, characterized in that: include: The acquisition module is used to obtain the audio signal triggered in the current scene; A determination module, configured to determine a target optimization strategy for the audio signal based on the current scenario and the sound effect optimization strategy of the client; The sound effect optimization strategy of the client is determined based on one or more preset scenarios of the client and hardware capability information of the terminal device, the hardware capability information of the terminal device being obtained via a data channel established between the client and an operating system of the terminal device, the one or more preset scenarios including the current scenario; a processing module, configured to optimize the sound effect of the audio signal through the operating system of the terminal device and the audio processing component in the terminal device according to the target optimization strategy; The processing module is specifically configured to: If the target optimization strategy is client optimization, performing client optimization on the audio signal to obtain an optimized audio signal, and sending the optimized audio signal to the operating system so that the operating system runs the audio processing component according to the optimized audio signal; If the target optimization strategy is audio processing component optimization, sending the audio signal and the target optimization strategy to the operating system, so that the operating system runs the audio processing component according to the audio signal and the target optimization strategy; If the target optimization strategy is hybrid optimization, client optimization is performed on the audio signal, and the client-optimized audio signal and the audio processing component in the hybrid optimization are optimized and sent to the operating system, so that the operating system can optimize and run the audio processing component based on the client-optimized audio signal and the audio processing component in the hybrid optimization.

11. A terminal device, characterized in that: include: A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that Used to store a computer program, wherein the computer program causes a computer to execute the method according to any one of claims 1 to 9.

13. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Images