Method, device, mobile terminal and storage medium for optimizing audio effects by scene

Abstract

The present invention discloses a method, device, mobile terminal and storage medium for optimizing audio sound effects in different scenes, belonging to the field of mobile terminals. The method comprises: dynamically recording the AudioTrack of the audio; judging the recorded AudioTrack according to a preset judgment strategy to determine the type of AudioTrack; and performing differentiated DTS sound effect optimization on the corresponding AudioTrack in the determined AudioTrack type according to a preset optimization strategy. Through the embodiments of the present invention, it can be achieved that game users hear enhanced game sound effects during the game, but ordinary DTS sound effect changes during ordinary non-game use. While enhancing the sound effects for shooting games, it can be compatible with ordinary mobile phone sound effects, thereby improving user experience.

Description

Technical Field

[0001] The present invention relates to the field of mobile terminals, and in particular to a method, device, mobile terminal and storage medium for optimizing audio scene-specific sound effects. Background Art

[0002] At present, with the increasing popularity of mobile terminals, more and more users are using mobile terminals, and users use mobile terminals more and more frequently in their daily lives, making mobile terminals one of the indispensable mobile devices for users. In addition, mobile terminals have powerful entertainment functions, and various game applications can be played on mobile terminals.

[0003] When playing a game on a mobile terminal, the game screen can be projected and published to the host. After the screen is projected and published to the host, the host may find that the game sound effects are not good when playing the projected game, and they do not have any advantage when fighting against opponents. For example, when playing the game "Peace Elite", the host finds that the gunshots are a bit muffled and the footsteps are a bit soft, which does not give them any advantage when fighting against the enemy when listening to the projected sound. In this case, under normal circumstances, the sound can be adjusted to make the game sounds such as footsteps and gunshots crisper and louder. However, because the entire mobile terminal uses a set of DTS (Digital Theater System) sound effects, which are not specifically set for the game scene, the above sound adjustment will cause the sound of the entire system to change. While the sound effects are enhanced for shooting games, it is not compatible with ordinary mobile phone sound effects such as ringtones and music, which affects the user experience. Summary of the Invention

[0004] In view of this, the embodiments of the present invention provide a method, device, mobile terminal and storage medium for optimizing audio effects in different scenes, which can achieve the goal that game users hear enhanced game sound effects during the game, but ordinary DTS sound effect changes during ordinary non-gaming use. While enhancing the sound effects for shooting games, it can be compatible with ordinary mobile phone sound effects, thereby improving user experience.

[0005] The technical solutions adopted by the present invention to solve the above technical problems are as follows:

[0006] According to one aspect of the present invention, a method for optimizing audio effects by scene is provided, which is applied to a mobile terminal and includes:

[0007] Dynamically record audio for AudioTrack;

[0008] The recorded AudioTrack is judged according to the preset judgment strategy to determine the type of AudioTrack;

[0009] According to a preset optimization strategy, differentiated DTS sound effect optimization is performed on the corresponding AudioTrack in the determined AudioTrack type.

[0010] In one possible design, judging the recorded AudioTrack according to a preset judgment strategy to determine the type of the AudioTrack includes:

[0011] Add an isGameTrack field to AudioTrack to identify whether the current AudioTrack is a track that needs to be enhanced for the game.

[0012] Determine the type of AudioTrack in the current game based on the preset judgment strategy;

[0013] According to the determined type of the AudioTrack in the current game, the isGameTrack field in the AudioTrack corresponding to the type of the AudioTrack is set to a corresponding value.

[0014] In a possible design, the preset judgment strategy includes: first determining whether the pid of the current AudioTrack belongs to a game application, and then determining the type of AudioTrack in the current game in the game application.

[0015] In one possible design, determining the type of AudioTrack in the current game in the game application includes:

[0016] Determine the number of AudioTracks included in the game application;

[0017] Print the characteristics of each AudioTrack determined in advance;

[0018] Sampling all AudioTracks of the game application during the game, and determining the sampling rate of all AudioTracks in the current game;

[0019] Compare the sample rates of all AudioTracks with the pre-printed AudioTrack characteristics to determine the type of AudioTrack currently in the game.

[0020] In one possible design, the method of setting the isGameTrack field in the AudioTrack corresponding to the type of the AudioTrack in the current game to a corresponding value according to the determined type of the AudioTrack includes:

[0021] In determining the type of AudioTrack, for a game-type AudioTrack that is a type of AudioTrack that needs to be enhanced for the game, set the isGameTrack field in the game-type AudioTrack to true;

[0022] For non-game type AudioTrack, which is not a type of AudioTrack that needs to be enhanced by the game, the isGameTrack field in the non-game type AudioTrack is set to false.

[0023] In one possible design, the step of performing differentiated DTS sound optimization on the corresponding AudioTrack of the determined AudioTrack type according to a preset optimization strategy includes:

[0024] According to the corresponding value of the isGameTrack field in the AudioTrack corresponding to the AudioTrack type, a preset optimization strategy is used to perform differentiated DTS sound effect optimization on the corresponding AudioTrack;

[0025] Mix the AudioTrack that has been optimized for dts sound effects and output the dts sound effect changes after mixing.

[0026] In one possible design, the preset optimization strategy includes: for the AudioTrack of the game type with the isGameTrack field set to true, the game-enhanced DTS algorithm is used; for the AudioTrack of the non-game type with the isGameTrack field set to false, the ordinary DTS algorithm is used for processing.

[0027] According to another aspect of the present invention, a device for optimizing audio effects by scene is provided, the device comprising: a recording module, a judgment module, and an optimization module; wherein:

[0028] The recording module is used to dynamically record the audio AudioTrack;

[0029] The judgment module is used to judge the recorded AudioTrack according to a preset judgment strategy to determine the type of AudioTrac;

[0030] The optimization module is used to perform differentiated DTS sound effect optimization on the AudioTrack corresponding to the determined AudioTrack type according to a preset optimization strategy.

[0031] According to another aspect of the present invention, a mobile terminal is provided, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of a method for optimizing audio effects by sub-scene provided in an embodiment of the present invention.

[0032] According to another aspect of the present invention, a storage medium is provided, on which is stored a program for a method for optimizing audio effects by scene. When the program for the method for optimizing audio effects by scene is executed by a processor, the steps of the method for optimizing audio effects by scene provided in an embodiment of the present invention are implemented.

[0033] Compared with related technologies, the embodiments of the present invention propose a method, device, mobile terminal, and storage medium for optimizing audio effects by scene. This method dynamically records and distinguishes the source of the audio AudioTrack, determines the type of the AudioTrack based on a preset judgment strategy, and performs differentiated DTS sound effect optimization on the corresponding AudioTrack within the determined AudioTrack type based on a preset optimization strategy. Different DTS sound effect optimizations are performed for different types of AudioTrack. This ensures that game users hear enhanced game sound effects during gaming, but experience ordinary DTS sound effect changes during non-gaming use, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 A schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present invention.

[0035] Figure 2 A communication network system architecture diagram provided for an embodiment of the present invention.

[0036] Figure 3 A flowchart of a method for optimizing audio effects by scene provided by an embodiment of the present invention.

[0037] Figure 4 A schematic diagram of the structure of an apparatus for optimizing audio effects by scene provided by an embodiment of the present invention.

[0038] Figure 5 A structural diagram of a mobile terminal provided by an embodiment of the present invention.

[0039] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0040] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer and more understandable, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only for explaining the present invention and are not intended to limit the present invention.

[0041] In the subsequent description, suffixes such as "module," "component," or "unit" used to represent elements are only used to facilitate the description of the present invention and have no specific meaning. Therefore, "module," "component," or "unit" can be used interchangeably.

[0042] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0043] The terminal can be implemented in various forms. For example, the terminal described in the present invention may include mobile terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0044] The following description will be made by taking a mobile terminal as an example. It will be understood by those skilled in the art that, in addition to components specifically used for mobile purposes, the configuration according to the embodiments of the present invention can also be applied to fixed type terminals.

[0045] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present invention. The mobile terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (audio / video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation to the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0046] The following combination Figure 1 A detailed introduction to each component of the mobile terminal is given below:

[0047] The RF unit 101 can be used to send and receive information or receive signals during calls. Specifically, it receives downlink information from the base station and transmits it to the processor 110 for processing. It also transmits uplink data to the base station. Typically, the RF unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and more. Furthermore, the RF unit 101 can communicate with the network and other devices via wireless communication. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution), etc.

[0048] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.

[0049] The audio output unit 103 can convert audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Furthermore, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, or the like.

[0050] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos captured by an image capture device (e.g., a camera) in video capture mode or image capture mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the GPU 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the RF unit 101 or the WiFi module 102. The microphone 1042 may receive sound (audio data) in operating modes such as a phone call mode, a recording mode, and a voice recognition mode, and may process such sound into audio data. In the phone call mode, the processed audio (voice) data may be converted into a format that can be transmitted to a mobile communication base station via the RF unit 101. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to eliminate (or suppress) noise or interference generated during the reception and transmission of audio signals.

[0051] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be described here.

[0052] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0053] The user input unit 107 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by the user using a finger, stylus, or any other suitable object or accessory on or near the touch panel 1071) and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction and detects the signal caused by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device and converts it into touch point coordinates, which are then sent to the processor 110. It can also receive commands sent by the processor 110 and execute them. In addition, the touch panel 1071 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Specifically, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, power keys, etc.), a trackball, a mouse, a joystick, etc., and are not specifically limited here.

[0054] Furthermore, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Subsequently, the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the embodiment, the touch panel 1071 and the display panel 1061 are two independent components to realize the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to realize the input and output functions of the mobile terminal, which is not limited here.

[0055] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0056] Memory 109 can be used to store software programs and various data. Memory 109 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as a sound playback function or an image playback function); the data storage area may store data generated based on the use of the mobile phone (such as audio data, a phone book, etc.). Furthermore, memory 109 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0057] Processor 110 is the control center of the mobile terminal, connecting all components of the mobile terminal using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 109 and accessing data stored in memory 109, it executes various functions of the mobile terminal and processes data, thereby providing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, processor 110 may integrate an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 110.

[0058] The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 through a power management system, thereby managing functions such as charging, discharging, and power consumption through the power management system.

[0059] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0060] To facilitate understanding of the embodiments of the present invention, the communication network system on which the mobile terminal of the present invention is based is described below.

[0061] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present invention. The communication network system is an LTE system of universal mobile communication technology. The LTE system includes a UE (User Equipment) 201, an Evolved UMTS Terrestrial Radio Access Network (E-UTRAN) 202, an Evolved Packet Core (EPC) 203, and an operator's IP service 204, which are sequentially connected in communication.

[0062] Specifically, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0063] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Among them, eNodeB 2021 can be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 can provide UE 201 with access to EPC 203 .

[0064] EPC 203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, PGW (PDN Gate Way) 2035, and PCRF (Policy and Charging Rules Function) 2036. MME 2031 is the control node that handles signaling between UE 201 and EPC 203, providing bearer and connection management. HSS 2032 provides registers for managing functions such as the Home Location Register (not shown) and stores user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources, and it selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0065] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem), or other IP services.

[0066] Although the above description is based on the LTE system as an example, those skilled in the art should know that the present invention is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems, and is not limited here.

[0067] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the method of the present invention are proposed.

[0068] In one embodiment, Figure 3 As shown, the present invention provides a method for optimizing the sound effects of game screen projection audio by scene, which is applied to a mobile terminal, and the method includes:

[0069] S1. Dynamically record the audio AudioTrack;

[0070] S2. Judging the recorded AudioTrack according to a preset judgment strategy to determine the type of AudioTrack; wherein the type of AudioTrack includes game-type AudioTrack and non-game-type AudioTrack.

[0071] S3. Perform differentiated DTS sound optimization on the corresponding AudioTrack in the determined AudioTrack type according to a preset optimization strategy.

[0072] In this embodiment, the audio source is dynamically recorded and distinguished by AudioTrack. The recorded AudioTrack is then judged according to a preset judgment strategy to determine the AudioTrack type. Differentiated DTS sound effects are then optimized for the corresponding AudioTrack type according to a preset optimization strategy, with different DTS sound effects optimized for different types of AudioTrack. This ensures that game users hear enhanced game sound effects during gameplay, while experiencing standard DTS sound effects during non-gaming use. While enhancing the sound effects for shooting games, the system is also compatible with standard mobile phone sound effects such as ringtones and music, improving the user experience.

[0073] In one embodiment, in step S1, the dynamic recording of the audio AudioTrack includes:

[0074] In the Android system, audio playback is performed using AudioTrack, which can identify the app from which the audio comes and the number of AudioTracks contained in the app. This AudioTrack information is recorded.

[0075] For example, in the Android system, for the Peacekeeper Elite game, in the audio played, AudioTrack can be used to identify that the audio comes from the Peacekeeper Elite app. The Peacekeeper Elite app contains two AudioTracks, one AudioTrack for all the AudioTrack sounds of the game itself, and the other AudioTrack for the AudioTrack sounds of talking to teammates.

[0076] In one embodiment, in step S2, the recorded AudioTrack is judged according to a preset judgment strategy to determine the type of AudioTrack; wherein the type of AudioTrack includes game type AudioTrack and non-game type AudioTrack.

[0077] S21. Add an isGameTrack field to AudioTrack. The isGameTrack field is used to identify whether the current AudioTrack is a track that needs to be enhanced for the game.

[0078] S22. Determine the type of AudioTrack in the current game according to a preset judgment strategy. The preset judgment strategy includes: first determining whether the pid of the current AudioTrack belongs to the game application; then determining the type of AudioTrack in the current game in the game application, the method is:

[0079] Determine the number of AudioTracks included in the game application;

[0080] Print the characteristics of each AudioTrack determined in advance;

[0081] Sampling all AudioTracks of the game application during the game, and determining the sampling rate of all AudioTracks in the current game;

[0082] Compare the sample rates of all AudioTracks with the pre-printed AudioTrack characteristics to determine the type of AudioTrack currently in the game.

[0083] For example, in the Heping Jingying gaming app, we pre-printed the characteristics of two AudioTracks in the game and found that the sampling rate of the speech AudioTrack was different from that of the game AudioTrack: 48000 and 8000, respectively. This difference can be used to distinguish the speech AudioTrack from the game AudioTrack and determine the type of AudioTrack in the current game.

[0084] S23. According to the determined type of AudioTrack in the current game, set the isGameTrack field in AudioTrack corresponding to the type of AudioTrack to a corresponding value. Specifically:

[0085] In determining the type of AudioTrack, for a game-type AudioTrack, which is a type of AudioTrack that needs to be enhanced for a game, the isGameTrack field in the game-type AudioTrack is set to true; for a non-game-type AudioTrack, which is a type of AudioTrack that does not need to be enhanced for a game, the isGameTrack field in the non-game-type AudioTrack is set to false.

[0086] In one embodiment, in step S3, the differentiated DTS sound effect optimization is performed on the corresponding AudioTrack of the determined AudioTrack type according to a preset optimization strategy, including:

[0087] S31. Based on the value of the isGameTrack field in the AudioTrack corresponding to the AudioTrack type, a preset optimization strategy is used to perform differentiated DTS sound optimization on the corresponding AudioTrack. The preset optimization strategy includes: using a game-enhanced DTS algorithm for game-type AudioTracks with the isGameTrack field set to true; and using a standard DTS algorithm for non-game-type AudioTracks with the isGameTrack field set to false.

[0088] S32, mixing the AudioTrack after DTS sound effect optimization, and outputting the DTS sound effect changes after mixing.

[0089] In this embodiment, the isGameTrack field is used to distinguish whether AudioTrack needs to use DTS enhancement. Before mixing and output, the corresponding DTS algorithm is processed on each AudioTrack. The game-enhanced AudioTrack adopts the game-enhanced DTS algorithm, while the non-game AudioTrack adopts the ordinary DTS algorithm. Before it is sent to mixing and other processing, this perfectly achieves the enhancement of game sound effects for game scenes (for example, the enhancement of shooting sound effects) without affecting ordinary sound effects such as speaking. While enhancing the sound effects for shooting games, it can also be compatible with ordinary mobile phone sound effects such as ringtones and music, thereby improving the user experience.

[0090] In one embodiment, Figure 4 As shown, the present invention provides a device for optimizing the sound effects of game screen projection audio by scene, which is applied to a mobile terminal. The device includes: a recording module 10, a judgment module 20, and an optimization module 30; wherein:

[0091] The recording module 10 is used to dynamically record the audio AudioTrack;

[0092] The judgment module 20 is used to judge the recorded AudioTrack according to a preset judgment strategy to determine the type of AudioTrack; wherein the type of AudioTrack includes game type AudioTrack and non-game type AudioTrack.

[0093] The optimization module 30 is used to perform differentiated DTS sound effect optimization on the corresponding AudioTrack in the determined AudioTrack type according to a preset optimization strategy.

[0094] In this embodiment, the audio source is dynamically recorded and distinguished by AudioTrack. The recorded AudioTrack is then judged according to a preset judgment strategy to determine the AudioTrack type. Differentiated DTS sound effects are then optimized for the corresponding AudioTrack type according to a preset optimization strategy, with different DTS sound effects optimized for different types of AudioTrack. This ensures that game users hear enhanced game sound effects during gameplay, while experiencing standard DTS sound effects during non-gaming use. While enhancing the sound effects for shooting games, the system is also compatible with standard mobile phone sound effects such as ringtones and music, improving the user experience.

[0095] In one embodiment, the recording module 10 is used to record the dynamic audio AudioTrack. Specifically, it includes:

[0096] In the Android system, audio playback is performed using AudioTrack, which can identify the app from which the audio comes and the number of AudioTracks contained in the app. This AudioTrack information is recorded.

[0097] For example, in the Android system, for the Peacekeeper Elite game, in the audio played, AudioTrack can be used to identify that the audio comes from the Peacekeeper Elite app. The Peacekeeper Elite app contains two AudioTracks, one AudioTrack for all the AudioTrack sounds of the game itself, and the other AudioTrack for the AudioTrack sounds of talking to teammates.

[0098] In one embodiment, the judgment module 20 is used to judge the recorded AudioTrack according to a preset judgment strategy to determine the type of AudioTrack; wherein the type of AudioTrack includes game type AudioTrack and non-game type AudioTrack. The specific judgment process includes:

[0099] An isGameTrack field is added to AudioTrack. The isGameTrack field is used to identify whether the current AudioTrack is a Track that needs to be enhanced for the game.

[0100] Determine the type of AudioTrack in the current game according to a preset judgment strategy. The preset judgment strategy includes: first determining whether the pid of the current AudioTrack belongs to the game application; then determining the type of AudioTrack in the current game in the game application, the method is:

[0101] Determine the number of AudioTracks included in the game application;

[0102] Print the characteristics of each AudioTrack determined in advance;

[0103] Sampling all AudioTracks of the game application during the game, and determining the sampling rate of all AudioTracks in the current game;

[0104] Compare the sample rates of all AudioTracks with the pre-printed AudioTrack characteristics to determine the type of AudioTrack currently in the game.

[0105] According to the determined type of AudioTrack in the current game, the isGameTrack field in the AudioTrack corresponding to the type of AudioTrack is set to the corresponding value. Specifically:

[0106] In determining the type of AudioTrack, for a game-type AudioTrack, which is a type of AudioTrack that needs to be enhanced for a game, the isGameTrack field in the game-type AudioTrack is set to true; for a non-game-type AudioTrack, which is a type of AudioTrack that does not need to be enhanced for a game, the isGameTrack field in the non-game-type AudioTrack is set to false.

[0107] In one embodiment, the optimization module 30 is configured to perform differentiated DTS sound optimization on the corresponding AudioTrack of the determined AudioTrack type according to a preset optimization strategy, specifically including:

[0108] According to the corresponding value of the isGameTrack field in the AudioTrack corresponding to the AudioTrack type, differentiated DTS sound effect optimization is performed on the corresponding AudioTrack. Specifically:

[0109] For the AudioTrack of the game type whose isGameTrack field is set to true, the game-enhanced DTS algorithm is used;

[0110] For non-game type AudioTracks whose isGameTrack field is set to false, the normal DTS algorithm is used for processing.

[0111] Mix the AudioTrack that has been optimized for dts sound effects and output the dts sound effect changes after mixing.

[0112] In this embodiment, the isGameTrack field is used to distinguish whether AudioTrack needs to use DTS enhancement. Before mixing and output, the corresponding DTS algorithm is processed on each AudioTrack. The game-enhanced AudioTrack adopts the game-enhanced DTS algorithm, while the non-game AudioTrack adopts the ordinary DTS algorithm. Before it is sent to mixing and other processing, this perfectly achieves the enhancement of game sound effects for game scenes (for example, the enhancement of shooting sound effects) without affecting ordinary sound effects such as speaking. While enhancing the sound effects for shooting games, it can also be compatible with ordinary mobile phone sound effects such as ringtones and music, thereby improving the user experience.

[0113] It should be noted that the above-mentioned device embodiment and method embodiment belong to the same concept, and their specific implementation process is detailed in the method embodiment, and the technical features in the method embodiment are correspondingly applicable in the device embodiment, which will not be repeated here.

[0114] In addition, an embodiment of the present invention further provides a mobile terminal, such as Figure 5 As shown, the mobile terminal 900 includes: a memory 902, a processor 901, and one or more computer programs stored in the memory 902 and executable on the processor 901. The memory 902 and the processor 901 are coupled together via a bus system 903. When the one or more computer programs are executed by the processor 901, the following steps of a method for optimizing the audio effects of game screen projection by scene are implemented in accordance with an embodiment of the present invention:

[0115] S1. Dynamically record the audio AudioTrack;

[0116] S2. Judging the recorded AudioTrack according to a preset judgment strategy to determine the type of AudioTrack; wherein the type of AudioTrack includes game-type AudioTrack and non-game-type AudioTrack.

[0117] S3. Perform differentiated DTS sound optimization on the corresponding AudioTrack in the determined AudioTrack type according to a preset optimization strategy.

[0118] The methods disclosed in the above embodiments of the present invention can be applied to or implemented by the processor 901. The processor 901 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be performed by hardware integrated logic circuits or software instructions in the processor 901. The processor 901 may be a general-purpose processor, a DSP, or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, etc. The processor 901 can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the present invention can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 902. The processor 901 reads information from the memory 902 and, in conjunction with its hardware, completes the steps of the above method.

[0119] It can be understood that the memory 902 in the embodiment of the present invention may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic random access memory (FRAM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device; the volatile memory can be random access memory (RAM), by way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), etc. Memory), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), Direct Rambus Random Access Memory (DRRAM).The memories described in the embodiments of the present invention are intended to include, but are not limited to, these and any other suitable types of memories.

[0120] It should be noted that the above-mentioned mobile terminal embodiment and method embodiment belong to the same concept, and their specific implementation process is detailed in the method embodiment, and the technical features in the method embodiment are correspondingly applicable in the mobile terminal embodiment, which will not be repeated here.

[0121] In addition, in an exemplary embodiment, an embodiment of the present invention further provides a computer storage medium, specifically a computer-readable storage medium, for example, including a memory 902 storing a computer program, wherein the computer storage medium stores one or more programs of a method for optimizing the sound effects of game screen projection audio by scene. When the one or more programs of the method for optimizing the sound effects of game screen projection audio by scene are executed by the processor 901, the following steps of the method for optimizing the sound effects of game screen projection audio by scene are implemented in an embodiment of the present invention:

[0122] S1. Dynamically record the audio AudioTrack;

[0123] S2. Judging the recorded AudioTrack according to a preset judgment strategy to determine the type of AudioTrack; wherein the type of AudioTrack includes game-type AudioTrack and non-game-type AudioTrack.

[0124] S3. Perform differentiated DTS sound optimization on the corresponding AudioTrack in the determined AudioTrack type according to a preset optimization strategy.

[0125] It should be noted that the method program embodiment of the game screen projection audio scene-by-scene sound effect optimization on the above-mentioned computer-readable storage medium and the method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment, and the technical features in the method embodiment are correspondingly applicable in the embodiment of the above-mentioned computer-readable storage medium, which will not be repeated here.

[0126] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0127] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0128] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0129] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, all of which are protected by the present invention.

Claims

1. A method for optimizing audio effects by scene, applied to a mobile terminal, characterized in that: The method comprises: Dynamically record audio for AudioTrack; The recorded AudioTrack is judged according to the preset judgment strategy to determine the type of AudioTrack; Performing differentiated DTS sound effect optimization on the corresponding AudioTrack of the determined AudioTrack type according to a preset optimization strategy; The method of judging the recorded AudioTrack according to a preset judgment strategy to determine the type of AudioTrack includes: Add an isGameTrack field to AudioTrack to identify whether the current AudioTrack is a track that needs to be enhanced for the game. Determine the type of AudioTrack in the current game based on the preset judgment strategy; According to the determined type of AudioTrack in the current game, the isGameTrack field in the AudioTrack corresponding to the type of the AudioTrack is set to a corresponding value; The preset judgment strategy includes: first judging whether the pid of the current AudioTrack belongs to the game application, and then judging the type of AudioTrack in the current game in the game application; Determining the type of AudioTrack in the current game in the game application includes: Determine the number of AudioTracks included in the game application; Print the characteristics of each AudioTrack determined in advance; Sampling all AudioTracks of the game application during the game, and determining the sampling rate of all AudioTracks in the current game; Compare the sampling rates of all AudioTracks with the pre-printed AudioTrack characteristics to determine the type of AudioTrack in the current game; The method of setting the isGameTrack field in the AudioTrack corresponding to the type of the AudioTrack in the current game to a corresponding value according to the determined type of the AudioTrack includes: In determining the type of AudioTrack, for a game-type AudioTrack that is a type of AudioTrack that needs to be enhanced for the game, set the isGameTrack field in the game-type AudioTrack to true; For non-game type AudioTrack, which is not a type of AudioTrack that needs to be enhanced by the game, set the isGameTrack field in the non-game type AudioTrack to false; The step of performing differentiated DTS sound optimization on the corresponding AudioTrack of the determined AudioTrack type according to a preset optimization strategy includes: According to the corresponding value of the isGameTrack field in the AudioTrack corresponding to the AudioTrack type, a preset optimization strategy is used to perform differentiated DTS sound effect optimization on the corresponding AudioTrack; Mix the AudioTrack that has been optimized for DTS sound effects and output the DTS sound effect changes after mixing; The preset optimization strategy includes: for the AudioTrack with the isGameTrack field set to true in the game-type AudioTrack, the game-enhanced DTS algorithm is used; for the AudioTrack with the isGameTrack field set to false in the non-game-type AudioTrack, the ordinary DTS algorithm is used for processing.

2. A mobile terminal, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of a method for optimizing audio effects by scene as described in claim 1.

3. A storage medium, characterized in that: The storage medium stores a program for a method for optimizing audio effects by scene. When the program for the method for optimizing audio effects by scene is executed by the processor, the steps of the method for optimizing audio effects by scene as described in claim 1 are implemented.

Images