Processing method, intelligent terminal and storage medium
By presetting audio data based on the scene on the smart terminal, the problem of users being unable to hear or hear key sounds in the game scene is solved, and the gaming experience is improved.
Patent Information
- Application Number
- CN202411817206.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-10
- Publication Date
- 2025-03-25
AI Technical Summary
Users may not hear or hear the sounds of key event skills in the game in the game scene, affecting the user's gaming experience.
By a processing method, the target audio data in the playback data is performed based on the scene, including determining the scene and the target audio data, and performing appropriate audio processing to improve the data playback effect.
Improve the playback effect of audio data in specific scenes and enhance the user's gaming experience.
Smart Images

Figure CN119697310A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a processing method, an intelligent terminal and a storage medium. Background Art
[0002] As the functions of smart terminals such as mobile phones and tablets continue to improve, they have gradually become one of the commonly used tools in people's daily life and work.
[0003] In the process of conceiving and implementing this application, the inventors found that there are at least the following problems: in some scenarios, such as game scenarios, users may not be able to hear or cannot clearly hear the sounds of key event skills in the game, affecting the user's gaming experience.
[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention
[0005] In response to the above technical problems, the present application provides a processing method, an intelligent terminal and a storage medium, which can process the target audio data in a targeted manner based on the scene, support improving the data playback effect, and thus enhance the user experience.
[0006] The present application provides a processing method, comprising: The target audio data in the data to be played is preset and processed based on the scene.
[0007] Optionally, the processing method further includes: playing the target audio data after the preset processing.
[0008] Optionally, the method for determining a scene includes at least one of the following: Determine the scenario based on the currently running application; Determine the scene based on the operation data of the preset area in the application interface; determining a scene based on an operation for selecting a scene for playback; A scenario is determined based on the first AI model.
[0009] Optionally, the method for determining the target audio data includes at least one of the following: Perform event recognition on the audio data to be played based on the default event list corresponding to the scene to determine the target audio data; Perform event recognition on the audio data to be played based on the historical event list corresponding to the scene to determine the target audio data; Performing event recognition on the audio data to be played based on the first target event list to determine the target audio data; Performing event recognition on the audio data to be played based on the second target event list to determine the target audio data; Predicting playback intention based on the playback scenario, and determining target audio data based on the playback intention; Target audio data is determined based on the second AI model.
[0010] Optionally, the method for obtaining the historical event list includes at least one of the following: Get a list of historical events based on the historical usage data of the application; After the audio data of the previous playback cycle is played, the corresponding event list is obtained, and the historical event list is obtained based on the saving operation and / or adjustment operation of the event list; A list of historical events is obtained based on the third AI model.
[0011] Optionally, the preset processing includes at least one of the following: Processing the target audio data based on the processing parameters; Processing target audio data based on environmental noise information; Processing the enhanced target audio data based on the clarity parameters corresponding to the current scene; Processing parameters are determined based on the playback intent, and target audio data is processed based on the processing parameters.
[0012] Optionally, predicting the playback intention based on the playback scenario includes at least one of the following: Predicting playback intention based on the playback progress of audio data; Predict playback intent based on the current screen; When the current application is a game application, the playback intention is predicted based on the game progress; Predicting playback intention based on operation data of a preset area in the application interface; Predict playback intention based on the fourth AI model.
[0013] Optionally, determining the target audio data based on the playback intent includes at least one of the following: Adjusting the currently used event list according to the playback intent, and determining the target audio data based on the adjusted event list; Displaying a recommended event list on the current interface according to the playback intention, determining an adjusted time event list in response to a selection operation on the recommended event list, and determining target audio data based on the adjusted event list; The target audio data is determined based on the fifth AI model.
[0014] Optionally, event recognition is performed to determine target audio data, including: Input the audio data to be played into the deep learning event detection model for event recognition; The target audio data is determined based on the event labels output by the deep learning event detection model.
[0015] The present application also provides an intelligent terminal, comprising: a memory and a processor, wherein a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of any of the above processing methods are implemented.
[0016] The present application also provides a storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the steps of any of the processing methods described above are implemented.
[0017] The technical solution of the present application performs preset processing on the target audio data in the playback data based on the scenario, can determine the target audio data in a targeted manner, support improving the data playback effect, and thus enhance the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.
[0019] Figure 1 A schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application; Figure 2 A communication network system architecture diagram provided for an embodiment of the present application; Figure 3 is a flowchart of a processing method according to the first embodiment; Figure 4 is an interface diagram of the processing method according to the first embodiment Figure 1 ; Figure 5 is an interface diagram of the processing method according to the first embodiment Figure 2 ; Figure 6 is an interface diagram of the processing method according to the first embodiment Figure 3 ; Figure 7 is a schematic diagram of the interaction of modules in the processing method according to the second embodiment; Figure 8 It is a schematic diagram of a specific flow chart of the processing method according to the second embodiment.
[0020] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0021] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0022] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.
[0023] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.
[0024] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
[0025] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.
[0026] It should be noted that in this article, step codes such as S1 and S2 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the order. When implementing the step, those skilled in the art may execute S2 first and then S1, etc., but these should all be within the scope of protection of this application.
[0027] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0028] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.
[0029] The smart terminal may be implemented in various forms. For example, the smart terminal described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, smart watches, personal digital assistants (PDAs), portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.
[0030] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.
[0031] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0032] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal: The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing- Long Term Evolution), TDD-LTE (Time Division Duplexing- Long Term Evolution), 5G and 6G, etc.
[0033] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.
[0034] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.
[0035] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.
[0036] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can also be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.
[0037] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
[0038] The user input unit 107 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch panel 1071), and drive corresponding connection devices according to a pre-set program. The touch panel 1071 may include a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.
[0039] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.
[0040] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.
[0041] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0042] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.
[0043] The mobile terminal 100 may further include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.
[0044] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.
[0045] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.
[0046] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.
[0047] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.
[0048] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .
[0049] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving GateWay) 2034, PGW (PDN Gate Way) 2035, and PCRF (Policy and Charging Rules Function) 2036. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as a home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034. PGW2035 can provide IP address allocation and other functions for UE 201. PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).
[0050] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.
[0051] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.
[0052] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.
[0053] First embodiment Reference Figure 3 , Figure 3 is a flowchart of a processing method according to the first embodiment. The processing method of the embodiment of the present application can be applied to a smart terminal (such as a mobile phone), including the steps of: S1: Preset processing is performed on target audio data in the data to be played based on the scenario.
[0054] Optionally, the data to be played may be audio, video, a combination of audio and video, etc. For example, when the current application is a game application, the audio data to be played may be an audio clip to be played or processed in the game, including background music, environmental sound effects, attack effects, character dialogues, etc.
[0055] Optionally, the target audio data may be all the audio data in the data to be played, or part of the audio data in the data to be played determined based on the user's preference.
[0056] Optionally, the partial audio data includes audio of a specific time period, audio of a specific type, audio of specific content, etc.
[0057] Optionally, the audio of a specific time period means that the user may be only interested in a certain time period in the data to be played, and therefore the audio data in the time period needs to be extracted.
[0058] Optionally, the audio of specific content means that the user may be more interested in a certain melody in the data to be played, the chorus part of a song, or a certain line in a movie dialogue.
[0059] Optionally, the specific type of audio means that the user may be interested in only a certain type of audio, such as background music, human voice, or specific sound effects.
[0060] Optionally, the method for determining a scene includes at least one of the following: Determine the scenario based on the currently running application; Determine the scene based on the operation data of the preset area in the application interface; determining a scene based on an operation for selecting a scene for playback; A scenario is determined based on the first AI model.
[0061] It is understandable that, considering the different storylines, operations and environments of different applications, the corresponding scenes will also be different. For example, in game applications, including FPS (first-person shooter) and MOBA (multiplayer online tactical competition), in FPS, users play games from a first-person perspective and directly control the actions and shooting of the characters, so the corresponding scene is a local field of view from a first-person perspective. This perspective enhances the user's sense of immersion and makes the game experience more real and tense. In MOBA games, a bird's-eye view or a third-person perspective is usually used, and users need to pay attention to the actions of multiple units (such as heroes, soldiers, etc.) at the same time, so the corresponding scenes mostly include a global field of view. It is understandable that in the same game application, different functional modes will also be set to provide users with different game experiences, so there will be multiple different scenes in the same game application.
[0062] Optionally, determining a preset area in the application interface includes: Determining a preset area in the application interface based on the detected touch operation on the application interface; and / or, An area at a preset position in the application interface is determined as a preset area.
[0063] Optionally, when detecting the user's touch action on the interface, it can be detected and determined based on capacitive touch sensor technology, specifically by detecting the touch position and action of the user's finger or stylus on the screen, to achieve accurate recognition and response to the user's operation.
[0064] Optionally, when a touch operation of a user on the application interface is detected, the preset area is determined by detecting at least one position information detected by the touch operation on the application interface, which may specifically include at least one of the following: The area where touch operations are concentrated is used as a preset area; An area within a first preset range from the detected touch point is used as a preset area; The area within the second preset range pointed to by the touch operation is used as the preset area.
[0065] Optionally, the preset area may be determined by any one of the above determination methods, or may be determined by combining at least two determination methods.
[0066] Optionally, the operation data of the preset area includes touch direction (such as left, right, up, down), touch gesture (such as single click, double click, long press, slide), touch frequency, touch change speed, touch order, etc.
[0067] Exemplarily, when determining that the current scene is an interface scene of an FPS game, determining the scene based on the operation data of a preset area in the application interface includes: when the left-hand touch action is monitored as follows: the left thumb clicks on the roulette sliding area at the bottom left of the screen, drags for a long time and keeps touching for a long time, but the change speed will be low. The left index finger will click on the quick click area at the upper left of the screen to fire. And / or, the right-hand touch action is monitored as follows: the right thumb clicks on the aiming and shooting area at the bottom right of the screen, drags for aiming and shooting, quickly and frequently clicks and keeps touching, and the right index finger will click on the small map area at the upper right of the screen, clicks to send a signal and punctuates. At this point, it can be determined that the current scene is an interface scene of an FPS game.
[0068] Exemplarily, when determining that the current scene is an interface scene of a MOBA game, determining the scene based on the operation data of a preset area in the application interface includes: when the left-hand touch action is monitored as follows: the left thumb will click on the roulette sliding area at the bottom left of the screen, drag for a long time and press and touch continuously, and the change speed will be very fast for the character's movement needs. The left index finger will click on the small map area at the upper left of the screen to observe the battlefield, and the frequency of use is relatively low. And / or, the right-hand touch action is monitored as follows: the right thumb will click on the skill key area at the bottom right of the screen, quickly click and accurately drag to release skills. The right index finger will click on the perspective drag area at the upper right of the screen, and drag over a large area to view the map situation to observe the battlefield. At this point, it can be determined that the current scene is an interface scene of a MOBA game.
[0069] Optionally, in the interface of multiple application scenarios, user instructions, such as click instructions, key instructions, voice instructions, etc., may be identified to determine the selected playback scene to further determine the scene.
[0070] Optionally, the first AI model can automatically identify the specific scene or environment in which the user is located by analyzing the data of the current interface or surrounding environment (such as images, text, voice, operations, etc.). It can be understood that the first AI model can be trained by learning the first sample data obtained by acquisition to realize the function of scene recognition. Optionally, the currently running application, the operation data of the preset area in the application interface, and the operation for selecting the playback scene can also be identified based on the first AI model to further determine the corresponding scene.
[0071] Optionally, the first sample data may be the user's previous historical behavior data, or may be big data obtained through networking.
[0072] Optionally, the method for determining the target audio data includes at least one of the following: Perform event recognition on the audio data to be played based on the default event list corresponding to the scene to determine the target audio data; Perform event recognition on the audio data to be played based on the historical event list corresponding to the scene to determine the target audio data; Performing event recognition on the audio data to be played based on the first target event list to determine the target audio data; Performing event recognition on the audio data to be played based on the second target event list to determine the target audio data; Predicting playback intention based on the playback scenario, and determining target audio data based on the playback intention; Target audio data is determined based on the second AI model.
[0073] Optionally, the event list can be a sorted list of at least one event determined based on user preferences or a specific scene. For example, when the scene is an FPS game scene, the default event list includes gunshots, footsteps, car sounds, system reminders, broken window sound effects, etc. in sequence. For another example, when the scene is a MOBA game scene, the default event list includes character sound effects, skill sound effects, walking sounds, tower stacking sound effects, jungle sound reminders, system reminders, etc. in sequence. For another example, when the scene is a comedy movie, the default event list includes the voices, laughter, and action sounds of specific characters in sequence. For another example, when the scene is rock music, the default event list includes the sounds of specific instruments, specific beats, high notes, low notes, etc. in sequence.
[0074] Optionally, a default event list generated by at least one event preset in the scene can be determined to correspond to the determined event list, or a default event list corresponding to the scene can be generated based on event reminders pushed by big data to identify at least one event and determine the target sound effect data that needs to be processed.
[0075] Optionally, a historical event list may be generated based on events selected or saved by the user in the historical data, and the event list may be further determined based on the historical event list.
[0076] Optionally, before performing event recognition on the audio data to be played based on the first target event list, the method further includes: determining the first target event list based on an operation of filtering a default event list corresponding to the scene.
[0077] Optionally, when filtering the default event list corresponding to the scene, the filtering may be performed based on the user's preference habits, or at least one event in the default event list may be filtered based on a time period.
[0078] Optionally, when filtering based on user preferences, the user's interests and behavior patterns can also be analyzed based on the user's historical game data, questionnaires, real-time or regular feedback, etc., so as to filter out at least one event that meets their preferences.
[0079] Optionally, when screening the first target event list, at least one event list that needs to be enhanced may be selected and sorted in order according to the degree of need to determine the first target event list.
[0080] Optionally, before performing event recognition on the audio data to be played based on the second target event list, the method further includes: when the current application is a game application, filtering a default event list corresponding to the playback scene according to the character information to determine the second target event list.
[0081] Optionally, considering that each character has its own unique attributes, skills, dialogues, and sound effects, when integrating the character sound effects with the background sound effects, the character sound effects may not be heard, which may affect the game experience of the character. For example, if the current character is a warrior, events related to combat, courage, and glory may be filtered out; for another example, if the character is a wizard, events related to magic, spells, and mysterious atmosphere may be given priority.
[0082] Optionally, in order to prevent the character sound effects from being covered by the background sound effects, when the character sound effects and the background sound effects are integrated, the corresponding volume ratio needs to be adjusted. For example, when the character speaks or makes an important sound effect, the volume of the background sound effects can be automatically reduced or some background sound effects can be temporarily turned off. Optionally, audio technology can also be used to enhance the clarity and recognizability of the character sound effects.
[0083] Optionally, the current playback scene is monitored in real time or periodically, including the game stage (such as tutorial, main quest, side quest, battle, etc.), environment (such as indoors, outdoors, specific location), time (such as day, night), and current game status (such as calm, tense, fierce battle), etc.
[0084] Optionally, based on the analysis of the playback scene, the user's possible intentions or needs in this scene are predicted accordingly. For example, in a battle scene, the user may pay more attention to the enemy's position, the status of teammates, the release of skills, etc.; in an exploration scene, the user may pay more attention to the immersion of the environment and the fun of discovering new elements.
[0085] Optionally, according to the playback intent, corresponding target audio data is selected or generated from the audio library to meet the needs of the user. For example, in a battle scene, in order to highlight the position of a certain character, the sound effects in that direction (such as footsteps, breathing, weapon collision, etc.) can be added; for another example, in order to emphasize the release of a certain skill, the sound effects of the skill (such as explosions, magic sound effects, special mechanical sounds, etc.) can be enhanced.
[0086] Optionally, the playback of audio data can be dynamically adjusted based on user feedback and behavior data. For example, if a user stays in a certain area for a long time or interacts frequently, the volume and complexity of the background music or ambient sound effects in that area may be increased; for another example, if a user shows a preference for a certain skill sound effect in battle, the sound effect can be more prominent in subsequent battles.
[0087] Optionally, the data of the current interface (such as images, text, voice, etc.) can be analyzed based on the second AI model to automatically identify and determine the user's target audio data. It can be understood that the second AI model can identify and determine the target audio based on the input scene correspondence by learning the second sample data acquired.
[0088] Optionally, the second sample data may be the user's previous historical behavior data, or may be big data obtained through networking.
[0089] Optionally, the method for obtaining the historical event list includes at least one of the following: Get a list of historical events based on the historical usage data of the application; After the audio data of the previous playback cycle is played, the corresponding event list is obtained, and the historical event list is obtained based on the saving operation and / or adjustment operation of the event list; A list of historical events is obtained based on the third AI model.
[0090] Optionally, the last play cycle is, for example, the last game, the last song of the same type, the previous same melody of the current song, the last movie of the same type, the previous same plot of the current movie, etc. Taking the game as an example, after the last game ends, a list of events that need to be retained and / or adjusted can be obtained based on the interface prompt, so that the next game can be played based on the adjusted events, thereby improving the user's gaming experience.
[0091] For example, Figure 4 As shown, if the current scene is an FPS game, after the user completes the last game, the user may be prompted with items that need to be enhanced, such as: weapon sounds, footsteps, vehicle sounds, airdrop reminders, broken window sounds, healing sounds, background music, etc. Correspondingly, the user makes selections based on the displayed items that can be enhanced and redefines the event list.
[0092] Alternatively, if Figure 5 As shown, if the current scene is a MOBA game, after the user completes the last game, the user is prompted with items that need to be enhanced, such as character sound effects, attack sound effects, head prompt sound effects, character movement sounds, equipment sounds, mark reminders, character interaction sound effects, background music, etc. Correspondingly, the user makes selections based on the displayed items that can be enhanced and re-determines the event list.
[0093] Optionally, the data of the current interface (such as images, text, voice, operations, etc.) can be analyzed based on the third AI model to automatically identify and determine the historical event list. It can be understood that the third AI model can be trained by learning the third sample data obtained by the collection so as to be able to identify and determine the event list.
[0094] Optionally, the third sample data may be the user's previous historical behavior data, or may be big data obtained through networking.
[0095] Optionally, the preset processing includes at least one of the following: Processing the target audio data based on the processing parameters; Processing target audio data based on environmental noise information; Processing the enhanced target audio data based on the clarity parameters corresponding to the current scene; Processing parameters are determined based on the playback intent, and target audio data is processed based on the processing parameters.
[0096] Optionally, the processing parameters include volume, equalization, compression, limiting, etc. For example, when a character uses a special skill, it may be necessary to increase the volume of the skill sound effect or adjust its equalization setting to make it more prominent. These parameters can be dynamically adjusted according to the game settings and user behavior to provide the best auditory experience.
[0097] Optionally, the environmental noise information refers to the sounds of the environment in which the terminal is located, such as wind, rain, and speech, which may interfere with the user's perception of the target audio data. By analyzing the characteristics of the environmental noise, the target audio data can be appropriately processed, such as increasing the volume, changing the frequency response, or applying noise reduction technology to ensure that the user can clearly hear important audio information.
[0098] Optionally, the enhanced target audio data is processed based on the clarity parameters corresponding to the current scene: the clarity parameters may include de-reverberation, enhanced speech clarity, etc. In some scenes, such as conversations or important reminders, it is necessary to ensure that the audio content is clear and understandable. By applying the clarity parameters to the enhanced audio data, the audio recognizability and comprehension can be further improved.
[0099] Optionally, playback intent refers to the user's preferred behavior and expectations in the current scenario. For example, when exploring a new area, the user may want to hear more ambient sound effects; in another example, in a tense battle scene, the user may pay more attention to skill sound effects and enemy location prompts, or may enhance them by turning off background music. By analyzing the user's playback intent, the corresponding processing parameters can be determined, and the target audio data can be customized to meet the user's needs and expectations.
[0100] In this way, by reasonably applying processing parameters, considering environmental noise information, applying clarity parameters, and customizing processing strategies according to playback intent, a more immersive and personalized playback experience can be provided to users.
[0101] Optionally, predicting the playback intention based on the playback scenario includes at least one of the following: Predicting playback intention based on the playback progress of audio data; Predict playback intent based on the current screen; When the current application is a game application, the playback intention is predicted based on the game progress; Predicting playback intention based on operation data of a preset area in the application interface; Predict playback intention based on the fourth AI model.
[0102] Optionally, the currently playing audio data can be monitored in real time or periodically to predict the next possible event or plot twist based on the current audio data playback progress, so as to further predict the playback intention. For example, if a predictive sound effect is about to end, it can be predicted that an important event may occur next.
[0103] Optionally, the current screen can be detected in real time or periodically to determine the current game state based on the current screen, and further infer the user's playback intention based on the determined current game state. For example, when encountering an enemy character in the game, it is preset that the character is about to attack, and the corresponding playback intention should focus on the attack sound effect. For another example, if in an FPS game, when the user is alone in a defensive state, the corresponding current playback intention can be predicted to focus on determining the footsteps, gunshots, car sounds, etc. from other users.
[0104] Optionally, in game development, the playback progress of audio data may also be associated with other game elements, including monster spawning progress, tower stacking progress, remaining number of people progress, countdown time progress, story development progress, etc. In this way, the playback intention can be predicted based on changes in different stages of the game or battle situations.
[0105] It can be understood that when the current application is a game application, the preset area in the application interface generally refers to the operation area in the application interface.
[0106] Optionally, based on the touch operation detected in the preset area, the user's attack, defense, etc. state can be further determined, and the corresponding playback intention can be determined.
[0107] Optionally, the data of the current interface (such as images, text, voice, operation, etc.) can be analyzed based on the fourth AI model to automatically identify and predict the playback intention. It can be understood that the fourth AI model can be trained by learning the fourth sample data obtained by the collection to enable scene recognition.
[0108] Optionally, the playback progress of the audio data, the game progress, the operation data of the preset area, etc. can also be identified based on the fourth AI model to further analyze and predict the playback intention.
[0109] Optionally, the fourth sample data may be the user's previous historical behavior data, or may be large data obtained through networking. Optionally, determining the target audio data based on the playback intention includes at least one of the following: Adjusting the currently used event list according to the playback intent, and determining the target audio data based on the adjusted event list; Displaying a recommended event list on the current interface according to the playback intention, determining an adjusted time event list in response to a selection operation on the recommended event list, and determining target audio data based on the adjusted event list; The target audio data is determined based on the fifth AI model.
[0110] Optionally, based on the determined current playback intention, the current event list can be automatically adjusted accordingly, including adjusting the character that the user is more concerned about, or adjusting the activities that the user prefers in the game experience, such as character attacking, looking for equipment, driving, flying a plane, etc.
[0111] Optionally, the audio data to be played is further determined based on the adjusted time event list. These audio data may include background music, environmental sound effects, character dialogues, etc., all of which are designed to enhance the user's immersion and gaming experience.
[0112] Optionally, appropriate audio data can be selected based on the priority and importance of the event and played out through the audio engine. At the same time, the playback of audio data can also be dynamically adjusted based on user behavior and feedback to ensure that it matches the game context.
[0113] Optionally, in addition to automatic recommendation and adjustment, the user can also display a list of recommended events on the current interface based on the playback intention, manually adjust the time event list or select other events accordingly. This manual adjustment may be based on the user's personal preferences, game strategy, or needs in a specific situation. Optionally, when the user makes manual adjustments, the user's new intentions can be identified, and the time event list and target audio data can be updated based on these intentions. This flexibility allows the game to better adapt to user changes and needs, providing a more personalized and customized gaming experience.
[0114] Alternatively, if Figure 6 As shown, when the user is in a jungle position based on the lane position selected by the user in the game, a list of recommended events can be based on the game interaction experience with the most jungle positions, including: attack sound effects, wild monster interaction sound effects, character movement sounds, equipment sounds, mark reminders, character interaction sound effects, and background music. Here, the user can make a selection based on the pop-up interface to determine the adjusted time event list, and determine the target audio data based on the adjusted event list.
[0115] Optionally, the data of the current interface (such as images, text, voice, operations, etc.) can be analyzed based on the fifth AI model, and the target audio data can be output accordingly. It can be understood that the fifth AI model can identify and determine the target audio data correspondingly by learning the fifth sample data collected.
[0116] Optionally, the fifth sample data may be the user's previous historical behavior data, or may be big data obtained through networking.
[0117] Optionally, event recognition is performed to determine target audio data, including: Input the audio data to be played into the deep learning event detection model for event recognition; The target audio data is determined based on the event labels output by the deep learning event detection model.
[0118] Optionally, a deep learning event detection model is a machine learning model based on a neural network that is trained to recognize and classify specific events or patterns in audio data. Such a model is usually trained using a large amount of labeled data to learn the features and patterns of different audio events. When performing event recognition based on a deep learning event detection model, first, the audio data to be played is input into the deep learning event detection model, and the model processes and analyzes the audio data, extracts the features therein, and matches them with the event features learned during training. Secondly, if the model recognizes that the audio data contains a specific event (such as a certain skill, the appearance of an enemy, etc.), it will output the corresponding event label to determine the corresponding sound effect processing. Then, corresponding actions can be taken based on the recognition results of the deep learning event detection model. For example, if the model recognizes the sound of the enemy appearing, it may trigger a corresponding combat mechanism or alarm; for another example, if a certain skill sound effect is recognized, the user's status or skill cooldown time may be updated. In this way, event recognition through a deep learning event detection model can respond to user behavior and intentions more intelligently and provide a richer and more personalized user experience.
[0119] Optionally, the deep learning event detection model can process the input audio data and identify specific events or patterns contained therein. Here, the training of the deep learning event detection model usually requires a large amount of labeled data, which contains various audio events and their corresponding labels. When determining the target audio data according to the event label output by the deep learning event detection model, first, when the audio data to be played is input into the deep learning event detection model, the model processes and analyzes the audio, extracts the features therein, and matches them with the event features learned during training. Secondly, if the model successfully identifies a specific event in the audio data, it outputs one or more event labels. These labels represent the types of events detected in the audio data, such as "enemy appearance", "skill release", "environmental changes", etc. Then, according to the event labels output by the deep learning event detection model, the target audio data to be played next can be determined. For example, if the model outputs an event label of "enemy appearance", sound effects or background music related to the appearance of the enemy can be selected as the target audio data to enhance the user's immersion and usage experience. If the model outputs an event tag of "skill release", the sound effect or voice prompt corresponding to the skill can be selected as the target audio data to provide feedback to the user on the use of the skill. Optionally, in addition to selecting static target audio data based on the event tag, the playback of audio data can be dynamically adjusted according to the specific circumstances of the event and the user's behavior. For example, if the event of the enemy's appearance is accompanied by an emergency or high threat level, the volume or priority of the sound effect can be increased to alert the user. For another example, if the user takes other actions quickly after the skill is released, the playback order or content of the audio data can also be adjusted accordingly to maintain the continuity and logic of the game.
[0120] Optionally, the processing method further includes: playing the target audio data after the preset processing.
[0121] Finally, user feedback on audio data playback can be collected, and the deep learning event detection model and audio data selection strategy can be optimized based on this feedback. Here, through continuous iteration and optimization, the accuracy of audio event recognition and the personalization of audio data playback can be gradually improved, thereby improving the overall user experience. In this way, by using a deep learning event detection model to identify and classify specific events in audio data, and selecting or adjusting the corresponding audio data based on the recognition results, a richer, more personalized, and immersive user experience can be provided.
[0122] In summary, by pre-processing the target audio data in the data to be played based on the scenario, the target audio data can be determined in a targeted manner, which supports improving the data playback effect and thus improves the user experience.
[0123] Second embodiment Reference Figure 7 , Figure 7 is a flowchart of a processing method according to the second embodiment, wherein the processing method is implemented by interacting with four models of a deep learning event detection module, a DSP (Digital Signal Processor) signal enhancement processing module, a deep learning sound effect clarity module, and a DSP post-processing standardization module. Optionally, in combination with Figure 8 The interaction diagram of the modules includes: Optionally, for the deep learning audio event detection module, the game type and the corresponding scene are first detected through the touch detection module, and the corresponding sound effect preset parameters are loaded to provide a basis for subsequent dynamic processing. After that, as the game APP is entered, the audio stream data is subjected to real-time or periodic category analysis and processing, and finally the corresponding event list is output as the input information of the next module to guide the operation mode of the next DSP module.
[0124] Optionally, for the DSP signal enhancement processing module, the currently recorded environmental audio data is obtained, and processed in combination with the results after the event detection module and the audio signal stream. The main operation method is to disassemble and enhance the important parts of the signal information and ignore the non-concerned parts of the signal to keep the signal content complete and healthy to the greatest extent.
[0125] Optionally, for the deep learning sound clarity post-processing module, first, the current signal frequency response ratio is captured according to the real-time content of the signal, and the dynamic reference value ratio is adjusted according to the result of the event detection module. Secondly, the real-time audio data stream is disassembled and analyzed to capture the current signal spectrum response ratio (Low, LM, MH, High), and the value of the clarity module frequency response reference curve is adjusted according to the target audio corresponding to the event list of the event detection module, so as to achieve a balanced final listening experience and obtain a better experience. Optionally, the deep learning of the model is based on the analysis of the signal acquisition angle of each event during the actual playback process (such as gunshots, footsteps, etc.), and the corresponding content of the optimal type of frequency response reference curve range, so that the audio real-time analysis spectrum works within the optimal listening frequency range.
[0126] Optionally, the DSP post-processing standardization module, which is also a real-time processing module, can perform final limiting control and enhanced gain control adjustment on the audio stream processed by the previous module, and return the processed audio signal to the audio stream to achieve final playback.
[0127] The technical solution of this embodiment can process the target audio data in the data to be played in a targeted manner based on the scene, support improving the data playback effect, and thus improve the user experience.
[0128] An embodiment of the present application also provides an intelligent terminal, including a memory and a processor. A processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method in any of the above embodiments are implemented.
[0129] An embodiment of the present application further provides a storage medium, on which a processing program is stored. When the processing program is executed by a processor, the steps of the processing method in any of the above embodiments are implemented.
[0130] In the embodiments of the smart terminal and storage medium provided in the present application, all technical features of any of the above-mentioned processing method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.
[0131] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.
[0132] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.
[0133] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0134] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0135] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.
[0136] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.
[0137] It should be noted that if this application involves the collection or analysis of user behavior data, it must comply with the requirements of relevant laws and regulations and be carried out with the user's knowledge and consent to protect the user's legitimate rights and interests.
[0138] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.
[0139] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0140] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.
[0141] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.
[0142] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a storage medium, or transmitted from one storage medium to another storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center to another website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a storage disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state storage disk Solid State Disk (SSD)), etc.
[0143] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A processing method, characterized in that: include: The target audio data in the data to be played is preset and processed based on the scene.
2. The method according to claim 1, characterized in that The processing method further includes: playing the target audio data after the preset processing; and / or, the scene determination method includes at least one of the following: Determine the scenario based on the currently running application; Determine the scene based on the operation data of the preset area in the application interface; determining a scene based on an operation for selecting a scene for playback; A scenario is determined based on the first AI model.
3. The method according to claim 1, characterized in that The method for determining the target audio data includes at least one of the following: Perform event recognition on the audio data to be played based on the default event list corresponding to the scene to determine the target audio data; Perform event recognition on the audio data to be played based on the historical event list corresponding to the scene to determine the target audio data; Performing event recognition on the audio data to be played based on the first target event list to determine the target audio data; Performing event recognition on the audio data to be played based on the second target event list to determine the target audio data; Predicting playback intention based on the playback scenario, and determining target audio data based on the playback intention; Target audio data is determined based on the second AI model.
4. The method according to claim 3, characterized in that The method for obtaining the historical event list includes at least one of the following: Get a list of historical events based on the historical usage data of the application; After the audio data of the previous playback cycle is played, a corresponding event list is obtained, and a historical event list is obtained based on a save operation and / or an adjustment operation on the event list; A list of historical events is obtained based on the third AI model.
5. The method according to claim 3 or 4, characterized in that: The preset processing includes at least one of the following: Processing the target audio data based on the processing parameters; Processing target audio data based on environmental noise information; Processing the enhanced target audio data based on the clarity parameters corresponding to the current scene; Processing parameters are determined based on the playback intent, and target audio data is processed based on the processing parameters.
6. The method according to claim 3 or 4, characterized in that: The predicting of playback intention based on the playback scenario includes at least one of the following: Predicting playback intention based on the playback progress of audio data; Predict playback intent based on the current screen; When the current application is a game application, the playback intention is predicted based on the game progress; Predicting playback intention based on operation data of a preset area in the application interface; Predict playback intention based on the fourth AI model.
7. The method according to claim 3 or 4, characterized in that: Determining target audio data based on the playback intent includes at least one of the following: Adjusting the currently used event list according to the playback intent, and determining the target audio data based on the adjusted event list; Displaying a recommended event list on the current interface according to the playback intention, determining an adjusted event list in response to a selection operation on the recommended event list, and determining target audio data based on the adjusted event list; The target audio data is determined based on the fifth AI model.
8. The method according to claim 3 or 4, characterized in that: Perform event recognition and determine target audio data, including: Input the audio data to be played into the deep learning event detection model for event recognition; The target audio data is determined based on the event labels output by the deep learning event detection model.
9. An intelligent terminal, characterized in that: The method comprises a memory and a processor, wherein a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method according to any one of claims 1 to 8 are implemented.
10. A storage medium, characterized in that: The storage medium stores a computer program, which, when executed by a processor, implements the steps of the processing method according to any one of claims 1 to 8.