Data processing method, intelligent terminal, and storage medium

Abstract

The present application relates to the technical field of communications, and specifically relates to a data processing method, an intelligent terminal, and a storage medium. The method comprises the following steps: outputting preset information of multimedia data on a preset interface; receiving a preset operation on the multimedia data; and processing the multimedia data on the basis of the preset information. By means of the technical solution, the function of a user independently selecting whether to receive multimedia data can be implemented, such that the problem of traffic waste is solved, thereby improving the user experience.

Description

Data processing method, intelligent terminal and storage medium Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a data processing method, an intelligent terminal, and a storage medium. Background Art

[0002] Sending information through multimedia is a very common way of chatting. In the relevant technical solutions of multimedia chatting, when a user receives a multimedia message, he usually receives the multimedia message first and then can see the multimedia data.

[0003] During the process of conceiving and implementing this application, the applicant discovered that there are at least the following problems: regardless of whether the user chooses to play the multimedia data, traffic consumption has already occurred when the multimedia data is received. In areas where traffic is relatively tight (such as Africa), when the user does not want to receive multimedia data, unnecessary traffic loss will be caused, thereby increasing the user's traffic usage load.

[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art.

[0005] Application Contents

[0006] In response to the above technical problems, the present application provides a data processing method, an intelligent terminal and a storage medium, which enable users to reduce traffic loss and make operation simple and convenient.

[0007] To solve the above technical problems, the present application provides a data processing method, comprising:

[0008] S10: Outputting preset information of multimedia data on a preset interface;

[0009] S20: receiving a preset operation for the multimedia data;

[0010] S30: Processing the multimedia data based on the preset information.

[0011] Optionally, the step S20 includes: the multimedia data includes at least one audio data, and the preset information is associated with the audio data.

[0012] Optionally, the step S10 includes: the preset information is at least one of an audio display icon and text information, and the multimedia data is output as an icon or text information.

[0013] Optionally, the preset interface is provided with a multimedia processing identifier, and the multimedia processing identifier is used to download the multimedia segment and / or play the multimedia segment.

[0014] Optionally, step S20 includes:

[0015] upon receiving the processing operation, determining a target multimedia segment to be processed by the processing operation;

[0016] The time information corresponding to the target multimedia segment is determined, and the time information is displayed in the preset interface.

[0017] Optionally, after step S20, the following steps are included:

[0018] S40: Send a multimedia download request for the multimedia segment, where the multimedia download request includes a time interval corresponding to the multimedia data, and determine the multimedia segment according to the time interval.

[0019] Optionally, processing the multimedia segment includes processing the multimedia data, or part of the multimedia data.

[0020] Optionally, processing the multimedia data according to at least one of the following contents includes:

[0021] All contents of the multimedia data;

[0022] Part of the multimedia data;

[0023] The specific content of the multimedia data.

[0024] Optionally, the preset information is forwarded to at least one specific electronic device, and a return text message or return multimedia data from the specific electronic device is received.

[0025] Optionally, the step S30 includes sending a processing request to a server or a third device to process the multimedia data.

[0026] To solve the above technical problems, the present application also provides an intelligent terminal, comprising: a memory and a processor, wherein the memory stores a multimedia processing program, and when the multimedia processing program is executed by the processor, the steps of the above method are implemented.

[0027] In order to solve the above technical problems, the present application also provides a storage medium, which stores a computer program, and when the computer program is executed by a processor, it implements the steps of the above method.

[0028] As described above, the data processing method of the present application, applied to a smart terminal, includes the following steps: S10: outputting preset information about multimedia data on a preset interface; S20: receiving a preset operation for the multimedia data; and S30: processing the multimedia data based on the preset multimedia data. This method solves the problem of data traffic waste and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for describing the embodiments. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without inventive work.

[0030] FIG1 is a schematic diagram of the hardware structure of an intelligent terminal for implementing various embodiments of the present application;

[0031] FIG2 is a diagram of a communication network system architecture provided by an embodiment of the present application;

[0032] FIG3 is a flow chart of a data processing method according to the first embodiment;

[0033] FIG4 is a schematic diagram of a preset interface according to the first embodiment;

[0034] FIG5 is a schematic diagram of a preset multimedia processing operation according to the first embodiment;

[0035] FIG6 is a schematic diagram showing multimedia clip downloading according to the first embodiment;

[0036] FIG7 is a flow chart of a data processing method according to a second embodiment;

[0037] FIG8 is a schematic flow chart of a data processing method according to a third embodiment;

[0038] FIG9 is a schematic diagram of the hardware structure of a controller 140 provided in this application;

[0039] FIG10 is a schematic diagram of the hardware structure of a network node 150 provided in this application.

[0040] The purpose of this application, its features, and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and the accompanying text are not intended to limit the scope of the present application in any way, but rather to illustrate the concepts of this application to those skilled in the art by reference to specific embodiments.

[0041] DETAILED DESCRIPTION

[0042] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0043] It should be noted that, in this document, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0044] It should be understood that although the terms "first," "second," "third," etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are used solely to distinguish information of the same type from one another. For example, without departing from the scope of this disclosure, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the term "if," as used herein, may be interpreted as "upon," "when," or "in response to a determination." Furthermore, as used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising" and "including" indicate the presence of the recited features, steps, operations, elements, components, items, types, and / or groups, but do not preclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, types, and / or groups. The terms "or," "and / or," "including at least one of the following," etc., as used herein, may be interpreted as inclusive, meaning any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”; and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0045] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are shown in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless clearly stated herein, the execution of these steps is not strictly limited in order, and they can be performed in other orders. Moreover, at least a portion of the steps in the figure may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0046] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to the determination" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)," depending on the context.

[0047] It should be noted that in this article, step codes such as S10 and S20 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the order. When implementing the step, those skilled in the art may execute S20 first and then S10, etc., but these should all be within the scope of protection of this application.

[0048] It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application.

[0049] In the subsequent description, the use of suffixes such as "module", "component" or "unit" to represent elements is only for the purpose of facilitating the description of the present application and has no specific meaning. Therefore, "module", "component" or "unit" can be used interchangeably.

[0050] Smart terminals can be implemented in various forms. For example, the smart terminals described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0051] The subsequent description will be made by taking a mobile terminal as an example. It will be understood by those skilled in the art that, in addition to components specifically used for mobile purposes, the configuration according to the embodiments of the present application can also be applied to fixed-type terminals.

[0052] Please refer to Figure 1, which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application. The mobile terminal 100 may include components such as an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (Audio / Video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will appreciate that the mobile terminal structure shown in Figure 1 does not limit the mobile terminal. The mobile terminal may include more or fewer components than shown, or may combine certain components, or arrange the components differently.

[0053] The following is a detailed introduction to the various components of the mobile terminal in conjunction with Figure 1:

[0054] The RF unit 101 can be used to send and receive information or receive signals during calls. Specifically, it receives downlink information from the base station and transmits it to the processor 110 for processing. It also transmits uplink data to the base station. Typically, the RF unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and more. Furthermore, the RF unit 101 can communicate with the network and other devices via wireless communication. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing- Long Term Evolution), TDD-LTE (Time Division Duplexing- Long Term Evolution) and 5G, etc.

[0055] WiFi is a short-range wireless transmission technology. A mobile terminal, through WiFi module 102, enables users to send and receive emails, browse web pages, and access streaming media, providing wireless broadband Internet access. Although FIG1 illustrates WiFi module 102, it is understood that it is not a required component of the mobile terminal and can be omitted as needed without changing the essence of the application.

[0056] The audio output unit 103 can convert audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a multimedia recognition mode, a broadcast reception mode, etc. In addition, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0057] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data, such as still images or videos, captured by an image capture device (e.g., a camera) in video capture mode or image capture mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the GPU 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the RF unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) in various operating modes, such as phone call mode, recording mode, and multimedia recognition mode, and process such sound into audio data. In phone call mode, the processed audio (multimedia) data may be converted into a format that can be transmitted to a mobile communication base station via the RF unit 101. The microphone 1042 may implement various noise cancellation (or suppression) algorithms to eliminate (or suppress) noise or interference generated during the reception and transmission of audio signals.

[0058] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, or other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 based on the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is brought to your ear. An accelerometer, a type of motion sensor, can detect acceleration in all directions (typically three axes) and, when stationary, can detect the magnitude and direction of gravity. This can be used for applications that recognize the phone's posture (e.g., switching between landscape and portrait modes, related games, magnetometer posture calibration), vibration recognition-related functions (e.g., pedometer, tapping), and other functions. Other sensors that may be configured on a mobile phone, such as a fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc., are not described here.

[0059] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0060] The user input unit 107 can be used to receive input digital or character information and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can detect user touch operations on or near it (for example, operations performed on or near the touch panel 1071 using a finger, stylus, or any other suitable object or accessory) and drive corresponding connected devices according to pre-set programs. The touch panel 1071 may include a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch position and detects signals generated by the touch operation, transmitting the signals to the touch controller. The touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 110. The touch controller can also receive and execute commands from the processor 110. Furthermore, the touch panel 1071 can be implemented using various types of sensors, including resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, power keys, etc.), a trackball, a mouse, a joystick, etc., and the specifics are not limited here.

[0061] Optionally, the touch panel 1071 may overlay the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. The processor 110 then provides a corresponding visual output on the display panel 1061 based on the type of touch event. Although in FIG1 , the touch panel 1071 and the display panel 1061 are shown as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, which is not limited to this specific embodiment.

[0062] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0063] Memory 109 can be used to store software programs and various data. Memory 109 may primarily include a program storage area and a data storage area. Optionally, the program storage area may store an operating system and at least one application required for a function (such as sound playback or image playback); the data storage area may store data generated based on the use of the phone (such as audio data and a phone book). Memory 109 may also include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0064] Processor 110 is the control center of the mobile terminal, connecting all components of the mobile terminal using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 109 and accessing data stored in memory 109, it executes various functions of the mobile terminal and processes data, thereby providing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, processor 110 may integrate an application processor and a modem processor. Optionally, the application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 110.

[0065] The mobile terminal 100 may further include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption.

[0066] Although not shown in FIG. 1 , the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0067] To facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.

[0068] Please refer to Figure 2, which is a communication network system architecture diagram provided in an embodiment of the present application. The communication network system is an LTE system of universal mobile communication technology. The LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence.

[0069] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0070] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 . Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface). eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0071] The EPC 203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving Gate Way) 2034, a PGW (PDN Gate Way) 2035, and a PCRF (Policy and Charging Rules Function) 2036. Optionally, the MME 2031 is a control node that processes signaling between the UE 201 and the EPC 203, providing bearer and connection management. The HSS 2032 provides registers for managing functions such as the Home Location Register (not shown) and stores user-specific information such as service features and data rates. All user data can be sent through SGW2034. PGW2035 can provide IP address allocation and other functions for UE 201. PCRF2036 is the policy and charging control policy decision point for service data flows and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0072] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem), or other IP services.

[0073] Although the above introduction takes the LTE system as an example, those skilled in the art should know that this application is not only applicable to the LTE system, but can also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new network systems (such as 5G), etc., which are not limited here.

[0074] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

[0075] First embodiment

[0076] 3 , which shows a first embodiment of the data processing method of the present application, the data processing method includes the following steps:

[0077] S10: Displaying preset information of multimedia data on a preset interface;

[0078] S20: receiving a preset operation for the multimedia data;

[0079] S30: Processing the multimedia data based on the preset information.

[0080] In this embodiment, which is applied to a smart terminal, a preset interface is provided in the smart terminal. The preset interface can receive multimedia data and display preset information of the multimedia data.

[0081] Optionally, the preset interface may be a multimedia interface or a chat window interface.

[0082] Optionally, the preset information may be information such as the font type, font size, and paragraph spacing of the text.

[0083] Optionally, the preset information may also be at least one of an audio display icon and text information, so that the multimedia data is displayed according to the display icon or text information.

[0084] It should be noted that compared with multimedia data, when the amount of information is similar, the traffic consumed by receiving preset information is much smaller than that of multimedia data (for example, the traffic used by multimedia data requires at least tens of MB, but text information only requires a few KB). Therefore, in this embodiment, the preset information of the multimedia data is first displayed on the preset interface. The traffic of the smart terminal will be consumed in the process of receiving the preset information sent by the server, but since the traffic consumption is less than the consumption of receiving multimedia data, it can achieve the effect of saving the traffic consumption of the smart terminal.

[0085] Optionally, a multimedia processing identifier is provided in the preset interface, and the user can interact with the smart terminal through the multimedia processing identifier. In this embodiment, the multimedia processing identifier is used to download the multimedia clip, that is, the user chooses to download / receive multimedia data through the multimedia processing identifier.

[0086] Optionally, referring to FIG4 , which is a schematic diagram of a preset interface in some embodiments, before a user chooses to receive multimedia data, the preset interface displays the playback duration of the multimedia data, sets a multimedia reception indicator next to the multimedia data frame, and displays preset information below the multimedia data frame. The preset information visualizes the content of the multimedia data in the preset interface, allowing the user to understand the general content of the multimedia data and decide whether to accept the multimedia data.

[0087] In this embodiment, after the preset information is displayed on the preset interface, when the smart terminal receives a processing operation for the preset information, the processing operation is generated by the user of the smart terminal clicking a corresponding button on the preset interface to generate a corresponding instruction for the processing operation, and the multimedia clip is a selection of multimedia data within a period of time captured from the original multimedia data.

[0088] Optionally, refer to Figure 5, which is a schematic diagram of the preset multimedia processing operation in the preset interface in some embodiments. The smart terminal is a terminal with a touch screen, and the processing operation for the preset information is: the user clicks on part of the preset information with his finger, and then presses and drags to one side to select the target multimedia segment to be downloaded (as shown in Figure 5, the selected target multimedia segment is "Today's weather is very good"), and when the multimedia segment is selected, the time information corresponding to the multimedia segment will be displayed in the corresponding area of ​​the preset interface (as shown in Figure 5, the time information corresponding to the selected target multimedia segment is 0:01-0:019, that is, the multimedia segment in the time interval of 1s~1.9s in the time axis of the multimedia data is selected).

[0089] Alternatively, in other implementations, a character in the preset information may be processed, and the time interval after the time point corresponding to the character may be used as the user-selected time interval. For example, for example, a sentence may read, "The weather is great today. Do you want to go out and play later?" If the user wants to confirm what the other party wants them to do, they may select the time interval after the time point corresponding to the character "you" in the preset interface as the time interval. In this case, the selected multimedia segment will be "Do you want to go out and play later?"

[0090] Alternatively, in other embodiments, the interval preceding this time point may be used as the user-selected time interval. For example, for example, a sentence might read, "Today, my family cooked a lot of dishes, including braised beef, chicken stewed with mushrooms, etc. Do you want to come to my house for dinner?" If the user wants to hear about the dishes they like before deciding whether to go, the interval preceding the time point corresponding to the character "you" is selected in the preset interface as the time interval, and the selected multimedia segment becomes, "Today, my family cooked a lot of dishes, including braised beef, chicken stewed with mushrooms, etc."

[0091] It should be noted that selecting multimedia data from different time intervals for reception not only reduces data traffic loss but also has some unexpected benefits: Because multimedia data can be translated into text messages with errors, this can be particularly true when the sender inputs multimedia data in a dialect or speaks in a noisy environment. The resulting text message may contain typos, missing content, or incoherent sentences. In these situations, users are often forced to receive the entire multimedia data segment to understand the intended meaning. If a user does not want to receive the entire multimedia segment but still wants to understand the intended meaning, they can select the portion of the text message where the translation error occurred and listen to the multimedia segment, thereby facilitating their understanding of the intended meaning. For example, a text message reads "The weather is very good today. Do you want to go out and be lazy for a while?" "Lazy" is a typo in the multimedia-to-text conversion process. What the other party originally wanted to say is "Do you want to go out and have fun for a while?" It is difficult for users to intuitively understand the meaning of the second half of the other party's sentence by simply reading this converted text message. Therefore, users can select the text message "Do you want to go out and be lazy for a while?" and download the multimedia segment corresponding to this text message from the server. Compared with downloading and playing the entire multimedia data, this can not only save traffic, but also omit unnecessary playback content for users in the multimedia.

[0092] Optionally, after processing the multimedia segment, the smart terminal will also send a multimedia download request for the multimedia segment to the server, wherein the multimedia download request includes the time interval corresponding to the multimedia segment, so that the server determines the corresponding multimedia segment in the multimedia data based on the time interval.

[0093] You can play the content backward or forward from this time point, or you can select only the text corresponding to this time point to play.

[0094] In this embodiment, the multimedia data is processed based on the preset information.

[0095] Alternatively, referring to FIG6 , which is a schematic diagram of downloading multimedia segments in a preset interface in some embodiments, multimedia segments can be downloaded using a multimedia processing identifier. After selecting a multimedia segment in the multimedia data, the user clicks the multimedia processing identifier to download the multimedia segment from the server to the smart terminal and save it to the corresponding storage path.

[0096] It should be noted that if the user directly clicks the multimedia receiving icon to download the multimedia data without processing the multimedia segment, the entire multimedia data will be downloaded from the server, rather than the individual multimedia segments. When downloading multimedia segments, users can also choose to save the corresponding multimedia to their own mobile phone or third-party apps, such as cloud storage, so as to save the corresponding multimedia without using their own data.

[0097] Optionally, in this embodiment, a processing request may be sent to a server or a third device to process the multimedia data, that is, the server or a third device with relatively abundant traffic may process the multimedia data. After the server or the third device has processed the multimedia data, the processed multimedia data segments are sent to the receiving end.

[0098] In the technical solution provided in this embodiment, by displaying the preset information of multimedia data on the preset interface, when the processing operation of the preset information is received, at least one multimedia segment of the multimedia data is processed and downloaded. Since the traffic consumed by receiving text information is less than the traffic consumed by receiving multimedia data, the traffic consumption of the smart terminal can be saved.

[0099] Second embodiment

[0100] 7 , which is a second embodiment of the data processing method of the present application, based on the first embodiment, step S20 includes:

[0101] S21: upon receiving the processing operation, determining a target multimedia segment to be processed by the processing operation;

[0102] S22: Determine time information corresponding to the target multimedia segment, and display the time information in the preset interface.

[0103] Optionally, when a play operation for the multimedia segment is received, the multimedia segment is played on the smart terminal. In this embodiment, the play operation can be generated or determined by the user through interaction with the multimedia processing identifier.

[0104] Optionally, when the user clicks the multimedia processing indicator for the first time, a download operation for the multimedia segment is generated, and the multimedia segment is downloaded from the server. When the user clicks the multimedia processing indicator for the second time, a play operation for the multimedia segment is generated, and the multimedia segment is played through the smart terminal's speaker or connected headphones. If the user clicks the multimedia processing indicator again before the multimedia segment is downloaded, the smart terminal will not play the multimedia segment immediately, but will play the multimedia segment after the multimedia segment is downloaded.

[0105] In the technical solution provided in this embodiment, when a playback operation of a multimedia clip is received, the multimedia clip is played through the speaker of the smart terminal or a connected headset or other device, so that the user can choose whether to receive the multimedia clip and whether to play the multimedia clip at the same time, thereby improving the user experience.

[0106] Third embodiment

[0107] 8 , which is a third embodiment of the data processing method of the present application, based on the first or second embodiment, the data processing method includes the following steps:

[0108] S50: Determine or generate preset information of multimedia data;

[0109] In this embodiment, this embodiment is applied to a server. First, when the server receives multimedia data sent by a multimedia sender, it determines or generates preset information of the multimedia data.

[0110] Optionally, a method for determining or generating preset information for multimedia data can employ a hidden Markov model of a deep neural network. The multimedia data is divided into multiple frames of waveforms. Based on the physiological characteristics of the human ear, each frame of waveform is converted into a multidimensional vector. The multidimensional vectors are arranged into a matrix, also known as an observation sequence. The hidden Markov model is used to find the best matching path for the observation sequence, thereby transforming this matrix into the preset information.

[0111] S60: Sending the preset information to the smart terminal;

[0112] After the step of determining or generating the preset information of the multimedia data, the server sends the preset information to the smart terminal, so that the smart terminal executes step S10 in the first embodiment when receiving the preset information.

[0113] S70: Determine a multimedia segment for the smart terminal based on the preset information, and send the multimedia segment to the smart terminal.

[0114] After sending the preset information to the smart terminal, the server determines a multimedia segment to be processed by the smart terminal based on the preset multimedia, and sends the multimedia segment to the smart terminal.

[0115] Optionally, when the server receives a multimedia download request sent by the smart terminal, the server determines the multimedia segment in the multimedia data selected by the smart terminal according to the time interval in the multimedia download request, and sends the multimedia segment to the smart terminal.

[0116] It should be noted that in this embodiment, the entire process of converting multimedia data into text information is completed on the server. In some traditional technical solutions, the process of converting multimedia data into text information requires the server and the smart terminal to jointly process it. After converting the multimedia data into text information, the server sends the text information that consumes less traffic to the smart terminal. The user can understand the general content of the multimedia data based on the text information of the smart terminal, and can choose whether to receive the multimedia data by the user. If the user chooses to receive the multimedia data, he or she can choose to receive the multimedia segment that he or she wants to receive in the text information, or he or she can choose to receive the entire multimedia data. The multimedia segment can be arbitrarily processed by the user in the text information through processing operations, and the download starting point and / or download end point of the multimedia segment can be selected through processing operations. Compared with traditional technical solutions, the technical solution provided in this embodiment can not only reduce the traffic consumption generated by the interaction between the server and the smart terminal, but also omit the unnecessary playback content for the user in the multimedia.

[0117] In the technical solution provided by this embodiment, the server completes the entire multimedia data-to-text conversion operation, sends the preset information to the smart terminal, and upon receiving a multimedia download request from the smart terminal, determines a multimedia segment based on the preset multimedia processing based on the multimedia download request and sends the multimedia segment to the smart terminal. This allows users to freely choose whether to receive multimedia data and select the multimedia segments they want to receive, thereby reducing data consumption on the smart terminal and enabling users to accurately understand the multimedia content sent by the multimedia sender.

[0118] Fourth embodiment

[0119] Based on any of the above embodiments, the data processing method further includes:

[0120] Processing the multimedia segment includes processing the multimedia data, or a portion of the multimedia data.

[0121] As an optional embodiment, in this embodiment, the entire multimedia data may be processed, or only a portion of relevant content may be selected for processing.

[0122] Optionally, the processing may include at least one of downloading and converting;

[0123] In this embodiment, when processing the entire multimedia data, the processing process of the entire multimedia data may be triggered by the user clicking on the content displayed on the preset information of the multimedia data.

[0124] For example, the multimedia data is voice information, and the preset information is an audio display icon. After the user clicks the audio display icon, the smart terminal downloads the complete information of the multimedia data from the server and can perform voice-to-text processing after the download is complete.

[0125] In this embodiment, during partial processing, you can click on some of the text displayed on the displayed information "preset information" to perform processing.

[0126] For example, the multimedia data is voice information, and the preset information is part of the text displayed in the voice information. After the user clicks on the part of the text, the smart terminal downloads part of the information related to the part of the text in the multimedia data from the server, and performs voice-to-text processing after the download is completed.

[0127] Furthermore, in this embodiment, processing the multimedia data according to at least one of the following contents includes:

[0128] All contents of the multimedia data;

[0129] Part of the multimedia data;

[0130] The specific content of the multimedia data.

[0131] Optionally, in this embodiment, the multimedia data to be processed may be all content, part of content and / or specific content of the multimedia data.

[0132] In this embodiment, the specific content is represented by content analyzed using a GPT model or an AI semantic analysis model. After the intelligent terminal, acting as the multimedia transmitter, sends multimedia data to the server, the server extracts the semantic information from the multimedia data using the GPT model or AI semantic analysis model and sends it as the specific content to the intelligent terminal, acting as the multimedia receiver.

[0133] In the technical solution provided in this embodiment, all content, part of the content and / or specific content in the multimedia data can be selected to allow users to freely choose whether to receive multimedia data and select the multimedia segments they want to receive. This can reduce the traffic consumption of the smart terminal while enabling users to accurately obtain the multimedia content sent by the multimedia sender.

[0134] Fifth embodiment

[0135] Based on any of the above embodiments, the data processing method further includes:

[0136] The preset information is forwarded to at least one specific electronic device, and a return text message or return multimedia data from the specific electronic device is received.

[0137] As an optional embodiment, in this embodiment, the preset information can also be forwarded to at least one specific electronic device. After receiving the preset information, the specific electronic device processes the multimedia data according to the preset information and then returns the text information or multimedia data to the multimedia recipient.

[0138] The meaning of the content in the original multimedia data can be learned based on the preset information, and the traffic consumed by the specific electronic device to receive the preset information is lower than the traffic originally required to receive the multimedia data, thereby further reducing the traffic consumption of the specific electronic device.

[0139] The specific electronic device is characterized as a smart terminal of a specific contact selected by the user, or a specific electronic device selected by the user.

[0140] Optionally, if it is a specific contact, the user can select the target object as the specific contact in the contact interface, and the device will forward the preset information to the specific contact.

[0141] Optionally, if it is a specific electronic device, the user can forward the preset information to a specific contact through Bluetooth or other information that does not require consuming traffic.

[0142] In the technical solution provided in this embodiment, the preset information is forwarded to another specific electronic device, which processes the multimedia data according to the preset information and then transmits it back to the preset information forwarder, thereby reducing the traffic consumption of the preset information forwarder.

[0143] The present application also provides an intelligent terminal, which includes a memory and a processor. The memory stores a multimedia processing program, and when the multimedia processing program is executed by the processor, the steps of the data processing method in any of the above embodiments are implemented.

[0144] The present application also provides a computer-readable storage medium, on which a multimedia processing program is stored. When the multimedia processing program is executed by a processor, the steps of the data processing method in any of the above embodiments are implemented.

[0145] In the embodiments of the smart terminal and computer-readable storage medium provided in this application, all technical features of any of the above-mentioned data processing method embodiments may be included. The expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods and will not be repeated here.

[0146] An embodiment of the present application further provides a computer program product, which includes computer program code. When the computer program code runs on a computer, the computer executes the methods in the various possible implementation modes described above.

[0147] An embodiment of the present application also provides a chip, including a memory and a processor, wherein the memory is used to store computer programs, and the processor is used to call and run the computer programs from the memory, so that a device equipped with the chip executes the methods in the various possible implementation modes as described above.

[0148] The embodiment of the present application also provides a computer module for executing the methods in the various possible implementation modes described above.

[0149] A computer module generally includes a processor and a memory. The memory is used to store instructions. When the instructions are executed by the processor, the computer module executes the steps or program modules of the present application.

[0150] FIG9 is a schematic diagram of the hardware structure of a controller 140 provided in this application. The controller 140 includes a memory 1401 and a processor 1402. The memory 1401 is used to store program instructions, and the processor 1402 is used to call the program instructions in the memory 1401 to execute the steps performed by the controller in the above method embodiment. The implementation principles and beneficial effects are similar and will not be repeated here.

[0151] Optionally, the controller further includes a communication interface 1403, which can be connected to the processor 1402 via a bus 1404. The processor 1402 can control the communication interface 1403 to implement the receiving and sending functions of the controller 140.

[0152] Figure 10 is a schematic diagram of the hardware structure of a network node 150 provided in this application. The network node 150 includes a memory 1501 and a processor 1502. The memory 1501 is used to store program instructions, and the processor 1502 is used to call the program instructions in the memory 1501 to execute the steps performed by the first node in the above method embodiment. The implementation principles and beneficial effects are similar and will not be repeated here.

[0153] Optionally, the network node further includes a communication interface 1503, which can be connected to the processor 1502 via a bus 1504. The processor 1502 can control the communication interface 1503 to implement the receiving and sending functions of the network node 150.

[0154] It is understood that the above scenarios are merely examples and do not limit the application scenarios of the technical solutions provided in the embodiments of this application. The technical solutions of this application can also be applied to other scenarios. For example, those skilled in the art will appreciate that with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application will also be applicable to similar technical problems.

[0155] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0156] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0157] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0158] In this application, the same or similar terminology, technical solutions and / or application scenario descriptions are generally only described in detail the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of this application, for the same or similar terminology, technical solutions and / or application scenario descriptions that are not described in detail later, you can refer to the previous relevant detailed descriptions.

[0159] In this application, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0160] The various technical features of the technical solution of this application can be combined arbitrarily. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0161] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as mentioned above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the method of each embodiment of the present application.

[0162] In the above embodiments, all or part of the embodiments can be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions according to the embodiments of the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer, or a data storage device such as a server or data center that integrates one or more available media. Available media can include magnetic media (e.g., floppy disks, storage disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks (SSDs)).

[0163] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A data processing method, characterized in that: The method comprises the following steps: S10: Outputting preset information of multimedia data on a preset interface; S20: receiving a preset operation for the multimedia data; S30: Processing the multimedia data based on the preset information.

2. The method according to claim 1, characterized in that The step S20 includes: the multimedia data includes at least one audio data, and the preset information is associated with the audio data.

3. The method according to claim 1, characterized in that The step S10 includes: the preset information is at least one of an audio display icon and text information, and the multimedia data is output as an icon or text information.

4. The method according to claim 3, characterized in that The preset interface is provided with a multimedia processing identifier, and the multimedia processing identifier is used to download the multimedia segment and / or play the multimedia segment.

5. The method according to claim 1, characterized in that The step S20 comprises: upon receiving the processing operation, determining a target multimedia segment to be processed by the processing operation; The time information corresponding to the target multimedia segment is determined, and the time information is displayed in the preset interface.

6. The method according to claim 1, characterized in that After step S20, the following steps are included: S40: Send a multimedia download request for the multimedia segment, where the multimedia download request includes a time interval corresponding to the multimedia data, and determine the multimedia segment according to the time interval.

7. The method according to claim 1, characterized in that Processing the multimedia segment includes processing the multimedia data, or a portion of the multimedia data.

8. The method according to claim 7, characterized in that Processing the multimedia data according to at least one of the following contents includes: All contents of the multimedia data; Part of the multimedia data; The specific content of the multimedia data.

9. The method according to claim 1, characterized in that The preset information is forwarded to at least one specific electronic device, and a returned text message or returned multimedia data from the specific electronic device is received.

10. The method according to claim 1, characterized in that The step S30 includes sending a processing request to a server or a third device to process the multimedia data.

11. An intelligent terminal, characterized in that: The intelligent terminal comprises: a memory and a processor, wherein the memory stores a multimedia processing program, and when the multimedia processing program is executed by the processor, the steps of the data processing method according to any one of claims 1 to 10 are implemented.

12. A storage medium, characterized in that: The storage medium stores a computer program, which, when executed by a processor, implements the steps of the data processing method according to any one of claims 1 to 10.

Images