Processing method, intelligent terminal and storage medium

Abstract

The invention provides a processing method, an intelligent terminal and a storage medium, the processing method can be used for first equipment, and the processing method comprises the following steps: S10, generating or determining second information based on first content and first information; according to the technical scheme, the accuracy and / or efficiency of information processing can be improved, and the use experience of a user is improved.

Description

Technical Field

[0001] The present application relates to the field of terminal application technology, and in particular to a processing method, an intelligent terminal and a storage medium. Background Art

[0002] In the context of globalization, the information processing function of smart terminals plays an important role in the transmission of information between different languages ​​and cultures.

[0003] In the process of conceiving and implementing this application, the inventors discovered that there are at least the following problems: the current information processing function has low accuracy and / or low efficiency in some usage scenarios (such as instant translation scenarios), which can easily lead to a poor user experience.

[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention

[0005] In response to the above technical problems, the present application provides a processing method, an intelligent terminal and a storage medium, aiming to improve the accuracy and / or efficiency of information processing and improve the user experience.

[0006] The present application provides a processing method, which can be applied to a first device, comprising the steps of: S10: Generate or determine second information based on the first content and the first information.

[0007] Optionally, the method further comprises at least one of the following: The first content includes at least one of pre-translated content, a preset data set, and a first preset model; The first information corresponds to the source language; The first information includes at least one of voice, text, image and gesture; The second information corresponds to the target language; The second information is output by the first device and / or the second device; The output mode of the second information includes at least one of audio broadcast, text display, image display and video display.

[0008] Optionally, the method for obtaining or determining the first content includes at least one of the following: In response to receiving the translation-related content, selecting or determining pre-translation content corresponding to the translation-related content; Acquire historical voice information, and construct a preset data set and / or a first preset model according to the historical voice information.

[0009] Optionally, the method further comprises at least one of the following: The translation-related content includes at least one of the document content, the subject name, and the keyword information; Pre-translated content includes specialized terminology and / or context-specific terms; The preset data set includes pronunciation habit information corresponding to at least one language; Pre-translated content is provided through the first language model; The second information is generated or determined by the second language model and / or the first preset model; The first content is output to the second device, so that the second device generates or determines second information corresponding to the first information based on the first content.

[0010] Optionally, step S10 includes: A first process is performed on the first information according to the first content to obtain second information.

[0011] Optionally, the method further comprises at least one of the following: In response to receiving the preset instruction, selecting or determining a target language, and generating or determining second information in the target language; In response to receiving the first translation request from the second device, selecting or determining a target language, and generating or determining second information in the target language; outputting second information; outputting the second information to the second device so that the second device outputs the second information; In response to receiving a second translation request from the second device, sending the first content to the second device according to the second translation request, so that the second device generates or determines second information corresponding to the first information based on the first content; The first processing includes at least one of translation, supplementation, summarization, deletion, replacement and word order adjustment.

[0012] The present application also provides a processing method, which can be applied to a second device, comprising the steps of: S20: Output second information, where the second information is generated or determined based on the first content and the first information.

[0013] Optionally, the method further comprises at least one of the following: At least one of the first information, the second information, and the first content is provided by the first device; The first content includes at least one of pre-translated content, a preset data set, and a first preset model; The first information corresponds to the source language; The first information includes at least one of voice, text, image and gesture; The second information corresponds to the target language; The output mode of the second information includes at least one of audio broadcast, text display, image display and video display.

[0014] The present application also provides an intelligent terminal, comprising: a memory and a processor, wherein a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the above method are implemented.

[0015] The present application also provides a storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0016] As described above, the processing method of the present application can be applied to a first device, including the step: S10: generating or determining second information based on the first content and the first information. The present application also provides a processing method, which can be applied to a second device (such as a mobile phone), including the step: S20: outputting second information, wherein the second information is generated or determined based on the first content and the first information. The processing method provided in the present application can improve the accuracy and efficiency of information processing and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0018] Figure 1 A schematic diagram of the hardware structure of a smart terminal for implementing each embodiment of the present application; Figure 2 A communication network system architecture diagram provided for an embodiment of the present application; Figure 3 is a flowchart of a processing method according to the first embodiment; Figure 4 is a flowchart of a processing method according to the second embodiment; Figure 5 is a flowchart of a processing method according to a third embodiment; Figure 6 is a flowchart of a processing method according to a fourth embodiment; Figure 7 is a schematic diagram of an interaction sequence according to a fourth embodiment; Figure 8 is a schematic diagram of an interface according to a fourth embodiment; Fig. 9 A schematic diagram of the structure of the processing device provided in the embodiment of the present application Figure 1 ; Fig.10A schematic diagram of the structure of the processing device provided in the embodiment of the present application Figure 2 .

[0019] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0020] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0021] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0022] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0023] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0024] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0025] It should be noted that in this article, step codes such as S10 and S20 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step, those skilled in the art may execute S20 first and then S10, etc., but these should all be within the scope of protection of this application.

[0026] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0027] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0028] The smart terminal may be implemented in various forms. For example, the smart terminal described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0029] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.

[0030] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0031] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal: The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing- Long Term Evolution), TDD-LTE (Time Division Duplexing- Long Term Evolution) and 5G, etc.

[0032] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.

[0033] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0034] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0035] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can also be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0036] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0037] The user input unit 107 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch panel 1071), and drive corresponding connection devices according to a pre-set program. The touch panel 1071 may include a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0038] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.

[0039] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0040] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0041] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0042] The mobile terminal 100 may further include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0043] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0044] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.

[0045] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.

[0046] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0047] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0048] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving GateWay) 2034, PGW (PDN Gate Way) 2035, and PCRF (Policy and Charging Rules Function) 2036. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as a home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034. PGW2035 can provide IP address allocation and other functions for UE 201. PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0049] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.

[0050] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.

[0051] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

[0052] First embodiment Reference Figure 3 , Figure 3 is a flowchart of a processing method according to a first embodiment. The processing method of the embodiment of the present application can be applied to a first device (such as a mobile phone), and includes the following steps: S10: Generate or determine second information based on the first content and the first information.

[0053] Optionally, the processing method in the embodiment of the present application is considered from different perspectives and is applicable to a variety of application scenarios. In this embodiment, the number of execution devices, information type and processing method are used as examples for explanation.

[0054] (1) From the perspective of the number of execution devices, the application scenario includes at least one of the following: Scenario A: The first device obtains the first information, generates or determines the second information based on the first content and the first information, and outputs the second information; Scenario B: The first device obtains the first information, generates or determines the second information based on the first content and the first information, and sends the second information to the second device so that the second device outputs the second information.

[0055] Optionally, in scenario A, the first user and the second user communicate using the first device. For example, the first device displays the information collected from different users in a split-screen manner and is used as a translator, which is suitable for face-to-face communication scenarios.

[0056] Optionally, in scenario B, a first user uses a first device to communicate with a second user holding a second device, which can be applicable to an instant translation scenario of face-to-face communication or a remote call scenario.

[0057] Optionally, the method for acquiring the first information includes collecting the first information through a sensor, and / or receiving the first information sent by an associated device. Optionally, the associated device includes a second device or other devices.

[0058] (2) From the perspective of information type, the application scenario includes at least one of the following: Scenario C: the first information is voice, and the first device collects the voice of the first user through a sensor such as a microphone, and / or receives the voice sent by the associated device to determine the first information; Scenario D: The first information is at least one of text, image, and gesture. When it is inconvenient for the first user to utter voice, text can be input into the first device, and / or an image can be taken or selected by the first device, and / or gesture information of the user can be collected by the first device to determine the first information.

[0059] Optionally, in scenario C, the first information needs to perform a first processing through the first device to generate or determine the second information to conform to the language habits of the first user and / or the second user. The first processing includes at least one of translation, supplementation, generalization, deletion, replacement and word order adjustment. The second information can be voice, or at least one of text, image or video.

[0060] Optionally, in scenario D, the first user can only input text content such as keywords that he wants to express, and the first device performs semantic understanding and / or content supplement based on the text input or selected by the user to form a complete sentence, and / or converts the complete sentence into speech and outputs it to the second user as second information. This can be done back and forth to assist the first user in communicating with the second user.

[0061] Optionally, in scenario D, the first user can also take a photo or select an image, and the first device can understand the user's intention through image recognition, such as recognizing information such as text and objects contained in the image taken by the user, or understanding the meaning represented by images such as emoticons selected by the user, and then generating a complete sentence, and / or converting the complete sentence into speech and outputting it to the second user as second information, and so on. This can assist the first user in communicating with the second user.

[0062] Optionally, in scenario D, the first device can also use sensors to identify information such as the first user's facial expressions, lip shapes, movements, and gestures. For example, when the first user is a person with a language barrier and needs to communicate with the second user through the first device, the first device can identify and process the first information such as the first user's facial expressions, lip shapes, movements, and gestures collected, and then generate or determine the second information to output to the second user. This process can assist the first user and the second user in communicating. Similarly, when the second user is a person with a language barrier, the second information can also be output in the form of at least one of audio broadcast, text display, image display, and video display through the first device and / or the second device. Optionally, the video display includes a synthesized sign language video, etc.

[0063] (3) From the perspective of processing methods, the application scenarios include at least one of the following: Scenario E: The first device translates the first information to obtain the second information, and outputs the second information to the second user through the first device and / or the second device, so that the second information conforms to the expression habits of the first user and / or the language habits of the second user; Scenario F: The first device performs at least one of supplementation, generalization, deletion, replacement, and word order adjustment on the first information to obtain second information, and outputs the second information to the second user through the first device and / or the second device, so that the second information conforms to the expression habits of the first user and / or the language habits of the second user.

[0064] Optionally, in scenario E, if the first information contains professional terms and / or specific context terms, and / or the first user has a heavy accent, it may increase the difficulty of translation, reduce the accuracy of the translation result, and / or extend the translation time. In an embodiment of the present application, the first content is provided to assist in translation to reduce the difficulty of translation and / or improve the accuracy of the translation result and / or translation efficiency. Optionally, the first content includes at least one of pre-translated content, a preset data set, and a first preset model.

[0065] Optionally, in scenario F, if there is missing information in the first information, the first information can be supplemented, for example, the missing content in the first information can be supplemented in combination with the context content to obtain the second information; if there is redundant information in the first information, the first information can be summarized and / or deleted, for example, the information can be summarized according to the degree of conciseness required by the user, and / or the repeated content in the first information can be deleted to obtain the second information, thereby optimizing the first information so that the obtained second information conforms to the language habits of the second user; the translated first information can also be processed by vocabulary replacement, word order adjustment, and timbre simulation to obtain the second information, so that the second information fits the expression habits of the first user.

[0066] Optionally, the application scenarios of the processing method in the embodiment of the present application include but are not limited to the above scenarios, and the scenarios can be implemented in any combination. For example, the combination implementation of scenario B, scenario C, and scenario E is: the first device obtains the first information, the first information is a voice in the source language, the first information is translated and processed according to the first content, and the second information in the target language is obtained, and the second information is sent to the second device, so that the second device outputs the second information. Such combination methods are not described one by one in the embodiment of the present application.

[0067] Through the technical solution of this embodiment, specifically by generating or determining the second information based on the first content and the first information, the accuracy and / or efficiency of information processing can be improved, and the user experience can be improved.

[0068] Second embodiment Based on the above Figure 3 The first embodiment shown in FIG. 1 is a second embodiment of the present application. This embodiment proposes a processing method. Figure 4 , Figure 4 is a flow chart of a processing method according to the second embodiment. The method includes a method for obtaining or determining the first content, specifically including: Step S01: In response to receiving translation-related content, selecting or determining pre-translation content corresponding to the translation-related content; Optionally, when the language used in the first information is different from the target language, that is, the source language (e.g., Chinese) used in the first information and the required target language (e.g., English) are different languages, the first information needs to be translated by the first device and / or the second device to obtain the second information in the target language.

[0069] Optionally, when the first information contains professional terms and / or specific context terms (such as slang, idioms, and two-part allegorical sayings), if the first device directly uses a local model for instant translation, the translation result may be less accurate and / or take longer to translate due to greater translation difficulty and / or insufficient computing power, affecting the effect of instant translation; if the first information is directly translated instantly with the help of an associated device (such as a server), there is a risk of privacy leakage. The embodiment of the present application proposes a solution for assisting translation through pre-translated content.

[0070] Optionally, the translation-related content includes at least one of document content, subject name, and keyword information.

[0071] Optionally, the pre-translated content includes specialized terminology and / or context-specific terms.

[0072] Optionally, the pre-translated content is provided via a first language model.

[0073] Optionally, before starting a conversation and / or during the conversation, the user can provide translation-related content related to the conversation, such as relevant documents, subject names, keywords and other information. The first device and / or associated devices can directly translate the professional terms and / or specific context terms involved in the translation-related content to obtain pre-translated content; and / or, the first device and / or associated devices can determine the relevant fields based on the translation-related content, and / or call the relevant database to select or determine relevant background knowledge information as pre-translation content, thereby reducing the translation delay in the subsequent instant translation process, and / or, the computing power of the associated device can be used to provide auxiliary support for the subsequent execution of instant translation by the local model.

[0074] Optionally, when an associated device (e.g., a server) is used for pre-translation, the pre-translation can be performed with the help of a large language model (e.g., a first language model) deployed in the associated device, to provide auxiliary support for the subsequent instant translation performed by the first device. Optionally, if the translation-related content still has strong privacy, the translation-related content can be encrypted before being sent to the associated device, for example, perturbation processing and / or differential privacy processing is performed, and the content returned by the associated device is decrypted accordingly to obtain the pre-translated content, thereby further protecting the data privacy during the pre-translation process.

[0075] Step S02: Acquire historical voice information, and construct a preset data set and / or a first preset model according to the historical voice information.

[0076] Optionally, when the first user has a heavy accent or pronunciation problem, if the first information corresponding to the first user is instantly translated by the first device and / or directly, the translation result may be less accurate and / or take longer to translate due to the difficulty of translation, thus affecting the effect of instant translation. In the embodiment of the present application, a solution for assisting translation by using a preset data set and / or a first preset model is proposed.

[0077] Optionally, the preset data set includes pronunciation habit information corresponding to at least one language.

[0078] Optionally, the first device may collect historical voice data with the user's permission, and the historical voice data may come from the user's voice assistant, call recordings, and voice messages. Optionally, by collecting voice data under different environmental noises, different emotional states, different speaking speeds, different conversation goals, and different conversation topics, the diversity and / or robustness of the data set may be increased.

[0079] Optionally, data preprocessing and / or feature extraction may be performed on the collected historical speech data.

[0080] Optionally, the data preprocessing process includes at least one of the following: De-noising the speech data, using filters and / or noise reduction algorithms to reduce background noise; Perform speech segmentation to segment the continuous speech stream into segments of single words or syllables, and cut the continuous speech signal into shorter frames, for example, 25 milliseconds per frame, with 10 milliseconds overlap between frames to reduce information loss; Normalize the speech signal to ensure that the speech segments have a uniform volume level; The high-frequency signal is enhanced by pre-emphasis through a first-order high-pass filter to compensate for the attenuation of the high-frequency signal during the recording process.

[0081] Optionally, the feature extraction method includes at least one of the following: Through Short-Time Fourier Transform (STFT), the signal is converted from the time domain to the frequency domain to analyze the spectral characteristics of the signal; Calculate the logarithmic energy spectrum of the amplitude spectrum, convert the linear frequency into nonlinear Mel frequency through the Mel filter bank, simulate the auditory perception mechanism of the human ear, perform discrete cosine transform (DCT) on the output of the filter bank, and obtain Mel Frequency Cepstral Coefficients (MFCCs); Describe the vocal tract response of the speech signal through linear prediction and extract the linear prediction coefficient; Analyze the frequency and duration of audio signals to extract pitch and rhythm information.

[0082] Optionally, the extracted features are organized into a preset data set, where each sample corresponds to a pronunciation of the user. The data set may also contain rich annotation information, such as pronunciation accuracy, speaking speed, emotion, etc. The data set may be divided into a training set, a validation set, and a test set to facilitate the use of the preset data set for model training and / or evaluation.

[0083] Optionally, based on the constructed preset data set, a first preset model can be further trained. A traditional machine learning model, such as a random forest, a support vector machine, or a deep learning model, such as a recurrent neural network (RNN) and / or a convolutional neural network (CNN) can be used.

[0084] Optionally, the first information of the first user may be directly and quickly identified and / or processed through a preset data set and / or a first preset model predetermined by the first device to generate or determine the second information.

[0085] Optionally, when the received first information is identified and / or processed by the second device, for the second device, if the identification and / or processing is temporarily performed based on the first information during a call, the generated second information is difficult to simulate the timbre that matches the first user who generated the first information, that is, it is difficult to simulate the pronunciation habits of the first user, and sound recognition also has a certain degree of difficulty. Therefore, in an embodiment of the present application, a preset data set and / or a first preset model predetermined by the first device is provided to the second device, so that the second device can generate or determine the second information corresponding to the first information based on the preset data set and / or the first preset model.

[0086] Optionally, when the first device sends the preset data set and / or the first preset model to the second device, the data privacy of the first user needs to be ensured. The data can be processed by methods such as data desensitization before sending. The emotional privacy protection framework mechanism Privacy++ proposed based on the cyclic adversarial generative neural network can also be used to protect the privacy information contained in the user's voice. Optionally, the pronunciation habits of the user may change over time and other factors, so the preset data set and / or the first preset model may be updated according to user settings and / or periodically.

[0087] Through the technical solution of this embodiment, specifically by responding to receiving translation-related content, selecting or determining pre-translation content corresponding to the translation-related content; and / or, obtaining historical voice information, building a preset data set and / or a first preset model based on the historical voice information, it is possible to determine at least one of the pre-translation content, the preset data set and the first preset model, which is used to provide auxiliary support for the instant translation process, which can reduce the difficulty of instant translation, and / or improve the accuracy of the translation results, and / or reduce the delay of the translation process.

[0088] Third embodiment Based on any of the above embodiments, a third embodiment of the present application is proposed. This embodiment proposes a processing method. Figure 5 , Figure 5 FIG. 1 is a flow chart of a processing method according to the third embodiment. Step S10 of the method includes: S101: Perform a first process on first information according to first content to obtain second information.

[0089] Optionally, the first processing includes at least one of translation, supplementation, summarization, deletion, replacement and word order adjustment.

[0090] Optionally, the triggering method for performing translation processing on the first information includes: In response to receiving the preset instruction, selecting or determining a target language, and generating or determining second information in the target language; and / or, In response to receiving the first translation request from the second device, a target language is selected or determined, and second information in the target language is generated or determined.

[0091] Optionally, the first device may trigger an instant translation function according to a preset instruction.

[0092] Optionally, the preset instruction can be initiated by user operation or automatically by the first device. For example, when it is recognized that the current call object (second user) is in the preset list, and / or the remark information of the current call object (second user) contains the target language, the translation instruction can be triggered to translate the first information according to the selected or determined target language to obtain the second information in the target language.

[0093] Optionally, the first device may trigger an instant translation function according to the first translation request of the second device.

[0094] Optionally, when a second user holding a second device starts a call with a first user holding a first device, if the second device recognizes that the source language used by the first user does not match the target language of the second user, the second device can send a first translation request to the first device, and the first translation request includes at least one of the target language, information type, and output method. After the first device receives the first translation request, it can call the first content related to the target language to perform instant translation of the first information. Optionally, the first content includes at least one of pre-translated content, a preset data set, and a first preset model.

[0095] Optionally, in the process of generating or determining the second information according to the first information by the first device, if the first information is voice, the voice signal can be first converted into text data through voice recognition technology, for example, through deep learning models such as Recurrent Neural Network (RNN) and / or Convolutional Neural Network (CNN), combined with attention mechanism to obtain the converted text data. Optionally, the converted text data is input into a natural language processing (NLP) module. This module can perform tasks such as language detection, word segmentation, part-of-speech tagging, named entity recognition, etc., providing a basis for subsequent translation and / or other text processing. The translation model based on neural network can translate the source language text into the target language text. The translation model can be pre-trained with a large-scale bilingual corpus, so as to generate fluent and accurate translation results.

[0096] Optionally, for text that needs to be supplemented or summarized, a text generation model, such as a Transformer-based model, can be used to generate additional information or summarize key points. The text generation model can generate coherent and relevant text content based on the context. Optionally, the text generation model used to supplement or summarize the first information is the first preset model in the first content.

[0097] Optionally, for text that needs to be deleted or replaced, a rule-based method or a machine learning model can be used to identify and modify specific parts of the text. For example, a text processing model can be trained to identify and replace sensitive information and / or inappropriate content. Optionally, the text processing model used to delete or replace the first information is a first preset model in the first content.

[0098] Optionally, in order to adapt to the grammatical structure of the target language and / or to the language habits required by the user, the translated text may need to be adjusted in word order, which can be achieved through dependency parsing and syntactic analysis to ensure that the text is grammatically and semantically correct. Optionally, the word order adjustment process can be performed based on a preset data set in the first content, or the first preset model in the first content can be used as a word order adjustment model to further optimize and adjust the translated text.

[0099] Optionally, if the information type of the second information required by the second user is voice, the processed text can be converted back into a voice signal, and the text information can be output as voice using a speech synthesis technology (Text-to-Speech, TTS). This can be achieved by using a vocoder and a speech synthesis model to generate natural and fluent voice output.

[0100] Optionally, the first device can also use an end-to-end speech model to directly convert the speech of the first information into the speech output of the second information, and use a unified model structure to directly map the original speech signal to the target output. In the generation stage, the decoder is responsible for converting the probability distribution of the model output into understandable text or speech signals, eliminating intermediate steps such as feature extraction, achieving real-time conversion, and further reducing the delay of instant translation, and / or, it can be combined with a language model to improve the fluency and accuracy of the generated results, and / or, use anti-noise technology and multimodal input (for example, combined with visual information) to improve recognition accuracy.

[0101] Through the technical solution of this embodiment, specifically by performing a first processing on the first information according to the first content, the second information is obtained, and at least one of the processing of translation, supplementation, generalization, deletion, replacement and word order adjustment is performed to ensure that the generated second information conforms to the expression habits of the first user and / or conforms to the language habits of the second user, thereby improving the user experience.

[0102] Fourth embodiment Reference Figure 6 , Figure 6 is a flowchart of a processing method according to a fourth embodiment. The processing method of the embodiment of the present application can be applied to a second device (such as a mobile phone), and includes the following steps: S20: Output second information, where the second information is generated or determined based on the first content and the first information.

[0103] Optionally, at least one of the first information, the second information and the first content is provided by the first device.

[0104] Optionally, the first content includes at least one of pre-translated content, a preset data set, and a first preset model.

[0105] Optionally, the first information corresponds to a source language.

[0106] Optionally, the first information includes at least one of voice, text, image and gesture.

[0107] Optionally, the second information corresponds to a target language.

[0108] Optionally, the output mode of the second information includes at least one of audio broadcast, text display, image display and video display.

[0109] Optionally, in a scenario where a first user uses a first device to communicate with a second user holding a second device, the first device may send the generated or determined second information to the second device so that the second device outputs the second information. Optionally, if the second device recognizes that the source language used by the first user does not match the target language of the second user, the second device may send a first translation request to the first device, the first translation request including at least one of the target language, information type, and output method. After the first device receives the first translation request, it may call the first content related to the target language to perform instant translation of the first information. Optionally, the first content includes at least one of pre-translated content, a preset data set, and a first preset model.

[0110] Optionally, in the embodiment of the present application, the process of generating or determining the second information based on the first content and the first information may also be performed by an associated device (eg, a network device).

[0111] Reference Figure 7 , Figure 7 is a schematic diagram of interaction timing according to the fourth embodiment, such as Figure 7As shown, in a scenario where a first user uses a first device to communicate with a second user holding a second device, the first device and / or the second device are associated with a network device. Optionally, if the second device recognizes that the source language used by the first user does not match the target language of the second user, the second device can send a first processing request to the network device. The first processing request includes at least one of the target language, information type, and output method. After the network device receives the first processing request, it can send relevant request information to the first device, such as a first translation request. In response to receiving the request information sent by the network device, the first device sends the first content and / or the first information to the network device, so that the network device generates or determines the second information based on the first content and the first information. Optionally, the first content includes at least one of the pre-translated content, the preset data set, and the first preset model. Optionally, the network device sends the generated or determined second information to the second device so that the second device outputs the second information.

[0112] Optionally, the second device selects or determines the target language in a manner including at least one of the following: Select or determine the target language according to system settings; selecting or determining a target language according to the third information; The target language is selected or determined according to the user operation.

[0113] Optionally, the third information includes voice information currently sent by the second user.

[0114] Optionally, the second device may perform a first process on the received first information according to the needs of the second user to obtain the second information. Optionally, the first process includes at least one of translation, supplementation, summarization, deletion, replacement, and word order adjustment.

[0115] Optionally, in a scenario where a first user uses a first device to communicate with a second user holding a second device, the second device may also generate or determine second information based on the first information and output it. Optionally, if the second device recognizes that the source language used by the first user does not match the target language of the second user, a second translation request may be sent to the first device. In response to receiving the second translation request from the second device, the first device sends the first content to the second device according to the second translation request, so that the second device generates or determines the second information corresponding to the first information based on the first content. Optionally, the first content includes at least one of pre-translated content, a preset data set, and a first preset model. Optionally, the second device outputs the second information, and optionally, the second information is output in the form of at least one of audio broadcast, text display, image display, and video display.

[0116] Optionally, for the second device, if it is necessary to learn information such as the pronunciation habits of the other user separately during calls with different devices and / or users, the real-time performance of information processing will be poor and / or the learning cost will be high. If at least one of the pre-translated content, preset data set and the first preset model provided by the other user can be obtained, the speed of information processing can be increased and / or the learning cost in the information processing process can be reduced and / or the effect of information processing can be improved.

[0117] Optionally, in a scenario where the first user and the second user communicate using the first device, the first device may directly output the generated or determined second information, and the second information may be output in at least one form of audio broadcast, text display, image display, and video display, and optionally, the video display includes a synthesized sign language video, etc. Optionally, the first device may also send the second information to the second device so that the second device outputs the second information.

[0118] Optionally, the processing method further includes: generating or determining target content based on at least one of the first information, the second information, and the third information; generating or determining fourth information according to the target content; The second process is performed on the fourth information.

[0119] Optionally, the step of generating or determining the fourth information according to the target content includes: Calling a target application and / or a target file according to the target content; The fourth information is generated or determined based on the target application and / or the target file.

[0120] Optionally, performing a second process on the fourth information includes at least one of the following: displaying fourth information on the first device; displaying fourth information on the second device; A call summary and / or a to-do list is generated based on the fourth information.

[0121] Reference Figure 8 , Figure 8 is a schematic diagram of an interface according to a fourth embodiment, as shown in Figure 8As shown, the first device and / or the second device can identify the target content in the first information and / or the second information in real time during the call, and then call the relevant target application and / or target file accordingly. For example, the third information sent by the second user contains keywords such as "tomorrow's meeting time". There is no need for the first user to exit the call interface to manually search for relevant information. The first device can automatically call the meeting appointment information of the conference software and display it on the interface of the first device, and / or, after confirmation by the first user, send the meeting appointment information to the second device so that the meeting appointment information is displayed on the interface of the second device. This can provide the user with the target information needed in a timely manner, assist the user to perform related operations, improve the efficiency of the voice call, and / or improve the intelligence of the call process to improve the user's experience.

[0122] Optionally, the first device and / or the second device may generate a call summary and / or a to-do list based on the target information involved in the call. Optionally, the call summary and / or the to-do list may be synchronized between multiple devices of the user, such as at least one of a smartphone, a tablet, a smartwatch, and a computer, so that the user can view and update them anytime and anywhere. The call summary can help the user quickly review and organize key information in the call to avoid missing important content. Especially when the call content is extensive or involves multiple matters, the summary can provide a clear and concise overview of the information; by automatically generating a to-do list, the user can be assisted in quickly converting the action points in the call into specific tasks, which is convenient for subsequent execution and tracking, and helps to ensure that the tasks are completed on time to enhance the user experience.

[0123] Through the technical solution of this embodiment, specifically by outputting the second information, which is generated or determined based on the first content and the first information, the accuracy and / or efficiency of information processing can be improved, and / or, by combining with the fourth information, the efficiency of voice calls can be improved, and / or, the intelligence of the call process can be improved to improve the user experience.

[0124] Fifth embodiment See also Fig. 9 , Fig. 9 A schematic diagram of the structure of the processing device provided in the embodiment of the present application Figure 1 , the device can be mounted on or is the first device in the above method embodiment. Fig. 9 The processing device shown can be used to perform part or all of the functions in the method embodiment described in the above embodiment. Fig. 9 As shown, the processing device 1100 includes: The processing module 1101 is used to generate or determine second information based on the first content and the first information.

[0125] Optionally, the device further comprises at least one of the following: The first content includes at least one of pre-translated content, a preset data set, and a first preset model; The first information corresponds to the source language; The first information includes at least one of voice, text, image and gesture; The second information corresponds to the target language; The second information is output by the first device and / or the second device; The output mode of the second information includes at least one of audio broadcast, text display, image display and video display.

[0126] Optionally, the method for obtaining or determining the first content includes at least one of the following: In response to receiving the translation-related content, selecting or determining pre-translation content corresponding to the translation-related content; Acquire historical voice information, and construct a preset data set and / or a first preset model according to the historical voice information.

[0127] Optionally, the device further comprises at least one of the following: The translation-related content includes at least one of the document content, the subject name, and the keyword information; Pre-translated content includes specialized terminology and / or context-specific terms; The preset data set includes pronunciation habit information corresponding to at least one language; Pre-translated content is provided through the first language model; The second information is generated or determined by the second language model and / or the first preset model; The first content is output to the second device, so that the second device generates or determines second information corresponding to the first information based on a preset data set and / or a first preset model.

[0128] Optionally, generating or determining the second information based on the first content and the first information includes: A first process is performed on the first information according to the first content to obtain second information.

[0129] Optionally, the device further comprises at least one of the following: In response to receiving the preset instruction, selecting or determining a target language, and generating or determining second information in the target language; In response to receiving the first translation request from the second device, selecting or determining a target language, and generating or determining second information in the target language; outputting second information; outputting the second information to the second device so that the second device outputs the second information; In response to receiving a second translation request from the second device, sending the first content to the second device according to the second translation request, so that the second device generates or determines second information corresponding to the first information based on the first content; The first processing includes at least one of translation, supplementation, summarization, deletion, replacement and word order adjustment.

[0130] The processing device provided in the embodiment of the present application has similar implementation principles and beneficial effects to the technical solutions shown in the above-mentioned corresponding method embodiments, and will not be described in detail here.

[0131] Sixth embodiment See also Fig.10 , Fig.10 A schematic diagram of the structure of the processing device provided in the embodiment of the present application Figure 2 , the device can be mounted on or is the second device in the above method embodiment. Fig.10 The processing device shown can be used to perform part or all of the functions in the method embodiment described in the above embodiment. Fig.10 As shown, the processing device 1200 includes: The output module 1201 is used to output second information, where the second information is generated or determined based on the first content and the first information.

[0132] Optionally, the device further comprises at least one of the following: At least one of the first information, the second information, and the first content is provided by the first device; The first content includes at least one of pre-translated content, a preset data set, and a first preset model; The first information corresponds to the source language; The first information includes at least one of voice, text, image and gesture; The second information corresponds to the target language; The output mode of the second information includes at least one of audio broadcast, text display, image display and video display.

[0133] The processing device provided in the embodiment of the present application has similar implementation principles and beneficial effects to the technical solutions shown in the above-mentioned corresponding method embodiments, and will not be described in detail here.

[0134] An embodiment of the present application also provides an intelligent terminal, including a memory and a processor. A processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method in any of the above embodiments are implemented.

[0135] An embodiment of the present application further provides a storage medium, on which a processing program is stored. When the processing program is executed by a processor, the steps of the processing method in any of the above embodiments are implemented.

[0136] In the embodiments of the smart terminal and storage medium provided in the present application, all technical features of any of the above-mentioned processing method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.

[0137] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.

[0138] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0139] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0140] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0141] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0142] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0143] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.

[0144] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0145] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0146] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0147] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a storage medium, or transmitted from one storage medium to another storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center to another website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a storage disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state storage disk Solid State Disk (SSD)), etc.

[0148] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A processing method, applied to a first device, characterized in that: Includes steps: S10: Generate or determine second information based on the first content and the first information.

2. The processing method according to claim 1, characterized in that Also includes at least one of the following: The first content includes at least one of pre-translated content, a preset data set, and a first preset model; The first information corresponds to the source language; The first information includes at least one of voice, text, image and gesture; The second information corresponds to the target language; The second information is output by the first device and / or the second device; The output mode of the second information includes at least one of audio broadcast, text display, image display and video display.

3. The processing method according to claim 2, characterized in that: The method for obtaining or determining the first content includes at least one of the following: In response to receiving the translation-related content, selecting or determining pre-translation content corresponding to the translation-related content; Acquire historical voice information, and construct a preset data set and / or a first preset model according to the historical voice information.

4. The processing method according to claim 3, characterized in that: Also includes at least one of the following: The translation-related content includes at least one of the document content, the subject name, and the keyword information; Pre-translated content includes specialized terminology and / or context-specific terms; The preset data set includes pronunciation habit information corresponding to at least one language; Pre-translated content is provided through the first language model; The second information is generated or determined by the second language model and / or the first preset model; The first content is output to the second device, so that the second device generates or determines second information corresponding to the first information based on the first content.

5. The processing method according to claim 2, characterized in that: Step S10 includes: A first process is performed on the first information according to the first content to obtain second information.

6. The processing method according to claim 5, characterized in that: Also includes at least one of the following: In response to receiving the preset instruction, selecting or determining a target language, and generating or determining second information in the target language; In response to receiving the first translation request from the second device, selecting or determining a target language, and generating or determining second information in the target language; outputting second information; outputting the second information to the second device so that the second device outputs the second information; In response to receiving a second translation request from the second device, sending the first content to the second device according to the second translation request, so that the second device generates or determines second information corresponding to the first information based on the first content; The first processing includes at least one of translation, supplementation, summarization, deletion, replacement and word order adjustment.

7. A processing method, applied to a second device, characterized in that: Includes steps: S20: Output second information, where the second information is generated or determined based on the first content and the first information.

8. The processing method according to claim 7, characterized in that: Also includes at least one of the following: At least one of the first information, the second information, and the first content is provided by the first device; The first content includes at least one of pre-translated content, a preset data set, and a first preset model; The first information corresponds to the source language; The first information includes at least one of voice, text, image and gesture; The second information corresponds to the target language; The output mode of the second information includes at least one of audio broadcast, text display, image display and video display.

9. An intelligent terminal, characterized in that: include: A memory and a processor, wherein a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method according to any one of claims 1 to 8 are implemented.

10. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the processing method according to any one of claims 1 to 8 are implemented.

Images