Call translation method and apparatus, electronic device, and readable storage medium

By receiving modification requests during a call and marking the modification locations on the call interface with the assistance of the server, the problem of inaccurate translation caused by speech recognition errors is solved, thus improving the accuracy and consistency of translation.

CN119358568BActive Publication Date: 2026-04-28CHINA MOBILE INTERNET CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
CHINA MOBILE INTERNET CO LTD
Filing Date
2024-09-25
Publication Date
2026-04-28

AI Technical Summary

Technical Problem

During a call, inaccurate translations due to speech recognition errors in existing technologies hinder communication.

Method used

The first terminal receives the modification operation, sends trajectory data and the modified language text to the server, the server determines the modification location and instructs the second terminal to mark the modification location in a preset form on the call interface, thereby correcting the translated text.

Benefits of technology

It improves the accuracy of call translation and ensures consistency between the content of the conversation between the two parties.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119358568B_ABST
    Figure CN119358568B_ABST
Patent Text Reader

Abstract

The application discloses a call translation method and device, electronic equipment and readable storage medium. The method comprises the following steps: displaying a first language text and a second language text in a first call interface, wherein the first call interface is a call interface of the first terminal and a second terminal on the first terminal, the first language text is a language text corresponding to a call audio of the first terminal, and the second language text is a language text obtained by translating the first language text; receiving a first modification operation on the first language text; in response to the first modification operation, sending track data corresponding to the first modification operation and the modified first language text to a server, and displaying an adjusted second language text, wherein the adjusted second language text is a language text obtained by translating the modified first language text, the track data and the modified first language text are used to trigger the server to determine a first modification position corresponding to the adjusted second language text according to the track data and the modified first language text, and instruct the second terminal to mark the first modification position in a first preset form in a second call interface, and the second call interface is a call interface of the second terminal and the first terminal on the second terminal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of 5G new communication, and more particularly to a call translation method, apparatus, electronic device and readable storage medium. Background Technology

[0002] 5G New Call is positioned as an upgrade and enhancement of basic call services. It utilizes a platform product with calls as the entry point, based on operator-owned number resources and using the dial pad as the entry point to unlock the value of call data traffic. 5G New Call's intelligent translation can convert speech to text during calls and achieve real-time online translation, displaying the translated text on the phone screen to enable barrier-free communication between people speaking different languages.

[0003] In related technologies, when performing online translation during a call, errors may occur in speech recognition, such as homophones with different characters. This will directly lead to the translation of the incorrectly recognized speech being incorrect as well, creating obstacles to communication between the two parties. Summary of the Invention

[0004] This application discloses a call translation method, apparatus, electronic device, and readable storage medium, which can improve the accuracy of call translation.

[0005] To solve the above problems, this application adopts the following technical solution:

[0006] In a first aspect, embodiments of this application disclose a call translation method applied to a first terminal, comprising: displaying first language text and second language text on a first call interface, wherein the first call interface is a call interface between the first terminal and a second terminal on the first terminal, the first language text is language text corresponding to the call audio of the first terminal, and the second language text is language text obtained by translating the first language text; receiving a first modification operation on the first language text; responding to the first modification operation, sending trajectory data corresponding to the first modification operation and the modified first language text to a server, and displaying the adjusted second language text, wherein the adjusted second language text is language text obtained by translating the modified first language text, the trajectory data and the modified first language text are used to trigger the server to determine a first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, and instructing the second terminal to mark the first modification position in a first preset form on the second call interface, wherein the second call interface is a call interface between the second terminal and the first terminal on the second terminal.

[0007] Secondly, this application discloses a call translation method applied to a server, comprising: receiving trajectory data corresponding to a first modification operation on a first language text and a modified first language text sent by a first terminal, wherein the first language text is a language text corresponding to the call audio of the first terminal; determining a first modification position corresponding to an adjusted second language text based on the trajectory data and the modified first language text, wherein the second language text is a language text obtained by translating the first language text, and the adjusted second language text is a language text obtained by translating the modified first language text; and sending a first annotation instruction to a second terminal, wherein the first annotation instruction carries the first modification position, and the first annotation instruction is used to instruct the second terminal to annotate the first modification position in a first preset form on a second call interface, wherein the second call interface is the call interface between the second terminal and the first terminal on the second terminal.

[0008] Thirdly, this application discloses a call translation method applied to a second terminal, comprising: receiving a first annotation instruction sent by a server, wherein the first annotation instruction carries a first modification position corresponding to an adjusted second language text, the first annotation instruction being used to instruct the second terminal to annotate the first modification position in a first preset form on a second call interface, the second call interface being the call interface between the second terminal and the first terminal on the second terminal, the second call interface including the modified first language text and the adjusted second language text, the adjusted second language text being language text obtained by translating the modified first language text, the first language text being language text corresponding to the call audio of the first terminal, and the second language text being language text obtained by translating the first language text; and, in response to the first annotation instruction, annotating the first modification position in the first preset form on the second call interface.

[0009] Fourthly, this application discloses a call translation device applied to a first terminal, comprising: a first display module for displaying first language text and second language text on a first call interface, wherein the first call interface is a call interface between the first terminal and a second terminal on the first terminal, the first language text is language text corresponding to the call audio of the first terminal, and the second language text is language text obtained by translating the first language text; a first receiving module for receiving a first modification operation on the first language text; and a response module for responding to the first modification operation by sending trajectory data corresponding to the first modification operation and the modified first language text to a server, and displaying the adjusted second language text, wherein the adjusted second language text is language text obtained by translating the modified first language text, the trajectory data and the modified first language text are used to trigger the server to determine a first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, and instruct the second terminal to mark the first modification position in a first preset form on the second call interface, wherein the second call interface is a call interface between the second terminal and the first terminal on the second terminal.

[0010] Fifthly, this application discloses a call translation device applied to a server, comprising: a second receiving module, configured to receive trajectory data corresponding to a first modification operation on a first language text and the modified first language text sent by a first terminal, wherein the first language text is a language text corresponding to the call audio of the first terminal; a determining module, configured to determine a first modification position corresponding to an adjusted second language text based on the trajectory data and the modified first language text, wherein the second language text is a language text obtained by translating the first language text, and the adjusted second language text is a language text obtained by translating the modified first language text; and a second sending module, configured to send a first annotation instruction to a second terminal, wherein the first annotation instruction carries the first modification position, and the first annotation instruction is used to instruct the second terminal to annotate the first modification position in a first preset form on a second call interface, wherein the second call interface is the call interface between the second terminal and the first terminal on the second terminal.

[0011] Sixthly, this application discloses a call translation device applied to a second terminal, comprising: a third receiving module, configured to receive a first annotation instruction sent by a server, wherein the first annotation instruction carries a first modification position corresponding to the adjusted second language text, the first annotation instruction being configured to instruct the second terminal to annotate the first modification position in a first preset form on a second call interface, the second call interface being a call interface between the second terminal and the first terminal on the second terminal, the second call interface including the modified first language text and the adjusted second language text, the adjusted second language text being language text obtained by translating the modified first language text, the first language text being language text corresponding to the call audio of the first terminal, and the second language text being language text obtained by translating the first language text; and an annotation module, configured to, in response to the first annotation instruction, annotate the first modification position in the first preset form on the second call interface.

[0012] In a seventh aspect, embodiments of this application provide an electronic device including a processor and a memory, the memory storing programs or instructions executable on the processor, the programs or instructions, when executed by the processor, implementing the steps of the methods described in the first, second, or third aspects.

[0013] Eighthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first, second, or third aspect.

[0014] Ninthly, embodiments of this application provide a computer program product, the computer program product including a computer program stored on a non-transitory computer-readable storage medium, the computer program including program instructions, which, when executed by a computer, cause the computer to perform the steps of the method described in the first, second, or third aspect.

[0015] The technical solution adopted in this application can achieve the following beneficial effects:

[0016] This application provides a call translation method. A first call interface displays first language text and second language text. The first call interface is the call interface between a first terminal and a second terminal on a first terminal. The first language text is the language text corresponding to the call audio of the first terminal, and the second language text is the language text obtained by translating the first language text. A first modification operation on the first language text is received. In response to the first modification operation, trajectory data corresponding to the first modification operation and the modified first language text are sent to a server, and the adjusted second language text is displayed. The adjusted second language text is the language text obtained by translating the modified first language text. The trajectory data and the modified first language text are used to trigger the server to determine a first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, and instruct the second terminal to mark the first modification position in a first preset form on the second call interface. The second call interface is the call interface between the second terminal and the first terminal on the second terminal. This application improves the accuracy of call translation by correcting the first language text obtained based on call audio speech recognition and displaying the translation data corresponding to the corrected text. Attached Figure Description

[0017] Figure 1 This is a flowchart illustrating a call translation method disclosed in an embodiment of this application;

[0018] Figure 2 This is a flowchart illustrating another call translation method disclosed in an embodiment of this application;

[0019] Figure 3 This is a flowchart illustrating another call translation method disclosed in an embodiment of this application;

[0020] Figure 4 This is a diagram illustrating the architecture of a call translation system disclosed in an embodiment of this application.

[0021] Figure 5 This is a flowchart of a call translation process disclosed in an embodiment of this application;

[0022] Figure 6 This is a schematic diagram of a simultaneous translation application interface disclosed in an embodiment of this application;

[0023] Figure 7 This is a schematic diagram illustrating an embodiment of this application;

[0024] Figure 8 This is a schematic diagram of a first 5G message disclosed in an embodiment of this application;

[0025] Figure 9This is a schematic diagram of the structure of a call translation device disclosed in an embodiment of this application;

[0026] Figure 10 This is a schematic diagram of another call translation device disclosed in an embodiment of this application;

[0027] Figure 11 This is a schematic diagram of the structure of another call translation device disclosed in an embodiment of this application;

[0028] Figure 12 This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of this application. Detailed Implementation

[0029] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0030] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the electrically connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0031] The call translation method, apparatus, electronic device, and readable storage medium disclosed in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0032] This application discloses a call translation method, applied to a first terminal. Figure 1 This is a flowchart illustrating a call translation method disclosed in an embodiment of this application. Figure 1 As shown, the method includes the following steps:

[0033] S120. Display first language text and second language text on the first call interface, wherein the first call interface is the call interface between the first terminal and the second terminal on the first terminal, the first language text is the language text corresponding to the call audio of the first terminal, and the second language text is the language text obtained by translating the first language text.

[0034] Exemplarily, the first language text can be the Chinese text "one hundred thousand", and the second language text can be the English text "one hundred thousand" translated from the Chinese text.

[0035] S140. Receive a first modification operation on the first language text.

[0036] Exemplarily, when the call audio of the first terminal is "forty thousand" and the speech recognition error causes the first language text to be displayed as "one hundred thousand", the "one hundred thousand" can be modified to "forty thousand" through the first modification operation.

[0037] S160. In response to the first modification operation, send the trajectory data corresponding to the first modification operation and the modified first language text to the server, and display the adjusted second language text. The adjusted second language text is the language text translated from the modified first language text. The trajectory data and the modified first language text are used to trigger the server to determine the first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, and instruct the second terminal to mark the first modification position in a first preset form on the second call interface. The second call interface is the call interface between the second terminal and the first terminal on the second terminal.

[0038] The server can be a 5G new call platform. 5G new call is a voice call based on 5G new air interface and supports multiple service scenarios based on the IMSDC interface.

[0039] It should be noted that the trajectory data corresponding to the first modification operation can characterize the modification range of the first language text. The server can determine the modification position based on the trajectory data corresponding to the first modification operation and the modified first language text. Exemplarily, the trajectory data can be the trajectory data within a preset time period, such as within 2 seconds.

[0040] Exemplarily, when the first language text is "one hundred thousand" and the modified first language text is "forty thousand", the first terminal, in response to the received first modification operation, sends the trajectory data corresponding to the first modification operation and the modified first language text "forty thousand" to the server, and displays the adjusted second language text "Forty thousand". That is, at this time, the first call interface displays the modified first language text "forty thousand" and the adjusted second language text "Fortythousand".

[0041] This application provides a call translation method. A first call interface displays first language text and second language text. The first call interface is the call interface between a first terminal and a second terminal on a first terminal. The first language text is the language text corresponding to the call audio of the first terminal, and the second language text is the language text obtained by translating the first language text. A first modification operation on the first language text is received. In response to the first modification operation, trajectory data corresponding to the first modification operation and the modified first language text are sent to a server, and the adjusted second language text is displayed. The adjusted second language text is the language text obtained by translating the modified first language text. The trajectory data and the modified first language text are used to trigger the server to determine a first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, and instruct the second terminal to mark the first modification position in a first preset form on the second call interface. The second call interface is the call interface between the second terminal and the first terminal on the second terminal. This application improves the accuracy of call translation by correcting the first language text obtained based on call audio speech recognition and displaying the translation data corresponding to the corrected text.

[0042] In one implementation, before receiving the first modification operation on the first language text, the method may further include: responding to a received operation on a first control of the first call interface, the first language text enters an editable state. For example, the first control may be a "Modify" button; that is, a "Modify" button is displayed on the first call interface, and the first user corresponding to the first terminal can click the "Modify" button to put the first language text into an editable state, thus avoiding accidental touches. It should be noted that in this application, the received operation on the first control may be a click, a long press, etc., and this application does not impose specific limitations on this.

[0043] In addition, the first language text obtained by speech recognition of the call audio can be directly in an editable state to reduce the complexity of operation.

[0044] In one implementation, after displaying the adjusted second language text, the process may further include: if no operation on the first language text is received within a preset time period, sending a first instruction to the server, wherein the first instruction indicates that the first language text has been modified. That is, if the first terminal does not receive any operation on the first language text from the first user within the preset time period, it assumes that the first user has completed modifying the first language text, and then sends a first instruction to the server, instructing the server to continue performing subsequent operations. For example, the preset time period can be 5 seconds.

[0045] In this embodiment of the application, after displaying the adjusted second language text, the method may further include: in response to a received operation on a second control of the first call interface, sending a second instruction to the server, wherein the second instruction represents a request from the first terminal to send the call translation record between the first terminal and the second terminal to the blockchain. For example, the second control may be a "Upload to Blockchain" button, allowing the first user corresponding to the first terminal to request the call translation record between the first terminal and the second terminal to be sent to the blockchain by clicking the "Upload to Blockchain" button.

[0046] In one implementation, after sending the second instruction to the server, the process may further include: receiving a first 5G message sent by the server, wherein the first 5G message carries the call translation record, the call time corresponding to the call translation record, a first identifier corresponding to the first terminal, and a second identifier corresponding to the second terminal. That is, after completing the uploading of the call translation record between the first and second terminals to the blockchain, the server can send a first 5G message to the first terminal carrying the call translation record, the call time corresponding to the call translation record, the first identifier corresponding to the first terminal, and the second identifier corresponding to the second terminal. The first user corresponding to the first terminal can view the call translation record by clicking the message card corresponding to the first 5G message. Additionally, the first 5G message may also carry other information about the first and second terminals.

[0047] In one implementation, after receiving the first 5G message sent by the server, the method may further include: receiving a second modification operation on the call translation record; and in response to the second modification operation, sending an update request to the smart contract of the blockchain, wherein the update request carries the modified call translation record and the first identifier. That is, if the first user corresponding to the first terminal has any objection to the call translation record, they can modify the call translation record. It should be noted that the modified call translation record carried in the update request can be encrypted using the private key from a key pair.

[0048] In this embodiment, the step of responding to the first modification operation by sending the trajectory data corresponding to the first modification operation and the modified first language text to the server, and displaying the adjusted second language text, may include: responding to the first modification operation by sending the trajectory data corresponding to the first modification operation and the modified first language text to the server; receiving the adjusted second language text sent by the server and displaying it. In other words, this application uses a server to translate the modified first language text to obtain the adjusted second language text.

[0049] In this embodiment, the language type of the first language text corresponds to the first user, and the language type of the second language text corresponds to the second user. The first user is the user corresponding to the first terminal, and the second user is the user corresponding to the second terminal. For example, if the first user is from country A and the second user is from country B, then the call audio of the first terminal is in the language of country A, the language type of the first language text is the language of country A, and the language type of the second language text is the language of country B.

[0050] This application discloses a call translation method applied to a server. Figure 2 This is a flowchart illustrating another call translation method disclosed in an embodiment of this application. Figure 2 As shown, the method includes the following steps:

[0051] S220: Receive trajectory data and modified first language text sent by the first terminal corresponding to the first modification operation on the first language text, wherein the first language text is the language text corresponding to the call audio of the first terminal.

[0052] It should be noted that the trajectory data corresponding to the first modification operation can represent the scope of modification to the first language text.

[0053] S240. Based on the trajectory data and the modified first language text, determine the first modification position corresponding to the adjusted second language text, wherein the second language text is the language text obtained by translating the first language text, and the adjusted second language text is the language text obtained by translating the modified first language text.

[0054] For example, the center point coordinates of the first modification position corresponding to the adjusted second language text can be determined based on the trajectory data corresponding to the first modification operation on the first language text and the modified first language text.

[0055] S260. Send a first annotation instruction to the second terminal, wherein the first annotation instruction carries the first modified position, and the first annotation instruction is used to instruct the second terminal to annotate the first modified position in a first preset form on the second call interface, and the second call interface is the call interface between the second terminal and the first terminal on the second terminal.

[0056] For example, the first preset form can be a red box, that is, after the server determines the first modified position corresponding to the adjusted second language text, it sends a first annotation instruction to the second terminal, instructing the second terminal to annotate the first modified position with a red box on the second call interface.

[0057] In this application, the first preset form can also be red highlight, etc., and this application does not impose specific restrictions on it.

[0058] This application provides a call translation method. A server receives trajectory data corresponding to a first modification operation on first language text and the modified first language text sent by a first terminal. The first language text is the language text corresponding to the call audio of the first terminal. Then, based on the trajectory data and the modified first language text, the server determines a first modification position corresponding to an adjusted second language text. The second language text is the language text obtained by translating the first language text. The adjusted second language text is the language text obtained by translating the modified first language text. The server sends a first annotation instruction to a second terminal. The first annotation instruction is used to instruct the second terminal to annotate the first modification position in a first preset form on the second call interface. The second call interface is the call interface between the second terminal and the first terminal on the second terminal, to indicate the changed content of the second user corresponding to the second terminal.

[0059] In one implementation, determining the first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text may include: determining a second modification position corresponding to the modified first language text based on the trajectory data and the modified first language text; and determining the first modification position corresponding to the adjusted second language text based on the second modification position. For example, when the first language text is Chinese and the second language text is English, the modification position of the Chinese text can be determined first based on the trajectory data corresponding to the first modification operation and the modified first language text, and then the modification position of the English text can be determined accordingly based on the modification position of the Chinese text.

[0060] In this embodiment of the application, before determining the first modified position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, the method may further include: translating the modified first language text to obtain the adjusted second language text; sending the adjusted second language text to the first terminal; and sending the modified first language text and the adjusted second language text to the second terminal.

[0061] In other words, after receiving the modified first language text sent by the first terminal, the server can translate the modified first language text to obtain the adjusted second language text, and then send the adjusted second language text to the first terminal, and send the modified first language text and the adjusted second language text to the second terminal.

[0062] In one implementation, after sending the first annotation instruction to the second terminal, the method may further include: receiving a first instruction sent by the first terminal, wherein the first instruction is used to indicate that the first language text has been modified; and in response to the first instruction, sending a second annotation instruction to the second terminal, wherein the second annotation instruction is used to instruct the second terminal to annotate the first modified position in a second preset form on the second call interface.

[0063] For example, the second preset form can be a yellow box or yellow highlight, as well as other annotation forms, and this application does not impose specific limitations on this.

[0064] In response to the first instruction, the server sends a second annotation instruction to the second terminal to prompt the second user corresponding to the second terminal to confirm the changed content.

[0065] In one implementation, after sending the second annotation instruction to the second terminal, the method may further include: receiving a target instruction, wherein the target instruction includes a second instruction sent by the first terminal and / or a third instruction sent by the second terminal, the second instruction representing that the first terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain, and the third instruction representing that the second terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain; and in response to the target instruction, sending the call translation record to the blockchain, and sending the call time corresponding to the call translation record, a first identifier corresponding to the first terminal, and a second identifier corresponding to the second terminal to the blockchain via a smart contract.

[0066] In other words, when the server receives an on-chain request from at least one of the first and second terminals, the server sends the call translation record of the first and second terminals to the blockchain, and sends the call time, first identifier, second identifier, and the public key of a key pair corresponding to the call translation record to the blockchain's smart contract. The smart contract then verifies and maintains the call translation record to update it, thereby achieving trusted update management of the call translation record and ensuring its accuracy and security.

[0067] In one implementation, after sending the call translation record to the blockchain in response to the target instruction, and sending the call time corresponding to the call translation record, the first identifier corresponding to the first terminal, and the second identifier corresponding to the second terminal to the smart contract of the blockchain, the method may further include: in response to the feedback information sent by the received smart contract, sending a first 5G message to the first terminal and the second terminal, wherein the first 5G message carries the call translation record, the call time corresponding to the call translation record, the first identifier corresponding to the first terminal, and the second identifier corresponding to the second terminal.

[0068] In other words, after the call ends, the first user corresponding to the first terminal and the second user corresponding to the second terminal can view the call translation record by clicking the message card corresponding to the first 5G message. Additionally, the first 5G message can also carry other information about the first and second terminals.

[0069] It should be noted that the server can encapsulate the call translation record, the corresponding call time, the first identifier, and the second identifier into a 5G message and send it to the 5G messaging platform. The 5G messaging platform then parses the 5G message and generates a rich media card message body, which is sent to the first terminal and the second terminal as the first 5G message. This rich media card message body can include an "update" function to allow users to update the call translation record later. Alternatively, the server can also directly send the first 5G message to the first terminal and the second terminal.

[0070] In this embodiment, after sending the first 5G message to the first terminal and the second terminal, the process may further include: receiving an update record corresponding to the call translation record sent by the smart contract in response to a received update request, wherein the update request is a request sent by the first terminal, and the update request carries the modified call translation record and the first identifier; and sending a second 5G message to the second terminal, wherein the second 5G message carries the update record. The second user corresponding to the second terminal can view the update record through the second 5G message.

[0071] This application discloses a call translation method applied to a second terminal. Figure 3 This is a flowchart illustrating another call translation method disclosed in an embodiment of this application. Figure 3 As shown, the method includes the following steps:

[0072] S320: Receive the first annotation instruction sent by the server.

[0073] Wherein, the first annotation instruction carries a first modification position corresponding to the adjusted second language text. The first annotation instruction is used to instruct the second terminal to annotate the first modification position in a first preset form on the second call interface. The second call interface is the call interface between the second terminal and the first terminal on the second terminal. The second call interface includes the modified first language text and the adjusted second language text. The adjusted second language text is the language text obtained by translating the modified first language text. The first language text is the language text corresponding to the call audio of the first terminal. The second language text is the language text obtained by translating the first language text.

[0074] It should be noted that the voice text on the first call interface of the first terminal and the voice text on the second call interface of the second terminal are displayed on the same screen.

[0075] If the first annotation instruction received carries the coordinates of the center point of the first modification location, the annotation range can be determined based on these center point coordinates. Of course, the first modification location carried in the first annotation instruction can also be the annotation range.

[0076] For example, the first preset form can be a red frame, red highlight, etc.

[0077] S340. In response to the first annotation instruction, the first modified position is annotated on the second call interface in the first preset form.

[0078] For example, when the first preset form is a red box, in response to the first annotation instruction, the first modification position is marked with a red box on the second call interface.

[0079] This application provides a call translation method. A second terminal receives a first annotation instruction sent by a server. The first annotation instruction carries a first modification position corresponding to the adjusted second language text. The first annotation instruction is used to instruct the second terminal to annotate the first modification position in a first preset form on the second call interface. The second call interface is the call interface between the second terminal and the first terminal on the second terminal. The second call interface includes the modified first language text and the adjusted second language text. The adjusted second language text is the language text obtained by translating the modified first language text. The first language text is the language text corresponding to the call audio of the first terminal. The second language text is the first language text obtained by translating the first language text. Then, in response to the first annotation instruction, the second terminal annotates the first modification position in the first preset form on the second call interface to indicate the changed content of the second user corresponding to the second terminal.

[0080] In one implementation, before receiving the first annotation instruction sent by the receiving server, the system may further include receiving and displaying the modified first language text and the adjusted second language text sent by the receiving server.

[0081] In this embodiment of the application, after the first modified position is marked in the first preset form on the second call interface, the method may further include: receiving a second marking instruction sent by the server, wherein the second marking instruction is used to instruct the second terminal to mark the first modified position in the second call interface in the second preset form; and in response to the second marking instruction, marking the first modified position in the second preset form on the second call interface.

[0082] For example, if the first preset form is a red box and the second preset form is a yellow box, and the second terminal receives the second annotation instruction, the red box annotation on the second call interface will be changed to a yellow box annotation.

[0083] In one implementation, after the first modified location is marked in the second preset form on the second call interface, the method may further include: displaying a prompt message, wherein the prompt message is used to prompt the second user to confirm the target information, wherein the second user is the user corresponding to the second terminal, and the target information is the information marked in the second preset form; and receiving a confirmation operation for the prompt message.

[0084] For example, the prompt message can be displayed as a pop-up window near the target information, and the pop-up message can be "Confirm?". Alternatively, in the case of a second preset format of a yellow box, the yellow box can be displayed along with the "Confirm" button in a flashing manner to prompt the second user to confirm the target information. This application does not limit the specific display method of the prompt message.

[0085] The second user can confirm the target information by clicking the "Confirm" button on the second call interface. After the second user confirms the target information, it means that the second user has confirmed the first user's modification of the translation content, and the translation content displayed on the current interface has completed the consensus confirmation.

[0086] In one implementation, after receiving the confirmation operation for the prompt information, the method further includes: in response to the received operation on the third control of the second call interface, sending a third instruction to the server, wherein the third instruction represents a request from the second terminal to send the call translation record between the first terminal and the second terminal to the blockchain. For example, the third control could be a "Upload to Blockchain" button, allowing the second user corresponding to the second terminal to request the call translation record between the first terminal and the second terminal to be sent to the blockchain by clicking the "Upload to Blockchain" button.

[0087] In this embodiment of the application, after sending the third instruction to the server, the method may further include: receiving a first 5G message sent by the server, wherein the first 5G message carries the call translation record, the call time corresponding to the call translation record, a first identifier corresponding to the first terminal, and a second identifier corresponding to the second terminal.

[0088] In other words, after uploading the call translation record between the first and second terminals to the blockchain, the server can send a first 5G message to the second terminal containing the call translation record, the call time corresponding to the translation record, a first identifier corresponding to the first terminal, and a second identifier corresponding to the second terminal. The second user corresponding to the second terminal can view the call translation record by clicking the message card corresponding to the first 5G message. Additionally, the first 5G message can also carry other information about the first and second terminals.

[0089] In one implementation, after receiving the first 5G message sent by the server, the method may further include: receiving a second 5G message sent by the server, wherein the second 5G message carries an update record corresponding to the call translation record. The second user corresponding to the second terminal can view the update record through this second 5G message.

[0090] It should be noted that the above description refers to the case where modifications are made on the first terminal and annotated on the second terminal. Alternatively, modifications can be made on the second terminal and annotated on the first terminal; the specific implementation methods are similar, and this application will not repeat them here. Both the first and second call interfaces can include a "Modify" button, a "Confirm" button, and a "Upload" button to achieve the same functionality.

[0091] like Figure 4 As shown, the call translation system of this application includes a first terminal, a second terminal, a server, a 5G messaging platform, and a blockchain. The server can be a 5G New Voice platform, and the blockchain stores smart contracts. 5G New Voice is a voice call based on the 5G New Radio interface, supporting multiple service scenarios based on the IMS DC interface. The server enables both parties in a call to simultaneously modify the bilingual translation content and reach a consensus during real-time call translation. The server calls the 5G messaging platform interface; after the call ends, the user can reliably update and maintain the translation records uploaded to the blockchain through a 5G messaging card. The blockchain is a decentralized database; this application utilizes the blockchain to store the call translation records agreed upon by the first and second terminals. Smart contracts are one of the core technologies of blockchain; this application uses smart contract technology to implement a reliable update process for translation records.

[0092] The call translation process in this application is as follows: Figure 5 As shown:

[0093] S1. In response to the service activation command of the first terminal and the second terminal, the server sends the screen translation application to the first terminal and the second terminal based on the IMS DC interface to translate the call content online. The first language text and the second language text are simultaneously displayed on the first call interface of the first terminal and the second call interface of the second terminal.

[0094] Among them, the service activation command is the activation command for the screen-sharing translation service. An icon for the screen-sharing translation application can be added to the top banner position of the call application. After the first user and the second user in the call click on the service icon, the server sends the screen-sharing translation application to the first terminal and the second terminal based on the IMSDC interface.

[0095] The interface of the screen-sharing translation application is as follows: Figure 6 As shown, the on-screen translation application interface displays bilingual translation content and also includes "Edit," "Confirm," and "Upload" buttons.

[0096] It should be noted that the online translation demonstration is based on existing technology, which can read the voice content of a call in real time, perform speech recognition on the voice content, and obtain text information.

[0097] S2. When the first user corresponding to the first terminal clicks the "Modify" button to modify the first language text, the server determines the first modification position corresponding to the adjusted second language text based on the trajectory data at the time of modification and the modified first language text, and sends a first annotation instruction to the second terminal. The first annotation instruction carries the first modification position and is used to instruct the second terminal to annotate the first modification position in a first preset form on the second call interface. This ensures that after receiving the first annotation instruction, the second terminal annotates the first modification position in the first preset form on the second call interface. Figure 7 As shown.

[0098] The first terminal can obtain the trajectory data at the time of modification through the screen-sharing translation application A on the first terminal and send it to the server. After receiving the first annotation instruction, the second terminal can use the screen-sharing translation application B on the second terminal to annotate the first modification location in a first preset format on the second call interface.

[0099] The first terminal and the second terminal are displayed on the same screen.

[0100] S3. If the first terminal does not receive any operation on the first language text within a preset time, it sends a first instruction to the server. The first instruction indicates that the first language text has been modified. In response to the first instruction, the server sends a second annotation instruction to the second terminal. The second annotation instruction instructs the second terminal to annotate the first modification location in a second preset form on the second call interface. After receiving the second annotation instruction, the second terminal annotates the first modification location in a second preset form on the second call interface and prompts the second user to confirm.

[0101] In this application, operations on the first language text can be monitored through a screen-sharing translation application A on the first terminal. After receiving the second annotation instruction, the second terminal can use a screen-sharing translation application B on the second terminal to annotate the first modification location in a second preset format on the second call interface.

[0102] S4. Repeat the above operations. In response to the received target instruction, the server summarizes the call translation records of the first terminal and the second terminal confirmed by the same-screen consensus, uploads the call translation records to the blockchain, and sends the first 5G message to the first terminal and the second terminal.

[0103] The target instruction may include a second instruction sent by the first user clicking the "on-chain" button on the first terminal and / or a third instruction sent by the second user clicking the "on-chain" button on the second terminal. The second instruction is used to indicate that the first terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain, and the third instruction is used to indicate that the second terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain.

[0104] While uploading the call translation record to the blockchain, the server also sends the call time corresponding to the translation record, the first identifier corresponding to the first terminal, the second identifier corresponding to the second terminal, and the public key from a key pair to the smart contract. After successful on-chain upload, the server receives feedback from the smart contract. The server can then encapsulate the call translation record, the corresponding call time, the first identifier, and the second identifier into a 5G message and send it to the 5G messaging platform. The 5G messaging platform parses the 5G message and generates a rich media card message body, sending a first 5G message to both the first and second terminals. This first 5G message carries the call translation record, the corresponding call time, the first identifier corresponding to the first terminal, and the second identifier corresponding to the second terminal. This rich media card message body can include an "update" function to allow users to update the call translation record later.

[0105] S5, First User Click Figure 8 The first 5G message shown allows browsing of call translation records and sending update requests to the smart contract to achieve reliable updates to the on-chain translation records.

[0106] The update request carries the modified call translation record encrypted with the private key of a key pair and the first identifier. After the smart contract decrypts the modified call translation record with the corresponding public key, it uploads the modified call translation record to the blockchain, updates the call translation record update record, and sends the update record to the server. The server then sends a second 5G message carrying the update record to the second terminal.

[0107] It should be noted that this example uses the first user updating the call translation record; the second user can also perform the same operation to update the call translation record.

[0108] Using the method provided in this application, both parties in a call can annotate, modify, and confirm the translated content based on the screen sharing function. The consensus-reached bilingual call translation content is then uploaded to the blockchain, and the smart contract performs record updates and verification, thereby achieving consensus and trusted update management of call translation records and ensuring the accuracy of call translation.

[0109] The call translation method provided in this application can be executed by a call translation device. This application uses a call translation device to execute the call translation method as an example to illustrate the device used in this application's embodiment.

[0110] The call translation device disclosed in this application is applied to a first terminal.

[0111] Figure 9 This is a schematic diagram of the structure of a call translation device disclosed in an embodiment of this application. Figure 9 As shown, the call translation device 900 includes: a first display module 910, a first receiving module 920, and a response module 930.

[0112] In this application, a first display module 910 is used to display first language text and second language text on a first call interface, wherein the first call interface is the call interface between the first terminal and the second terminal on the first terminal, the first language text is the language text corresponding to the call audio of the first terminal, and the second language text is the language text obtained by translating the first language text; a first receiving module 920 is used to receive a first modification operation on the first language text; a response module 930 is used to respond to the first modification operation by sending trajectory data corresponding to the first modification operation and the modified first language text to the server, and displaying the adjusted second language text, wherein the adjusted second language text is the language text obtained by translating the modified first language text, the trajectory data and the modified first language text are used to trigger the server to determine a first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, and instruct the second terminal to mark the first modification position in a first preset form on the second call interface, wherein the second call interface is the call interface between the second terminal and the first terminal on the second terminal.

[0113] In one implementation, the response module 930 is further configured to, in response to a received operation on a first control of the first call interface, cause the first language text to enter a pending editing state before receiving the first modification operation on the first language text.

[0114] In one implementation, the above-mentioned device further includes: a first sending module, configured to send a first instruction to the server if no operation on the first language text is received within a preset time after the display of the adjusted second language text, wherein the first instruction is used to indicate that the first language text has been modified.

[0115] In one implementation, the response module 930 is further configured to, after displaying the adjusted second language text, send a second instruction to the server in response to a received operation on the second control of the first call interface, wherein the second instruction is used to indicate that the first terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain.

[0116] In one implementation, the first receiving module 920 is further configured to receive a first 5G message sent by the server after sending the second instruction to the server, wherein the first 5G message carries the call translation record, the call time corresponding to the call translation record, a first identifier corresponding to the first terminal, and a second identifier corresponding to the second terminal.

[0117] In one implementation, the first receiving module 920 is further configured to receive a second modification operation on the call translation record after receiving the first 5G message sent by the server; the response module 930 is further configured to send an update request to the smart contract of the blockchain in response to the second modification operation, wherein the update request carries the modified call translation record and the first identifier.

[0118] In one implementation, the response module 930, in response to the first modification operation, sends the trajectory data corresponding to the first modification operation and the modified first language text to the server, and displays the adjusted second language text, including: in response to the first modification operation, sending the trajectory data corresponding to the first modification operation and the modified first language text to the server; receiving the adjusted second language text sent by the server and displaying it.

[0119] In one implementation, the language type of the first language text corresponds to the first user, and the language type of the second language text corresponds to the second user, wherein the first user is the user corresponding to the first terminal, and the second user is the user corresponding to the second terminal.

[0120] The call translation device provided in this application embodiment can implement all the processes implemented in the call translation method embodiment, and will not be described again here to avoid repetition.

[0121] The call translation method provided in this application can be executed by a call translation device. This application uses a call translation device to execute the call translation method as an example to illustrate the device used in this application's embodiment.

[0122] The call translation device disclosed in this application is used in a server.

[0123] Figure 10 This is a schematic diagram of another call translation device disclosed in an embodiment of this application. Figure 10 As shown, the call translation device 1000 includes: a second receiving module 1010, a determining module 1020, and a second sending module 1030.

[0124] In this application, the second receiving module 1010 is used to receive trajectory data corresponding to the first modification operation on the first language text and the modified first language text sent by the first terminal, wherein the first language text is the language text corresponding to the call audio of the first terminal; the determining module 1020 is used to determine the first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, wherein the second language text is the language text obtained by translating the first language text, and the adjusted second language text is the language text obtained by translating the modified first language text; the second sending module 1030 is used to send a first marking instruction to the second terminal, wherein the first marking instruction carries the first modification position, and the first marking instruction is used to instruct the second terminal to mark the first modification position in a first preset form on the second call interface, wherein the second call interface is the call interface between the second terminal and the first terminal on the second terminal.

[0125] In one implementation, the determining module 1020 determines a first modified position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, including: determining a second modified position corresponding to the modified first language text based on the trajectory data and the modified first language text; and determining a first modified position corresponding to the adjusted second language text based on the second modified position.

[0126] In one implementation, the above apparatus further includes: a obtaining module, configured to obtain the adjusted second language text by translating the modified first language text before determining the first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text; and a second sending module 1030, configured to send the adjusted second language text to the first terminal and send the modified first language text and the adjusted second language text to the second terminal.

[0127] In one implementation, the second receiving module 1010 is further configured to receive a first instruction sent by the first terminal after sending the first annotation instruction to the second terminal, wherein the first instruction is used to indicate that the first language text has been modified; the second sending module 1030 is further configured to send a second annotation instruction to the second terminal in response to the first instruction, wherein the second annotation instruction is used to instruct the second terminal to annotate the first modification position in a second preset form on the second call interface.

[0128] In one implementation, the second receiving module 1010 is further configured to receive a target instruction after sending the second annotation instruction to the second terminal, wherein the target instruction includes a second instruction sent by the first terminal and / or a third instruction sent by the second terminal, the second instruction representing that the first terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain, and the third instruction representing that the second terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain; the second sending module 1030 is further configured to, in response to the target instruction, send the call translation record to the blockchain, and send the call time corresponding to the call translation record, the first identifier corresponding to the first terminal, and the second identifier corresponding to the second terminal to the smart contract of the blockchain.

[0129] In one implementation, the second sending module 1030 is further configured to, in response to the target instruction, send the call translation record to the blockchain, and send the call time corresponding to the call translation record, the first identifier corresponding to the first terminal, and the second identifier corresponding to the second terminal to the smart contract of the blockchain, and then, in response to the feedback information received from the smart contract, send a first 5G message to the first terminal and the second terminal, wherein the first 5G message carries the call translation record, the call time corresponding to the call translation record, the first identifier corresponding to the first terminal, and the second identifier corresponding to the second terminal.

[0130] In one implementation, the second receiving module 1010 is further configured to receive, after sending the first 5G message to the first terminal and the second terminal, an update record corresponding to the call translation record sent by the smart contract in response to a received update request, wherein the update request is a request sent by the first terminal, and the update request carries the modified call translation record and the first identifier; the second sending module 1030 is further configured to send a second 5G message to the second terminal, wherein the second 5G message carries the update record.

[0131] The call translation device provided in this application embodiment can implement all the processes implemented in the call translation method embodiment, and will not be described again here to avoid repetition.

[0132] The call translation method provided in this application can be executed by a call translation device. This application uses a call translation device to execute the call translation method as an example to illustrate the device used in this application's embodiment.

[0133] The call translation device disclosed in this application is applied to a second terminal.

[0134] Figure 11 This is a schematic diagram of another call translation device disclosed in an embodiment of this application. Figure 11 As shown, the call translation device 1100 includes a third receiving module 1110 and a labeling module 1120.

[0135] In this application, the third receiving module 1110 is used to receive a first annotation instruction sent by the server, wherein the first annotation instruction carries a first modification position corresponding to the adjusted second language text, the first annotation instruction is used to instruct the second terminal to annotate the first modification position in a first preset form on the second call interface, the second call interface is the call interface between the second terminal and the first terminal on the second terminal, the second call interface includes the modified first language text and the adjusted second language text, the adjusted second language text is language text obtained by translating the modified first language text, the first language text is language text corresponding to the call audio of the first terminal, and the second language text is language text obtained by translating the first language text; the annotation module 1120 is used to annotate the first modification position in the first preset form on the second call interface in response to the first annotation instruction.

[0136] In one implementation, the third receiving module 1110 is further configured to receive and display the modified first language text and the adjusted second language text sent by the receiving server before the first annotation instruction sent by the receiving server.

[0137] In one implementation, the third receiving module 1110 is further configured to receive a second annotation instruction sent by the server after the first modified position is annotated in the first preset form on the second call interface, wherein the second annotation instruction is used to instruct the second terminal to annotate the first modified position in the second call interface in the second preset form; the annotation module 1120 is further configured to annotate the first modified position in the second call interface in response to the second annotation instruction in the second preset form.

[0138] In one implementation, the above-mentioned device further includes: a second display module, configured to display a prompt message after the first modified position is marked in the second preset form on the second call interface, wherein the prompt message is used to prompt a second user to confirm the target information, wherein the second user is a user corresponding to the second terminal, and the target information is information marked in the second preset form; and to receive a confirmation operation on the prompt message.

[0139] In one implementation, the above apparatus further includes: a third sending module, configured to, after receiving the confirmation operation on the prompt information, send a third instruction to the server in response to the received operation on the third control of the second call interface, wherein the third instruction is used to indicate that the second terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain.

[0140] In one implementation, the third receiving module 1110 is further configured to receive a first 5G message sent by the server after sending the third instruction to the server, wherein the first 5G message carries the call translation record, the call time corresponding to the call translation record, a first identifier corresponding to the first terminal, and a second identifier corresponding to the second terminal.

[0141] In one implementation, the third receiving module 1110 is further configured to receive a second 5G message sent by the server after receiving the first 5G message sent by the server, wherein the second 5G message carries an update record corresponding to the call translation record.

[0142] The call translation device provided in this application embodiment can implement all the processes implemented in the call translation method embodiment, and will not be described again here to avoid repetition.

[0143] Optionally, such as Figure 12 As shown, this application embodiment also provides an electronic device 1200, including a processor 1201 and a memory 1202. The memory 1202 stores a program or instructions that can run on the processor 1201. When the program or instructions are executed by the processor 1201, they implement the various steps of the above-described call translation method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0144] It should be noted that the electronic devices in the embodiments of this application include mobile electronic devices and non-mobile electronic devices.

[0145] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described call translation method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0146] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0147] This application also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium. The computer program includes program instructions that, when executed by a computer, cause the computer to perform the steps of the call translation method described above.

[0148] The above embodiments of this application focus on describing the differences between the various embodiments. As long as the different optimization features between the various embodiments are not contradictory, they can be combined to form a better embodiment. For the sake of brevity, they will not be described in detail here.

[0149] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A method for translating voice calls, characterized in that, Applied to the first terminal, including: The first call interface displays first language text and second language text. The first call interface is the call interface between the first terminal and the second terminal on the first terminal. The first language text is the language text corresponding to the call audio of the first terminal. The second language text is the language text obtained by translating the first language text. Receive a first modification operation on the first language text; In response to the first modification operation, the trajectory data corresponding to the first modification operation and the modified first language text are sent to the server, and the adjusted second language text is displayed. The adjusted second language text is a translation of the modified first language text. The trajectory data and the modified first language text trigger the server to determine a first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, and instruct the second terminal to mark the first modification position in a first preset format on a second call interface. The second call interface is the call interface between the second terminal and the first terminal on the second terminal. Determining the first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text includes: determining a second modification position corresponding to the modified first language text based on the trajectory data and the modified first language text; and determining a first modification position corresponding to the adjusted second language text based on the second modification position.

2. The method according to claim 1, characterized in that, Prior to receiving the first modification operation on the first language text, the method further includes: In response to the received operation on the first control of the first call interface, the first language text enters the editable state.

3. The method according to claim 1, characterized in that, Following the display of the adjusted second language text, the following is also included: If no operation on the first language text is received within a preset time, a first instruction is sent to the server, wherein the first instruction is used to indicate that the first language text has been modified.

4. The method according to claim 1, characterized in that, Following the display of the adjusted second language text, the following is also included: In response to a received operation on the second control of the first call interface, a second instruction is sent to the server, wherein the second instruction represents a request from the first terminal to send the call translation record between the first terminal and the second terminal to the blockchain.

5. The method according to claim 4, characterized in that, After sending the second instruction to the server, the method further includes: The server receives a first 5G message, wherein the first 5G message carries the call translation record, the call time corresponding to the call translation record, a first identifier corresponding to the first terminal, and a second identifier corresponding to the second terminal.

6. The method according to claim 5, characterized in that, After receiving the first 5G message sent by the server, the method further includes: Receive a second modification operation on the call translation record; In response to the second modification operation, an update request is sent to the smart contract of the blockchain, wherein the update request carries the modified call translation record and the first identifier.

7. The method according to claim 1, characterized in that, In response to the first modification operation, the trajectory data corresponding to the first modification operation and the modified first language text are sent to the server, and the adjusted second language text is displayed, including: In response to the first modification operation, the trajectory data corresponding to the first modification operation and the modified first language text are sent to the server; Receive and display the adjusted second language text sent by the server.

8. The method according to claim 1, characterized in that, The language type of the first language text corresponds to the first user, and the language type of the second language text corresponds to the second user, wherein the first user is the user corresponding to the first terminal, and the second user is the user corresponding to the second terminal.

9. A method for translating voice calls, characterized in that, Applied to servers, including: The system receives trajectory data and modified first language text sent by a first terminal, corresponding to a first modification operation on the first language text. The first language text is the language text corresponding to the call audio of the first terminal. Based on the trajectory data and the modified first language text, a first modification position corresponding to the adjusted second language text is determined, wherein the second language text is a language text obtained by translating the first language text, and the adjusted second language text is a language text obtained by translating the modified first language text; Send a first annotation instruction to the second terminal, wherein the first annotation instruction carries the first modified position, and the first annotation instruction is used to instruct the second terminal to annotate the first modified position in a first preset form on the second call interface, and the second call interface is the call interface between the second terminal and the first terminal on the second terminal; Determining the first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text includes: Based on the trajectory data and the modified first language text, determine the second modification position corresponding to the modified first language text; Based on the second modification position, a first modification position corresponding to the adjusted second language text is determined.

10. The method according to claim 9, characterized in that, Before determining the first modified position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, the method further includes: The modified first language text is translated to obtain the adjusted second language text; The adjusted second language text is sent to the first terminal, and the modified first language text and the adjusted second language text are sent to the second terminal.

11. The method according to claim 9, characterized in that, After sending the first annotation instruction to the second terminal, the method further includes: Receive a first instruction sent by the first terminal, wherein the first instruction is used to indicate that the first language text has been modified. In response to the first instruction, a second annotation instruction is sent to the second terminal, wherein the second annotation instruction is used to instruct the second terminal to annotate the first modified position in a second preset form on the second call interface.

12. The method according to claim 11, characterized in that, After sending the second annotation instruction to the second terminal, the method further includes: Receive target instructions, wherein the target instructions include a second instruction sent by the first terminal and / or a third instruction sent by the second terminal, wherein the second instruction is used to indicate that the first terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain, and the third instruction is used to indicate that the second terminal requests to send the call translation record between the first terminal and the second terminal to the blockchain; In response to the target instruction, the call translation record is sent to the blockchain, and the call time corresponding to the call translation record, the first identifier corresponding to the first terminal, and the second identifier corresponding to the second terminal are sent to the smart contract of the blockchain.

13. The method according to claim 12, characterized in that, After the smart contract that responds to the target instruction by sending the call translation record to the blockchain and sending the call time corresponding to the call translation record, the first identifier corresponding to the first terminal, and the second identifier corresponding to the second terminal to the blockchain, the method further includes: In response to the feedback information received from the smart contract, a first 5G message is sent to the first terminal and the second terminal, wherein the first 5G message carries the call translation record, the call time corresponding to the call translation record, a first identifier corresponding to the first terminal, and a second identifier corresponding to the second terminal.

14. The method according to claim 13, characterized in that, After sending the first 5G message to the first terminal and the second terminal, the method further includes: The system receives an update record corresponding to the call translation record sent by the smart contract in response to a received update request, wherein the update request is a request sent by the first terminal, and the update request carries the modified call translation record and the first identifier; A second 5G message is sent to the second terminal, wherein the second 5G message carries the update record.

15. A method for translating voice calls, characterized in that, Applied to the second terminal, including: The system receives a first annotation instruction sent by a server. This instruction carries a first modification position corresponding to the adjusted second language text. The first annotation instruction instructs the second terminal to annotate the first modification position in a first preset format on a second call interface. The second call interface is the call interface between the second terminal and the first terminal. The second call interface includes the modified first language text and the adjusted second language text. The adjusted second language text is a language text translated from the modified first language text. The first language text is a language text corresponding to the call audio of the first terminal. The second language text is a language text obtained by translating the first language text. The first modification position is determined by the server based on a second modification position corresponding to the modified first language text. The second modification position is determined by the server based on trajectory data sent by the first terminal corresponding to the first modification operation on the first language text, and the modified first language text. In response to the first annotation instruction, the first modified position is annotated on the second call interface in the first preset form.

16. The method according to claim 15, characterized in that, Before the first annotation instruction sent by the receiving server, the following is also included: Receive and display the modified first language text and adjusted second language text sent by the server.

17. The method according to claim 15, characterized in that, After the first modified location is marked in the first preset form on the second call interface, the following is also included: The second annotation instruction sent by the server is received, wherein the second annotation instruction is used to instruct the second terminal to annotate the first modified position in the second call interface in a second preset form; In response to the second annotation instruction, the first modified position is annotated on the second call interface in the second preset form.

18. The method according to claim 17, characterized in that, After the first modified location is marked in the second preset format on the second call interface, the following is also included: Display prompt information, wherein the prompt information is used to prompt the second user to confirm the target information, wherein the second user is the user corresponding to the second terminal, and the target information is information marked in the second preset form; Receive confirmation of the prompt information.

19. The method according to claim 18, characterized in that, After receiving the confirmation operation for the prompt information, the method further includes: In response to a received operation on a third control of the second call interface, a third instruction is sent to the server, wherein the third instruction represents a request from the second terminal to send the call translation record between the first terminal and the second terminal to the blockchain.

20. The method according to claim 19, characterized in that, After sending the third instruction to the server, the method further includes: The server receives a first 5G message, wherein the first 5G message carries the call translation record, the call time corresponding to the call translation record, a first identifier corresponding to the first terminal, and a second identifier corresponding to the second terminal.

21. The method according to claim 20, characterized in that, After receiving the first 5G message sent by the server, the method further includes: The server receives a second 5G message, which carries an update record corresponding to the call translation record.

22. A call translation device, characterized in that, Applied to the first terminal, including: The first display module is used to display first language text and second language text on the first call interface, wherein the first call interface is the call interface between the first terminal and the second terminal on the first terminal, the first language text is the language text corresponding to the call audio of the first terminal, and the second language text is the language text obtained by translating the first language text. The first receiving module is used to receive a first modification operation on the first language text; A response module is configured to respond to the first modification operation by sending trajectory data corresponding to the first modification operation and modified first language text to the server, and displaying adjusted second language text. The adjusted second language text is a translation of the modified first language text. The trajectory data and the modified first language text trigger the server to determine a first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, and instruct the second terminal to mark the first modification position in a first preset format on a second call interface. The second call interface is the call interface between the second terminal and the first terminal on the second terminal. Determining the first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text includes: determining a second modification position corresponding to the modified first language text based on the trajectory data and the modified first language text; and determining a first modification position corresponding to the adjusted second language text based on the second modification position.

23. A call translation device, characterized in that, Applied to servers, including: The second receiving module is used to receive trajectory data and modified first language text sent by the first terminal corresponding to the first modification operation on the first language text, wherein the first language text is the language text corresponding to the call audio of the first terminal. The determining module is used to determine a first modification position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, wherein the second language text is a language text obtained by translating the first language text, and the adjusted second language text is a language text obtained by translating the modified first language text; The second sending module is used to send a first annotation instruction to the second terminal, wherein the first annotation instruction carries the first modified position, and the first annotation instruction is used to instruct the second terminal to annotate the first modified position in a first preset form on the second call interface, and the second call interface is the call interface between the second terminal and the first terminal on the second terminal; The determining module determines a first modified position corresponding to the adjusted second language text based on the trajectory data and the modified first language text, including: determining a second modified position corresponding to the modified first language text based on the trajectory data and the modified first language text; and determining a first modified position corresponding to the adjusted second language text based on the second modified position.

24. A call translation device, characterized in that, Applied to the second terminal, including: The third receiving module is used to receive a first annotation instruction sent by the server. The first annotation instruction carries a first modification position corresponding to the adjusted second language text. The first annotation instruction is used to instruct the second terminal to annotate the first modification position in a first preset form on the second call interface. The second call interface is the call interface between the second terminal and the first terminal on the second terminal. The second call interface includes the modified first language text and the adjusted second language text. The adjusted second language text is language text obtained by translating the modified first language text. The first language text is language text corresponding to the call audio of the first terminal. The second language text is language text obtained by translating the first language text. The first modification position is determined by the server based on the second modification position corresponding to the modified first language text. The second modification position is determined by the server based on the trajectory data corresponding to the first modification operation on the first language text sent by the first terminal and the modified first language text. The annotation module is used to respond to the first annotation instruction and annotate the first modified position on the second call interface in the first preset form.

25. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the call translation method as described in any one of claims 1-21.

26. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the call translation method as described in any one of claims 1-21.

27. A computer program product, characterized in that, The computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program including program instructions that, when executed by a computer, cause the computer to perform the steps of the call translation method as described in any one of claims 1-21.

Citation Information

Patent Citations

  • Communication control method, device, computer device, and computer readable storage medium

    CN107783966A

  • Simultaneous interpretation method and mobile terminal

    CN108009159A