Call translation method, device and system

Abstract

The invention is suitable for the technical field of translation, and provides a call translation method, device and system. The call translation method comprises the following steps: receiving call audio received by a mobile terminal in real time; playing the call audio and recording the call audio to obtain a recording file; sending the sound recording file to the mobile terminal, so that the mobile terminal obtains corresponding translation information according to the sound recording file; and receiving translation information sent by the mobile terminal, and presenting the translation information. According to the embodiment of the invention, call translation can be realized only through the mobile terminal and the earphone device, a translation device is not needed, the operation is simple, and the user experience is improved.

Description

Technical Field

[0001] The present application belongs to the field of translation technology, and in particular, relates to a call translation method, device and system. Background Art

[0002] As globalization continues to deepen, the need for cross-language communication is becoming increasingly urgent. Traditional manual simultaneous interpretation services are expensive and cannot meet the need for translation anytime and anywhere. Based on this, various translation devices have emerged.

[0003] In the related art, when translation is needed during a call, the hands-free mode of the calling device needs to be turned on so that the translation device can receive the sound signal played by the calling device and translate it. The operation process is very cumbersome and the translation effect is poor. Summary of the invention

[0004] The embodiments of the present application provide a call translation method, device and system, which can solve the problems of cumbersome operation and poor translation effect in call translation in related technologies.

[0005] In a first aspect, an embodiment of the present application provides a call translation method, which is applied to a headset device in a call translation system. The call translation system also includes a mobile terminal, and the mobile terminal is connected to the headset device via Bluetooth. The method includes:

[0006] Receive call audio received by the mobile terminal in real time;

[0007] Play the call audio and record the call audio to obtain the recording file;

[0008] Sending the recording file to the mobile terminal so that the mobile terminal obtains corresponding translation information according to the recording file;

[0009] The translation information sent by the mobile terminal is received, and the translation information is presented.

[0010] In a second aspect, an embodiment of the present application provides a call translation device, which is applied to a headset device in a call translation system. The call translation system also includes a mobile terminal, and the mobile terminal is connected to the headset device via Bluetooth. The device includes:

[0011] A receiving module, used to receive the call audio received by the mobile terminal in real time;

[0012] The recording module is used to play and record the call audio to obtain a recording file;

[0013] A sending module, used to send the recording file to the mobile terminal, so that the mobile terminal obtains corresponding translation information according to the recording file;

[0014] The presentation module is used to receive the translation information sent by the mobile terminal and present the translation information.

[0015] In a third aspect, an embodiment of the present application provides a call translation system, including a headset device and a mobile terminal, wherein the mobile terminal is connected to the headset device via Bluetooth;

[0016] The earphone device is used to receive the call audio received by the mobile terminal in real time;

[0017] The headset device is also used to play the call audio and record the call audio to obtain a recording file;

[0018] The headset device is also used to send the recording file to the mobile terminal;

[0019] The mobile terminal is used to obtain corresponding translation information according to the recording file;

[0020] The headset device is also used to receive the translation information sent by the mobile terminal and present the translation information.

[0021] In a fourth aspect, an embodiment of the present application provides a headset device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned call translation method when executing the computer program.

[0022] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of the above-mentioned call translation method are implemented.

[0023] In a sixth aspect, an embodiment of the present application provides a computer program product, which, when executed on a headset device, enables the headset device to execute the above-mentioned call translation method.

[0024] Compared with the prior art, the embodiments of the present application have the following beneficial effects: the embodiments of the present application play the call audio and record the call audio by receiving the call audio received in real time by the mobile terminal, obtain the recording file, and then send the recording file to the mobile terminal, so that the mobile terminal obtains the corresponding translation information according to the recording file, receives the translation information sent by the mobile terminal, and presents the translation information. The embodiments of the present application only require the mobile terminal and the earphone device to realize the call translation, and do not require the translation device, which is simple to operate and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0026] Figure 1 It is a schematic diagram of the implementation flow of a call translation method provided in an embodiment of the present application;

[0027] Figure 2 It is a structural diagram of a call translation system provided in an embodiment of the present application;

[0028] Figure 3 It is a structural diagram of a conversation translation device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work are protected by the present application.

[0030] It should be noted that the terms "include", "comprises" and "have" and any variations thereof in the specification and claims of the present application and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, terminal, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices. In the claims, specification and drawings of the present application, relational terms such as "first" and "second" are merely used to distinguish one entity / operation / object from another entity / operation / object, and do not necessarily require or imply any such real-time relationship or order between these entities / operations / objects.

[0031] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0032] As globalization continues to deepen, the need for cross-language communication is becoming increasingly urgent. Traditional manual simultaneous interpretation services are expensive and cannot meet the need for translation anytime and anywhere. Based on this, various translation devices have emerged.

[0033] In the related art, when translation is needed during a call, the hands-free mode of the calling device needs to be turned on so that the translation device can receive the sound signal played by the calling device and translate it. The operation process is very cumbersome and the translation effect is poor.

[0034] In view of this, the embodiment of the present application only requires a mobile terminal and a headset device to achieve call translation, without the need for a translation device, which is simple to operate and improves the user experience.

[0035] In order to illustrate the technical solution of the present application, a specific embodiment is provided below for illustration.

[0036] refer to Figure 1 and Figure 2 , Figure 1 A schematic diagram of an implementation flow of a call translation method provided in an embodiment of the present application is shown. Figure 2 A structural schematic diagram of a call translation system 2 provided in an embodiment of the present application is shown. The method can be applied to the earphone device 201 in the call translation system 2. The call translation system 2 may also include a mobile terminal 202, which is connected to the earphone device 201 via Bluetooth. The earphone device 201 is a wearable device with audio receiving, playing and recording functions, which has functions such as data processing and Bluetooth connection. The mobile terminal 202 may be a portable device such as a smart phone or a tablet computer, which has functions such as data processing, network communication and Bluetooth connection. Specifically, the above-mentioned call translation method may include the following steps S101 to S104.

[0037] Step S101, receiving the call audio received by the mobile terminal 202 in real time.

[0038] Among them, call audio refers to the sound signal generated during a call, including the sound of the user speaking and the other party speaking.

[0039] In the embodiment of the present application, when the user makes a call through the mobile terminal 202, the mobile terminal 202 can first receive the corresponding call audio, and transmit the call audio to the earphone device 201 in real time via Bluetooth. The earphone device 201 can then receive the call audio in real time.

[0040] Step S102, play the call audio and record the call audio to obtain a recording file.

[0041] In the implementation mode of the present application, after receiving the call audio, the earphone device 201 can immediately play the call audio through its built-in speaker to ensure that the user can normally hear the call content. At the same time, the earphone device 201 can start the recording function to record the call audio as a digital file for storage.

[0042] It is understandable that the headset device 201 in the embodiment of the present application integrates a recording function, and can automatically start the recording function after receiving the call audio, or start the recording function according to the user's instructions. Specifically, when the call audio is received, and a start recording instruction sent by the user through the mobile terminal 202 is received, or a start recording instruction directly issued by the user on the headset device 201 is received, the headset device 201 can start recording, and after receiving the end recording instruction, the recording is stopped and the recording file is obtained.

[0043] It should be understood that a typical application scenario of the embodiment of the present application is to provide a call translation function for iOS devices. Generally speaking, iOS devices cannot record independently, so for iOS devices, they cannot record by themselves to obtain a recording file, and then play the recording file for translation. Based on this, for iOS devices, the embodiment of the present application uses the earphone device 201 to record, which solves the problem that iOS devices cannot record during calls, so that the call audio can be translated later.

[0044] Step S103, sending the recording file to the mobile terminal 202, so that the mobile terminal 202 obtains corresponding translation information according to the recording file.

[0045] The translation information is the translation result of the call audio.

[0046] In the implementation manner of the present application, after recording is completed, the headset device 201 can send the recording file to the mobile terminal 202 via Bluetooth. After receiving the recording file, the mobile terminal 202 can translate the recording file by itself or other devices, servers, etc. to obtain corresponding translation information.

[0047] Step S104, receiving the translation information sent by the mobile terminal 202, and presenting the translation information.

[0048] In an embodiment of the present application, the earphone device 201 can receive translation information from the mobile terminal 202 via Bluetooth. After receiving the translation information, the earphone device 201 can play the translated voice content through its built-in speaker, or display the translated text content through the display screen of the earphone device 201 (e.g., the display screen on the earphone compartment).

[0049] Compared with the prior art, the embodiment of the present application has the following beneficial effects: the embodiment of the present application plays the call audio and records the call audio by receiving the call audio received in real time by the mobile terminal 202 to obtain a recording file, and then sends the recording file to the mobile terminal 202, so that the mobile terminal 202 obtains the corresponding translation information according to the recording file, receives the translation information sent by the mobile terminal 202, and presents the translation information. The embodiment of the present application only requires the mobile terminal 202 and the headset device 201 to realize call translation, and does not require a translation device, which is simple to operate and improves the user experience.

[0050] In some implementations of the present application, the sending of the recording file to the mobile terminal 202 so that the mobile terminal 202 obtains corresponding translation information according to the recording file may specifically include step S401 and step S402.

[0051] Step S401 : the headphone device 201 sends the recording file to the mobile terminal 202 .

[0052] In an embodiment of the present application, the earphone device 201 can automatically or according to a user instruction send the recording file to the paired mobile terminal 202 via a Bluetooth connection.

[0053] After obtaining the recording file, the headphone device 201 can send the recording file to the mobile terminal 202 immediately to quickly obtain the translation result, thereby improving the timeliness of the translation.

[0054] Step S402: the mobile terminal 202 translates the recording file to obtain corresponding translation information.

[0055] In the implementation manner of the present application, after receiving the recording file, the mobile terminal 202 can directly translate the recording file using a built-in translation engine to obtain corresponding translation information.

[0056] The implementation method of the present application directly utilizes the mobile terminal 202 for translation, and does not need to introduce other devices or servers, which can reduce the operation process and thus improve the translation speed.

[0057] Specifically, the mobile terminal 202 may first decode the recording file to restore the original audio data, and then convert the audio data into text information using a built-in speech recognition engine.

[0058] In other embodiments of the present application, the call translation system 2 further includes a cloud server 203, which sends the recording file to the mobile terminal 202 so that the mobile terminal 202 obtains corresponding translation information according to the recording file, and specifically may further include steps S501 to S503.

[0059] The cloud server 203 is a remote server located on the Internet, which has powerful computing power and storage resources, and is equipped with a powerful translation engine capable of processing large amounts of data and complex tasks. In this call translation system 2, the cloud server 203 can be responsible for executing the translation processing of the recording file.

[0060] Step S501 : the headphone device 201 sends the recording file to the mobile terminal 202 .

[0061] In an embodiment of the present application, the earphone device 201 can automatically or according to a user instruction send the recording file to the paired mobile terminal 202 via a Bluetooth connection.

[0062] Step S502 , the mobile terminal 202 sends the recording file to the cloud server 203 .

[0063] In an embodiment of the present application, after the mobile terminal 202 receives the recording file, it can upload the file to the cloud server 203 through its network connection (such as Wi-Fi, 4G / 5G, etc.).

[0064] In step S503 , the cloud server 203 translates the recording file, obtains corresponding translation information, and sends the translation information to the mobile terminal 202 .

[0065] In the implementation mode of the present application, after receiving the recording file, the cloud server 203 first uses the speech recognition model to perform speech recognition on the file to obtain the recognized text. Then, the recognized text is translated using the translation model to obtain the translated text. Finally, the translated text (or the translated speech obtained by further performing speech synthesis) is sent back to the mobile terminal 202.

[0066] The present application embodiment utilizes the powerful computing power of the cloud server 203 for translation processing, which can reduce the burden on the mobile terminal 202 and improve the translation speed and accuracy. At the same time, the cloud server 203 can also continuously update and optimize the translation model to provide better translation services.

[0067] In some specific implementations of the present application, the above-mentioned translation of the recording file may include step S601 and step S602.

[0068] Step S601, using a speech recognition model to perform speech recognition on the recording file to obtain a corresponding recognition text.

[0069] Among them, the speech recognition model is a model based on machine learning or deep learning technology, which can recognize and convert human speech into text.

[0070] In an embodiment of the present application, the mobile terminal 202 or the cloud server 203 can use a trained speech recognition model (such as an ASR recognition model) to recognize the recording file and convert the audio signal into text information for subsequent translation.

[0071] Step S602: Use the translation model to translate the recognized text to obtain a corresponding translated text.

[0072] The translation model is a model used to convert text in one language into text in another language. It is trained based on a large number of bilingual corpora and can generate high-quality translation results.

[0073] In an embodiment of the present application, the mobile terminal 202 or the cloud server 203 can input the recognized text into a trained translation model, and the translation model will convert the recognized text into text in the target language.

[0074] In some more specific implementations of the present application, after translating the recognized text using the translation model to obtain the corresponding translated text, the following steps may also be included:

[0075] Perform speech synthesis on the translated text to obtain the translated speech.

[0076] In an embodiment of the present application, after obtaining the translated text, if the translation result in voice form is required (such as the user wants to hear the translated voice), the mobile terminal 202 or the cloud server 203 can use a trained speech synthesis model (such as a TTS speech synthesis model) to convert the text into speech.

[0077] It should be understood that the mobile terminal 202 can install a specific translation application, and the translation application can have a built-in translation model, but the mobile terminal 202 usually only has built-in translation models for common languages, such as Chinese-English translation models, Chinese-Japanese translation models, Chinese-Korean translation models, etc. For relatively niche languages, such as Polish, Greek, Cambodian, etc., the mobile terminal 202 usually does not have a built-in corresponding translation model. If the user needs to translate the call audio corresponding to these languages, it cannot be simply translated through the mobile terminal 202.

[0078] Based on this, in some more specific implementations of the present application, the sending of the recording file to the mobile terminal 202 so that the mobile terminal 202 obtains the corresponding translation information according to the recording file may specifically include steps S701 to S705.

[0079] Step S701 : the headphone device 201 sends the recording file to the mobile terminal 202 .

[0080] In an embodiment of the present application, the earphone device 201 can automatically or according to a user instruction send the recording file to the paired mobile terminal 202 via a Bluetooth connection.

[0081] Step S702: the mobile terminal 202 performs language analysis on the recording file to determine the language to be translated corresponding to the recording file.

[0082] In the implementation manner of the present application, after receiving the recording file, the mobile terminal 202 can use the built-in language analysis algorithm or module to perform language analysis on the audio content to determine the language type (ie, the language to be translated).

[0083] In step S703, the mobile terminal 202 determines whether it has a built-in translation model corresponding to the language to be translated.

[0084] In the implementation manner of the present application, according to the result of the language analysis, the mobile terminal 202 may query its internal storage or pre-installed application to determine whether a translation model for the corresponding language pair has been built-in.

[0085] In step S704, if it is determined that the mobile terminal 202 does not have a built-in translation model corresponding to the language to be translated, the mobile terminal 202 sends the recording file to the cloud server 203 and determines a first translation path for the call audio.

[0086] Among them, the first translation path is that the earphone device 201 sends the recording file to the mobile terminal 202, the mobile terminal 202 sends the recording file to the cloud server 203, the cloud server 203 translates the recording file, obtains translation information and sends the translation information to the mobile terminal 202.

[0087] In an embodiment of the present application, if the mobile terminal 202 does not have the required translation model built in, the mobile terminal 202 can send the recording file to the cloud server 203 through a network connection (such as Wi-Fi, 4G / 5G), and the cloud server 203 will perform the translation.

[0088] In step S705, the headset device 201, the mobile terminal 202 and the cloud server 203 translate the call audio received in real time according to the first translation path.

[0089] In an embodiment of the present application, after determining the first translation path of the call audio, during the entire call process, the earphone device 201 will continue to capture the audio and send it to the mobile terminal 202. The mobile terminal 202 will send the file that needs cloud translation to the cloud server 203 according to the setting of the translation path (first translation path), and after receiving the translation result, it will play it to the user through the earphone device 201 or display the translation result to the user.

[0090] The implementation method of the present application determines the device or server that supports translation before translation. When it is determined that the mobile terminal 202 does not support translation of the call audio, the translation path is determined to be translated through the cloud server 203, and the powerful translation capability of the cloud server 203 is used to ensure the translation effect of the call audio. With the support of the cloud server 203, more language pairs can be covered to meet the diverse translation needs of users.

[0091] In some other specific implementations of the present application, after the mobile terminal 202 determines whether it has a built-in translation model corresponding to the language to be translated, step S801 and step S802 may also be included.

[0092] Step S801: If it is determined that the mobile terminal 202 has a built-in translation model corresponding to the language to be translated, the mobile terminal 202 determines a second translation path for the call audio.

[0093] The second translation path is that the headphone device 201 sends the recording file to the mobile terminal 202, and the mobile terminal 202 translates the recording file to obtain translation information.

[0094] In the implementation of the present application, if the mobile terminal 202 has a built-in translation model corresponding to the required language, the translation operation can be performed directly on the mobile terminal 202 without relying on the cloud server 203. At this time, the mobile terminal 202 can use the built-in translation model to translate the recording file, obtain the translated text or voice, and play it to the user in real time through the earphone device 201 or display the translation result to the user.

[0095] Step S802: the earphone device 201 and the mobile terminal 202 translate the call audio received in real time according to the second translation path.

[0096] In an implementation manner of the present application, after determining the second translation path of the call audio, during the entire call process, the earphone device 201 will continue to capture the audio and send it to the mobile terminal 202. The mobile terminal 202 will directly translate the recording file, and after obtaining the translation result, it will be played to the user through the earphone device 201 or the translation result will be displayed to the user.

[0097] The implementation manner of the present application first determines the device or server that supports translation before translation. When it is determined that the mobile terminal 202 supports translation of the call audio, the mobile terminal 202 is directly used to translate the call audio, which can reasonably reduce the translation process and significantly shorten the translation time, thereby improving the user experience.

[0098] In some embodiments of the present application, the translation information includes a translation text, the headphone device 201 includes a headphone compartment, and the headphone compartment is provided with a display screen. The presentation of the translation information may specifically include step S901 and / or step S902.

[0099] Step S901, displaying the translated text on a display screen.

[0100] In the implementation mode of the present application, when the earphone device 201 receives the translated text sent from the mobile terminal 202, the display content can be updated on the display screen of the earphone compartment to display the translated text. The user can quickly understand the intention of the other party by viewing the translated text on the display screen. The user can obtain the translated content without relying on hearing, which is particularly suitable for use in noisy environments.

[0101] And / or, step S902, playing the translated voice.

[0102] In the implementation mode of the present application, in addition to displaying the translated text on the display screen, the earphone device 201 can also choose to play the translated voice through the speaker of the earphone device 201. The user can directly listen to the translated voice content by wearing the earphone. During the call, playing the translated voice through the earphone can enhance the user's immersion and make the communication smoother and more natural.

[0103] In some implementations of the present application, after receiving the translation information sent by the mobile terminal 202 and presenting the translation information, the following steps may also be included:

[0104] Store audio files and translation information.

[0105] In the implementation of the present application, the headset device 201 can store recording files, translation information, etc. in its own memory so that the user can retrieve the corresponding information. In particular, for users whose mobile terminal 202 is an iOS device, recording files can be stored, which improves the user experience.

[0106] Figure 3 The structure diagram of a call translation device provided by an embodiment of the present application is shown. The call translation device 3 can be applied to the earphone device 201 in the call translation system 2. The call translation system 2 also includes a mobile terminal 202. The mobile terminal 202 is connected to the earphone device 201 via Bluetooth. Specifically, the call translation device 3 can include:

[0107] The receiving module 301 is used to receive the call audio received by the mobile terminal 202 in real time;

[0108] The recording module 302 is used to play the call audio and record the call audio to obtain a recording file;

[0109] The sending module 303 is used to send the recording file to the mobile terminal 202, so that the mobile terminal 202 obtains the corresponding translation information according to the recording file;

[0110] The presentation module 304 is configured to receive the translation information sent by the mobile terminal 202 and present the translation information.

[0111] Compared with the prior art, the embodiment of the present application has the following beneficial effects: the embodiment of the present application plays the call audio and records the call audio by receiving the call audio received in real time by the mobile terminal 202 to obtain a recording file, and then sends the recording file to the mobile terminal 202, so that the mobile terminal 202 obtains the corresponding translation information according to the recording file, receives the translation information sent by the mobile terminal 202, and presents the translation information. The embodiment of the present application only requires the mobile terminal 202 and the headset device 201 to realize call translation, and does not require a translation device, which is simple to operate and improves the user experience.

[0112] In some implementations of the present application, the sending module 303 is further used for: the earphone device 201 sends the recording file to the mobile terminal 202; the mobile terminal 202 translates the recording file to obtain corresponding translation information.

[0113] In some embodiments of the present application, the call translation system 2 also includes a cloud server 203, and the above-mentioned sending module 303 is also used for: the earphone device 201 sends the recording file to the mobile terminal 202; the mobile terminal 202 sends the recording file to the cloud server 203; the cloud server 203 translates the recording file, obtains corresponding translation information, and sends the translation information to the mobile terminal 202.

[0114] In some implementations of the present application, the sending module 303 is further used to: perform speech recognition on the recording file using a speech recognition model to obtain a corresponding recognized text; and perform text translation on the recognized text using a translation model to obtain a corresponding translated text.

[0115] In some embodiments of the present application, the conversation translation device 3 further includes a synthesis module, which is used to perform speech synthesis on the translation text to obtain the translation speech.

[0116] In some embodiments of the present application, the sending module 303 is also used for: the earphone device 201 sends the recording file to the mobile terminal 202; the mobile terminal 202 performs language analysis on the recording file to determine the language to be translated corresponding to the recording file; the mobile terminal 202 determines whether it has a built-in translation model corresponding to the language to be translated; if it is determined that the mobile terminal 202 does not have a built-in translation model corresponding to the language to be translated, the mobile terminal 202 sends the recording file to the cloud server 203 and determines a first translation path for the call audio, the first translation path being that the earphone device 201 sends the recording file to the mobile terminal 202, the mobile terminal 202 sends the recording file to the cloud server 203, the cloud server 203 translates the recording file, obtains translation information and sends the translation information to the mobile terminal 202; the earphone device 201, the mobile terminal 202 and the cloud server 203 translate the call audio received in real time according to the first translation path.

[0117] In some embodiments of the present application, the sending module 303 is also used for: if it is determined that the mobile terminal 202 has a built-in translation model corresponding to the language to be translated, the mobile terminal 202 determines a second translation path for the call audio, and the second translation path is that the earphone device 201 sends the recording file to the mobile terminal 202, and the mobile terminal 202 translates the recording file to obtain translation information; the earphone device 201 and the mobile terminal 202 translate the call audio received in real time according to the second translation path.

[0118] In some embodiments of the present application, the translation information includes a translation text, the earphone device 201 includes an earphone compartment, and the earphone compartment is provided with a display screen. The above-mentioned presentation module 304 is also used to: display the translation text on the display screen; and / or, play the translation voice.

[0119] The embodiment of the present application provides an earphone device 201. The earphone device 201 may include: a processor, a memory, and a computer program stored in the memory and executable on the processor, such as a call translation program. When the processor executes the computer program, the steps in the above-mentioned call translation method embodiments are implemented, such as Figure 1 Alternatively, when the processor executes the computer program, the functions of each module / unit in the above-mentioned device embodiments are implemented, for example Figure 3 The receiving module 301, the recording module 302, the sending module 303, and the presenting module 304 are shown.

[0120] The computer program may be divided into one or more modules / units, one or more modules / units are stored in the memory and executed by the processor to complete the present application. One or more modules / units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the headphone device 201.

[0121] The headset device 201 may include, but is not limited to, a processor and a memory. Those skilled in the art will appreciate that the headset device 201 may include more or fewer components, or a combination of certain components, or different components, for example, the headset device 201 may also include an input / output device, a network access device, a bus, etc.

[0122] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0123] The memory may be an internal storage unit of the headset device 201, such as a hard disk or memory of the headset device 201. The memory may also be an external storage device of the headset device 201, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the headset device 201. Further, the memory may include both an internal storage unit of the headset device 201 and an external storage device. The memory is used to store computer programs and other programs and data required by the headset device 201. The memory may also be used to temporarily store data that has been output or is to be output.

[0124] It should be noted that, for the convenience and brevity of description, the structure of the earphone device 201 can also refer to the specific description of the structure in the method embodiment, which will not be repeated here.

[0125] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0126] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned call translation method can be implemented.

[0127] The embodiment of the present application provides a computer program product. When the computer program product runs on the headset device 201, the headset device 201 can implement the steps in the above-mentioned call translation method when executing.

[0128] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0129] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0130] In the embodiments provided in the present application, it should be understood that the disclosed device / mobile terminal and method can be implemented in other ways. For example, the device / mobile terminal embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0131] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0132] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0133] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0134] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for conversation translation, characterized in that: The headset device is applied to a call translation system, the call translation system further comprising a mobile terminal, the mobile terminal is connected to the headset device via Bluetooth, and the method comprises: Receiving the call audio received in real time by the mobile terminal; Play the call audio and record the call audio to obtain a recording file; Sending the recording file to the mobile terminal so that the mobile terminal obtains corresponding translation information according to the recording file; The translation information sent by the mobile terminal is received, and the translation information is presented.

2. The conversation translation method according to claim 1, characterized in that: The sending the recording file to the mobile terminal so that the mobile terminal obtains corresponding translation information according to the recording file includes: The headset device sends the recording file to the mobile terminal; The mobile terminal translates the recording file to obtain the corresponding translation information.

3. The conversation translation method according to claim 1, characterized in that: The call translation system further includes a cloud server, and the step of sending the recording file to the mobile terminal so that the mobile terminal obtains corresponding translation information according to the recording file includes: The headset device sends the recording file to the mobile terminal; The mobile terminal sends the recording file to the cloud server; The cloud server translates the recording file to obtain the corresponding translation information, and sends the translation information to the mobile terminal.

4. The conversation translation method according to claim 2 or 3, characterized in that: The translating of the recording file comprises: Performing speech recognition on the recording file using a speech recognition model to obtain corresponding recognition text; The recognized text is translated using a translation model to obtain a corresponding translated text.

5. The conversation translation method according to claim 4, characterized in that: After translating the recognized text using the translation model to obtain a corresponding translated text, the method further includes: Perform speech synthesis on the translation text to obtain translation speech.

6. The conversation translation method according to claim 3, characterized in that: The sending the recording file to the mobile terminal so that the mobile terminal obtains corresponding translation information according to the recording file includes: The headset device sends the recording file to the mobile terminal; The mobile terminal performs language analysis on the recording file to determine the language to be translated corresponding to the recording file; The mobile terminal determines whether it has a built-in translation model corresponding to the language to be translated; If it is determined that the mobile terminal does not have a built-in translation model corresponding to the language to be translated, the mobile terminal sends the recording file to the cloud server and determines a first translation path for the call audio, wherein the first translation path is that the earphone device sends the recording file to the mobile terminal, the mobile terminal sends the recording file to the cloud server, the cloud server translates the recording file, obtains the translation information, and sends the translation information to the mobile terminal; The headset device, the mobile terminal and the cloud server translate the call audio received in real time according to the first translation path.

7. The conversation translation method according to claim 6, characterized in that: After the mobile terminal determines whether it has a built-in translation model corresponding to the language to be translated, the method further includes: If it is determined that the mobile terminal has a built-in translation model corresponding to the language to be translated, the mobile terminal determines a second translation path for the call audio, where the second translation path is that the earphone device sends the recording file to the mobile terminal, and the mobile terminal translates the recording file to obtain the translation information; The earphone device and the mobile terminal translate the call audio received in real time according to the second translation path.

8. The conversation translation method according to claim 1, wherein: The translation information includes a translation text, the earphone device includes an earphone compartment, and the earphone compartment is provided with a display screen, and presenting the translation information includes: Displaying the translated text on the display screen; And / or, playing the translated voice.

9. A conversation translation device, characterized in that: A headset device used in a call translation system, wherein the call translation system further comprises a mobile terminal, wherein the mobile terminal is connected to the headset device via Bluetooth, and the device comprises: A receiving module, used to receive the call audio received by the mobile terminal in real time; A recording module, used to play the call audio and record the call audio to obtain a recording file; A sending module, used to send the recording file to the mobile terminal, so that the mobile terminal obtains corresponding translation information according to the recording file; The presentation module is used to receive the translation information sent by the mobile terminal and present the translation information.

10. A conversation translation system, characterized in that: It includes a headset device and a mobile terminal, wherein the mobile terminal is connected to the headset device via Bluetooth; The earphone device is used to receive the call audio received by the mobile terminal in real time; The earphone device is also used to play the call audio and record the call audio to obtain a recording file; The earphone device is also used to send the recording file to the mobile terminal; The mobile terminal is used to obtain corresponding translation information according to the recording file; The earphone device is further used to receive the translation information sent by the mobile terminal and present the translation information.

Images