Voice translation terminal, mobile terminal, translation system, translation method and device thereof
By setting only one trigger button on the voice translation terminal and using the server to automatically translate voice information, the problem of cumbersome operation steps in the prior art is solved, and the automatic translation of voice information between different languages and the improvement of user experience is achieved.
Patent Information
- Application Number
- CN201910173337.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-03-07
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2039-03-07
AI Technical Summary
When translating with existing voice translation terminals, users need to press two buttons first, and the operation steps are complicated.
The first voice information is automatically translated into the second voice information through the server. Only one trigger button is set on the voice translation terminal. The user only needs to trigger the key to collect voice information, realizing automatic translation of voice information.
It simplifies the user's operation steps, improves the user's user experience, and realizes automatic translation of voice information between different languages.
Smart Images

Figure CN109754781B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of speech recognition technology, and in particular to a speech translation terminal, a mobile terminal, a translation system, a translation method and a device thereof. Background Art
[0002] With the rapid development of the economy and the increasing frequency of international communication, users may have the need to use two or even multiple languages. At present, voice translation terminals are popular among users with language translation needs due to their powerful language translation functions. Using voice translation terminals for translation during the conversation can enable users who speak different languages to communicate without barriers.
[0003] In the related art, a voice translation terminal can realize the translation from a specified language (such as English) to a specified target language (such as Chinese). Therefore, the voice translation terminal has at least two buttons, one for determining the language spoken by the user and the other for triggering the collection of voice data. When the user uses the voice translation terminal for translation, the automatic translation from the language spoken by the user to another language can be realized.
[0004] However, when a user uses a voice translation terminal for translation, he needs to press two buttons in succession, and the operation steps are relatively cumbersome. Summary of the invention
[0005] The present application proposes a voice translation terminal, a mobile terminal, a translation system, a translation method and a device thereof, so as to realize automatic translation of a first voice message into a second voice message through a server, without setting a corresponding button on the voice translation terminal to determine the language of the first voice message. Therefore, when a user uses the voice translation terminal for translation, it only needs to trigger a unique trigger button to collect the first voice message, so as to realize automatic translation of the first voice message between different languages, which can simplify the user's operation steps and improve the user's experience.
[0006] The first embodiment of the present application provides a speech translation terminal, including:
[0007] Housing, controller, a trigger button, microphone set, speaker and communication components;
[0008] The housing forms a space for accommodating the controller, the microphone group, the speaker and the communication component;
[0009] The one trigger button is arranged on the housing and is electrically connected to the controller;
[0010] The microphone group is electrically connected to the controller and is used to collect the first voice information after the trigger button is triggered;
[0011] The speaker is electrically connected to the controller and is used to play the second voice information according to the control of the controller; wherein the second voice information is the voice information translated from the first voice information;
[0012] The controller is electrically connected to the communication component, and is used to control the communication component to send the first voice information to the mobile terminal, and control the communication component to receive the second voice information sent by the mobile terminal.
[0013] As a first possible implementation method of the first aspect of the present application, the voice translation terminal communicates with the mobile terminal through the communication component, and the mobile terminal communicates with the server. The voice translation terminal sends the first voice information to the mobile terminal through the communication component. After the first voice information is pre-processed by the mobile terminal, it is sent to the server through the mobile terminal, so that the server translates the first voice information according to the translation setting of the mobile terminal to obtain the second voice information. The second voice information is sent to the mobile terminal through the server, and the voice translation terminal receives the second voice information sent by the mobile terminal through the communication component.
[0014] As a second possible implementation manner of the embodiment of the first aspect of the present application, the microphone group includes two microphones, one of which is used to collect voice data input by the user, and the other is used to collect noise data;
[0015] The microphone group is used to subtract and amplify the voice data and the noise data to obtain the first voice information.
[0016] As a third possible implementation manner of the embodiment of the first aspect of the present application, the controller is used to:
[0017] receiving first voice information collected by the microphone group, and compressing and packetizing the first voice information;
[0018] Controlling the communication component to send the compressed and packetized first voice information to the mobile terminal, and controlling the communication component to receive the second voice information sent by the mobile terminal; wherein the compressed and packetized first voice information is pre-processed by the mobile terminal to obtain the pre-processed first voice information; the pre-processed first voice information is sent to the server through the mobile terminal, so that the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information, and the second voice information is sent to the mobile terminal through the server;
[0019] Packaging and decompressing the second voice information;
[0020] The loudspeaker is controlled to play the second voice information after the packetization and decompression processing.
[0021] As a fourth possible implementation manner of the embodiment of the first aspect of the present application, the communication component is a Bluetooth component.
[0022] The voice translation terminal of the embodiment of the present application collects the first voice information through the microphone group, and then sends the first voice information to the mobile terminal through the communication component, and receives the second voice information sent by the mobile terminal; wherein the first voice information is transmitted to the server through the mobile terminal, and the second voice information is obtained through the translation of the server, and the server sends the second voice information to the voice translation terminal through the mobile terminal, and finally, the voice translation terminal plays the second voice information through the speaker. In the present application, the user does not need to set the corresponding button on the voice translation terminal to determine the language of the first voice information, and only needs to trigger the unique trigger button to collect the first voice information, so as to realize the automatic translation of the first voice information between different languages, which can simplify the user's operation steps and improve the user's experience.
[0023] A second aspect of the present application provides a mobile terminal, including:
[0024] A housing, a mobile communication component, and a mobile controller; the mobile communication component is electrically connected to the mobile controller; the mobile communication component communicates with the voice translation terminal and the server;
[0025] The mobile communication component is used to receive the first voice information sent by the voice translation terminal, and send the first voice information pre-processed by the mobile processor to the server, so that the server translates the pre-processed first voice information according to the translation setting of the mobile processor to obtain the second voice information;
[0026] The mobile communication component is further used to receive the second voice information sent by the server, and send the second voice information to the voice translation terminal;
[0027] The mobile processor is used to pre-process the first voice information;
[0028] The mobile processor is further used to generate translation setting information, and send the translation setting information to the server through the mobile communication component, so that the server determines corresponding translation settings according to the translation setting information, and translates the preprocessed first voice information based on the translation setting to obtain second voice information.
[0029] As a first possible implementation method of the second aspect of the present application,
[0030] The mobile processor pre-processes the first voice information, wherein the mobile processor is specifically used to:
[0031] Performing an integrity check on the first voice information;
[0032] If the first voice information passes the integrity check, further decoding the first voice information;
[0033] If the first voice information fails the integrity check, the information is fed back to the voice translation terminal so that the voice translation terminal resends the first voice information.
[0034] As a second possible implementation manner of the second aspect of the present application, the translation setting information includes setting information for translation between the first language and the second language or setting information for translation from the first language to the second language.
[0035] The mobile terminal of the embodiment of the present application receives the first voice information sent by the voice translation terminal, pre-processes the first voice information, and then sends the pre-processed first voice information to the server, so that the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information. After the server translates the second voice information, the first voice information can be sent to the voice translation terminal through the mobile terminal. In the present application, the user does not need to set a corresponding button on the voice translation terminal to determine the language of the first voice information. It only needs to trigger a unique trigger button to collect the first voice information, and the automatic translation of the first voice information between different languages can be realized, which can simplify the user's operation steps and improve the user's experience.
[0036] The third aspect of the present application provides a translation system, including: a speech translation terminal, a mobile terminal and a server, wherein the speech translation terminal communicates with the mobile terminal, and the mobile terminal communicates with the server;
[0037] The speech translation terminal comprises:
[0038] A housing, a controller, a trigger button, a microphone group, a speaker and a communication component; the housing forms a space for accommodating the controller, the microphone group, the speaker and the communication component; the trigger button is arranged on the housing and is electrically connected to the controller; the microphone group is electrically connected to the controller and is used to collect first voice information after the trigger button is triggered; the speaker is electrically connected to the controller and is used to play second voice information according to the control of the controller; wherein the second voice information is the voice information translated from the first voice information; the controller is electrically connected to the communication component and is used to control the communication component to send the first voice information to the mobile terminal and control the communication component to receive the second voice information sent by the mobile terminal;
[0039] The mobile terminal comprises:
[0040] A housing, a mobile communication component, and a mobile processor; the mobile communication component is electrically connected to the mobile controller; the mobile communication component communicates with a voice translation terminal and a server; the mobile communication component is used to receive the first voice information sent by the voice translation terminal, and send the first voice information preprocessed by the mobile processor to the server, so that the server translates the preprocessed first voice information according to the translation setting of the mobile terminal to obtain the second voice information; the mobile communication component is also used to receive the second voice information sent by the server, and send the second voice information to the voice translation terminal; the mobile processor is used to preprocess the first voice information; the mobile processor is also used to generate translation setting information, and send the translation setting information to the server through the mobile communication component, so that the server determines the corresponding translation setting according to the translation setting information, and translates the preprocessed first voice information based on the translation setting to obtain the second voice information;
[0041] The server comprises:
[0042] A receiver is used to obtain the preprocessed first voice information from the mobile terminal; a processor is used to translate the preprocessed first voice information into the second voice information according to the translation setting of the mobile terminal; and a transmitter is used to send the second voice information to the mobile terminal.
[0043] As a first possible implementation manner of the embodiment of the third aspect of the present application, the microphone group includes two microphones, one of which is used to collect voice data input by the user, and the other is used to collect noise data;
[0044] The microphone group is used to subtract and amplify the voice data and the noise data to obtain the first voice information.
[0045] As a second possible implementation manner of the embodiment of the third aspect of the present application, the controller is used to:
[0046] receiving first voice information collected by the microphone group, and compressing and packetizing the first voice information;
[0047] Controlling the communication component to send the compressed and packetized first voice information to the mobile terminal, and controlling the communication component to receive the second voice information sent by the mobile terminal; wherein the compressed and packetized first voice information is pre-processed by the mobile terminal to obtain the pre-processed first voice information; the pre-processed first voice information is sent to the server through the mobile terminal, so that the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information, and the second voice information is sent to the mobile terminal through the server;
[0048] Packaging and decompressing the second voice information;
[0049] The loudspeaker is controlled to play the second voice information after the packetization and decompression processing.
[0050] As a third possible implementation manner of the embodiment of the third aspect of the present application, the communication component is a Bluetooth component.
[0051] As a fourth possible implementation manner of the embodiment of the third aspect of the present application, the mobile processor preprocesses the first voice information, and the mobile processor is specifically configured to:
[0052] Performing an integrity check on the first voice information;
[0053] If the first voice information passes the integrity check, further decoding the first voice information;
[0054] If the first voice information fails the integrity check, the information is fed back to the voice translation terminal so that the voice translation terminal resends the first voice information.
[0055] As a fifth possible implementation manner of the embodiment of the third aspect of the present application, the translation setting information includes setting information for translation between the first language and the second language or setting information for translation from the first language to the second language.
[0056] The translation system of the embodiment of the present application, when the trigger button is triggered, collects the first voice information through the voice translation terminal, and sends the collected first voice information to the mobile terminal, and then the mobile terminal pre-processes the first voice information, and sends the pre-processed first voice information to the server, and the server translates the pre-processed first voice information into the second voice information according to the translation setting of the mobile terminal, and then the server can send the second voice information to the voice translation terminal through the mobile terminal, and correspondingly, the voice translation terminal can play the second voice information through the speaker after receiving the second voice information. In the present application, the user does not need to set the corresponding button on the voice translation terminal to determine the language of the first voice information, and only needs to trigger the unique trigger button to collect the first voice information, so as to realize the automatic translation of the first voice information between different languages, which can simplify the user's operation steps and improve the user's experience.
[0057] A fourth aspect of the present application provides a translation method, which is applied to a speech translation terminal, wherein the speech translation terminal communicates with a mobile terminal, and the method includes:
[0058] collecting first voice information;
[0059] Sending the first voice information to the mobile terminal, and receiving the second voice information sent by the mobile terminal; wherein the second voice information is the voice information translated from the first voice information;
[0060] Play the second voice information.
[0061] As a first possible implementation method of the fourth aspect of the present application, the second voice information is obtained by the mobile terminal preprocessing the first voice information, sending the preprocessed first voice information to the server, and the server translating the preprocessed first voice information according to the translation setting of the mobile terminal.
[0062] As a second possible implementation manner of the fourth aspect of the present application, collecting the first voice information includes:
[0063] Collect voice data and noise data input by the user;
[0064] The voice data and the noise data are subtracted and amplified to obtain the first voice information.
[0065] As a third possible implementation manner of the fourth aspect of the present application, after collecting the first voice information, the method further includes:
[0066] compressing and packetizing the first voice information;
[0067] The sending the first voice information to the mobile terminal includes:
[0068] The compressed and packetized first voice information is sent to the mobile terminal so that the mobile terminal pre-processes the compressed and packetized first voice information, and the pre-processed first voice information is sent to the server, and the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information.
[0069] As a fourth possible implementation manner of the fourth aspect of the present application, the playing of the second voice information includes:
[0070] Packaging and decompressing the second voice information;
[0071] Play the second voice information after the packetization and decompression processing.
[0072] The translation method of the embodiment of the present application collects the first voice information through the voice translation terminal, then sends the first voice information to the mobile terminal, and receives the second voice information sent by the mobile terminal; wherein the first voice information is transmitted to the server through the mobile terminal, the second voice information is obtained after the server translates it, the server sends the second voice information to the voice translation terminal through the mobile terminal, and finally, the voice translation terminal plays the second voice information. Thus, the automatic translation of the first voice information between different languages can be realized.
[0073] A fifth aspect of the present application provides another translation method, which is applied to a mobile terminal, wherein the mobile terminal communicates with a speech translation terminal and a server, and the method includes:
[0074] Receiving a first voice message sent by the voice translation device;
[0075] Preprocessing the first voice information;
[0076] Sending the preprocessed first voice information to the server, so that the server translates the preprocessed first voice information to obtain second voice information according to the translation setting of the mobile processor;
[0077] receiving a second voice message sent by the server;
[0078] The second voice information is sent to the voice translation device.
[0079] As a first possible implementation method of the fifth aspect of the present application,
[0080] The preprocessing of the first voice information includes:
[0081] Performing an integrity check on the first voice information;
[0082] If the first voice information passes the integrity check, further decoding the first voice information;
[0083] If the first voice information fails the integrity check, the information is fed back to the voice translation terminal so that the voice translation terminal resends the first voice information.
[0084] As a second possible implementation manner of the fifth aspect of the present application, the translation setting information includes setting information for translation between the first language and the second language or setting information for translation from the first language to the second language.
[0085] The translation method of the embodiment of the present application receives the first voice information through the mobile terminal, pre-processes the first voice information, and then sends the pre-processed first voice information to the server, so that the server translates the first voice information into the second voice information according to the translation setting of the mobile terminal, and finally sends the second voice information to the mobile terminal. Correspondingly, after receiving the second voice information, the mobile terminal can send the second voice information to the voice translation device, so that the voice translation device plays the second voice information. In this way, the automatic translation of the first voice information between different languages can be realized.
[0086] A sixth aspect of the present application provides a translation device, including:
[0087] A collection module, used for collecting first voice information;
[0088] A sending module, used to send the first voice information to a mobile terminal, and receive the second voice information sent by the mobile terminal; wherein the second voice information is the voice information translated from the first voice information;
[0089] A playing module is used to play the second voice information.
[0090] As a first possible implementation method of the sixth aspect of the present application, the second voice information is obtained by the mobile terminal preprocessing the first voice information, sending the preprocessed first voice information to the server, and the server translating the preprocessed first voice information according to the translation setting of the mobile terminal.
[0091] As a second possible implementation manner of the sixth aspect of the present application, the acquisition module is specifically used to:
[0092] Collect voice data and noise data input by the user;
[0093] The voice data and the noise data are subtracted and amplified to obtain the first voice information.
[0094] As a third possible implementation manner of the embodiment of the sixth aspect of the present application, the device further includes:
[0095] A processing module, used for compressing and packetizing the first voice information after collecting the first voice information;
[0096] The sending module is specifically used for:
[0097] The compressed and packetized first voice information is sent to the mobile terminal so that the mobile terminal pre-processes the compressed and packetized first voice information, and the pre-processed first voice information is sent to the server, and the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information.
[0098] As a fourth possible implementation manner of the sixth aspect of the present application, the playback module is specifically configured to:
[0099] Packaging and decompressing the second voice information;
[0100] Play the second voice information after the packetization and decompression processing.
[0101] The translation device of the embodiment of the present application collects the first voice information through the voice translation terminal, then sends the first voice information to the mobile terminal, and receives the second voice information sent by the mobile terminal; wherein the first voice information is transmitted to the server through the mobile terminal, the second voice information is obtained through the translation of the server, the server sends the second voice information to the voice translation terminal through the mobile terminal, and finally, the voice translation terminal plays the second voice information. Thus, the automatic translation of the first voice information between different languages can be realized.
[0102] The seventh aspect of the present application provides another translation device, including:
[0103] A receiving module, used for receiving the first voice information sent by the voice translation device;
[0104] A preprocessing module, used for preprocessing the first voice information;
[0105] A sending module, used for sending the pre-processed first voice information to the server, so that the server translates the pre-processed first voice information to obtain the second voice information according to the translation setting of the mobile processor;
[0106] The receiving module is further used to receive the second voice information sent by the server;
[0107] The sending module is further used to send the second voice information to the voice translation device.
[0108] As a first possible implementation method of the seventh aspect of the present application,
[0109] The preprocessing module is specifically used for:
[0110] Performing an integrity check on the first voice information;
[0111] If the first voice information passes the integrity check, further decoding the first voice information;
[0112] If the first voice information fails the integrity check, the information is fed back to the voice translation terminal so that the voice translation terminal resends the first voice information.
[0113] As a second possible implementation manner of the seventh aspect of the present application, the translation setting information includes setting information for translation between the first language and the second language or setting information for translation from the first language to the second language.
[0114] The translation device of the embodiment of the present application receives the first voice information through the mobile terminal, pre-processes the first voice information, and then sends the pre-processed first voice information to the server, so that the server translates the first voice information into the second voice information according to the translation setting of the mobile terminal, and finally sends the second voice information to the mobile terminal. Correspondingly, after receiving the second voice information, the mobile terminal sends the second voice information to the voice translation device, so that the voice translation device plays the second voice information. In this way, the automatic translation of the first voice information between different languages can be realized.
[0115] The eighth aspect embodiment of the present application proposes another voice translation terminal, which is characterized in that it includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the program, it implements the translation method described in the fourth aspect embodiment of the present application.
[0116] The ninth aspect embodiment of the present application proposes another mobile terminal, characterized in that it includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the program, it implements the translation method described in the fifth aspect embodiment of the present application.
[0117] The tenth aspect embodiment of the present application proposes a computer-readable storage medium on which a computer program is stored, characterized in that when the program is executed by a processor, it implements the translation method proposed in the fourth aspect embodiment of the present application, or implements the translation method described in the fifth aspect embodiment of the present application.
[0118] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0119] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0120] Figure 1 This is a schematic diagram of the structure of the voice translation terminal provided in Example 1 of the present application;
[0121] Figure 2 A schematic diagram of the product shape of the voice translation terminal provided in the second embodiment of the present application;
[0122] Figure 3 This is a schematic diagram of the structure of the voice translation terminal provided in Embodiment 3 of the present application;
[0123] Figure 4 A schematic diagram of the translation process provided in Example 4 of the present application;
[0124] Figure 5 A schematic diagram of the structure of a mobile terminal provided in Embodiment 5 of the present application;
[0125] Figure 6 A schematic diagram of the structure of the translation system provided in Example 6 of the present application;
[0126] Figure 7 A flowchart of the translation method provided in Example 7 of the present application;
[0127] Figure 8 A flowchart of the translation method provided in Example 8 of the present application;
[0128] Fig. 9 A schematic diagram of the structure of a translation device provided in Embodiment 9 of the present application;
[0129] Fig.10 A schematic diagram of the structure of a translation device provided in Embodiment 10 of the present application;
[0130] Fig.11 This is a schematic diagram of the structure of the translation device provided in Example 11 of the present application. DETAILED DESCRIPTION
[0131] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.
[0132] The following describes a speech translation terminal, a mobile terminal, a translation system, a translation method and an apparatus thereof according to embodiments of the present application with reference to the accompanying drawings.
[0133] Figure 1 This is a schematic diagram of the structure of the voice translation terminal provided in Example 1 of the present application.
[0134] like Figure 1 As shown, the voice translation terminal 100 may include: a housing (not shown in the figure), a controller 110 , a trigger button 120 , a microphone group 130 , a speaker 140 and a communication component 150 .
[0135] The shell forms a space for accommodating the controller 110 , the microphone group 130 , the speaker 140 and the communication component 150 .
[0136] A trigger button 120 is disposed on the housing and is electrically connected to the controller 110 .
[0137] In the embodiment of the present application, only one trigger button 120 is provided on the voice translation terminal 100, and the user can input voice data by triggering the trigger button 120. Accordingly, when the voice translation terminal 100 detects that the user triggers the trigger button 120 by monitoring, the first voice information can be collected through the speaker group 130.
[0138] As an example, see Figure 2 , Figure 2 The product shape diagram of the voice translation terminal provided in the second embodiment of the present application is shown in FIG. The front of the voice translation terminal 100 may include a trigger button 120 , and when the user triggers the trigger button 120 , the controller may control the microphone group 130 to collect the first voice information.
[0139] It should be noted that Figure 2 The appearance of the voice translation terminal 100 is only taken as a square example. In actual application, in order to improve the aesthetics of the appearance of the voice translation terminal 100, the designer can set the appearance of the voice translation terminal 100 according to his own needs, for example, it can be set to a circular, oval, etc., and there is no limitation to this.
[0140] The microphone group 130 is electrically connected to the controller 110 and is used to collect the first voice information after the trigger button 120 is triggered.
[0141] In an embodiment of the present application, the microphone group 130 is composed of at least two microphones. For example, when the microphone group 130 includes two microphones, one microphone can collect voice data input by the user, and the other microphone can collect noise data. For example, one microphone can be set on the front of the voice translation terminal 100, mainly used to collect voice data input by the user. It can be understood by those skilled in the art that in addition to the normal collection of the user's voice data, the microphone may also have a small part of environmental noise; the other microphone can be set on the back of the voice translation terminal 100, mainly used to collect noise data. It can be understood by those skilled in the art that the noise data may also contain a small part of the voice data input by the user. The microphone group 130 can subtract and amplify the voice data and the noise data to obtain the first voice information. Thus, the collected first voice information is the voice information obtained after the noise reduction process, which can improve the signal quality of the first voice information, so that when the second voice information is obtained by translation later, the accuracy of the translation result can be improved.
[0142] The speaker 140 is electrically connected to the controller 110 and is used to play the second voice information according to the control of the controller 110; wherein the second voice information is the voice information translated from the first voice information.
[0143] The controller 110 is electrically connected to the communication component 150 and is used to control the communication component 150 to send a first voice message to the mobile terminal and control the communication component 150 to receive a second voice message sent by the mobile terminal.
[0144] In the embodiments of the present application, the mobile terminal may be a mobile phone, a tablet computer, a personal digital assistant, a wearable device, or other hardware device having various operating systems, a touch screen, and / or a display screen.
[0145] In the embodiment of the present application, the communication component 150 may be, for example, a Bluetooth component, and the speech translation terminal 100 may communicate with the mobile terminal through the communication component 150 .
[0146] Specifically, the voice translation terminal 100 can communicate with the mobile terminal through the communication component 150, such as a Bluetooth component. After the voice translation terminal 100 collects the first voice information, the voice translation terminal 100 can send the first voice information to the mobile terminal through the Bluetooth Low Energy (BLE) protocol, and then send the first voice information to the server through the mobile terminal. When the server receives the first voice information, it can translate the first voice information to obtain the second voice information. After that, the server can send the second voice information to the mobile terminal, and the mobile terminal sends the second voice information to the voice translation terminal 100 based on the BLE protocol. Correspondingly, after receiving the second voice information, the voice translation terminal 100 can play the second voice information through the speaker 140.
[0147] For example, the voice translation terminal 100 can be connected to the mobile terminal in advance via Bluetooth, and start the translation application (Application, APP for short) in the mobile terminal, such as the Leopard Translation APP. After the voice translation terminal 100 collects the first voice information, the voice translation terminal 100 can send the first voice information to the mobile terminal through the BLE protocol, and the translation APP in the mobile terminal then sends the first voice information to the server through the network. When the server receives the first voice information, the first voice information can be translated to obtain the second voice information. After that, the server can send the second voice information to the mobile terminal through the network, and the translation APP in the mobile terminal then sends the second voice information to the voice translation terminal 100 based on the BLE protocol. Correspondingly, after receiving the second voice information, the voice translation terminal 100 can play the second voice information through the speaker 140.
[0148] In the embodiment of the present application, the server can translate the first voice information into the second voice information according to the translation setting of the mobile terminal, wherein the translation setting is determined according to the translation setting information input by the user.
[0149] Specifically, the user can set the translation setting information in the mobile terminal, for example, the user can set the above translation setting information in the translation APP of the mobile terminal. After the user sets the translation setting information, the mobile terminal can send the above translation setting information to the server, so that the server can determine the corresponding translation setting according to the translation setting information set by the user.
[0150] As a possible implementation, the translation setting information includes information on the setting of mutual translation between the first language and the second language. At this time, the translation setting includes the setting of mutual translation between the first language and the second language. The server can identify the language of the first voice information. If the language of the first voice information is the first language, the server can translate the first voice information in the first language into the second voice information in the second language. If the language of the first voice information is the second language, the server can translate the first voice information in the second language into the second voice information in the first language. Thus, the server automatically identifies the language spoken by the user, and automatically translates the language spoken by the user into the voice information corresponding to another language, so that there is no need to set a corresponding button on the voice translation device 100 to determine the language spoken by the user, which can simplify the user's operation and improve the user's experience.
[0151] Among them, the above translation settings can be Chinese-English translation, Chinese-French translation, English-German translation, etc. For example, if the translation is set to Chinese-English translation, the first language can be Chinese and the second language can be English, or the first language can be English and the second language can be Chinese.
[0152] As an example, take the translation setting as Chinese-English translation. When the user uses the voice translation terminal 100 for translation, if the user speaks English after pressing the trigger button 120, the voice translation terminal 100 will play Chinese after lifting the trigger button 120. If the user speaks Chinese after pressing the trigger button 120, the voice translation terminal 100 will play English after lifting the trigger button 110. In other words, no matter whether the user speaks Chinese or English, the voice translation terminal will translate it into another corresponding voice. Thus, automatic translation between the two languages can be achieved, which is convenient for users.
[0153] As another possible implementation, the translation setting information includes information about the setting of translating from the first language to the second language. In this case, the translation setting includes the setting of translating from the first language to the second language, and the server can translate the first voice information into the second voice information in the second language. The above translation setting can be Chinese to English, English to Chinese, Chinese to French, Chinese to German, etc. For example, if the translation setting is Chinese to English, the first language can be Chinese, and the second language can be English.
[0154] As an example, taking the translation setting as Chinese to English, when the user uses the voice translation terminal 100 for translation, if the user speaks English after pressing the trigger button 120, the voice translation terminal 100 will play Chinese after releasing the trigger button 120. In this way, the language spoken by the user can be automatically translated into another language, which is convenient for the user.
[0155] The speech translation terminal 100 of the embodiment of the present application collects the first voice information through the microphone group 130, and then sends the first voice information to the mobile terminal through the communication component 150, and receives the second voice information sent by the mobile terminal; wherein the first voice information is transmitted to the server through the mobile terminal, and the second voice information is obtained through the translation of the server, and the server sends the second voice information to the speech translation terminal through the mobile terminal, and finally, the speech translation terminal 100 plays the second voice information through the speaker 140. In the present application, the user does not need to set the corresponding button on the speech translation terminal to determine the language of the first voice information, and only needs to trigger the unique trigger button to collect the first voice information, so as to realize the automatic translation of the first voice information between different languages, which can simplify the user's operation steps and improve the user's experience.
[0156] It should be noted that when the server translates the first voice information into the second voice information according to the translation setting, it recognizes the first voice information as text information, and then translates it according to the text information and synthesizes it into the corresponding second voice information. Specifically, the server can recognize the first voice information to obtain the language of the first voice information, convert the first voice information into a text file according to the language corresponding to the first voice information, and then determine the target language according to the language corresponding to the first voice information and the translation mode, and translate the text file into a translation file of the target language, and finally, generate the translation file as the second voice information, for example, converting a file in text format into a voice information in voice format.
[0157] It is understandable that the phoneme arrangements between different languages are different, that is, the pronounced phonemes, phoneme strings, and the frequency of phoneme appearance and the contextual relationship are different. Based on the above characteristics, different languages can be distinguished.
[0158] As a possible implementation manner, a trained language recognition model may be set in the server, and the language to which the first voice information belongs may be recognized by the trained language recognition model.
[0159] As another possible implementation, multiple voice samples may be acquired in advance, and the language corresponding to each voice sample may be marked. After the server acquires the first voice information, the first voice information may be matched with the above voice samples, and voice samples with a matching degree higher than a preset threshold may be determined, and the language of the determined voice sample may be used as the language of the first voice information. The preset threshold is preset, for example, 95%.
[0160] In an embodiment of the present application, after the server recognizes the language of the first voice information, the first voice information can be converted into a text file based on the voice recognition technology in the relevant technology, and then the target language is determined according to the language and translation mode corresponding to the first voice information, and the text file is translated into a translation file of the target language. For example, when the language corresponding to the first voice information is the first language, the target language is the second language, and when the language corresponding to the first voice information is the second language, the target language is the first language. The server can translate the text file into a translation file of the target language based on the translation rules between the language corresponding to the first voice information and the target language in the relevant technology. Afterwards, the server can synthesize the translation file into the second voice information.
[0161] For example, when the target language is English, the server can convert the translation file from letters to phonemes (or syllables) to synthesize the second voice information. When the target language is Chinese, the server can convert the translation file from Chinese characters to phonemes (or pinyin) to synthesize the second voice information.
[0162] In the embodiment of the present application, the accuracy of the translation result can be improved by recognizing the first voice information as text information, and then translating the text information and synthesizing it into the corresponding second voice information.
[0163] As a possible implementation method, after receiving the first voice information, the mobile terminal can pre-process the first voice information, and then send the pre-processed first voice information to the server. Accordingly, when the server receives the pre-processed first voice information, it can translate the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information. Thereafter, the server can send the second voice information to the mobile terminal. Accordingly, after receiving the second voice information, the mobile terminal can send the second voice information to the voice translation device 100. Accordingly, the voice translation terminal 100 can receive the second voice information sent by the mobile terminal through the communication component 150.
[0164] It is understandable that the voice translation terminal 100 can generate a header, a tail, etc. of the file in the process of collecting voice and generating a voice file. The first voice information finally sent to the mobile terminal should be a complete voice file. Therefore, after receiving the first voice information, the mobile terminal can perform a file integrity check on the first voice information to determine whether the first voice information is a complete voice file. If not, it will be fed back to the voice translation terminal 100 so that the voice translation terminal 100 resends the first voice information. If yes, the first voice information is further decoded and sent to the server.
[0165] Specifically, the mobile terminal can decode the first voice information according to the format of the voice file supported by the server. For example, for the Microsoft server, the voice file format supported by it is the MP3 format, so the first voice information can be decoded into a voice file in the MP3 format, and then the decoded first voice information can be sent to the Microsoft server, so that the Microsoft server can translate the first voice information according to the format it supports to obtain the second voice information.
[0166] In the embodiment of the present application, by decoding the first voice information according to the format of the voice file supported by the server, it can be ensured that the server can achieve normal translation of the first voice information.
[0167] As a possible implementation, Figure 1 Based on the embodiment shown, the housing may include: a first housing and a second housing matched with each other, wherein:
[0168] The first housing is provided with a light emitting diode LED and a trigger button 120 .
[0169] The LED control module (or controller 110) can be used to control the LED to light up or turn off to prompt the user. For example, when the user presses the trigger button 120, the LED control module (or controller 110) can control the LED to light up to prompt the user, and when the user does not press the trigger button 120, the LED control module (or controller 110) can control the LED to turn off.
[0170] The second housing is provided with a speaker 140 , a charging slot, and a microphone group 130 .
[0171] A communication component 150 , a power module, and an access module are disposed between the first shell and the second shell.
[0172] In the embodiment of the present application, in order to improve the accuracy of subsequent translation results, the first voice information after noise reduction processing can be collected by the microphone group 130.
[0173] The controller 110 is used to receive the first voice information collected by the microphone group 130, and compress and packetize the first voice information.
[0174] In the embodiment of the present application, in order to ensure the signal quality of the first voice information and reduce network resource usage, thereby improving translation efficiency, after collecting the first voice information, the controller 110 can also compress and packetize the processed first voice information.
[0175] The communication component 150 is used to send the compressed and sub-packed first voice information to the mobile terminal. Accordingly, when the mobile terminal receives the compressed and sub-packed first voice information, it can pre-process the compressed and sub-packed first voice information to obtain the pre-processed first voice information. After that, the mobile terminal can send the compressed and sub-packed first voice information to the server through the network, so that the server can identify the pre-processed first voice information to obtain the language of the pre-processed first voice information, and translate the pre-processed first voice information according to the translation setting of the mobile terminal and the language of the pre-processed first voice information to obtain the second voice information. After the server translates and obtains the second voice information, it can send the second voice information to the mobile terminal through the network, and the mobile terminal sends the second voice information to the speech translation device 100. Accordingly, the speech translation device 100 can receive the second voice information sent by the mobile terminal through the communication component 150.
[0176] The controller 110 is further configured to obtain the second voice information sent by the server via the mobile terminal, and perform packetization and decompression processing on the second voice information.
[0177] The speaker 140 is used to play the second voice information after the packaging and decompression processing.
[0178] As an example, see Figure 3 When the user presses the trigger button, the LED control module can control the LED to light up. At the same time, the microphone group can collect the first voice information after denoising and enhancement processing, and then the access module can store the first voice information.
[0179] The controller can obtain the first voice information from the access module, and compress and sub-packetize the first voice information. Afterwards, the communication component can be controlled to send the compressed and sub-packetized first voice information to the mobile terminal, and the mobile terminal pre-processes the compressed and sub-packetized first voice information to obtain the pre-processed first voice information. Afterwards, the mobile terminal can send the pre-processed first voice information to the server.
[0180] After obtaining the pre-processed first voice information, the server can translate the pre-processed first voice information according to the translation setting of the mobile terminal and the language of the pre-processed first voice information to obtain the second voice information, and send the second voice information to the voice translation terminal through the mobile terminal. When the voice translation terminal receives the second voice information through the communication component, the controller can package and decompress the second voice information, and control the speaker to play the packaged and decompressed second voice information.
[0181] As an example, see Figure 4 , Figure 4 A schematic diagram of the translation process provided for the fourth embodiment of the present application. Among them, the user can press the trigger button on the voice translation terminal to collect the voice data input by the user. It should be noted that there is only one trigger button on the voice translation terminal. No matter what language the user speaks (the languages supported by the voice translation device only need to be set in the translation APP in the mobile terminal, that is, the user can set the language he speaks and the language of the final translation in the translation APP), this trigger button is pressed. When the user finishes speaking, the user can release the trigger button.
[0182] After the voice data is collected, in order to improve the accuracy of the subsequent translation results, the voice data can be subjected to noise reduction and enhancement processing to obtain the first voice information. In addition, in order to ensure the quality of the first voice information and reduce network resource usage, thereby improving translation efficiency, in this application, the voice translation terminal can compress and sub-packetize the first voice information. Then, the voice translation terminal can send the compressed and sub-packetized first voice information to the mobile terminal based on the customized BLE reliable transmission protocol, and the translation APP in the mobile terminal can perform front-end processing (pre-processing) of the compressed and sub-packetized first voice information, and then send the pre-processed first voice information to the server through the network.
[0183] After receiving the first voice message, the server can identify the language of the pre-processed first voice message according to the translation setting of the mobile terminal, and convert the pre-processed first voice message into a text file according to the voice recognition technology. After that, the text file can be translated into a translation file of the target language, and the translation file can be synthesized into the second voice message. After that, the server can send the second voice message to the mobile terminal through the network, and the translation APP in the mobile terminal can send the second voice message to the voice translation terminal based on the BLE protocol.
[0184] After receiving the second voice information, the voice translation terminal may package, decompress and distribute the second voice information, and then play the packaged and decompressed second voice information through a speaker.
[0185] In order to implement the above embodiments, the present application also proposes a mobile terminal.
[0186] Figure 5 This is a schematic diagram of the structure of the mobile terminal provided in Example 5 of the present application.
[0187] like Figure 5 As shown, the mobile terminal 300 includes: a housing (not shown in the figure), a mobile communication component 310, and a mobile controller 320.
[0188] The mobile communication component 310 is electrically connected to the mobile controller 320 ; the mobile communication component 310 communicates with the speech translation terminal 100 and the server.
[0189] The mobile communication component 310 is used to receive the first voice information sent by the voice translation terminal 100, and send the first voice information preprocessed by the mobile processor 320 to the server, so that the server translates the preprocessed first voice information according to the translation setting of the mobile processor 320 to obtain the second voice information.
[0190] The mobile communication component 310 is also used to receive the second voice information sent by the server and send the second voice information to the voice translation terminal 100; the mobile processor 320 is used to pre-process the first voice information; the mobile processor 320 is also used to generate translation setting information, and send the translation setting information to the server through the mobile communication component 310, so that the server determines the corresponding translation setting according to the translation setting information, and translates the pre-processed first voice information based on the translation setting to obtain the second voice information.
[0191] In the embodiment of the present application, the translation setting is determined according to the translation setting information input by the user. Specifically, the user can set the translation setting information in the mobile terminal, for example, the user can set the above translation setting information in the translation APP of the mobile terminal. After the user sets the translation setting information, the mobile terminal 300 can send the above translation setting information to the server, so that the server can determine the corresponding translation setting according to the translation setting information set by the user.
[0192] As a possible implementation, the translation setting information includes information on settings for translation between the first language and the second language. In this case, the translation setting includes settings for translation between the first language and the second language. The above translation setting may be Chinese-English translation, Chinese-French translation, English-German translation, etc. For example, if the translation setting is Chinese-English translation, the first language may be Chinese and the second language may be English, or the first language may be English and the second language may be Chinese.
[0193] In the embodiment of the present application, after the voice translation terminal 100 collects the first voice information, it can send the first voice information to the mobile terminal 300 through the communication component. Correspondingly, the mobile terminal 300 can receive the first voice information through the mobile communication component 310. After receiving the first voice information, the mobile terminal 300 can pre-process the first voice information through the mobile processor 320, and send the pre-processed first voice information to the server through the mobile communication component 310, so that the server can identify the language of the pre-processed first voice information. If the language of the pre-processed first voice information is the first language, the server can translate the pre-processed first voice information of the first language into the second voice information of the second language, and if the language of the pre-processed first voice information is the second language, the server can translate the pre-processed first voice information of the second language into the second voice information of the first language. Thus, the server automatically identifies the language spoken by the user, and automatically translates the language spoken by the user into the voice information corresponding to another language, so that there is no need to set a corresponding button on the voice translation device 100 to determine the language spoken by the user, which can simplify the user's operation and improve the user's experience.
[0194] As another possible implementation, the translation setting information includes information about settings for translating from a first language to a second language. In this case, the translation setting includes settings for translating from a first language to a second language. The above translation settings may be Chinese to English, English to Chinese, Chinese to French, Chinese to German, etc. For example, if the translation setting is Chinese to English, the first language may be Chinese, and the second language may be English.
[0195] In the embodiment of the present application, after receiving the first voice information, the mobile terminal 300 can pre-process the first voice information and send the pre-processed first voice information to the server, so that the server can translate the first voice information into second voice information in a second language.
[0196] The mobile terminal 300 of the embodiment of the present application receives the first voice information sent by the voice translation terminal, pre-processes the first voice information, and then sends the pre-processed first voice information to the server, so that the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information. After the server translates the second voice information, the first voice information can be sent to the voice translation terminal through the mobile terminal. In the present application, the user does not need to set a corresponding button on the voice translation terminal to determine the language of the first voice information. It only needs to trigger a unique trigger button to collect the first voice information, and the automatic translation of the first voice information between different languages can be realized, which can simplify the user's operation steps and improve the user's experience.
[0197] As a possible implementation method, when pre-processing the first voice information, the mobile processor 320 performs an integrity check on the first voice information and determines whether the first voice information passes the integrity check. If the first voice information fails the integrity check, it feeds back to the voice translation terminal so that the voice translation terminal resends the first voice information. If the first voice information passes the integrity check, the first voice information is further decoded.
[0198] It is understandable that the voice translation terminal 100 can generate a header, a tail, etc. of the file in the process of collecting voice and generating a voice file. The first voice information finally sent to the mobile terminal 300 should be a complete voice file. Therefore, after receiving the first voice information, the mobile terminal 300 can perform a file integrity check on the first voice information through the mobile processor 320 to determine whether the first voice information is a complete voice file. If not, the first voice information is fed back to the voice translation terminal 100 so that the voice translation terminal 100 resends the first voice information. If yes, the first voice information is further decoded and sent to the server.
[0199] Specifically, the mobile processor 320 can decode the first voice information according to the format of the voice file supported by the server. For example, for the Microsoft server, the voice file format supported by it is the MP3 format, so the first voice information can be decoded into a voice file in the MP3 format, and then the decoded first voice information can be sent to the Microsoft server, so that the Microsoft server can translate the first voice information according to the format it supports to obtain the second voice information.
[0200] In the embodiment of the present application, by decoding the first voice information according to the format of the voice file supported by the server, it can be ensured that the server can achieve normal translation of the first voice information.
[0201] In order to implement the above embodiment, the present application also proposes a translation system.
[0202] Figure 6 This is a structural diagram of the translation system provided in Example 6 of the present application.
[0203] like Figure 6 As shown, the translation system may include: a speech translation terminal 100, a server 200 and a mobile terminal 300. Among them,
[0204] The speech translation terminal 100 includes: a housing (not shown), a controller 110, a trigger button 120, a microphone group 130, a speaker 140 and a communication component 150.
[0205] The shell forms a space for accommodating the controller 110, the microphone group 130, the speaker 140 and the communication component 150; a trigger button 120 is set on the shell and is electrically connected to the controller 110; the microphone group 130 is electrically connected to the controller 110, and is used to collect the first voice information after the trigger button 120 is triggered; the speaker 140 is electrically connected to the controller 110, and is used to play the second voice information according to the control of the controller 110; wherein the second voice information is the voice information translated from the first voice information; the controller 110 is electrically connected to the communication component 150, and is used to control the communication component 150 to send the first voice information to the mobile terminal 300, and control the communication component 150 to receive the second voice information sent by the mobile terminal 300.
[0206] In the embodiment of the present application, only one trigger button 120 is provided on the voice translation terminal 100, and the user can input voice data by triggering the trigger button 120. As an example, see Figure 2 The front of the voice translation terminal 100 may include a trigger button 120, and the user may input voice data by triggering the trigger button 120. Accordingly, when the voice translation terminal 100 detects that the user triggers the trigger button 120 by monitoring, the first voice information may be collected through the speaker group 130.
[0207] In an embodiment of the present application, the microphone group 130 is composed of at least two microphones. For example, when the microphone group 130 includes two microphones, one microphone can collect voice data input by the user, and the other microphone can collect noise data. For example, one microphone can be set on the front of the voice translation terminal 100, mainly used to collect voice data input by the user. It can be understood by those skilled in the art that in addition to the normal collection of the user's voice data, the microphone may also have a small part of environmental noise; the other microphone can be set on the back of the voice translation terminal 100, mainly used to collect noise data. It can be understood by those skilled in the art that the noise data may also contain a small part of the voice data input by the user. The microphone group 130 can subtract and amplify the voice data and the noise data to obtain the first voice information. Thus, the collected first voice information is the voice information obtained after the noise reduction process, which can improve the signal quality of the first voice information, so that when the second voice information is obtained by translation later, the accuracy of the translation result can be improved. In the embodiment of the present application, the communication component 150 may be, for example, a Bluetooth component, and the speech translation terminal 100 may communicate with the mobile terminal through the communication component 150 .
[0208] The mobile terminal 300 includes: a housing (not shown in the figure), a mobile communication component 310, and a mobile processor 320.
[0209] The mobile communication component 310 is electrically connected to the mobile controller 320; the mobile communication component 310 communicates with the speech translation terminal 100 and the server 200; the mobile communication component 310 is used to receive the first voice information sent by the speech translation terminal 100, and send the first voice information pre-processed by the mobile processor 320 to the server 200, so that the server 200 translates the pre-processed first voice information according to the translation setting of the mobile terminal 300 to obtain the second voice information; the mobile communication component 310 is also used to receive the second voice information sent by the server 200, and send the second voice information to the speech translation terminal 100; the mobile processor 320 is used to pre-process the first voice information; the mobile processor 320 is also used to generate translation setting information, and send the translation setting information to the server 200 through the mobile communication component 310, so that the server 200 determines the corresponding translation setting according to the translation setting information, and translates the pre-processed first voice information based on the translation setting to obtain the second voice information.
[0210] The server 200 includes: a receiver 210, a processor 220 and a transmitter 230.
[0211] The receiver 210 is used to obtain the preprocessed first voice information from the mobile terminal 300; the processor 220 is used to translate the preprocessed first voice information into the second voice information according to the translation setting of the mobile terminal 300; the transmitter 230 is used to send the second voice information to the mobile terminal 300.
[0212] In the embodiment of the present application, the speech translation terminal 100 can communicate with the mobile terminal 300 through the communication component 150, such as the Bluetooth component. After the speech translation terminal 100 collects the first voice information, the speech translation terminal 100 can send the first voice information to the mobile communication component 310 of the mobile terminal 300 through the BLE protocol, and then pre-process the first voice information through the mobile processor 320 in the mobile terminal 300. After the mobile processor 320 pre-processes the first voice information, the pre-processed first voice information can be sent to the server 200 through the mobile communication component 310. When the server 200 receives the pre-processed first voice information, the pre-processed first voice information can be translated through the processor 220 to obtain the second voice information. After that, the server 200 can send the second voice information to the mobile terminal 300 through the transmitter 230, and the mobile communication component 310 in the mobile terminal 300 sends the second voice information to the speech translation terminal 100 based on the BLE protocol. Correspondingly, after receiving the second voice information, the speech translation terminal 100 can play the first voice information through the speaker 140.
[0213] Specifically, the processor 220 in the server 200 may translate the pre-processed first voice information into the second voice information according to the translation setting of the mobile terminal 300. The translation setting is determined according to the translation setting information input by the user.
[0214] In an embodiment of the present application, a user can set translation setting information in a mobile terminal. For example, a user can set the above translation setting information in a translation APP of the mobile terminal. After the user sets the translation setting information, the mobile terminal can send the above translation setting information to a server, so that the server can determine the corresponding translation setting according to the translation setting information set by the user.
[0215] As a possible implementation, the translation setting information includes information on the setting of mutual translation between the first language and the second language. At this time, the translation setting includes the setting of mutual translation between the first language and the second language. The processor 220 can identify the language of the preprocessed first voice information. If the language of the preprocessed first voice information is the first language, the processor 220 can translate the preprocessed first voice information of the first language into the second voice information of the second language. If the language of the preprocessed first voice information is the second language, the processor 220 can translate the preprocessed first voice information of the second language into the second voice information of the first language. Thus, the server automatically identifies the language spoken by the user, and automatically translates the language spoken by the user into the voice information corresponding to another language, so that there is no need to set a corresponding button on the voice translation device 100 to determine the language spoken by the user, which can simplify the user's operation and improve the user's experience.
[0216] Among them, the above translation settings can be Chinese-English translation, Chinese-French translation, English-German translation, etc. For example, if the translation is set to Chinese-English translation, the first language can be Chinese and the second language can be English, or the first language can be English and the second language can be Chinese.
[0217] As another possible implementation, the translation setting information includes setting information for translating from a first language into a second language. In this case, the translation setting includes setting information for translating from a first language into a second language, and the processor 220 can translate the preprocessed first voice information into second voice information in the second language.
[0218] Among them, the above translation settings can be Chinese to English, English to Chinese, Chinese to French, Chinese to German, etc. For example, if the translation setting is Chinese to English, the first language can be Chinese and the second language can be English.
[0219] The translation system of the embodiment of the present application, when the trigger button is triggered, collects the first voice information through the voice translation terminal, and sends the collected first voice information to the mobile terminal, and then the mobile terminal pre-processes the first voice information and sends the pre-processed first voice information to the server, and the server translates the pre-processed first voice information into the second voice information according to the translation setting of the mobile terminal, and then the server sends the second voice information to the voice translation terminal through the mobile terminal, and correspondingly, the voice translation terminal plays the second voice information after receiving the second voice information. In the present application, the user does not need to set the corresponding button on the voice translation terminal to determine the language of the first voice information, and only needs to trigger the unique trigger button to collect the first voice information, so as to realize the automatic translation of the first voice information between different languages, which can simplify the user's operation steps and improve the user's experience.
[0220] As a possible implementation method, the mobile processor 320 pre-processes the first voice information, specifically by performing an integrity check on the first voice information; if the first voice information passes the integrity check, the first voice information is further decoded; if the first voice information fails the integrity check, it is fed back to the voice translation terminal 100 so that the voice translation terminal 100 resends the first voice information.
[0221] It is understandable that the voice translation terminal 100 can generate a header, a tail, etc. of the file in the process of collecting voice and generating a voice file, and the first voice information finally sent to the mobile terminal 300 is a complete voice file. Therefore, after receiving the first voice information, the mobile terminal 300 can perform a file integrity check on the first voice information to determine whether the first voice information is a complete voice file. If not, the first voice information is fed back to the voice translation terminal 100 so that the voice translation terminal 100 resends the first voice information. If yes, the first voice information is further decoded and sent to the server 200.
[0222] Specifically, the mobile terminal 300 can decode the first voice information according to the format of the voice file supported by the server 200. For example, for the Microsoft server, the voice file format supported by it is the MP3 format, so the first voice information can be decoded into a voice file in the MP3 format, and then the decoded first voice information can be sent to the Microsoft server, so that the Microsoft server can translate the first voice information according to the format supported by it to obtain the second voice information.
[0223] In the embodiment of the present application, by decoding the first voice information according to the format of the voice file supported by the server, it can be ensured that the server can achieve normal translation of the first voice information.
[0224] As a possible implementation method, in order to ensure the signal quality of the first voice information and reduce network resource usage, thereby improving translation efficiency, after collecting the first voice information, the controller 110 can also compress and packetize the first voice information.
[0225] The communication component 150 is used to send the compressed and packetized first voice information to the mobile terminal 300. The mobile terminal 300 can pre-process the compressed and packetized first voice information, and then send the pre-processed first voice information to the server 200, so that the server 200 can recognize the pre-processed first voice information to obtain the language of the pre-processed first voice information, and translate the pre-processed first voice information according to the translation setting of the mobile terminal 300 and the language of the pre-processed first voice information to generate a second voice information.
[0226] The controller 110 is further configured to obtain the second voice information sent by the server 200, and perform packetization and decompression processing on the second voice information.
[0227] The speaker 140 is used to play the second voice information after the packaging and decompression processing.
[0228] In order to implement the above embodiment, the present application also proposes a translation method.
[0229] Figure 7 This is a flowchart of the translation method provided in Example 7 of the present application.
[0230] like Figure 7 As shown, the translation method is applied to the voice translation terminal proposed in the above embodiment, and the voice translation terminal communicates with the mobile terminal. The translation method may include the following steps:
[0231] Step 101, collecting first voice information.
[0232] In the embodiment of the present application, a trigger button may be provided on the voice translation terminal, and the user may input voice data by triggering the trigger button. Accordingly, when the voice translation terminal detects through monitoring that the user has triggered the trigger button, the first voice information may be collected through the speaker group.
[0233] Among them, the microphone group is composed of at least two microphones. For example, when the microphone group includes two microphones, one microphone can collect voice data input by the user, and the other microphone can collect noise data. For example, one microphone can be set on the front of the voice translation terminal, mainly used to collect voice data input by the user. It can be understood by those skilled in the art that in addition to the normal collection of the user's voice data, the microphone may also have a small amount of environmental noise; the other microphone can be set on the back of the voice translation terminal, mainly used to collect noise data. It can be understood by those skilled in the art that the noise data may also contain a small amount of voice data input by the user. The microphone group can subtract and amplify the voice data and the noise data to obtain the first voice information. Thus, the collected first voice information is the voice information obtained after noise reduction processing, which can improve the signal quality of the first voice information, so that when the second voice information is obtained by translation later, the accuracy of the translation result can be improved.
[0234] Step 102, sending a first voice message to a mobile terminal, and receiving a second voice message sent by the mobile terminal; wherein the second voice message is a voice message translated from the first voice message.
[0235] In an embodiment of the present application, the voice translation terminal can communicate with the mobile terminal through a communication component, such as a Bluetooth component. After the voice translation terminal collects the first voice information, the voice translation terminal can send the first voice information to the mobile terminal through the BLE protocol, and then the mobile terminal can send the first voice information to the server. When the server receives the first voice information, it can translate the first voice information to obtain the second voice information. When the server translates the second voice information, it can send the second voice information to the voice translation terminal through the mobile terminal.
[0236] Specifically, the server may translate the first voice information into the second voice information according to the translation setting of the mobile terminal, wherein the translation setting is determined according to the translation setting information input by the user.
[0237] In an embodiment of the present application, a user can set translation setting information in a mobile terminal. For example, a user can set the above translation setting information in a translation APP of the mobile terminal. After the user sets the translation setting information, the mobile terminal can send the above translation setting information to a server, so that the server can determine the corresponding translation setting according to the translation setting information set by the user.
[0238] As a possible implementation, the translation setting information includes information on settings for mutual translation between the first language and the second language. In this case, the translation setting includes settings for mutual translation between the first language and the second language. The server can identify the language of the first voice information. If the language of the first voice information is the first language, the server can translate the first voice information in the first language into the second voice information in the second language. If the language of the first voice information is the second language, the server can translate the first voice information in the second language into the second voice information in the first language. Thus, the server automatically identifies the language spoken by the user, and automatically translates the language spoken by the user into voice information corresponding to another language, so that there is no need to set corresponding buttons on the voice translation device to determine the language spoken by the user, which can simplify the user's operation and improve the user's experience.
[0239] Among them, the above translation settings can be Chinese-English translation, Chinese-French translation, English-German translation, etc. For example, if the translation is set to Chinese-English translation, the first language can be Chinese and the second language can be English, or the first language can be English and the second language can be Chinese.
[0240] As another possible implementation, the translation setting information includes setting information for translating from a first language into a second language. In this case, the translation setting includes setting information for translating from a first language into a second language, and the server can translate the first voice information into second voice information in the second language.
[0241] Among them, the above translation settings can be Chinese to English, English to Chinese, Chinese to French, Chinese to German, etc. For example, if the translation setting is Chinese to English, the first language can be Chinese and the second language can be English.
[0242] Step 103: play the second voice message.
[0243] In the embodiment of the present application, after the voice translation terminal receives the second voice information, the second voice information can be played through the speaker.
[0244] The translation method of the embodiment of the present application collects the first voice information through the voice translation terminal, then sends the first voice information to the mobile terminal, and receives the second voice information sent by the mobile terminal; wherein the first voice information is transmitted to the server through the mobile terminal, the second voice information is obtained through the translation of the server, the server sends the second voice information to the voice translation terminal through the mobile terminal, and finally, the voice translation terminal plays the second voice information. Thus, the automatic translation of the first voice information between different languages can be realized.
[0245] As a possible implementation method, the first voice information received by the server is preprocessed by the mobile terminal, that is, the second voice information is obtained by the mobile terminal preprocessing the first voice information and sending the preprocessed first voice information to the server, and the server translates the preprocessed first voice information according to the translation setting of the mobile terminal.
[0246] It is understandable that the voice translation terminal can generate a file header, a packet tail, etc. in the process of collecting voice and generating a voice file, and the first voice information finally sent to the mobile terminal is a complete voice file. Therefore, after receiving the first voice information, the mobile terminal can perform a file integrity check on the first voice information to determine whether the first voice information is a complete voice file. If not, it will be fed back to the voice translation terminal so that the voice translation terminal resends the first voice information. If so, the first voice information is further decoded and sent to the server.
[0247] Specifically, the mobile terminal can decode the first voice information according to the format of the voice file supported by the server. For example, for the Microsoft server, the voice file format supported by it is the MP3 format, so the first voice information can be decoded into a voice file in the MP3 format, and then the decoded first voice information can be sent to the Microsoft server, so that the Microsoft server can translate the first voice information according to the format it supports to obtain the second voice information.
[0248] In the embodiment of the present application, by decoding the first voice information according to the format of the voice file supported by the server, it can be ensured that the server can achieve normal translation of the first voice information.
[0249] As a possible implementation, in order to ensure the quality of the first voice information and reduce network resource usage, thereby improving translation efficiency, after the microphone group collects the first voice information, the first voice information may be compressed and packetized.
[0250] Accordingly, step 102 may specifically include: sending the compressed and packetized first voice information to the mobile terminal. After receiving the compressed and packetized first voice information, the mobile terminal may pre-process the compressed and packetized first voice information, and send the pre-processed first voice information to the server, so that the server recognizes the pre-processed first voice information to obtain the language of the pre-processed first voice information, and translates the pre-processed first voice information according to the translation setting of the mobile terminal and the language of the pre-processed first voice information to generate the second voice information.
[0251] After the server translates the second voice information, it can send the second voice information to the voice translation terminal through the mobile terminal. Correspondingly, after receiving the second voice information, the voice translation terminal can package and decompress the second voice information, and then play the packaged and decompressed second voice information.
[0252] In order to implement the above embodiment, the present application also proposes a translation method.
[0253] Figure 8 This is a flowchart of the translation method provided in Example 8 of the present application.
[0254] like Figure 8 As shown, the translation method is applied to the mobile terminal proposed in the above embodiment, and the mobile terminal communicates with the speech translation terminal and the server. The translation method may include the following steps:
[0255] Step 201: Receive first voice information sent by a voice translation device.
[0256] In the embodiment of the present application, after collecting the first voice information, the voice translation terminal can send the first voice information to the mobile terminal through the communication component, and correspondingly, the mobile terminal can receive the first voice information sent by the voice translation device.
[0257] Step 202: pre-process the first voice information.
[0258] In the embodiment of the present application, after receiving the first voice information, the mobile terminal may pre-process the first voice information to obtain the pre-processed first voice information.
[0259] It is understandable that the voice translation terminal can generate a file header, a packet tail, etc. in the process of collecting voice and generating a voice file, and the first voice information finally sent to the mobile terminal is a complete voice file. Therefore, as a possible implementation method of the embodiment of the present application, after receiving the first voice information, the mobile terminal can perform a file integrity check on the first voice information to determine whether the first voice information is a complete voice file. If not, it is fed back to the voice translation terminal so that the voice translation terminal resends the first voice information. If so, the first voice information is further decoded and the decoded first voice information is sent to the server.
[0260] Specifically, the mobile terminal can decode the first voice information according to the format of the voice file supported by the server. For example, for the Microsoft server, the voice file format supported by it is the MP3 format, so the first voice information can be decoded into a voice file in the MP3 format, and then the decoded first voice information can be sent to the Microsoft server, so that the Microsoft server can translate the first voice information according to the format it supports to obtain the second voice information.
[0261] In the embodiment of the present application, by decoding the first voice information according to the format of the voice file supported by the server, it can be ensured that the server can achieve normal translation of the first voice information.
[0262] Step 203, sending the preprocessed first voice information to the server, so that the server translates the preprocessed first voice information according to the translation setting of the mobile processor to obtain the second voice information.
[0263] In the embodiment of the present application, the translation setting is determined according to the translation setting information input by the user. Specifically, the user can set the translation setting information in the mobile terminal, for example, the user can set the above translation setting information in the translation APP of the mobile terminal. After the user sets the translation setting information, the mobile terminal can send the above translation setting information to the server, so that the server can determine the corresponding translation setting according to the translation setting information set by the user.
[0264] As a possible implementation, the translation setting information includes information on settings for translation between the first language and the second language. In this case, the translation setting includes settings for translation between the first language and the second language. The above translation setting may be Chinese-English translation, Chinese-French translation, English-German translation, etc. For example, if the translation setting is Chinese-English translation, the first language may be Chinese and the second language may be English, or the first language may be English and the second language may be Chinese.
[0265] In an embodiment of the present application, after preprocessing the first voice information, the mobile terminal can send the preprocessed first voice information to the server, so that the server can identify the language of the preprocessed first voice information. If the language of the preprocessed first voice information is the first language, the server can translate the preprocessed first voice information in the first language into the second voice information in the second language, and if the language of the preprocessed first voice information is the second language, the server can translate the preprocessed first voice information in the second language into the second voice information in the first language. Thus, the server automatically identifies the language spoken by the user, and automatically translates the language spoken by the user into the voice information corresponding to another language, so that there is no need to set a corresponding button on the voice translation device to determine the language spoken by the user, which can simplify the user's operation and improve the user's experience.
[0266] As another possible implementation, the translation setting information includes information about settings for translating from a first language to a second language. In this case, the translation setting includes settings for translating from a first language to a second language. The above translation settings may be Chinese to English, English to Chinese, Chinese to French, Chinese to German, etc. For example, if the translation setting is Chinese to English, the first language may be Chinese, and the second language may be English.
[0267] In the embodiment of the present application, after preprocessing the first voice information, the mobile terminal may send the preprocessed first voice information to the server, so that the server may translate the preprocessed first voice information into second voice information in a second language.
[0268] Step 204: receiving the second voice information sent by the server, and sending the second voice information to the voice translation device.
[0269] In an embodiment of the present application, after the server translates the second voice information, it can send the second voice information to the mobile terminal, and the mobile terminal then sends the second voice information to the voice translation terminal. Correspondingly, after receiving the second voice information, the voice translation terminal can play the second voice information.
[0270] The translation method of the embodiment of the present application receives the first voice information through the mobile terminal, pre-processes the first voice information, and then sends the pre-processed first voice information to the server, so that the server translates the first voice information into the second voice information according to the translation setting of the mobile terminal, and finally sends the second voice information to the mobile terminal. Correspondingly, after receiving the second voice information, the mobile terminal can send the second voice information to the voice translation device, so that the voice translation device plays the second voice information. In this way, the automatic translation of the first voice information between different languages can be realized.
[0271] In order to implement the above embodiment, the present application also proposes a translation device.
[0272] Fig. 9 This is a schematic diagram of the structure of the translation device provided in Example 9 of the present application.
[0273] like Fig. 9 As shown, the translation device includes: a collection module 410, a sending module 420, and a playing module 430. Among them,
[0274] The collection module 410 is used to collect the first voice information.
[0275] As a possible implementation manner, the collection module 410 is specifically used to: collect voice data and noise data input by the user; subtract and amplify the voice data and the noise data to obtain the first voice information.
[0276] The sending module 420 is used to send a first voice message to a mobile terminal and receive a second voice message sent by the mobile terminal; wherein the second voice message is a voice message translated from the first voice message.
[0277] As a possible implementation, the second voice information is obtained by the mobile terminal preprocessing the first voice information and sending the preprocessed first voice information to the server, and the server translates the preprocessed first voice information according to the translation setting of the mobile terminal.
[0278] The playing module 430 is used to play the second voice information.
[0279] Further, as a possible implementation method of the present application, see Fig.10 ,exist Fig. 9 Based on the illustrated embodiment, the translation device may further include: a processing module 440 .
[0280] The processing module 440 is used to compress and packetize the first voice information after collecting the first voice information.
[0281] The sending module 420 is specifically used to: send the compressed and sub-packetized first voice information to the mobile terminal, so that the mobile terminal pre-processes the compressed and sub-packetized first voice information, and send the pre-processed first voice information to the server, and the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information.
[0282] The playing module 430 is specifically used to: package and decompress the second voice information; and play the packaged and decompressed second voice information.
[0283] It should be noted that the above Figure 7 The explanation of the translation method embodiment is also applicable to the translation device of this embodiment, and will not be repeated here.
[0284] The translation device of the embodiment of the present application collects the first voice information through the voice translation terminal, then sends the first voice information to the mobile terminal, and receives the second voice information sent by the mobile terminal; wherein the first voice information is transmitted to the server through the mobile terminal, the second voice information is obtained through the translation of the server, the server sends the second voice information to the voice translation terminal through the mobile terminal, and finally, the voice translation terminal plays the second voice information. Thus, the automatic translation of the first voice information between different languages can be realized.
[0285] In order to implement the above embodiment, the present application also proposes a translation device.
[0286] Fig.11 This is a schematic diagram of the structure of the translation device provided in Example 11 of the present application.
[0287] like Fig.11 As shown, the translation device includes: a receiving module 510, a pre-processing module 520 and a sending module 530.
[0288] The receiving module 510 is used to receive the first voice information sent by the voice translation device.
[0289] The preprocessing module 520 is used to preprocess the first voice information.
[0290] As a possible implementation method, the preprocessing module 520 is specifically used to: perform an integrity check on the first voice information; if the first voice information passes the integrity check, further decode the first voice information; if the first voice information fails the integrity check, feed back to the voice translation terminal so that the voice translation terminal resends the first voice information.
[0291] The sending module 530 is used to send the pre-processed first voice information to the server, so that the server translates the pre-processed first voice information according to the translation setting of the mobile processor to obtain the second voice information.
[0292] As a possible implementation manner, the translation setting information includes setting information for translation between the first language and the second language or setting information for translation from the first language to the second language.
[0293] The receiving module 510 is further configured to receive the second voice information sent by the server.
[0294] The sending module 530 is further configured to send the second voice information to the voice translation device.
[0295] It should be noted that the above Figure 8 The explanation of the translation method embodiment is also applicable to the translation device of this embodiment, and will not be repeated here.
[0296] The translation device of the embodiment of the present application receives the first voice information through the mobile terminal, pre-processes the first voice information, and then sends the pre-processed first voice information to the server, so that the server translates the first voice information into the second voice information according to the translation setting of the mobile terminal, and finally sends the second voice information to the mobile terminal. Correspondingly, after receiving the second voice information, the mobile terminal can send the second voice information to the voice translation device, so that the voice translation device plays the second voice information. In this way, the automatic translation of the first voice information between different languages can be realized.
[0297] In order to implement the above embodiments, the present application also proposes a speech translation terminal, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the above embodiments of the present application are implemented. Figure 7 The translation method proposed in the embodiment.
[0298] In order to implement the above embodiment, the present application further proposes a server, characterized in that it includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the above-mentioned Figure 8 The translation method proposed in the embodiment.
[0299] In order to implement the above embodiments, the present application also proposes a computer-readable storage medium on which a computer program is stored, characterized in that when the program is executed by a processor, the above-mentioned Figure 7 The translation method proposed in the embodiment, or the implementation as described in the previous application Figure 8 The translation method proposed in the embodiment.
[0300] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.
[0301] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0302] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.
[0303] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable optical disk read-only memory. In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or otherwise processing in a suitable manner if necessary, and then stored in a computer memory.
[0304] The various parts of the present application may be implemented in hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof may be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array, a field programmable gate array, etc.
[0305] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.
[0306] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
[0307] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.
Claims
1. A voice translation terminal, characterized in that: include: The housing, controller, only one trigger button, microphone set, speaker and communication components; The housing forms a space for accommodating the controller, the microphone group, the speaker and the communication component; The one trigger button is arranged on the housing and is electrically connected to the controller; The microphone group is electrically connected to the controller and is used to collect the first voice information after the trigger button is triggered; The speaker is electrically connected to the controller and is used to play the second voice information according to the control of the controller; wherein the second voice information is the voice information translated from the first voice information; The controller is electrically connected to the communication component, and is used to control the communication component to send the first voice information to the mobile terminal, and control the communication component to receive the second voice information sent by the mobile terminal; The voice translation terminal communicates with the mobile terminal through the communication component, and the mobile terminal communicates with the server. The voice translation terminal sends the first voice information to the mobile terminal through the communication component. The first voice information is pre-processed by the mobile terminal and then sent to the server through the mobile terminal, so that the server translates the first voice information according to the translation setting of the mobile terminal to obtain the second voice information. The second voice information is sent to the mobile terminal through the server, and the voice translation terminal receives the second voice information sent by the mobile terminal through the communication component. The translation setting is translation setting information set by the user on the mobile terminal, and the translation setting information includes setting information for translation between the first language and the second language or setting information for translation from the first language to the second language; the server automatically identifies the first language or the second language, and translates it into the second language or voice information corresponding to the first language; The microphone group includes two microphones, one of which is used to collect voice data input by a user, and the other is used to collect noise data; and The communication component is a Bluetooth component.
2. The speech translation terminal according to claim 1, characterized in that: The microphone group is used to subtract and amplify the voice data and the noise data to obtain the first voice information.
3. The voice translation terminal according to claim 1, characterized in that: The controller is used to: receiving first voice information collected by the microphone group, and compressing and packetizing the first voice information; Controlling the communication component to send the compressed and packetized first voice information to the mobile terminal, and controlling the communication component to receive the second voice information sent by the mobile terminal; wherein the compressed and packetized first voice information is pre-processed by the mobile terminal to obtain the pre-processed first voice information; the pre-processed first voice information is sent to the server through the mobile terminal, so that the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information, and the second voice information is sent to the mobile terminal through the server; Packaging and decompressing the second voice information; The loudspeaker is controlled to play the second voice information after the packetization and decompression processing.
4. A mobile terminal, characterized in that: include: A housing, a mobile communication component, and a mobile processor; the mobile communication component is electrically connected to the mobile processor; the mobile communication component communicates with a server and the voice translation terminal according to any one of claims 1 to 3; The mobile communication component is used to receive the first voice information sent by the voice translation terminal, and send the first voice information pre-processed by the mobile processor to the server, so that the server translates the pre-processed first voice information according to the translation setting of the mobile processor to obtain the second voice information; The mobile communication component is further used to receive the second voice information sent by the server, and send the second voice information to the voice translation terminal; The mobile processor is used to pre-process the first voice information; The mobile processor is further configured to generate translation setting information, and send the translation setting information to the server through the mobile communication component, so that the server determines corresponding translation settings according to the translation setting information, and translates the preprocessed first voice information based on the translation setting to obtain second voice information; Among them, the translation setting is the translation setting information set by the user in the mobile terminal, and the translation setting information includes setting information for translation between the first language and the second language or setting information for translation from the first language to the second language; the server automatically identifies the first language or the second language, and translates it into the second language or the voice information corresponding to the first language.
5. The mobile terminal according to claim 4, wherein the mobile processor pre-processes the first voice information, characterized in that: The mobile processor is specifically used for: Performing an integrity check on the first voice information; If the first voice information passes the integrity check, further decoding the first voice information; If the first voice information fails the integrity check, the information is fed back to the voice translation terminal so that the voice translation terminal resends the first voice information.
6. A translation system, characterized in that: It includes a speech translation terminal, a mobile terminal and a server, wherein the speech translation terminal communicates with the mobile terminal, and the mobile terminal communicates with the server; The speech translation terminal comprises: A housing, a controller, only one trigger button, a microphone group, a speaker and a communication component; the housing forms a space for accommodating the controller, the microphone group, the speaker and the communication component; the trigger button is arranged on the housing and is electrically connected to the controller; the microphone group is electrically connected to the controller and is used to collect first voice information after the trigger button is triggered; the speaker is electrically connected to the controller and is used to play second voice information according to the control of the controller; wherein the second voice information is the voice information translated from the first voice information; the controller is electrically connected to the communication component and is used to control the communication component to send the first voice information to the mobile terminal and control the communication component to receive the second voice information sent by the mobile terminal; the microphone group includes two microphones, one of which is used to collect voice data input by the user and the other is used to collect noise data; and the communication component is a Bluetooth component; The mobile terminal comprises: A housing, a mobile communication component, and a mobile processor; the mobile communication component is electrically connected to the mobile processor; the mobile communication component communicates with a voice translation terminal and a server; the mobile communication component is used to receive a first voice message sent by the voice translation terminal, and send the first voice message preprocessed by the mobile processor to the server, so that the server translates the preprocessed first voice message according to the translation setting of the mobile terminal to obtain a second voice message; the mobile communication component is also used to receive the second voice message sent by the server, and send the second voice message to the voice translation terminal; the mobile processor is used to preprocess the first voice message; the mobile processor is also used to generate translation setting information, and send the translation setting information to the server through the mobile communication component, so that the server determines the corresponding translation setting according to the translation setting information, and translates the preprocessed first voice message based on the translation setting to obtain the second voice message; The server comprises: a receiver, configured to obtain the pre-processed first voice information from the mobile terminal; a processor, configured to translate the pre-processed first voice information into the second voice information according to the translation setting of the mobile terminal; and a transmitter, configured to send the second voice information to the mobile terminal; Among them, the translation setting is the translation setting information set by the user in the mobile terminal, and the translation setting information includes setting information for translation between the first language and the second language or setting information for translation from the first language to the second language; the server automatically identifies the first language or the second language, and translates it into the second language or the voice information corresponding to the first language.
7. The translation system according to claim 6, characterized in that The microphone group is used to subtract and amplify the voice data and the noise data to obtain the first voice information.
8. The translation system according to claim 6, characterized in that The controller is used to: receiving first voice information collected by the microphone group, and compressing and packetizing the first voice information; Controlling the communication component to send the compressed and packetized first voice information to the mobile terminal, and controlling the communication component to receive the second voice information sent by the mobile terminal; wherein the compressed and packetized first voice information is pre-processed by the mobile terminal to obtain the pre-processed first voice information; the pre-processed first voice information is sent to the server through the mobile terminal, so that the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information, and the second voice information is sent to the mobile terminal through the server; Packaging and decompressing the second voice information; The loudspeaker is controlled to play the second voice information after the packetization and decompression processing.
9. The translation system according to claim 7, wherein the mobile processor pre-processes the first voice information, characterized in that: The mobile processor is specifically used for: Performing an integrity check on the first voice information; If the first voice information passes the integrity check, further decoding the first voice information; If the first voice information fails the integrity check, the information is fed back to the voice translation terminal so that the voice translation terminal resends the first voice information.
10. A translation method, characterized in that: Applied to the speech translation terminal according to any one of claims 1 to 3, the speech translation terminal communicates with a mobile terminal, and the method comprises the following steps: collecting first voice information; Sending the first voice information to the mobile terminal, and receiving the second voice information sent by the mobile terminal; wherein the second voice information is the voice information translated from the first voice information; Play the second voice information.
11. The translation method according to claim 10, characterized in that: The collecting of the first voice information includes: Collect voice data and noise data input by the user; The voice data and the noise data are subtracted and amplified to obtain the first voice information.
12. The translation method according to claim 10, characterized in that: After collecting the first voice information, the method further includes: compressing and packetizing the first voice information; The sending the first voice information to the mobile terminal includes: The compressed and packetized first voice information is sent to the mobile terminal so that the mobile terminal pre-processes the compressed and packetized first voice information, and the pre-processed first voice information is sent to the server, and the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information.
13. The translation method according to claim 12, characterized in that: The playing of the second voice information includes: Packaging and decompressing the second voice information; Play the second voice information after the packetization and decompression processing.
14. A translation method, characterized in that: Applied to the mobile terminal according to any one of claims 4-5, the mobile terminal communicates with a speech translation terminal and a server, and the method comprises the following steps: Receiving a first voice message sent by the voice translation terminal; Preprocessing the first voice information; Sending the preprocessed first voice information to the server, so that the server translates the preprocessed first voice information to obtain second voice information according to the translation setting of the mobile processor; receiving a second voice message sent by the server; Sending the second voice information to the voice translation terminal; Among them, the translation setting is the translation setting information set by the user in the mobile terminal, and the translation setting information includes setting information for translation between the first language and the second language or setting information for translation from the first language to the second language; the server automatically identifies the first language or the second language, and translates it into the second language or the voice information corresponding to the first language.
15. The translation method according to claim 14, characterized in that: The preprocessing of the first voice information includes: Performing an integrity check on the first voice information; If the first voice information passes the integrity check, further decoding the first voice information; If the first voice information fails the integrity check, the information is fed back to the voice translation terminal so that the voice translation terminal resends the first voice information.
16. A translation device, characterized in that: For implementing the method according to any one of claims 10 to 13, the device comprises: A collection module, used for collecting first voice information; A sending module, used for sending the first voice information to a mobile terminal, and receiving a second voice information sent by the mobile terminal; wherein the second voice information is a voice information translated from the first voice information; A playing module is used to play the second voice information.
17. The translation device according to claim 16, characterized in that The second voice information is obtained by the mobile terminal preprocessing the first voice information and sending the preprocessed first voice information to the server, and the server translating the preprocessed first voice information according to the translation setting of the mobile terminal.
18. The translation device according to claim 16, characterized in that: The acquisition module is specifically used for: Collecting voice data input by the user and collecting noise data; The voice data and the noise data are subtracted and amplified to obtain the first voice information.
19. The translation device according to claim 17, characterized in that: The device also includes: A processing module, used for compressing and packetizing the first voice information after collecting the first voice information; The sending module is specifically used for: The compressed and packetized first voice information is sent to the mobile terminal so that the mobile terminal pre-processes the compressed and packetized first voice information, and the pre-processed first voice information is sent to the server, and the server translates the pre-processed first voice information according to the translation setting of the mobile terminal to obtain the second voice information.
20. The translation device according to claim 19, characterized in that The playback module is specifically used for: Packaging and decompressing the second voice information; Play the second voice information after the packetization and decompression processing.
21. A translation device, characterized in that: For implementing the method according to any one of claims 14-15, the device comprises: A receiving module, used for receiving a first voice message sent by a voice translation terminal; A preprocessing module, used for preprocessing the first voice information; A sending module, used for sending the pre-processed first voice information to the server, so that the server translates the pre-processed first voice information to obtain the second voice information according to the translation setting of the mobile processor; The receiving module is further used to receive the second voice information sent by the server; The sending module is further used to send the second voice information to the voice translation terminal; Among them, the translation setting is the translation setting information set by the user in the mobile terminal, and the translation setting information includes the setting information for translation between the first language and the second language or the setting information for translation from the first language to the second language; the server automatically identifies the first language or the second language, and translates it into the second language or the voice information corresponding to the first language.
22. The translation device according to claim 21, characterized in that The preprocessing module is specifically used for: Performing an integrity check on the first voice information; If the first voice information passes the integrity check, further decoding the first voice information; If the first voice information fails the integrity check, the information is fed back to the voice translation terminal so that the voice translation terminal resends the first voice information.
23. A voice translation terminal, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the program, the translation method according to any one of claims 10 to 13 is implemented.
24. A mobile terminal, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the program, the translation method according to any one of claims 14 to 15 is implemented.
25. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the program implements the translation method as described in any one of claims 10-13, or implements the translation method as described in any one of claims 14-15.
Citation Information
Patent Citations
Voice translation terminal, mobile terminal and translation system
CN209947430U
Method for Determining a Noise Reference Signal for Noise Compensation and / or Noise Reduction
US20100246851A1
Method and system for supporting a translation-based communication service and terminal supporting the service
US20140242955A1
Speech translation apparatus, speech translation method, and non-transitory computer readable medium thereof
US20150081271A1