Simultaneous translation method based on Bluetooth headset, mobile terminal and Bluetooth headset

Abstract

The invention provides a simultaneous translation method based on a Bluetooth headset, a mobile terminal and the Bluetooth headset, the method comprises the steps that connection is established between the mobile terminal and the Bluetooth headset, and the headset and a charging bin are connected with the mobile terminal through the Bluetooth technology. Meanwhile, the mobile terminal is connected with an application program of the mobile terminal through a Bluetooth low-power-consumption technology; when the earphone or the charging bin needs to send voice information, acquiring voice transmission authority by preempting a Bluetooth technology link focus of the mobile terminal; the device obtaining the voice transmission authority collects voice information of a first language in real time, transmits the voice information to the mobile terminal, and translates the voice information of the first language into voice information of a target language; and after the translation is completed, the other device grabs the link focus of the mobile terminal to obtain a voice playing permission and plays the voice information of the target language, so that the Bluetooth earphone has a simultaneous translation function.

Description

Technical Field

[0001] The invention belongs to the technical field of audio processing, and in particular relates to a simultaneous interpretation method based on a Bluetooth headset, a mobile terminal and a Bluetooth headset. Background Art

[0002] When people travel to a strange country, the first problem they encounter is often the language barrier, making it difficult to communicate effectively with the locals. In this case, tourists may have to communicate with the locals in English, which is not fluent, but such communication is often difficult, time-consuming and laborious. Another option is to use translation software, but this usually requires users to enter the text sentence by sentence, wait for the software to translate it into the local language, and then play it to the other party. The other party also needs to repeat the same process to translate the conversation back to the language that the user can understand. Although this method can barely achieve communication, the experience is not ideal.

[0003] In business meetings, this cumbersome communication method is even less applicable because it does not allow both parties to fully understand each other's needs, which can easily lead to misunderstandings. Therefore, the market urgently needs a translation device that is easy to carry, simple to operate, and supports multiple languages ​​to solve these communication problems. It is in this context that AI simultaneous translation headphones came into being.

[0004] Currently, most Bluetooth headsets on the market can only perform basic voice functions such as listening to music and making phone calls, and no product can achieve the function of simultaneous interpretation. The emergence of AI simultaneous interpretation headsets aims to change this situation. Summary of the invention

[0005] In order to solve the above technical problems, the present invention provides a simultaneous interpretation method based on Bluetooth headset, a mobile terminal and a Bluetooth headset, which are used to solve the technical problems in the prior art.

[0006] On the one hand, the invention provides the following technical solution: a simultaneous interpretation method based on a Bluetooth headset, applied to a mobile terminal, wherein the Bluetooth headset includes at least one headset and a charging compartment, and the method includes:

[0007] Establishing a connection between the mobile terminal and the Bluetooth headset, wherein the headset and the charging compartment are connected to the mobile terminal via Bluetooth technology, and are also connected to an application of the mobile terminal via Bluetooth low energy technology;

[0008] When the headset or charging case needs to send voice information, it obtains voice transmission permission by seizing the Bluetooth technology link focus of the mobile terminal, and the other device that does not obtain permission switches to standby mode;

[0009] The device that obtains the voice transmission permission collects voice information in the first language in real time, transmits the voice information to the mobile terminal, and translates the voice information in the first language into voice information in the target language;

[0010] After the translation is completed, the other device grabs the link focus of the mobile terminal to obtain the voice playing authority, and plays the voice information in the target language.

[0011] Compared with the prior art, the beneficial effects of the present application are: voice information in a first language is collected in real time by a device that obtains voice transmission authority, the voice information is transmitted to the mobile terminal, and the voice information in the first language is translated into voice information in a target language, so that both the earphone and the charging case of the Bluetooth headset can play and record, and then the recording is translated through the mobile terminal, so that the Bluetooth headset has the function of simultaneous interpretation.

[0012] Furthermore, before the step of establishing a connection between the mobile terminal and the Bluetooth headset, the method further includes:

[0013] Open the application of the mobile terminal and enter the simultaneous interpretation function module;

[0014] Determine whether the mobile terminal is connected to the Bluetooth headset. If the mobile terminal is not connected to the Bluetooth headset, issue a prompt tone and enter a step of establishing a connection between the mobile terminal and the Bluetooth headset.

[0015] Furthermore, the step of transmitting the voice information to the mobile terminal and translating the voice information in the first language into voice information in the target language includes:

[0016] The voice information is transmitted to a server, and the server translates the voice information in the first language into voice information in a target language based on a preset translation model;

[0017] The server transmits the voice information in the target language to the mobile terminal, and determines whether the translation of the voice information in the target language is correct;

[0018] If the translation of the target language voice information is correct, the step after the translation is completed is entered.

[0019] Furthermore, after the step of determining whether the translation of the speech information in the target language is wrong, the method further comprises:

[0020] If the translation of the voice information in the target language is incorrect, the application of the mobile terminal sends an end-of-conversation instruction to the device that has obtained the voice transmission permission, and plays an end-of-conversation prompt tone;

[0021] At the same time, the application of the mobile terminal sends a voice transmission permission change instruction to the charging compartment so that the other device obtains the voice transmission permission.

[0022] Furthermore, when the headset or the charging case needs to send voice information, the step of seizing the Bluetooth technology link focus of the mobile terminal includes:

[0023] When the headset needs to send voice information, pressing the speech button of the application of the mobile terminal, and determining whether the headset occupies the Bluetooth technology link focus of the mobile terminal;

[0024] If the headset does not occupy the Bluetooth technology link focus of the mobile terminal, the application of the mobile terminal issues an instruction to seize the Bluetooth technology link focus of the mobile terminal, so that the headset obtains the Bluetooth technology link focus of the mobile terminal;

[0025] When the charging compartment needs to send a voice message, pressing the speech button on the screen of the charging compartment and determining whether the headset occupies the Bluetooth technology link focus of the mobile terminal;

[0026] If the charging compartment does not occupy the Bluetooth technology link focus of the mobile terminal, the charging compartment is caused to issue an instruction to seize the Bluetooth technology link focus of the mobile terminal, so that the charging compartment obtains the Bluetooth technology link focus of the mobile terminal.

[0027] Furthermore, after the step of playing the voice information in the target language, the method further includes:

[0028] After playing the voice information in the target language, the application of the mobile terminal sends an instruction to change the voice transmission authority so that the other device obtains the voice transmission authority.

[0029] Furthermore, after the step of playing the voice information in the target language, the method further includes:

[0030] The user can stop playing the voice information in the target language at any time. After the playing is stopped, the application of the mobile terminal sends an instruction to change the voice transmission authority so that the other device obtains the voice transmission authority.

[0031] Furthermore, the target language is preset by the user in an application of the mobile terminal.

[0032] In a second aspect, the invention provides the following technical solution: a mobile terminal comprising a memory, a processor, and a simultaneous interpretation program based on a Bluetooth headset stored in the memory and executable on the processor; when the simultaneous interpretation program based on a Bluetooth headset is executed by the processor, the simultaneous interpretation method based on a Bluetooth headset as claimed in the claim is implemented.

[0033] In a third aspect, the invention provides the following technical solution: a Bluetooth headset, comprising at least one earphone and a charging compartment, wherein the earphone and the charging compartment both comprise: a memory, a processor, and a simultaneous interpretation program based on the Bluetooth headset stored in the memory and executable on the processor, wherein the simultaneous interpretation program based on the Bluetooth headset, when executed by the processor, implements the simultaneous interpretation method based on the Bluetooth headset as described in the claim. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0035] Figure 1 The present invention provides a flowchart of a simultaneous interpretation method based on Bluetooth headsets according to an embodiment of the present invention.

[0036] Figure 2 A schematic diagram of the structure of a simultaneous interpretation method based on Bluetooth headset provided in an embodiment of the present invention.

[0037] Figure 3 A flowchart of implementing speaking on the earphone side provided by an embodiment of the present invention.

[0038] Figure 4 A flowchart for implementing speech at the charging station end provided in an embodiment of the present invention.

[0039] Figure 5 This is a schematic diagram of the implementation principle of simultaneous interpretation provided by an embodiment of the present invention.

[0040] The embodiments of the present invention will be further described below with reference to the accompanying drawings. DETAILED DESCRIPTION

[0041] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout are the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the embodiments of the present invention, and should not be construed as limiting the present invention.

[0042] In the description of the embodiments of the present invention, it should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside" and "outside" etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the embodiments of the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.

[0043] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0044] In the embodiments of the present invention, please refer to Figures 1 to 4 As shown, a simultaneous interpretation method based on Bluetooth headset is applied to a mobile terminal. The Bluetooth headset includes at least one headset and a charging compartment. In addition to charging the headset, the smart charging compartment also needs to have an LCD display, a speaker for playing audio data, and a microphone for receiving sound. The smart charging compartment needs to have a Bluetooth IC that supports BT (Bluetooth Technology) and BLE (Bluetooth Low Energy) dual-mode communication. The headset, an ordinary Bluetooth headset, can realize BT and BLE communication. The BT of the headset and the charging compartment needs to be connected to the mobile phone at the same time, and the APP needs to connect the headset and the charging compartment through BLE. The mobile phone needs to use the WebSocket API to access the AIService server. The mobile phone needs a network.

[0045] The simultaneous interpretation method based on Bluetooth headset comprises the following steps S01 to S05:

[0046] S01, establishing a connection between the mobile terminal and the Bluetooth headset, wherein the headset and the charging compartment are connected to the mobile terminal via Bluetooth technology, and are also connected to an application of the mobile terminal via Bluetooth low energy technology;

[0047] Specifically, before the step of establishing a connection between the mobile terminal and the Bluetooth headset, the method further includes:

[0048] S11, opening the application of the mobile terminal and entering the simultaneous interpretation function module;

[0049] S12, determining whether the mobile terminal is connected to the Bluetooth headset. If the mobile terminal is not connected to the Bluetooth headset, a prompt tone is issued, and a step of establishing a connection between the mobile terminal and the Bluetooth headset is entered.

[0050] When the headset sends a voice message, open the TOZO APP and enter the simultaneous translation function module. The APP checks whether the BT and BLE of the current headset and charging case are connected. If there is no link, the user needs to be prompted that the connection is required before use.

[0051] When the charging compartment sends a voice message, the charging compartment determines whether the current BT and BLE are connected. If not, a pop-up box prompts the user: BT and BLE need to be connected before use. If the connection is normal, proceed to the next step.

[0052] S02, when the headset or charging case needs to send voice information, it obtains voice transmission permission by seizing the Bluetooth technology link focus of the mobile terminal, and the other device that has not obtained permission switches to standby mode;

[0053] Specifically, when the headset or the charging case needs to send voice information, the step of seizing the Bluetooth technology link focus of the mobile terminal includes:

[0054] When the headset needs to send voice information, pressing the speech button of the application of the mobile terminal, and determining whether the headset occupies the Bluetooth technology link focus of the mobile terminal;

[0055] If the headset does not occupy the Bluetooth technology link focus of the mobile terminal, the application of the mobile terminal issues an instruction to seize the Bluetooth technology link focus of the mobile terminal, so that the headset obtains the Bluetooth technology link focus of the mobile terminal;

[0056] When the charging compartment needs to send a voice message, pressing the speech button on the screen of the charging compartment and determining whether the headset occupies the Bluetooth technology link focus of the mobile terminal;

[0057] If the charging compartment does not occupy the Bluetooth technology link focus of the mobile terminal, the charging compartment is caused to issue an instruction to seize the Bluetooth technology link focus of the mobile terminal, so that the charging compartment obtains the Bluetooth technology link focus of the mobile terminal.

[0058] In specific applications, when the headset needs to send voice information, the APP sends a command to seize the BT Bluetooth link to the headset end. The headset end checks whether there is a BT link focus at present. If not, it needs to immediately seize the BT link focus of the mobile phone. The headset plays a start-speaking prompt, for example: a beep. After the prompt tone is played, the start-speaking command is immediately sent to the APP. The APP sends a conversation permission change command to the charging compartment end, the speaking button on the charging compartment is grayed out, and the APP starts recording through the headset's BT Bluetooth. When the charging compartment needs to send voice information, it is determined whether the charging compartment has a BT link focus. If not, the charging compartment needs to seize the BT link focus of the mobile phone. If so, the charging compartment plays a start-recording prompt tone, which is a "beep", and sends a start-speaking command to the APP end. The headset speaking button on the APP end is grayed out, prohibiting the headset from speaking, and the APP end starts recording through the charging compartment's BT.

[0059] S03, the device that obtains the voice transmission permission collects voice information in the first language in real time, transmits the voice information to the mobile terminal, and translates the voice information in the first language into voice information in the target language;

[0060] Specifically, the step of transmitting the voice information to the mobile terminal and translating the voice information in the first language into voice information in the target language includes:

[0061] The voice information is transmitted to a server, and the server translates the voice information in the first language into voice information in a target language based on a preset translation model;

[0062] The server transmits the voice information in the target language to the mobile terminal, and determines whether the translation of the voice information in the target language is correct;

[0063] If the translation of the target language voice information is correct, the step after the translation is completed is entered.

[0064] In this embodiment, the server is an AI Service, which generally refers to various services and functions provided based on artificial intelligence technology.

[0065] Specifically, after the step of determining whether the translation of the speech information in the target language is wrong, the method further includes:

[0066] If the translation of the voice information in the target language is incorrect, the application of the mobile terminal sends an end-of-conversation instruction to the device that has obtained the voice transmission permission, and plays an end-of-conversation prompt tone;

[0067] At the same time, the application of the mobile terminal sends a voice transmission permission change instruction to the charging compartment so that the other device obtains the voice transmission permission.

[0068] In specific applications, when the headset is recording, the user releases the speak button, the APP stops recording, and the APP sends an end-recording instruction to the headset. The headset plays a prompt tone to end recording, which is "a beep". At the same time, the APP sends the recorded audio data to the server, and the server returns the translated voice data. The APP receives the audio data returned by the server, and first determines whether the audio data is wrong. If there is an error, the APP sends an end-conversation instruction to the headset, the headset exits the conversation process, and plays a prompt tone to end the conversation, such as "beep". At the same time, the APP sends a conversation permission change instruction to the charging bin, and reactivates the speak button on the charging bin; if there is no error, the APP will send an instruction to the charging bin to let the charging bin grab the BT link focus, and then the APP starts playing the translated voice data through the BT of the charging bin. After the playback is over, the APP will also send a conversation permission change instruction to the charging bin to reactivate the speak button on the charging bin.

[0069] In specific applications, when the charging station is recording, the user releases the talk button on the charging station, and the charging station sends an "end recording command" to the APP, and the APP stops recording immediately. The charging station plays a prompt tone to end recording, for example: a click. At the same time, the APP sends the recording data to the server, and the server returns the translated audio data. The APP checks the translation data returned by the server. If it is incorrect, the APP sends an "end conversation command" to the charging station, and the charging station prompts "System error, end conversation", so the charging station ends the conversation; if it is correct, the APP will send a "grab BT link focus command" to the earphone end, the earphone end grabs the BT link focus, and then the APP end plays the translated voice data through the BT of the earphone end. After playing, the earphone talk button on the APP end is reactivated.

[0070] S04, after the translation is completed, the other device seizes the link focus of the mobile terminal to obtain the voice playing permission, and plays the voice information in the target language.

[0071] Specifically, after the step of playing the voice information in the target language, the method further includes:

[0072] After playing the voice information in the target language, the application of the mobile terminal sends an instruction to change the voice transmission authority so that the other device obtains the voice transmission authority.

[0073] Specifically, after the step of playing the voice information in the target language, the method further includes:

[0074] The user can stop playing the voice information in the target language at any time. After the playing is stopped, the application of the mobile terminal sends an instruction to change the voice transmission authority so that the other device obtains the voice transmission authority.

[0075] Specifically, the target language is preset by the user in the application of the mobile terminal. In this embodiment, the target language can be a variety of mainstream languages ​​in the world such as English, Spanish, French, German, Portuguese, Italian, Dutch, Russian, Arabic and Chinese.

[0076] In specific applications, when the charging case is playing translated audio data, the user can double-click the play button on the charging case at any time to stop playing. After stopping playing, the charging case returns to the conversation state. When the earphone is playing translated voice data, the user can click the stop button on the APP at any time to stop playing. After stopping, the earphone talk button on the APP is reactivated.

[0077] Application scenario: Xiaohua is going to meet an American customer Mike today. Mike does not speak Chinese, and Xiaohua's English listening and speaking skills are also poor. In order to successfully take over Mike's order, Xiaohua needs someone to translate the conversation between the two parties. At this time, if there is a simultaneous translation headset, it can solve the translation problem very well.

[0078] Connect the earphones and charging case to the phone, open the APP, set the earphones to Chinese, and the charging case to English. Xiaohua puts on the earphones and places the charging case in front of the American customer. When Xiaohua speaks, press and hold the talk button on the APP and start saying, "Good morning, Mike." Release your finger, and the charging case will play "Good morning, Mike." Then Mike will press and hold the talk button on the charging case and say, "Good moring, Miss Hua." Release your finger, and the earphones will play, "Good morning, Miss Hua." This way, Xiaohua and Mike can easily have a cross-language conversation.

[0079] In summary, a simultaneous interpretation method based on Bluetooth headset has the following effects:

[0080] First, it solves the translation problem and supports 10 major languages ​​in the world: English, Spanish, French, German, Portuguese, Italian, Dutch, Russian, Arabic and Chinese.

[0081] Second: Conversation is convenient. One party wears the headset and speaks Chinese into the headset and listens to Chinese, while the other party speaks English into the headset and listens to English.

[0082] Third: The transmission distance is long. The Bluetooth transmission distance can generally reach about 10 meters. Two people talking can have a normal conversation even if they are 10 meters apart.

[0083] Fourth: Easy to carry. The appearance of simultaneous interpretation headphones is not much different from ordinary headphones. They are small in size and have a long battery life.

[0084] The embodiment of the present invention also provides a mobile terminal, which is provided with a software program, wherein the software program enables the mobile terminal to execute the simultaneous interpretation method based on Bluetooth headset. The mobile terminal is a device such as a mobile phone, a tablet computer, etc.

[0085] The embodiment of the present invention also provides a Bluetooth headset, which includes at least one headset and a charging compartment. In addition to charging the headset, the charging compartment also needs to have an LCD display, a speaker for playing audio data, and a microphone for receiving sound. The charging compartment needs to have a Bluetooth IC that supports BT (Bluetooth Technology) and BLE (Bluetooth Low Energy) dual-mode communication. The headset is an ordinary Bluetooth headset that can realize BT and BLE communication.

[0086] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A simultaneous interpretation method based on Bluetooth headset, characterized in that: Applied to a mobile terminal, the Bluetooth headset includes at least one headset and a charging compartment, and the method includes: Establishing a connection between the mobile terminal and the Bluetooth headset, wherein the headset and the charging compartment are connected to the mobile terminal via Bluetooth technology, and are also connected to an application of the mobile terminal via Bluetooth low energy technology; When the headset or charging case needs to send voice information, it obtains voice transmission permission by seizing the Bluetooth technology link focus of the mobile terminal, and the other device that does not obtain permission switches to standby mode; The device that obtains the voice transmission permission collects voice information in the first language in real time, transmits the voice information to the mobile terminal, and translates the voice information in the first language into voice information in the target language; After the translation is completed, the other device grabs the link focus of the mobile terminal to obtain the voice playing authority, and plays the voice information in the target language.

2. The simultaneous interpretation method based on Bluetooth headset according to claim 1, characterized in that: Before the step of establishing a connection between the mobile terminal and the Bluetooth headset, the method further includes: Open the application of the mobile terminal and enter the simultaneous interpretation function module; Determine whether the mobile terminal is connected to the Bluetooth headset. If the mobile terminal is not connected to the Bluetooth headset, issue a prompt tone and enter a step of establishing a connection between the mobile terminal and the Bluetooth headset.

3. The simultaneous interpretation method based on Bluetooth headset according to claim 1, characterized in that: The step of transmitting the voice information to the mobile terminal and translating the voice information in the first language into voice information in the target language includes: The voice information is transmitted to a server, and the server translates the voice information in the first language into voice information in a target language based on a preset translation model; The server transmits the voice information in the target language to the mobile terminal, and determines whether the translation of the voice information in the target language is correct; If the translation of the target language voice information is correct, the step after the translation is completed is entered.

4. The simultaneous interpretation method based on Bluetooth headset according to claim 3, characterized in that: After the step of determining whether the translation of the speech information in the target language is wrong, the method further comprises: If the translation of the voice information in the target language is incorrect, the application of the mobile terminal sends an end-of-conversation instruction to the device that has obtained the voice transmission permission, and plays an end-of-conversation prompt tone; At the same time, the application of the mobile terminal sends a voice transmission permission change instruction to the charging compartment so that the other device obtains the voice transmission permission.

5. The simultaneous interpretation method based on Bluetooth headset according to claim 1, characterized in that: When the headset or the charging case needs to send voice information, the step of seizing the Bluetooth technology link focus of the mobile terminal includes: When the headset needs to send voice information, pressing the speech button of the application of the mobile terminal, and determining whether the headset occupies the Bluetooth technology link focus of the mobile terminal; If the headset does not occupy the Bluetooth technology link focus of the mobile terminal, the application of the mobile terminal issues an instruction to seize the Bluetooth technology link focus of the mobile terminal, so that the headset obtains the Bluetooth technology link focus of the mobile terminal; When the charging compartment needs to send a voice message, pressing the speech button on the screen of the charging compartment and determining whether the headset occupies the Bluetooth technology link focus of the mobile terminal; If the charging compartment does not occupy the Bluetooth technology link focus of the mobile terminal, the charging compartment is caused to issue an instruction to seize the Bluetooth technology link focus of the mobile terminal, so that the charging compartment obtains the Bluetooth technology link focus of the mobile terminal.

6. The simultaneous interpretation method based on Bluetooth headset according to claim 1, characterized in that: After the step of playing the voice information in the target language, the method further comprises: After playing the voice information in the target language, the application of the mobile terminal sends an instruction to change the voice transmission authority so that the other device obtains the voice transmission authority.

7. The simultaneous interpretation method based on Bluetooth headset according to claim 1, characterized in that: After the step of playing the voice information in the target language, the method further comprises: The user can stop playing the voice information in the target language at any time. After the playing is stopped, the application of the mobile terminal sends an instruction to change the voice transmission authority so that the other device obtains the voice transmission authority.

8. The simultaneous interpretation method based on Bluetooth headset according to claim 1, characterized in that: The target language is preset by a user in an application program of the mobile terminal.

9. A mobile terminal, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the steps of the simultaneous interpretation method based on Bluetooth headset as described in any one of claims 1 to 8 are implemented.

10. A Bluetooth headset, characterized in that: The Bluetooth headset includes at least one headset and a charging compartment, and the headset and the charging compartment both include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the steps of the simultaneous interpretation method based on Bluetooth headset as described in any one of claims 1 to 8 are implemented.

Images