A simultaneous translation method based on Bluetooth headset, a mobile terminal, and a Bluetooth headset

Abstract

This invention provides a simultaneous translation method, a mobile terminal, and a Bluetooth headset based on Bluetooth earphones. The method includes establishing a connection between the mobile terminal and the Bluetooth earphones, wherein the earphones and the charging case are connected to the mobile terminal via Bluetooth technology and also to an application on the mobile terminal via Bluetooth Low Energy technology. When the earphones or the charging case need to send voice information, they gain voice transmission permission by preempting the Bluetooth link focus of the mobile terminal. The device that gains voice transmission permission collects voice information in a first language in real time, transmits the voice information to the mobile terminal, and translates the first language voice information into voice information in a target language. After the translation is completed, another device preempts the link focus of the mobile terminal to gain voice playback permission and plays the voice information in the target language, thus enabling the Bluetooth earphones to perform simultaneous translation.

Description

Technical Field

[0001] This invention belongs to the field of audio processing technology, and specifically relates to a simultaneous translation method based on Bluetooth headsets, a mobile terminal, and Bluetooth headsets. Background Technology

[0002] When people travel to a foreign country, the first problem they often encounter is the language barrier, making it difficult to communicate effectively with locals. In this situation, tourists may have to use broken English to communicate with locals, but such communication is often fraught with difficulties, being both time-consuming and laborious. Another option is to use translation software, but this usually requires the user to type in text sentence by sentence, wait for the software to translate it into the local language, and then play it back for the other person. The other person also needs to repeat the same process, translating the conversation back into the user's language. While this method can achieve communication to some extent, the experience is far from ideal.

[0003] In business meetings, this cumbersome communication method is even more unsuitable because it fails to ensure both parties fully understand each other's needs, easily leading to misunderstandings. Therefore, there is an urgent market demand for a translation device that is portable, easy to operate, and supports multiple languages ​​to solve these communication problems. It is against this backdrop that AI simultaneous interpretation headphones have emerged.

[0004] Most Bluetooth headsets on the market currently only offer basic voice functions such as listening to music and making phone calls, and none can provide simultaneous translation. The emergence of AI simultaneous translation headsets aims to change this situation. Summary of the Invention

[0005] To address the aforementioned technical problems, this invention provides a simultaneous translation method based on a Bluetooth headset, a mobile terminal, and a Bluetooth headset, which solve the technical problems in the prior art.

[0006] On one hand, the invention provides the following technical solution: a simultaneous translation method based on Bluetooth headsets, applied to a mobile terminal, wherein the Bluetooth headsets include at least one earphone and a charging case, and the method includes:

[0007] A connection is established between the mobile terminal and the Bluetooth headset, wherein the headset and the charging case are connected to the mobile terminal via Bluetooth technology, and are also connected to the mobile terminal's application via Bluetooth Low Energy technology;

[0008] When the earphones or charging case need to send voice information, they obtain voice transmission permission by preempting the Bluetooth link focus of the mobile terminal, and the other device that has not obtained permission switches to standby mode.

[0009] The device that has obtained voice transmission permission collects voice information in a first language in real time, transmits the voice information to the mobile terminal, and translates the voice information in the first language into voice information in the target language.

[0010] After the translation is completed, the other device seizes the link focus of the mobile terminal to obtain the voice playback permission and plays the voice information in the target language.

[0011] Compared with the prior art, the beneficial effects of this application are as follows: by acquiring voice information in a first language in real time through a device with voice transmission permission, transmitting the voice information to the mobile terminal, and translating the voice information in the first language into voice information in the target language, the Bluetooth headset and charging case can both play and record. Then, the recording is translated through the mobile terminal, thereby enabling the Bluetooth headset to have the function of simultaneous translation.

[0012] Furthermore, prior to the step of establishing a connection between the mobile terminal and the Bluetooth headset, the method further includes:

[0013] Open the application on the mobile terminal and enter the simultaneous translation function module;

[0014] Determine whether the mobile terminal and the Bluetooth headset are connected. If the mobile terminal and the Bluetooth headset are not connected, issue a prompt tone and proceed to the step of establishing a connection between the mobile terminal and the Bluetooth headset.

[0015] Furthermore, the step of transmitting the voice information to the mobile terminal and translating the voice information in the first language into voice information in the target language includes:

[0016] The voice information is transmitted to the server, which translates the voice information in the first language into the voice information in the target language based on a preset translation model.

[0017] The server transmits the voice information of the target language to the mobile terminal and determines whether the translation of the voice information of the target language is correct.

[0018] If the translation of the target language speech information is correct, proceed to the step after the translation is completed.

[0019] Furthermore, after the step of determining whether the translation of the target language speech information is incorrect, the method further includes:

[0020] If the translation of the voice information in the target language is incorrect, the application of the mobile terminal sends an end-of-dialogue command to the device that has obtained voice transmission permission and plays an end-of-dialogue prompt tone.

[0021] Simultaneously, the mobile terminal's application sends a voice transmission permission change command to the charging case, so that the other device can obtain voice transmission permission.

[0022] Furthermore, the step of preempting the Bluetooth link focus of the mobile terminal when the earphones or charging case need to send voice information includes:

[0023] When the headset needs to send voice information, press the talk button of the mobile terminal's application and determine whether the headset occupies the Bluetooth link focus of the mobile terminal;

[0024] If the earphone does not occupy the Bluetooth link focus of the mobile terminal, the application of the mobile terminal issues an instruction to preempt the Bluetooth link focus of the mobile terminal, so that the earphone can obtain the Bluetooth link focus of the mobile terminal.

[0025] When the charging case needs to send voice information, press the talk button on the screen of the charging case and determine whether the earphone occupies the Bluetooth link focus of the mobile terminal;

[0026] If the charging case does not occupy the Bluetooth link focus of the mobile terminal, the charging case issues a command to preempt the Bluetooth link focus of the mobile terminal, so that the charging case obtains the Bluetooth link focus of the mobile terminal.

[0027] Furthermore, after the step of playing the voice information in the target language, the method further includes:

[0028] After playing the voice information in the target language, the application of the mobile terminal sends a command to change the voice transmission permission, so that the other device can obtain the voice transmission permission.

[0029] Furthermore, after the step of playing the voice information in the target language, the method further includes:

[0030] The user can stop the playback of the target language voice information at any time. After playback stops, the mobile terminal's application sends a command to change the voice transmission permission, so that the other device can obtain the voice transmission permission.

[0031] Furthermore, the target language is preset by the user in the application on the mobile terminal.

[0032] Secondly, the invention provides the following technical solution: a mobile terminal, including a memory, a processor, and a simultaneous translation program based on a Bluetooth headset stored in the memory and executable on the processor, wherein the simultaneous translation program based on the Bluetooth headset, when executed by the processor, implements the simultaneous translation method based on a Bluetooth headset as described in claim 1.

[0033] Thirdly, the invention provides the following technical solution: a Bluetooth headset, comprising at least one earphone and a charging case, wherein both the earphone and the charging case include: a memory, a processor, and a simultaneous translation program based on the Bluetooth headset stored in the memory and executable on the processor, wherein the simultaneous translation program based on the Bluetooth headset, when executed by the processor, implements the simultaneous translation method based on the Bluetooth headset as described in claim 1. Attached Figure Description

[0034] To more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0035] Figure 1 A flowchart of a simultaneous translation method based on Bluetooth headset provided in an embodiment of the present invention.

[0036] Figure 2 This is a schematic diagram of the structure of a simultaneous translation method based on Bluetooth headset provided in an embodiment of the present invention.

[0037] Figure 3 A flowchart illustrating the implementation of speech via the earpiece in an embodiment of the present invention.

[0038] Figure 4 This is a flowchart illustrating the implementation of voice communication at the charging compartment end in an embodiment of the present invention.

[0039] Figure 5 This is a schematic diagram illustrating the principle of simultaneous translation provided in an embodiment of the present invention.

[0040] The embodiments of the present invention will be further described below with reference to the accompanying drawings. Detailed Implementation

[0041] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain embodiments of the present invention, and should not be construed as limiting the present invention.

[0042] In the description of the embodiments of the present invention, it should be understood that the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing the embodiments of the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the present invention.

[0043] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of embodiments of the present invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0044] In an embodiment of the present invention, please refer to Figures 1 to 4 As shown, a simultaneous interpretation method based on Bluetooth headsets is applied to a mobile terminal. The Bluetooth headset includes at least one earbud and a charging case. Besides charging the earbuds, the smart charging case also needs an LCD display, a speaker for playing audio data, and a microphone for recording sound. The smart charging case requires a Bluetooth IC supporting both Bluetooth Technology (BT) and Bluetooth Low Energy (BLE) dual-mode communication. The earbuds are ordinary Bluetooth headsets capable of BT and BLE communication. Both the earbuds and the charging case need to be connected to the mobile phone via BT, and the app needs to be connected to the earbuds and charging case via BLE. The mobile phone needs to access the AIService server using the WebSocket API. The mobile phone needs an internet connection.

[0045] The simultaneous translation method based on Bluetooth headset includes the following steps S01 to S05:

[0046] S01, a connection is established between the mobile terminal and the Bluetooth headset, wherein the headset and the charging case are connected to the mobile terminal via Bluetooth technology, and are also connected to the application of the mobile terminal via Bluetooth Low Energy technology;

[0047] Specifically, before the step of establishing a connection between the mobile terminal and the Bluetooth headset, the method further includes:

[0048] S11, Open the application on the mobile terminal and enter the simultaneous translation function module;

[0049] S12, determine whether the mobile terminal and the Bluetooth headset are connected. If the mobile terminal and the Bluetooth headset are not connected, issue a prompt tone and proceed to the step of establishing a connection between the mobile terminal and the Bluetooth headset.

[0050] When the earphones send voice messages, open the TOZO APP, enter the simultaneous translation function module, and the APP checks whether the BT and BLE connections of the earphones and charging case are currently connected. If they are not connected, the APP should prompt the user that they need to be connected before they can be used.

[0051] When the charging case sends a voice message, it checks whether BitTorrent and BLE are currently connected. If not, a pop-up message prompts the user that BitTorrent and BLE need to be connected before use. If the connection is normal, proceed to the next step.

[0052] S02, when the earphone or charging case needs to send voice information, it obtains voice transmission permission by preempting the Bluetooth link focus of the mobile terminal, and the other device that has not obtained permission switches to standby mode;

[0053] Specifically, the step of preempting the Bluetooth link focus of the mobile terminal when the earphones or charging case need to send voice information includes:

[0054] When the headset needs to send voice information, press the talk button of the mobile terminal's application and determine whether the headset occupies the Bluetooth link focus of the mobile terminal;

[0055] If the earphone does not occupy the Bluetooth link focus of the mobile terminal, the application of the mobile terminal issues an instruction to preempt the Bluetooth link focus of the mobile terminal, so that the earphone can obtain the Bluetooth link focus of the mobile terminal.

[0056] When the charging case needs to send voice information, press the talk button on the screen of the charging case and determine whether the earphone occupies the Bluetooth link focus of the mobile terminal;

[0057] If the charging case does not occupy the Bluetooth link focus of the mobile terminal, the charging case issues a command to preempt the Bluetooth link focus of the mobile terminal, so that the charging case obtains the Bluetooth link focus of the mobile terminal.

[0058] In practical applications, when the earphones need to send voice messages, the app sends a command to the earphones to seize the Bluetooth BT link. The earphones check if there is currently a BT link focus; if not, they need to immediately seize the BT link focus from the phone. The earphones play a start-to-speak prompt, such as a "beep." After the prompt tone, they immediately send a start-to-speak command to the app, and the app sends a dialogue permission change command to the charging case. The talk button on the charging case is grayed out, and the app begins recording via the earphones' Bluetooth BT. When the charging case needs to send voice messages, it checks if it has a BT link focus. If not, the charging case needs to seize the BT link focus from the phone. If it does, the charging case plays a start-to-record prompt tone (a "beep") and sends a start-to-speak command to the app. The talk button on the earphones on the app is grayed out, preventing earphone talking, and the app begins recording via the charging case's Bluetooth BT.

[0059] S03, the device that has obtained voice transmission permission collects voice information in the first language in real time, transmits the voice information to the mobile terminal, and translates the voice information in the first language into voice information in the target language;

[0060] Specifically, the step of transmitting the voice information to the mobile terminal and translating the voice information in the first language into voice information in the target language includes:

[0061] The voice information is transmitted to the server, which translates the voice information in the first language into the voice information in the target language based on a preset translation model.

[0062] The server transmits the voice information of the target language to the mobile terminal and determines whether the translation of the voice information of the target language is correct.

[0063] If the translation of the target language speech information is correct, proceed to the step after the translation is completed.

[0064] In this embodiment, the server is an AI Service, which typically refers to various services and functions provided based on artificial intelligence technology.

[0065] Specifically, after the step of determining whether the translation of the target language speech information is incorrect, the method further includes:

[0066] If the translation of the voice information in the target language is incorrect, the application of the mobile terminal sends an end-of-dialogue command to the device that has obtained voice transmission permission and plays an end-of-dialogue prompt tone.

[0067] Simultaneously, the mobile terminal's application sends a voice transmission permission change command to the charging case, so that the other device can obtain voice transmission permission.

[0068] In practical application, when the earphones are recording, the user releases the talk button, the app stops recording, and the app sends a stop recording command to the earphones. The earphones play a "beep" sound to indicate the end of recording. Simultaneously, the app sends the recorded audio data to the server, which returns the translated audio data. Upon receiving the audio data from the server, the app first checks for errors. If an error is found, the app sends a stop conversation command to the earphones, which exit the conversation and play a stop conversation command (e.g., "beep beep"), while the app sends a conversation permission change command to the charging case, reactivating the talk button on the charging case. If no errors are found, the app sends a command to the charging case to seize the BT link focus, and then the app starts playing the translated audio data via the charging case's BT. After playback ends, the app again sends a conversation permission change command to the charging case, reactivating the talk button on the charging case.

[0069] In practical application, when the charging case is recording, the user releases the talk button on the charging case. The charging case sends a "stop recording command" to the APP, and the APP immediately stops recording. The charging case plays a stop recording prompt tone, such as a "click." Simultaneously, the APP sends the recorded data to the server, which returns the translated audio data. The APP checks the translated data returned by the server. If it is incorrect, the APP sends a "end conversation command" to the charging case, which displays "System error, end conversation," and the conversation ends. If it is correct, the APP sends a "seize BT link focus command" to the earphones. The earphones seize the BT link focus, and the APP plays the translated audio data through the earphones' BT. After playback, the earphone talk button on the APP is reactivated.

[0070] S04, after the translation is completed, the other device seizes the link focus of the mobile terminal to obtain the voice playback permission and plays the voice information in the target language.

[0071] Specifically, after the step of playing the voice information in the target language, the method further includes:

[0072] After playing the voice information in the target language, the application of the mobile terminal sends a command to change the voice transmission permission, so that the other device can obtain the voice transmission permission.

[0073] Specifically, after the step of playing the voice information in the target language, the method further includes:

[0074] The user can stop the playback of the target language voice information at any time. After playback stops, the mobile terminal's application sends a command to change the voice transmission permission, so that the other device can obtain the voice transmission permission.

[0075] Specifically, the target language is preset by the user in the application on the mobile terminal. In this embodiment, the target language can be one of the world's major languages, including English, Spanish, French, German, Portuguese, Italian, Dutch, Russian, Arabic, and Chinese.

[0076] In practical application, while the charging case is playing translated audio data, users can double-click the play button on the charging case at any time to stop playback. After stopping playback, the charging case returns to conversation mode. When the earbuds are playing translated voice data, users can click the stop button on the app at any time to stop playback. After stopping, the earbud's talk button on the app is reactivated.

[0077] Application Scenario: Xiaohua is meeting with an American client, Mike, today. Mike doesn't speak Chinese, and Xiaohua's English listening and speaking skills are also poor. In order to successfully complete Mike's order, Xiaohua needs someone to translate their conversation. This simultaneous interpretation headset would solve the translation problem perfectly.

[0078] Connect the earbuds and charging case to your phone, open the app, set the earbuds to Chinese and the charging case to English, then Xiaohua puts on the earbuds and places the charging case in front of her American customer. When Xiaohua speaks, she presses the talk button on the app and says, "Good morning, Mike," then releases her finger. The charging case will play "Good morning, Mike." Then Mike presses the talk button on the charging case and says, "Good morning, Miss Hua," then releases his finger. The earbuds will play "Good morning, Miss Hua." By repeating this process, Xiaohua and Mike can easily have a cross-language conversation.

[0079] In summary, a simultaneous translation method based on Bluetooth headsets has the following effects:

[0080] First, it solves the translation problem, supporting 10 major world languages ​​including English, Spanish, French, German, Portuguese, Italian, Dutch, Russian, Arabic, and Chinese.

[0081] Second: Conversation is convenient. One person wears an earphone, speaks and listens in Chinese, while the other speaks and listens in English into the earphone's charging battery.

[0082] Third: Long transmission distance. Bluetooth transmission distance can generally reach about 10 meters, so two people can have a normal conversation even if they are 10 meters apart.

[0083] Fourth: It is easy to carry. The simultaneous translation headset is not much different in appearance from ordinary headsets. It is small in size and has a long battery life.

[0084] This invention also provides a mobile terminal equipped with a software program that enables the mobile terminal to execute a simultaneous interpretation method based on a Bluetooth headset. The mobile terminal is a device such as a mobile phone or tablet computer.

[0085] This invention also provides a Bluetooth headset, which includes at least one earbud and a charging case. The charging case, in addition to charging the earbuds, also includes an LCD display, a speaker for playing audio data, and a microphone. The charging case contains a Bluetooth IC supporting both Bluetooth Technology (BT) and Bluetooth Low Energy (BLE) dual-mode communication. The earbuds are ordinary Bluetooth headsets capable of both BT and BLE communication.

[0086] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A simultaneous translation method based on Bluetooth headset, characterized in that, Applied to a mobile terminal, the Bluetooth headset includes at least one earphone and a charging case, and the method includes: A connection is established between the mobile terminal and the Bluetooth headset, wherein the headset and the charging case are connected to the mobile terminal via Bluetooth technology, and are also connected to the mobile terminal's application via Bluetooth Low Energy technology; When the earphones or charging case need to send voice information, they obtain voice transmission permission by preempting the Bluetooth link focus of the mobile terminal, and the other device that has not obtained permission switches to standby mode. The device that has obtained voice transmission permission collects voice information in a first language in real time, transmits the voice information to the mobile terminal, and translates the voice information in the first language into voice information in the target language. After the translation is completed, the other device seizes the link focus of the mobile terminal to obtain the voice playback permission and plays the voice information in the target language; The step of transmitting the voice information to the mobile terminal and translating the voice information in the first language into voice information in the target language includes: The voice information is transmitted to the server, which translates the voice information in the first language into the voice information in the target language based on a preset translation model. The server transmits the voice information of the target language to the mobile terminal and determines whether the translation of the voice information of the target language is correct. If the translation of the speech information in the target language is correct, proceed to the step after the translation is completed; After the step of determining whether the translation of the target language speech information is correct, the method further includes: If the translation of the voice information in the target language is incorrect, the application of the mobile terminal sends an end-of-dialogue command to the device that has obtained voice transmission permission and plays an end-of-dialogue prompt tone. Simultaneously, the mobile terminal's application sends a voice transmission permission change command to the charging case, so that the other device can obtain voice transmission permission.

2. The simultaneous translation method based on Bluetooth headset according to claim 1, characterized in that, Prior to the step of establishing a connection between the mobile terminal and the Bluetooth headset, the method further includes: Open the application on the mobile terminal and enter the simultaneous translation function module; Determine whether the mobile terminal and the Bluetooth headset are connected. If the mobile terminal and the Bluetooth headset are not connected, issue a prompt tone and proceed to the step of establishing a connection between the mobile terminal and the Bluetooth headset.

3. The simultaneous translation method based on Bluetooth headset according to claim 1, characterized in that, The step of preempting the Bluetooth link focus of the mobile terminal when the earphones or charging case need to send voice information includes: When the headset needs to send voice information, press the talk button of the mobile terminal's application and determine whether the headset occupies the Bluetooth link focus of the mobile terminal; If the earphone does not occupy the Bluetooth link focus of the mobile terminal, the application of the mobile terminal issues an instruction to preempt the Bluetooth link focus of the mobile terminal, so that the earphone can obtain the Bluetooth link focus of the mobile terminal. When the charging case needs to send voice information, press the talk button on the screen of the charging case and determine whether the earphone occupies the Bluetooth link focus of the mobile terminal; If the charging case does not occupy the Bluetooth link focus of the mobile terminal, the charging case issues a command to preempt the Bluetooth link focus of the mobile terminal, so that the charging case obtains the Bluetooth link focus of the mobile terminal.

4. The simultaneous translation method based on Bluetooth headset according to claim 1, characterized in that, After the step of playing the voice information in the target language, the method further includes: After playing the voice information in the target language, the application of the mobile terminal sends a command to change the voice transmission permission, so that the other device can obtain the voice transmission permission.

5. The simultaneous translation method based on Bluetooth headset according to claim 1, characterized in that, After the step of playing the voice information in the target language, the method further includes: The user can stop the playback of the target language voice information at any time. After playback stops, the mobile terminal's application sends a command to change the voice transmission permission, so that the other device can obtain the voice transmission permission.

6. The simultaneous translation method based on Bluetooth headset according to claim 1, characterized in that, The target language is preset by the user in the application on the mobile terminal.

7. A mobile terminal, characterized in that, The system includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when executed by the processor, the computer program implements the steps of the simultaneous translation method based on a Bluetooth headset as described in any one of claims 1 to 6.

8. A Bluetooth headset, characterized in that, The invention includes Bluetooth earphones, the Bluetooth earphones comprising at least one earphone and a charging case, both the earphones and the charging case comprising: The memory, the processor, and the computer program stored in the memory and executable on the processor, wherein when executed by the processor, the computer program implements the steps of the simultaneous translation method based on a Bluetooth headset as described in any one of claims 1 to 6.

Images