Audio translation system and method based on translation earphone

Abstract

The audio translation system comprises the translation earphone and an intelligent terminal which communicate with each other, and the intelligent terminal is provided with third-party audio software and audio translation software; after receiving original audio data from the third-party audio software, the translation earphone copies the original audio data and sends the copied audio data to the audio translation software for voice translation, and the intelligent terminal sends the audio data translated by the audio translation software to the translation earphone for playing. According to the system and the method, the audio data of the third-party audio software is copied through the translation earphone and then sent to the audio translation software to be translated, and finally the translated audio data is sent to the translation earphone to be played, so that real-time translation of the audio data of the third-party audio and video playing software is realized; and the translation efficiency is improved. In addition, the system reduces the audio signal transmission sampling rate of the audio data copied by the translation earphone through the sampling rate conversion module, so that the data processing complexity of audio translation software is reduced.

Description

Technical Field

[0001] This invention relates to the field of speech translation, and more specifically, to an audio translation system and method based on translation headphones. Background Technology

[0002] As the most important communication tool in modern society, smartphones have brought great convenience to people's lives and work. With the development of science and technology and society, cross-border communication and exchanges are very frequent, but language barriers have greatly affected communication efficiency.

[0003] In existing technologies, translation software is embedded in mobile phones or computers to achieve translation functions. However, this embedded translation software cannot directly translate the audio from third-party audio and video playback software. This is because the audio data of third-party audio and video playback software (such as telephone calling software, WeChat, TikTok, music players, and movie players) is not publicly available to the translation software embedded in the phone. In other words, the translation software cannot directly obtain audio data from third-party audio and video playback software, thus preventing the translation software from performing real-time translation of the audio data from third-party audio and video playback software. Summary of the Invention

[0004] The purpose of this invention is to overcome the defects and shortcomings of the prior art and provide an audio translation system based on a translation headset. This system copies the audio data from third-party audio software through the translation headset and sends it to the audio translation software for translation. Finally, the translated audio data is sent back to the translation headset for playback, thereby realizing real-time translation of audio data from third-party audio and video playback software and improving translation efficiency.

[0005] To achieve the above objectives, the present invention provides an audio translation system based on a translation headset, the audio translation system comprising a translation headset and a smart terminal, wherein the translation headset and the smart terminal are communicatively connected to each other; the smart terminal is equipped with third-party audio software and audio translation software; The third-party audio software is the source of the original audio data, which is then sent to the translation headphones for playback. After receiving raw audio data from the third-party audio software, the translation earphone copies the raw audio data and sends the copied audio data to the audio translation software for voice translation. The smart terminal then sends the audio data translated by the audio translation software to the translation earphone for playback.

[0006] According to one embodiment of the present invention, the translation headset includes a first audio decoding module, a second audio decoding module, an audio encoding module, an audio data stream copying module, a traditional Bluetooth communication module, a low-power Bluetooth communication module, and an audio playback speaker; The third-party audio software transmits the original audio data to the translation headset via the traditional Bluetooth communication module. The first audio decoding module decodes the audio data into playable audio data. The audio data stream copying module copies the playable audio data, and the audio encoding module encodes the copied audio data. The encoded audio data is transmitted to the audio translation software via the low-power Bluetooth communication module for voice translation. The smart terminal transmits the translated audio data to the second audio decoding module via the low-power Bluetooth communication module for decoding. Finally, the audio playback speaker plays the audio data decoded by the second audio decoding module.

[0007] According to one embodiment of the present invention, the translation headset further includes a sampling rate conversion module. The audio data stream copying module copies the playable audio data and transmits the copied playable audio data to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting a high audio signal transmission sampling rate to a low audio signal transmission sampling rate. Then, the audio data with the reduced sampling rate is encoded by the audio encoding module. The encoded audio data is transmitted to the audio translation software for speech translation via the low-power Bluetooth communication module. The smart terminal transmits the translated audio data to a second audio decoding module for decoding via the low-power Bluetooth communication module. The audio data decoded by the second audio decoding module is then transmitted to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting a low audio signal transmission sampling rate to a high audio signal transmission sampling rate. Finally, the audio data with the increased sampling rate is played by the audio playback speaker.

[0008] According to one embodiment of the present invention, the signal transmission sampling rate between the third-party audio software and the translation headset is 44.1 kHz, and the signal transmission sampling rate between the audio translation software and the translation headset is 16 kHz.

[0009] According to one embodiment of the present invention, the smart terminal includes a smartphone, a computer, and a tablet computer.

[0010] Another object of the present invention is to provide an audio translation method based on translation headphones, the audio translation method comprising the following steps: S1. Raw audio data is sent by a third-party audio software on a smart terminal. S2. The raw audio data is transmitted to the translation headset via a traditional Bluetooth communication module; S3. The translation earphone copies the original audio data and sends the copied audio data to the smart terminal via a low-power Bluetooth communication module, where the audio translation software performs voice translation. S4. The smart terminal sends the translated audio data to the translation earphones for playback via a low-power Bluetooth communication module.

[0011] According to one embodiment of the present invention, after the third-party audio software transmits the original audio data to the translation earphone via the conventional Bluetooth communication module, the translation earphone decodes it into playable audio data via the first audio decoding module, the playable audio data is copied by the audio data stream copying module, and the copied audio data is encoded by the audio encoding module. The encoded audio data is transmitted to the audio translation software for speech translation via the low-power Bluetooth communication module, and the smart terminal transmits the translated audio data to the second audio decoding module for decoding via the low-power Bluetooth communication module. Finally, the audio playback speaker plays the audio data decoded by the second audio decoding module.

[0012] According to one embodiment of the present invention, the audio data stream copying module copies playable audio data and transmits the copied playable audio data to a sampling rate conversion module for audio signal transmission sampling rate conversion, converting the 44.1kHz audio signal transmission sampling rate to 16kHz. Then, the audio encoding module encodes the 16kHz audio data, and the encoded audio data is transmitted to the audio translation software for speech translation via the Bluetooth Low Energy communication module. The smart terminal transmits the translated audio data to a second audio decoding module for decoding via the Bluetooth Low Energy communication module, and transmits the decoded audio data to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting the 16kHz audio signal transmission sampling rate to 44.1kHz. Finally, the audio playback speaker plays the 44.1kHz audio data.

[0013] Compared with existing technologies, the present invention has the following advantages: The present invention provides an audio translation system and method based on translation headphones. This system copies audio data from third-party audio software using translation headphones and sends it to the audio translation software for translation. Finally, the translated audio data is sent back to the translation headphones for playback, thereby achieving real-time translation of audio data from third-party audio and video playback software and improving translation efficiency. Furthermore, the system of the present invention reduces the audio signal transmission sampling rate of the audio data copied by the translation headphones through a sampling rate conversion module, thereby reducing the data processing complexity of the audio translation software. Attached Figure Description

[0014] Figure 1 This is a block diagram illustrating the principle of the audio translation system based on translation headphones according to the present invention. Figure 2 This is a flowchart of the audio translation method based on translation headphones according to the present invention; Figure 3 This is a schematic diagram of an embodiment of the present invention. Detailed Implementation

[0015] The technical solution of the present invention will be further described in detail below with reference to specific embodiments.

[0016] like Figure 1 The diagram shown is a principle block diagram of an audio translation system based on a translation headset according to the present invention. The audio translation system includes a translation headset and a smart terminal. The translation headset and the smart terminal are interconnected. The smart terminal is equipped with third-party audio software and audio translation software. In this embodiment, the smart terminal is typically an electronic device such as a mobile phone, tablet computer, or laptop computer. The third-party audio software and audio translation software are applications installed on the mobile phone, tablet computer, or laptop computer. Since the data between different applications is independent, the audio translation software cannot directly access the data from the third-party audio software, thus preventing the audio translation software from translating the audio data from the third-party audio software. The communication method between the translation headset and the smart terminal is typically dual-mode Bluetooth communication. This provides more accurate and clearer raw audio data while quickly implementing audio translation, reducing data processing complexity. When the third-party audio software sends raw audio data to the translation headset, a traditional Bluetooth communication module is used for data transmission; when the translation headset communicates with the audio translation software, a low-power Bluetooth communication module is used for data transmission.

[0017] Third-party audio software on a smart terminal is the source of the original audio data. Normally, the original audio data is sent to the translation headset and played. This invention aims to translate the audio data from the third-party audio software on the smart terminal. When the translation headset receives the original audio data from the third-party audio software, it copies the original audio data and sends the copied audio data to the audio translation software for speech translation. The smart terminal then sends the translated audio data back to the translation headset for playback. This achieves the translation of the audio data from the third-party audio software. Figure 2 As shown.

[0018] like Figure 1As shown, the translation earphone of this invention includes a first audio decoding module, a second audio decoding module, an audio encoding module, an audio data stream copying module, a traditional Bluetooth communication module, a low-power Bluetooth communication module, and an audio playback speaker. In this embodiment of the invention, the translation earphone also includes other hardware modules to achieve its normal function, such as a processor, a memory, and a power supply module. Since the main innovation of this invention is to obtain audio data from third-party audio software through the translation earphone and send the audio data to the audio translation software for translation, other existing technologies are not described in detail.

[0019] In this embodiment of the invention, third-party audio software transmits the original audio data to the translation headset via a traditional Bluetooth communication module. The headset is then decoded into playable audio data by a first audio decoding module. An audio data stream copying module copies the playable audio data, and an audio encoding module encodes the copied audio data. The encoded audio data is transmitted to the audio translation software via a low-power Bluetooth communication module for speech translation. The smart terminal then transmits the translated audio data to a second audio decoding module via the same low-power Bluetooth communication module for further decoding. Finally, the audio playback speaker plays the audio data decoded by the second audio decoding module. In this embodiment, the encoded audio data is transmitted to the audio translation software via the low-power Bluetooth communication module for speech translation. Speech translation typically employs existing technologies, such as sending the received audio signal to a cloud-based translation engine or using a local translation system. Furthermore, the choice of translation language can be set on the smart terminal; these are existing technologies and are not described in detail in this invention.

[0020] In embodiments of the present invention, such as Figure 3 As shown, the translation headset also includes a sampling rate conversion module and an audio data stream copying module. The copied playable audio data is copied and transmitted to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting a high audio signal transmission sampling rate to a low one. Then, the audio data with the reduced sampling rate is encoded by an audio encoding module. The encoded audio data is transmitted to the audio translation software for voice translation via a low-power Bluetooth communication module. The smart terminal transmits the translated audio data to a second audio decoding module for decoding via the low-power Bluetooth communication module. The decoded audio data is then transmitted to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting a low audio signal transmission sampling rate to a high one. Finally, the audio playback speaker plays the audio data with the increased sampling rate. In this embodiment, the signal transmission sampling rate between the third-party audio software and the translation headset is 44.1 kHz, and the signal transmission sampling rate between the audio translation software and the translation headset is 16 kHz.

[0021] Another object of the present invention is to provide an audio translation method based on translation headphones, the audio translation method comprising the following steps: S1. Raw audio data is sent by a third-party audio software on a smart terminal. S2. Raw audio data is transmitted to the translation headset via a traditional Bluetooth communication module; S3, the translation earphone copies the original audio data and sends the copied audio data to the smart terminal via the low-power Bluetooth communication module, where the audio translation software performs voice translation; S4. The smart terminal sends the translated audio data to the translation earphones for playback via a low-power Bluetooth communication module.

[0022] After the third-party audio software transmits the raw audio data to the translation earphone via a traditional Bluetooth communication module, the translation earphone decodes it into playable audio data through the first audio decoding module. The audio data stream copying module copies the playable audio data, and the audio encoding module encodes the copied audio data. The encoded audio data is then transmitted to the audio translation software for voice translation via a low-power Bluetooth communication module. The smart terminal transmits the translated audio data to the second audio decoding module for decoding via the low-power Bluetooth communication module. Finally, the audio playback speaker plays the audio data decoded by the second audio decoding module.

[0023] In this embodiment of the invention, the audio data stream copying module copies the playable audio data and transmits the copied playable audio data to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting the 44.1kHz audio signal transmission sampling rate to 16kHz. Then, the audio data with a sampling rate of 16kHz is encoded by the audio encoding module. The encoded audio data is transmitted to the audio translation software for speech translation via the low-power Bluetooth communication module. The smart terminal transmits the translated audio data to the second audio decoding module for decoding via the low-power Bluetooth communication module. The audio data after decoding by the second audio decoding module is transmitted to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting the 16kHz audio signal transmission sampling rate to 44.1kHz. Finally, the audio playback speaker plays the audio data with a sampling rate of 44.1kHz.

[0024] In summary, this invention provides an audio translation system and method based on translation earphones. The system copies audio data from third-party audio software using translation earphones and sends it to the audio translation software for translation. Finally, the translated audio data is sent back to the translation earphones for playback, thus achieving real-time translation of audio data from third-party audio and video playback software and improving translation efficiency. Furthermore, the system uses a sampling rate conversion module to reduce the audio signal transmission sampling rate of the audio data copied by the translation earphones, thereby reducing the data processing complexity of the audio translation software.

[0025] The preferred embodiments of the present invention have been described in detail above. However, the present invention is not limited to the above embodiments. Within the scope of knowledge possessed by those skilled in the art, various changes can be made without departing from the spirit of the present invention.

Claims

1. An audio translation system based on translation headphones, characterized in that, The audio translation system includes translation earphones and a smart terminal, and the translation earphones and the smart terminal are interconnected; the smart terminal is equipped with third-party audio software and audio translation software. The third-party audio software is the source of the original audio data, which is then sent to the translation headphones for playback. After receiving raw audio data from the third-party audio software, the translation earphone copies the raw audio data and sends the copied audio data to the audio translation software for voice translation. The smart terminal then sends the audio data translated by the audio translation software to the translation earphone for playback.

2. The audio translation system based on translation headphones according to claim 1, characterized in that, The translation headset includes a first audio decoding module, a second audio decoding module, an audio encoding module, an audio data stream copying module, a traditional Bluetooth communication module, a low-power Bluetooth communication module, and an audio playback speaker; The third-party audio software transmits the original audio data to the translation headset via the traditional Bluetooth communication module. The first audio decoding module decodes the audio data into playable audio data. The audio data stream copying module copies the playable audio data, and the audio encoding module encodes the copied audio data. The encoded audio data is transmitted to the audio translation software via the low-power Bluetooth communication module for voice translation. The smart terminal transmits the translated audio data to the second audio decoding module via the low-power Bluetooth communication module for decoding. Finally, the audio playback speaker plays the audio data decoded by the second audio decoding module.

3. The audio translation system based on translation headphones according to claim 2, characterized in that, The translation headset also includes a sampling rate conversion module. The audio data stream copying module copies the playable audio data and transmits the copied playable audio data to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting a high audio signal transmission sampling rate to a low audio signal transmission sampling rate. Then, the audio data with the reduced sampling rate is encoded by the audio encoding module. The encoded audio data is transmitted to the audio translation software for speech translation via the low-power Bluetooth communication module. The smart terminal transmits the translated audio data to the second audio decoding module for decoding via the low-power Bluetooth communication module. The audio data decoded by the second audio decoding module is then transmitted to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting a low audio signal transmission sampling rate to a high audio signal transmission sampling rate. Finally, the audio playback speaker plays the audio data with the increased sampling rate.

4. An audio translation system based on translation headphones according to claim 3, characterized in that, The signal transmission sampling rate between the third-party audio software and the translation headset is 44.1 kHz, and the signal transmission sampling rate between the audio translation software and the translation headset is 16 kHz.

5. An audio translation system based on translation headphones according to claim 1, characterized in that, The smart terminals include smartphones, computers, and tablets.

6. An audio translation method based on translation headphones, characterized in that, The audio translation method includes the following steps: S1. Raw audio data is sent by a third-party audio software on a smart terminal. S2. The raw audio data is transmitted to the translation headset via a traditional Bluetooth communication module; S3. The translation earphone copies the original audio data and sends the copied audio data to the smart terminal via a low-power Bluetooth communication module, where the audio translation software performs voice translation. S4. The smart terminal sends the translated audio data to the translation earphones for playback via a low-power Bluetooth communication module.

7. The audio translation method based on translation headphones according to claim 6, characterized in that, After the third-party audio software transmits the original audio data to the translation earphone via the traditional Bluetooth communication module, the translation earphone decodes it into playable audio data through the first audio decoding module. The playable audio data is then copied by the audio data stream copying module, and the copied audio data is encoded by the audio encoding module. The encoded audio data is transmitted to the audio translation software for voice translation via the low-power Bluetooth communication module. The smart terminal then transmits the translated audio data to the second audio decoding module for decoding via the low-power Bluetooth communication module. Finally, the audio playback speaker plays the audio data decoded by the second audio decoding module.

8. The audio translation method based on translation headphones according to claim 7, characterized in that, The audio data stream copying module copies the playable audio data and transmits the copied playable audio data to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting the 44.1kHz audio signal transmission sampling rate to 16kHz. Then, the audio encoding module encodes the 16kHz audio data. The encoded audio data is transmitted to the audio translation software for speech translation via the low-power Bluetooth communication module. The smart terminal transmits the translated audio data to the second audio decoding module for decoding via the low-power Bluetooth communication module. The decoded audio data is then transmitted to the sampling rate conversion module for audio signal transmission sampling rate conversion, converting the 16kHz audio signal transmission sampling rate to 44.1kHz. Finally, the audio playback speaker plays the 44.1kHz audio data.

Images