System for realizing synchronization of delay glasses and real-time translation earphone

Abstract

The invention relates to a system for realizing synchronization of translated voice and visual information, which specifically comprises delay glasses and a translation earphone, and solves the problem of mismatching of voice and mouth shape in multi-language communication through combination of delay display and real-time translation. And the delay glasses receive delay information fed back by the translation earphone, and dynamically adjust and display delay, so that the mouth shape change seen by the wearer is synchronized with the translated voice. The delay glasses of the system comprise a control module, a processing chip, a display module, a wireless communication module and a noise monitoring module, and delay display can be accurately controlled. The translation earphone comprises a voice recognition module, a real-time translation module, a delay matching module and an active noise reduction module, translates multiple languages in real time and shields original voice. The overall design improves the naturalness of cross-language communication, enables visual and auditory information to be coordinated and consistent, and is especially suitable for a real-time communication scene in a multi-language environment.

Description

Technical Field

[0001] The invention relates to the field of translation and real-time synchronization, in particular to a system for visually synchronizing the speech output of a real-time translation headset with the changes in the speaker's mouth shape. Background Art

[0002] With the development of globalization, cross-language communication is becoming more and more frequent. Existing translation headsets can provide multi-language translation services, but their voice output cannot be synchronized with the speaker's mouth shape changes in real time, resulting in a mismatch between visual and auditory information, affecting the communication experience. Current technology has not yet provided a system that can synchronize the translation voice with the visual mouth shape changes, thereby achieving a smooth cross-language communication experience. Summary of the invention

[0003] The present invention proposes a time-delay glasses and translation headset synchronization system. The system includes time-delay glasses and translation headsets, and solves the problem of inconsistency between voice output and mouth shape changes in current translation headsets by synchronizing the mouth shape changes displayed in the glasses with the translated voice output in the translation headset, making cross-language communication more natural.

[0004] Technical principle The system receives the delayed feedback provided by the translation headset through the control module of the time-delay glasses, and adjusts the display time of the mouth shape change according to the delay time of the translation in the translation headset, so that the image of the time-delay glasses is synchronized with the translated speech. The translation headset recognizes the original speech in real time and translates it into the target language speech, and transmits the delay information to the time-delay glasses through the delay matching module to achieve the synchronous output of audio and visual information.

[0005] Beneficial Effects

[0006] (1) Improved synchronization: This system achieves synchronous output of vision and hearing by combining time-delay glasses with translation headphones, solving the problem of asynchrony between vision and hearing in existing translation headphones.

[0007] (2) Delay adjustability: The time-delay glasses can automatically adjust the display delay by receiving delayed feedback from the translation headphones, which is suitable for translation needs in different languages.

[0008] (3) User experience optimization: This system synchronizes visual mouth shape changes with translated speech, significantly improving the naturalness and user experience in cross-language communication.

[0009] (4) Active noise reduction: The translation headset is integrated with an active noise reduction module to effectively reduce external noise interference, allowing the wearer to receive the translated voice more clearly.

[0010] (5) Portability and ease of use: The system is designed to be suitable for portable devices. Users only need to wear time-delay glasses and translation headphones to achieve a smooth cross-language communication experience.

[0011] Implementation feasibility The implementation of this system mainly relies on existing speech recognition, translation and delayed display technologies. Existing speech recognition and real-time translation technologies are relatively mature, and delayed glasses can use micro-displays and wireless communication modules to achieve low-latency display. The overall technical framework is ready for implementation and can be commercialized when the hardware is further optimized in the future. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 This is a schematic diagram of the overall structure of the system, including the delay glasses module, the translation headphone module, the control signal feedback path, and the display and audio output path.

[0013] Figure 2 This is a flowchart of the system workflow, including original voice signal reception, voice recognition and translation processing, delay time calculation and synchronization control, translated voice output to headphones, and delay glasses to display mouth shape changes.

[0014] Figure 3 This is the module diagram of the time-delay glasses, which includes the following modules: Control module: receives delayed feedback signal and controls display time;

[0015] Processing chip: calculates the number of frames required for delayed display;

[0016] Display module: displays the mouth shape changes in the wearer’s field of vision with a time delay;

[0017] Wireless communication module: communicate with the translation headset and transmit delay information;

[0018] Noise monitoring module: detects environmental noise and adaptively adjusts delay.

[0019] Figure 4 To translate the headphone module diagram, it includes the following modules: Speech recognition module: recognizes original speech and analyzes language;

[0020] Real-time translation module: translate speech into target language;

[0021] Delay matching module: calculates and feeds back the delay to the delay glasses;

[0022] Active noise reduction module: reduces external noise interference;

[0023] Audio output unit: plays the translated voice signal. DETAILED DESCRIPTION Example 1: Implementation of time-delay glasses

[0024] The time-delay glasses include a control module, a processing chip, a display module, a wireless communication module, and a noise monitoring module. After receiving the delay information provided by the translation headset, the time-delay glasses adjust the display delay through the control module. The processing chip is responsible for calculating the number of frames required for delayed display, and the display module displays the processed image in the wearer's field of view.

[0025] Implementation steps (1) The original speech signal enters the translation headset, and the speech recognition module in the translation headset recognizes and translates the speech.

[0026] (2) While the translation module transmits the translated speech signal to the output unit, the delay matching module calculates the delay time.

[0027] (3) The wireless communication module of the time-delay glasses receives the delay information from the translation headphones and starts the time-delay display mode through the control module.

[0028] (4) The delayed display module delays the display of mouth shape changes to ensure synchronization with the translated speech. Embodiment 2: Implementation of translation earphones

[0029] The translation headset includes a speech recognition module, a real-time translation module, a delay matching module, an active noise reduction module and an audio output unit. The speech recognition module of the translation headset recognizes the language and content of the original speech signal, the real-time translation module translates the recognized speech into the target language in real time, and the delay matching module transmits the delay information to the delay glasses to achieve synchronization between the translated speech and the delay display.

[0030] Implementation steps (1) The translation headset receives external voice signals and identifies the language and content through the voice recognition module.

[0031] (2) The real-time translation module translates the recognition results into target language speech.

[0032] (3) The delay matching module monitors the delay during the translation process and sends delay feedback to the control module of the delay glasses.

[0033] (4) The active noise reduction module reduces external interference sounds to ensure the clarity of the translated audio.

[0034] (5) The translated voice signal is transmitted to the audio output unit for the wearer to listen to.

Claims

1. A system for achieving synchronization of vision and translated speech, the system comprising time-delay glasses and translation headphones, wherein: The time-delay glasses are used to capture and delay the display of the speaker's mouth shape changes, so that the mouth shape changes seen by the wearer are synchronized with the translated speech output from the translation headset; The translation headset is used to receive the original voice signal of the speaker, translate the original voice signal into a target language voice signal in real time, and output the target language voice signal to the wearer; The time-delay glasses include: a control module for receiving delayed signal feedback from a translation headset, and adjusting the delay time of the mouth shape change display according to the delayed signal feedback to ensure that the display of the time-delay glasses is consistent with the output time of the translation headset.

2. The system according to claim 1, wherein: The time-delay glasses further include: A noise monitoring module is used to detect the current environmental noise. The noise monitoring module is connected to the control module and adjusts the display delay and the synchronization of the translated voice output according to the environmental noise.

3. The system according to claim 1, wherein: The translation headset further comprises: A speech recognition module, used to recognize and separate the languages ​​in the original speech signal; A real-time translation module for translating the recognized original speech signal into a target language; The delay matching module is used to send the required delay time information to the delay glasses to synchronize the translated speech output with the display of the delay glasses.

4. The system according to claim 1, wherein: The control module of the time-delay glasses comprises: A processing chip for analyzing delayed feedback data transmitted by the translation headset; A display module is used to present the mouth shape changes in the wearer's field of view with a preset delay to match the speech output in the translation headset.

5. The system according to claim 1, wherein: The translation headset includes: The AI ​​prediction module is used to predict sentence structure during speech translation to optimize the match between speech and delayed display.

6. The system according to claim 1, wherein: The time-delay glasses further include: A wireless communication module configured to communicate data with the translation headset via a wireless connection to achieve real-time adjustment of delay control and feedback.

7. The system according to claim 1, wherein: The delayed display time of the time-delay glasses can be adjusted through a mobile phone application, and the mobile phone application is connected to the control modules of the time-delay glasses and the translation headset, so that the user can customize the delay time according to the translation delay requirements of different languages.

8. The system according to claim 1, wherein: The translation headset also includes an active noise reduction module for reducing noise, so as to reduce external original voice interference received by the wearer and ensure the clarity of the translated voice.

Images