Communication Terminal Audio-Text Synchronization via Preliminary Action
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional videoconference systems experience a time lag between audio data reproduction and text data display due to the sequential processing of audio data conversion to text data, where audio data is reproduced before text data is available for display, leading to a mismatch between the two.
Innovation Solution
A communication terminal that collects audio data, transmits it to a speech recognition apparatus via a network, and synchronizes the reproduction of audio data with the display of text data by suspending audio data reproduction until the text data is received from the speech recognition process, ensuring that audio and text data correspond in time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If audio data is transmitted to speech recognition apparatus and text data is displayed after conversion, then text data accuracy is improved, but time lag between audio reproduction and text display increases
Solution Approach 1:
The system performs preliminary actions by transmitting audio data to the speech recognition apparatus in advance and preparing text data before audio reproduction starts. The communication terminal sends audio data to the speech recognition apparatus, receives the converted text data, and stores it ready for display, eliminating the time lag between audio playback and text appearance.
2Speed
If audio data is reproduced before text data is received, then real-time audio output is maintained, but synchronization between audio and text deteriorates
Solution Approach 1:
The system performs preliminary conversion of audio data to text data before audio reproduction begins. The communication terminal transmits audio data to the speech recognition apparatus, receives the text data in advance, and stores it in memory. When audio reproduction starts, the corresponding text data is already ready and displayed simultaneously, maintaining both real-time audio output and perfect synchronization.
Data Source
AI summary
A communication terminal includes circuitry. The circuitry receives audio data collected by an audio collecting device, and transmits the audio data to a speech recognition apparatus via a network. The circuitry further receives text data, which is a result of speech recognition of the audio data, from the speech recognition apparatus, reproduces the audio data, and displays the text data on a display device during a period in which the audio data is being reproduced.