Dynamic Caption Update via Transcript Replacement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current communication systems experience significant latency delays when transcribing audio data into text captions, particularly for long sentences, which degrades the interactive experience for users.

Innovation Solution

A method where a client receives a transcript and sentence identifier from a service server, updates the displayed caption content dynamically by replacing or updating it based on differences, allowing for real-time caption display without waiting for complete transcription, thereby reducing latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the server issues transcribed texts to the client after finishing transcribing audio data of each sentence, then the transcription accuracy is improved, but the caption latency increases

Engineering Contradiction:
Improvetranscription accuracyVSAvoidcaption latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by displaying intermediate transcription results as soon as they are available, rather than waiting for the complete transcription to finish. This allows the client to show captions dynamically during the transcription process, reducing latency while maintaining the ability to update with more accurate results when available.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements dynamic caption display by continuously updating the displayed text based on the transcription progress. The caption can change from intermediate results to final accurate transcriptions in real-time, making the system adaptable between speed and accuracy requirements.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If the server waits for complete sentence transcription before displaying captions, then the transcription quality is improved, but the interactive experience deteriorates

Engineering Contradiction:
Improvetranscription qualityVSAvoidinteractive experience
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system displays preliminary transcription results immediately when available, providing immediate feedback to users. This preliminary action maintains interactive experience by showing something useful right away, while the system continues to refine the transcription in the background.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms where intermediate results are displayed and then updated with improved transcriptions. This feedback loop allows users to see transcription progress in real-time, maintaining engagement while improving quality over time.

Inventive Principle:
Principle #23Feedback

3Loss of time

If the system displays intermediate transcription results dynamically, then the caption latency is reduced, but the transcription accuracy may be compromised

Engineering Contradiction:
Improvecaption latencyVSAvoidtranscription accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The system dynamically adjusts the displayed transcription based on availability. It can display intermediate results quickly to reduce latency, then automatically update with more accurate final transcriptions. This dynamic behavior allows the system to optimize for speed when needed while maintaining accuracy when available.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary display of transcription results before final accuracy is achieved. This preliminary action reduces latency by showing immediate results, while the system maintains the capability to correct and improve the transcription accuracy in subsequent updates.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240395255A1Information processing method, system, apparatus, electronic device and storage medium
Publication Date: 2024.11.28 DOUYIN VISION CO LTD
  • US20240395255A1 patent drawing
  • US20240395255A1 patent drawing
  • US20240395255A1 patent drawing

AI summary

An information processing method, a system, an apparatus, an electronic device and a storage medium, where the method is applied to a client, and includes: receiving a transcript and a sentence identifier of the transcript sent by a service server; reading a local sentence identifier, and when the received sentence identifier is the same as the local sentence identifier, updating a displayed caption content corresponding to the local sentence identifier with the transcript. When the received sentence identifier of the client is the same as the local sentence identifier, the displayed caption content is replaced with the received transcript.