Real-Time Subtitle Synchronization in Live Broadcasts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Real-time subtitle implementation in live video news broadcasts is hindered by delays and inflexibility, limiting global understanding due to language barriers.

Innovation Solution

A method and system that involve delaying the simultaneous interpretation signal and the source signal to synchronize subtitles with live broadcasts, performing voice dictation on the interpretation signal to generate translated text, and allowing proofreading with countdowns for real-time display, using a transfer server, voice recognition service, and proofreading module to provide synchronized subtitles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If voice dictation is performed on the simultaneous interpretation signal without delay to obtain translated text, then the real-time translation capability is improved, but the subtitle synchronization accuracy deteriorates

Engineering Contradiction:
Improvereal-time translation speedVSAvoidsubtitle synchronization accuracy
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The system segments the simultaneous interpretation signal into two separate processing paths: one path delays the signal for accurate subtitle generation, while the other path processes the undelayed signal for real-time translation. This segmentation allows both real-time translation speed and subtitle synchronization accuracy to be optimized independently in their respective processing streams.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If the source signal is delayed to synchronize with proofreading process, then the subtitle accuracy is improved, but the live broadcast delay increases

Engineering Contradiction:
Improvesubtitle accuracyVSAvoidlive broadcast delay
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by pre-delaying the source signal according to the estimated time required for voice dictation and proofreading processes. This allows the proofreader to work on the delayed signal while the undelayed signal is being translated, and then synchronize all components at the appropriate moment without causing excessive overall delay to the live broadcast.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If manual proofreading is introduced to improve subtitle quality, then the subtitle accuracy is improved, but the system complexity increases

Engineering Contradiction:
Improvesubtitle qualityVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system introduces an intermediary proofreading interface that mediates between the automated voice dictation process and the final subtitle output. The proofreader works through this specialized interface that receives both the delayed source signal and the translated text, allowing manual quality improvement while maintaining a structured workflow that manages system complexity through standardized interaction protocols.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Manufacturing precision

If multiple processing paths are used for simultaneous interpretation and source signal, then the subtitle synchronization is improved, but the device complexity increases

Engineering Contradiction:
Improvesubtitle synchronizationVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system employs dynamic delay adjustment mechanisms that adaptively control the timing of different signal paths. The delay parameters for the simultaneous interpretation signal and source signal are dynamically adjusted based on the actual processing times of voice dictation and proofreading operations, allowing precise subtitle synchronization while managing device complexity through flexible, adaptive timing control rather than fixed complex routing.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11595731B2Implementation method and system of real-time subtitle in live broadcast and device
Publication Date: 2023.02.28 SHANGHAI BILIBILI TECH CO LTD
  • US11595731B2 patent drawing
  • US11595731B2 patent drawing
  • US11595731B2 patent drawing

AI summary

The present disclosure describes techniques of synchronizing subtitles in live broadcast The disclosed techniques comprise obtaining a source signal and a simultaneous interpretation signal in a live broadcast; performing voice recognition on the simultaneous interpretation signal in real-time to obtain corresponding translation text; delaying the simultaneous interpretation signal to obtain a first delayed signal; delaying the source signal to obtain a second delayed signal; obtaining proofreading results of the first delayed signal and the corresponding translation text; determining proofread subtitles based on the proofreading results; and sending the proofread subtitles and the second delay signal to a live display interface.