Live Subtitle Speed Control via Timestamp Blocks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Live subtitling often results in an unpleasant user experience due to the fast appearance of words, causing lag and poor quality, especially when translation is involved, as existing methods fail to synchronize subtitles effectively with video content in real-time.

Innovation Solution

Applying a presentation timestamp to each subtitling element to ensure a minimum delay between subtitle appearances, grouping them into blocks, and adjusting the display frequency to maintain a consistent pace, such as limiting the display to 180 words per minute, to enhance user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If words of sub-titles are transmitted as soon as they are available in real-time live subtitling, then the lag between video transmission and subtitle production is minimized, but the words appear one after another in a very fast manner causing poor user perception and unpleasant quality

Engineering Contradiction:
Improvelag between video transmission and subtitle productionVSAvoiduser perception quality
Core Design Contradiction:
Loss of timeVSEase of operation

Solution Approach 1:

The patent segments the continuous stream of subtitle words into discrete blocks that are processed and transmitted together. Instead of transmitting each word immediately as it becomes available, the system groups words into blocks and transmits them in controlled batches, thereby reducing the visual overload on users while maintaining real-time performance

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements periodic transmission of subtitle blocks at controlled intervals rather than continuous word-by-word transmission. By establishing a regular rhythm of block transmission and controlling the display rate (e.g., limiting to 180 words per minute), the system creates a periodic action pattern that is more pleasant for users to consume

Inventive Principle:
Principle #19Periodic action

2Speed

If the speed of subtitle display is increased to maintain real-time synchronization, then the lag is reduced, but the readability and pleasantness of sub-titles deteriorates

Engineering Contradiction:
Improvesubtitle display speedVSAvoidreadability and pleasantness
Core Design Contradiction:
SpeedVSEase of operation

Solution Approach 1:

The patent implements dynamic control of subtitle display speed by adjusting the transmission and display rate based on block size and content. The system can adaptively modify the display speed within acceptable ranges (e.g., maintaining around 180 words per minute) to ensure readability while staying as close as possible to real-time synchronization requirements

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes key parameters of subtitle presentation including display speed, block size, and timing intervals. By modifying these parameters dynamically - particularly limiting display to approximately 180 words per minute and adjusting block transmission timing - the system optimizes both synchronization accuracy and user reading comfort

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If manual insertion of sub-titles is performed offline to achieve perfect synchronization and pleasant visual aspect, then the quality is improved, but the process is time-consuming and cannot be used for live sub-titles

Engineering Contradiction:
Improvesynchronization quality and visual aspectVSAvoidsubtitling speed
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent enables the live subtitling system to automatically perform tasks that traditionally required manual operator intervention. Through automated block formation, timing calculation, and synchronized transmission, the system achieves near-offline quality synchronization without human operators, thereby maintaining high productivity in live environments

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary processing of subtitle content by pre-grouping words into blocks and pre-calculating optimal transmission timing before actual display. This preliminary organization of subtitle data into structured blocks with predetermined timing allows the system to achieve smooth, synchronized display without real-time manual intervention

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10299009B2Controlling speed of the display of sub-titles
Publication Date: 2019.05.21 HARMONIC INC
  • US10299009B2 patent drawing
  • US10299009B2 patent drawing
  • US10299009B2 patent drawing

AI summary

Applying a presentation timestamp to an element of a sequence of sub-titles. A minimum presentation timestamp TMIN of an element of a sequence of sub-titles N is initialized. The presentation timestamp T(N) of the new element of a sub-title sequence N is compared with the minimum presentation timestamp for sub-titles TMIN. The minimum presentation timestamp for sub-titles TMIN is applied to the element of a sequence of sub-titles N if the presentation timestamp T(N) of the new sub-titles element is prior to the minimum presentation timestamp for sub-titles TMIN. The minimum presentation timestamp for sub-titles TMIN for an element of a sequence of sub-titles N+1 is calculated as a timestamp posterior to the presentation timestamp T(N) of the new sub-titles element.