Subtitle Timing Error Detection and Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual timing of subtitles relative to shot changes in audiovisual programs is error-prone and time-consuming, often resulting in suboptimal viewing experiences due to unnecessary re-reading and flickering effects.

Innovation Solution

A computer-implemented method that detects timing errors between subtitles and shot changes by determining if temporal edges satisfy guidelines, modifying subtitle positions to eliminate errors, and providing a graphical user interface for efficient re-scheduling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual timing of subtitles is performed to synchronize with spoken dialog, then subtitle synchronization quality is improved, but time consumption and error rate increase prohibitively

Engineering Contradiction:
Improvesubtitle timing precisionVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical process of subtitle timing with an automated computer-implemented system. The processor automatically detects shot changes, identifies temporal edges of subtitles, and determines timing errors by comparing against stored guidelines, eliminating the need for manual frame-by-frame analysis while maintaining or improving timing precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service automation where the computer-implemented method performs the entire subtitle timing analysis independently. The processor automatically retrieves shot change information, compares subtitle temporal edges against shot changes using stored timing guidelines, and generates error reports without requiring continuous human intervention or manual adjustment.

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If manual timing of subtitles is performed to check timing guidelines, then timing accuracy is improved, but productivity decreases due to prohibitive time consumption

Engineering Contradiction:
Improvesubtitle timing accuracyVSAvoidsubtitle processing throughput
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent replaces manual subtitle timing verification with an automated computer-implemented system that processes multiple subtitles simultaneously. The processor efficiently retrieves shot change information, compares numerous subtitle temporal edges against timing guidelines, and generates comprehensive error reports, achieving both high timing accuracy and improved productivity through automated batch processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs preliminary action by pre-storing timing guidelines and shot change information in memory before the actual timing analysis. This allows the processor to quickly compare subtitle temporal edges against pre-established criteria without requiring real-time manual reference to guidelines, significantly improving processing throughput while maintaining timing accuracy.

Inventive Principle:
Principle #10Preliminary action

3Object-affected harmful factors

If subtitles are manually adjusted to satisfy timing guidelines, then viewing experience quality is improved, but the complexity and time required for subtitle production increases

Engineering Contradiction:
Improveviewing experience qualityVSAvoidsubtitle production complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The patent replaces complex manual subtitle adjustment processes with an automated computer-implemented system. The processor automatically identifies timing errors by comparing subtitle temporal edges against shot changes and stored guidelines, then provides precise error location information to guide efficient adjustments, reducing both the complexity and time required for subtitle production while improving viewing experience quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system implements feedback by automatically detecting timing errors and providing specific information about which subtitle temporal edges violate timing guidelines and by how much. This targeted feedback enables producers to make precise adjustments only where needed, rather than manually reviewing and adjusting all subtitles, thereby reducing production complexity while ensuring viewing experience quality.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10798271B2Detecting errors in the timing between subtitles and shot changes
Publication Date: 2020.10.06 NETFLIX INC
  • US10798271B2 patent drawing
  • US10798271B2 patent drawing
  • US10798271B2 patent drawing

AI summary

In various embodiments, a subtitle timing application detects timing errors between subtitles and shot changes. In operation, the subtitle timing application determines that a temporal edge associated with a subtitle does not satisfy a timing guideline based on a shot change. The shot change occurs within a sequence of frames of an audiovisual program. The subtitle timing application then determines a new temporal edge that satisfies the timing guideline relative to the shot change. Subsequently, the subtitle timing application causes a modification to a temporal location of the subtitle within the sequence of frames based on the new temporal edge. Advantageously, the modification to the subtitle improves a quality of a viewing experience for a viewer. Notably, by automatically detecting timing errors, the subtitle timing application facilitates proper and efficient re-scheduling of subtitles that are not optimally timed with shot changes.