Receiving Device for Live Streaming Subtitle Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In live streaming, fragmented text information cannot be continuously displayed due to the lack of synchronization in subtitle data, particularly in scenarios where the timing of text information is unknown, leading to interruptions in subtitle display.

Innovation Solution

A receiving device and method that analyze fragmented text information using TTML documents, controlling the display of first text information to continue seamlessly with second text information by utilizing structured documents that define start and end times for display, ensuring temporal alignment and consistent formatting.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If fragmented text information is separately sent for real-time processing, then processing efficiency is improved, but display continuity is lost

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddisplay continuity
Core Design Contradiction:
ProductivityVSStability of the object's composition

Solution Approach 1:

The patent divides the TTML document into separate fragments (initialization document instance and body document instances) that can be processed independently in real-time. Each fragment contains specific subtitle information that can be parsed and displayed without waiting for the complete document, thus improving processing efficiency while maintaining display continuity through proper timing synchronization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary actions by pre-defining the structure and timing information in the TTML fragments before transmission. The receiving device can prepare parsing routines and display contexts in advance, allowing for faster real-time processing when the actual subtitle data arrives, thereby maintaining both processing efficiency and display continuity.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the entire XML document is parsed for each distribution, then processing accuracy is improved, but system overhead increases

Engineering Contradiction:
Improveprocessing accuracyVSAvoidsystem overhead
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary portions of the XML document (specific body document instances containing subtitle text and timing information) rather than parsing the entire document. This extraction approach maintains processing accuracy for the relevant subtitle data while significantly reducing system overhead by avoiding unnecessary parsing of unrelated content.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by parsing only the specific fragments of the TTML document that contain active subtitle information rather than the complete document. This selective parsing ensures processing accuracy for the current subtitle while reducing overall system overhead by avoiding redundant parsing of already-processed or irrelevant portions.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If live streaming uses chunked TTML documents, then adaptability to real-time transmission is improved, but display synchronization becomes difficult

Engineering Contradiction:
Improveadaptability to real-time transmissionVSAvoiddisplay synchronization
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements dynamics by making the TTML document structure adaptable to real-time transmission conditions. The body document instances are designed to be dynamically generated and transmitted as chunks, with flexible timing information that can adjust to varying network conditions while maintaining proper display synchronization through embedded time codes and rendering instructions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent incorporates feedback mechanisms where the receiving device monitors the arrival and processing of fragmented TTML documents, adjusting its parsing and display timing accordingly. This feedback loop ensures that even though documents are transmitted in chunks, the display synchronization remains reliable by compensating for variations in transmission timing and processing speed.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9584837B2Receiving device and method of controlling the same, distribution device and distribution method, program, and distribution system
Publication Date: 2017.02.28 SATURN LICENSING LLC
  • US9584837B2 patent drawing
  • US9584837B2 patent drawing
  • US9584837B2 patent drawing

AI summary

There is provided a receiving device including a receiving unit configured to receive a stream of a content to be distributed live, an analysis unit configured to analyze fragmented text information corresponding to subtitle data included in the received stream, and a control unit configured to control display of first text information so as to allow the display to be continued when second text information out of the text information is displayed based on a result of the analysis, the second text information being started to be displayed temporally after the first text information is displayed.