On-Demand Captioning Synchronization via Local Stream Download
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current captioning systems for broadcast programs lack the ability to provide on-demand, personalized captioning services, especially in mobile environments, due to limitations in encoding and transmission methods, which result in high costs, latency, and battery drain from prolonged wireless connections.
Innovation Solution
A system and method that allow users to download and synchronize a time-stamped captioning stream with a broadcast media stream using universal-time synchronization signals, enabling autonomous playback even when disconnected from the network, thus reducing the need for continuous wireless connections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If captions are encoded and transmitted on the media stream (e.g., on Line 21 of a broadcast video stream), then captions are visible on caption-capable television sets, but there is no way to provide on-demand, selectable, personalized captioning services
Solution Approach 1:
The captioning system is segmented into separate components: the broadcast media stream and the captioning text stream are delivered separately to the user device. The user device independently processes and synchronizes these streams, allowing personalized captioning control without modifying the broadcast signal itself.
Solution Approach 2:
The user device acts as an intermediary that receives both the broadcast media stream and captioning text stream, then synchronizes and displays them together. This intermediary function enables personalized captioning services while maintaining compatibility with standard broadcast delivery.
2Reliability
If a user remains wirelessly connected to a simulcast web service to receive on-line captions, then captions can be received in real-time, but connection charges increase and battery charge drains
Solution Approach 1:
The user device downloads the entire captioning text stream in advance before the broadcast program begins. This preliminary action allows the device to operate autonomously during the program without maintaining a wireless connection, thereby conserving battery charge while ensuring caption availability.
Solution Approach 2:
The system uses periodic synchronization checks where the user device periodically compares its local caption timeline with the broadcast program timeline to maintain synchronization without requiring continuous network connection. This periodic action ensures reliability while minimizing energy consumption.
3Reliability
If a user remains wirelessly connected to receive on-line captions, then captions can be received, but network latency causes delays preventing webcast captions from being played on synchronism with the broadcast program
Solution Approach 1:
The captioning text stream is downloaded in advance before the broadcast program begins. This preliminary download eliminates network latency during program playback, as all caption data is already stored locally and ready for immediate synchronization and display.
Solution Approach 2:
The user device creates a local copy of the captioning text stream and stores it in its memory. This local copy is then synchronized with the broadcast program using time codes, eliminating the need for real-time network transmission and thus removing latency issues.
4Adaptability or versatility
If text captions are displayed on a TV set in a public place, then deaf people can understand the program, but visual comfort of other people is disturbed
Solution Approach 1:
The captioning display is localized to the user device's own display screen rather than being broadcast to all viewers. Each user can control their own device to display captions at appropriate times and styles, allowing deaf users to access captions without imposing visual disturbances on other viewers in public spaces.
Data Source
AI summary
The present invention relates to a system, method and computer program for enabling a user receiving a broadcast program on a program receiver to download on his/her computer device time stamped captions and synchronization data related to the received broadcast program, and to autonomously generate and display on his/her computer device, a captions stream synchronized with the display of the broadcast program on the program receiver.