Closed Caption Parsing for Concurrent Video Metadata Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for obtaining information related to video content require users to take action outside the viewing experience, often leading to missed or ignored auditory or visual messages, and are inconvenient for viewers who need to operate a computing device while watching videos.
Innovation Solution
A system and method that parses closed caption content from video streams, sends relevant information to a server, and executes instructions to display additional information such as web pages, media, or coupons concurrently with the video playback on a client device, without requiring user intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If users visit a website using an Internet-enabled device to obtain information relevant to video content, then information access is achieved, but user convenience deteriorates and viewing experience is disrupted
Solution Approach 1:
The system automatically parses closed caption content from the video stream, extracts relevant information, and displays supplemental content without requiring user intervention. The client device autonomously identifies keywords in closed captions, queries the server, and presents related information, allowing the system to serve itself rather than requiring manual user action.
Solution Approach 2:
The system pre-processes closed caption content during video playback by continuously parsing and identifying relevant keywords. The server maintains a database of related information ready for retrieval, and the client device prepares to display supplemental content as soon as relevant keywords are detected in the closed captions, eliminating the need for post-viewing information search.
2Loss of information
If auditory or visual messages prompt users to take action, then information delivery is improved, but user attention deteriorates as messages are missed or ignored
Solution Approach 1:
The closed caption text serves as an intermediary that bridges the video content and supplemental information. Instead of relying on auditory or visual prompts that compete for user attention, the system uses the existing closed captions (which users are already reading) as the trigger mechanism. The server acts as a mediator, receiving keyword queries from the client and returning relevant supplemental content, creating a reliable information delivery channel that doesn't compete for user attention.
3Loss of information
If users operate a computing device while viewing video content, then information access is enabled, but viewing experience deteriorates due to inconvenience
Solution Approach 1:
The system merges the video playback function with the information retrieval function into a single integrated experience. The client device combines video decoding, closed caption parsing, keyword extraction, and supplemental content display in one unified interface. Users view video and access related information simultaneously on the same display without needing to switch between devices or applications, simplifying the overall system operation.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
A video stream including closed captions is received. A set of information is determined from the closed captions. A request including the set of information is sent to a server remotely located from the client for additional processing. A set of instructions is received from the server. The set of instructions is determined based on the additional processing of the set of information. One of more applications are executed in accordance with the set of instructions in response to receiving the set of instructions.