Second Screen Sync via Closed Captioning Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current second screen content synchronization with audio/video programming lacks real-time and event-specific content delivery, failing to provide users with intelligently selected information during live or recorded TV viewing.

Innovation Solution

A system that utilizes closed captioning data to synchronize supplemental content on a second screen device by retrieving event details from a remote server, allowing for real-time presentation of relevant information during audio/video content playback, including webpages, advertisements, and interactive content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If second screen content is provided without real-time synchronization, then device complexity is reduced, but user engagement and content relevance deteriorate

Engineering Contradiction:
Improveuser engagementVSAvoidsynchronization system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent uses closed captioning data as an intermediary signal to trigger second screen content delivery. The closed captioning system acts as a mediator between the audio/video programming and the supplemental content, automatically initiating content delivery when captions are detected without requiring complex real-time analysis or user intervention.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system pre-establishes associations between closed captioning events and supplemental content in advance. When closed captioning data is received during playback, the corresponding content is already prepared and can be immediately delivered, eliminating the need for complex real-time content generation or selection algorithms.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If event-specific content delivery is implemented, then content relevance is improved, but system complexity increases

Engineering Contradiction:
Improvecontent relevanceVSAvoidevent detection system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Closed captioning data serves as an intermediary that simplifies event detection. Instead of implementing complex video or audio analysis to detect events, the system uses the already-present closed captioning stream as a reliable trigger signal, significantly reducing the complexity of event detection while maintaining high content relevance.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If real-time content synchronization is achieved, then user engagement improves, but processing requirements increase

Engineering Contradiction:
Improvecontent synchronization accuracyVSAvoidprocessing energy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system performs content preparation and association in advance, before actual playback occurs. This preliminary action allows real-time delivery to proceed with minimal processing, as the matching between closed captioning events and supplemental content has already been established, significantly reducing real-time energy consumption.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3100459B1Methods and apparatus to synchronize second screen content with audio/video programming using closed captioning data
Publication Date: 2020.05.06 DISH TECHNOLOGIES LLC
  • EP3100459B1 patent drawingFigure 1
  • EP3100459B1 patent drawingFigure 2
  • EP3100459B1 patent drawingFigure 3

AI summary

A method for synchronized utilization of an electronic device is provided. The method receives closed captioning data from an audio/video content receiver for a set of audio/video content; retrieves detail for a first event occurring in the set of audio/video content, wherein the first event is indicated by the received closed captioning data; and presents content to a user, using the electronic device, based on the retrieved detail.