Event-Driven Streaming Subtitle Interactivity for Contextual Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for learning a foreign language through TV programming are inefficient and lack interactive, contextualized pedagogical information, leading to ineffective learning experiences due to the absence of precise lexical semantics, inappropriate word usage, and lack of interactive tools that interfere with the entertainment value of the content.

Innovation Solution

A system utilizing 'Subtitle Markup Language' (SML) to provide contextual information and interactive features such as auto-continuous looping, question insertion, and social learning communities, enabling users to access and interact with subtitles and their translations, and create shareable media segments for enhanced learning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If manual dictionary lookup is used for each subtitle word, then lexical information can be obtained, but the learning process becomes slow and tedious

Engineering Contradiction:
Improvelexical information accessVSAvoidlearning time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system pre-processes subtitle content to identify and extract key lexical elements (words, phrases, idioms) before the user views them. When a user pauses at a subtitle, the relevant lexical information is already prepared and can be immediately displayed with a single interaction, eliminating the need for manual dictionary lookup for each word.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary system between the subtitle and the user that automatically processes and presents lexical information. This intermediary layer analyzes the subtitle context, identifies relevant vocabulary, and presents curated definitions and explanations, rather than requiring the user to manually search through dictionary interfaces.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If comprehensive lexical information is provided for each subtitle word, then learning depth is improved, but the system complexity increases

Engineering Contradiction:
Improvepedagogical information completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system applies local quality by providing different levels of lexical information based on the specific needs of each subtitle context. Rather than uniformly providing comprehensive information for all words, the system selectively enhances specific lexical elements within subtitles that are most relevant to learning objectives, keeping the overall system simpler while delivering targeted depth where needed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the lexical information delivery into distinct layers: basic word definitions, contextual meanings, idiomatic expressions, and pedagogical notes. This segmentation allows the system to provide comprehensive information when needed while maintaining a simpler interface structure, as each segment can be independently managed and presented based on user interaction with specific subtitle elements.

Inventive Principle:
Principle #1Segmentation

3Productivity

If interactive features are added to subtitle viewing, then learning effectiveness is improved, but the entertainment value is reduced

Engineering Contradiction:
Improvelearning effectivenessVSAvoidviewing experience
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system applies partial action by providing interactive lexical features only when users pause the video or explicitly request information, rather than continuously interrupting the viewing experience. This allows the entertainment value to be maintained during active viewing while enabling effective learning interactions when the user chooses to engage with the educational aspects.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent extracts lexical learning interactions as a separate, optional layer that does not interfere with the primary video viewing experience. Users can access comprehensive lexical information through discrete actions (pausing, clicking on specific words), separating the entertainment content delivery from the educational interaction, thereby maintaining both viewing enjoyment and learning effectiveness.

Inventive Principle:
Principle #2Taking out (Extraction)

4Ease of operation

If full-screen video viewing is enabled, then entertainment value is maximized, but access to lexical information becomes difficult

Engineering Contradiction:
Improvevideo viewing qualityVSAvoidsubtitle accessibility
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system resolves this contradiction by moving lexical information display to another dimension - when users pause the full-screen video, the lexical information is presented in an overlay or expanded view that utilizes the full screen space differently. This allows users to maintain full-screen viewing for entertainment while accessing comprehensive lexical information in a dedicated learning mode when they pause, effectively using different screen real estate for different purposes.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12356048B2Event-driven streaming media interactivity
Publication Date: 2025.07.08 FLICKRAY INC
  • US12356048B2 patent drawing
  • US12356048B2 patent drawing
  • US12356048B2 patent drawing

AI summary

Aspects described herein may provide systems, methods, and device for facilitating language learning using videos. Subtitles may be displayed in a first, target language or a second, native language during display of the video. On a pause event, both the target language subtitle and the native language subtitle may be displayed simultaneously to facilitate understanding. While paused, a user may select an option to be provided with additional contextual information indicating usage and context associated with one or more words of the target language subtitle. The user may navigate through previous and next subtitles with additional contextual information while the video is paused. Other aspects may allow users to create auto-continuous video loops of definable duration, and may allow users to generate video segments by searching an entire database of subtitle text, and may allow users create, save, share, and search video loops.