Interactive Caption Text Supplementary Information Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current media devices lack an efficient method to provide supplementary information related to spoken content, such as names or terms mentioned during broadcasts, which can be of interest to viewers, especially for those who are deaf or hearing impaired, or those who speak different languages.
Innovation Solution
A system and apparatus that process media content to display text associated with audio data, allowing users to select and highlight specific words, which then retrieve and display supplementary information from external sources like search providers or dictionaries, enabling users to obtain additional details about mentioned entities or terms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If closed captioning is displayed to provide text version of audio output, then accessibility for deaf or hearing impaired users is improved, but the system cannot provide supplementary information about mentioned names or terms
Solution Approach 1:
The system segments the captioning text into individual words or phrases that can be independently selected and queried. This allows users to highlight specific portions of the caption text to retrieve supplementary information, transforming the monolithic caption display into an interactive, queryable structure that provides both accessibility and additional context.
2Device complexity
If the system displays only the text version of audio output, then the interface remains simple, but users cannot access additional details about mentioned entities or terms
Solution Approach 1:
The system introduces an intermediary search provider or data source that acts as a bridge between the simple caption display and the detailed supplementary information. When users highlight text, the intermediary retrieves and displays additional context, definitions, or related information without complicating the core captioning interface.
3Loss of information
If the system retrieves supplementary information from external sources, then users gain access to translations and definitions, but the response time and system complexity increase
Solution Approach 1:
The system performs preliminary actions by pre-fetching or caching supplementary information for commonly queried terms and entities. When users highlight text, the system checks cached data first before querying external sources, significantly reducing response time for repeated queries while maintaining comprehensive information availability.
Data Source
AI summary
Media data may include audio content and video content. Text may be associated with the audio content and presented on a display device. In response to receiving a selected portion of the text, supplementary information associated with the selected portion of text may be provided to a user. A method, device, or medium may be associated with identifying the selected portion of text and providing the supplementary information.