Object-Query Supplemental Content During Media Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users often struggle to understand complex media content due to confusion about depicted objects, leading to a subpar viewing experience, and existing supplemental content systems are not personalized or efficient in resource usage.
Innovation Solution
A system that allows users to query objects within media assets, identifying relevant supplemental content points based on user interest and providing personalized information using machine learning and knowledge graphs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If supplemental content is provided for every scene throughout the media asset, then users receive comprehensive information about all objects, but computing and networking resources are wasted on scenes users are not interested in
Solution Approach 1:
The system provides supplemental content selectively based on user interests and query context rather than uniformly for all scenes. The media asset processing is localized to specific time points and objects of user interest, with different levels of supplemental content delivery tailored to each queried object's relevance to the user's profile and current viewing context.
2Device complexity
If the same supplemental content options are provided to all users, then content delivery is simplified, but user personalization and interest matching are lost
Solution Approach 1:
The supplemental content delivery system dynamically adapts to each user's profile, interests, and viewing context. The system adjusts content selection, level of detail, and delivery timing based on real-time analysis of user queries, historical preferences, and current media asset context, making the content delivery flexible and personalized rather than static and uniform.
3Loss of information
If users rewatch the media asset or seek external sources to understand depicted objects, then they obtain detailed information, but viewing time is lost and viewing experience is disrupted
Solution Approach 1:
The system prepares and delivers supplemental content in real-time during media asset playback, allowing users to obtain object information without interrupting their viewing flow. By anticipating user information needs and providing relevant supplemental content at the appropriate moment during playback, the system eliminates the need for rewinding, rewatching, or switching to external sources.
Data Source
AI summary
Systems and methods are described for generating for display a media asset, and receiving a query regarding an object depicted in the media asset at a first time point within a presentation duration of the media asset. The system and methods may, based on receiving the query, determine one or more second presentation points within the presentation duration of the media asset related to the object, identify the one or more second presentation points as supplemental content, and generate for display the supplemental content while the media asset is being generated for display.