Content Reference Mapping for Immersive Cross-Device Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Content providers struggle to replicate the immersive experience of movie theaters in home viewing environments, as not all viewers have large screens, surround sound systems, or quiet spaces, limiting their ability to engage viewers fully.
Innovation Solution
Systems and methods that identify entities and contexts within content items on a user device, mapping them to associated applications on connected devices to perform actions relevant to the content, such as launching a navigation app when a character drives to a location or a coffee maker when a character consumes coffee.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If content providers use traditional home viewing methods (TV screens, home sound systems), then viewers can watch content at home, but the immersive experience is limited compared to movie theaters
Solution Approach 1:
The patent uses a mobile device as an intermediary between the content being viewed and the user's physical environment. The mobile device captures images of physical objects (popcorn maker, coffee cup, location markers) and uses AR to overlay digital information, mediating between the 2D content and the 3D physical world to create immersion without requiring complex home theater equipment
Solution Approach 2:
The patent creates virtual copies of theater-like experiences by using AR to project digital elements (characters, objects, locations) into the user's physical space. Instead of copying the physical theater environment, it copies the immersive experience through digital overlays that respond to user actions and content context
2Adaptability or versatility
If the system identifies entities and contexts in real-time during content consumption, then the immersion is enhanced, but the processing complexity and time increase
Solution Approach 1:
The system performs preliminary actions by pre-identifying entities and contexts in the content before user consumption. Metadata is extracted and prepared in advance, and the mobile device is pre-configured with recognition capabilities for specific objects, reducing the processing burden during real-time viewing while maintaining responsive interaction
Solution Approach 2:
The mobile device leverages its existing cameras, sensors, and processing capabilities to perform entity identification and context recognition. Rather than requiring a separate complex processing system, the device serves itself by using its built-in tools to capture images, recognize objects, and generate AR overlays autonomously
Data Source
AI summary
Systems and methods are provided herein for determining types of references within a content item and mapping them to particular applications. A content management application identifies an entity and a context of the entity at a location within the content item. The content management application may identify the entity and the context of the entity in real time as a first user device processes the content item, or the content management application may identify and store the entity and the context of the entity in a database before providing the content item. After determining a presence of a second user device associated with a profile, the content management application determines at least one application associated with the entity and the context of the entity on the second user device and launches the application to create an immersive content consumption experience.