Mobile Device Overlaying Non-Video Content on Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video display technologies do not effectively allow for the overlay of non-video content, such as audio, tactile, and olfactory content, onto video content in a way that is intuitive and context-specific for individual viewers, often interfering with the main video experience and lacking integration with video discs and games.
Innovation Solution
A system and method using a mobile device with an integrated video camera and display to track video content from a source, such as a TV, and overlay non-video content in real-time, utilizing markers for orientation and synchronization, allowing users to select specific portions of the video to access and present associated non-video content like audio, tactile, or olfactory experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If non-video content is overlaid on video content for display to individual viewers, then personalized engagement and immersion are improved, but interference with the main picture and disturbance to other viewers may occur
Solution Approach 1:
The system segments the video content into distinct regions or objects that can be individually identified and tracked. By dividing the video frame into selectable elements, the system enables personalized overlay content to be associated with specific segments rather than the entire video, allowing individual viewers to engage with content related to particular objects or areas without forcing overlays on the complete picture that would disturb other viewers.
Solution Approach 2:
The system applies different overlay content qualities and types to different local regions of the video based on what each viewer is looking at or interested in. Instead of applying uniform overlays across the entire video, the system tailors the overlay content locally to specific objects, characters, or areas within the video frame, enabling personalized engagement while preserving the integrity of the main picture for all viewers.
2Ease of manufacture
If traditional video disc formats are used for additional content, then content delivery is simplified, but accessibility and context-relevance of additional content deteriorate
Solution Approach 1:
The system introduces a mobile device as an intermediary between the video disc player and the viewer. This intermediary captures video output from the display, identifies objects or regions of interest, and delivers personalized overlay content through the mobile device's display and sensors. This intermediary layer enables context-relevant content delivery while maintaining compatibility with traditional video disc formats, bridging the gap between simplified content delivery and enhanced accessibility.
Solution Approach 2:
The system adds a new dimension of interaction by using the mobile device's camera, display, and motion sensors to create an augmented viewing experience. Instead of relying solely on the traditional video disc interface, the system overlays additional content in a second dimension through the mobile device, allowing viewers to access context-relevant information by pointing the device at specific areas of the video, thereby enhancing accessibility without complicating the underlying content delivery infrastructure.
Data Source
AI summary
Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.