Themed Imagery Overlay for Head-Mounted Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality and augmented reality head-mounted display devices lack the ability to enhance the viewing environment by overlaying themed imagery onto real-world objects while streaming video content, resulting in a static and unengaging user experience.
Innovation Solution
A method and apparatus that utilize depth data from a head-mounted display device to identify and classify objects in a user space, selecting themed imagery based on the streamed video content and overlaying it onto real-world objects, maintaining the structural integrity of the objects while enhancing the viewing environment with themed textures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If themed imagery is overlayed onto real-world objects in HMDD, then the viewing environment engagement is enhanced, but the device complexity increases
Solution Approach 1:
The system segments the viewing environment by detecting and classifying specific objects (walls, floors, ceilings, furniture) separately from the video content display. Each object surface is processed independently with appropriate themed imagery overlays, allowing complex environmental transformation without overwhelming system complexity through modular object-by-object handling
Solution Approach 2:
A computing device acts as an intermediary between the HMDD and the video content source. This intermediary processes depth data, detects objects, classifies video content, selects appropriate themed imagery, and manages the overlaying process, thereby reducing the complexity burden on the HMDD itself while enabling enhanced viewing environment engagement
2Adaptability or versatility
If real-world objects are overlaid with themed imagery, then the immersive experience is improved, but the difficulty of detecting and measuring objects increases
Solution Approach 1:
The system performs preliminary object detection and classification before applying themed imagery overlays. By pre-identifying objects and their spatial relationships using depth data, the system establishes a foundation that simplifies subsequent imagery overlaying and maintains accurate object representation throughout the immersive experience
Solution Approach 2:
The system utilizes depth data to transform 2D camera views into 3D spatial understanding, changing the parameter space from simple image processing to three-dimensional object reconstruction. This enables accurate detection and measurement of objects in the real-world environment, facilitating proper themed imagery overlaying while maintaining immersive experience quality
3Manufacturing precision
If depth data is used to identify objects in user space, then the themed imagery overlay precision is improved, but the use of energy by the device increases
Solution Approach 1:
Instead of continuously processing depth data and rendering themed imagery, the system employs periodic action by updating object detections and imagery overlays at appropriate intervals. This periodic processing maintains overlay precision while significantly reducing energy consumption compared to continuous real-time processing
Solution Approach 2:
The system applies partial action by selectively processing only the portions of the environment that are currently visible through the HMDD display, rather than processing the entire user space. This partial processing approach maintains sufficient overlay precision for the visible field while substantially reducing energy consumption compared to full-space processing
Data Source
AI summary
Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.