Mixed Reality Overlay for Static Printed Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Static printed materials are static and unchangeable, limiting their dynamic interaction with users, as they require physical manipulation and lack the ability to update or enhance content.
Innovation Solution
A see-through, near-eye, mixed reality display device system that identifies printed content and allows users to interact with it using physical actions, overlaying virtual data and updating content in real-time by capturing image data and processing user inputs to display relevant virtual information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If static printed material is used, then the content is permanent and requires no power, but the content cannot be updated or changed
Solution Approach 1:
The patent creates a virtual copy of the printed content that can be displayed through the HMD device. The system captures an image of the printed material and generates a digital representation that can be manipulated, updated, and enhanced while the original physical material remains unchanged, thus maintaining permanence while enabling adaptability.
Solution Approach 2:
The HMD device acts as an intermediary between the static printed material and the user. It captures the printed content, processes it, and presents an enhanced virtual version that combines the reliability of permanent printed material with the adaptability of digital content through overlays, annotations, and real-time updates.
2Illumination intensity
If physical printed material is used, then the data is visible and requires no power, but interaction is limited to physical manipulation
Solution Approach 1:
The system transforms the static interaction model into a dynamic one. Users can interact with the content through multiple modalities including voice commands, gestures, and eye tracking, allowing the content to respond and change based on user actions while maintaining visibility through the see-through display.
Solution Approach 2:
The patent merges the advantages of physical printed material (visibility, no power required) with digital interactivity (voice, gesture, eye tracking controls). The HMD combines the real-world view of the printed material with virtual overlays and digital control interfaces, creating a unified system that enhances both visibility and ease of operation.
3Ease of operation
If static printed content is displayed, then the format is comfortable for reading, but additional information cannot be added
Solution Approach 1:
The system adds a virtual dimension to the physical printed content. Through the HMD's see-through display, users can see the original printed material in its comfortable reading format while simultaneously accessing additional virtual information, annotations, and data layers that are overlaid in the same field of view, effectively adding information without compromising reading comfort.
Data Source
AI summary
The technology provides embodiments for making static printed content being viewed through a see-through, mixed reality display device system more dynamic with display of virtual data. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. A task in relation to the printed content selection can also be determined based on physical action user input. Virtual data for the printed content selection is displayed in accordance with the task. Additionally, virtual data can be linked to a work embodied in a printed content item. Furthermore, a virtual version of the printed material may be displayed at a more comfortable reading position and with improved visibility of the content.