Mixed Reality Display Overlaying Virtual Data on Printed Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Static printed materials are non-adaptive and do not change based on user interactions or preferences, limiting their dynamic potential.
Innovation Solution
A see-through, near-eye, mixed reality display device system that identifies and updates printed content with personalized virtual data by using user input, such as gaze or gestures, to overlay virtual information onto physical printed materials, allowing for dynamic and interactive experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If static printed material is used to store information, then the data can be stored permanently and presented in a format comfortable for human reading, but the content does not adapt to the reader and cannot change based on user interactions
Solution Approach 1:
The patent combines static printed material with dynamic virtual reality content delivery system. The printed material serves as a trigger or key that activates personalized virtual content through cameras, processors, and VR displays, merging the permanence of print with the adaptability of digital content.
Solution Approach 2:
The system introduces cameras, processors, and content delivery mechanisms as intermediaries between the static printed material and the user. These intermediaries capture images of the printed content, process the data, and deliver personalized virtual content, enabling adaptation without modifying the original printed material.
2Adaptability or versatility
If virtual data is overlaid on printed content to enable dynamic updates, then the content becomes adaptive and interactive, but the device complexity increases
Solution Approach 1:
The system uses universal components such as cameras, processors, and content delivery mechanisms that can work with any printed material. The same hardware infrastructure supports multiple functions including content recognition, virtual content delivery, and user interaction tracking across different printed materials.
Solution Approach 2:
The system captures images of the printed content using cameras and creates virtual copies or representations of the content. These digital copies are then processed and enhanced with personalized virtual data, allowing the system to work with any printed material without physical modification.
3Ease of operation
If personalized virtual data is selected and displayed based on user profile data, then user engagement is enhanced, but processing requirements and system complexity increase
Solution Approach 1:
The system pre-processes and stores personalized content and user profile data before interaction. When a user engages with printed material, the system quickly retrieves pre-prepared personalized content based on user profiles, reducing real-time processing requirements and enhancing user experience.
Solution Approach 2:
The system automatically matches user profiles with appropriate personalized content without requiring manual intervention. The processing system autonomously selects and delivers relevant virtual content based on user characteristics and printed material context, reducing operational complexity.
Data Source
AI summary
The technology provides for updating printed content with personalized virtual data using a see-through, near-eye, mixed reality display device system. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. Virtual data is selected from available virtual data for the printed content selection based on user profile data, and the display device system displays the selected virtual data in a position registered to the position of the printed content selection. In some examples, a task related to the printed content item is determined based on physical action user input, and personalized virtual data is displayed registered to the printed content item in accordance with the task.