Mixed Reality Book Augmentation via Gesture-Triggered Virtual Slates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional reading experiences, whether with traditional books or eBooks, lack integration of additional information, requiring users to switch between reading materials and information sources, disrupting the flow and obscuring text.
Innovation Solution
A mixed reality system using a see-through head-mounted display that identifies the user's focus and provides additional text, graphics, or video on a virtual display slate around the book, answering questions or offering information upon verbal or physical gestures without obscuring the text.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If additional information is displayed on the same device as the reading material, then information accessibility is improved, but the text becomes obscured or replaced
Solution Approach 1:
The patent displays additional information in a third dimension by projecting it above the physical book using a head-mounted display, allowing users to access supplementary content without it overlapping or obscuring the text on the book pages
2Loss of information
If users switch between reading material and information sources, then information accessibility is improved, but reading continuity is disrupted
Solution Approach 1:
The patent combines the physical book with a digital information display system worn on the user's head, merging the reading experience with access to supplementary information so that both the book text and additional content are simultaneously available in the user's field of view
3Loss of time
If a see-through head mounted display is used to show additional information, then reading continuity is maintained, but device complexity increases
Solution Approach 1:
The patent introduces a see-through head-mounted display as an intermediary device that overlays digital information in the user's field of view, allowing access to additional content without requiring the user to physically interact with multiple devices or switch between different reading materials
Data Source
AI summary
A system and method are disclosed for augmenting a reading experience in a mixed reality environment. In response to predefined verbal or physical gestures, the mixed reality system is able to answer a user's questions or provide additional information relating to what the user is reading. Responses may be displayed to the user on virtual display slates in a border or around the reading material without obscuring text or interfering with the user's reading experience.