Gaze-Adaptive CGR Overlay for Reading Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to effectively present computer-generated reality (CGR) content associated with text content based on user interactions, such as eye tracking and device positional changes, limiting immersive and interactive experiences.
Innovation Solution
An electronic device with processors, memory, an eye tracking sensor, and an image sensor is used to obtain gaze vectors and positional changes, identifying focused reading content and presenting CGR representations accordingly, either overlaying them on physical objects or displaying them independently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional text content presentation systems are used, then simplicity and ease of operation are maintained, but user engagement and immersion are limited
Solution Approach 1:
The system performs preliminary actions by tracking user gaze and device position in advance, identifying portions of reading content before presenting CGR representations. This allows the system to prepare immersive content based on predicted user interest, enhancing engagement while managing complexity through proactive content selection rather than reactive processing
Solution Approach 2:
The system introduces CGR representations as an intermediary between traditional text content and user understanding. These computer-generated reality representations serve as a mediator that enhances comprehension and engagement with reading content without requiring complete system redesign, allowing gradual integration of immersive elements
2Adaptability or versatility
If CGR content is presented continuously, then user immersion is enhanced, but information loss about the original reading content increases
Solution Approach 1:
The system applies partial action by presenting CGR representations selectively rather than continuously. It identifies specific portions of reading content based on gaze tracking and device position, presenting immersive content only when and where relevant, thus maintaining immersion while preserving context through targeted rather than exhaustive content delivery
Solution Approach 2:
The system segments the reading content into discrete portions based on user gaze and device position data. By dividing the content into manageable segments and presenting corresponding CGR representations only for identified portions, the system maintains immersion while preventing information loss through structured, organized content delivery
3Measurement precision
If eye tracking and positional sensing are implemented, then user focus detection accuracy is improved, but device complexity increases
Solution Approach 1:
The system achieves multi-functionality by using the same sensor suite for multiple purposes: eye tracking sensors detect both gaze direction and device position, while image sensors capture both pass-through image data and reading content. This universal use of sensors reduces overall system complexity despite implementing multiple measurement functions, as single components serve multiple detection needs
Data Source
AI summary
In accordance with some implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, one or more input devices, and a display. The method includes displaying, on the display, a reader interface including one or more portions of reading content. The method further includes detecting, via the one or more input devices, a first positional change input. The first positional change input is indicative of the electronic device changing from a first position to a second position. The method further includes, in response to detecting the first positional change input, ceasing to display the reader interface including the one or more portions of reading content, and displaying, on the display, one or more computer-generated representations corresponding to the one or more portions of reading content.