XR Content Presentation Using Eye-Tracked Perception Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
XR systems often interfere with or distract users from their real-world environment due to inappropriate display of virtual content, or fail to provide essential content when needed.
Innovation Solution
An XR system determines the user's perception and comprehension of virtual content using eye-related attributes and other sensors, adjusting display settings to optimize content presentation based on perception and comprehension levels, hiding or emphasizing content as necessary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If virtual content is displayed continuously and prominently, then information delivery is improved, but user distraction and interference with real-world activities increases
Solution Approach 1:
The system dynamically adjusts display settings based on real-time perception detection. Virtual content transitions from static to adaptive states, changing prominence, position, or visibility according to user attention levels detected through eye tracking and perception analysis
Solution Approach 2:
The system implements a feedback loop where user perception of virtual content is detected and used to modify subsequent content presentation. The display settings are adjusted based on feedback from perception detection, creating a closed-loop system that adapts to user needs
2Object-affected harmful factors
If virtual content is reduced or hidden, then user distraction is minimized, but essential information may not be delivered when needed
Solution Approach 1:
The system performs preliminary detection of user perception status before delivering critical information. By anticipating when the user is ready to receive information based on perception detection, the system ensures essential content is presented at optimal moments
Solution Approach 2:
The system changes display parameters such as brightness, size, position, or duration of virtual content based on detected perception levels. Critical information is presented with adjusted parameters that ensure visibility while maintaining minimal distraction
3Adaptability or versatility
If display settings are adjusted frequently based on perception, then content optimization is improved, but system complexity increases
Solution Approach 1:
The system uses the user's own perception indicators (eye movements, attention patterns) to automatically adjust display settings without requiring external control systems. The user's natural behavior serves as the control input, simplifying the overall system architecture
Data Source
AI summary
Systems and techniques are described for extended reality (XR) operations. An XR system displays virtual content using a display according to display settings. The display settings can identify, for instance, a position, orientation, and/or size of the virtual content as displayed. The environment can be viewable using the display as the virtual content is displayed by the display, for example using a see-through display or a pass-through display. The imaging system can determine, based on one or more attributes of one or both eyes of the user of the imaging system, an extent of perception of the virtual content that is displayed using the display by the user. The attributes can identify, for instance, eye position, eye movement, pupil dilation, saccades, fixations, blinking, and/or squinting. The XR system can determine, based on the extent of perception of the virtual content by the user, a modification to the display settings.