Gaze and Head Movement Recognition for AR Content Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Augmented Reality (AR) technologies rely solely on line of sight for content selection, which can be stressful for users and may lead to false recognition, as it does not accurately determine user interest.
Innovation Solution
An information processing apparatus that recognizes shifts in gaze and head movement to control the display of information, providing simplified displays when the user gazes at a subject and transitioning to detailed displays when the user turns their head towards the subject, thereby improving usability and accuracy in presenting relevant information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If content selection is based solely on line of sight, then the system can determine user interest quickly and simply, but the accuracy of determining user interest deteriorates leading to false recognition
Solution Approach 1:
The patent combines multiple detection methods (line of sight detection and head movement detection) into a unified content selection system. By merging these two detection approaches, the system maintains the speed advantage of line of sight detection while adding the accuracy benefit of head movement analysis, thereby resolving the contradiction between quick selection and accurate determination of user interest.
Solution Approach 2:
The system implements feedback by continuously monitoring both line of sight and head movement, then using this combined information to dynamically adjust content selection. The head movement detection provides feedback that validates or corrects the initial line of sight-based selection, improving accuracy while maintaining responsiveness.
2Loss of information
If detailed information is always displayed, then complete information is provided to the user, but the user experiences increased stress and information overload
Solution Approach 1:
The patent applies dynamics by making the information display adaptive rather than static. The system dynamically adjusts the amount and detail of information displayed based on real-time detection of user attention (line of sight) and engagement (head movement). This allows the display to transition from simplified to detailed information only when the user shows genuine interest, reducing stress while ensuring completeness when needed.
Solution Approach 2:
The system applies local quality by providing different levels of information detail to different content regions based on user attention. Instead of uniformly displaying all information at maximum detail, the system selectively provides detailed information only for content that the user is actively viewing and engaging with, while keeping other areas simplified or hidden.
3Ease of operation
If simplified information is displayed initially, then user stress is reduced, but the risk of providing too little information increases
Solution Approach 1:
The system performs preliminary action by displaying simplified information first, which reduces user stress and provides a manageable initial view. The more detailed information is prepared in advance but not displayed until the user shows interest through head movement, at which point the detailed information is revealed to ensure sufficiency.
Data Source
AI summary
There is provided an information processing apparatus, an information processing method, and a program that make it possible to improve usability in information presentation. The information processing apparatus includes a recognition unit configured to recognize a shift in gaze and a move of a head of a user; and a display controller configured to control display of information on a subject according to the move of the head that is made after the gaze is turned to the subject.