Gaze Tracking AR Object Indication System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of augmented reality devices often find themselves near others who are not looking in the same direction, making it difficult to identify virtual objects referenced by others when they are not within the viewer's field of view, as there are currently no effective solutions for shared augmented reality experiences.
Innovation Solution
A system comprising a processor, display, and storage that receives input on an object a person is looking at and presents graphical indications on an electronic display to help the user locate the referenced object, using eye tracking and camera inputs to determine the object's location and identity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users are in close proximity for shared augmented reality experiences, then social interaction is improved, but the ability to share viewing of virtual objects is worsened when users are not looking in similar directions
Solution Approach 1:
The system uses an intermediary device (smartphone, tablet, or computer) to receive image data from the AR device's camera and process eye tracking information. This intermediary acts as a mediator between the AR device and the second user's display device, enabling the transmission and processing of gaze direction data without requiring direct line-of-sight sharing between users.
Solution Approach 2:
The system implements feedback by analyzing the first user's eye tracking data to determine gaze direction, then using this information to identify which virtual object is being viewed. This feedback loop allows the system to automatically update the second user's display with relevant information about the object being observed, creating a responsive shared experience.
2Ease of operation
If a user references a virtual object to another user, then communication is improved, but the referenced object may not be visible to the other user if they are not looking in the same direction
Solution Approach 1:
The system replaces the mechanical requirement of physical alignment (both users looking in the same direction) with an optical/electronic solution using eye tracking cameras and image processing. Instead of requiring mechanical coordination of head and eye positions, the system uses digital detection of gaze direction and computational mapping to achieve the same communicative goal.
Solution Approach 2:
The system changes the parameter of object identification from requiring spatial coincidence (object must be in both users' fields of view) to using gaze direction data as the identifying parameter. By tracking where the first user is looking and using that angular information to identify the target object, the system decouples object identification from physical viewing alignment.
3Measurement precision
If eye tracking and camera inputs are processed to determine object location, then object identification accuracy is improved, but computational requirements and processing time increase
Solution Approach 1:
The system segments the computational task across multiple devices: the AR device's camera captures image data, the intermediary device processes the image data and eye tracking information to determine gaze direction, and the second user's device receives the processed results. This segmentation distributes computational load and reduces the processing burden on any single device.
Data Source
AI summary
In one aspect, a device includes at least one processor, a display accessible to the at least one processor, and storage accessible to the at least one processor. The storage includes instructions executable by the at least one processor to receive input regarding an object at which one person is looking and to present, to another person via the display, a graphical indication regarding the object.