Pupil Location Indicators for AR Overlays on Head-Mounted Items
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image augmentation technologies struggle to accurately position graphical overlays on images of users wearing head-mounted items, as the user's eyes are obstructed by the device, making it difficult to determine the correct placement of augmentations.
Innovation Solution
Implement gaze tracking to determine the location of a user's pupil while wearing a head-mounted item and display an indication of this location on the item's surface, allowing for accurate positioning of image augmentations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If head-mounted items are worn by users, then mediated reality and messaging applications can be enhanced, but facial features like pupils become occluded making it difficult to accurately position image augmentations
Solution Approach 1:
The patent introduces an intermediary indicator that is displayed on the head-mounted item to represent the user's pupil location. This indicator serves as a mediator between the occluded pupil and the image processing system, allowing accurate positioning of image augmentations without directly observing the pupil. The indicator is positioned on the head-mounted item at a location that corresponds to the pupil's position, enabling the system to use this visible marker for precise augmentation placement.
2Ease of operation
If pupils are occluded by head-mounted items, then head-mounted technology can be utilized, but the ability to detect and measure pupil location for image augmentation positioning deteriorates
Solution Approach 1:
The patent creates a copy or representation of the pupil's location by displaying an indicator on the head-mounted item at the corresponding position. This indicator is a visual copy of the pupil's spatial information, allowing the system to detect and measure the pupil location indirectly through the indicator rather than directly observing the occluded pupil. The indicator effectively replicates the pupil's positional data in a visible form that can be easily detected and used for image augmentation positioning.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables precise placement of image augmentations by using the pupil location indication as a reference point, even when the user's eyes are obscured by the head-mounted device, improving the accuracy of image processing and augmentation in mediated reality applications.
Implementation Method 1
The indication of the location of the user's pupil may comprise outcoupled light from the head mounted item
Data Source
Figure 1
Figure 2
Figure 3A~3B
AI summary
Examples of the disclosure enable image augmentations to be used with images of users wearing head mounted items. In examples of the disclosure an apparatus can be configured to use gaze tracking to determine a location of a user's pupil wherein the user is wearing a head mounted item. The apparatus can also be configured to enable display of an indication of the location of the user's pupil so that the indication is visible on a surface of the head mounted item. The indication is configured to be used for positioning at least one image augmentation for a captured image comprising the user.