AR Display Object Recognition Eye-Tracking Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) devices often present AR content at locations that obstruct a user's view of real-world objects, lacking effective solutions to prevent this obstruction.
Innovation Solution
A device with a processor, camera, and display that identifies real-world objects using camera input and presents AR images on the display at locations that do not obstruct the user's view, utilizing object recognition and eye-tracking to dynamically adjust the AR image placement based on the user's line of sight.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If AR content is presented at central display locations to maximize visibility, then the AR content is more visible to the user, but the user's view of real-world objects is obstructed
Solution Approach 1:
The patent applies local quality by dynamically assigning different display locations to different AR content based on the user's current line of sight. The system identifies regions of interest in the real world and places AR content in corresponding display regions that do not overlap with those interests, making the display quality adaptive to local viewing conditions rather than using a fixed display pattern.
Solution Approach 2:
The patent implements dynamics by continuously tracking the user's eye movements and adjusting AR content placement in real-time. The display locations are not static but dynamically change based on the user's shifting attention, ensuring that AR content remains visible while avoiding obstruction of real-world objects that capture the user's current focus.
2Device complexity
If AR images are displayed at fixed locations on the display, then the display system is simpler to implement, but the AR content may obstruct important real-world objects in the user's field of view
Solution Approach 1:
The patent employs feedback mechanisms by using eye-tracking data to inform AR content placement decisions. The system continuously monitors the user's line of sight and uses this feedback to adjust where AR content is displayed, creating a closed-loop system that adapts to user behavior rather than relying on predetermined fixed locations.
Solution Approach 2:
The system applies self-service by automatically adjusting AR content placement based on eye-tracking information without requiring manual user intervention. The device autonomously determines optimal display locations by processing eye-tracking data and repositioning AR content accordingly, eliminating the need for users to manually configure display settings.
3Object-affected harmful factors
If eye-tracking and object recognition systems are added to determine dynamic AR placement, then obstruction of real-world objects is prevented, but the device complexity increases
Solution Approach 1:
The patent applies universality by having the eye-tracking system serve multiple functions: it not only tracks user attention for AR placement purposes but also potentially provides data for other AR applications such as foveated rendering, gaze-based interaction, and attention-aware content delivery. This multi-functionality justifies the added complexity by extracting multiple benefits from a single tracking infrastructure.
Data Source
AI summary
In one aspect, a device includes at least one processor, a camera accessible to the at least one processor, a display accessible to the at least one processor, and storage accessible to the at least one processor. The storage includes instructions executable by the at least one processor to receive input from the camera and, based on the input from the camera, identify information related to a first real-world object. The instructions are also executable to, based on the identification of the information related to the first real-world object, present at least one augmented reality (AR) image on the display at a location of the display that does not obstruct a user's view of the first real-world object while the device is worn.