Gaze Tracking for AR Anchor Point Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently processing and enhancing digital images captured by portable devices, particularly in varying conditions such as changes in image scales, noise, lighting, movement, and geometric distortion, while also providing augmented reality experiences that seamlessly integrate virtual content with real-world environments.
Innovation Solution
A system and method for capturing and processing digital images using eyewear devices with integrated sensors and computing capabilities, enabling real-time tracking of user gaze direction to generate augmented reality content that interacts with the real environment, utilizing a messaging system to enhance image processing and sharing, and employing neural networks for image transformations and overlays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gaze direction tracking is implemented to enable interactive augmented reality content generation, then user engagement and content relevance are improved, but device complexity and computational requirements increase
Solution Approach 1:
The patent introduces gaze direction as an intermediary parameter that mediates between the user and the augmented reality content. By tracking where the user is looking, the system can automatically determine which content to generate and present, eliminating the need for complex manual input mechanisms while maintaining high user engagement and interaction relevance.
Solution Approach 2:
The system uses the user's natural gaze direction as a self-service input mechanism. Instead of requiring users to manually control or select content, the system automatically adapts to user interests by detecting where they are looking, thereby reducing device complexity while maintaining ease of operation through intuitive, automatic content generation.
2Speed
If real-time image processing and augmented reality content generation are performed, then responsiveness to user interactions is improved, but power consumption increases
Solution Approach 1:
The patent applies preliminary action by pre-processing images and pre-generating augmented reality content templates before the user interacts with the system. By having processing capacity ready in advance and using efficient algorithms that can quickly generate content from pre-prepared data, the system achieves real-time responsiveness while minimizing power consumption during actual user interaction moments.
Solution Approach 2:
The system implements periodic action by processing images and generating augmented reality content at strategically determined intervals rather than continuously. By analyzing gaze direction changes and user interaction events to trigger processing cycles, the system maintains responsiveness to user needs while significantly reducing overall power consumption compared to continuous processing approaches.
3Reliability
If gaze direction tracking and image processing are performed continuously, then augmented reality experience quality is improved, but loss of energy increases
Solution Approach 1:
The patent implements dynamics by adjusting the intensity and frequency of gaze direction tracking and image processing based on real-time conditions. When the user is actively interacting with or looking at content, the system increases processing intensity to maintain high augmented reality experience quality. When the user is not interacting, the system reduces processing intensity to minimize energy consumption, thereby achieving reliable experience quality only when needed.
Solution Approach 2:
The system applies parameter changes by dynamically adjusting processing parameters such as resolution, frame rate, and computational intensity based on gaze direction stability and user interaction state. By changing these parameters from high to low based on actual usage conditions, the system maintains augmented reality experience quality during active use while significantly reducing energy consumption during idle periods.
Data Source
AI summary
The subject technology determines a gaze direction in a field of view of a user using an eyewear device. The subject technology generates an anchor point in the field of view based at least in part on the determined gaze direction. The subject technology identifies a surface corresponding to a ground plane in the field of view. The subject technology determines a distance from the identified surface to the anchor point. The subject technology generates AR content based at least in part on the determined distance. The subject technology renders the generated AR content in the field of view for display by the eyewear device.