Augmented Reality Object Selection Using Dominant-Eye Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) devices face inaccuracies in object selection due to discrepancies between the user's pointing direction and the device's recognition, leading to increased power consumption and user inconvenience, particularly in head-mounted displays.
Innovation Solution
An electronic device with a camera module and processor that determines a user's dominant eye, adjusts the selection point based on dominant eye correction information, and corrects the position or direction of object recognition to improve accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a virtual extension line is displayed to show the direction the device points to, then the user can see the selection direction, but the current consumption increases and the direction may not match the user's actual pointing direction
Solution Approach 1:
The patent removes the virtual extension line from the display to eliminate continuous power consumption. Instead of displaying a persistent visual indicator, the system uses eye tracking to determine the user's dominant eye and applies correction values to align the pointer with the user's actual pointing direction, achieving the same functional goal without the energy cost of continuous display.
Solution Approach 2:
The system uses the user's own eye movements and dominant eye characteristics to automatically determine the correct pointer position. By tracking eye position and applying stored correction values specific to each user's dominant eye, the system self-adjusts the pointer alignment without requiring additional visual indicators or user input.
2Ease of operation
If the pointer position is changed to match user's head movement, then the user can select objects by moving the head, but it becomes inconvenient for the user
Solution Approach 1:
The system incorporates feedback from eye tracking to automatically adjust the pointer position. By continuously monitoring eye position and comparing it with the user's intended target, the system applies correction values to align the pointer with the user's pointing direction, providing accurate selection without requiring the user to move their head.
3Measurement precision
If the device uses a fixed reference point for object selection, then the system is simple to implement, but the selection accuracy decreases due to discrepancies between device direction and user pointing direction
Solution Approach 1:
The system changes the selection reference from a fixed device-centered point to a dynamic point based on user eye position and dominant eye characteristics. By storing and applying user-specific correction values derived from eye tracking data, the system adapts the reference frame to match the user's natural pointing behavior, significantly improving selection accuracy.
Solution Approach 2:
The system performs preliminary eye tracking and dominant eye determination during an initialization phase to store correction values in advance. These pre-calculated correction values are then applied during normal operation to adjust the pointer position, allowing the system to maintain high accuracy without complex real-time calculations during selection.
Data Source
AI summary
An electronic device includes a first camera module; a display for displaying an augmented reality content; a processor operatively connected to the first camera module and the display; and a memory operatively connected to the at least one processor and storing instructions and dominant eye correction information. The processor performs a dominant eye determination operation of a user of the electronic device identifying a first position of a first object during the dominant eye determination operation; identifies a second position of the first object by using the first camera module; recognizes, as a selected point, a point moved, by a first correction value determined on the basis of the dominant eye correction information, from a first reference point displayed on the augmented reality content during the dominant determination operation; and selects a second object on the augmented reality content corresponding to the selected point.