Wearable Gaze Alignment with Dual-Camera Object Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices struggle to accurately adjust gaze information of users by integrating visual and external object interactions within the field of view, leading to suboptimal augmented reality experiences.
Innovation Solution
A wearable device equipped with a first camera to identify external objects interacting with visual objects, a second camera to track eye direction, and a display to adjust gaze information based on the position of these objects, enhancing the accuracy of gaze direction alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If gaze information is adjusted using only eye direction data from the second camera, then the device complexity is reduced, but the accuracy of gaze direction alignment deteriorates
Solution Approach 1:
The patent combines eye direction data from the second camera with external object position data from the first camera to adjust gaze information. By merging these two data sources, the system achieves more accurate gaze direction alignment than using eye direction data alone, while the integrated processing approach manages the increased complexity through coordinated operation of multiple cameras and processors.
Solution Approach 2:
The wearable device performs multiple functions: the first camera captures external object information, the second camera captures eye direction information, and the processor integrates both to adjust gaze information for augmented reality display. This multi-functional approach allows the system to improve measurement precision while utilizing existing hardware components for multiple purposes.
2Measurement precision
If multiple cameras are used to capture both external objects and eye direction, then the measurement precision of gaze information improves, but the device complexity increases
Solution Approach 1:
The patent divides the gaze information capture function into two separate camera systems: the first camera dedicated to capturing external objects and the second camera dedicated to capturing eye direction. This segmentation allows each camera to be optimized for its specific function while the processor integrates the results, achieving high measurement precision through specialized data collection.
Solution Approach 2:
The processor acts as an intermediary that receives data from both cameras and coordinates their information to adjust gaze direction. By using the processor as a mediator to integrate data from multiple cameras, the system manages the complexity of multi-camera operation through centralized processing and coordination.
3Reliability
If gaze adjustment is performed without considering external object interactions, then the ease of operation is improved, but the realism of augmented reality experience deteriorates
Solution Approach 1:
The system continuously captures external object position data and eye direction data, processes this information to adjust gaze direction in real-time, and displays updated augmented reality content. This feedback loop ensures that the augmented reality experience remains realistic by dynamically adapting to user gaze and external object interactions, while the automated processing maintains ease of operation.
Solution Approach 2:
The wearable device automatically adjusts gaze information based on captured data without requiring manual user input for gaze calibration or adjustment. The system serves itself by using the first and second cameras to automatically determine and correct gaze direction, maintaining both realism and ease of operation through autonomous functionality.
Data Source
AI summary
In accordance with an aspect of the disclosure, a wearable device is provided. The wearable device includes a first camera, a second camera, a display, memory storing one or more computer programs; and one or more processors communicatively coupled to the first camera, the second camera, the display, and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the at one or more processors individually or collectively, cause the wearable device to display, using the display, a visual object within a field of view (FoV) of a user in a state where the wearable device is worn by the user, while displaying the visual object, based on the first camera disposed toward the FoV, identify an external object, interacting with the visual object, seen through the FoV, obtain a position of the external object, based on identifying an interaction between the external object and the visual object using the first camera, and change information indicating a direction of eyes, identified by frames outputted from the second camera disposed toward the eyes of the user, using at least one of a position of the visual object or the position of the external object, based on obtaining the position of the external object.