Wearable Gaze Tracking Synchronization Prevents Camera Crosstalk
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current wearable electronic devices, such as head-mounted displays, face challenges in accurately tracking user gaze and facial expressions for enhanced augmented and virtual reality experiences, particularly in varying lighting conditions and without causing user discomfort.
Innovation Solution
A wearable electronic device equipped with multiple cameras and infrared lights, where the first tracking device captures images of the user's eyes and the second tracking device captures facial expressions, with synchronized exposure times to prevent crosstalk and improve image quality, allowing for precise gaze and facial expression tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple cameras and infrared lights are used for gaze and face tracking, then tracking accuracy is improved, but device complexity increases
Solution Approach 1:
The tracking system is divided into multiple independent camera modules (first camera for left eye, second camera for right eye, third camera for face) and lighting units (first infrared lights for eyes, second infrared lights for face). Each module operates independently to capture specific tracking data, enabling precise gaze and facial expression tracking while maintaining modular device architecture.
Solution Approach 2:
The patent combines multiple camera systems and infrared lighting units into a single integrated wearable device. The first cameras, second cameras, first infrared lights, and second infrared lights are merged into one cohesive tracking system that simultaneously captures eye gaze and facial expression data, improving overall tracking accuracy.
2Adaptability or versatility
If multiple cameras operate simultaneously to track both eyes and face, then comprehensive tracking is improved, but image quality deteriorates due to crosstalk
Solution Approach 1:
The patent implements periodic exposure timing where the first cameras and second cameras are activated in alternating time slots. The first cameras capture eye images during their designated exposure period, then the second cameras capture face images during their exposure period. This periodic operation prevents simultaneous exposure that would cause crosstalk, thereby maintaining high image quality while achieving comprehensive tracking coverage.
Solution Approach 2:
The system pre-configures exposure timing sequences to ensure that eye tracking and face tracking occur in predetermined time slots. By planning the exposure schedule in advance, the system eliminates potential crosstalk between different camera modules while ensuring both tracking functions are comprehensively covered.
3Ease of operation
If exposure timing is not synchronized between multiple cameras, then device operation is simplified, but tracking precision deteriorates due to temporal misalignment
Solution Approach 1:
The patent implements a centralized control mechanism that receives feedback from the periodic exposure timing system and adjusts the operation of multiple cameras accordingly. The control unit monitors the exposure timing of first cameras and second cameras, ensuring they operate in synchronized alternating patterns. This feedback-based control maintains precise temporal alignment between different tracking modules while keeping the overall operation manageable through automated coordination.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables accurate and efficient tracking of user gaze and facial expressions, enhancing the realism and interactivity of augmented and virtual reality experiences while minimizing user discomfort and improving image quality in various lighting conditions.
Implementation Method 1
a first tracking device including first infrared (IR) lights configured to generate images reflected on a left eye and a right eye of a user wearing the wearable electronic device
Data Source
AI summary
A wearable electronic device is provided. The wearable electronic device includes a processor and memory communicatively coupled to the processor. The wearable electronic device includes a first tracking device including first lights corresponding to a first area of a user wearing the wearable electronic device and first cameras corresponding to the first area, and a second tracking device including second lights corresponding to a second area of the user and second cameras corresponding to the second area. The memory store one or more computer programs including computer-executable instructions that, when executed by the processor, cause the wearable electronic device to generate a first signal related to the exposure of a first primary camera among the first cameras before an exposure time of the first primary camera and input the generated first signal as a signal notifying the second cameras of the start of a frame.