Single-Sensor Camera Architecture for Eye and Outward Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Implementing both eye-tracking and outward-tracking systems in augmented-reality/mixed-reality near-eye devices poses challenges due to increased device weight, power consumption, thermal management, and alignment issues, particularly in non-rigid frames like lightweight AR glasses.
Innovation Solution
A combined camera architecture is implemented using a single outward-facing imaging system with a color filter array and optical elements like hot mirror coatings or holographic optical elements to reflect eye and environmental light, allowing a single sensor to perform both eye-tracking and outward-tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If separate eye-tracking and outward-tracking systems are implemented, then tracking functionality is comprehensive, but device weight increases
Solution Approach 1:
The patent combines separate eye-tracking and outward-tracking systems into a single integrated imaging system. The imaging system captures both the user's eye through the optical element and the external environment simultaneously, merging two previously separate functions into one unified system. This reduces the total number of components and overall device weight while maintaining comprehensive tracking functionality.
Solution Approach 2:
The integrated imaging system performs multiple functions: it tracks the user's eye position, captures outward environmental scenes, and provides imaging data for both purposes through a single system. This multi-functional approach eliminates the need for separate dedicated cameras and processing systems for each tracking type, thereby reducing device weight.
2Adaptability or versatility
If separate eye-tracking and outward-tracking systems are implemented, then tracking functionality is comprehensive, but power consumption increases
Solution Approach 1:
The patent merges separate imaging systems into one integrated system that processes both eye-tracking and outward-tracking data. This consolidation reduces the total power consumption by eliminating redundant components such as multiple image sensors, separate processing units, and duplicate illumination systems, while still providing comprehensive tracking functionality.
Solution Approach 2:
The single imaging system is designed to perform multiple tracking functions simultaneously, reducing overall power consumption compared to running separate dedicated systems. The system efficiently manages power by using shared hardware resources and unified processing pipelines for both eye-tracking and environmental capture tasks.
3Adaptability or versatility
If separate eye-tracking and outward-tracking systems are implemented, then tracking functionality is comprehensive, but thermal management becomes difficult
Solution Approach 1:
The patent combines multiple heat-generating components into a single integrated imaging system, reducing the total thermal load and simplifying heat dissipation. By consolidating image sensors, processing units, and illumination sources into one system, the device generates less overall heat and can manage thermal conditions more effectively compared to running multiple separate systems.
4Adaptability or versatility
If separate eye-tracking and outward-tracking systems are implemented, then tracking functionality is comprehensive, but alignment issues increase
Solution Approach 1:
The patent integrates eye-tracking and outward-tracking into a single imaging system with a unified optical path, eliminating alignment issues between separate systems. The single system ensures consistent spatial relationships and calibration between eye position data and environmental capture, as both functions share the same sensor and processing pipeline, removing the need for complex inter-system alignment.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces device weight and power consumption, improves thermal management, and minimizes the need for online calibration to address alignment issues, enhancing the functionality and efficiency of near-eye devices.
Implementation Method 1
directing light reflected off the eye of the user to the imaging system
Implementation Method 2
a color filter array comprising: a first set of filters for allowing the projected light from the eye illuminator to pass; and a second set of filters for allowing visible light to pass
Data Source
AI summary
Implementations of camera architectures for combined eye-tracking and outward-tracking are provided. One example includes a near-eye device comprising: a frame comprising an arm; an eye illuminator disposed on the arm of the frame, wherein the eye illuminator is configured to project light to an eye of a user; an imaging system disposed on the arm of the frame, wherein the imaging system comprises: an image sensor; and a color filter array comprising: a first set of filters for allowing the projected light from the eye illuminator to pass; and a second set of filters for allowing visible light to pass; and a lens comprising an optical element for: directing the projected light from the eye illuminator to the eye of the user; and directing light reflected off the eye of the user to the imaging system.