Optical Waveguide Combiner Camera Self-Calibration for AR Registration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality (VR), augmented reality (AR), and mixed reality (MR) display systems face challenges in accurately registering virtual objects with real-world objects due to uncertainties in display angle and position, leading to errors in projected boresight and parallax, particularly in applications where mechanical registration is not feasible or desirable.
Innovation Solution
The implementation of an optical display system with an optical waveguide combiner and multiple cameras, allowing for electronic self-calibration and registration of virtual objects with real objects using overlapping camera fields of view and fiducial alignment, along with methods for determining real object distances and spatial locations from captured images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If mechanical registration is used to align virtual objects with real objects, then registration accuracy is improved, but device complexity and ease of manufacture deteriorate when mechanical registration is not feasible
Solution Approach 1:
The patent replaces mechanical registration systems with an optical-based registration system using waveguide combiners and cameras. The system captures images of real objects, determines their spatial locations and distances, and registers virtual objects accordingly, eliminating the need for complex mechanical alignment mechanisms while maintaining registration accuracy
Solution Approach 2:
The system performs self-calibration and self-registration by using its own cameras to capture real-world scenes, automatically determine object spatial parameters, and adjust virtual object placement without requiring external calibration equipment or manual mechanical adjustment, enabling the system to register accurately without complex external mechanical systems
2Measurement precision
If multiple cameras with overlapping fields of view are used for self-calibration, then registration accuracy is improved, but device complexity increases
Solution Approach 1:
The multiple cameras serve multiple functions: they capture real-world scenes for object recognition, provide overlapping fields of view for self-calibration, and enable determination of spatial locations and distances. This multi-functionality justifies the added complexity by eliminating the need for separate calibration equipment and mechanisms
Solution Approach 2:
The system uses the cameras to continuously capture real-world scenes, compare virtual and real object positions, detect registration errors, and adjust virtual object placement accordingly. This feedback loop enables automatic maintenance of registration accuracy without requiring complex manual intervention or calibration procedures
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate registration of virtual objects with real objects, reducing errors in VR/AR/MR displays, even in applications with independent camera and sensor movements, thereby improving the precision and safety of AR navigation and object alignment.
Implementation Method 1
an optical waveguide combiner comprising a waveguide optical substrate, an optical input coupler on, in or adjacent the waveguide optical substrate; and an optical output coupler on or in the waveguide optical substrate. The optical input coupler may be coupled via the waveguide optical substrate to the optical output coupler.
Implementation Method 2
The output coupler comprises any one or combination of prism arrays, cascaded mirrors, diffractive gratings and holograms. The output coupler may comprise optical diffractive elements.
Data Source
AI summary
An optical display system has an optical waveguide combiner and one or more cameras. The one or more camera(s) is optically coupled to the optical waveguide combiner and have a field of view of at least one real object and at least one virtual object displayable by the optical display system. The one or more camera(s), which may be for example wafer level waveguide camera(s), may be disposed outside the usable field of view of an output coupler. The one or more camera(s) may be self-calibrated electronically using images captured by the cameras of one or more virtual object(s) displayable by the optical display system. AR/VR/MR registration of devices and/or displayed virtual objects with real objects may be implemented using the images captured by the one or more camera(s) of the displayed virtual objects and real world objects. Real object distance and/or spatial location relative to the optical waveguide combiners may be determined or estimated from the captured images.