Optical Waveguide Combiner Cameras for Self-Calibrated AR Registration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality (VR), augmented reality (AR), and mixed reality (MR) display systems face challenges in accurately registering virtual objects with real-world objects due to uncertainties in display angle and position, leading to errors in projected boresight and parallax, particularly in applications where mechanical registration is not feasible or desirable.
Innovation Solution
The use of optical waveguide combiners with integrated cameras that electronically self-calibrate and register virtual objects with real objects through image stitching and fiducial alignment, allowing for accurate registration without mechanical constraints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If mechanical registration is used to align virtual objects with real-world objects, then registration accuracy is improved, but device complexity and ease of manufacture deteriorate due to stringent mechanical tolerancing requirements
Solution Approach 1:
The patent replaces mechanical registration systems with an optical-computational approach. Multiple cameras capture images of real-world objects, and a processor computationally determines spatial locations and generates accurate 3D models, eliminating the need for complex mechanical registration mechanisms while achieving superior registration accuracy.
Solution Approach 2:
The patent creates digital copies (3D models) of real-world objects through photogrammetry. Multiple 2D images captured by cameras are processed to generate accurate 3D representations, which are then used for precise virtual object registration without requiring physical mechanical alignment systems.
2Measurement precision
If multiple cameras are used to capture images for 3D modeling, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent makes the camera system multi-functional. The same cameras that capture images for 3D modeling also capture images for virtual object registration and augmented reality overlay. This eliminates the need for separate specialized sensors, reducing overall device complexity while maintaining high measurement precision.
Solution Approach 2:
The camera system serves itself by using its own captured images for multiple purposes. The images taken for spatial mapping are automatically reused for virtual object registration and AR content placement, eliminating the need for additional dedicated systems and reducing complexity.
3Ease of operation
If cameras are positioned within the field of view of the eyebox, then ease of operation is improved, but measurement precision deteriorates due to limited overlapping field of view
Solution Approach 1:
The patent positions cameras in a different spatial dimension - outside and adjacent to the eyebox field of view rather than within it. This external positioning provides an orthogonal or side-view perspective that captures the entire eyebox area and virtual image, enabling comprehensive spatial mapping and accurate 3D modeling without obstructing the user's view.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables precise alignment of virtual and real-world objects, improving the accuracy and reliability of AR and VR displays, especially in environments where mechanical registration is impractical, such as bomb disposal suits or low-light navigation.
Implementation Method 1
an optical waveguide combiner comprising a waveguide optical substrate, an optical input coupler on, in or adjacent the waveguide optical substrate; and an optical output coupler on or in the waveguide optical substrate
Implementation Method 2
The output coupler comprises any one or combination of prism arrays, cascaded mirrors, diffractive gratings and holograms. The output coupler may comprise optical diffractive elements.
Data Source
AI summary
An optical display system has an optical waveguide combiner and one or more cameras. The one or more camera(s) is optically coupled to the optical waveguide combiner and have a field of view of at least one real object and at least one virtual object displayable by the optical display system. The one or more camera(s), which may be for example wafer level waveguide camera(s), may be disposed outside the usable field of view of an output coupler. The one or more camera(s) may be self-calibrated electronically using images captured by the cameras of one or more virtual object(s) displayable by the optical display system. AR/VR/MR registration of devices and/or displayed virtual objects with real objects may be implemented using the images captured by the one or more camera(s) of the displayed virtual objects and real world objects. Real object distance and/or spatial location relative to the optical waveguide combiners may be determined or estimated from the captured images.