Folded Optics for XR Pass-Through Without Digital Reprojection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality (XR) systems face challenges in providing pass-through images without digital reprojection, which leads to computational intensity, increased power consumption, and artifacts due to differences in camera perspectives and user viewpoints.
Innovation Solution
Utilizing foldable optics with light redirecting elements to project real-world environment images onto the user's viewpoint directly, eliminating the need for digital reprojection by redirecting light through mirrors or prisms between the environment and the user's eyes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If digital reprojection is used to provide pass-through images in XR systems, then the user can see real-world environment through the device, but computational intensity and power consumption increase significantly
Solution Approach 1:
The patent extracts the computational reprojection process entirely from the system by using optical elements (prisms, mirrors, or relay lenses) to directly relay the camera image to the user's eye. This removes the need for digital image processing and reproduction, eliminating the associated power consumption while maintaining pass-through functionality.
Solution Approach 2:
The patent introduces optical intermediaries (prisms, mirrors, or relay lenses) between the camera and the user's eye to transfer the image. These optical elements act as mediators that physically redirect light paths, replacing the computational mediation previously used to achieve the same effect.
2Measurement precision
If digital reprojection is used to correct camera perspective differences, then image alignment improves, but computational intensity increases
Solution Approach 1:
The patent removes the computational image alignment process by using optical elements positioned at the camera to directly project the image at the correct angle to the user's eye. The perspective correction is achieved optically rather than computationally, eliminating processing requirements.
Solution Approach 2:
The patent performs perspective correction in advance through the optical design of the camera assembly, where prisms or mirrors are configured to pre-align the image path before it reaches the user's eye. This preliminary optical alignment eliminates the need for subsequent computational adjustments.
3Adaptability or versatility
If multiple cameras are used to capture different perspectives, then scene coverage improves, but device complexity increases
Solution Approach 1:
The patent combines multiple camera assemblies into a single integrated unit with shared optical elements and processing. By merging the camera systems, the patent achieves comprehensive scene coverage while reducing overall device complexity through consolidation of components and streamlined processing architecture.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces computational costs, power consumption, and artifacts by allowing direct projection of real-world images from the user's perspective, enhancing the XR experience.
Implementation Method 1
redirecting, by the first light redirecting element, the light from the scene toward a second optical axis
Data Source
AI summary
Systems and techniques are described for redirecting light. For example, an apparatus for redirecting light can include a display positioned along a first optical axis. The first optical axis passes through a viewing plane of the display and intersects with a viewing position. The apparatus can include a first light redirecting element positioned along the first optical axis. The first light redirecting element is configured to redirect light from a scene toward a second optical axis. The apparatus includes an image sensor. The image sensor is configured to receive the light from the scene. The first light redirecting element is included along an optical path between the scene and the image sensor.