AR Virtual Image Alignment Using Real-Time Pixel Offset
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented-reality (AR) devices struggle to achieve real-time alignment of electromagnetic data as a virtual image overlaid on the real-world environment, particularly in transparent displays, due to the lack of effective methods and systems for aligning thermal or infrared imagery with the user's field of view.
Innovation Solution
A method and system for AR devices that capture electromagnetic data, determine the distance and angle to a target object, compute a pixel offset value, and re-project the image in real-time to align it with the real-world environment using a multispectral imaging camera and measurement sensors like LiDAR or IR sensors, ensuring continuous alignment through a continuous loop process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If mechanical repositioning of the imaging unit is used to align the EM virtual image, then alignment accuracy is improved, but device complexity and difficulty of implementation increase significantly
Solution Approach 1:
The patent replaces mechanical repositioning of the imaging unit with a computational approach. The system calculates a pixel offset value based on distance measurements and applies this offset digitally to the projected image position. This substitutes complex mechanical actuation with simple computational correction, resolving the contradiction between alignment accuracy and device complexity.
Solution Approach 2:
The patent changes the parameter being adjusted from physical position (mechanical) to pixel offset (digital). By measuring distance and calculating the corresponding pixel offset, the system adjusts image alignment through parameter transformation rather than mechanical movement, reducing device complexity while maintaining alignment precision.
2Device complexity
If the EM virtual image is projected on the periphery of the wearer's vision, then device simplicity is maintained, but alignment accuracy and user interaction capability deteriorate
Solution Approach 1:
The patent implements dynamic image repositioning based on real-time distance measurements. The pixel offset value is continuously updated as the target object's distance changes, allowing the image to be dynamically positioned in the optimal location (center of FOV) rather than statically on the periphery. This maintains device simplicity while achieving accurate alignment through adaptive parameter adjustment.
3Measurement precision
If automated real-time alignment is implemented, then alignment accuracy is improved, but device complexity and difficulty of manufacture increase
Solution Approach 1:
The patent replaces complex automated mechanical alignment systems with a computational solution. The system uses distance measurements from simple sensors (LiDAR, IR, ultrasonic) and applies pixel offset calculations to achieve real-time alignment. This substitution of mechanical automation with computational methods improves alignment accuracy while maintaining ease of manufacture.
4Adaptability or versatility
If mechanical adjustability mechanisms are added to the AR device, then alignment capability is improved, but device complexity and weight increase
Solution Approach 1:
The patent replaces mechanical adjustability mechanisms with a digital image repositioning system. The system calculates pixel offset values based on distance measurements and applies these offsets to the projected image, achieving alignment capability without any mechanical moving parts. This resolves the contradiction by providing adaptability through computational means rather than mechanical complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables real-time alignment of virtual images with the real-world environment, enhancing user interaction and spatial orientation by maintaining accurate alignment of thermal or infrared imagery with the user's field of view, even as the distance to the target object changes.
Implementation Method 1
determining, by a first measurement sensor, a first distance (D) to the target object in the user FOV
Implementation Method 2
capturing at a first time, by a first imaging device, electromagnetic data of a target object... wavelengths of light that are not perceptible to the human eye
Implementation Method 3
The infrared range of the EM spectrum contains useful information about the temperature of objects
Data Source
AI summary
The present disclosure provides a method and augmented reality (AR) device for the real-time alignment of a virtual image on a real-world environment visible to a wearer through the display of the AR device. The method includes the calculation of a pixel offset value based on the distance from a distance measurement sensor of the device to a target object, a fixed distance between an imaging device of the AR device and an eye of the user, and a physical angle between the optical axis and the target object.