AR Overlay Reprojection Using Distance and Angle-Based Pixel Offset
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented-reality (AR) devices struggle to achieve real-time alignment of electromagnetic data as a virtual image overlaid on the real-world environment, particularly due to the lack of automated methods and suitable devices for integrating EM imaging, which is crucial for applications like construction, healthcare, firefighting, and hunting.
Innovation Solution
A method and AR device that captures electromagnetic data, determines the distance and angle to a target object, computes a pixel offset value, and re-projects the image on the display to align it with the real-world environment, using a first imaging device and measurement sensors to ensure continuous alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If mechanical repositioning of the imaging unit is used to align the virtual image, then alignment accuracy can be improved, but device complexity and difficulty of implementation increase significantly
Solution Approach 1:
The patent replaces the mechanical repositioning system with a computational approach. Instead of physically moving the imaging unit to align the virtual image with the real-world target, the system calculates the correct projection position based on measured distance and angle data, then digitally positions the virtual image accordingly. This substitution eliminates complex mechanical components while achieving the same alignment function through software-based coordinate transformation.
Solution Approach 2:
The patent introduces an intermediary computational layer that processes distance measurements from the measurement sensor and angle data from the imaging device. This intermediary system calculates the appropriate projection position on the display without requiring direct mechanical coupling between the sensor and the display, thereby simplifying the overall device architecture while maintaining alignment accuracy.
2Device complexity
If the EM virtual image is projected on the periphery of the wearer's vision, then device complexity is reduced, but alignment accuracy and usability deteriorate
Solution Approach 1:
The patent applies local quality by adapting the projection location based on the target's position in the user's field of view. Instead of always projecting to a fixed peripheral location, the system calculates the appropriate projection position that corresponds to the angular position of the target object. This ensures the virtual image appears at the correct location in the user's vision, maintaining alignment accuracy while keeping the device relatively simple.
3Ease of operation
If automated real-time alignment is implemented, then alignment accuracy and usability are improved, but device complexity and implementation difficulty increase
Solution Approach 1:
The patent implements self-service by enabling the system to automatically perform alignment calculations and adjust the virtual image position without requiring manual intervention. The measurement sensor continuously provides distance data, and the processing system automatically computes and applies the appropriate projection position, making the device adaptive to changing conditions while maintaining relatively simple operation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables real-time alignment of virtual images with the real-world environment, enhancing user interaction and spatial orientation by continuously adjusting the image projection based on changing distances and angles, thereby improving usability and accuracy.
Implementation Method 1
capturing at a first time, by a first imaging device, electromagnetic data of a target object
Implementation Method 2
determining, by a first measurement sensor, a first distance (D) to the target object
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present disclosure provides a method and augmented reality (AR) device for the real-time alignment of a virtual image on a real-world environment visible to a wearer through the display of the AR device. The method includes the calculation of a pixel offset value based on the distance from a distance measurement sensor of the device to a target object, a fixed distance between an imaging device of the AR device and an eye of the user, and a physical angle between the optical axis and the target object.