AR Object Overlay Depth Comparison
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Augmented Reality (AR) systems struggle to accurately overlay virtual objects onto real environments due to calibration errors and the inability to dynamically adjust for changes in robot cell constructions, leading to incorrect positioning and visibility issues of AR objects.
Innovation Solution
A method and device that optically record image points of the real environment, determine depth positions, and compare them with virtual image points to dynamically adjust the representation of AR objects in real-time, allowing for accurate overlaying without the need for complex modeling processes, using techniques like depth image recording and real-time processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If overlap models are used to overlay AR objects in environmental images, then the positioning and overlap accuracy can be improved, but calibration errors and model-reality discrepancies cause incorrect positioning and visibility issues
Solution Approach 1:
The patent replaces the mechanical/calibration-based overlap model system with an optical field-based depth comparison system. Instead of relying on pre-calibrated 3D models that require manual adjustment, the system uses depth images captured by a depth sensor to directly compare real-world depths with virtual object depths at corresponding image points, eliminating calibration errors inherent in model-based approaches
Solution Approach 2:
The patent changes the fundamental parameter for determining overlap from model coordinates and calibration data to actual optical depth measurements. By using depth values captured from the real environment and comparing them with depth values of virtual objects at the same image coordinates, the system dynamically adapts to real-world conditions without relying on static models
2Measurement precision
If complex modeling processes are used to create accurate overlap models, then the positioning precision can be improved, but the device complexity and computational requirements increase
Solution Approach 1:
The patent extracts only the essential depth information from the complex modeling process. Instead of creating and maintaining complete 3D overlap models with all their geometric and spatial complexities, the system extracts depth values at specific image points from depth images and uses only those values for overlap determination, significantly simplifying the process
Solution Approach 2:
The patent uses depth images as direct optical copies of the real environment, eliminating the need to create mathematical models. The depth sensor captures the actual depth structure of the environment, and these captured depth values are directly compared with virtual object depths, replacing complex model creation with simple image capture and comparison
3Measurement precision
If static overlap models are used, then the initial positioning can be accurate, but the system cannot dynamically adjust to changes in robot cell constructions
Solution Approach 1:
The patent transforms the static overlap model approach into a dynamic system that continuously captures depth images and recalculates overlap relationships in real-time. The system adapts to changes in the environment by repeatedly capturing updated depth information and comparing it with virtual object positions, enabling automatic adjustment without manual recalibration
Solution Approach 2:
The patent implements a feedback mechanism where depth images of the real environment are continuously captured, compared with virtual object depths, and used to dynamically adjust the overlay positioning. This closed-loop approach automatically compensates for changes in the robot cell construction by using real-time depth measurement feedback
Data Source
AI summary
A method for overlaying AR objects on an environmental image representing the environment includes recording a depth image of the environment from a point of vision; modifying the representation of an AR object to be placed in the environmental image in terms of how it appears from the point of vision at a pre-defined spot in the environmental image; determining how the parts of the AR object facing the point of vision are arranged in relation to an associated image point of the depth image, from the point of vision; modifying at least the representation of parts of the AR object in a pre-determined manner in relation to the apparent depth in the image; and overlaying the processed AR object on the environmental image. A device for overlaying AR objects on an environmental image displaying the environment operates according to the method steps.