2D Point of Interest Mapping to 3D Spatial Coordinates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for mapping points of interest in 2D images to 3D environments are inefficient, particularly in dynamic industrial settings where equipment configurations change frequently, leading to inaccuracies and increased effort in maintenance and navigation.
Innovation Solution
A method utilizing augmented reality devices to capture 3D images, match them with 2D image databases containing points of interest defined in 2D coordinates, and convert these 2D coordinates to 3D data sets, thereby simplifying the configuration and reuse of point-of-interest definitions across 3D applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If 2D images with points of interest are used for 3D applications, then the effort to define points of interest is reduced, but the accuracy of locating parts in 3D space deteriorates
Solution Approach 1:
The patent introduces an intermediary conversion process that maps 2D image coordinates to 3D spatial coordinates through camera calibration parameters and projection geometry. This mediator enables the system to work with simple 2D images while accurately determining 3D locations by mathematically bridging the coordinate systems.
Solution Approach 2:
The system creates a virtual copy of the physical environment by capturing images with an augmented reality device and mapping points of interest from 2D images into a 3D coordinate system. This digital replica allows operators to interact with virtual representations while maintaining accurate spatial relationships to physical components.
2Measurement precision
If full 3D images and associated content are stored, then the accuracy of point of interest location is improved, but the storage requirements increase
Solution Approach 1:
The patent extracts only the essential information needed for 3D localization by storing 2D image files and their associated 3D coordinate mappings, rather than storing complete 3D image data. This extraction approach retains the necessary spatial accuracy while dramatically reducing data storage requirements by keeping only the minimal required dataset.
3Adaptability or versatility
If 2D images are used for dynamic equipment configurations, then the adaptability to configuration changes is improved, but the reliability of point of interest identification deteriorates
Solution Approach 1:
The system dynamically adapts to equipment configuration changes by capturing new images with the augmented reality device whenever changes occur. The point of interest definitions are updated in real-time by matching new 2D images with the existing 3D coordinate system, allowing the system to remain reliable despite dynamic changes in the physical environment.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention relates to a method for mapping 2-dimensional point of interest to a 3-dimensional view. The disclosed method includes capturing a 3-dimensional (3D) image with an augmented reality device. Matching images of a 2D image database with the captured 3D-image, the 2D image database containing 2-dimensional (2D) images associated with points of interest having a 2-dimensional (2D) data set. And when the 2D-image matches the 3D image, capturing 3D-data for the matched 2D-image and converting the 2D-data set of the point-of-interest to a 3D-data set. The disclosed method simplifies the configuration of Points of interest for 3D applications, such as an augmented reality device.