3D Subspace Image Matching via Projection and Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Manual subspace matching between 3D scenes and 2D images is time-consuming and labor-intensive, necessitating an automated method for establishing association relationships between 3D and 2D images in virtual roaming applications.
Innovation Solution
An image matching method and apparatus that involves obtaining panoramic images of 3D subspaces, performing 3D reconstruction, and projecting these images onto a 2D plane to establish matching relationships between panoramic and 2D images, utilizing deep neural networks for semantic recognition and segmentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual subspace matching is performed between 3D scenes and 2D images, then association relationships can be established, but the process is time-consuming and labor-intensive
Solution Approach 1:
The patent replaces manual mechanical matching operations with an automated computer-based system that uses image processing algorithms to perform 3D reconstruction, projection, and matching operations, thereby eliminating time-consuming manual labor while maintaining matching accuracy
Solution Approach 2:
The patent creates a projection image (a 2D copy) from the panoramic 3D image through 3D reconstruction and projection operations, enabling automated comparison and matching between the projection image and 2D reference images without manual intervention
2Productivity
If automated image matching is implemented using 3D reconstruction and projection, then matching efficiency is improved, but system complexity increases
Solution Approach 1:
The patent divides the complex matching task into distinct modular steps: obtaining panoramic images, performing 3D reconstruction, generating projection images, and comparing with reference images. This segmentation enables automated processing while managing system complexity through clear separation of functions
Solution Approach 2:
The patent introduces a projection image as an intermediary between the panoramic 3D image and the 2D reference image. This intermediary enables automated matching by providing a common 2D representation that can be directly compared with reference images, thereby improving efficiency while keeping the system architecture manageable
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
Disclosed are an image matching method and apparatus. The image matching method is inclusive of steps of obtaining a panoramic image of at least one subspace in a 3D space and a 2D image of the 3D space; acquiring a 2D image of the at least one subspace in the 3D space; performing 3D reconstruction on the panoramic image of the at least one subspace, and procuring a projection image corresponding to the panoramic image of the at least one subspace; and attaining a matching relationship between the panoramic image of the at least one subspace and the 2D image of the at least one subspace, and establishing an association relationship between the panoramic image of the at least one subspace and the 2D image of the at least one subspace between which the matching relationship has been generated.