3D Reconstruction Registration Using Reference 3D Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D reconstruction methods face challenges in achieving accurate 3D representations due to errors propagated from images captured at different perspectives or conditions, leading to unsatisfactory models.
Innovation Solution
The method involves correlating each image with a high-precision reference 3D data set to update intrinsic and extrinsic camera parameters, using stereo image pairs for registration, and employing iterative refinement to improve positional accuracy, generating a water mask to reduce height variance, and preprocessing images to enhance registration accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image registration is performed without correlating with reference 3D data set, then the processing is faster and simpler, but the positional accuracy of images deteriorates
Solution Approach 1:
The patent applies preliminary action by pre-correlating images with a reference 3D data set before performing full 3D reconstruction. This preliminary correlation establishes accurate camera parameters and positional information in advance, which then serves as a foundation for the reconstruction process, improving accuracy without proportionally increasing overall complexity
Solution Approach 2:
The reference 3D data set acts as an intermediary that mediates between the input images and the final 3D reconstruction. By introducing this intermediate reference structure, the system can transfer and propagate high-precision positional information through the reconstruction pipeline, resolving the accuracy-complexity trade-off
2Measurement precision
If arbitrary initial state is used for 3D reconstruction, then the process is simpler to start, but the reconstruction accuracy and time consumption deteriorate
Solution Approach 1:
The patent performs preliminary correlation of images with the reference 3D data set to generate an accurate initial state for reconstruction. This preliminary action provides a head start in the optimization process, reducing the number of iterations needed to achieve high accuracy and thereby reducing overall reconstruction time
Solution Approach 2:
The system uses feedback from the correlation process with the reference data set to continuously refine camera parameters and 3D point positions during reconstruction. This feedback mechanism guides the optimization toward the correct solution more efficiently, improving both accuracy and convergence speed
3Reliability
If unconstrained search space is used during 3D reconstruction, then the solution space is more complete, but the computational complexity and time consumption increase
Solution Approach 1:
The patent applies local quality by constraining the search space locally around the positions suggested by correlation with the reference 3D data set. Instead of searching the entire parameter space uniformly, the method focuses computational effort on locally relevant regions, maintaining reliability while improving efficiency
Solution Approach 2:
The system dynamically changes search parameters based on the correlation results, adjusting the bounds and focus of the optimization search. By modifying search parameters to reflect the information gained from preliminary correlation, the system achieves efficient convergence without sacrificing solution quality
Data Source
Figure 1a
Figure 1b~2
AI summary
The present disclosure relates to a method (100) for 3D reconstruction. The method comprises obtaining (S100) a set of images, each image overlapping a region of interest, performing (S400) image registration for the set of images, wherein performing the image registration comprises correlating (S410) each image with a reference 3D data set, the correlating (S410) of each image with the reference 3D data set being arranged to determine the positional accuracy of each image to the same positional accuracy of the reference 3D data set, and generating (S600) a 3D data set relating to the region of interest using (S610) 3D reconstruction based on the registered images. The present disclosure also relates to corresponding computer program products and systems.