Indoor 3D Reconstruction from 2D Video and Point Cloud Regularization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for three-dimensional reconstruction of indoor scenes are time-consuming, require high professional skills, are costly, or have stringent image shooting requirements, limiting their widespread use and efficiency.
Innovation Solution
A method utilizing a two-dimensional video for three-dimensional reconstruction involving generating a color point cloud, regularizing it, projecting onto a horizontal plane, fitting straight lines, performing region division, and reconstructing a 3D model based on vector room plan data, using techniques like SFM and multi-view stereo.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual three-dimensional modeling software is used to establish a three-dimensional model, then the model can be accurately constructed, but the process is very time-consuming and requires high professional skills
Solution Approach 1:
The patent uses two-dimensional video images as copies of the three-dimensional indoor scene. By extracting feature points from these 2D video frames and using structure-from-motion (SFM) algorithms, the system reconstructs the 3D model without requiring manual modeling, thus reducing time consumption while maintaining accuracy
Solution Approach 2:
The patent replaces the manual mechanical modeling process with automated computer vision algorithms. Instead of operators manually creating 3D models using software like 3dsMax, the system automatically processes video data through feature extraction, matching, and 3D reconstruction algorithms
2Measurement precision
If 3D scanning equipment is used to acquire three-dimensional data, then the data acquisition is direct and accurate, but the equipment cost is too high and the process is cumbersome
Solution Approach 1:
The patent replaces expensive, specialized 3D scanning equipment with ordinary video recording devices that are widely available. The system uses standard 2D video cameras to capture sufficient data for 3D reconstruction, making the technology accessible to the general public without requiring specialized equipment
Solution Approach 2:
The patent makes the 3D modeling capability universal by using ordinary video cameras that everyone possesses rather than specialized scanning equipment. The same video data can be used for multiple purposes including 3D reconstruction, panoramic rendering, and spatial analysis
3Manufacturing precision
If image-based modeling method is used with parallax principle, then the three-dimensional information can be calculated, but a large number of photographs must be taken with specific requirements for clarity, coverage and overlap
Solution Approach 1:
The patent transitions from static photograph-based modeling to dynamic video-based modeling. By using continuous video footage, the system captures the indoor scene from multiple angles and positions automatically during camera movement, eliminating the need for manual positioning and multiple discrete photographs with specific overlap requirements
Solution Approach 2:
The patent uses continuous video recording to capture the indoor environment, ensuring that useful data is collected continuously as the camera moves through the space. This continuous capture method ensures adequate coverage and overlap without requiring manual intervention to take multiple discrete photographs
Data Source
AI summary
The disclosure provides a method, an apparatus and a computer device for three-dimensional reconstruction of an indoor structure based on a two-dimensional video, wherein the method comprises: generating a color point cloud of three-dimensional structure of a house by using the video data of the house; regularizing the color point cloud of the house; extracting a plan of the house based on the color point cloud of the house; and constructing a three-dimensional model of the house in real life. The disclosure realizes autonomous and rapid construction of a three-dimensional model of a house by the general public, and realizes a low-cost, efficient and convenient three-dimensional visual digital representation of the house.