3D Reconstruction Combining Structured Light and Photometry
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing three-dimensional scanning technologies face challenges in achieving high precision for textured Lambert and non-Lambert surfaces due to surface texture and reflectivity effects, leading to errors and noise in reconstruction results.
Innovation Solution
A method combining structured light and photometry systems to acquire structured light depth and photometric information, using coded patterns and multiple light sources to correct positioning errors caused by surface texture, enabling high-precision reconstruction of complex surfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If structured light three-dimensional scanning is used, then high speed and high precision are achieved for non-textured Lambert surfaces, but reconstruction precision deteriorates for textured Lambert and non-Lambert surfaces due to surface texture and reflectivity effects
Solution Approach 1:
The patent combines structured light three-dimensional scanning with photometry to create a hybrid system. The structured light component provides depth information through triangulation, while the photometry component captures surface reflectivity and texture characteristics. By merging these two systems, the patent eliminates the harmful effects of surface texture and reflectivity on reconstruction precision, as the photometry data is used to correct errors in the structured light measurements.
Solution Approach 2:
The patent introduces photometry as an intermediary system that mediates between the structured light system and the final reconstruction. The photometry component acts as a mediator by capturing surface properties and using this information to correct positioning errors in the structured light data, thereby improving overall reconstruction accuracy for surfaces with complex optical properties.
2Measurement precision
If laser three-dimensional scanning is used, then depth information is obtained through triangulation, but scanning speed deteriorates due to point-by-point and line-by-line scanning mode
Solution Approach 1:
The patent merges laser three-dimensional scanning with structured light projection to create a hybrid system that achieves both high precision and high speed. The structured light component projects coded patterns that illuminate the entire surface at once, enabling parallel measurement of multiple points simultaneously, thereby dramatically increasing scanning speed while maintaining the depth information accuracy provided by triangulation.
Solution Approach 2:
The patent uses periodic projection of coded patterns in structured light to enable rapid capture of surface information. By projecting sequences of coded patterns and capturing images at different time points, the system achieves high-speed scanning through time-multiplexed measurement, replacing the slow sequential point-by-point scanning of traditional laser methods.
3Productivity
If structured light coding technology is used, then one-time measurement of the whole surface is achieved, but positioning errors occur due to surface texture effects on stripe positioning
Solution Approach 1:
The patent introduces photometry as an intermediary system that captures surface reflectivity and texture information. This photometry data serves as a mediator to identify and correct positioning errors in the structured light stripe patterns caused by surface texture effects, thereby maintaining both high measurement speed and improved positioning accuracy.
Solution Approach 2:
The patent implements a feedback mechanism where photometry measurements of surface properties are used to correct errors in structured light stripe positioning. The system continuously monitors surface characteristics and uses this information to adjust and correct positioning deviations, ensuring accurate reconstruction even for surfaces with complex optical properties.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The combined approach improves the accuracy of three-dimensional reconstruction by correcting structured light positioning errors, ensuring precise reconstruction of objects with diverse surface characteristics.
Implementation Method 1
a laser three-dimensional scanning system utilizes a projection laser line or a dot matrix to capture the characteristics of the projected laser and recovers the three-dimensional depth information of an object through triangulation
Implementation Method 2
a photometry system projects P light sources to the three-dimensional object from P different directions respectively, to acquire photometric information
Data Source
AI summary
The present application is applicable to the technical field of computer vision, and provides a method for reconstructing a three-dimensional object combining structured light and photometry and a terminal device, wherein the method comprises: acquiring N first images, wherein each first image is obtained by shooting after a coded pattern having a coding stripe sequence is projected to a three-dimensional object, and N is a positive integer; determining structured light depth information of the three-dimensional object based on the N first images; acquiring M second images, wherein the M second images are obtained by shooting after P light sources are respectively projected to the three-dimensional object from different directions, and M and P are positive integers; determining photometric information of the three-dimensional object based on the M second images; and reconstructing the three-dimensional object based on the structured light depth information and the photometric information. Therefore, the structured light system and the photometric system are combined to reconstruct the three-dimensional object, and the precision of a three-dimensional reconstruction result of the three-dimensional object with complex surfaces is improved.