3D Reconstruction with Multi-View Structured Light for Shiny Surfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional stereo vision systems face challenges in creating accurate three-dimensional reconstructions of objects with low surface roughness and high specular reflection, leading to oversaturation in captured images, which results in missing information and inaccurate 3D reconstruction data.
Innovation Solution
The system employs multiple image sensors and projectors that illuminate the object from different perspectives, capturing images with optical patterns to reduce distortion by identifying and modifying oversaturation issues using images from various viewpoints, and combining data from multiple projections to generate consistent and dense 3D point data without requiring synchronization of projectors and cameras.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional stereo vision systems use standard illumination and capture methods, then the system structure is simple, but images of objects with high specular reflection become oversaturated leading to inaccurate 3D reconstruction
Solution Approach 1:
The system dynamically adjusts illumination parameters by using multiple projectors with different optical patterns (structured light sequences) rather than static illumination. This dynamic approach allows the system to capture multiple images with varying illumination conditions, preventing oversaturation by distributing the illumination intensity across multiple captures and angles.
Solution Approach 2:
The patent introduces temporal dimension by capturing multiple images over time with different optical patterns projected sequentially. Instead of relying on a single static illumination angle, the system uses time-varying structured light patterns to illuminate the object from multiple effective perspectives, adding temporal variation to resolve the oversaturation problem.
2Measurement precision
If multiple projectors illuminate the object from different perspectives, then distortion is reduced and 3D reconstruction accuracy improves, but device complexity increases
Solution Approach 1:
The patent merges multiple imaging systems (multiple cameras and multiple projectors) into a coordinated array that functions as a unified measurement system. By combining these components and processing their data together through structured light pattern correlation, the system achieves improved accuracy while managing complexity through integrated control and processing.
Solution Approach 2:
The system uses multiple projectors to create multiple copies of structured light patterns projected at different angles and positions. These pattern copies illuminate different aspects of the object simultaneously, allowing the imaging system to capture comprehensive surface information without requiring a single complex illumination source.
3Stability of the object's composition
If synchronized capture is used with multiple image sensors, then temporal consistency is improved, but system complexity and synchronization requirements increase
Solution Approach 1:
The system employs periodic projection of structured light patterns in a predetermined sequence across multiple projectors. This periodic action creates a temporal structure in the illumination that allows the imaging system to capture data in a coordinated manner, achieving temporal consistency through the regular, repeating pattern projection rather than complex real-time synchronization.
Solution Approach 2:
The system pre-coordinates the projection sequences and timing of multiple projectors before capture begins. The structured light patterns are projected in a predetermined temporal sequence that has been planned in advance, allowing the image sensors to capture data in synchronization with the known projection schedule, thereby reducing real-time synchronization complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables the generation of accurate three-dimensional reconstructions with reduced distortion, providing reliable and robust 3D data for objects with shiny surfaces or complex reflections, improving reconstruction accuracy and completeness.
Implementation Method 1
Each projector may illuminate the object from a different perspective... receiving, from each of the at least two image sensors, for each projector of the at least two projectors, images of the object illuminated with the associated optical pattern
Data Source
AI summary
Methods, systems, and computer readable media for generating a three-dimensional reconstruction of an object with reduced distortion are described. In some aspects, a system includes at least two image sensors, at least two projectors, and a processor. Each image sensor is configured to capture one or more images of an object. Each projector is configured to illuminate the object with an associated optical pattern and from a different perspective. The processor is configured to perform the acts of receiving, from each image sensor, for each projector, images of the object illuminated with the associated optical pattern and generating, from the received images, a three-dimensional reconstruction of the object. The three-dimensional reconstruction has reduced distortion due to the received images of the object being generated when each projector illuminates the object with an associated optical pattern from the different perspective.