Spatially Reconfigurable Pattern Generator for 3D Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging systems struggle to efficiently reconstruct three-dimensional data from dynamic scenes with low power consumption and small form factor, especially in battery-operated mobile devices, due to limitations in dynamically changing light patterns and high energy consumption of prior art projection technologies.
Innovation Solution
A compact, low power consumption pattern projection system that uses a spatially reconfigurable pattern generator to project multiple patterns sequentially, optimizing pattern generation and projection based on the scene, employing a source of collimated light and diffractive optical elements with electronically controllable spacing or a liquid crystal spatial light modulator to dynamically change patterns without moving parts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional projection technologies are used to dynamically change light patterns, then pattern versatility is improved, but power consumption increases and form factor enlarges
Solution Approach 1:
The patent replaces traditional mechanical projection systems with a spatial light modulator (SLM) that uses electronic control to dynamically generate different light patterns. The SLM modulates light from a single source based on electronic signals, eliminating the need for mechanical moving parts while achieving versatile pattern generation with lower power consumption and compact form factor
Solution Approach 2:
The patent changes the state of the spatial light modulator between transmissive and reflective modes to achieve different projection patterns. By electronically controlling the SLM's operational state and adjusting light source parameters, the system generates diverse patterns without mechanical movement, reducing power consumption while maintaining pattern versatility
2Adaptability or versatility
If traditional projection technologies are used to dynamically change light patterns, then pattern versatility is improved, but device size increases
Solution Approach 1:
The patent replaces bulky mechanical projection systems with a compact spatial light modulator controlled by electronic signals. This substitution eliminates mechanical components and reduces the overall device volume while maintaining the ability to generate multiple projection patterns dynamically
Solution Approach 2:
The patent uses a single light source combined with a spatial light modulator to perform multiple projection functions. The SLM can generate various patterns (grids, lines, dots, random patterns) from one light source, eliminating the need for multiple separate projection systems and reducing device form factor
3Measurement precision
If stereo matching algorithms are used to reconstruct three-dimensional data from dynamic scenes, then depth reconstruction capability is improved, but processing speed decreases
Solution Approach 1:
The patent projects structured light patterns (grids, lines, dots) onto the scene before capturing images. These pre-projected patterns provide known reference features that simplify the correspondence matching process, allowing faster computation of depth information while maintaining accuracy in dynamic scenes
Solution Approach 2:
The patent uses different colored light patterns (red, green, blue channels) projected onto the scene to create distinct visual references. The color information helps in rapidly identifying corresponding points between stereo images, accelerating the stereo matching process while preserving depth reconstruction accuracy
4Measurement precision
If multiple light patterns are projected sequentially to improve signal quality, then signal-to-noise ratio is improved, but frame rate decreases
Solution Approach 1:
The patent employs periodic projection of different light patterns (grids, lines, dots) in a sequential manner, with each pattern type providing complementary information. The periodic switching between patterns is synchronized with the camera frame rate, allowing the system to maintain high frame rates while collecting sufficient data from multiple patterns for improved signal-to-noise ratio
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables rapid and accurate three-dimensional image reconstruction with improved signal/noise characteristics, facilitating the detection of disparity and recognition of gestures even in dynamic scenes with texturally unremarkable or distant objects, while maintaining low power consumption and a small form factor.
Implementation Method 1
The first DOE received optical energy from the light source... The projectable patterns appear within the optical far-field of the second DOE
Implementation Method 2
employing a source of collimated light and diffractive optical elements with electronically controllable spacing or a liquid crystal spatial light modulator to dynamically change patterns without moving parts
Data Source
AI summary
Dynamic projection of at least first and second patterns contributes detectable disparity onto a scene that includes a target object. The scene is imaged with two-dimensional cameras whose acquired imagery includes disparity contributions whose presence enable a three-dimensional reconstruction depth map to be rapidly and accurately generated. In one embodiment coherent light is input to a first DOE within whose near range output is disposed a second DOE, whose far range output projects an image. Electronically varying effective optical distance between the two DOEs varies the pattern projected from the second DOE. A processor system and algorithms enable dynamic intelligent selection of projected patterns to more readily discern target object characteristics: shape, size, velocity. Patterns can implement spatio-temporal depth reconstruction, spatio-temporal depth reconstruction, and even single-camera spatio-temporal light coding reconstruction. Target objects may be scanned or may make gestures that are rapidly detected and recognized by the system and method.