Structured Light Depth Imaging Resolution Enhancement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional depth camera devices using structured light result in low-resolution depth images due to their reliance on line structured light, which limits their precision and resolution.
Innovation Solution
The method involves projecting multi-stripe structured light and dot structured light onto an object, capturing images with an image sensor, and calculating depth values at both light stripes and spots to generate a depth image, thereby increasing the resolution by incorporating more information points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If line structured light is used to obtain depth image for real time performance, then real-time requirement is satisfied, but resolution of the obtained depth image is low
Solution Approach 1:
The patent combines line structured light and dot structured light into a single composite structured light pattern. The light projector projects both line structures and dot structures simultaneously onto the object, allowing the depth camera to capture both types of features in one image. This merging approach increases the number of measurable points (both along lines and at discrete dots) without requiring multiple separate projections, thus improving depth image resolution while maintaining real-time performance
Solution Approach 2:
The patent segments the structured light into two distinct components: line structured light for capturing continuous depth information along stripes, and dot structured light for capturing discrete depth information at specific points. By segmenting the light pattern into these two functional elements, the system can process different types of depth data from the same projection, increasing overall measurement precision without sacrificing processing speed
2Productivity
If multiple light stripes are presented on the object to be captured, then real-time depth image is obtained, but the precision is low resulting in low resolution
Solution Approach 1:
The patent merges line structured light and dot structured light into a single composite pattern projected onto the object. This combination allows the system to capture both continuous line features and discrete dot features in one imaging operation, effectively increasing the density of measurable points and improving depth image resolution without requiring multiple separate projections that would reduce productivity
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances the resolution of the depth image by utilizing both light stripe and spot depth values, improving the accuracy and detail of the generated depth map compared to conventional methods.
Implementation Method 1
controlling a light projector to project multi-stripe structured light and dot structured light onto a surface of an object to be captured
Implementation Method 2
acquiring, by the image sensor, a target image of the object to be captured having the light stripes and the light spots on the surface
Implementation Method 3
calculating a first parallax of the target light stripe with respect to the reference light stripe for each of the stripe match pairs based on feature information of the target light stripe and the reference light stripe in the stripe match pair
Data Source
AI summary
Image processing method and device are provided. The method includes: controlling a projector to project multi-stripe structured light and dot structured light onto an object, to form multiple light stripes and light spots between the light stripes on the surface of the object; acquiring a target image of the object having the light stripes and the light spots on the surface; obtaining a reference image including the light stripes and the light spots; calculating a first depth value at each light stripe in the target image based on feature information of the light stripes in the reference image and target image; calculating a second depth value at each light spot in the target image based on feature information of the light spots in the reference image and target image; and generating a depth image of the target image based on the first depth value and the second depth value.