Dynamic Vision Sensor Depth Imaging via Swiped Light Patterns
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D depth cameras require substantial energy consumption and multiple image captures to produce a single depth image with desired precision, leading to inefficiencies in energy usage and motion sensitivity.
Innovation Solution
An apparatus comprising a projector and a camera with a dynamic vision sensor (DVS) that projects a light pattern and moves it over an object, capturing changes in image elements to generate a depth image in a single swipe, using a processor to calculate depth based on the changes and baseline distance between the projector and camera.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If current 3D depth cameras repeatedly capture numerous images to produce a single depth image, then measurement precision is improved, but use of energy increases and loss of time increases
Solution Approach 1:
The patent applies periodic action by using a structured light pattern that is projected in a systematic sequence across the scene. The light pattern is divided into multiple stripes that are projected in successive time slots, creating a periodic illumination scheme that enables depth measurement through temporal modulation rather than repeated static captures.
Solution Approach 2:
The patent implements continuity of useful action by maintaining the projected light pattern throughout the capture process. Instead of taking discrete separate images, the system continuously projects the light pattern while the camera captures images, allowing depth information to be extracted from the continuous interaction between the light pattern and the scene.
2Measurement precision
If current 3D depth cameras repeatedly capture numerous images to produce a single depth image, then measurement precision is improved, but loss of time increases
Solution Approach 1:
The patent uses periodic action by projecting light patterns in a systematic temporal sequence. The light pattern is divided into multiple stripes that are projected in successive time slots, enabling depth measurement through temporal modulation rather than repeated static captures, thus reducing total time while maintaining precision.
Solution Approach 2:
The patent implements continuity of useful action by maintaining the projected light pattern throughout the capture process. Instead of taking discrete separate images, the system continuously projects the light pattern while the camera captures images, allowing depth information to be extracted from the continuous interaction, thereby eliminating time loss associated with multiple sequential captures.
3Device complexity
If conventional camera and projector systems are used, then device complexity is reduced, but measurement precision deteriorates due to motion sensitivity
Solution Approach 1:
The patent applies feedback by using the captured images to compute depth information, which then informs the projection of subsequent light patterns. The system continuously adjusts the projection based on the captured scene information, creating a feedback loop that compensates for motion and maintains measurement precision without requiring complex hardware.
Solution Approach 2:
The patent implements parameter changes by dynamically adjusting the projection parameters based on captured image data. The system changes the light pattern parameters (position, orientation, timing) based on the measured depth information and motion detection, allowing the system to adapt to motion conditions and maintain precision while using relatively simple hardware.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces energy consumption, enhances motion resistance, and simplifies processing with low latency, enabling high dynamic range depth imaging with a single swipe instead of multiple captures.
Implementation Method 1
the camera may include a dynamic vision sensor (DVS) device, to capture changes in at least some image elements that correspond to an image of the object, during the swipe of the object with the light pattern
Data Source
AI summary
Apparatuses, methods and storage media for providing a depth image of an object are described. In some embodiments, the apparatus may include a projector to project a light pattern on an object, and to move the projected light pattern over the object, to swipe the object with the light pattern, and a camera coupled with the projector. The camera may include a dynamic vision sensor (DVS) device, to capture changes in at least some image elements that correspond to an image of the object, during the swipe of the object with the light pattern. The apparatus may further include a processor coupled with the projector and the camera, to generate a depth image of the object, based at least in part on the changes in the at least some image elements. Other embodiments may be described and claimed.