DVS Frame Generation with Speed-Adaptive Pixel Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Dynamic Vision Sensors (DVS) struggle to capture sufficient pixels for stationary or slowly moving objects and excessive redundant pixels for fast-moving objects, leading to unsatisfactory image quality due to motion blur or insufficient detail.
Innovation Solution
A method and system that adjusts the timespan for integrating DVS pixels based on object movement speed, combining consecutive frames when the speed is below a threshold to generate a combined frame with sufficient detail.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the DVS integrates pixels within a fixed timespan to generate frames, then the image generation process is simple and fast, but the image quality is unsatisfactory for objects with different moving speeds (either insufficient detail for slow objects or excessive motion blur for fast objects)
Solution Approach 1:
The patent applies dynamics by making the timespan parameter adjustable rather than fixed. The system dynamically adapts the integration timespan based on the detected moving speed of objects in the scene. When objects move slowly, a longer timespan is used to capture sufficient pixel details; when objects move fast, a shorter timespan is used to reduce motion blur. This dynamic parameter adjustment resolves the contradiction between maintaining simple fixed-timespan processing and achieving high image quality across varying object speeds.
Solution Approach 2:
The patent implements parameter changes by modifying the integration timespan based on object movement characteristics. The system evaluates the moving speed of objects and accordingly changes the timespan parameter for pixel integration. This parameter adaptation allows the system to optimize image quality for different scenarios without requiring completely different processing pipelines, thus balancing image quality improvement with processing complexity management.
2Quantity of substance
If the DVS uses a longer timespan to capture more pixels, then sufficient detail is obtained for slow-moving objects, but excessive redundant pixels are captured for fast-moving objects causing motion blur
Solution Approach 1:
The system dynamically adjusts the integration timespan based on real-time detection of object movement speed. For slow-moving objects, the system extends the timespan to accumulate sufficient pixel data for detailed imaging. For fast-moving objects, the system shortens the timespan to capture fewer pixels, thereby reducing motion blur. This dynamic adaptation directly addresses the contradiction between capturing enough pixels and maintaining image clarity under different motion conditions.
Solution Approach 2:
The patent changes the integration timespan parameter according to the detected speed characteristics of objects in the scene. By evaluating object movement and adjusting the timespan parameter accordingly, the system optimizes the balance between the quantity of captured pixels and the resulting image clarity, resolving the contradiction between these two opposing requirements.
3Speed
If the DVS captures pixels asynchronously to achieve low latency and high dynamic range, then real-time performance is improved, but the system cannot capture sufficient pixels for stationary objects within a reasonable timespan
Solution Approach 1:
The patent applies dynamics by making the integration timespan adaptive rather than fixed. For stationary or slow-moving objects, the system automatically extends the integration timespan, allowing asynchronous pixel capture to continue accumulating sufficient pixel data without compromising real-time performance for moving objects. This dynamic adjustment resolves the contradiction between maintaining fast response and capturing enough pixels for stationary targets.
Solution Approach 2:
The system changes the integration timespan parameter based on object movement status. When objects are detected as stationary or moving slowly, the timespan is extended to accumulate sufficient pixel captures. This parameter adaptation allows the asynchronous capture mechanism to maintain both real-time performance and sufficient pixel quantity for different object types.
4Area of stationary object
If the DVS integrates pixels from all directions to create complete frames, then comprehensive scene coverage is achieved, but redundant information from fast-moving objects increases processing load and reduces image quality
Solution Approach 1:
The patent applies dynamics by adjusting the integration timespan based on object movement speed. For fast-moving objects, the shorter timespan naturally limits the spatial area covered by integrated pixels, reducing redundant information from directions where the object has moved significantly. For stationary objects, the full scene coverage is maintained. This dynamic adjustment optimizes the balance between comprehensive coverage and processing efficiency.
Solution Approach 2:
The system changes the integration timespan parameter to control the extent of pixel integration from different directions. By adapting this parameter to object movement characteristics, the system reduces redundant pixel integration for fast-moving objects while maintaining comprehensive coverage for stationary objects, thus improving frame generation efficiency without sacrificing necessary scene coverage.
Data Source
AI summary
A method and system for generating frames for a DVS is disclosed. The method comprises: receiving DVS pixels of an object from a DVS; initializing a timespan to a timespan value; generating a frame by integrating DVS pixels captured within a timespan; evaluating a moving speed of the object; combining a plurality of consecutive frames into one combined frame when the evaluated moving speed is lower than a first threshold value. The system comprises a DVS configured to capture DVS pixels of an object; and a processor configured to receive the DVS pixels from the DVS and performed the method.