Frame Data Generation for Asynchronous Event Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems face difficulties in utilizing event data from asynchronous image sensors, such as dynamic vision sensors, without modification, as this data is not synchronized with vertical synchronization signals, making it challenging to generate appropriate frame data for subsequent image processing.
Innovation Solution
A data processing device and method that generates first and second frame data based on event data indicating variations in pixel electrical signals, with a frame period setting unit configuring the accumulation times and intervals for generating frame data, allowing for the conversion of event data into frame data suitable for image processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If event data from asynchronous image sensors is used directly for image processing, then the high temporal resolution and event-based advantages are maintained, but the data cannot be processed by existing synchronous image processing systems
Solution Approach 1:
The patent introduces a frame data generation unit as an intermediary component that converts asynchronous event data into synchronous frame data format. This mediator translates between the two data formats, enabling compatibility with existing synchronous image processing systems while preserving the advantages of event-based sensing.
Solution Approach 2:
The system changes the temporal parameters of event data by accumulating events over specific time periods (frame periods) and converting them into frame-synchronized data. This parameter transformation allows asynchronous event data to be processed by synchronous systems without losing essential information.
2Reliability
If event data is accumulated over longer time periods to generate frame data, then better synchronization with vertical sync signals is achieved, but temporal resolution and responsiveness are reduced
Solution Approach 1:
The frame period setting unit dynamically adjusts the accumulation time period based on the vertical synchronization signal frequency. This dynamic adaptation allows the system to optimize between synchronization accuracy and temporal resolution depending on the specific application requirements and display refresh rates.
Solution Approach 2:
The system uses periodic vertical synchronization signals to define frame boundaries for accumulating event data. This periodic structure ensures that frame data generation is synchronized with display refresh cycles, maintaining both synchronization accuracy and temporal responsiveness.
3Speed
If event data is accumulated over shorter time periods to maintain temporal resolution, then responsiveness is improved, but synchronization with vertical sync signals becomes more difficult
Solution Approach 1:
The system uses vertical synchronization signals as feedback to adjust the frame data generation timing. By monitoring the vertical sync signal, the frame data generation unit can synchronize its output with the display refresh cycle, ensuring proper timing even with short accumulation periods.
4Reliability
If frame data is generated for every vertical sync signal, then continuous synchronization is maintained, but data processing load increases
Solution Approach 1:
The system generates frame data selectively based on whether sufficient event data has accumulated during each frame period, rather than forcing frame data generation at every vertical sync signal. This partial action approach maintains synchronization while reducing unnecessary processing when event activity is low.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the generation of appropriate frame data for image processing by setting specific accumulation times and intervals, effectively addressing the challenge of synchronizing event data from asynchronous image sensors, thereby improving the usability of event data in image processing systems.
Implementation Method 1
an electrical signal by performing photoelectric conversion
Data Source
AI summary
The present technology relates to image data processing devices, image data processing methods, and programs. A frame data generation unit generates first frame data based on event data indicating a variation in an electrical signal of a pixel generating the electrical signal by performing photoelectric conversion during a first accumulation time from a first frame generation start time to a first frame generation end time, and second frame data based on event data occurring during a second accumulation time from a second frame generation start time to a second frame generation end time. A first frame period from the first frame generation start time to the second frame generation start time is set and supplied to the frame data generation unit. The present technology can be applied to, for example, a case where a frame data is generated from an event data output from a dynamic vision sensor (DVS).