Dynamic Vision Sensor Intensity Image Acquisition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Dynamic vision sensors (DVS) primarily output event-based data representing changes in light intensity, lacking direct internal pixel state output, making it challenging to acquire intensity images effectively.

Innovation Solution

A system and method that includes a dynamic vision sensor with a photodiode circuit, current-to-voltage converter, reset, and integration circuits to form pixel intensity data by integrating events, providing intensity image outputs, and separating events for event-based outputs, allowing for the acquisition of intensity images through resetting pixel states and integrating event signals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If event-based cameras output only asynchronous event data representing temporal changes, then dynamic response and temporal resolution are improved, but the ability to acquire intensity images directly is lost

Engineering Contradiction:
Improvedynamic responseVSAvoidinternal pixel state information
Core Design Contradiction:
SpeedVSLoss of information

Solution Approach 1:

The system performs preliminary resetting of pixel states at specific time points before integrating events, establishing a known reference state that enables subsequent intensity calculation from event streams without adding hardware components

Inventive Principle:
Principle #10Preliminary action

2Duration of action of moving object

If DVS pixels integrate light internally without outputting the state, then pixel-level light integration is achieved, but external access to intensity information is prevented

Engineering Contradiction:
Improveintegration timeVSAvoidaccess to pixel state
Core Design Contradiction:
Duration of action of moving objectVSEase of operation

Solution Approach 1:

The system uses feedback by resetting pixel states to predetermined values at controlled intervals, creating a reference that enables calculation of integrated light intensity from the accumulated events, thus providing indirect access to the internal integration state

Inventive Principle:
Principle #23Feedback

3Loss of time

If the sensor provides only event-based output, then temporal precision is improved, but image intensity acquisition becomes challenging

Engineering Contradiction:
Improvetemporal precisionVSAvoidintensity measurement
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The system applies periodic resetting of pixel states at defined time intervals, creating a structured temporal pattern that transforms the continuous event stream into measurable intensity data while preserving the high temporal precision of event-based detection

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the acquisition of intensity images from DVS without additional circuits, achieving lower latency and providing both event-based and integrated image intensity data, leveraging the dynamic range of DVS sensors with minimal adjustments to the sensor.

Implementation Method 1

each pixel having a photodiode circuit

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS10348994B2Intensity image acquisition from dynamic vision sensors
Publication Date: 2019.07.09 SAMSUNG ELECTRONICS CO LTD
  • US10348994B2 patent drawing
  • US10348994B2 patent drawing
  • US10348994B2 patent drawing

AI summary

A method for acquiring intensity images through a dynamic vision sensor is provided, the method including resetting an inner state of each of a plurality of pixels in the dynamic vision sensor to a predetermined value; receiving from at least one of the plurality of pixels an event signal based on a change in its inner state indicative of a difference in amount of light incident upon the at least one of the plurality of pixels versus that corresponding to the predetermined value; and integrating over a time period the received event signal for the at least one of the plurality of pixels to determine the intensity of light incident upon the at least one of the plurality of pixels.