Dynamic Vision Sensor Color Camera Using Temporal Multiplexing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional cameras generate substantial redundant data and are inefficient in energy, bandwidth, and memory usage due to all pixels registering light intensity simultaneously, whereas Dynamic Vision System (DVS) cameras are sensitive to light intensity changes but lack color sensitivity.

Innovation Solution

A dynamic vision sensor (DVS) color camera (DVS-CCam) that includes a DVS photosensor, an illuminator transmitting a light pattern with temporal changes in intensity and color, an optical system to focus light on the DVS pixels, and a processor to process DVS signals and generate color images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional cameras control all pixels to register light intensity simultaneously, then color images can be captured, but substantial redundant data is generated and energy efficiency deteriorates

Engineering Contradiction:
Improveredundant dataVSAvoidenergy efficiency
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The camera divides pixels into multiple groups (first group for first color, second group for second color, third group for third color) that operate independently at different times. Each group captures data for its specific color channel during its active period, segmenting the overall imaging task into color-specific subtasks that reduce redundant data collection while maintaining energy efficiency.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If DVS cameras operate each pixel independently to detect light intensity changes, then sensitivity to changes is enhanced and redundant data is eliminated, but color sensitivity is lost

Engineering Contradiction:
Improvesensitivity to changesVSAvoidcolor information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The camera employs periodic illumination with different colors (first color, second color, third color) at different time intervals. During each illumination period, the corresponding pixel group is activated to capture intensity changes for that specific color. This periodic action allows the DVS camera to maintain its change-detection sensitivity while recovering color information through temporal multiplexing of color-specific measurements.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The DVS-CCam achieves enhanced sensitivity to changes in a scene, reduces redundant data, and improves resource efficiency while providing color images by processing temporal changes in light intensity and color.

Implementation Method 1

each pixel in the DVS photosensor independently of the other pixels. Each pixel in the DVS generates and transmits an image data signal

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 2

an optical system configured to collect and focus on the pixels of the DVS photosensor light reflected by features in the scene

Methodology Applied
Scientific EffectOptical focusing: Focusing

Data Source

PatentUS20250126371A1Dynamic vision sensor color camera
Publication Date: 2025.04.17 RAMOT AT TEL AVIV UNIVERSITY LTD
  • US20250126371A1 patent drawing
  • US20250126371A1 patent drawing
  • US20250126371A1 patent drawing

AI summary

A dynamic vision sensor (DVS) color camera (DVS-CCam) operable to acquire a color image of a scene, the DVS-CCam including a DVS photosensor comprising DVS pixels, an illuminator operable to transmit a light pattern characterized by temporal changes in intensity and color to illuminate a scene, an optical system configured to collect and focus on the pixels of the DVS photosensor light reflected by features in the scene from the light pattern transmitted by the illuminator, and a processor configured to process DVS signals generated by the DVS pixels responsive to temporal changes in the reflected light to provide a color image of the scene.