Transfer Control Device for Event-Driven Vision Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

There is a lack of effective methods for using event-driven vision sensors in combination with frame-based vision sensors to achieve advantageous effects.

Innovation Solution

A transfer control device and method that identifies difference regions in images captured by synchronous scanning using event signals, enabling differential data transfer between these regions and other areas, allowing for efficient data management and image restoration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If event-driven vision sensor is used to capture images, then power consumption is reduced and operating speed is improved, but data transfer efficiency deteriorates when combined with frame-based vision sensors

Engineering Contradiction:
Improvepower consumptionVSAvoiddata transfer efficiency
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The patent segments the image data into two categories: difference regions (where light intensity changes occurred) and non-difference regions. Only the difference region data is transferred from the event-driven vision sensor to the frame-based vision sensor, while non-difference region data is discarded. This segmentation approach maintains the low power consumption advantage of event-driven sensors while improving data transfer efficiency by reducing the volume of transferred data.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If all image data is transferred from event-driven vision sensor to frame-based vision sensor, then complete image information is preserved, but data transfer amount increases

Engineering Contradiction:
Improveimage information completenessVSAvoiddata transfer amount
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential information from the event-driven vision sensor output - specifically, the difference regions where light intensity changes occurred. By extracting and transferring only this relevant data to the frame-based vision sensor, the system preserves necessary image information while minimizing the data transfer amount. The extraction process identifies and isolates change regions, discarding redundant unchanged data.

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces data transfer amounts and enhances processing efficiency by focusing on pixel regions with light intensity changes, simplifying the process and improving communication speed and memory capacity.

Implementation Method 1

an event driven vision sensor in which a pixel detects a change in intensity of light to be incident to generate a signal asynchronously in time

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11910110B2Transfer control device, image processing device, transfer control method, and program
Publication Date: 2024.02.20 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11910110B2 patent drawing
  • US11910110B2 patent drawing
  • US11910110B2 patent drawing

AI summary

A transfer control device includes a difference identifying section which identifies, for a first and second images sequentially captured by synchronous scanning, a difference region of the second image, on the basis of an event signal indicating a change in intensity of light generated in one or a plurality of pixels of each of the first and second images during a time period from capturing of the first image to capturing of the second image; and a transfer control section which executes data transfer different between the difference region and regions other than the difference region, for the second image.