Event Camera Frame Rate Control for Lower Vehicle Power Use

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High power consumption is a challenge when generating frame data at high frame rates for event-based visual sensors like DVS, particularly in vehicle-mounted applications where continuous high frame rate generation increases power usage.

Innovation Solution

A data processing device and method that control the frame rate of frame data generation based on vehicle information, such as speed and event occurrence, allowing for dynamic adjustment of frame intervals and widths to optimize power usage while maintaining necessary image processing capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If frame data is generated at high frame rate continuously, then image processing quality is improved, but power consumption increases

Engineering Contradiction:
Improveimage processing qualityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The frame rate is made dynamic rather than fixed. The control unit adjusts the frame rate based on vehicle speed and event occurrence frequency. When the vehicle is stationary or moving slowly with few events, the frame rate is reduced to save power. When the vehicle is moving quickly or many events occur, the frame rate increases to maintain image processing quality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the frame rate parameter based on operating conditions. By monitoring vehicle speed and event frequency, the system adjusts the frame rate parameter dynamically, transitioning between different frame rate levels to optimize the balance between image processing quality and power consumption.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If frame rate is always maintained at high level, then image processing capability is improved, but power consumption increases

Engineering Contradiction:
Improveimage processing capabilityVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

Instead of maintaining full frame rate continuously, the system applies partial action by reducing the frame rate when full capability is not needed. The control unit determines when to use high frame rate based on actual requirements (vehicle speed and event frequency), applying full processing capability only when necessary.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The frame rate is adjusted periodically based on changing vehicle conditions. The control unit continuously monitors vehicle speed and event occurrence, and periodically adjusts the frame rate accordingly, transitioning between high and low frame rate modes as conditions change.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively reduces power consumption by adjusting frame rates according to vehicle conditions and event frequencies, ensuring efficient operation without compromising image processing quality.

Implementation Method 1

an electrical signal of a pixel that generates the electrical signal by performing photoelectric conversion

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS11770625B2Data processing device and data processing method
Publication Date: 2023.09.26 SONY GROUP CORP
  • US11770625B2 patent drawing
  • US11770625B2 patent drawing
  • US11770625B2 patent drawing

AI summary

The present technology relates to a data processing device and a data processing method capable of suppressing power consumption. A vehicle information acquisition unit acquires vehicle information that can be acquired by a vehicle, and a control unit controls, according to the vehicle information, a frame rate of frame data generated on the basis of event data representing the occurrence of an event that occurs in an accumulation time from a start of frame generation to an end of frame generation and is a change in an electrical signal of a pixel that generates the electrical signal by performing photoelectric conversion. A data processing unit generates the frame data of the frame rate controlled by the control unit. In the present technology, the present technology can be applied to, for example, a case where frame data is generated from event data output by a dynamic vision sensor (DVS).