Event-Driven Flicker Detection for Fast Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image sensors struggle to accurately and efficiently detect the flicker characteristics of objects like traffic lights and vehicle lights due to their synchronous operation, which limits the speed and accuracy of object detection in autonomous driving systems.

Innovation Solution

An object detection device employing a dynamic vision sensor (DVS) with an asynchronous event-driven system, where each pixel detects light intensity exceeding a threshold, generating flicker information to enable high-speed and accurate object detection by specifying flicker detection areas based on event occurrence counts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a general image sensor operating at a predetermined frame rate is used, then the device complexity is low and ease of operation is maintained, but the measurement precision of flicker characteristics is insufficient and detection speed is limited

Engineering Contradiction:
Improveflicker characteristic detection accuracyVSAvoiddetection speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent transitions from a static synchronous readout system to a dynamic asynchronous event-driven system. Each pixel independently detects light intensity changes and generates events asynchronously when thresholds are exceeded, enabling the system to dynamically respond to flicker frequencies without being constrained by a fixed frame rate, thereby simultaneously improving measurement precision and detection speed

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the fundamental operating parameter from synchronous frame-based capture to asynchronous event-based capture. By detecting events based on light intensity threshold exceedances rather than fixed time intervals, the system can accurately capture flicker characteristics across a wide range of frequencies while maintaining high detection speed

Inventive Principle:
Principle #35Parameter changes

2Reliability

If a general image sensor with synchronous readout is used, then the device complexity is low, but the reliability of object detection is insufficient due to inability to capture flicker characteristics

Engineering Contradiction:
Improveobject detection reliabilityVSAvoidsensor system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the image sensor into independently operating pixels, each capable of autonomous event detection. This segmentation allows each pixel to function as an independent flicker detector, significantly improving object detection reliability by capturing flicker characteristics that synchronous sensors miss, while the modular architecture keeps device complexity manageable

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism where each pixel's light-receiving element directly triggers event generation upon threshold exceedance, without requiring synchronous readout coordination. This intermediary event-driven approach reliably captures flicker characteristics while simplifying the overall system architecture compared to complex synchronous coordination mechanisms

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If asynchronous event-driven detection is implemented, then detection speed and measurement precision are improved, but the device complexity increases due to per-pixel event processing

Engineering Contradiction:
Improvedetection speedVSAvoidpixel circuit complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent extracts only the essential function of light intensity threshold detection from each pixel, generating events only when necessary. This extraction approach enables high-speed asynchronous detection by eliminating unnecessary synchronous readout operations, while keeping per-pixel circuit complexity low by implementing only the minimal required event detection logic

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Each pixel in the patent performs self-service by autonomously detecting light intensity changes and generating events when thresholds are exceeded, without requiring external control signals. This self-service capability enables high-speed parallel processing across all pixels, improving detection speed while minimizing the need for complex external control circuitry

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for precise detection of objects with flicker characteristics, enhancing the speed and accuracy of object detection in autonomous driving systems, reducing erroneous detections and improving overall system performance.

Implementation Method 1

a solid-state imaging device provided with a plurality of pixels arranged in a matrix, the solid-state imaging device that detects, according to a light amount incident on each of the pixels, occurrence of an event in the pixel

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS11823466B2Object detection device, object detection system, and object detection method
Publication Date: 2023.11.21 SONY GROUP CORP
  • US11823466B2 patent drawing
  • US11823466B2 patent drawing
  • US11823466B2 patent drawing

AI summary

A characteristic of a flicker component is detected to perform object detection at a higher speed and with higher accuracy. An object detection device according to an embodiment is provided with a solid-state imaging device (200) provided with a plurality of pixels arranged in a matrix, the solid-state imaging device that detects, according to a light amount incident on each of the pixels, occurrence of an event in the pixel, a flicker detection unit (12) that generates flicker information on the basis of the occurrence of the event detected by the solid-state imaging device, and an object detection unit (15) that detects an object on the basis of the flicker information detected by the solid-state imaging device.