Event-Driven Vision Sensor With Wavelength-Specific Event Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing event-driven vision sensors lack the capability to execute different processes based on the wavelength band of light in which an intensity change occurs.

Innovation Solution

A system and information processing device that utilizes a filter with alternating first and second filters passing different wavelength bands, generating distinguishable event signals for separate processing based on these bands, allowing distinct processes to be executed by different processing sections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If event-driven vision sensors are used to detect light intensity changes, then high speed operation and low power consumption are achieved, but the capability to execute different processes based on wavelength band is lost

Engineering Contradiction:
Improveoperation speedVSAvoidwavelength band discrimination capability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The sensor array is divided into multiple sensor groups, where each group is associated with a specific wavelength band. Each sensor group independently detects light intensity changes within its assigned wavelength band, enabling wavelength-specific event detection while maintaining the high-speed, low-power advantages of event-driven sensing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the sensor array are assigned different functional characteristics corresponding to different wavelength bands. This allows each local region to specialize in detecting specific wavelength ranges, providing wavelength band discrimination capability without requiring the entire sensor array to process all wavelengths uniformly.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If conventional frame-based vision sensors are used, then wavelength band processing capability is available, but high power consumption and reduced speed are incurred

Engineering Contradiction:
Improvewavelength band processing capabilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

Instead of continuously scanning all pixels at fixed intervals like frame-based sensors, the event-driven sensor only activates specific sensor groups when light intensity changes occur within their assigned wavelength bands. This event-triggered periodic activation dramatically reduces power consumption while maintaining wavelength band processing capability.

Inventive Principle:
Principle #19Periodic action

3Area of stationary object

If all pixels scan at each predetermined cycle, then complete image coverage is achieved, but high power consumption and reduced operational speed result

Engineering Contradiction:
Improveimage coverageVSAvoidoperational speed
Core Design Contradiction:
Area of stationary objectVSProductivity

Solution Approach 1:

The sensor array transitions from a static, uniform scanning approach to a dynamic, adaptive activation model. Individual sensor groups are dynamically activated based on event detection needs, allowing the system to cover the entire sensor array area while only actively processing regions where wavelength-specific intensity changes occur, thereby improving operational speed.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables processing based on specific wavelength bands, enhancing accuracy and reducing latency in applications like marker tracking and position estimation by correcting drift errors and increasing resolution.

Implementation Method 1

a filter including first filters and second filters, each having a different transmission characteristic, are alternately arranged in two directions on a plane

Methodology Applied
Scientific EffectOptical filtering: Filter (optical)

Data Source

PatentEP3993398B1System, information processing device, information processing method, and program
Publication Date: 2025.11.12 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP3993398B1 patent drawingFigure 1
  • EP3993398B1 patent drawingFigure 2
  • EP3993398B1 patent drawingFigure 3

AI summary

Provided is a system that includes an event-driven vision sensor and an information processing device. The event-driven vision sensor includes a sensor array where a first sensor and a second sensor are arranged in a predetermined pattern. The first sensor generates a first event signal when detecting a change in an intensity of light incident through a first filter. The first filter selectively passes light in a first wavelength band. The second sensor generates a second event signal when detecting a change in an intensity of light incident through a second filter. The second filter selectively passes light in a second wavelength band that is different from the first wavelength band. The information processing device includes a first processing section and a second processing section. The first processing section executes a first process on the basis of the first event signal. The second processing section executes a second process different from the first process on the basis of the second event signal.