Event-Driven Vision Sensor Calibration via Dynamic Luminance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies lack efficient methods for calibrating event-driven vision sensors, which operate differently from frame-type sensors, making it difficult to effectively calibrate these sensors, especially when the subject is stationary.

Innovation Solution

A sensor calibration system that includes an event-driven vision sensor and a display apparatus capable of changing luminance in a planar region with a predetermined spatial resolution, generating event signals upon detection of changes in incident light intensity, allowing for efficient calibration by analyzing these signals based on calibration patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If frame-type vision sensors are used, then all pixels can be scanned at predetermined intervals, but the scanning speed is limited and power consumption is high

Engineering Contradiction:
Improvescanning speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent transitions from static frame-based scanning to dynamic event-driven detection, where sensors continuously monitor and trigger only when changes occur. This dynamic approach enables high-speed response to changes while reducing power consumption by activating processing only when events are detected, rather than continuously scanning all pixels at fixed intervals.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The invention implements periodic luminance changes in the display device to systematically stimulate the event-driven sensors. By periodically varying the display content in specific patterns, the system ensures all sensor regions are activated and calibrated without requiring continuous high-speed scanning, thus achieving comprehensive coverage with reduced power consumption compared to traditional frame-based approaches.

Inventive Principle:
Principle #19Periodic action

2Productivity

If event-driven vision sensors are used, then high speed operation on low power is achieved, but calibration methods are insufficient and difficult to implement

Engineering Contradiction:
Improveoperational efficiencyVSAvoidcalibration difficulty
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent applies preliminary action by performing calibration before actual sensor deployment. The system pre-calibrates the event-driven sensors using systematically generated luminance change patterns, establishing baseline characteristics and correction factors. This preliminary calibration simplifies subsequent operation, as the sensors are already optimized and characterized before use, making the complex calibration process easier to implement overall.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The invention utilizes parameter changes by systematically varying luminance parameters in the display device during calibration. By controlling and changing luminance levels, patterns, and temporal characteristics, the system extracts sensor response characteristics across different operating conditions. This approach enables comprehensive calibration of event-driven sensors without requiring complex physical adjustments, simplifying the calibration process while maintaining high operational efficiency.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If calibration patterns are displayed to calibrate sensors, then sensor accuracy can be improved, but the system complexity increases

Engineering Contradiction:
Improvesensor calibration accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies universality by designing the display device to serve multiple functions: it acts as both the primary display for user content and the calibration stimulus generator for sensor characterization. The same display hardware is used to present both normal content and calibration patterns, eliminating the need for separate calibration equipment. This multi-functionality reduces system complexity while maintaining high calibration accuracy through systematic luminance modulation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise calibration of event-driven vision sensors by detecting and analyzing luminance changes, correcting image distortions and identifying defective pixels, thereby improving the accuracy and reliability of the vision sensors.

Implementation Method 1

an event-driven vision sensor including a sensor array configured with sensors that generate event signals upon detection of a change in incident light intensity

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

a display apparatus including a display section configured to change luminance of a planar region instantaneously with a predetermined spatial resolution

Methodology Applied
Scientific EffectElectroluminescence: Electroluminescence

Data Source

PatentUS12033354B2Sensor calibration system, display control apparatus, program, and sensor calibration method
Publication Date: 2024.07.09 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12033354B2 patent drawing
  • US12033354B2 patent drawing
  • US12033354B2 patent drawing

AI summary

A sensor calibration system is provided that includes a sensor apparatus including an event-driven vision sensor including a sensor array configured with sensors that generate event signals upon detection of a change in incident light intensity, and a display apparatus including a display section configured to change luminance of a planar region instantaneously with a predetermined spatial resolution as per a calibration pattern of the sensors.