Event Vision Sensor Threshold Control for Driver Eye Monitoring

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies face challenges in accurately observing eyeball behaviors such as microsaccade and tremor, which are high-speed motions, and struggle with data amount increases when using an event vision sensor (EVS), making it difficult to determine a driver's awakening level for safe switching from automatic to manual driving modes.

Innovation Solution

An information processing apparatus and method utilizing an event vision sensor with a pixel array and event detection unit to image the inside of a mobile body, adjusting a luminance threshold to accurately observe eyeball behaviors and determine the driver's awakening level without excessive data increase.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If an event vision sensor is used to observe high-speed eyeball behaviors, then measurement precision is improved, but quantity of data increases

Engineering Contradiction:
Improveeyeball behavior observation accuracyVSAvoiddata amount
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent changes the threshold parameter of the event vision sensor based on detected eyeball behavior patterns. When microsaccade or tremor is detected, the threshold is adjusted to optimize detection sensitivity while reducing unnecessary data generation from normal eye movements, thus resolving the contradiction between measurement precision and data quantity

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the luminance threshold is lowered to detect subtle eyeball movements, then measurement precision is improved, but data amount increases

Engineering Contradiction:
Improveeyeball behavior detection accuracyVSAvoiddata amount
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent implements dynamic threshold adjustment where the luminance threshold is not fixed but adapts based on detected eyeball behavior characteristics. This dynamic approach allows the system to maintain high measurement precision for detecting subtle movements like microsaccade while reducing data generation during periods of normal eye activity, effectively resolving the contradiction between precision and data quantity

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate observation of eyeball behaviors to ensure safe switching from automatic to manual driving modes by monitoring the driver's awakening level, reducing the risk of accidents.

Implementation Method 1

an event detection unit that detects that a luminance change amount due to incident light has exceeded a predetermined threshold in the pixels

Methodology Applied
Scientific EffectLuminance change detection: Photoelectric Effect

Data Source

PatentUS12528518B2Information processing with driver eye movement monitoring
Publication Date: 2026.01.20 SONY SEMICON SOLUTIONS CORP
  • US12528518B2 patent drawing
  • US12528518B2 patent drawing
  • US12528518B2 patent drawing

AI summary

There is provided an information processing apparatus including an event vision sensor (400) that images an inside of a mobile body and a sensor control unit (330) that controls the event vision sensor. The event vision sensor includes a pixel array unit (500) including a plurality of pixels arrayed in a matrix and an event detection unit (508) that detects that a luminance change amount due to incident light has exceeded a predetermined threshold in the pixels. The sensor control unit changes a value of the predetermined threshold when grasping, with the event vision sensor, an eyeball behavior of a driver seated on a driver's seat of the mobile body.