Patterned-Light Gaze Detection for Event-Based Imaging Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional gaze detection devices suffer from reduced detection accuracy due to the imaging method used in imaging systems, particularly when event-based vision sensors are employed.

Innovation Solution

A gaze detection device that irradiates the eyeball with patterned light having a shape along a reference pattern with at least three non-parallel lines, each crossing at an intersection point, and includes a corneal-reflection-image detection unit to associate feature points with intersection points based on angle and direction information, using an imaging system that may be an event-based vision sensor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional patterned light shapes (rectangular frame or two crossing line segments) are used, then the device structure is simple, but detection accuracy reduces when using event-based vision sensors

Engineering Contradiction:
Improvegaze detection accuracyVSAvoidpatterned light shape complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patterned light is divided into multiple independent line segments that extend from the illumination point in different directions. Each line segment creates a corresponding reflection feature on the cornea, allowing the system to detect gaze direction by analyzing the positions and orientations of these segmented reflection features. This segmentation approach improves detection accuracy with event-based sensors while maintaining reasonable device complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patterned light uses line segments with different orientations and lengths radiating from a common point, creating an asymmetric pattern that provides richer directional information. The asymmetric arrangement of line segments ensures that reflections can be detected across multiple angles, improving gaze detection accuracy particularly when using event-based vision sensors that rely on temporal and spatial feature analysis.

Inventive Principle:
Principle #4Asymmetry

2Speed

If event-based vision sensors are used, then power consumption is reduced and response speed is improved, but detection accuracy deteriorates

Engineering Contradiction:
Improveresponse speedVSAvoidgaze detection accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patterned light illumination creates pre-configured reflection features on the cornea before gaze detection begins. The line segments are arranged in advance to produce distinct reflection patterns that event-based sensors can quickly detect and analyze. This preliminary configuration of the illumination pattern enables the sensor to rapidly determine gaze direction without requiring complex real-time processing, thus maintaining high accuracy while leveraging the fast response capability of event-based sensors.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patterned light reflections act as intermediary features that bridge the illumination source and the gaze direction. These reflection features serve as mediators that event-based sensors can detect and use to infer eye movement and gaze direction. The intermediary reflection patterns convert the complex task of gaze detection into a simpler problem of detecting and analyzing reflection feature positions and orientations, which event-based sensors can handle efficiently with high accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The device enhances detection accuracy by robustly detecting gaze direction regardless of the imaging method, maintaining high precision even with event-based vision sensors.

Implementation Method 1

a corneal-reflection-image detection unit that detects from the captured image a feature point of a corneal reflection image of the patterned light

Methodology Applied
Scientific EffectCorneal reflection: Reflection

Data Source

PatentUS20250370535A1Gaze detection device
Publication Date: 2025.12.04 SONY GROUP CORP
  • US20250370535A1 patent drawing
  • US20250370535A1 patent drawing
  • US20250370535A1 patent drawing

AI summary

Provided is a gaze detection device that can suppress reduction in detection accuracy regardless of the imaging method of an imaging system. The gaze detection device according to the present technique includes a patterned-light illumination system that irradiates an eyeball with patterned light, an imaging system that captures an image of the eyeball irradiated with the patterned light, and a gaze detection system that detects a gaze as the direction of the eyeball on the basis of the captured image of the imaging system. The patterned light has a shape along the reference pattern having at least three lines not parallel to one another, the reference pattern having an intersection point where at least two lines of the at least three lines cross each other. According to the gaze detection device of the present technique, the gaze detection device can be provided to suppress reduction in detection accuracy regardless of the imaging method of the imaging system.