Line-of-Sight Detection Using Multi-Method Reliability Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies for detecting a user's line-of-sight direction are not stable and reliable, particularly in applications such as amusement, traffic, and medical care, where accurate and consistent detection is crucial.

Innovation Solution

An information processing apparatus that acquires eye information from a user and uses multiple methods to determine line-of-sight directions, calculating reliability information to synthesize these directions and update correction parameters, ensuring stable detection by combining different detection methods.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a single line-of-sight detection method is used, then the device complexity is low, but the reliability and stability of detection are insufficient

Engineering Contradiction:
Improveline-of-sight detection reliabilityVSAvoiddetection method complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple line-of-sight detection methods (pupil-corneal reflection method and pupil position method) into a unified detection system. The processor integrates results from both methods and calculates reliability information to determine the final line-of-sight direction, thereby improving detection reliability without requiring separate independent systems for each method

Inventive Principle:
Principle #5Merging (Combining)

2Stability of the object's composition

If multiple detection methods are used to improve reliability, then the line-of-sight detection stability improves, but the processing complexity increases

Engineering Contradiction:
Improveline-of-sight detection stabilityVSAvoidprocessing complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The patent segments the detection process into distinct modules: a first line-of-sight detection unit using the pupil-corneal reflection method, a second line-of-sight detection unit using the pupil position method, and a synthesis unit that combines results. This segmentation allows each method to be processed independently and simplifies the overall processing architecture while maintaining high detection stability

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If reliability information is calculated for each detection method, then the accuracy of line-of-sight determination improves, but the computational load increases

Engineering Contradiction:
Improveline-of-sight measurement precisionVSAvoidcomputational energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent calculates reliability information only when necessary for synthesizing the final line-of-sight direction. Rather than continuously processing all possible detection parameters, the system performs partial actions by evaluating reliability based on the specific detection results obtained from the two methods, thereby reducing unnecessary computational energy consumption while maintaining high measurement precision

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The apparatus achieves stable and accurate detection of a user's line-of-sight direction, improving reliability and adaptability to positional shifts, and maintaining high accuracy across various applications.

Implementation Method 1

a light source that emits infrared light and an imaging unit that captures an image of an eyeball. Infrared light is irradiated onto an eyeball by the light source

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

an image of an eyeball in which a bright spot (a Purkinje image) of the infrared light is reflected is captured by the imaging unit

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS12076087B2Information processing apparatus and information processing method
Publication Date: 2024.09.03 SONY GROUP CORP
  • US12076087B2 patent drawing
  • US12076087B2 patent drawing
  • US12076087B2 patent drawing

AI summary

An information processing apparatus according to an embodiment of the present technology includes an acquisition section and a processor. The acquisition section acquires eye information regarding an eye of a user. The processor determines a first line-of-sight direction on the basis of the eye information using a first method, determines a second line-of-sight direction on the basis of the eye information using a second method that is different from the first method, calculates reliability information regarding at least one of reliability of the first line-of-sight direction or reliability of the second line-of-sight direction, and determines a line-of-sight direction of the user on the calculated reliability information.