Gaze Point Detection Using Dual-Camera 3D Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gaze point detection devices cannot accurately measure the spatial position of a pupil, its size, and depth, leading to inaccuracies in detecting the gaze point.

Innovation Solution

A gaze point detection system that uses two cameras to input images and depth information, with face detection, line of sight direction estimation, and position information estimation to identify the gaze point based on three-dimensional spatial positions of the pupil and camera positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single camera is used for gaze point detection, then the device complexity is reduced, but the measurement precision of pupil spatial position and depth is insufficient

Engineering Contradiction:
Improvedevice complexityVSAvoidmeasurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent transitions from single-camera 2D imaging to dual-camera 3D imaging, adding a depth dimension. The two cameras are positioned at different locations to capture images from multiple viewpoints, enabling three-dimensional spatial position estimation of the pupil through triangulation or stereo vision algorithms, thereby resolving the contradiction between device simplicity and measurement precision.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent combines two separate camera systems to work together as an integrated gaze detection device. By merging the imaging data from both cameras with different viewpoints, the system achieves accurate three-dimensional pupil position measurement that neither camera could achieve alone, while maintaining relatively simple individual camera components.

Inventive Principle:
Principle #5Merging (Combining)

2Device complexity

If depth information is not captured, then the device complexity is reduced, but the accuracy of three-dimensional spatial position estimation is insufficient

Engineering Contradiction:
Improvedevice complexityVSAvoidthree-dimensional spatial position accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent adds depth information capture by using two cameras positioned at different locations to obtain three-dimensional spatial coordinates. This dimensional transition from 2D to 3D imaging enables accurate estimation of pupil depth and spatial position without requiring complex additional depth sensing hardware, resolving the contradiction between device simplicity and spatial accuracy.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12067162B2Gaze point detection device and gaze point detection method
Publication Date: 2024.08.20 NEC CORP
  • US12067162B2 patent drawing
  • US12067162B2 patent drawing
  • US12067162B2 patent drawing

AI summary

A gaze point detection device 30 includes face detection means 31 for detecting a face portion of an object person from a first image and first depth information, line of sight direction estimation means 32 for estimating a line of sight direction of the object person using the face portion detected by the face detecting means 31, position information estimation means 33 for estimating a three-dimensional spatial position of a pupil of the object person and three-dimensional spatial positions of a first photographing unit and a second photographing unit, based on the first image, the first depth information, a second image and second depth information, and gaze point identification means 34 for identifying a gaze point of the object person, based on the three-dimensional spatial position of the pupil of the object person and the line of sight direction.