Pupil Detection via Visible Near-Infrared Image Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing pupil detection technologies require costly and complex setups with multiple light sources and imaging devices aligned to specific wavelengths, necessitating expensive equipment and precise installation to detect pupils efficiently.

Innovation Solution

An image processing device that receives visible and near-infrared images of a face, adjusts brightness based on pixel value distributions, aligns the images, inverts the visible image brightness, and detects the pupil region from a synthetic image, eliminating the need for precise alignment of light sources and imaging devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple light sources and imaging devices are used to detect pupils based on wavelength differences, then pupil detection accuracy is improved, but device complexity and cost increase

Engineering Contradiction:
Improvepupil detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses image processing to create a synthetic representation of the pupil detection process. Instead of physically separating light paths with complex optical components, the system captures images with a single imaging device and synthesizes the wavelength-separated effect through digital image processing, where the near-infrared image serves as a copy of the pupil region that is then combined with the visible image.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical/optical system of multiple light sources and wavelength-separating devices with an electronic/image processing system. The physical separation of light paths using dichroic mirrors or prisms is substituted by digital image processing techniques that simulate the effect of wavelength separation through image synthesis and combination.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If multiple light sources and imaging devices are precisely aligned, then pupil detection accuracy is improved, but installation and adjustment difficulty increase

Engineering Contradiction:
Improvepupil detection accuracyVSAvoidinstallation ease
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent uses image processing to create a synthetic representation of the pupil detection process. Instead of physically separating light paths with complex optical components, the system captures images with a single imaging device and synthesizes the wavelength-separated effect through digital image processing, where the near-infrared image serves as a copy of the pupil region that is then combined with the visible image.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The single imaging device performs multiple functions: it captures both visible light images and near-infrared images, and through image processing, it synthesizes the effect of multiple wavelength-separated imaging paths. This multi-functional approach eliminates the need for separate optical paths and their associated alignment requirements.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If wavelength-separating devices are installed, then pupil detection accuracy is improved, but system cost increases

Engineering Contradiction:
Improvepupil detection accuracyVSAvoidsystem cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses image processing to create a synthetic representation of the pupil detection process. Instead of physically separating light paths with complex optical components, the system captures images with a single imaging device and synthesizes the wavelength-separated effect through digital image processing, where the near-infrared image serves as a copy of the pupil region that is then combined with the visible image.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical/optical system of multiple light sources and wavelength-separating devices with an electronic/image processing system. The physical separation of light paths using dichroic mirrors or prisms is substituted by digital image processing techniques that simulate the effect of wavelength separation through image synthesis and combination.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces costs and improves pupil detection accuracy by simplifying the setup and enhancing image alignment, allowing for effective pupil detection without the need for complex optical axis alignment and specialized light separation devices.

Implementation Method 1

A human pupil has a retroreflection characteristic with respect to near-infrared light (for example, an electromagnetic wave having a wavelength around 850 nanometer (nm)).

Methodology Applied
Scientific EffectRetroreflection: Retroreflector

Data Source

PatentUS12014572B2Image processing device, image processing method, and storage medium
Publication Date: 2024.06.18 NEC CORP
  • US12014572B2 patent drawing
  • US12014572B2 patent drawing
  • US12014572B2 patent drawing

AI summary

An image processing device according to one aspect of the present disclosure includes: at least one memory storing a set of instructions; and at least one processor configured to execute the set of instructions to: receive a visible image of a face; receive a near-infrared image of the face; adjust brightness of the visible image based on a frequency distribution of pixel values of the visible image and a frequency distribution of pixel values of the near-infrared image; specify a relative position at which the visible image is related to the near-infrared image; invert adjusted brightness of the visible image; detect a region of a pupil from a synthetic image obtained by adding up the visible image the brightness of which is inverted and the near-infrared image based on the relative position; and output information on the detected pupil.