Near-Infrared Skin Feature Extraction for Masked Face Authentication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing face recognition technologies face challenges in identifying individuals when face organs are covered by objects like masks or sunglasses, and they struggle to effectively utilize skin regions for discrimination due to uniform imaging and varying lighting conditions.

Innovation Solution

An image processing apparatus that uses a specific wavelength band where spectral transmittance of melanin and other skin substances differs, allowing for the detection and emphasis of skin features even when face organs are obscured, and employs feature extraction and similarity calculation methods to determine individual identity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If general imaging apparatuses are used to capture face images, then the imaging process is simple and fast, but skin regions are imaged as uniform planes making it difficult to detect individual differences

Engineering Contradiction:
Improveskin feature detection precisionVSAvoidimaging system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent changes the wavelength parameter of the imaging system to the near-infrared region (700-900nm), where skin substances exhibit different spectral transmittance characteristics. This parameter change enables the imaging apparatus to capture skin features with individual differences while maintaining a relatively simple imaging system configuration.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If face organs are used for identification, then individual differences are easily recognized, but identification becomes difficult when face organs are covered by wearing objects

Engineering Contradiction:
Improveface identification reliabilityVSAvoididentification capability under various conditions
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent extracts and utilizes skin region information separately from face organ information. By focusing on the skin region's spectral characteristics in the near-infrared wavelength, the system can identify individuals even when face organs are covered, thereby improving adaptability while maintaining reliability through complementary use of skin features.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces skin region spectral characteristics as an intermediary for identification when direct face organ observation is blocked. The skin's optical properties in the near-infrared region serve as a mediator that provides identification capability independent of face organ visibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If skin regions are used for discrimination, then identification can be performed when face organs are covered, but skin appears as a uniform plane in general imaging making feature detection difficult

Engineering Contradiction:
Improveidentification capability with covered face organsVSAvoidskin feature detection precision
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent changes the imaging wavelength to the near-infrared region where skin substances exhibit varying spectral transmittance. This enables the imaging system to detect skin features with individual differences that are not visible in conventional imaging, thereby achieving both adaptability for covered faces and precision in skin feature detection.

Inventive Principle:
Principle #35Parameter changes

4Reliability

If conventional face recognition methods are used, then the system is simple to implement, but the system lacks robustness against varying lighting conditions and cannot effectively utilize skin regions

Engineering Contradiction:
Improverobustness against lighting variationsVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent changes the operating wavelength to near-infrared, where skin substances exhibit consistent spectral characteristics regardless of visible light conditions. This provides robustness against lighting variations while the spectral transmittance analysis adds a layer of processing complexity for enhanced reliability.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables effective face authentication by emphasizing melanin patterns in the skin, improving identification accuracy even when face organs are covered, and providing robustness against varying lighting conditions.

Implementation Method 1

an imaging unit (1100), which images a target object using signals in a predetermined wavelength band in which a spectral transmittance of a specific substance of a plurality of substances on a surface of the target object is different from a spectral transmittance of the other substances of the plurality of substances

Methodology Applied
Scientific EffectSpectral transmittance: Absorption (EM radiation)

Data Source

PatentUS10650225B2Image processing apparatus which determines category to which object in image belongs, method therefor, and object discrimination apparatus
Publication Date: 2020.05.12 CANON KK
  • US10650225B2 patent drawing
  • US10650225B2 patent drawing
  • US10650225B2 patent drawing

AI summary

An image processing apparatus includes an imaging unit, a determination unit, and a discrimination unit. The imaging unit images a target object using signals in a predetermined wavelength band in which a spectral transmittance of a specific substance of a plurality of substances on a surface of the target object is different from a spectral transmittance of the other substances of the plurality of substances. The determination unit determines a distribution state of the specific substance on the surface of the target object based on an image captured by the imaging unit. The discrimination unit discriminates a class to which the target object belongs based on the distribution state of the specific substance.