Camera Pipeline Integrity via Light Sensor Correlation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern digital security is threatened by hardware attacks such as camera hijacking and hardware malfunctions, which can compromise biometric authentication systems by injecting false feeds or malfunctioning sensor outputs, making it difficult to distinguish between legitimate and illegitimate image frames.

Innovation Solution

The solution involves cross-checking image frames captured by a camera with signals from light sensors to determine the correlation of illuminance values, using a method that estimates both image-based and sensor-based illuminance, and compares them to a threshold to detect hardware hijack or malfunction, thereby preventing unauthorized access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If additional hardware is added to detect hardware hijack or malfunction, then detection capability is improved, but device complexity and cost increase

Engineering Contradiction:
Improvedetection capabilityVSAvoidhardware complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The light sensor is utilized for its primary function of measuring ambient light conditions while simultaneously serving as a verification sensor to detect camera pipeline integrity. By cross-checking the illuminance values derived from image frames against the light sensor readings, the system achieves hardware hijack detection without adding dedicated verification hardware, thus maintaining device simplicity while improving reliability

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If additional hardware is added to detect hardware hijack or malfunction, then detection capability is improved, but system cost increases

Engineering Contradiction:
Improvedetection capabilityVSAvoidsystem cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The system repurposes the existing light sensor to perform dual functions: ambient light measurement for normal operation and illuminance verification for security detection. This eliminates the need for dedicated verification hardware, reducing bill of materials costs and simplifying manufacturing while maintaining robust hardware hijack detection capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If cross-checking between image frames and light sensor signals is performed, then hardware hijack detection accuracy is improved, but processing time increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs illuminance verification by comparing key parameters (illuminance values, correlation coefficients) rather than analyzing every pixel or detail of image frames. This partial verification approach achieves sufficient detection accuracy to identify hardware hijacks while minimizing processing overhead and maintaining acceptable authentication speeds

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively detects and prevents hardware hijack or malfunction, enhancing digital security by ensuring the integrity of image frames and sensor outputs, reducing the need for additional hardware and lowering authentication system costs.

Implementation Method 1

receiving one or more signals representing outputs of one or more light sensors of a device

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

receiving one or more image frames captured by a camera

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11341880B1Multi-sensor scene brightness analysis to check camera pipeline integrity
Publication Date: 2022.05.24 JUMIO CORP
  • US11341880B1 patent drawing
  • US11341880B1 patent drawing
  • US11341880B1 patent drawing

AI summary

Technology described herein includes a method that includes receiving, at one or more processing devices at one or more locations, one or more image frames; receiving, at the one or more processing devices, one or more signals representing outputs of one or more light sensors of a device; estimating, by the one or more processing devices based on the one or more image frames, one or more illuminance values; determining, by the one or more processing devices, that a degree of correlation between (i) a first illuminance represented by the one or more illuminance values and (ii) a second illuminance represented by the one or more signals fails to satisfy a threshold condition; and in response to determining that the degree of correlation fails to satisfy the threshold condition, determining, by the one or more processing devices, presence of an adverse condition associated with the device.