Runtime Sensor Configuration for IR Visible Light Occupant Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Infrared (IR) cameras face limitations in efficiency due to limited naturally occurring IR radiation and restrictive illumination regulations, leading to challenges in signal-to-noise ratio and image processing accuracy, especially in low-light conditions.

Innovation Solution

The implementation of a runtime configuration system that combines visible light (VL) and IR sensing elements, using pulsed illumination sources, to dynamically adjust exposure time and sensor gain based on the source ratio of detected photons, allowing for efficient compensation of non-linear photon count dependence and emulation of longer exposure times.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pulsed illumination sources are used to improve IR camera performance, then signal-to-noise ratio increases, but illumination intensity and duration are limited by regulations

Engineering Contradiction:
Improvesignal-to-noise ratioVSAvoidillumination intensity and duration
Core Design Contradiction:
Measurement precisionVSIllumination intensity

Solution Approach 1:

The system dynamically adjusts the exposure time of the infrared sensor based on the detected source ratio, allowing the exposure duration to vary within regulatory limits to optimize signal-to-noise ratio for different scene conditions

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the exposure time parameter adaptively based on the source ratio between reflected IR photons and emitted IR photons, enabling optimization of measurement precision while complying with illumination regulations

Inventive Principle:
Principle #35Parameter changes

2Use of energy by moving object

If exposure time is increased to improve image brightness, then more photons are detected, but prolonged exposure is prohibited by regulations

Engineering Contradiction:
Improvephoton detection efficiencyVSAvoidexposure time
Core Design Contradiction:
Use of energy by moving objectVSDuration of action of moving object

Solution Approach 1:

The system implements dynamic exposure time configuration that adapts to real-time scene conditions, allowing maximum exposure time utilization within regulatory constraints by adjusting exposure duration based on the detected source ratio

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from the detected source ratio to adjust exposure time settings, enabling optimization of photon detection efficiency while ensuring compliance with exposure duration regulations through continuous monitoring and adaptation

Inventive Principle:
Principle #23Feedback

3Ease of operation

If IR sensors are used in low-light conditions, then operations can proceed without disturbing human vision, but naturally occurring IR radiation is insufficient

Engineering Contradiction:
Improveoperation in low-light conditionsVSAvoidnaturally occurring IR radiation
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The system performs preliminary detection of the source ratio to determine the relative contribution of reflected versus emitted IR photons, enabling proactive adjustment of exposure parameters to compensate for insufficient natural IR radiation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes exposure time parameters based on the detected source ratio, allowing optimization of IR sensor performance in low-light conditions by adapting to the available natural IR radiation levels

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the accuracy and speed of image generation with correct brightness, particularly in situations where prolonged exposure is prohibited, and improves the performance of IR cameras in various applications, including autonomous driving and surveillance.

Implementation Method 1

IR cameras often operate by detecting photons emitted by pulsed illumination sources that are reflected from the environment

Methodology Applied
Scientific EffectPulsed illumination:

Implementation Method 2

IR cameras often operate by detecting photons emitted by pulsed illumination sources that are reflected from the environment

Methodology Applied
Scientific EffectPhoton detection: Photoelectric Effect

Data Source

PatentUS20240284018A1Runtime configuration of infrared and visible light sensors for occupant monitoring in autonomous and semi-autonomous systems and applications
Publication Date: 2024.08.22 NVIDIA CORP
  • US20240284018A1 patent drawing
  • US20240284018A1 patent drawing
  • US20240284018A1 patent drawing

AI summary

Disclosed are apparatuses, systems, and techniques that implement runtime configuration of sensors that combine visible light sensing elements with infrared sensing elements and deploy pulsed illumination sources in real-time data generating and streaming applications. In one disclosed embodiment, a sensing system includes a plurality of infrared (IR) sensing elements to generate an IR portion of an image and a plurality of visible light (VL) sensing elements to generate one or more VL portions of the image. A processing device identifies a source parameter characterizing a photon count associated with the IR portion of the image relative to the photon count associated with the one or more VL portions of the image, and determines, using the source parameter, one or more settings of the sensing system.