RGB-IR Camera Exposure Control for High-Rate HDR Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera systems face challenges in simultaneously capturing high-quality color and infrared images with existing camera systems, and high dynamic range images at a high repetition rate, leading to reduced image quality and motion artifacts, especially in low-light conditions.
Innovation Solution
A camera system with an image sensor capable of capturing RGB and IR images using different exposure durations, combined with an infrared light source and a computing unit to merge images for high dynamic range, allowing simultaneous capture and processing of RGB, IR, and HDR images at high repetition rates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If exposure series with multiple different exposure durations are recorded to generate HDR images, then the dynamic scope is increased, but the image repetition rate is reduced
Solution Approach 1:
The patent segments the image capture process into two independent parallel streams: one for RGB color images and one for infrared images. Each stream can operate with its own exposure duration optimized for its specific purpose, allowing HDR generation without compromising the repetition rate of individual image streams.
Solution Approach 2:
The patent adds the infrared dimension to the traditional RGB imaging approach. By capturing infrared images simultaneously with RGB images using the same exposure duration, the system achieves HDR effects through multi-spectral fusion rather than traditional multi-exposure time sequencing, thus maintaining high repetition rates.
2Adaptability or versatility
If color images and infrared images are captured alternately to generate both streams, then both spectra can be recorded, but the image repetition rate of both video streams is reduced
Solution Approach 1:
The patent merges the capture of RGB and infrared images into a single simultaneous exposure event. The image sensor is configured to detect both visible light (for RGB) and infrared light (for IR images) during the same exposure period, allowing both spectral streams to be generated at the full camera repetition rate without alternation.
Solution Approach 2:
The image sensor is designed with multi-functionality to simultaneously perform RGB color imaging and infrared imaging in a single exposure. This universal capability allows the system to generate both color and infrared video streams at the maximum possible repetition rate, eliminating the need for alternate capture sequences.
3Device complexity
If a single camera is used to record both color and infrared images, then costs and installation space are reduced, but the dynamic scope and image quality must be optimized simultaneously
Solution Approach 1:
The patent employs a single image sensor with multi-functional capabilities that can simultaneously detect visible light for color imaging and infrared light for thermal imaging. This universal sensor design enables one camera to perform multiple functions (RGB and IR capture) with optimized image quality for both spectra, eliminating the need for separate dedicated cameras.
Solution Approach 2:
The system dynamically adjusts exposure parameters including exposure duration, gain, and spectral sensitivity to optimize image quality for both RGB and infrared capture. By changing these parameters based on the specific imaging requirements and lighting conditions, the single camera achieves high image quality across both spectral ranges.
4Illumination intensity
If long exposure durations are used to improve dynamic scope, then HDR quality is enhanced, but motion artifacts occur
Solution Approach 1:
The patent segments the imaging task into simultaneous RGB and IR capture operations with identical exposure durations. By avoiding sequential multi-exposure sequences, the system eliminates the time differences that cause motion artifacts while still achieving HDR quality through spectral fusion of the simultaneous captures.
Solution Approach 2:
The patent replaces the traditional mechanical approach of sequential multi-exposure time sequencing with a simultaneous multi-spectral capture approach. Instead of taking multiple images at different times to build HDR, the system captures multiple spectral information streams at the same moment, substituting temporal separation with spectral separation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system enables high-quality, high-repetition-rate capture of RGB, IR, and HDR images, improving image quality and reducing motion artifacts, particularly in low-light conditions, while optimizing resource use and reducing installation space.
Implementation Method 1
image sensor that is set up to detect light in the visible spectrum by means of RGB exposure means and light in the infrared spectrum by means of IR exposure means
Implementation Method 2
control the infrared light source in order to additionally illuminate the scene with infrared light during at least one second recording process
Data Source
AI summary
A camera module is controlled in order to expose the image sensor with a first exposure duration during at least one first recording process to generate a first RGB image. The An infrared light source is controlled to additionally illuminate the scene with infrared light during at least one second recording process and simultaneously the camera module exposes an image sensor during the second recording process with a second exposure duration deviating from the first exposure duration to generate a second RGB image and an IR image. The at least one first RGB image and the at least one second RGB image are merged to form an HDR image.