High Resolution Infrared Image Generation Using RGB-IR Sensor Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional RGB-IR cameras produce low-resolution infrared images when only IR pixels are used, lacking color information and resulting in monochrome output, which is inadequate for applications requiring high-resolution imaging.
Innovation Solution
A processor circuit generates high-resolution infrared images by interpolating infrared data using red, green, and blue samples from an RGB-IR sensor, increasing pixel resolution beyond the number of IR samples and integrating visible light interpolation to enhance image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If only IR pixels are used to generate infrared images, then the image resolution is reduced, but the manufacturing complexity is lowered
Solution Approach 1:
The patent merges IR pixel data with RGB pixel data to generate high-resolution infrared images. The processor combines infrared sample data with red, green, and blue sample data through interpolation algorithms, fusing the advantages of both data types to achieve full-resolution infrared imaging without requiring separate high-resolution IR sensors
Solution Approach 2:
The patent introduces an intermediary processing stage that uses RGB pixel information as a mediator to reconstruct IR image details. The visible light interpolation algorithm acts as an intermediary that fills in gaps between IR pixels using surrounding RGB data, enabling high-resolution output without direct high-resolution IR sensing
2Reliability
If IR pixels are used for night vision, then infrared detection capability is improved, but color information is lost
Solution Approach 1:
The patent merges infrared detection data with color information from RGB pixels. The processing algorithm combines the infrared sample data (which provides detection capability) with red, green, and blue sample data (which provides color information), producing infrared images that retain color data while maintaining infrared detection reliability
Solution Approach 2:
The patent makes the infrared image generation process multi-functional by simultaneously achieving infrared detection, color preservation, and high-resolution output. The same processing pipeline that detects infrared radiation also recovers color information and generates high-resolution images, eliminating the need for separate processing paths
3Measurement precision
If standard IR pixel output is used, then device complexity is reduced, but image resolution becomes insufficient for advanced applications
Solution Approach 1:
The patent performs preliminary action by capturing both IR and RGB data simultaneously using the RGB-IR sensor array. The sensor captures infrared samples and visible light samples in the same frame, preparing multi-dimensional data for subsequent processing that will generate high-resolution infrared images through interpolation
Solution Approach 2:
The patent changes the output parameter from standard low-resolution IR pixel count to high-resolution infrared image pixel count. By using interpolation algorithms that leverage both IR and RGB data, the system transforms the limited physical pixel count into a higher effective resolution output, achieving 4x or greater resolution improvement
Data Source
AI summary
An apparatus includes a memory and a processor circuit. The memory may be configured to store one or more frames of image pixel data. Each of the frames generally comprises red (R) samples, green (G) samples, blue (B) samples, and infrared (IR) samples. The processor circuit may be configured to generate an infrared image for each frame. The infrared image generally has a number of infrared (IR) pixels greater than the number of the infrared (IR) samples of each frame. The processor circuit generally performs interpolation utilizing the infrared (IR) samples and one or more of the red (R) samples, the green (G) samples, and the blue (B) samples of each frame in generating the infrared image for each frame.