Multi-Spectrum Image Sensor with Five Photosensitive Channels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The complexity of the optical system in image acquisition devices with beam splitting and fusion functions limits their application scope, as they require special design to simultaneously acquire infrared and visible light, resulting in a cumbersome structure.

Innovation Solution

A multi-spectrum based image fusion apparatus with an image sensor having five types of photosensitive channels (red, green, blue, infrared, and full-band W channels) that acquires and processes images, allowing for the generation of a fused image with reduced structural complexity by using interpolation and filtering techniques to combine RGB and brightness signals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a beam splitting and fusion function is used to acquire dual-band images, then the image information content is improved, but the optical system complexity increases

Engineering Contradiction:
Improveimage information contentVSAvoidoptical system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges the functions of separate visible light and infrared imaging systems into a single image sensor. The image sensor integrates multiple photosensitive channels (RGB channels for visible light and IR channel for infrared) within one device, eliminating the need for separate beam splitting mirrors, multiple sensors, and complex registration mechanisms. This combining approach maintains dual-band image acquisition capability while significantly reducing optical system complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The image sensor is designed with multi-functionality to handle both visible light and infrared spectrum detection. By incorporating photosensitive channels that respond to different wavelength ranges (RGB for visible, IR for infrared) within a single sensor device, the system achieves universal imaging capability across multiple spectral bands without requiring separate specialized devices, thus simplifying the overall optical system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If a prism beam splitter is used to separate visible and infrared light, then the dual-band image acquisition is achieved, but the structural complexity increases

Engineering Contradiction:
Improvedual-band image acquisition capabilityVSAvoidstructural complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the spectral separation function from the optical domain (prism beam splitter) and relocates it to the sensor domain (photosensitive channels with different spectral responses). Instead of using optical elements to physically separate light paths, the single image sensor uses electronically distinguishable channels to capture different spectral bands simultaneously, eliminating complex optical separation structures.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical/optical beam splitting system (prism, mirrors, separate sensors) with an electronic/sensor-based system. The spectral differentiation is achieved through the photosensitive characteristics of different channels within the image sensor rather than through physical light path separation, substituting a simpler sensor-based mechanism for a complex mechanical-optical system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables the acquisition of dual-band images with improved quality and reduced structural complexity, making the image fusion apparatus more versatile and widely applicable.

Implementation Method 1

an image sensor having five types of photosensitive channels, the five types of photosensitive channels including red, green and blue RGB channels, an infrared IR channel and a full-band W channel; wherein the light acquisition device is configured to acquire target light corresponding to incident light; the image sensor is configured to convert the target light into an image signal

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11526969B2Multi-spectrum-based image fusion apparatus and method, and image sensor
Publication Date: 2022.12.13 HANGZHOU HIKVISION DIGITAL TECHNOLOGY CO LTD
  • US11526969B2 patent drawing
  • US11526969B2 patent drawing
  • US11526969B2 patent drawing

AI summary

A multi-spectrum based image fusion apparatus is disclosed, which includes a light acquisition device, an image processor, and an image sensor having five types of photosensitive channels. The five types of photosensitive channels including red, green and blue RGB channels, an infrared IR channel and a full-band W channel. The light acquisition device acquires target light corresponding to incident light. The image sensor converts the target light into an image signal through the RGB channels, the IR channel and the W channel. The image processor analyzes the image signal into RGB color signals and a brightness signal, and fuses the RGB color signals and the brightness signal to obtain a fused image. The collection of the channels based on which the RGB color signals and the brightness signal are obtained includes the five types of photosensitive channels.