Multispectral Imaging Parallax Correction via Virtual Cyclopean Camera
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multispectral imaging systems face challenges in combining visible light and infrared images due to parallax effects, which cause distortion and reduce the displayable contrast of objects with varying temperatures, especially when cameras are positioned differently, leading to misalignment and reduced spatial information.
Innovation Solution
The implementation of a virtual cyclopean camera arrangement, where two spaced-apart visible light cameras and an infrared camera are combined to produce a cyclopean image from a central viewpoint, reducing parallax issues by aligning the images from the same virtual position, and using structured light scanning for three-dimensional overlaying and image segmentation to enhance visibility and contrast.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If visible light and infrared cameras are positioned at different spatial locations to capture images, then each camera can independently capture its respective spectral information, but parallax effects occur causing misalignment and spatial information loss in the combined image
Solution Approach 1:
The patent combines multiple cameras (visible light and infrared) into a single integrated imaging system with a shared lens and sensor array. This merging eliminates parallax effects by ensuring all spectral channels capture images from the exact same spatial position and angle, achieving perfect spatial alignment while maintaining independent spectral capture capabilities
Solution Approach 2:
The imaging system is designed with multi-functionality where a single camera assembly performs multiple spectral imaging functions simultaneously. The same optical path and sensor array capture both visible light and infrared radiation, making the system universal for multispectral imaging without requiring separate camera positions
2Loss of information
If infrared and visible light images are overlaid to provide combined information, then temperature information becomes visible, but the displayable contrast range is reduced because the display must cover the entire temperature range of all objects in the scene
Solution Approach 1:
The patent applies local quality by allowing different regions of the image to have different contrast optimizations. Objects of interest can be identified and have their temperature ranges separately optimized for display, while other regions maintain their own contrast characteristics. This enables enhanced visibility of specific thermal features without being constrained by the full scene temperature range
Solution Approach 2:
The system dynamically adjusts display parameters such as temperature range mapping and contrast enhancement based on identified objects of interest. By changing the display parameter ranges locally for different regions or selected objects, the system maximizes visible contrast for important thermal information while maintaining overall image coherence
3Measurement precision
If separate visible light and infrared cameras are used, then each camera can operate at its optimal resolution, but the combined image lacks discernible spatial information and requires complex alignment
Solution Approach 1:
The patent merges visible light and infrared imaging into a single integrated system where both spectral channels share the same optical path, lens, and sensor array. This ensures that spatial information is captured identically for both wavelengths, eliminating alignment issues and preserving complete spatial detail in the combined multispectral image
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An apparatus and a metthod for multispectral imaging, comprising a cyclopean camera arrangement comprising at least two spaced apart imaging sensors operating at a first waveband,an image combiner arranged to combine images from the at least two spaced apart imaging sensors to provide a first cyclopean image of a scene from a first virtual position, a further imaging sensor operating at a second waveband different from the first and arranged to provide a second image of the scene from a second position, and image combining means arranged to combine the first and second images of the scene to provide a multispectral image, wherein the first virtual position of the cyclopean camera arrangement and the second position of the further sensor are arranged to be substantially the same.