3D Stereo Robot Vision Using LWIR Thermal Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional robot vision systems using single visible light cameras lack depth and shape information, are sensitive to illumination levels, and struggle with object recognition, especially in low-light conditions and covert operations, due to limitations in providing three-dimensional situational awareness.
Innovation Solution
A three-dimensional stereo robot vision system utilizing long-wave infrared (LWIR) images from two side-by-side cameras or a single camera with a specially designed optical system, providing stereoscopic images that enhance situational awareness by offering dimensional information and improved object recognition, regardless of lighting conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a single visible light video camera is used for robot vision, then the system is simple and easy to operate, but it does not provide depth or shape information and quality varies significantly with illumination levels
Solution Approach 1:
The patent combines multiple imaging modalities (visible light camera, infrared camera, and depth sensor) into a unified robot vision system. This merging of sensors allows the system to capture depth, shape, and thermal information simultaneously while maintaining operational simplicity through integrated processing and a single display interface.
Solution Approach 2:
The patent transitions from two-dimensional visible light imaging to three-dimensional visualization by incorporating depth sensors and infrared imaging. The system projects depth maps and thermal data onto the video feed, adding dimensional information without requiring the operator to switch between multiple separate systems.
2Illumination intensity
If high sensitivity image intensifiers are used to improve video quality under low light conditions, then video quality improves, but the device becomes saturated by illumination sources and may not work in full sunlight
Solution Approach 1:
The patent implements a multi-functional imaging system that operates across diverse lighting conditions by combining visible light, infrared, and depth sensing capabilities. The system automatically selects and switches between imaging modalities based on environmental conditions, providing consistent performance whether in darkness, low light, or bright sunlight.
Solution Approach 2:
The patent changes the operating parameters of the imaging system by switching between different wavelength bands (visible light, infrared) and sensing modes based on illumination conditions. This allows the system to adapt to varying light levels without saturation or loss of performance across different environmental conditions.
3Illumination intensity
If onboard light sources are used to compensate for low lighting, then video quality improves, but power consumption increases, range is limited, and the robot's location is revealed in covert operations
Solution Approach 1:
The patent replaces active mechanical illumination systems with passive sensing technologies. By using infrared cameras that detect thermal radiation and depth sensors that measure time-of-flight or stereo disparity, the system obtains imaging capability in low light without requiring power-intensive light sources or revealing the robot's position through emitted light.
4Reliability
If traditional visible light cameras are used, then the system is simple to implement, but object recognition and situational awareness are limited in complex terrains and low-light conditions
Solution Approach 1:
The patent merges multiple sensing technologies (visible light imaging, infrared thermal imaging, and depth sensing) into a unified system that processes and displays integrated information. This combination enhances object recognition and situational awareness by providing complementary data from different spectral and spatial domains while maintaining a single operational interface.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system provides enhanced situational awareness and improved object recognition by offering three-dimensional imaging, overcoming limitations of traditional systems, with LWIR images providing contrast and depth cues that improve navigation and object detection, even in challenging environments.
Implementation Method 1
using thermal imaging to provide three dimensional robot vision
Data Source
AI summary
A robot vision system provides images to a remote robot viewing station, using a single long wave infrared camera on-board the robot. An optical system, also on-board the robot, has mirrors that divide the camera's field of view so that the camera receives a stereoscopic image pair. An image processing unit at the viewing station receives image data from the camera and processes the image data to provide a stereoscopic image.