Multi-Sensor Human Detection Using LWIR and LADAR Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in accurately detecting human beings in a field of view, particularly in distinguishing humans from terrain or man-made obstacles due to variations in lighting, size, range, and body dimensions, and this becomes even more difficult when the sensing device is mounted on a moving platform.
Innovation Solution
A method and apparatus that combines long-wave infrared (LWIR) images with corresponding images from other devices such as stereo cameras and LADAR scanners, using image processing and pattern detection algorithms to identify areas of interest with thermal emission characteristics and sizes appropriate for humans, and marking their locations for avoidance by unmanned or manned systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Difficulty of detecting and measuring
If LADAR systems are used to detect humans, then detection capability is provided, but accuracy in recognizing humans in crouched position deteriorates due to similarity with shrubs
Solution Approach 1:
The patent combines LADAR depth information with LWIR thermal imaging and visible light camera data to create a multi-modal detection system. This fusion allows the system to distinguish humans from shrubs by analyzing multiple characteristics simultaneously - thermal emission patterns, depth profiles, and visual appearance - rather than relying on LADAR data alone.
Solution Approach 2:
The patent introduces LWIR thermal imaging as an intermediary detection method that detects thermal emission characteristics specific to human beings. This intermediary technology provides additional discriminatory information that helps resolve the ambiguity between humans and shrubs that LADAR alone cannot distinguish.
2Difficulty of detecting and measuring
If LWIR systems are used to detect humans, then thermal emission detection is enabled, but discrimination accuracy deteriorates when numerous warm objects are present
Solution Approach 1:
The patent merges LWIR thermal imaging with LADAR depth sensing and visible light imaging to create a multi-parameter detection system. By combining thermal data with depth information and visual characteristics, the system can distinguish human thermal patterns from other warm objects through their unique combination of properties rather than thermal emission alone.
Solution Approach 2:
The patent applies different detection criteria and processing methods to different regions and objects in the field of view. The system analyzes local thermal patterns, depth profiles, and visual characteristics specific to each detected object, allowing it to identify human-specific patterns even among multiple warm objects with varying local properties.
3Device complexity
If single sensor systems are used for human detection, then device complexity is reduced, but detection reliability deteriorates due to variations in lighting, size, range, and body dimensions
Solution Approach 1:
The patent combines LADAR, LWIR, and visible light camera systems into an integrated multi-sensor platform. This merging of diverse sensing technologies provides complementary information that compensates for the limitations of individual sensors under varying environmental conditions, lighting, and target characteristics.
Solution Approach 2:
The patent creates a universal detection system that uses multiple sensing modalities capable of detecting humans under various conditions - different lighting scenarios, ranges, body positions, and environmental contexts. Each sensor type contributes to multiple detection functions, making the overall system adaptable to diverse operational requirements.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach effectively enhances human detection accuracy for both stationary and moving personnel, reducing false positives and improving system reliability, especially in dynamic environments.
Implementation Method 1
A LWIR image may be processed in a computer to identify areas of the image that correspond to thermal emission characteristics of a human being
Data Source
AI summary
A method and apparatus for determining human beings from terrain or man-made obstacles is provided. A long-wave infrared camera along with additional devices such as a color camera, two cameras in stereo configuration, and/or a LADAR scanner are used such that the physical scene captured in one image is the same from all of the devices. The images may be processed such that areas of interest representing characteristics of human beings are labeled likely human. The processing may include determining the physical size, range, and relative locations of the objects found in the images. The system, method and apparatus may be used in unmanned vehicles or autonomous machines, as a driving aid to a manned vehicle or system, or as part of a security system.