Supra-Hemispheric Vision System for Panoramic Surveillance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current surveillance systems for vehicles and platforms face limitations in providing complete environmental coverage, resolution, and real-time perception, especially in urban environments, with blind spots, insufficient angular resolution, and limited day-night vision capabilities.

Innovation Solution

A video optronic system with supra-hemispherical optics and a multi-megapixel matrix detector that offers adjustable sensitivity, real-time image processing, and adaptive dynamic range, enabling comprehensive day and night vision with high resolution and fast frame rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a network of several cameras is used to cover the panorama, then the field of view is improved, but the device complexity and video stream management difficulty increase

Engineering Contradiction:
Improvefield of viewVSAvoidvideo stream management
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent merges multiple camera views into a single integrated panoramic image using a fish-eye lens system. Instead of managing multiple separate video streams from different cameras, the system uses one camera with wide-angle optics to capture the entire panorama, then processes and merges the image data computationally to provide complete 360-degree coverage.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system creates a virtual panoramic representation by capturing images with a fish-eye lens and applying computational algorithms to reconstruct the complete panorama. This virtual copying approach replaces the physical need for multiple cameras while maintaining comprehensive field of view.

Inventive Principle:
Principle #26Copying

2Area of stationary object

If a bar sensor sweeping the scene at 360° is used, then the field of view is improved, but the frame rate decreases to 1-10Hz

Engineering Contradiction:
Improvefield of viewVSAvoidframe rate
Core Design Contradiction:
Area of stationary objectVSProductivity

Solution Approach 1:

The system captures the complete panoramic scene in a single exposure using a fish-eye lens, rather than sweeping the sensor across the scene over time. This preliminary capture of the entire field of view at once enables high frame rates while maintaining 360-degree coverage, eliminating the trade-off between field of view and frame rate.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If a camera with 2000x2000 pixels is used, then the resolution is improved, but the data processing load and memory requirements increase

Engineering Contradiction:
ImproveresolutionVSAvoiddata processing
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies different processing qualities to different regions of the panoramic image based on their importance. High-resolution processing is applied to regions where threats are likely to be detected, while lower processing intensity is applied to less critical areas. This localized approach maintains high resolution where needed while reducing overall processing burden.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts the processing intensity and resolution based on the captured image content and operational requirements. When no threats are detected, processing can be reduced; when potential threats are identified, processing intensity increases to provide higher resolution analysis of specific regions.

Inventive Principle:
Principle #15Dynamics

4Illumination intensity

If visible or near-infrared cameras are used, then daytime vision is improved, but night vision capability is insufficient

Engineering Contradiction:
Improvedaytime visionVSAvoidday-night vision
Core Design Contradiction:
Illumination intensityVSAdaptability or versatility

Solution Approach 1:

The system uses a single camera sensor that is capable of operating across multiple illumination conditions - visible light during daytime and thermal infrared at night. This multi-functional sensor allows the same hardware to provide both daytime and night vision capabilities, eliminating the need for separate optical systems for different lighting conditions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides real-time, high-resolution, panoramic vision day and night, effectively detecting threats at various distances and positions, enhancing crew protection and situational awareness without the need for the operator to leave the platform.

Implementation Method 1

a sensor (10) with supra-hemispherical optics and a matrix detector located in the focal plane of the optics

Methodology Applied
Scientific EffectOptical focusing: Focusing

Implementation Method 2

a matrix detector located in the focal plane of the optics... the matrix detector is at video rate and comprises: i. L rows×C columns of pixels

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentEP2616864B1Optronic supra hemispheric vision system
Publication Date: 2017.04.19 THALES SA
  • EP2616864B1 patent drawingFigure 1

AI summary

The invention relates to a video optoelectronic system (100) including a sensor (10) having a super-hemispheric optical unit and a matrix detector, a unit (20) for processing the captured images, and means (30) for displaying the processed images. The matrix detector operates at a video frame rate and includes: i) LxC pixels, where L and C > 2000, each pixel being a correlated double-sampling pixel and capable of providing a charge/voltage conversion; and ii) 2 C analog-to-digital conversion elements (or ADC) arranged in parallel, each element comprising a first ADC having a low output and a high gain, and a second ADC having a high output and a low gain, wherein the optical unit has a focal distance that is controlled on the basis of the site angle, the focal distance being the longest distance in the equatorial plane, and has a digital aperture of between 0.9 and 1.6, and the processing unit includes: i) a means for correcting non-uniformities; ii) a means for the weighted summation of a plurality of adjacent pixels; and iii) a means for adjusting and compressing the captured image.