Panoramic Staring Sensor Radar Integration for Real-Time Target Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current surveillance systems with radar and single movable cameras are reactive, leading to delays in target detection and increased risk of missing targets, especially when multiple radar hits occur simultaneously, as they require manual slewing to reposition the camera, which can result in targets escaping detection.

Innovation Solution

A system integrating radar with a panoramic staring sensor that continuously captures and processes a wide field-of-view using multiple cameras, allowing for simultaneous detection and tracking of targets with cognitive processing modules to identify anomalies and assign scores, enabling real-time monitoring and analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single movable camera is used with radar for surveillance, then the system complexity is reduced, but the response time increases and targets may be missed due to manual slewing delays

Engineering Contradiction:
Improvesystem complexityVSAvoidresponse time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The surveillance system is segmented into multiple independent camera units arranged in a panoramic configuration, each capable of independently capturing video data from its specific field of view. This segmentation eliminates the need for manual slewing of a single camera, as multiple cameras simultaneously monitor different sectors, thereby reducing response time while maintaining manageable system complexity through modular architecture

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from a single-point observation model to a distributed multi-point observation model by arranging cameras in a panoramic array. This dimensional change from one camera to multiple cameras spatially distributed across different angles enables simultaneous coverage of multiple areas, eliminating the time delay associated with mechanical slewing while the modular nature keeps complexity controlled

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If manual slewing is used to reposition the camera to radar hits, then the device complexity is reduced, but the productivity decreases when multiple radar hits occur simultaneously

Engineering Contradiction:
Improvedevice complexityVSAvoidtarget detection throughput
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The surveillance system is segmented into multiple independent camera units arranged in a panoramic configuration, each capable of independently capturing video data from its specific field of view. This segmentation eliminates the need for manual slewing of a single camera, as multiple cameras simultaneously monitor different sectors, thereby reducing response time while maintaining manageable system complexity through modular architecture

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements automated association between radar hits and video clips through electronic processing. The controller automatically receives radar hit data, identifies corresponding video clips from the appropriate cameras, and presents them to the operator without manual intervention. This self-service automation significantly increases productivity when multiple radar hits occur simultaneously, while the straightforward electronic association mechanism keeps device complexity manageable

Inventive Principle:
Principle #25Self-service

3Area of stationary object

If a panoramic staring sensor with multiple cameras is used, then the coverage area increases, but the device complexity increases

Engineering Contradiction:
Improvefield-of-view coverageVSAvoidsensor system complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The panoramic staring sensor is segmented into multiple discrete camera units, each with a defined field of view. This segmentation allows the system to achieve wide-area coverage through spatial distribution of simpler camera components rather than using a single complex sensor, thereby increasing coverage area while managing device complexity through modular, standardized units

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple identical camera units are used to provide both wide panoramic coverage and the capability to focus on specific regions of interest. Each camera serves multiple functions: general area surveillance, targeted monitoring of radar hits, and providing video clips for analysis. This multi-functionality increases effective coverage area while keeping individual camera units simple and standardized

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively detects and tracks multiple targets in real-time across a wide field-of-view, reducing the risk of missing targets and improving response times by continuously monitoring the entire panorama, thereby enhancing surveillance capabilities.

Implementation Method 1

The field-of-view of the scene is scanned with a radar sensor to detect an object of interest

Methodology Applied
Scientific EffectRadar: Radar

Data Source

PatentUS9778351B1System for surveillance by integrating radar with a panoramic staring sensor
Publication Date: 2017.10.03 HRL LAB
  • US9778351B1 patent drawing
  • US9778351B1 patent drawing
  • US9778351B1 patent drawing

AI summary

Described is system for surveillance that integrates radar with a panoramic staring sensor. The system captures image frames of a field-of-view of a scene using a multi-camera panoramic staring sensor. The field-of-view is scanned with a radar sensor to detect an object of interest. A radar detection is received when the radar sensor detects the object of interest. A radar message indicating the presence of the object of interest is generated. Each image frame is marked with a timestamp. The image frames are stored in a frame storage database. The set of radar-based coordinates from the radar message is converted into a set of multi-camera panoramic sensor coordinates. A video clip comprising a sequence of image frames corresponding in time to the radar message is created. Finally, the video clip is displayed, showing the object of interest.