Multi-Figure Object Recognition System for SAR Data Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current remote sensing systems face limitations in object recognition due to the unmanageable number of matching libraries required for varying sensor-object interaction conditions, especially in SAR imaging, and struggle with geospatial registration accuracy, which hinders effective data fusion and object extraction.

Innovation Solution

A real-time system that integrates sensor data with human perception capabilities by creating a multi-tone image space for figure-ground recognition, allowing flexible feature extraction and visualization, and enables geospatial registration without prior data registration, using a feature signature library and dynamic GCP/image matching to unify coordinate systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple polarization modes and aspect angles are used to improve SAR sensing capability, then the object recognition capability is improved, but the number of matching libraries required becomes unmanageable

Engineering Contradiction:
Improveobject recognition capabilityVSAvoidnumber of matching libraries
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple SAR images acquired under different polarization modes and aspect angles into a unified multi-faceted figure ground structure. Instead of maintaining separate matching libraries for each sensing condition, the system merges the information from multiple images to create a comprehensive object representation that captures various interaction conditions simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The figure ground structure serves multiple functions: it represents objects under varying SAR-object interaction conditions, provides a unified framework for matching across different sensing scenarios, and enables flexible extraction of object features regardless of the specific polarization or aspect angle used during acquisition.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If geospatial registration is performed with high precision, then data fusion accuracy is improved, but the requirement for prior data registration increases system complexity

Engineering Contradiction:
Improvegeospatial registration accuracyVSAvoidprior data registration requirement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary geospatial registration by incorporating geospatial information during the feature extraction and matching process, rather than requiring complete pre-registration of all data. This allows the system to handle unregistered or partially registered data while still achieving accurate geospatial alignment through the multi-faceted figure ground structure.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If the number of spectral bands is increased to improve sensor capability, then object discrimination capability is improved, but the data processing complexity increases

Engineering Contradiction:
Improveobject discrimination capabilityVSAvoiddata processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system extracts the most relevant features from multi-spectral SAR data by creating a multi-faceted figure ground structure that identifies and separates key object characteristics. This extraction process filters out redundant spectral information while retaining the essential features needed for object discrimination, reducing processing complexity while maintaining discrimination capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS8369622B1Multi-figure system for object feature extraction tracking and recognition
Publication Date: 2013.02.05 HSU SHIN YI
  • US8369622B1 patent drawing
  • US8369622B1 patent drawing
  • US8369622B1 patent drawing

AI summary

The invention features a system wherein a recognition environment utilizes comparative advantages of automated feature signature analysis and human perception to form a synergistic data and information processing system for scene structure modeling and testing, object extraction, object linking, and event/activity detection using multi-source sensor data and imagery in both static and time-varying formats. The scene structure and modeling and testing utilizes quantifiable and implementable human language key words. The invention implements real-time terrain categorization and situational awareness plus a dynamic ground control point selection and evaluation system in a Virtual Transverse Mercator (VTM) geogridded Equi-Distance system (ES) environment. The system can be applied to video imagery to define and detect objects/features, events and activity. By adapting the video imagery analysis technology to multi-source data, the invention performs multi-source data fusion without registering them using geospatial ground control points.