Modular Feature Extraction for VHR Imagery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing feature extraction techniques for very high resolution (VHR) remotely-sensed Earth imagery face challenges due to the random orientation of objects in images, which are not accounted for in previously proposed methods, making them unsuitable for analyzing VHR imagery.

Innovation Solution

A modular and decoupled architecture for feature extraction that includes various modules such as fractal dimension, total variational, rotationally invariant histogram of gradients, Gabor wavelet, and clustering histogram modules, which can analyze VHR imagery without assuming fixed orientations, using a common interface format for interoperability and hierarchical feature extraction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional feature extraction techniques are used, then processing speed may be maintained, but they fail to accurately analyze objects with random orientations in VHR imagery

Engineering Contradiction:
Improvefeature extraction accuracyVSAvoidadaptability to random orientations
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system dynamically adjusts the orientation of analysis windows to match the orientation of detected edges in the image. Instead of using fixed-oriented windows, the method rotates analysis windows to align with edge orientations, enabling accurate feature extraction for objects at any orientation. This dynamic adaptation resolves the contradiction by making the system flexible to random orientations while maintaining extraction accuracy.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If a modular architecture with multiple feature extraction modules is implemented, then versatility and adaptability improve, but system complexity increases

Engineering Contradiction:
Improveversatility in feature extractionVSAvoidsystem architecture complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the feature extraction process into multiple independent modules, each responsible for extracting specific types of features (e.g., fractal dimension, total variability, rotationally invariant histogram of gradients, Gabor wavelet, clustering histogram). Each module can be independently developed, tested, and configured. This segmentation enables versatility while managing complexity through modular design, as each module handles a specific aspect of feature extraction without requiring the entire system to be redesigned.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The modular architecture implements a universal interface that allows different feature extraction modules to work together through standardized communication protocols. The system uses a common data structure and interface format that enables any module to process any image data, making the system universally applicable to various VHR imagery types and analysis tasks. This universality achieves versatility without proportionally increasing complexity, as the interface standardization creates efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If hierarchical feature extraction is implemented, then comprehensive feature analysis is achieved, but processing time increases

Engineering Contradiction:
Improvecomprehensive feature analysisVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary feature extraction at multiple hierarchical levels simultaneously rather than sequentially. Base-level features (edge orientations, basic textures) are extracted first and made available for higher-level analysis. The system prepares and caches intermediate results at each hierarchical level, so that when comprehensive feature analysis is needed, the results are already partially computed. This preliminary action reduces the time penalty of hierarchical extraction by pre-computing and storing intermediate features.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3044758B1Automated and scalable object and feature extraction from imagery
Publication Date: 2018.07.11 DIGITALGLOBE INC
  • EP3044758B1 patent drawingFigure 1
  • EP3044758B1 patent drawingFigure 2
  • EP3044758B1 patent drawingFigure 3

AI summary

Feature extraction of image data using feature extraction modules. The feature extraction modules may be provided in an architecture that allows for modular, decoupled generation and/or operation of the feature extraction modules to generate feature data corresponding to image data. In this regard, the feature extraction modules may communicate with a file system storing image data and feature data by way of a common interface format. Accordingly, regardless of the nature of the execution of the feature extraction module, each feature extraction module may be communicative by way of the common interface format, thereby providing a modular approach that is highly scalable, flexible, and adaptive.