Video Satellite Dim Object Detection via Discriminant Feature Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for detecting dim and small objects in video satellite data face challenges due to differences in shooting angles, observation angles, sensor platforms, spatial resolutions, and imaging methods compared to ground video data, leading to inefficiencies in feature extraction and object detection.

Innovation Solution

A method involving image block segmentation, VGG16 backbone network processing, symmetric semantic segmentation, autoencoder networks, attention mechanisms, and multi-scale semantic analysis to extract and enhance discriminant features for improved object detection in video satellite data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If two-stage algorithm is used to detect dim and small objects, then detection accuracy is improved, but detection speed deteriorates due to computing time required to generate candidate regions

Engineering Contradiction:
Improvedetection accuracyVSAvoiddetection speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-processing video satellite data through background subtraction and frame difference methods before applying deep learning detection. This preliminary processing reduces the complexity of the detection task and prepares the data in advance, allowing the two-stage algorithm to operate more efficiently on pre-processed candidate regions rather than raw data.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the detection process into multiple stages: first using traditional image processing (background subtraction, frame difference) to identify potential regions, then applying deep learning algorithms specifically to these segmented regions. This segmentation allows the complex two-stage algorithm to focus computational resources only on relevant areas, improving both accuracy and speed.

Inventive Principle:
Principle #1Segmentation

2Productivity

If one-stage algorithm is used to detect dim and small objects, then detection speed is improved, but detection accuracy deteriorates due to grid framework restrictions

Engineering Contradiction:
Improvedetection speedVSAvoiddetection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by using traditional image processing methods (background subtraction, frame difference) to pre-identify potential object regions before applying the one-stage deep learning algorithm. This preliminary processing creates a more favorable input for the one-stage algorithm, compensating for its grid framework limitations and improving detection accuracy without sacrificing speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the detection process by first identifying candidate regions through traditional methods, then applying the one-stage algorithm specifically to these segmented regions. This segmentation allows the one-stage algorithm to operate on reduced, more relevant data, improving accuracy while maintaining the speed advantage of the one-stage approach.

Inventive Principle:
Principle #1Segmentation

3Device complexity

If conventional feature extraction algorithms are used for video satellite data, then detection process is simplified, but detection accuracy deteriorates due to poor generalization ability and dependency on manual settings

Engineering Contradiction:
Improveprocess complexityVSAvoiddetection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent replaces manual feature extraction algorithms with deep learning-based automatic feature extraction. Instead of relying on manually designed features (Haar, SIFT, HOG) that require rational manual settings and have poor generalization, the patent uses convolutional neural networks to automatically learn and extract features directly from video satellite data, improving detection accuracy while reducing dependency on manual configuration.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent applies self-service by enabling the deep learning model to automatically learn and extract features from the data itself without human intervention in feature design. The model self-adjusts its feature extraction process through training on labeled data, eliminating the need for manual setting and improving generalization ability across different detection scenarios.

Inventive Principle:
Principle #25Self-service

4Adaptability or versatility

If ground video data detection methods are applied to video satellite data, then existing algorithms can be reused, but detection accuracy deteriorates due to differences in shooting angles, observation angles, spatial resolutions, and imaging methods

Engineering Contradiction:
Improvealgorithm reusabilityVSAvoiddetection accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent applies parameter changes by training the deep learning model specifically on video satellite data with its unique characteristics (shooting angles, observation angles, spatial resolutions, imaging methods). The model learns to adapt to these specific parameters through training, transforming it from a generic ground video detection algorithm into a specialized satellite video detection system that maintains high accuracy for satellite-specific data characteristics.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent achieves universality by using a deep learning framework that can be trained on video satellite data and then applied to detect various types of dim and small objects in satellite video. The model learns general detection capabilities that work across different object types and scenarios in satellite video, making the system universally applicable to satellite video detection tasks while adapting to satellite-specific characteristics.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11315345B2Method for dim and small object detection based on discriminant feature of video satellite data
Publication Date: 2022.04.26 BEIJING UNIV OF CIVIL ENG & ARCHITECTURE
  • US11315345B2 patent drawing
  • US11315345B2 patent drawing
  • US11315345B2 patent drawing

AI summary

A method for detecting a dim and small object based on a discriminant feature of video satellite data is provided. The method makes full use of the discriminant feature to improve detection accuracy of the dim and small object. A symmetric semantic segmentation model and an autoencoder model are used to extract the discriminant feature of an object. A top-down adjustment mechanism is used to fuse an image feature and the discriminant feature of the object. Then an attention mechanism is used to enhance a background to further increase contrast between the object and the background. A multi-scale semantic analysis strategy is introduced, and a pyramid model is used to extract the dim and small object in the video satellite data.