Attitude Estimation Accuracy Degradation Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image classification methods for 3D attitude estimation in Space Situational Awareness (SSA) face challenges in accurately detecting degradation of estimation accuracy due to limited datasets covering all attitudes and lighting environments, leading to potential misjudgment of object states in space, which can result in missed important information.

Innovation Solution

An image processing device and method that estimates attitude parameters using a learned attitude estimation model, acquires a teacher image with the highest similarity to the target image, computes image similarity, and determines if it falls below a predetermined threshold to detect accuracy degradation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a dataset covering all attitudes and lighting environments is generated, then the accuracy of estimating the attitude is improved, but the cost of generating the dataset increases

Engineering Contradiction:
Improveaccuracy of estimating the attitudeVSAvoidcost of generating dataset
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent creates virtual images through computer graphics (CG) to copy real-world scenarios, allowing the generation of diverse training data without physically capturing each scenario. This enables comprehensive coverage of attitudes and lighting environments at lower cost while maintaining estimation accuracy.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent pre-generates a comprehensive dataset covering all possible attitudes and lighting environments before actual operation. This preliminary action ensures the model is trained on diverse data, improving accuracy while avoiding the need to generate data during operational phases.

Inventive Principle:
Principle #10Preliminary action

2Quantity of substance

If a dataset is used for only limited attitudes and lighting environments, then the cost of generating the dataset is reduced, but the accuracy of estimating the attitude decreases when unanticipated situations occur

Engineering Contradiction:
Improvecost of generating datasetVSAvoidaccuracy of estimating the attitude in unanticipated situations
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent creates a universal dataset that covers multiple attitudes, lighting environments, and object types. This multi-functional dataset enables the model to handle various unanticipated situations reliably while keeping generation costs manageable through efficient virtual image synthesis.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent systematically varies parameters such as lighting conditions, object attitudes, and camera angles in virtual image generation. By changing these parameters comprehensively, the dataset becomes robust to unanticipated situations while controlling generation costs through targeted parameter exploration.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If computer graphics (CG) is used to prepare data sets for various attitudes and lighting environments, then the cost of generating the dataset is reduced, but the accuracy of estimating the attitude may be decreased due to differences between CG and live-action images

Engineering Contradiction:
Improvecost of generating datasetVSAvoidaccuracy of estimating the attitude
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent uses CG-generated images as an intermediary to bridge the gap between controlled virtual environments and real-world applications. By carefully designing the CG rendering process to match real-world characteristics, the intermediary data maintains accuracy while reducing generation costs.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies different quality levels to different parts of the dataset generation process. Critical regions requiring high fidelity are rendered with greater detail, while less critical areas use optimized rendering, balancing accuracy and cost in the overall dataset.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20240296663A1Image processing device and image processing method
Publication Date: 2024.09.05 NEC CORP
  • US20240296663A1 patent drawing
  • US20240296663A1 patent drawing
  • US20240296663A1 patent drawing

AI summary

An estimation unit estimates attitude parameters, which are parameters representing an attitude of an object in a target image based on the target image, which is an image in which the object whose attitude is to be estimated has been taken, using an attitude estimation model learned using one or more teacher data including a teacher image, which is an image in which the object has been taken, and the attitude parameters of the object in the teacher image. An acquisition unit acquires a teacher image whose attitude similarity, which is a degree of similarity between the estimated attitude parameters and the attitude parameters related to the teacher image, is the largest among one or more teacher images included in the one or more teacher data. A first computation unit computes an image similarity, which is a degree of similarity between the target image and the acquired teacher image.