Image Anomaly Detection Using Geometric Relationship Knowledge Graphs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for anomaly or normality detection in digital images face challenges due to the scarcity of anomalous data for training, leading to inefficiencies in distinguishing between normal and abnormal geometric relationships of objects, particularly in applications like autonomous driving and manufacturing.
Innovation Solution
A method that integrates geometric relationships of objects with a knowledge graph and expert-defined rules to determine likelihood values, enhancing detection by incorporating semantic similarity and using classifiers to distinguish between normal and abnormal scenarios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional anomaly detection methods are used with limited anomalous data, then the detection system can be implemented with available data, but the accuracy of distinguishing normal from abnormal geometric relationships deteriorates
Solution Approach 1:
The patent introduces knowledge graphs as an intermediary component that mediates between limited anomalous data and the anomaly detection task. The knowledge graph stores pre-defined normal geometric relationships and contextual knowledge about object interactions, serving as a bridge that enhances detection accuracy without requiring large amounts of anomalous training data. This external knowledge source compensates for the scarcity of abnormal examples by providing rules for what constitutes normal behavior.
Solution Approach 2:
The system performs preliminary action by pre-populating the knowledge graph with normal geometric relationships and contextual knowledge before the actual anomaly detection process. This advance preparation of knowledge structures allows the system to efficiently compare observed geometric relationships against established norms, improving detection accuracy while minimizing the need for extensive anomalous data during training.
2Measurement precision
If geometric relationships with knowledge graphs and expert rules are integrated, then the accuracy of distinguishing normal from abnormal relationships is improved, but the system complexity increases
Solution Approach 1:
The patent segments the anomaly detection system into distinct functional modules: geometric relationship extraction from images, knowledge graph storage and querying, expert rule evaluation, and anomaly scoring. This segmentation allows each component to be developed and optimized independently, managing overall system complexity while achieving high detection accuracy through coordinated operation of specialized subsystems.
Solution Approach 2:
The knowledge graph serves multiple functions within the system: it stores normal geometric relationships, provides contextual knowledge about object interactions, and acts as a reference for evaluating anomalies. This multi-functionality reduces the need for separate specialized components, thereby managing complexity while maintaining high detection accuracy across different anomaly types.
3Reliability
If pairwise likelihood values for multiple object pairs are computed and aggregated, then the detection reliability is improved, but the computational time increases
Solution Approach 1:
The patent applies partial action by computing likelihood values selectively for the most relevant object pairs based on their geometric proximity and semantic relationships, rather than exhaustively evaluating all possible pairs. This approach maintains detection reliability by focusing computational resources on critical relationships while reducing overall computational time through intelligent sampling and prioritization.
Solution Approach 2:
The system employs self-service mechanisms by using the scene graph structure to automatically identify and prioritize object pairs that are most likely to contain anomalies based on their spatial and semantic relationships. This self-organizing approach reduces the need for external computational intervention and optimizes the evaluation sequence to minimize total processing time while maintaining reliability.
Data Source
AI summary
A device and a computer implemented method for processing a digital image for anomaly or normality detection. The method includes providing the digital image, determining, depending on the digital image, a geometric relationship between objects depicted in the digital image, providing knowledge about normal and/or abnormal geometric relationships between objects, determining, depending on the geometric relationship between the objects and the knowledge a likelihood indicating a normal or an abnormal geometric relation between objects in the digital image, and detecting an anomaly or a normality depending on the likelihood.


