Road Sign Knowledge Graph Deduplication via Visual Attribute Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current road sign recognition systems face challenges in managing and maintaining a universal dataset of diverse road signs across different countries, leading to redundancy and inefficiency, as existing solutions lack a comprehensive and scalable method for annotating and categorizing the vast number of road sign images.

Innovation Solution

A system and method for constructing a road sign knowledge graph that utilizes machine learning and human feedback to maintain a unique database of road sign templates, incorporating visual attributes and annotations, and prevents redundancy by using a visual attribute recognition model to compare new sign templates with existing ones, with human validation for accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a large dataset of annotated road sign images is collected to train a universal machine classifier, then the recognition accuracy across multiple countries is improved, but the time and resources required for data management and annotation increase significantly

Engineering Contradiction:
Improverecognition accuracyVSAvoiddata management time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-defining a structured knowledge graph with road sign templates, visual attributes, and hierarchical categories before actual annotation begins. This framework is prepared in advance to guide the annotation process, reducing the time needed for data management and annotation while maintaining high recognition accuracy across multiple countries.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms where the knowledge graph is continuously updated and refined based on annotated data. The structured framework provides feedback loops that allow the system to learn from annotations and improve its classification capabilities, thereby maintaining high accuracy while reducing the time required for ongoing data management.

Inventive Principle:
Principle #23Feedback

2Quantity of substance

If all unlabeled videos and images are manually reviewed to select data with rare signs, then the completeness of the dataset is improved, but the productivity of data management decreases

Engineering Contradiction:
Improvedataset completenessVSAvoiddata management efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The system segments the data selection process by using the predefined knowledge graph structure to automatically categorize and filter road sign images. Instead of manually reviewing all images, the system divides the task into structured categories (sign types, visual attributes, countries), allowing automated processing to identify rare signs efficiently while maintaining dataset completeness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The knowledge graph acts as an intermediary between raw unlabeled data and the final annotated dataset. It provides a structured framework that mediates the selection process, enabling automated systems to identify and select rare signs based on predefined categories and attributes, thereby improving productivity without sacrificing dataset completeness.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If a comprehensive knowledge graph includes all possible road sign variants from different countries, then the versatility of the recognition system is improved, but the complexity of maintaining the knowledge graph increases

Engineering Contradiction:
Improvecross-country recognition capabilityVSAvoidknowledge graph maintenance complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system applies local quality by organizing the knowledge graph with country-specific and region-specific variations nested within a universal structure. Each country or region can have its own specific sign variants and attributes while maintaining compatibility with the overall framework. This allows the system to accommodate diverse road sign conventions without creating a monolithic complex structure, as each local variation is managed independently within its own context.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The knowledge graph is designed with universal structures and common categories that can accommodate multiple countries and conventions. By establishing a unified framework with standardized attributes and hierarchical organization, the system achieves multi-functionality where the same structure serves multiple purposes across different regions, reducing maintenance complexity while maintaining versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Ease of manufacture

If redundant road sign templates are allowed in the knowledge graph, then the ease of adding new data is improved, but the quality and efficiency of machine learning training decreases

Engineering Contradiction:
Improvedata addition easeVSAvoidtraining data quality
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The system performs preliminary actions by establishing a deduplication mechanism based on visual attribute comparison before data is added to the knowledge graph. The predefined attributes and structured framework enable automatic detection of redundant templates during the data ingestion process, ensuring high training data quality from the outset while maintaining ease of data addition through automated verification.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback loops that continuously monitor and compare new road sign templates against existing ones using visual attribute recognition. When potential duplicates are detected, the system provides feedback to prevent addition, thereby maintaining data quality. This automated feedback mechanism ensures high training data quality while keeping the data addition process efficient and user-friendly.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11978264B2Scalable road sign knowledge graph construction with machine learning and human in the loop
Publication Date: 2024.05.07 ROBERT BOSCH GMBH
  • US11978264B2 patent drawing
  • US11978264B2 patent drawing
  • US11978264B2 patent drawing

AI summary

Systems and methods for constructing and managing a unique road sign knowledge graph across various countries and regions is disclosed. The system utilizes machine learning methods to assist humans when comparing a new sign template with a plurality of stored sign templates to reduce or eliminate redundancy in the road sign knowledge graph. Such a machine learning method and system is also used in providing visual attributes of road signs such as sign shapes, colors, symbols, and the like. If the machine learning determines that the input road sign template is not found in the road sign knowledge graph, the input sign template can be added to the road sign knowledge graph. The road sign knowledge graph can be maintained to add signs templates that are not already in the knowledge graph but are found in real-world by integrating human annotator's feedback during ground truth generation for machine learning.