Machine Learning Ground Control Point Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional methods for determining ground control points are labor-intensive and do not scale well, requiring manual efforts and significant resources, which limits their accuracy and update frequency, especially in applications like autonomous driving that demand centimeter-level map data.

Innovation Solution

A computer-implemented method using machine learning to automatically identify ground control points from image data by selecting features that meet specific properties, training a machine learning model with labeled ground truth images, and predicting pixel locations in input images, enabling scalable and accurate ground control point determination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual ground surveyors are deployed to determine ground control points, then measurement precision can be maintained, but productivity is significantly reduced and the process does not scale well

Engineering Contradiction:
Improveground control point accuracyVSAvoidground control point determination rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces the mechanical manual surveying system with an automated computer vision system using machine learning models. The system processes satellite or aerial images to automatically identify and classify ground control points, eliminating the need for physical deployment of surveyors while maintaining measurement precision through algorithmic detection and classification.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a digital copy of the ground surveying process through machine learning models trained on labeled image data. The models learn from annotated training images containing ground truth labels and replicate the surveyor's ability to identify ground control points, enabling automated processing of large numbers of images without additional manual resources.

Inventive Principle:
Principle #26Copying

2Quantity of substance

If manual resources are limited, then resource allocation is optimized, but the ability to update and maintain ground control points deteriorates

Engineering Contradiction:
Improvemanual resource availabilityVSAvoidground control point update frequency
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent implements a self-service system where the machine learning model automatically processes images, identifies ground control points, and updates digital maps without requiring continuous manual intervention. Once trained, the system can independently process new images and generate updates, maintaining reliability and update frequency while minimizing ongoing manual resource requirements.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent performs preliminary training of machine learning models using extensively labeled ground truth images before deployment. This preliminary action creates a robust model that can handle various scenarios, reducing the need for frequent manual retraining or adjustments and ensuring reliable performance with limited ongoing manual resources.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If traditional manual methods are used, then implementation simplicity is maintained, but adaptability to high-definition map requirements deteriorates

Engineering Contradiction:
Improvesystem implementation complexityVSAvoidcapability to meet centimeter-level accuracy demands
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent segments the ground control point determination process into distinct automated stages: image acquisition, preprocessing, machine learning inference, and result validation. This segmentation allows each stage to be optimized independently while maintaining overall system manageability, enabling the system to meet high-definition map requirements without overwhelming complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal machine learning system that can process various types of images (satellite, aerial, drone) and identify multiple types of ground control points (road intersections, building corners, landmarks). This multi-functional capability allows the system to adapt to different high-definition map requirements while using a single integrated platform.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11182607B2Method, apparatus, and system for determining a ground control point from image data using machine learning
Publication Date: 2021.11.23 HERE GLOBAL BV
  • US11182607B2 patent drawing
  • US11182607B2 patent drawing
  • US11182607B2 patent drawing

AI summary

An approach is provided for determining a ground control point from image data using machine learning. The approach, for example, involves selecting an feature based determining that the feature meets one or more properties for classification as a machine learnable feature. The approach also involves retrieving a plurality of ground truth images depicting the feature. The plurality of ground truth images is labeled with known pixel location data of the feature as respectively depicted in each of the plurality of ground truth images. The approach further involves training a machine learning model using the plurality of ground truth images to identify predicted pixel location data of the ground control point as depicted in an input image.