Machine Learning Camera Calibration Saddle Point Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital imaging devices in automotive applications require efficient and reliable camera calibration methods to accurately determine pre-determined points in images, especially under varying light conditions and distortions.

Innovation Solution

A computer-implemented method using a machine-learning approach, specifically training a series of machine-learning methods to identify pre-determined points in images, including a first phase for existence prediction, a second phase for position estimation, and a third phase using adversarial-like training to minimize false positives.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a machine-learning method is trained to determine pre-determined points in an image, then the accuracy of camera calibration is improved, but the complexity of the training process increases

Engineering Contradiction:
Improveaccuracy of pre-determined point detectionVSAvoidcomplexity of training process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The training process is segmented into three distinct phases: Phase 1 trains the network to detect presence/absence of pre-determined points using binary labels; Phase 2 refines position estimation using coordinate labels; Phase 3 applies adversarial training with modified images to improve robustness. This segmentation allows the complex training to be broken down into manageable stages, each building on the previous phase while progressively improving detection accuracy.

Inventive Principle:
Principle #1Segmentation

2Reliability

If adversarial-like training with modified images is used, then the reliability of detection under diverse conditions is improved, but the training time and computational resources increase

Engineering Contradiction:
Improvedetection reliability under diverse light conditions and distortionsVSAvoidtraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

Adversarial training is performed as a preliminary action in Phase 3, where images are pre-modified with various distortions, rotations, and lighting changes before training. This preliminary exposure to diverse conditions prepares the network to handle real-world variations more effectively, improving reliability while managing training time by structuring the adversarial training as a dedicated phase rather than continuous refinement.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If multiple phases of training are implemented, then the quality of camera calibration is improved, but the execution time increases

Engineering Contradiction:
Improvequality of camera calibrationVSAvoidexecution time
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The three-phase training approach maintains continuity of useful action by ensuring each phase builds directly on the previous phase's results. Phase 1 establishes basic detection capability, Phase 2 refines position accuracy, and Phase 3 enhances robustness - each phase's output becomes the input for the next, creating a continuous improvement trajectory that optimizes calibration quality while managing execution time through progressive refinement rather than repeated full training cycles.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12211233B2Methods and systems for training a machine learning method for determining pre-determined points in an image
Publication Date: 2025.01.28 APTIV TECHNOLOGIES AG
  • US12211233B2 patent drawing
  • US12211233B2 patent drawing
  • US12211233B2 patent drawing

AI summary

Disclosed are computer systems and computer-implemented methods for training a machine-learning method for determining pre-determined points in an image. The method includes training a first machine-learning method based on training data indicating whether or not a pre-determined point is present in a cell of the image; training a second machine-learning method based on a position of pre-determined points in the cell and based on training of the first machine-learning method; and training a third machine-learning method based on a modified version of the image and based on training of the second machine-learning method. Also disclosed are methods and computer systems implementing the trained machine-learning method.