Pattern-Based Camera–Lidar Calibration for Unsynchronized Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional Simultaneous Localization and Mapping (SLAM) systems for autonomous vehicles face significant operational complexity, leading to prolonged localization and mapping times due to sensors not being synchronized and installed at the same position, which hinders efficient data collection and analysis for high-definition road maps.

Innovation Solution

A calibration method for cameras and lidars using a calibration board with specific patterns, enabling feature point identification and calibration through data generators, allowing for precise alignment of sensor data within a single frame, reducing calibration time and enhancing accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional SLAM systems are used for calibration, then sensor data can be processed, but the operational complexity increases and calibration time is prolonged

Engineering Contradiction:
Improvecalibration accuracyVSAvoidcalibration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by using a pre-designed calibration board with known geometric patterns and dimensions. The calibration board is prepared in advance with specific marker patterns that enable automatic feature detection. This pre-prepared reference structure eliminates the need for complex real-time calculations during calibration, significantly reducing calibration time while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The calibration board serves as an intermediary object between the camera and lidar sensors. It provides a common reference framework that mediates the calibration process by offering known geometric features that can be detected by both sensors. This intermediary reference eliminates the need for direct complex coordination between sensors, simplifying the calibration operations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If sensors are not synchronized and installed at the same position, then system flexibility is improved, but calibration complexity increases

Engineering Contradiction:
Improvesensor installation flexibilityVSAvoidcalibration system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The calibration board enables self-service calibration by providing automatic feature detection and geometric relationship computation. The system automatically detects features on the calibration board from both camera and lidar data, computes the geometric relationships, and performs calibration without requiring manual intervention or complex synchronized operations. This self-service approach maintains installation flexibility while reducing calibration complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces complex mechanical synchronization systems with a computational geometry-based approach. Instead of requiring physical synchronization mechanisms or precise mechanical alignment, the system uses geometric pattern recognition and mathematical computations to establish relationships between sensors. This substitution maintains installation flexibility while dramatically reducing system complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If complex operations are performed for localization and mapping, then mapping accuracy is improved, but processing time increases

Engineering Contradiction:
Improvemapping accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts the essential calibration information from the complex SLAM processing by focusing solely on the geometric relationships provided by the calibration board. It separates the calibration task from the full SLAM pipeline, extracting only the necessary geometric data needed for sensor calibration. This extraction approach maintains mapping accuracy requirements while significantly reducing processing time by eliminating unnecessary complex operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12422535B2Method for calibration of camera and lidar, and computer program recorded on recording medium for executing method therefor
Publication Date: 2025.09.23 MOBILTECH
  • US12422535B2 patent drawing
  • US12422535B2 patent drawing
  • US12422535B2 patent drawing

AI summary

Proposed is a calibration method for a camera and a lidar using a calibration board having a specific pattern. The method may include extracting one frame for an image captured by a camera and point cloud data acquired by a lidar, by a data generator, identifying a feature point for a calibration board included in one extracted frame for the image and the lidar, by the data generator, and performing calibration for the camera and the lidar based on the identified feature point, by the data generator. The present method is a technology developed with support from the Ministry of Trade, Industry and Energy/Korea Planning and Evaluation Institute of Industrial Technology (Project No. 20022003/Project name-Automotive industry technology development project/Project name-Development of industrial autonomous driving and safety assurance technology based on longitudinal and lateral interconnection).