In-Vehicle Camera Calibration via Road Surface Feature Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for calibrating in-vehicle cameras struggle to accurately distinguish feature points on the road surface from those on surrounding structures, leading to misalignment issues, especially for side cameras with varying pitch angles and feature points of different heights, which complicates precise calibration.

Innovation Solution

A calibration apparatus and method that estimates the road surface range using feature points from non-target cameras and filters out feature points of different heights from the calibration target camera's images, ensuring only road surface points are used for calibration, employing a system with feature point detection, tracking, height calculation, road surface range estimation, and sorting units.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If feature points from surrounding structures (walls, guard rails, houses) are used for calibration, then the quantity of feature points increases, but calibration accuracy deteriorates due to misalignment

Engineering Contradiction:
Improvequantity of feature pointsVSAvoidcalibration accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent extracts and selects only feature points that exist on the road surface from the plurality of feature points detected in the camera image. This is achieved by determining the road surface range and filtering feature points based on their spatial relationship with the estimated road surface, thereby eliminating feature points from surrounding structures that would cause calibration errors.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different selection criteria to different spatial regions by estimating the road surface range and determining whether each feature point lies within this range. This local quality approach ensures that only feature points with appropriate geometric properties (those on the road surface) are used for calibration, while excluding feature points from structures at different heights or positions.

Inventive Principle:
Principle #3Local quality

2Quantity of substance

If feature points of different heights are used for calibration, then the quantity of feature points increases, but calibration reliability deteriorates due to pitch angle misalignment ambiguity

Engineering Contradiction:
Improvequantity of feature pointsVSAvoidcalibration reliability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent extracts only feature points that lie on the road surface by determining the road surface range and filtering the plurality of feature points accordingly. This extraction process eliminates feature points of different heights from surrounding structures, resolving the ambiguity between pitch angle misalignment and height variations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the selection parameter from simply detecting any feature point to detecting feature points with specific spatial characteristics (those on the road surface). By estimating the road surface range and using it as a filtering criterion, the system changes the quality parameter of selected feature points from generic to specifically road-surface-based, thereby improving reliability.

Inventive Principle:
Principle #35Parameter changes

3Ease of manufacture

If conventional calibration method mounting camera at vehicle is used, then calibration can be performed with simple equipment, but workload increases and cannot handle load-induced parameter changes

Engineering Contradiction:
Improvecalibration process simplicityVSAvoidcalibration efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent enables the calibration system to automatically identify and select appropriate feature points on the road surface without requiring manual intervention or specialized measurement equipment. The system uses the camera's own images and automatically estimates the road surface range to perform calibration, making the process self-sufficient and adaptable to different vehicle load conditions.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11373333B2Calibration apparatus and method for in-vehicle camera
Publication Date: 2022.06.28 FAURECIA CLARION ELECTRONICS CO LTD
  • US11373333B2 patent drawing
  • US11373333B2 patent drawing
  • US11373333B2 patent drawing

AI summary

There are provided a calibration apparatus and method capable of obtaining a high-precision calibration result by taking out only feature points on a road surface from images captured by an in-vehicle camera which is a calibration target. A road surface range is estimated by using feature points appearing in an image(s) captured by a camera (a front camera 102 or a rear camera 103) that is not a camera on which the calibration is executed (a side camera 106); and the calibration is executed by using only feature points existing within the estimated road surface range from among the feature points appearing in an image(s) captured by the camera on which the calibration is executed.