Curb Detection Using Template Matching for Driver Assistance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing driver assistance systems in motor vehicles assess curb criticality solely based on height, failing to account for the varying hazards posed by different types of curbs, leading to inadequate warnings or interventions.

Innovation Solution

A driver assistance system with a control device that classifies detected curbs by comparing images with stored comparison images of different curb types, using image analysis to determine the specific type and assess criticality based on geometry and texture, incorporating curb height and tire cross-section information for differentiated decision-making.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If curb assessment is based solely on height, then the assessment process is simple, but the accuracy of criticality determination is insufficient

Engineering Contradiction:
Improvecurb criticality assessment accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Comparison images of different curb types are stored in advance in the control device's memory. During operation, the system performs template matching by comparing captured images with these pre-stored comparison images, enabling rapid classification without complex real-time analysis of curb geometry and texture features.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates and stores standardized comparison images (templates) representing different curb types in advance. These copied reference images are then used for matching against actual curb images, simplifying the classification process while improving assessment accuracy beyond simple height measurement.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If all curbs of the same height are treated equally, then the decision-making process is straightforward, but the differentiation of actual hazard levels is lost

Engineering Contradiction:
Improvecurb type differentiation capabilityVSAvoidclassification system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system analyzes local geometric and textural properties of curbs by comparing specific regions in captured images with corresponding regions in comparison images. This enables differentiation of curb types (e.g., sharp-edged granite vs. rounded concrete) based on their unique local characteristics rather than treating all curbs of the same height uniformly.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Different curb types are represented by pre-stored comparison images that capture their distinctive geometric and textural features. The control device selects and compares against the appropriate comparison image based on the detected curb type, enabling adapted response strategies for different curb categories.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If comprehensive curb analysis is performed, then the warning system becomes more accurate, but the processing time increases

Engineering Contradiction:
Improvewarning system reliabilityVSAvoidcurb detection and classification time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

Comparison images are prepared and stored in advance in standardized formats. During runtime, the system performs efficient template matching by directly comparing captured images with these pre-processed comparison images, avoiding the need for complex real-time feature extraction and analysis, thus maintaining high reliability with minimal processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces complex mechanical or manual curb analysis with automated image processing and pattern recognition algorithms. The control device automatically compares captured images with stored comparison images using digital image correlation, rapidly determining curb type and criticality without time-consuming manual assessment.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP2942253B1Motor vehicle
Publication Date: 2021.07.07 AUDI AG
  • EP2942253B1 patent drawingFigure 1
  • EP2942253B1 patent drawingFigure 2

AI summary

Motor vehicle comprising a driver assistance system for detecting curbs in the vehicle's surroundings and for issuing a warning or for performing a longitudinal or lateral guidance intervention, wherein the driver assistance system has at least one camera for recording images of the vehicle's surroundings and a control device for evaluating the images to detect any curb shown in the image, wherein the control device (3) is assigned a memory (4) containing comparison images (13, 14, 15) showing different curb types, wherein the control device (3) is configured to classify a curb (20) detected in an image (11) by comparing the image (11) with a comparison image (13, 14, 15) and to issue the warning or to perform the intervention depending on the classification result.