Multi-Camera Raised Pavement Marker Detection System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for detecting raised pavement markers are unreliable and inconsistent due to their small size and similarity to noise or other road objects, making it difficult for single camera systems to accurately detect them, especially under varying weather and lighting conditions.

Innovation Solution

A camera system with multiple cameras (front, rear, left mirror, and right mirror) captures and analyzes images from different angles, using image stitching in overlapping regions to enhance detection robustness and accuracy, and applies predefined conditions such as shape, brightness, and collinearity criteria to identify raised pavement markers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a single camera system is used to detect raised pavement markers, then the device complexity is low, but the detection reliability is poor due to small marker size and similarity to noise

Engineering Contradiction:
Improvedetection reliabilityVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The detection task is segmented across multiple cameras positioned at different locations (front, rear, left mirror, right mirror). Each camera captures images from its specific viewpoint, and the system processes each image separately before combining results. This segmentation allows the system to detect markers that might be missed by a single camera while maintaining manageable processing complexity through modular analysis.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system merges detection results from multiple cameras by analyzing overlapping regions in the captured images. When the same raised pavement marker is detected by multiple cameras, the system combines these detections to confirm presence and reduce false positives. This merging strategy significantly improves detection reliability by cross-validating observations across different viewpoints.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If multiple cameras are used to capture images from different angles, then the detection accuracy is improved, but the data processing complexity increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies local quality analysis by focusing processing efforts on overlapping regions where multiple camera views intersect. Rather than processing entire images uniformly, the system concentrates computational resources on regions where marker detection is most critical and where cross-validation can occur. This approach improves detection accuracy while limiting the increase in processing complexity to only the necessary overlapping areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system performs partial action by selectively processing only the overlapping regions from multiple camera images rather than analyzing every pixel in every image. This targeted approach extracts sufficient information for accurate marker detection without the full computational burden of complete image processing, achieving a balance between accuracy and complexity.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If image stitching is performed in overlapping regions, then the robustness of detection is enhanced, but the processing time increases

Engineering Contradiction:
Improvedetection robustnessVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary action by pre-identifying and pre-processing overlapping regions before final marker detection. By preparing these regions in advance and establishing their geometric relationships beforehand, the system reduces the computational burden during actual detection. This preliminary setup enhances detection robustness through proper image alignment while minimizing the time penalty during operational detection phases.

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If predefined conditions such as shape, brightness, and collinearity criteria are applied, then false positives are filtered out, but the detection algorithm complexity increases

Engineering Contradiction:
Improvedetection precisionVSAvoidalgorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies parameter changes by using multiple detection criteria (shape, brightness, collinearity) to characterize raised pavement markers. Each criterion checks a specific parameter of potential markers, and markers must satisfy multiple parameter constraints to be confirmed. This multi-parameter approach significantly improves detection precision by filtering out false positives while keeping algorithm complexity manageable through the use of simple, well-defined parameter checks for each criterion.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11138447B2Method for detecting raised pavement markers, computer program product and camera system for a vehicle
Publication Date: 2021.10.05 CONNAUGHT ELECTRONICS
  • US11138447B2 patent drawing
  • US11138447B2 patent drawing
  • US11138447B2 patent drawing

AI summary

A method is disclosed for detecting raised pavement markers in an environment of a vehicle by a camera system. The method includes capturing at least one first image of at least one first part of the environment by at least one first camera of the camera system and analyzing the at least one first image and determining whether at least one first pavement marker is present in the environment in dependency of a result of the analysis of the at least one first image. The method further includes capturing at least one second image of at least one second part of the environment by at least one second camera of the camera system and analyzing the at least one second image and determining whether the at least one first or at least one second pavement marker is present in the environment in dependency of a result of the analysis.