Lane Detection Algorithm Using Sensor Fusion and Offline Refinement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current lane detection systems for autonomous vehicles face challenges in precision and stability due to the limitations of differential GPS and require improved methods for accurate localization and vehicle pose determination to enhance road safety and reduce accidents.

Innovation Solution

A method and system for lane detection using a non-transitory computer-readable storage medium that generates a ground truth, trains a lane detection algorithm using sensors like IMU and GPS, and refines the algorithm offline to optimize lane marking predictions, incorporating parameters for arc-based lane markings and confidence level assessment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If differential GPS is used for lane detection, then the system can provide localization capability, but the precision and stability of localization are insufficient

Engineering Contradiction:
Improvelocalization precisionVSAvoidlocalization stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent combines multiple sensors (IMU, GPS, camera) into an integrated lane detection system. The IMU provides motion data for dead reckoning, GPS provides position information, and the camera captures visual lane marking data. By merging these complementary data sources through sensor fusion algorithms, the system achieves both high precision and stable localization, overcoming the limitations of using differential GPS alone.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary processing layer that fuses data from multiple sensors and uses machine learning algorithms to interpret camera images. This intermediary layer processes raw sensor data, combines information from different sources, and produces refined lane detection results, thereby improving both precision and reliability compared to direct GPS-based localization.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If a single sensor system is used for lane detection, then the device complexity is low, but the detection precision and reliability are insufficient

Engineering Contradiction:
Improvelane detection precisionVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple sensor types (inertial sensors, GPS receiver, camera) into a unified lane detection system. Each sensor contributes its strengths: IMU provides high-frequency motion data, GPS provides absolute position, and camera provides visual lane marking information. The fusion of these sensors achieves superior detection precision that would be unattainable with any single sensor alone.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a multi-functional sensor system where the same sensor suite serves multiple purposes: IMU data is used for both vehicle pose estimation and motion-based prediction, GPS provides both position and velocity information, and the camera captures both lane markings and environmental context. This universal approach maximizes the utility of each sensor while maintaining system precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If offline training and refinement is performed, then the lane detection algorithm precision is improved, but the processing time and computational resources increase

Engineering Contradiction:
Improvelane detection precisionVSAvoidalgorithm training time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary offline training of the lane detection algorithm using labeled ground truth data from multiple sensors. This preliminary action pre-computes optimal detection parameters and creates trained models that can be deployed for real-time operation. By doing the heavy computational lifting in advance, the system achieves high precision detection during actual use without real-time performance penalties.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements an offline refinement process where detected lane markings are compared against ground truth data, and the algorithm parameters are adjusted based on the feedback from these comparisons. This iterative feedback loop continuously improves detection precision while the trained model handles real-time detection efficiently, separating the time-consuming refinement process from operational detection.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10373003B2Deep module and fitting module system and method for motion-based lane detection with multiple sensors
Publication Date: 2019.08.06 CREATEAI INC
  • US10373003B2 patent drawing
  • US10373003B2 patent drawing
  • US10373003B2 patent drawing

AI summary

A method of lane detection for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs include instructions, which when executed by a computing device, cause the computing device to perform the following steps comprising: generating a ground truth; off-line training a lane detection algorithm by using the ground truth, the lane detection algorithm using parameters that express a lane marking in an arc; on-line generating a predicted lane marking; comparing the predicted lane marking against the ground truth; and off-line refining the lane detection algorithm.