Lane Line Reconstruction Using Future Scenes and Vehicle Trajectory

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional autonomous control systems for vehicles struggle to detect lane lines that are occluded by objects or located near the vanishing points of the horizon, making it difficult to navigate accurately.

Innovation Solution

A vehicle-mounted camera system with a lane detection system that uses a training module to process images, reconstruct occluded lane lines, and predict their positions in real-time using machine-learning algorithms and image analysis techniques, allowing for autonomous or semi-autonomous driving.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional autonomous control systems use standard image processing to detect lane lines, then the system structure remains simple, but the system cannot accurately detect occluded lane lines or lane lines near the horizon

Engineering Contradiction:
Improvelane line detection accuracyVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by capturing future frames ahead of the current frame and pre-processing them to extract lane line information. This allows the system to anticipate and reconstruct occluded lane lines before they become critical for navigation, improving detection accuracy without requiring complex real-time processing of occluded regions

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary mechanism that uses trajectory information and future frame data as mediators to reconstruct occluded lane lines. Instead of directly detecting obscured lines, the system uses intermediate trajectory predictions and future scene information to infer the current lane line positions, resolving the contradiction between accuracy and complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the system uses real-time image processing only, then the processing speed remains fast, but the system cannot anticipate lane curvature near vanishing points

Engineering Contradiction:
Improvelane line prediction reliabilityVSAvoidcomputation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary processing of future frames to extract lane line information in advance. By capturing and pre-processing future scenes, the system anticipates lane curvature and trajectory changes before they affect current navigation decisions, improving reliability without significant time loss

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the processing pipeline by selectively processing future frames based on detected scene changes, vehicle motion, and lane line visibility. This dynamic approach ensures reliable lane prediction while optimizing computation time by avoiding unnecessary processing in stable conditions

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If the system processes multiple future frames to reconstruct occluded lane lines, then the detection accuracy improves, but the computational complexity increases

Engineering Contradiction:
Improveoccluded lane line reconstruction accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies partial processing by selectively analyzing only the necessary portions of future frames rather than processing entire images at full resolution. This allows accurate reconstruction of occluded lane lines by focusing computational resources on relevant regions, balancing accuracy with processing complexity

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system segments the image processing task by dividing future frames into regions of interest based on detected objects, trajectory predictions, and expected lane line locations. This segmentation allows accurate reconstruction of occluded areas while avoiding unnecessary processing of irrelevant regions, reducing overall computational complexity

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11670173B2Lane line reconstruction using future scenes and trajectory
Publication Date: 2023.06.06 PHANTOM AI INC
  • US11670173B2 patent drawing
  • US11670173B2 patent drawing
  • US11670173B2 patent drawing

AI summary

A vehicle capable of autonomous driving includes a lane detection system. The lane detection system is trained to predict lane lines using training images. The training images are automatically processed by a training module of the lane detection system in order to create ground truth data. The ground truth data is used to train the lane detection system to predict lane lines that are occluded in real-time images of roadways. The lane detection system predicts lane lines of a roadway in a real-time image even though the lane lines maybe indiscernible due to objects on the roadway or due to the position of the lane lines being in the horizon.