Camera Mirror Display Road Marking Detection for Trailer Edge Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera mirror systems for commercial trucks face difficulty in distinguishing between the edge of a trailer and visually similar road features like lane lines, parking lines, or curbs, leading to inaccurate trailer angle detection.

Innovation Solution

The system identifies road features by converting images to grayscale, detecting edges, using the Hough transform for line extraction, and filtering noise to differentiate between trailer edges and road markings, allowing for accurate trailer angle determination and automatic panning to maintain the trailer end in view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the system uses automated panning with trailer edge identification to maintain trailer end in view, then the field of view coverage is improved, but the measurement precision deteriorates due to difficulty in differentiating between trailer edges and road markings

Engineering Contradiction:
Improvefield of view coverageVSAvoidtrailer edge detection accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system converts the image from RGB to grayscale and applies edge detection to identify edges regardless of color. This transformation allows the system to detect edges based on intensity changes rather than color information, enabling differentiation between trailer edges and road markings through subsequent line comparison algorithms that analyze geometric properties rather than color characteristics.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The system changes the parameter space for edge analysis by converting from color-based RGB values to intensity-based grayscale values, and then to edge magnitude values. This parameter transformation enables the detection algorithm to focus on geometric and spatial properties of edges rather than color properties, improving the ability to distinguish trailer edges from road markings.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the system compares detected lines with known road marking features to identify road features, then the measurement precision is improved, but the device complexity increases due to additional processing steps

Engineering Contradiction:
Improveroad feature identification accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary edge detection and line extraction using the Hough transform before comparing with road marking features. By pre-processing the image to identify potential lines and their geometric properties (slope, intercept, position), the system reduces the complexity of the subsequent comparison step, as it only needs to match pre-extracted line parameters against known road marking characteristics rather than analyzing raw pixel data.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces complex polynomial data fitting methods with the Hough transform for line detection. The Hough transform provides a more efficient and straightforward mathematical approach to identifying lines in images, substituting a computationally intensive iterative fitting process with a voting-based algorithm that is both faster and easier to implement.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If the system avoids polynomial data fitting in favor of Hough transform for line detection, then the productivity is improved, but the manufacturing precision may worsen due to different detection algorithms

Engineering Contradiction:
Improveprocessing speedVSAvoidline detection precision
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system substitutes polynomial data fitting with the Hough transform, replacing an iterative optimization approach with a voting-based geometric algorithm. The Hough transform maps edge points to parameter space, where lines appear as peaks that can be directly identified, providing both computational efficiency and robustness to noise and gaps in edge data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the parameter representation from polynomial coefficients (requiring iterative fitting) to Hough transform parameters (rho and theta in polar coordinates). This parameter transformation allows for direct computation of line equations from edge points without iterative optimization, improving processing speed while maintaining detection precision through the geometric nature of the Hough transform.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12049172B2Camera mirror system display for commercial vehicles including system for identifying road markings
Publication Date: 2024.07.30 STONERIDGE INC
  • US12049172B2 patent drawing
  • US12049172B2 patent drawing
  • US12049172B2 patent drawing

AI summary

A process for identifying a road feature in an image includes receiving an image at a controller, identifying a region of interest within the image and converting the region of interest from red-green-blue (RGB) to a single color using the controller. A set edges is detected within the region of interest, and at least one line within the set of edges is identified using the controller. The at least one line is compared with a set of known and expected road marking features, and the set of at least one first line in the at least one line is identified as corresponding to a road feature in response to the at least the first line matching the set of known and expected road marking features.