Traffic Light Visibility Detection Using Camera and Lidar

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Vehicle operators, especially in smaller vehicles, often have their view of traffic signals obstructed by larger vehicles, leading to difficulties in determining the traffic signal state, which can result in unnecessary disengagement of advanced driver-assistance systems (ADAS) when the operator is unsure of the signal state.

Innovation Solution

A system that uses a camera and lidar to estimate the dimensions of a leading vehicle and determine if it obstructs the view of a traffic signal, generating a graphical user interface on a heads-up display to provide the traffic signal state and alert the driver, utilizing SPaT messaging for traffic signal location and cycle state data, and adjusting vehicle speed to maintain visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a vehicle operator relies on direct visual view of traffic signals, then the operator can directly perceive signal state, but the view may be blocked by larger proximate vehicles causing inability to determine signal state

Engineering Contradiction:
Improvetraffic signal state determination reliabilityVSAvoidview obstruction by leading vehicle
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an intermediary system consisting of a camera mounted on the leading vehicle and a display system in the host vehicle. The camera captures traffic signal images that would otherwise be obscured, and the display system presents these images to the host vehicle operator, thereby mediating the obstruction problem between the traffic signal and the operator's view

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a visual copy of the traffic signal by capturing the signal's image with a camera mounted on the leading vehicle. This copied image is then transmitted and displayed in the host vehicle, allowing the operator to view a replica of the actual traffic signal state without needing direct line-of-sight to the physical signal

Inventive Principle:
Principle #26Copying

2Productivity

If ADAS system operates without confirmed traffic signal visibility, then the vehicle can maintain automated operation, but the operator may unnecessarily disengage the ADAS system when unsure of signal state

Engineering Contradiction:
ImproveADAS system operational continuityVSAvoidoperator uncertainty about signal state
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously monitors whether the traffic signal is visible to the host vehicle operator. When obstruction is detected or anticipated, the system activates the alternative display system to provide feedback about the signal state, thereby maintaining operator confidence and ADAS operational continuity

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent uses predictive algorithms to determine future traffic signal view obstruction based on current vehicle positions, speeds, and trajectories. By anticipating potential obstruction before it occurs, the system can proactively activate the camera and display systems to maintain continuous signal state information, preventing operator uncertainty and unnecessary ADAS disengagement

Inventive Principle:
Principle #10Preliminary action

3Reliability

If vehicle operator maintains distance from leading vehicle to ensure signal visibility, then signal view is maintained, but following distance increases reducing traffic flow efficiency

Engineering Contradiction:
Improvetraffic signal visibilityVSAvoidtraffic flow efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The camera system mounted on the leading vehicle acts as an intermediary that extends the host vehicle operator's visual reach. This allows the operator to maintain a normal following distance while still accessing traffic signal information through the camera-captured image, eliminating the need to increase distance for visibility

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transitions the traffic signal viewing experience from a direct spatial dimension (requiring line-of-sight) to an information dimension (using captured images and displays). This dimensional shift allows the operator to access signal state information without being constrained by physical distance or line-of-sight requirements, maintaining both safety distance and traffic flow efficiency

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Ensures accurate determination and notification of traffic signal states to vehicle operators, preventing unnecessary disengagement of ADAS systems and maintaining traffic signal visibility by calculating the minimum distance required for signal visibility and alerting the driver when obstruction is imminent.

Implementation Method 1

a camera for capturing an image wherein the image includes a representation of a leading vehicle

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

a lidar configured to capture a depth map indicative of the leading vehicle dimension and the first distance

Methodology Applied
Scientific EffectLIDAR: LIDAR

Data Source

PatentUS11715373B2Traffic light visibility detection and augmented display
Publication Date: 2023.08.01 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US11715373B2 patent drawing
  • US11715373B2 patent drawing
  • US11715373B2 patent drawing

AI summary

A method for capturing, by a host vehicle camera, an image of a leading vehicle, estimating a leading vehicle dimension and a first distance between a host vehicle and the leading vehicle in response to the image, receiving a data indicative of a traffic signal location and a traffic signal cycle state, determining a second distance between the host vehicle and the traffic signal, estimating a traffic signal view obstruction in response to the leading vehicle dimension, the first distance, and the second distance, and generating a graphical user interface indicative of the traffic signal cycle state in response to the traffic signal view obstruction.