Traffic Signal Recognition Using Probabilistic Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing traffic signal recognition processes face challenges in accurately identifying unseen traffic lights, as they require detailed template descriptions and independently process adjacent image frames without considering temporal and spatial relationships, leading to increased computational intensity and potential misidentifications.

Innovation Solution

A method that uses a vehicle-mounted camera, a color filter, and a probabilistic estimator to detect traffic signal candidates based on navigational maps or GPS location, employing a Kalman filter for frame-by-frame tracking and rejecting false candidates through spatial and temporal behavior analysis, allowing for reliable recognition regardless of traffic light shape and size.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If template matching is used to identify traffic light candidates in all areas of the frame, then traffic signal recognition accuracy is improved, but computational intensity and processing time increase significantly

Engineering Contradiction:
Improvetraffic signal recognition accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary actions by using GPS location and navigational map data to predict where traffic signals are likely to be located before actually processing the image frames. This allows the system to narrow down the search area to specific candidate regions rather than analyzing the entire frame, significantly reducing computational intensity while maintaining recognition accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies local quality by focusing computational resources on specific local areas of the image frame where traffic signals are expected to be located, based on GPS and map data. Instead of uniformly processing the entire frame, the system concentrates analysis on predicted traffic signal locations, improving processing efficiency while maintaining detection accuracy.

Inventive Principle:
Principle #3Local quality

2Device complexity

If adjacent image frames are processed independently, then processing simplicity is maintained, but temporal and spatial relationships are lost leading to potential misidentifications

Engineering Contradiction:
Improveprocessing complexityVSAvoididentification accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system implements feedback by using results from previously processed image frames to inform the processing of current frames. The probabilistic estimator accumulates evidence across multiple frames, using temporal relationships to confirm or reject traffic signal candidates. This feedback mechanism improves identification reliability without significantly increasing processing complexity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system maintains continuity of useful action by continuously tracking traffic signal candidates across adjacent image frames using a probabilistic estimator. This allows the system to accumulate evidence over time and distinguish true traffic signals from false positives, improving identification accuracy while maintaining a consistent processing approach.

Inventive Principle:
Principle #20Continuity of useful action

3Measurement precision

If detailed template descriptions are required for each template in the library, then matching accuracy is improved, but the system cannot handle previously unseen traffic lights

Engineering Contradiction:
Improvetemplate matching accuracyVSAvoidcapability to recognize unseen traffic lights
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system applies parameter changes by using a probabilistic estimator that can adapt to various traffic light characteristics without requiring detailed predefined templates. The estimator evaluates candidates based on multiple parameters including color, shape, size, and temporal behavior, allowing the system to recognize both known and previously unseen traffic light configurations with high accuracy.

Inventive Principle:
Principle #35Parameter changes

4Reliability

If all areas of the image frame are analyzed to identify traffic light candidates, then detection completeness is improved, but computational resources and processing time increase

Engineering Contradiction:
Improvedetection completenessVSAvoidcomputational resource consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by using GPS location and navigational map data to predict traffic signal locations before analyzing image frames. This allows the system to limit detailed analysis to specific candidate areas rather than processing the entire frame, reducing computational resource consumption while maintaining detection completeness through the probabilistic estimation approach.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9731661B2System and method for traffic signal recognition
Publication Date: 2017.08.15 TOYOTA JIDOSHA KK
  • US9731661B2 patent drawing
  • US9731661B2 patent drawing
  • US9731661B2 patent drawing

AI summary

Detecting traffic signaling of a mobile environment includes receiving image frames captured by an imaging device to detect a traffic signal candidate therefrom based on at least a vehicle location. A score having a predefined value is established for the traffic signal candidate. The traffic signal candidate is tracked by incrementing the score when the traffic signal candidate is determined to appear, based on a probabilistic estimator that indicates an expected value for a location of the traffic signal candidate, in a tracked image frame of the captured image frames. The score is decremented when the traffic signal candidate is determined not to appear, based on the probabilistic estimator, in the tracked image frame. The traffic signal candidate is recognized as a traffic signal based on whether the score is above a specified threshold.