Stop Sign Violation Detection Using Image and Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face challenges in efficiently analyzing large amounts of image data from vehicles to detect stop sign violations, leading to difficulties in identifying and addressing improper driving behaviors in a timely manner, which results in increased accidents and associated costs for enterprises.

Innovation Solution

A violation detection system that utilizes image data, location data, and sensor data from vehicles to automatically detect traffic violations, including stop sign violations, through a machine learning model that processes and analyzes compressed and resized image data, providing real-time alerts and enabling proactive measures to prevent accidents.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If large amounts of image data are captured from vehicles to detect stop sign violations, then detection accuracy is improved, but data processing time and computational resources increase

Engineering Contradiction:
Improveviolation detection accuracyVSAvoiddata processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system extracts only the most relevant features from image data using pre-trained convolutional neural networks, rather than processing entire images. This extraction approach maintains detection accuracy while significantly reducing processing time and computational resources required for analysis.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary processing of image data through pre-trained models before final violation detection. By pre-training convolutional neural networks on large datasets beforehand, the system prepares feature extraction capabilities in advance, enabling faster real-time processing during actual violation detection without sacrificing accuracy.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If manual analysis of image data is performed to identify stop sign violations, then detection precision can be maintained, but productivity and response time decrease

Engineering Contradiction:
Improveviolation detection precisionVSAvoidviolation detection throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system replaces manual mechanical analysis with automated machine learning models. Pre-trained convolutional neural networks automatically analyze image data and detect violations with precision comparable to or exceeding human analysts, while processing thousands of images per second instead of individual manual reviews.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system uses pre-trained models that have been copied and deployed across multiple vehicles and processing units. These replicated models enable parallel processing of image data from multiple sources simultaneously, dramatically increasing overall detection throughput while maintaining consistent precision across all instances.

Inventive Principle:
Principle #26Copying

3Loss of time

If comprehensive sensor data and image data are processed in real-time to detect violations, then early detection capability is improved, but device complexity and computational requirements increase

Engineering Contradiction:
Improvedetection response timeVSAvoidsystem computational complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system segments the complex detection task into distinct processing stages: image capture, feature extraction using pre-trained CNNs, sensor data processing, and violation determination. Each segment handles specific aspects of the detection problem independently, reducing overall system complexity while enabling real-time processing through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system employs universal pre-trained convolutional neural networks that can process various types of image data and detect multiple violation types with a single model. This multi-functional approach eliminates the need for separate specialized models for each violation type, reducing computational complexity while maintaining comprehensive detection capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11900657B2System for automatic stop sign violation identification
Publication Date: 2024.02.13 VERIZON CONNECT DEVELOPMENT LTD
  • US11900657B2 patent drawing
  • US11900657B2 patent drawing
  • US11900657B2 patent drawing

AI summary

A violation detection platform may obtain image data, location data, and sensor data associated with a vehicle. The violation detection platform may determine a probability that a frame of the image data includes an image of a stop sign. The violation detection platform may determine that the probability satisfies a probability threshold. The violation detection platform may identify location data and sensor data associated with the frame of the image data based on the probability satisfying the probability threshold. The violation detection platform may determine an occurrence of a type of a stop sign violation based on the probability, the location data, and the sensor data. The violation detection platform may perform one or more actions based on determining the occurrence of the type of the stop sign violation.