Windshield Image Classification for HOV Lane Occupancy Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for enforcing managed lane occupancy rules, such as HOV and HOT lanes, face challenges in accurately detecting vehicle occupancy violations due to reliance on manual observations and conventional image recognition techniques that are prone to errors, leading to high undetected violations and safety risks for enforcement officers.

Innovation Solution

An image-based system that captures vehicle images using a near-infrared camera, processes pixels to compute a feature vector representing the cabin region, and applies machine learning classifiers like Support Vector Machines to classify vehicles as violators or non-violators without assuming specific image content, using techniques such as Successive Mean Quantization Transform, Scale-Invariant Feature Transform, Histogram of Gradients, Bag-of-Visual-Words, or Fisher Vector Representations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If conventional object recognition methods are used to detect occupants in vehicle images, then the system can identify objects based on appearance characteristics, but the classification accuracy deteriorates when image variations occur (e.g., passengers leaning forward, sideways-facing occupants, or rear-seated passengers)

Engineering Contradiction:
Improveautomated enforcementVSAvoidoccupancy classification accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

Instead of searching for specific objects (faces, seats, seat belts) within the image as conventional methods do, the patent inverts the approach by searching for the windshield and cabin region first, then classifying the entire windshield image as representing either a single-occupant or multi-occupant vehicle. This inversion from object-centric to region-centric classification eliminates the need to correctly identify and locate specific objects, thereby solving the accuracy problems caused by image variations in occupant position and orientation

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent extracts and focuses on the windshield and cabin region from the full vehicle image, discarding the rest of the image content. By extracting only the relevant windshield region and classifying based on the overall characteristics of this extracted region rather than searching for specific objects within it, the system achieves more reliable occupancy classification that is insensitive to variations in object appearance and position

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If manual traffic stops are performed by enforcement officers for visual detection of violations, then enforcement can be conducted, but labor costs increase and officers are exposed to safety risks from oncoming traffic

Engineering Contradiction:
Improveviolation detectionVSAvoidsafety risks to officers
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent replaces the mechanical system of manual traffic stops with an automated image-based classification system. The system uses computer vision to capture images of vehicles, extract windshield regions, and automatically classify occupancy status without requiring officers to physically approach vehicles. This substitution eliminates the safety risks associated with manual traffic stops while maintaining reliable violation detection through automated analysis

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an automated image classification system as an intermediary between the need for violation detection and the enforcement process. This intermediary system processes images and provides classification results, allowing enforcement to proceed without direct officer involvement in the detection phase, thereby reducing safety risks while maintaining detection reliability

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If RFID transponders with manual switches are used to detect occupancy in HOT lanes, then automated toll assessment is enabled, but compliance becomes voluntary and enforcement reliability decreases

Engineering Contradiction:
Improveautomated toll assessmentVSAvoidcompliance enforcement
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements a system where the vehicle's occupancy status is determined automatically through image analysis of the windshield region, without requiring manual input from the driver. The system processes the entire windshield image to classify occupancy, making the enforcement process self-acting and eliminating the need for voluntary driver compliance with manual switch operation

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual switch-based RFID system with an automated image classification system that uses computer vision to determine occupancy. This substitution transforms the system from one requiring voluntary mechanical input to an automated optical system that independently assesses occupancy, thereby improving enforcement reliability while maintaining automated operation

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS8824742B2Occupancy detection for managed lane enforcement based on localization and classification of windshield images
Publication Date: 2014.09.02 CONDUENT BUSINESS SERVICES LLC
  • US8824742B2 patent drawing
  • US8824742B2 patent drawing
  • US8824742B2 patent drawing

AI summary

A system for detecting a vehicle occupancy violation includes an image capture module that acquires an image including a vehicle cabin from a camera positioned to view oncoming traffic. The system includes a violation determination device, which includes a feature extraction module that processes the image pixels for determining an image descriptor. The process is selected from a group consisting of a Successive Mean Quantization Transform; a Scale-Invariant Feature Transform; a Histogram of Gradients; a Bag-of-Visual-Words Representation; a Fisher Vector Representation; and, a combination of the above. The system further includes a classifier that determines a distance that the vehicle image descriptor/representation is positioned in the projected feature space relative to a hyper-plane. The classifier determines whether the distance meets a threshold and classifies the image when the threshold is met. A processor implements the modules. A graphic user interface outputs the classification.