Computer Vision Hazard Detection for Railroad Train Automation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Positive Train Control (PTC) and Energy Management (EM) systems rely on static track databases and cannot effectively handle dynamic conditions on railroad tracks, leading to inefficient and potentially catastrophic operations due to human error and limitations in detecting hazards within the range of a locomotive engineer's vision.

Innovation Solution

A computer vision-based train monitoring system utilizing Baseline Navigational Data to autonomously detect and respond to line-of-sight hazards, allowing for consistent and vigilant responses beyond human capabilities, which can operate with or without a human operator, by synchronizing active views with pre-defined Baseline Navigational Data to identify and classify hazardous conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If PTC and EM systems rely on static track databases, then system simplicity is maintained, but the ability to handle dynamic conditions and detect hazards is insufficient

Engineering Contradiction:
Improveability to handle dynamic conditionsVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system transitions from static track databases to dynamic computer vision-based hazard detection. Image capture devices continuously capture images of the track environment, and the system dynamically processes these images to detect hazards, enabling adaptation to changing conditions while maintaining operational simplicity through automated processing.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent replaces traditional mechanical sensor packages with computer vision systems using image capture devices. This substitution enables more versatile hazard detection capabilities while managing system complexity through software-based image processing and analysis algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If human engineers monitor track conditions, then operational flexibility is maintained, but detection consistency and vigilance are limited by human error and fatigue

Engineering Contradiction:
Improvedetection consistencyVSAvoidautomation level
Core Design Contradiction:
ReliabilityVSExtent of automation

Solution Approach 1:

The system performs self-monitoring of track conditions through automated computer vision processing. The image capture devices and processing system operate autonomously to detect hazards, eliminating reliance on human engineer vigilance while maintaining operational flexibility through automated decision-making protocols.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements continuous feedback loops where captured images are processed, hazards are detected and classified, and responses are automatically initiated. This closed-loop feedback mechanism ensures consistent detection reliability while progressively increasing automation levels through learned patterns and automated response protocols.

Inventive Principle:
Principle #23Feedback

3Reliability

If engineers operate at restricted speeds to maintain visual contact with hazards, then safety is improved, but operational efficiency deteriorates

Engineering Contradiction:
ImprovesafetyVSAvoidoperational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system extends detection beyond the human line-of-sight dimension by using image capture devices and digital image processing. This creates a new dimensional capability where hazards can be detected at greater distances and angles, allowing trains to operate at efficient speeds while maintaining safety through enhanced detection capabilities.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system performs preliminary hazard detection and classification before the train reaches hazardous areas. By identifying and classifying potential hazards in advance using computer vision, the system allows engineers to prepare appropriate responses while maintaining efficient operating speeds, rather than requiring continuous restricted-speed operation.

Inventive Principle:
Principle #10Preliminary action

4Difficulty of detecting and measuring

If advanced sensor packages are deployed to detect hazards, then detection capability is improved, but system complexity and cost increase

Engineering Contradiction:
Improvedetection capabilityVSAvoidsensor system complexity
Core Design Contradiction:
Difficulty of detecting and measuringVSDevice complexity

Solution Approach 1:

The system uses multi-functional image capture devices that serve both hazard detection and general monitoring purposes. By employing universal imaging technology rather than specialized sensors for each detection task, the system improves detection capability while managing complexity through consolidated hardware platforms that perform multiple functions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20230391384A1Automated operation of railroad trains
Publication Date: 2023.12.07 HULLEMEYER ERIC AUGUST
  • US20230391384A1 patent drawing
  • US20230391384A1 patent drawing
  • US20230391384A1 patent drawing

AI summary

A new over lay technology for the Positive Train Control and Energy Management systems used by the railroad industry today which allows for automated train handling responses to potential on-track hazards. Various sensors, including image-capture devices, radar, and drones, are placed on or proximate to a train. These sensors are used to interface with or override the Positive Train Control and Energy Management systems where those systems activate specific actions such as slowing or stopping a train but hazardous conditions on the track may dictate an alternative response.