Augmented Reality Risk Zone Overlay for Mining Vehicle Safety

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mining vehicles pose significant risks to workers and other machinery due to their size and movement, making it difficult for operators to assess and avoid potential hazards in real-time, leading to accidents.

Innovation Solution

A method and augmented reality display device that captures video streams, recognizes mining vehicles, calculates and visualizes risk zones in real-time, and provides alerts to prevent accidents by overlaying risk zones onto the operator's view, using image processing and geofences, and optionally incorporating external sensor data for enhanced safety.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple cameras are provided to monitor risk zones, then the coverage of risk zones is improved, but the device complexity increases

Engineering Contradiction:
Improverisk zone monitoring reliabilityVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The wearable device integrates multiple functions including camera capture, image processing, risk zone calculation, and augmented reality display into a single system. This multi-functional integration reduces the need for separate monitoring systems while maintaining comprehensive risk zone coverage through the camera's field of view that corresponds to the person's field of view.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Speed

If real-time image processing is performed to recognize mining vehicles, then the response time is improved, but the computational energy consumption increases

Engineering Contradiction:
Improvevehicle recognition speedVSAvoidprocessing energy consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs image processing selectively by recognizing specific mining vehicles in the camera stream and calculating risk zones only for detected vehicles. This partial processing approach reduces overall computational energy consumption compared to continuous full-scene processing, while maintaining real-time response for safety-critical vehicle detection.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11216664B2Method and device for augmenting a person's view of a mining vehicle on a mining worksite in real-time
Publication Date: 2022.01.04 HEXAGON INNOVATION HUB GMBH
  • US11216664B2 patent drawing
  • US11216664B2 patent drawing
  • US11216664B2 patent drawing

AI summary

A method for real-time visualization of a risk zone of a mining vehicle to a person on a mining worksite for augmenting the person's current view of the mining vehicle including capturing with a camera a stream of pictures corresponding at least partly to the person's field of view, recognizing at least one mining vehicle in the picture stream by means of image processing, extracting image data of the mining vehicle from the picture stream, calculating, based on the image data and on preset vehicle risk zone data, at least one risk zone of the mining vehicle adapted to the person's current view of the mining vehicle, and visualizing the risk zone on a person's display such that the person's current view of the mining vehicle is overlayed in real-time with the visualization of the risk zone.