Remote Operator Video Overlay for Traction Slippage Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote operators of work machines, such as wheel loaders, often lack adequate feedback on traction device slippage, leading to delayed responses and premature wear of traction devices, resulting in unscheduled repairs and downtime.
Innovation Solution
A system that includes a controller to receive data from speed sensors and determine slippage conditions, activating a visual overlay in a real-time video feed on a remote operator interface to represent slippage, enabling operators to take corrective actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If an operator operates the work machine remotely without direct physical presence, then operator safety is improved and operational flexibility is enhanced, but the operator's ability to perceive and respond to traction device slippage deteriorates
Solution Approach 1:
The system implements a feedback mechanism by detecting slippage conditions through speed sensors and providing visual feedback through overlays on the video feed displayed to the remote operator. The controller monitors the speed of traction devices and generates visual indicators that are superimposed on the video feed, allowing the operator to perceive slippage conditions that would otherwise be imperceptible in remote operation mode.
2Device complexity
If the operator relies on delayed or absent slippage feedback, then the remote operation system remains simple, but traction device wear increases and device lifespan decreases
Solution Approach 1:
The system introduces an intermediary detection and notification system between the traction devices and the remote operator. Speed sensors act as intermediaries to detect slippage conditions, and the controller serves as an intermediary to process this data and generate visual feedback. This intermediary system provides timely slippage information to the operator without requiring complex direct sensing at the traction device level.
3Loss of information
If visual feedback overlays are activated to indicate slippage conditions, then operator awareness of slippage is improved, but the complexity of the remote operator interface increases
Solution Approach 1:
The system creates a visual copy or representation of the slippage condition by superimposing graphical overlays on the existing video feed. Instead of adding separate dedicated displays or complex interfaces, the system copies the video feed and adds visual indicators directly onto it, maintaining familiarity for the operator while conveying additional information about traction device slippage conditions.
Data Source
AI summary
A system for communicating slippage experienced by at least one traction device of a work machine, to a remote operator interface for controlling the work machine through the remote operator interface is described. The system includes a controller configured to receive data associated with a speed of the at least one traction device of the work machine and determine a slippage condition of the at least one traction device based on the data. The controller is further configured to activate a visual overlay over a virtual image, of the at least one traction device, displayed in a video feed to represent the slippage condition on the remote operator interface. The video feed is a real-time video feed, indicating one or more operations of the work machine, displayed on the remote operator interface.