Remote Excavator Operation With Predicted Trajectory Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote operation systems face inefficiencies and safety risks due to communication delays in video image transmission, leading to inconsistent video images on the operator's screen, which complicates remote operation of work machines.
Innovation Solution
A remote operation device that includes a control device with a communication control section, a predicted trajectory computing section, and a display control section to superpose camera video images with predicted trajectory data on the same screen, allowing operators to recognize vehicle body states and visually distinguish delays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If video image transmission is performed from work machine to remote operation device, then visual information is provided to operator, but communication delay causes inconsistency between real video image and virtual viewpoint video image
Solution Approach 1:
The system pre-calculates and displays the predicted trajectory of the work machine based on current motion state, providing advance information about future position. This preliminary action allows the operator to see where the machine will be, compensating for the delay in real video feedback and maintaining operational consistency.
Solution Approach 2:
Instead of transmitting only the delayed real video image, the system creates a predicted trajectory copy showing the expected future position of the work machine. This copied visual information represents the machine's trajectory as if viewed from a virtual viewpoint, allowing the operator to understand the machine's motion pattern despite communication delays.
2Productivity
If real video image and virtual viewpoint video image are displayed on same screen, then work efficiency is improved, but communication delay creates visual inconsistency that reduces safety
Solution Approach 1:
The predicted trajectory video image acts as an intermediary element between the delayed real video image and the operator's decision-making. It provides a visual reference that mediates the inconsistency caused by communication delay, allowing the operator to safely interpret the work machine's actual motion state.
Solution Approach 2:
The system dynamically updates the predicted trajectory based on real-time vehicle body information and motion state changes. This dynamic adjustment ensures that the predicted trajectory remains relevant and accurate despite varying communication conditions, maintaining both efficiency and safety.
Data Source
AI summary
Provided is a remote operation device capable of remotely operating efficiently and safely a work machine that is operated from a remote location, even when a communication delay occurs. The remote operation device includes a communication control section 222 that receives a camera video image of a work site captured by a vehicle-mounted camera 91 and vehicle body information of the work machine (hydraulic shovel) 1, a predicted trajectory computing section 220 that computes a predicted trajectory of the work machine (hydraulic shovel) 1 from the vehicle body information and outputs predicted trajectory data to be displayed as a video image on a display device 202, and a display control section 221 that causes the display device 202 to display the camera video image and the video image of the predicted trajectory on the same screen (simultaneously).