Remote Work Machine Selection Using Visual ID Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In remote operation systems, operators face difficulties in verifying whether the work machine being operated is the intended target, especially when multiple machines are involved, due to similar video feeds from cameras mounted on the machines, leading to potential unintended operation.
Innovation Solution
A remote operation system with a mutual communication function that includes a first support process element to acquire and output images from designated work machines and a second support process element to recognize and transmit commands for operations, ensuring the correct work machine is being operated by using distinct communication paths and identification information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If video feeds from cameras mounted on multiple work machines are displayed for operator selection, then the operator can choose a target machine, but it becomes difficult to distinguish and confirm the correct machine due to similar appearances of the video feeds
Solution Approach 1:
The patent applies color changes by superimposing color-coded identification information (such as colored frames, icons, or labels) on the video feeds displayed on the selection screen. Each work machine is assigned distinct color markers that remain visible during video playback, allowing operators to quickly distinguish between similar-looking machines without changing the fundamental video content. This resolves the contradiction by maintaining ease of selection through visual differentiation while preserving the natural appearance of the video feeds.
2Extent of automation
If the operator relies on video feeds to identify the work machine, then remote operation is enabled, but the operator cannot physically check the external appearance and site circumstances of the machine
Solution Approach 1:
The patent applies preliminary action by displaying identification information (such as machine names, numbers, or location tags) on the selection screen before the operator initiates video playback. This pre-presentation of identifying markers allows operators to mentally note which machine they intend to select, and then confirm the selection during video playback by referencing the previously noted identification. This resolves the contradiction by enabling remote operation while compensating for the loss of physical verification through pre-displayed visual cues.
3Productivity
If multiple work machines are remotely operated through a single master device, then operational efficiency is improved, but the risk of connecting to an unintended work machine increases
Solution Approach 1:
The patent applies feedback by continuously displaying identification information alongside the video feed during remote operation. When the operator selects a work machine, the system provides immediate visual feedback by highlighting or confirming the selected machine's identification markers on the screen. This ongoing visual feedback loop allows operators to verify they are controlling the correct machine throughout the operation, not just at selection time. This resolves the contradiction by maintaining high operational efficiency through single-master control while ensuring connection accuracy through continuous visual verification.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A remote operation system has a mutual communication function of communicating with each of plural work machines (40, 50) and a remote operation device (20) which remotely operates a cooperating work machine as a remote operation target among the plural work machines. The remote operation system includes a first support process element (121) that acquires captured image which is captured by an actual machine image capturing device (412) of a first work machine establishing communication by a first communication path and transmits the captured image to the remote operation device and a second support process (122) element that recognizes that one designation operation is performed, which is a portion of plural operations for causing a second work machine establishing communication by a second communication path and in which a changing situation corresponding to the operation appears in the captured image and that transmits a command signal corresponding to the one designation operation to the second work machine.