Remote Operation Interface for Work Machine Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators using remote operation devices may mistakenly identify which work machine to operate when multiple work machines of the same model and manufacturer are displayed in a work-site bird's-eye image, leading to inappropriate operation modes.
Innovation Solution
A work assist server that outputs a work-site bird's-eye image and determines whether a work machine in the image is the connection-target work machine by comparing its image coordinate position with its real spatial position, and displays a sign image to indicate the correct work machine.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple work machines of the same model are displayed in the work-site bird's-eye image, then the operator can monitor all machines, but the operator may mistakenly identify which machine to operate
Solution Approach 1:
The patent applies color changes by displaying the connection-target work machine with a distinct color (e.g., red frame or highlight) different from other work machines in the bird's-eye image. This visual differentiation allows operators to quickly identify which machine is currently selected for remote operation, preventing misidentification while maintaining the ability to monitor multiple machines simultaneously.
Solution Approach 2:
The patent applies local quality by providing enhanced visual information specifically at the location of the connection-target work machine, while other machines display standard information. This localized enhancement (such as showing machine ID, status indicators, or operational parameters only for the selected machine) helps operators distinguish the target machine without altering the overall display structure for monitoring multiple machines.
2Ease of operation
If work machines are displayed without identification signs, then the display is simple and clear, but the operator cannot distinguish which machine is the connection-target
Solution Approach 1:
The patent uses color changes to display identification information by showing the connection-target work machine with a distinctive color marker or highlight in the bird's-eye image. This approach provides clear machine identification without adding complex text labels or icons, maintaining display simplicity while preventing information loss about which machine is selected for operation.
3Ease of operation
If the operator relies on image position to identify the work machine, then the interface is intuitive, but misidentification occurs when multiple similar machines are present
Solution Approach 1:
The patent applies color changes by displaying the connection-target work machine with a distinct visual marker (such as a colored frame, highlight, or icon) in the bird's-eye image. This maintains the intuitive spatial layout for interface navigation while adding precise identification capability through color coding, allowing operators to quickly distinguish the target machine from similar machines based on visual cues rather than solely on position.
Solution Approach 2:
The patent applies asymmetry by creating a visual distinction between the connection-target work machine and other machines through asymmetric display elements (such as highlighting only the selected machine with a frame or icon, while leaving others unhighlighted). This asymmetric treatment provides precise identification without altering the symmetric spatial arrangement of all machines in the bird's-eye view, maintaining interface intuitiveness while improving identification precision.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Provided is a server and a system that can assist an operator in recognizing whether or not a work machine in a work-site bird's-eye image output on an output interface constituting a remote operation device is subject to remote operation by the remote operation device. According to the captured image acquired through the image pickup device C, when a work machine 40 is in the work-site bird's-eye image that is output on an output interface 220 constituting a remote operation device 20, whether or not the work machine 40 is a connection-target work machine is determined. If the determination result is positive, a first sign image ID1 associated with an actual machine image Q2 that represents the work machine 40 in the work-site bird's-eye image is displayed on the output interface 220 of the remote operation device 20.