Work Machine Image Display System for Remote Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote operation of work machines, such as excavators, faces challenges due to two-dimensional image displays that lack perspective, making it difficult for operators to accurately gauge distances between the machine and targets, leading to decreased work efficiency.
Innovation Solution
An image display system that includes a position detection unit, distance detection device, and processing device to generate and display a first image indicating the position of the working tool on the target surface, along with a turning direction, enhancing the operator's perception of depth and distance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a two-dimensional image is used for remote operation, then the system complexity is reduced, but the perspective feeling and distance perception deteriorate
Solution Approach 1:
The patent overlays two-dimensional graphical information (distance indicators, position markers, arc trajectories) onto the video feed to create a composite display that conveys three-dimensional spatial relationships. This adds informational dimensions to the basic video image, enabling operators to perceive depth and distance without switching to a fully 3D visualization system.
Solution Approach 2:
The system introduces intermediate graphical elements (such as arc indicators showing turning radius, distance markers, and position overlays) that mediate between the raw video feed and the operator's spatial understanding. These graphical intermediaries translate complex spatial data into intuitive visual cues that enhance distance perception while maintaining system simplicity.
2Device complexity
If a two-dimensional image is used for remote operation, then the display system remains simple, but the work efficiency decreases due to poor perspective feeling
Solution Approach 1:
By overlaying graphical information that represents three-dimensional spatial relationships onto the two-dimensional video display, the system enhances operational accuracy and work efficiency without requiring a complex 3D visualization system. The graphical overlays provide depth cues and distance information that improve the operator's ability to perform precise work.
Solution Approach 2:
Graphical intermediaries such as distance markers, position indicators, and trajectory arcs serve as mediators that translate spatial relationships into intuitive visual information. These intermediaries bridge the gap between the simple 2D display and the operator's need for accurate spatial perception, thereby improving work efficiency.
3Device complexity
If an operator relies on skill-based distance estimation, then no additional detection devices are needed, but the accuracy of distance judgment varies and work efficiency decreases
Solution Approach 1:
The system provides visual feedback by overlaying detected position and distance information directly onto the video display. This feedback loop continuously updates the operator with accurate spatial information, replacing subjective skill-based estimation with objective, real-time data while maintaining a relatively simple system architecture.
Solution Approach 2:
The system creates a graphical copy or representation of the actual spatial relationships (through overlays showing working equipment position, distance markers, and trajectory indicators) that supplements the direct video feed. This graphical copy provides standardized, accurate spatial information that does not depend on operator skill level.
Data Source
AI summary
An image display system for a work machine including working equipment having a working tool and a turning body to which the working equipment is attached, includes: a position detector detecting at least one of an attitude and a position of the working equipment; a distance detector obtaining information on a distance from the work machine to a work target; and a processing device that generates, by using information on a position of the working tool obtained by the position detector and information on a position of the work target obtained from the information on the distance obtained by the distance detector, a first image including a portion corresponding to a part of the working tool and extending along a turning direction of the turning body, on the work target opposed to the working tool, and displays the first image on the display device.