Work Machine Image Display System with Spatial Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In remote operation of work machines like excavators, the two-dimensional image display lacks perspective, making it difficult for operators to accurately gauge the distance between the working unit and the object, leading to reduced working efficiency.
Innovation Solution
An image display system that combines images from an imaging device and attitude/distance detection devices to generate a three-dimensional representation of the working implement's position and attitude relative to the object, displayed on a remote operation device, providing a grid and line image overlay to enhance spatial awareness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a two-dimensional image is used for remote operation, then the operation system is simple, but the operator cannot accurately grasp the distance and spatial relationship
Solution Approach 1:
The patent overlays two-dimensional images with three-dimensional spatial information including distance markers, depth indicators, and positional data. This combines the simplicity of 2D display with the spatial awareness of 3D representation, allowing operators to accurately grasp distance and spatial relationships without requiring a fully three-dimensional display system.
Solution Approach 2:
The system introduces intermediate visual elements such as grid overlays, distance markers, and virtual reference objects that mediate between the actual physical scene and the operator's perception. These intermediaries provide spatial context and distance information without requiring complex 3D visualization, thus resolving the contradiction between system simplicity and measurement precision.
2Device complexity
If only imaging device is used, then the system is simple, but working efficiency decreases due to lack of spatial awareness
Solution Approach 1:
The patent merges data from multiple sources including imaging devices, attitude detection devices, and distance detection devices into a single integrated display. This combination provides comprehensive spatial information while maintaining system simplicity through unified processing and presentation, thereby improving working efficiency without excessive complexity.
Solution Approach 2:
The system enhances two-dimensional images with three-dimensional spatial data including depth information, distance markers, and positional relationships. This allows operators to quickly assess spatial awareness and make accurate operational decisions, significantly improving working efficiency while adding only moderate system complexity.
3Device complexity
If two-dimensional image display is used, then the display device is simple, but the operator cannot accurately judge the position of working implement
Solution Approach 1:
The patent introduces virtual intermediary elements such as overlay graphics, position markers, and spatial reference lines that are superimposed on the two-dimensional image. These intermediaries provide precise positional information about working implements without requiring complex three-dimensional display hardware, thus achieving high positioning accuracy with simple display devices.
Solution Approach 2:
The system adds depth and spatial dimension information to two-dimensional displays through techniques such as perspective projection, depth cues, and layered visual information. This enables operators to accurately judge the position of working implements in three-dimensional space while using simple two-dimensional display devices.
Data Source
AI summary
An image display system for a work machine includes an imaging device mounted to a work machine including a working unit having a working implement, an attitude detector detecting an attitude of the working unit, a distance detector determining information about distance to an object to be worked by the work machine, and a processor using information about position of the working implement obtained using an attitude of the working unit, and information about position of the object to be worked obtained from the information about distance from the work machine to an object to be worked, determined by the distance detector, generating an image of a portion corresponding to the working implement, on the object to be worked opposing the working implement, combining the generated image with an image of the object to be worked imaged by the imaging device, and displaying the combined image on a display device.