Work Machine Route Display for Remote Depth Perception

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

When remotely operating a work machine, the two-dimensional image display leads to a poor sense of perspective, making it difficult for operators to accurately gauge the distance between working equipment and work objects, which can lower work efficiency.

Innovation Solution

An image display system that calculates the position of working equipment and displays a route image in a form that differs when viewed from a predetermined position, depending on whether the route is shielded by the equipment, thereby enhancing depth perception.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a two-dimensional image display is used for remote operation, then the operation system is simple, but the sense of perspective is poor and distance perception is difficult

Engineering Contradiction:
Improveoperation system complexityVSAvoiddistance perception accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies dimensionality change by displaying the route image in different forms based on whether it is shielded by working equipment. Specifically, shielded portions are displayed with transparency or different visual characteristics while unshielded portions use normal display, creating a multi-dimensional visual representation that conveys depth and spatial relationships on a two-dimensional screen, thereby improving distance perception without adding complex hardware

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If work support information is projected in front of the cab, then information visibility is improved, but depth information cannot be effectively communicated on a two-dimensional screen

Engineering Contradiction:
Improveinformation visibilityVSAvoiddepth information transmission
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent applies local quality by differentiating the display characteristics of different portions of the route image based on their spatial relationship with the working equipment. Shielded portions are displayed with distinct visual properties (such as transparency or different coloring) while unshielded portions maintain normal display characteristics, allowing depth information to be communicated through localized variations in the visual presentation

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12241226B2Image display system of work machine, remote operation system of work machine, work machine, and method for displaying image of work machine
Publication Date: 2025.03.04 KOMATSU LTD
  • US12241226B2 patent drawing
  • US12241226B2 patent drawing
  • US12241226B2 patent drawing

AI summary

There are provided a position calculator that determines a position of working equipment included in a work machine, a display that displays a route image corresponding to a route through which the working equipment moves, and a display processor that causes, on the basis of a position of the route and a position of the working equipment determined by the position calculator, the display to display the route image corresponding to a portion of the route that is shielded by the working equipment with a predetermined position serving as a viewpoint in a form different from the route image corresponding to a portion of the route that is not shielded by the working equipment.