Work Machine Display System Terrain Ruggedness Representation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display systems for work machines struggle to accurately represent the ruggedness of terrain, particularly on slope grounds, as they either fail to color-code slope surfaces correctly or display small ruggedness with the same color when elevation differences are large, leading to poor work efficiency and perspective recognition.

Innovation Solution

A display system that acquires three-dimensional data from a work machine, converts it into a vehicle body coordinate system, and generates a reference image representing the terrain's three-dimensional shape, with the display form changing based on the distance from the ground surface, allowing for distinct representation of ruggedness on slope grounds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If coloring is changed depending on the elevation with reference to a horizontal plane, then the elevation difference can be displayed, but ruggedness on slope ground cannot be color-coded and displayed

Engineering Contradiction:
Improveelevation display accuracyVSAvoidslope ground representation
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

Instead of coloring the terrain based on absolute elevation from a horizontal plane, the patent inverts the approach by coloring based on relative elevation differences with respect to the work machine's ground surface. This allows ruggedness to be displayed relative to the machine's perspective, making slope grounds properly color-coded while maintaining elevation display accuracy.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent applies different coloring criteria to different regions relative to the work machine. Areas close to the machine use one coloring reference (ground surface), while distant areas use another. This local quality approach enables proper representation of ruggedness on slope grounds while maintaining accurate elevation display in different zones.

Inventive Principle:
Principle #3Local quality

2Device complexity

If all small ruggedness are colored with the same color when a difference in elevation of a target range is large, then the display is simplified, but the ruggedness detail is lost

Engineering Contradiction:
Improvedisplay complexityVSAvoidruggedness recognition accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the terrain display into multiple zones based on distance from the work machine. Each zone has its own coloring reference and scale, allowing small ruggedness details to be preserved in close zones while maintaining overall elevation context in distant zones. This segmentation prevents all ruggedness from being colored uniformly while avoiding excessive display complexity.

Inventive Principle:
Principle #1Segmentation

3Device complexity

If a two-dimensional image is displayed for remote operation, then the system is simple, but the sense of perspective is poor and distance recognition is difficult

Engineering Contradiction:
Improvedisplay system complexityVSAvoidperspective and distance information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent overlays a three-dimensional lattice image representing terrain elevation onto the two-dimensional captured image. This dimensionality enhancement provides perspective and distance information without requiring a complete 3D model, maintaining system simplicity while reducing information loss about terrain topology.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent uses color-coded lattice lines to represent different elevation levels and terrain features. This color encoding conveys three-dimensional terrain information in a two-dimensional display, improving perspective recognition and distance judgment while keeping the display system relatively simple.

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS11908076B2Display system and display method
Publication Date: 2024.02.20 KOMATSU LTD
  • US11908076B2 patent drawing
  • US11908076B2 patent drawing
  • US11908076B2 patent drawing

AI summary

A display system for a work machine includes an acquisition unit configured to acquire three-dimensional data of a plurality of measurement points, a conversion unit configured to convert the three-dimensional data into a vehicle body coordinate system, an image generation unit configured to generate a reference image representing a three-dimensional shape of a terrain based on the three-dimensional data converted into the vehicle body coordinate system, and a display processing unit configured to display the reference image on a captured image in a superimposed manner. The image generation unit decides a display form of the reference image at a position of the reference image corresponding to each measurement point depending on a distance of the measurement point in a normal direction with respect to a ground surface of the work machine.