Depth Detection for Work Machine Shadowed Areas

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display control systems for remote operation of work machines, such as hydraulic excavators, cannot detect the distance of construction targets that are in the shadow of the work equipment due to the placement of distance detection devices, limiting the operator's perspective and work efficiency.

Innovation Solution

A display control system that includes a depth detection device positioned to avoid interference from work equipment, generating a three-dimensional map and depth image to display the depth of the construction target, including areas obscured by the work equipment, using a combination of depth and posture detection devices and a display control unit to output a display signal for visualization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the distance detection device is provided in the front portion of the work machine for detecting the distance in an imaging range that includes work equipment, then the operator can have a sense of perspective when the work machine is performed remote operation, but the distance detection device cannot detect a distance of a portion of a construction target that is in a shadow of the work equipment

Engineering Contradiction:
Improvedepth informationVSAvoidshadow interference
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent transitions from two-dimensional image processing to three-dimensional depth detection by introducing a depth detection device that measures actual distance values. This dimensional change allows the system to detect depth information in areas that were previously obscured in 2D images, including regions shadowed by work equipment.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a depth detection device as an intermediary component that bridges the gap between the imaging device and the construction target. This mediator actively measures depth by emitting and receiving signals (such as laser or ultrasound), enabling detection of distances that cannot be obtained through passive imaging alone, including areas shadowed by equipment.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the depth detection device is positioned to avoid interference from work equipment, then the distance of construction targets in shadow areas can be detected, but the detection range may be reduced

Engineering Contradiction:
Improvedepth detection accuracyVSAvoiddetection range
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent combines multiple detection devices at different positions on the work machine. By merging the detection capabilities of multiple devices with overlapping fields of view, the system achieves both accurate depth measurement and comprehensive coverage of the construction area, including regions that would be shadowed by equipment.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent divides the detection task among multiple depth detection devices positioned at different locations on the work machine. Each device covers a specific sector, and their combined data creates a complete three-dimensional map of the construction area, ensuring no regions are missed while maintaining detection accuracy.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11459735B2Display control system, display control device, and display control method
Publication Date: 2022.10.04 KOMATSU LTD
  • US11459735B2 patent drawing
  • US11459735B2 patent drawing
  • US11459735B2 patent drawing

AI summary

A display control system includes a work machine and a display control device. The work machine includes work equipment, a depth detection device configured to detect a depth in a detection range and provided at a position where the work equipment does not interfere with the detection range, and a posture detection device configured to detect a posture of the work machine. The display control device includes a map generation unit configured to generate a three-dimensional map representing a shape around the work machine based on depth information generated by the depth detection device and posture information generated by the posture detection device, a depth image generation unit configured to generate a depth image representing a depth of a range including a position of the work equipment in the three-dimensional map, and a display control unit configured to output a display signal to display the depth image.