Work Machine Panorama View Generation for Wider Surroundings Survey

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Operators of work machines face difficulty in easily surveying a wide range of their surroundings due to limited display views, requiring complex viewpoint switching to assess the environment effectively.

Innovation Solution

A system comprising multiple cameras, a processor, and a display that captures and synthesizes images to generate a panorama moving image from viewpoints moving around the work machine, allowing for easy visualization of a broader area.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras capture images and the controller synthesizes a bird's-eye view image, then the operator can view the surroundings of the work machine, but the range that can be seen on the display is limited and the operator needs to perform complicated operations to switch viewpoints

Engineering Contradiction:
Improveviewable rangeVSAvoidviewing operation
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent applies dynamics by making the viewpoint movable rather than fixed. The processor generates panorama moving images from multiple moving viewpoints around the work machine, allowing the display to dynamically shift perspectives. This eliminates the need for complicated manual viewpoint switching operations while expanding the viewable range, as the system automatically presents multiple dynamic perspectives of the surroundings.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If the controller generates images from different viewpoints by synthesizing multiple camera images, then the operator can check surroundings, but complex viewpoint switching operations are required to view a wider range

Engineering Contradiction:
Improveviewpoint varietyVSAvoidviewpoint switching mechanism
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses copying by generating virtual panorama images from multiple synthesized viewpoints rather than requiring physical camera movement or complex mechanical viewpoint switching. The processor creates copied representations of the surroundings from different virtual perspectives by synthesizing images from multiple fixed cameras, providing viewpoint variety without mechanical complexity.

Inventive Principle:
Principle #26Copying

3Loss of information

If a display shows the work machine and surroundings, then the operator can monitor the environment, but the limited display area restricts the wide-range survey capability

Engineering Contradiction:
Improvesurroundings informationVSAvoiddisplay area
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The patent applies dimensionality change by transitioning from a single fixed bird's-eye view to multiple moving viewpoints around the work machine. The processor generates panorama moving images that effectively add temporal and spatial dimensions to the display, allowing comprehensive surroundings information to be conveyed despite limited physical display area. Operators can view a wider range by navigating through the generated moving images from different virtual perspectives.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12084840B2System and method for work machine
Publication Date: 2024.09.10 KOMATSU LTD
  • US12084840B2 patent drawing
  • US12084840B2 patent drawing
  • US12084840B2 patent drawing

AI summary

A system includes a processor and a display. A plurality of cameras capture surroundings images of a work machine. The processor acquires image data indicative of the surroundings images. The processor synthesizes the surroundings images and generates a panorama moving image from viewpoints that move around the work machine. The display displays, based on a signal from the processor, the panorama moving image from the viewpoints that move around the work machine. The system may include the cameras and the work machine.