Work Machine AR Display for Hidden Structure Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display technologies for work machines, such as excavators, fail to provide visual support when objects around the machine are blocked, hindering safe operation due to poor visibility of structures, terrain, or zone boundaries.
Innovation Solution
A display device configured with a position information acquisition unit, peripheral information acquisition unit, augmented image generation unit, and display processing unit that superimposes augmented images of structures, terrain, or zone boundaries onto the operator's field of view from a predetermined viewpoint, ensuring visibility even in obstructed conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If AR display is used to show work machine parts, then visibility of machine components is improved, but visibility of surrounding objects blocked by the machine remains insufficient
Solution Approach 1:
The system creates a virtual copy of the surrounding environment (structures, terrain, zone boundaries) and displays it as an augmented image overlaid on the operator's field of view. This virtual copy compensates for the loss of visual information caused by the machine blocking the operator's view of surrounding objects.
Solution Approach 2:
The system introduces an intermediary layer (the augmented image display system) between the operator and the physical environment. This intermediary provides visual information about surrounding objects that would otherwise be blocked, while not interfering with the direct view of machine components.
2Device complexity
If traditional display methods are used, then device complexity is low, but operational safety is compromised due to poor visibility
Solution Approach 1:
The display device serves multiple functions: it displays machine component information (traditional AR function) and simultaneously provides environmental awareness information (new function). This multi-functionality addresses both visibility needs without requiring separate systems.
Solution Approach 2:
The system transitions from traditional 2D display screens to a multi-dimensional augmented reality display that overlays information directly in the operator's field of view. This dimensional change allows simultaneous presentation of machine component data and environmental information in spatial context.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
An appropriate operation is performed for a work machine. A position information acquisition unit (43) configured to acquire position information of a work machine (100), a peripheral information acquisition unit (31, 411) configured to acquire peripheral information indicating an existing structure, terrain, or a boundary of a zone around a position indicated by the position information of the work machine (100), an augmented image generation unit (32, 412) configured to generate an augmented image in which the existing structure, the terrain, or the boundary of a zone is viewed from a predetermined viewpoint (E1) of the work machine (100), and a display processing unit (33, 413) configured to display the augmented image (AR1, AR2) of the existing structure, the terrain, or the boundary of a zone while superimposing the augmented image (AR1, AR2) on a field of view from the predetermined viewpoint (E1) of the work machine (100) or on an image (R1, R2) of the field of view.