Work Machine AR Display for Obstructed Surroundings Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display technologies for work machines, such as excavators, fail to provide effective visual support when objects around the machine are blocked from view, compromising safety and operational efficiency.
Innovation Solution
A display device equipped with a position information acquisition unit, peripheral information acquisition unit, augmented image generation unit, and display processing unit that superimposes augmented images of the environment, including structures and terrain, onto the operator's field of view from a predetermined viewpoint, correcting errors in display positioning to ensure accurate visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If AR display is used to show work machine components, then position recognition is assisted, but objects around the machine remain blocked from view
Solution Approach 1:
The patent transitions from displaying only work machine components to presenting environmental information from an aerial viewpoint, adding a new dimensional perspective that reveals blocked objects and surrounding terrain that cannot be seen from the operator's cabin position
Solution Approach 2:
The system introduces an aerial viewpoint as an intermediary perspective, using captured images and map data to create a virtual aerial view that mediates between the operator's limited field of view and the complete environmental context, allowing simultaneous awareness of both nearby components and distant obstacles
2Ease of operation
If display device shows only bucket position, then AR assistance is provided, but comprehensive environmental awareness is lost
Solution Approach 1:
The display device evolves from a single-function AR bucket position indicator to a multi-functional system that simultaneously displays work machine components, surrounding terrain, existing structures, and zone boundaries, making it universally applicable for both positioning assistance and environmental awareness
Solution Approach 2:
The system performs preliminary acquisition of environmental information through peripheral information acquisition units that capture images and retrieve map data before the operator needs to make decisions, preparing comprehensive spatial context in advance to prevent safety issues before they occur
Data Source
AI summary
A display device for a work machine includes a position information acquisition unit configured to acquire position information of a work machine, a peripheral information acquisition unit configured to acquire peripheral information indicating an existing structure, terrain, or a boundary of a zone around a position indicated by the position information of the work machine, an augmented image generation unit configured to generate an augmented image in which the existing structure, the terrain, or the boundary of a zone is viewed from a predetermined viewpoint of the work machine, and a display processing unit configured to display the augmented image of the existing structure, the terrain, or the boundary of a zone while superimposing the augmented image on a field of view from the predetermined viewpoint of the work machine or on an image of the field of view.