AR Bucket Overlay for Excavator Distance-Aware Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional display control devices for work machines, such as excavators, do not provide adequate graphical assistance during a series of operations, including rotating and moving, which can lead to interference with the perception of distance and inefficient work performance.
Innovation Solution
A display control device that acquires a video of the work area, incorporates three-dimensional terrain information, calculates the bucket's position based on the work machine's attitude, and generates augmented reality (AR) images to overlay on the video, providing clear visual assistance for the operator.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a figure is superimposed on the video to assist operation, then work assistance is improved, but the video may be hidden and perception of distance is interfered with
Solution Approach 1:
The patent applies local quality by displaying the first figure (bucket position) with high visibility in the first region, while displaying the second figure (terrain information) with adjusted transparency or positioning in the second region to avoid obscuring the video. This allows different parts of the AR display to have different visual properties optimized for their specific function.
Solution Approach 2:
The patent uses AR technology to overlay graphical figures in the third dimension on top of the 2D video feed. By utilizing the Z-depth dimension, the system provides additional information without blocking the underlying video, allowing operators to perceive both the real-world video and virtual graphical information simultaneously.
2Device complexity
If a simple figure display is used, then device complexity is reduced, but appropriate work assistance during series of operations is not provided
Solution Approach 1:
The patent implements dynamic display adaptation by switching between different figure display modes based on the work machine's operational state. During excavation operations, the first figure highlighting bucket position is displayed; during rotation or movement, the second figure providing terrain context is displayed. This dynamic adaptation allows the system to provide appropriate assistance for each operation type without requiring a completely different system for each case.
Solution Approach 2:
The AR display system is designed to be universal by incorporating multiple figure types (first figure for bucket position, second figure for terrain information) that can be activated based on operational needs. This multi-functional approach allows a single display system to provide appropriate assistance for various operations including excavation, rotation, and movement, eliminating the need for separate specialized systems.
3Productivity
If graphical display is provided during series of operations, then work efficiency is improved, but interference with distance perception may occur
Solution Approach 1:
The patent applies local quality by providing different visual treatments for different types of graphical information. The first figure (bucket position) uses high-contrast, prominent display to ensure precise position awareness, while the second figure (terrain information) uses semi-transparent or less prominent display to provide contextual information without interfering with depth perception. This localized optimization allows work efficiency improvement while preserving distance perception.
Data Source
AI summary
An appropriate graphical display during a series of operations of a work machine is made possible. This display control device acquires three-dimensional terrain information indicating a shape of a terrain of the area for work. Information regarding an attitude of the work machine is acquired to calculate a position of the bucket in the area for work. An AR image is generated on the basis of the terrain information and the position of the bucket, and the AR image to be overlaid over the video of the area for work is displayed on the display. The generated AR image includes a first figure highlighting the position of the bucket, and a second figure highlighting a part of a second region adjacent to a first region, the first region including a portion in which the first figure is projected in a vertical direction or a front-rear direction of the work area.