Augmented Reality Overlay for Excavator Positioning Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current excavator technologies lack effective methods for real-time visualization and navigation of underground features during excavation, leading to potential human errors and inefficiencies in material moving operations.
Innovation Solution
An excavator system equipped with a camera, dynamic sensors, and an architecture controller that generates an augmented reality overlay image, superimposing virtual trenches and underground features onto the real-time camera view, allowing for precise positioning and navigation of the excavating implement relative to the terrain.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional excavation methods are used without real-time visualization, then the device complexity is low, but the measurement precision of underground features and the reliability of excavation operations deteriorate
Solution Approach 1:
The patent introduces an intermediary augmented reality system that mediates between the physical excavation environment and the operator. The system uses cameras, sensors, and virtual overlays to create an intermediate visual representation of underground features, allowing operators to see through the earth without physically digging. This intermediary layer provides precise positioning information while maintaining manageable system complexity through modular architecture.
Solution Approach 2:
The patent replaces traditional mechanical measurement and visualization methods with optical and computational systems. Instead of using physical surveying equipment and manual measurements, the system uses cameras, sensors, and computer-generated virtual overlays to provide real-time visualization of underground features and precise positioning information, significantly improving measurement precision.
2Productivity
If real-time augmented reality visualization is implemented, then the productivity of excavation operations is improved, but the use of energy by the machine increases
Solution Approach 1:
The system implements periodic action by updating the augmented reality display at optimized intervals rather than continuously. The camera captures images and the system processes sensor data at discrete time points, generating new virtual overlays only when necessary to maintain accurate positioning. This periodic operation improves productivity through real-time feedback while reducing energy consumption compared to continuous processing.
Solution Approach 2:
The system applies partial action by selectively processing and displaying only the most critical information in the augmented reality overlay. Rather than processing all possible sensor data and visual elements continuously, the system focuses on key positioning information and underground feature visualizations that directly impact excavation efficiency, reducing computational energy requirements while maintaining productivity benefits.
3Reliability
If comprehensive sensor integration and virtual overlay systems are used, then the reliability of excavation operations is improved, but the device complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the complex control architecture into distinct functional modules: sensor data acquisition, image processing, virtual overlay generation, and display control. Each module handles a specific aspect of the system, allowing for independent optimization and maintenance. This modular segmentation improves reliability through better error isolation while managing device complexity through organized system architecture.
Solution Approach 2:
The system implements universality by designing the control architecture to handle multiple functions through a unified platform. The same hardware components (cameras, sensors, processors) serve multiple purposes: capturing visual data, tracking positioning, detecting underground features, and generating virtual overlays. This multi-functionality improves reliability through consistent performance across operations while reducing device complexity by avoiding redundant specialized components.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
A material moving machine including an implement, a camera, an augmented display, and a controller including an image generator. The controller is programmed to store a three-dimensional model of underground features of the terrain, capture an implement image comprising the implement and terrain, generate through the image generator a superimposed image by superimposing corresponding portions of the implement image and the three-dimensional model of underground features, generate a virtual trench based on the position of the implement, overlay the virtual trench on the superimposed image to generate an augmented reality overlay image comprising the virtual trench and the superimposed portions of the implement image and the three-dimensional model of underground features, generate through the image generator the augmented reality overlay image, and display the augmented reality overlay image on the augmented display.