Augmented Reality Overlay for Obstructed Work Implement Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators of machines with work implements, such as excavators and dozers, face challenges in visualizing the position and orientation of obstructed work implements, which can lead to misalignment and inefficient operation, especially when the view is obstructed by the implement's position or environment.
Innovation Solution
The implementation of an augmented reality system using a controller that generates an overlay indicating the working edge or point of the implement, superimposed on an operator display device, allowing the operator to see the implement's position and orientation even when obstructed, by combining implement dimensional data with position data from sensors and projecting this information onto a transparent display screen or head-mounted display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the work implement is positioned to perform work at the worksite, then the working capability is improved, but the visibility of the working edge or point is obstructed
Solution Approach 1:
The system creates a visual copy (overlay) of the work implement's position and orientation based on sensor data, displaying it on the operator interface. This virtual representation allows the operator to see the implement's location even when physically obstructed, resolving the visibility problem while maintaining full working capability
Solution Approach 2:
The system introduces an intermediary visual representation (the overlay display) between the operator and the actual work implement. This intermediary provides indirect visualization of the implement's position through computational rendering based on sensor inputs, enabling the operator to monitor the working edge without direct line of sight
2Productivity
If the work implement is positioned to perform work at the worksite, then the working capability is improved, but the alignment accuracy deteriorates due to obstructed view
Solution Approach 1:
The system continuously receives position data from sensors on the work implement and updates the overlay display in real-time. This feedback loop provides the operator with current information about implement position and orientation, enabling precise alignment adjustments even when the actual implement is obstructed from view
Solution Approach 2:
By creating an accurate visual copy of the implement's position based on sensor data, the system allows the operator to monitor and adjust alignment precision through the overlay display, maintaining manufacturing precision despite physical obstructions
3Productivity
If the work implement is positioned to perform work at the worksite, then the working capability is improved, but the operational efficiency deteriorates due to obstructed view
Solution Approach 1:
The system maintains continuous visualization of the work implement through the overlay display, which is updated in real-time based on sensor data. This continuous information flow allows the operator to work without interruption or delays caused by needing to reposition to see the implement, maintaining operational efficiency while the implement performs work in obstructed positions
Data Source
AI summary
The disclosed strategy and method assists in controlling a machine equipped with a work implement for performing work at a worksite. The work implement can be positioned around the worksite such that the implement is obstructed from view through an operator display device through which the worksite is visible. A controller or the like determines the position of the work implement and generates an augmented overlay. The augmented overlay is displayed on the operator display device superimposed over the worksite indicating the position of the work implement.