Ground-Projected AR for Working Machine Operator Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators of working machines, such as excavators, face challenges in maintaining focus on their surroundings due to the need to split attention between the work implement and augmented reality information typically displayed on a screen or head-mounted display, which can increase operational risks and reduce efficiency.
Innovation Solution
An information system that projects images onto the surrounding area using an illumination arrangement controlled by a unit receiving construction data and the working machine's location, allowing the operator to focus on the environment without needing a dedicated display, with the image formed based on both the implement's location and external construction information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If augmented reality information is displayed on a screen or head-mounted display, then the operator receives information about the work implement and environment, but the operator must split attention between the display and the work implement, increasing operational risks
Solution Approach 1:
The ground surface acts as an intermediary medium between the information system and the operator. By projecting AR information onto the ground, the system eliminates the need for traditional displays (screens or HMDs) that require the operator to divert attention. The ground becomes a mediator that delivers information directly in the operator's field of view, resolving the contradiction between information delivery and operational safety.
Solution Approach 2:
The system transitions information display from a traditional two-dimensional screen or HMD interface to a three-dimensional spatial projection on the ground surface. This dimensional change allows information to be integrated into the physical workspace, enabling the operator to perceive both the work implement and informational overlays simultaneously without shifting focus, thereby maintaining operational safety while delivering comprehensive information.
2Ease of operation
If a head-mounted display is used to provide augmented reality information, then the operator can see the work implement even when obstructed, but the operator is forced to wear additional equipment that increases complexity and potential risk
Solution Approach 1:
The system extracts the AR information delivery function from the operator's equipment (HMD) and relocates it to the ground surface projection system. This separation eliminates the need for the operator to wear complex HMD equipment while maintaining the ability to see the work implement and receive AR information. The projection system on the ground assumes the informational role previously requiring personal equipment.
3Adaptability or versatility
If information is projected onto the ground surface, then multiple personnel can access information without individual displays, but the projection system must accurately track the working machine's location and orientation
Solution Approach 1:
The ground surface projection system serves multiple functions simultaneously: it displays AR information about the work implement, provides spatial orientation cues, and accommodates multiple operators or personnel in the vicinity. By using the ground as a universal display medium, the system replaces multiple individual displays (one per person) with a single shared projection surface, achieving multi-user accessibility while the tracking system manages the complexity of location and orientation data.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables the operator to maintain focus on the work environment, provides information to multiple personnel without individual displays, and enhances safety by projecting relevant data directly onto the ground surface, reducing the risk of unintentional contact with underground structures.
Implementation Method 1
an illumination arrangement (204) arranged to project an image onto an area (122) externally of said working machine (100)
Data Source
Figure 1
Figure 2
Figure 3A~3B
AI summary
The present disclosure generally relates to an information system (200) for a working machine (100), specifically adapted for projecting an image (206) onto an area (122) externally of the working machine (100) based on construction data relating to a surrounding of the working machine (100). The present disclosure also relates to a corresponding method and computer program for such a working machine (100).