Construction Machine Windshield AR Display With GNSS Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) technologies face challenges in providing high-accuracy positioning and safety for machine operators in the construction industry, as they are often unsuitable due to safety requirements and difficulties in linking AR devices with high-accuracy positioning data.
Innovation Solution
An AR display system that detects the position and orientation of a construction machine using GNSS and orientation sensors, and projects AR elements onto the windshield, allowing for accurate alignment with real-world and design objects, enhancing operator safety and efficiency by providing virtual elements that correspond to the machine's implement, design, and surrounding environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If head-mounted AR devices are used to display digital models, then AR functionality is provided, but safety requirements for machine operators are not met and positioning accuracy is insufficient
Solution Approach 1:
The patent uses the machine's existing windshield as an intermediary display surface instead of head-mounted devices. The projection system casts AR elements onto the windshield, which the operator can view without wearing additional equipment. This resolves the safety issue by eliminating head-mounted devices while maintaining AR functionality through the windshield intermediary.
2Measurement precision
If AR devices are linked with positioning data, then location accuracy is improved, but device complexity increases
Solution Approach 1:
The patent merges the AR display system with the machine's existing positioning and orientation sensors. By integrating the projection system with the GNSS receiver and orientation sensor already present on the construction machine, the system achieves high positioning accuracy without adding separate complex AR tracking devices. The controller coordinates all components using a unified coordinate system transformation approach.
Solution Approach 2:
The system uses the construction machine's own built-in sensors (GNSS receiver and orientation sensor) to provide positioning and orientation data for the AR display, rather than requiring external or additional specialized sensors. This self-service approach reduces system complexity while maintaining high positioning accuracy through the machine's existing capabilities.
3Reliability
If AR elements are displayed on windshield, then operator safety is improved, but alignment precision with real-world objects becomes challenging
Solution Approach 1:
The system continuously transforms coordinates between the world reference frame and machine reference frame based on real-time positioning and orientation data. This feedback loop ensures that AR elements remain accurately aligned with real-world objects as the machine moves, maintaining alignment precision while the operator views information through the windshield display.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system enables high-accuracy display of AR elements on a construction machine's windshield, improving operator safety and efficiency by aligning virtual elements with real-world and design objects, thus assisting operators in carrying out construction tasks without diverting attention from the operation.
Implementation Method 1
the position of the construction machine in the world reference frame is detected using a machine position sensor that is mounted to the construction machine. In some embodiments, the machine position sensor is a Global Navigation Satellite System (GNSS) receiver.
Implementation Method 2
the orientation of the construction machine is detected using a machine orientation sensor that is mounted to the construction machine.
Implementation Method 3
the position of the operator in the machine reference frame is detected using an operator position sensor that is mounted to the construction machine. In some embodiments, the operator position sensor is a camera that is configured to capture an image of the operator.
Implementation Method 4
the display system includes a projector that projects the AR elements onto a windshield of the construction machine.
Data Source
Figure 1A~1C
Figure 2A
Figure 2B
AI summary
Disclosed are techniques for displaying AR elements on a display system of a construction machine. A position of the construction machine in a world reference frame is detected. An orientation of the construction machine is detected. A position of an operator of the construction machine in a machine reference frame is detected. A position of the operator in the world reference frame is determined based on the position of the operator in the machine reference frame, the position of the construction machine in the world reference frame, and the orientation of the construction machine. The AR elements are generated based on the position of the operator in the world reference frame and a position of the display system in the world reference frame. The AR elements are then displayed on the display system.