Augmented Reality Facility Semantic Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing semantic mapping technologies are inefficient and prone to errors due to manual effort and outdated CAD layouts, leading to confusion and productivity loss in facility optimization.
Innovation Solution
An augmented reality-based facility mapping system using camera and LiDAR sensors to create and update semantic maps in real-time, allowing for simultaneous real-world and AR map modifications with an AR device, which includes fiducials for accurate object identification and properties application.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual map editing is used, then semantic maps can be created, but the process is time-consuming and difficult
Solution Approach 1:
The patent replaces manual mechanical map editing with an automated optical scanning system using mobile devices. The system captures images of facility elements, automatically identifies them through image recognition, and generates semantic maps without manual intervention, thus eliminating the time-consuming manual editing process while maintaining mapping accuracy.
Solution Approach 2:
The system enables self-service mapping by allowing the facility environment to map itself through automated image capture and recognition. Mobile devices automatically scan and identify facility elements, and the system autonomously processes images to generate and update semantic maps without requiring human operators to manually edit each element.
2Productivity
If CAD layouts are converted to semantic maps, then manual effort is reduced, but the maps become outdated and inaccurate
Solution Approach 1:
The patent transforms static CAD-based mapping into a dynamic system that continuously updates semantic maps through repeated automated scanning. The system can capture changes in real-time as facility elements are moved or added, ensuring the maps remain current and accurate while maintaining high productivity through automation.
Solution Approach 2:
The system incorporates feedback mechanisms where newly captured images are continuously compared with existing semantic maps. This feedback loop automatically detects changes in the facility environment and triggers map updates, ensuring reliability and accuracy while maintaining efficient automated operation.
3Productivity
If automated scanning is used, then mapping speed increases, but system complexity increases
Solution Approach 1:
The patent leverages the multi-functionality of standard mobile devices that already possess cameras, processors, and operating systems. By utilizing existing universal hardware and software capabilities, the system achieves high-speed automated scanning without requiring specialized complex equipment, thus increasing productivity while minimizing additional system complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances the speed and accuracy of facility mapping by enabling immediate, real-time modifications and updates, reducing manual effort and ensuring up-to-date information, thus improving operational efficiency.
Implementation Method 1
capture images of the facility environment using sensors like camera devices
Implementation Method 2
capturing the layout of the facility environment using sensors like camera devices and LiDAR devices
Data Source
AI summary
Aspects of augmented reality (AR)-based facility mapping are described. In some examples, an AR device detects optical data using an optical device, and position data using a position detection device. An AR-based modification user interface is displayed using the AR device. The AR-based modification user interface includes an AR map and an AR object. The AR-based modification user interface is generated using the facility data and the sensor data. The AR-based modification user interface identifies a user action that modifies the AR object.