AR Virtual X-Ray Vision for Hidden Process Control Assets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) systems in process control environments face challenges such as time- and labor-intensive 3D model creation, sensory overload, and difficulty in displaying information for objects obscured or at inconvenient locations, due to complex layouts and frequent changes in equipment.
Innovation Solution
An AR platform that allows users to generate a 3D model using a mobile device, employing location tracking and fusion of inertial measurement unit (IMU) and camera data for positioning, enabling the addition of nodes (objects) and providing augmented information through a database, with features like virtual x-ray vision and avatar representation for hidden or distant objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If 3D models are manually constructed by human designers or using 3D scanners, then the model accuracy and detail are improved, but the time and labor required increase significantly
Solution Approach 1:
The system enables users to generate and update 3D models themselves using mobile devices without requiring professional designers or complex scanning equipment. The mobile device captures images and automatically processes them into 3D models, making the system self-sufficient and eliminating dependency on external expertise.
Solution Approach 2:
The patent replaces manual modeling operations and complex scanning mechanisms with software-based image processing algorithms running on mobile devices. The mechanical process of manual construction or scanning is substituted with computational methods that automatically generate 3D models from captured images.
2Loss of information
If AR systems display information for all objects in dense environments, then the information completeness is improved, but sensory overload occurs and user perception becomes difficult
Solution Approach 1:
The system applies different information display strategies to different spatial contexts. In dense environments, it selectively displays information based on object importance, user proximity, and contextual relevance rather than uniformly displaying all object information, thereby maintaining completeness while avoiding overload.
Solution Approach 2:
The system displays only the necessary subset of information rather than all available information. It provides partial action by showing critical data points and hiding less relevant details, allowing users to access complete information on demand while maintaining a clean default view that prevents sensory overload.
3Ease of operation
If physical access to dangerous or distant areas is required to view object information, then the information accessibility is improved, but worker safety is compromised
Solution Approach 1:
The system creates virtual copies or representations of distant or dangerous objects and displays them in the user's current location through AR. Instead of requiring physical presence at the object location, the system projects 3D models and information overlays that replicate the remote object's data and visual characteristics, making information accessible without physical exposure to hazards.
4Manufacturing precision
If the entire modeling process is repeated after environment changes, then the model accuracy is maintained, but the productivity decreases
Solution Approach 1:
The system performs preliminary actions by continuously capturing images of the environment in the background and pre-processing them into 3D model updates. When changes occur, the system has already prepared updated models, eliminating the need to restart the entire modeling process and maintaining accuracy without sacrificing productivity.
Solution Approach 2:
The system maintains continuous operation by automatically detecting environmental changes and incrementally updating 3D models in real-time. Rather than stopping to remodel entirely, the system continues capturing images and progressively updates the model, ensuring continuous availability of accurate information while improving efficiency.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Facilitates efficient 3D model generation and updates, reduces sensory overload, and improves worker safety by providing relevant information without the need to physically access dangerous areas, while allowing for flexible interaction with various software applications and content delivery.
Implementation Method 1
employing location tracking and fusion of inertial measurement unit (IMU) and camera data for positioning
Data Source
AI summary
In a method of providing virtual enhanced vision to a user of an augmented reality (AR) mobile device, it is determined that a first node associated with a map of a process control environment corresponds to a first real-world object currently within a field of view of a camera of the AR mobile device. A relationship between the first node and one or more other nodes is determined, with the relationship indicating that one or more other objects corresponding to other nodes are at least partially obscured by the first object. At least partially in response to determining the relationship, one or more digital models or images depicting the other object(s) is/are retrieved from memory. A display of the AR mobile device is caused to present the retrieved digital models or images to the user while the first object is in the field of view of the camera.