3D Process Control Mapping With Role-Based AR Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality systems for process control environments are time- and labor-intensive to set up and maintain, particularly in complex layouts with many objects, and can cause sensory overload due to excessive information display, with objects often being obscured or inaccessible.

Innovation Solution

An augmented reality platform that allows users to generate a 3D model of the environment using a mobile device, enabling efficient mapping and updating of objects, and providing filtered information through location tracking and inertial measurement units, with features like virtual x-ray vision and avatar representation for obscured or distant objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional AR systems display all available information in dense environments, then complete information is provided, but sensory overload occurs and user perception becomes difficult

Engineering Contradiction:
Improveinformation completenessVSAvoidsensory overload
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system applies local quality by providing different information densities to different users based on their roles and needs. Operators receive task-specific information subsets rather than all available data, allowing each user to perceive information at an appropriate level without sensory overload while maintaining access to complete information when needed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The information display is segmented into role-based subsets and priority levels. The system divides the complete information set into manageable portions tailored to specific operational contexts and user responsibilities, preventing sensory overload while ensuring relevant information is always available.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If manual 3D modeling is used to create accurate environment models, then modeling precision is improved, but time consumption and labor intensity increase significantly

Engineering Contradiction:
Improvemodeling accuracyVSAvoidmodeling time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary automated 3D mapping of the environment using mobile devices before AR deployment. This pre-established spatial framework allows rapid object placement and environment integration without requiring time-consuming manual modeling during operational setup, while maintaining accurate geometric representations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates digital copies of physical objects and environments using automated scanning and mapping technologies. These digital twins replicate real-world geometries and spatial relationships with high precision, eliminating the need for manual modeling while preserving accurate representations for AR overlay and interaction.

Inventive Principle:
Principle #26Copying

3Loss of information

If the 3D model includes all objects in the environment, then completeness is improved, but system complexity and processing requirements increase

Engineering Contradiction:
Improveenvironmental completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The complete environment model is segmented into region-based or functionally-grouped subsets that are loaded and processed on-demand. The system maintains the full environmental database but only activates and renders relevant portions based on user location, role, and current task context, reducing processing complexity while preserving access to complete environmental information.

Inventive Principle:
Principle #1Segmentation

4Loss of information

If AR systems provide detailed information about all objects, then information completeness is improved, but ease of operation deteriorates due to information overload

Engineering Contradiction:
Improveinformation availabilityVSAvoiduser interaction simplicity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system implements local quality by tailoring information presentation to specific user roles, locations, and task contexts. Operators receive customized information subsets relevant to their responsibilities, while maintaining the ability to access complete object information when needed, thus preserving ease of operation without sacrificing information availability.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11244515B23D mapping of a process control environment
Publication Date: 2022.02.08 FISHER ROSEMOUNT SYST INC
  • US11244515B2 patent drawing
  • US11244515B2 patent drawing
  • US11244515B2 patent drawing

AI summary

In a method of mapping a real-world process control environment, a mobile device is registered at a reference location, and positions and orientations of the mobile device are tracked using an inertial measurement unit. A user input indicating that a new node is to be added to a 3D map of the process control environment is detected, and a 3D position of a real-world object relative to the reference location is determined, or caused to be determined, based on a tracked position and orientation of the mobile device. A node database is caused to add the new node to the 3D map of the process control environment, at least by causing the 3D position of the real-world object to be stored in association with the new node.