AR Device Visualizing Industrial Plant Network Connections

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality devices fail to effectively visualize the network of connections within industrial plants, making it difficult for users to understand which sensors or actuators would be affected by changes to the control system, leading to potential errors in plant operation.

Innovation Solution

An augmented reality device equipped with a processing unit that processes data from sensors and actuators, and a display unit that overlays a virtual model of the industrial plant's components and connections onto the real environment, using GPS or local position data to provide a clear representation of all plant components and their connections, with visible indicators for non-visible components and selective highlighting of selected components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the AR device displays only the control and its immediate connections, then the display remains clear and simple, but the user cannot recognize the broader network of connections between sensors, actuators, and controls across the industrial plant

Engineering Contradiction:
Improvevisibility of plant network connectionsVSAvoidcomplexity of displayed information
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the industrial plant network into multiple hierarchical levels: control components (PLC, HMI), sensor components, and actuator components. Each level can be displayed independently or combined based on user needs, allowing comprehensive network visualization without overwhelming the display with all information simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a spatial dimension to the display by showing the physical locations of control components, sensors, and actuators within the industrial plant. The display unit presents components at their actual spatial positions rather than in a flat hierarchical structure, enabling users to understand both network connections and physical relationships simultaneously.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the AR device shows all plant components and connections, then the user can see the complete network, but the display becomes cluttered and difficult to navigate

Engineering Contradiction:
Improvecompleteness of network informationVSAvoidease of navigation in plant network
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent implements dynamic display capabilities where the AR device adapts the displayed information based on user interactions. Users can select specific control components, sensors, or actuators to focus on, and the display dynamically adjusts to show relevant connections and details while hiding unrelated elements, maintaining clarity while providing comprehensive information on demand.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent introduces selection mechanisms and filtering capabilities as intermediaries between the complete plant network data and the user's view. Users can selectively activate or deactivate specific components and their connections, allowing them to navigate the network systematically by focusing on one area or relationship type at a time while knowing the complete network structure exists.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If the AR device displays detailed connection information, then the user can understand system relationships, but the user cannot easily locate specific components in the physical plant

Engineering Contradiction:
Improvevisibility of connection relationshipsVSAvoidaccuracy of component location
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent integrates spatial location information directly into the display by showing control components, sensors, and actuators at their actual physical positions within the industrial plant. The display unit uses position data to render components in their correct spatial context, allowing users to simultaneously understand connection relationships and locate components in the physical environment without separate mapping steps.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent implements feedback mechanisms where the system continuously tracks the user's position and orientation relative to plant components. The display adjusts in real-time to show relevant components and connections based on the user's current location, providing directional guidance and confirming the user's spatial context, thereby improving both location accuracy and relationship understanding.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10878241B2Augmented reality device
Publication Date: 2020.12.29 SICK AG
  • US10878241B2 patent drawing
  • US10878241B2 patent drawing
  • US10878241B2 patent drawing

AI summary

An augmented reality device includes a processing unit adapted to process data, and a display unit with a field of view, which is adapted to display a control, control components and first connections between the control components as an extended real image, The control receives sensor data from at least one sensor and transmits actuator signals to at least one actuator of an industrial plant. The processing unit processes from the data a model of the industrial plant with the control, the sensor, the actuator and second connections as plant components, and processes position data of the plant components into the model. The position data of the display unit can be transmitted to the processing unit as GPS data by means of satellites or local position data by means of local sensors, and the processing unit processes the position data of the display unit into the model.