XR Event Playback for Infrastructure Equipment Troubleshooting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current infrastructure monitoring systems lack the ability to visually simulate and display events as they occurred on physical equipment, limiting troubleshooting and sequencing capabilities.

Innovation Solution

An extended reality monitoring and control system that combines real-time event data with media content to create a continuous playback of events, allowing users to select viewpoints and compare sequences against known good sequences, using a combination of videos, images, and computer-generated representations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional event log systems are used to track equipment faults and failures, then data can be stored and analyzed, but visual simulation and display of events as they occurred on physical equipment is not possible

Engineering Contradiction:
ImproveEvent visualization capabilityVSAvoidSystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent creates virtual copies of physical infrastructure equipment and their events. Event logs are transformed into visual representations that replicate the actual equipment behavior and fault conditions. This allows users to view and analyze equipment events in a virtual environment without adding physical complexity to the actual infrastructure.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from traditional 2D event log displays to immersive 3D virtual reality representations. Events are displayed in an additional spatial dimension, allowing users to visualize equipment faults and failures in their actual spatial context rather than flat lists or graphs.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If detailed event logs are stored for future analysis, then troubleshooting capability is improved, but the ability to visually simulate events in real-time is limited

Engineering Contradiction:
ImproveTroubleshooting capabilityVSAvoidAnalysis time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent pre-processes and stores event data in structured formats that enable rapid retrieval and visualization. Event logs are organized and prepared in advance with associated visual assets, allowing immediate playback and analysis when troubleshooting is needed, rather than requiring time-consuming data processing during incident response.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides immediate visual feedback when users interact with virtual equipment representations. Fault conditions, event sequences, and equipment states are displayed in real-time as users navigate the virtual environment, enabling rapid diagnostic decision-making without delays associated with traditional analysis methods.

Inventive Principle:
Principle #23Feedback

3Quantity of substance

If system-wide event logs are maintained in list and data graph format, then data storage is efficient, but visual simulation of events on actual equipment is not achievable

Engineering Contradiction:
ImproveEvent data storage efficiencyVSAvoidEvent contextual information
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The patent segments event data into discrete, manageable units that can be individually processed and visualized. Each event is broken down into components that can be mapped to specific virtual equipment elements, allowing efficient storage of structured data while enabling rich visual reconstruction of event contexts through assembly of these segments.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12189381B2Extended reality playback of events for manufacturing, installation, operation, maintenance and repair of infrastructure equipment
Publication Date: 2025.01.07 ASCO POWER TECHNOLOGIES LP
  • US12189381B2 patent drawing
  • US12189381B2 patent drawing
  • US12189381B2 patent drawing

AI summary

System and methods for monitoring and control infrastructure equipment uses extended reality playback to monitor such infrastructure equipment. The system and method advantageously blends videos and images of physical equipment with computer-generated representations of events to enable playback of the events, including any user interactions with the equipment. The extended reality playback presents events captured by real-time event logs for the infrastructure equipment using extended reality media content. The playback is composed of a real-time sequence of media content depicting one or more equipment operations corresponding to the events as a continuous presentation. The real-time sequence can then be displayed in real time and stored for subsequent playback at any time by a user. The real-time sequence can also be compared to a verified “golden” sequence to detect errors in the infrastructure equipment.