Integrating Simulated Reality Training with Augmented Reality Guidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual reality systems are expensive to create and manage, while augmented reality systems can lead to overreliance on technology, hindering real-world problem-solving skills and internalization of lessons, especially in scenarios like power outages where communication with AR systems is lost.

Innovation Solution

A method and system that integrate simulated reality training environments with augmented reality environments by receiving feedback from simulated tasks, determining error sources, generating preventative actions, and displaying virtual content in the AR environment to assist users in avoiding errors during real-world tasks, while also updating both environments based on feedback from both domains.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtual reality systems are used for training, then training effectiveness is improved, but cost of creating and managing content increases

Engineering Contradiction:
Improvetraining effectivenessVSAvoidcost of creating and managing content
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges virtual reality training systems with augmented reality field systems into a unified platform. Training content created in VR is automatically adapted and delivered through AR field guides, eliminating the need for separate content creation and management systems. This integration resolves the contradiction by maintaining training effectiveness while reducing overall system cost and complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system creates multi-functional content that serves both training and field operation purposes. A single content asset can be used for VR training simulations and then deployed as AR field guidance, making the system universally applicable across multiple functions. This reduces content creation costs while maintaining training effectiveness.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If augmented reality systems are used for task performance, then user capabilities are expanded, but real-world problem solving skills deteriorate

Engineering Contradiction:
Improveuser capabilitiesVSAvoidreal-world problem solving skills
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system performs preliminary training action in virtual reality before deploying users to field operations with augmented reality. Users first learn and practice procedures in VR training environments, achieving mastery before needing AR assistance. This preliminary training preserves problem-solving skills while still providing AR capabilities for complex tasks.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms that track user performance and AR system usage. When users demonstrate proficiency, the system reduces AR guidance intervention, allowing users to rely more on their own problem-solving skills. This dynamic feedback loop maintains user capabilities while preventing overreliance on AR systems.

Inventive Principle:
Principle #23Feedback

3Productivity

If augmented reality systems are used in field operations, then task performance is enhanced, but reliability in emergency scenarios without system access deteriorates

Engineering Contradiction:
Improvetask performanceVSAvoidperformance without system access
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary training in VR environments where users must complete tasks without AR assistance, simulating emergency scenarios. Users learn to perform critical functions independently before field deployment. This preliminary action ensures reliability in emergency situations while maintaining enhanced task performance when the system is available.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides beforehand cushioning by ensuring users have internalized procedures through VR training before they might need to operate without AR support. This preparatory training creates a buffer that protects against reliability deterioration in emergency scenarios, while still allowing AR enhancement during normal operations.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS20240371292A1System and method for integrating a simulated reality training environment and an augmented reality environment
Publication Date: 2024.11.07 HONEYWELL INTERNATIONAL INC
  • US20240371292A1 patent drawing
  • US20240371292A1 patent drawing
  • US20240371292A1 patent drawing

AI summary

A method is disclosed for integrating a simulated reality training environment and an augmented reality environment. The method comprises receiving simulated reality training feedback associated with performance of a simulated task in the simulated reality training environment; determining a source of error in the performance of the simulated task in the simulated reality training environment based on the simulated reality training feedback; determining a preventative action for preventing occurrence of the source of error during a real-world task to be performed in the augmented reality environment; generating virtual content based on the preventative action to assist a user in avoiding the source of error during the real-world task to be performed in the augmented reality environment; and causing the virtual content to be displayed to the user in the augmented reality environment during performance of the real-world task.