Augmented Reality Training Overlay for Real-World Terrain

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current military training simulations are limited by their virtual environments, which lack physical correlation to real-world settings, reducing training effectiveness and being resource-intensive to build and maintain, while real-world training is costly and sometimes dangerous.

Innovation Solution

A computer system with augmented reality capabilities that renders virtual training elements in real-world environments, using sensors and a centralized control center to correlate terrain maps and project virtual elements at specific real-world locations, allowing trainees to interact with immersive and realistic battlefield scenarios.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtual environment simulations are used to reduce costs and improve safety, then training safety and cost-effectiveness are improved, but training effectiveness and realism deteriorate due to lack of physical correlation with real-world environments

Engineering Contradiction:
Improvetraining safetyVSAvoidtraining realism
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent introduces augmented reality technology as an intermediary that overlays virtual training elements onto the real-world environment. This mediator allows trainees to interact with virtual objects (such as virtual enemies, weapons, or obstacles) while physically navigating real terrain, thereby maintaining both safety and realism simultaneously. The augmented reality interface acts as the intermediary layer that bridges the virtual and physical worlds.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent merges virtual training elements with the real-world environment by superimposing digital objects onto physical locations. The system combines virtual reality components (simulated battlefield elements) with real-world terrain and features, creating a hybrid training environment that preserves the authenticity of physical navigation while incorporating the safety and controllability of virtual simulations.

Inventive Principle:
Principle #5Merging (Combining)

2Manufacturing precision

If virtual environments are built with detailed databases to improve realism, then training authenticity is improved, but time and resource requirements increase

Engineering Contradiction:
Improveenvironmental detailVSAvoiddatabase building time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Instead of building comprehensive virtual databases of entire environments, the patent uses augmented reality to copy and project only the necessary virtual training elements onto relevant real-world locations. This selective copying approach creates detailed training scenarios where needed without requiring exhaustive pre-modeling of entire environments, significantly reducing database construction time and resources.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary setup by pre-positioning virtual training elements at strategically important real-world locations rather than creating complete virtual environments. This preliminary action focuses computational resources on critical training areas, achieving high realism where it matters most while minimizing overall database building time and resource expenditure.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If real-world training environments are used to improve training effectiveness, then training realism is improved, but cost and safety risks increase

Engineering Contradiction:
Improvetraining realismVSAvoidtraining safety
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The augmented reality system serves as a protective intermediary layer between trainees and real-world dangers. It overlays virtual hazard indicators, safety boundaries, and contextual information onto the real environment, allowing trainees to recognize and respond to potential threats without actually exposing them to dangerous situations. The intermediary layer provides safety guidance while maintaining realistic training conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Loss of energy

If simulated equipment is used to reduce resource requirements, then cost and resource efficiency are improved, but interaction authenticity deteriorates

Engineering Contradiction:
Improveresource efficiencyVSAvoidinteraction authenticity
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

The patent replaces physical simulated equipment with augmented reality interfaces that provide tactile and visual feedback through digital means. Instead of using heavy mechanical simulators or physical replicas of equipment, the system uses lightweight augmented reality displays and haptic feedback mechanisms to convey equipment interactions, significantly reducing resource requirements while maintaining authentic interaction experiences through sensory substitution.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10726735B1Simulation and training with virtual participants in a real-world environment
Publication Date: 2020.07.28 ROCKWELL COLLINS INC
  • US10726735B1 patent drawing
  • US10726735B1 patent drawing
  • US10726735B1 patent drawing

AI summary

A computer system with an augmented reality display renders one or more virtual training elements in a real world environment. Cameras analyze the local real-world environment to produce a detailed terrain map which is used to more accurately locate the virtual training elements. The cameras also track the movement of the trainee by recognizing terrain features and deriving such movement based on changes from one scan to the next, and potentially based on GPS and inertial management unit data. A centralized computer system correlates terrain maps from a plurality of trainees and defines real-world locations for virtual training elements, then transmitting the virtual training elements to the plurality of trainees.