Hybrid Visual Overlay Training System for Real-Time Collision Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing training simulators for high-risk operations like air to air refueling and heavy duty crane operations lack the realism of real-life conditions, posing risks and inefficiencies, as they transition from fully virtual to fully real environments without intermediate training steps.

Innovation Solution

A training system that overlays real images of a device with virtual apparatus images, controlling depth order and simulating responses based on real and virtual device positions and behaviors, allowing for real-time evaluation of contact, collision, or aerodynamic interference, thereby recreating realistic scenarios without actual risks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If fully virtual training environments are used, then operator safety is improved and training costs are reduced, but training realism and effectiveness deteriorate

Engineering Contradiction:

Improveoperator safetyVSAvoidtraining realism

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The patent combines virtual and real environments by overlaying virtual apparatus images onto real device images, creating a hybrid training system that merges the safety benefits of virtual simulation with the realism of actual equipment operation

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The system uses an intermediary overlay mechanism that places virtual training elements over real device views, allowing trainees to interact with virtual objects while viewing real equipment, thus bridging the gap between fully virtual and fully real training

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If fully real training conditions are used, then training realism is improved, but operator safety and equipment risk deteriorate

Engineering Contradiction:

Improvetraining realismVSAvoidoperator safety

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent creates virtual copies of apparatus and objects that can be interacted with safely, allowing realistic training scenarios to be rehearsed without actual risk to operators or equipment

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system prepares training scenarios in advance using virtual overlays that cushion the transition to real operations, allowing trainees to practice hazardous maneuvers in a protected environment before encountering actual risks

Inventive Principle:

Principle #11Beforehand cushioning (Prior cushioning)

3Reliability

If ground console simulation with synthetic images is used, then training safety is improved, but training effectiveness and real-life situation recreation deteriorate

Engineering Contradiction:

Improvetraining safetyVSAvoidreal-life situation recreation

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The patent replaces the traditional ground-based mechanical simulation system with a visual overlay system that presents virtual training elements directly over real device views, substituting synthetic image generation with real-time visual composition

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS8911236B2Training method and system comprising mixed real and virtual images

Publication Date: 2014.12.16 EADS CONSTRS AERONAUTICAS

AI summary

Training method for the simulation of an operation performed by at least one device which is part of a real apparatus, wherein the method comprises providing to display means overlaid images under controlled depth order of a virtual apparatus, and real images of said device, and providing a simulated response to control means, based on data of the position and behavior of said device and on data of the position and behavior of said virtual apparatus.