Wearable AR Display for Simulator Depth Perception

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current simulator technologies fail to provide true stereoscopic depth perception and have a large physical footprint, limiting situational awareness for pilots in training environments, especially when configured for two users.

Innovation Solution

A display system comprising a main display and a wearable see-through display, with a control unit that generates and filters images to provide augmented reality, using cameras to capture the user's line of view and synchronize image display to create a stereoscopic experience, reducing the physical footprint and enhancing depth perception.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If wide field of view displays are used to provide immersive visual environment, then situational awareness is improved, but true stereoscopic depth perception cannot be provided and physical footprint increases

Engineering Contradiction:
Improvesituational awarenessVSAvoidphysical footprint
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The display system is segmented into a main display for wide field of view coverage and a wearable display for stereoscopic depth perception. The main display handles the peripheral and central visual field while the wearable display provides binocular 3D images, dividing the functions to resolve the contradiction between immersive coverage and depth perception capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system merges the main display and wearable display into a coordinated dual-display configuration. The wearable display is positioned to align with the user's eyes and receives stereoscopic images synchronized with the main display, combining the advantages of wide field of view and true 3D perception while maintaining a compact physical footprint.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of information

If wide field of view displays are used to provide immersive visual environment, then situational awareness is improved, but stereoscopic depth perception is lost

Engineering Contradiction:
Improvesituational awarenessVSAvoiddepth perception
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The display system is segmented into a main display for wide field of view coverage and a wearable display for stereoscopic depth perception. The main display handles the peripheral and central visual field while the wearable display provides binocular 3D images, dividing the functions to resolve the contradiction between immersive coverage and depth perception capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different parts of the visual field are provided with different qualities: the main display provides wide field of view coverage for situational awareness, while the wearable display provides high-quality stereoscopic images specifically at the user's line of sight, ensuring true depth perception where it is most needed.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If sequential display of first and second set of images is used, then stereoscopic effect is achieved, but image crosstalk may occur without proper filtering

Engineering Contradiction:
Improvestereoscopic effectVSAvoidimage crosstalk
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system uses periodic action by sequentially displaying the first and second sets of images in alternating frames synchronized with the liquid crystal shutter. The shutter opens and closes in periodic cycles to allow each eye to see only its designated image, achieving the stereoscopic effect while preventing image crosstalk through time-division multiplexing.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system employs feedback through synchronization between the control unit, display device, and liquid crystal shutter. The control unit coordinates the sequential display of stereoscopic image pairs with the shutter's opening and closing cycles, ensuring that each eye receives the correct image at the correct time, thereby eliminating crosstalk while maintaining the stereoscopic effect.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively provides enhanced situational awareness by offering stereoscopic augmented reality to users, improving depth perception and reducing the physical space required for simulators, allowing for more immersive and effective training for pilots.

Implementation Method 1

The passive filter comprises a polarization glass device for allowing the user to see images having a given polarization, the images of the first set having the given polarization and the images of the second set having a polarization different from the given polarization

Methodology Applied
Scientific EffectPolarization: Polarisation

Implementation Method 2

the shutter device comprises a liquid crystal shutter

Methodology Applied
Scientific EffectLiquid crystal: Liquid Crystals

Data Source

PatentUS10567744B1Camera-based display method and system for simulators
Publication Date: 2020.02.18 CAE INC
  • US10567744B1 patent drawing
  • US10567744B1 patent drawing
  • US10567744B1 patent drawing

AI summary

A display system for a simulator comprising: a first display for displaying a simulated scene, the first display being positionable away from a user; a second display for displaying a portion of the simulated scene, the second display being wearable by the user; at least one camera for capturing video images along a line of view of the user; a filter for filtering a portion of a field of view of the user; and a control unit configured for: receiving environment images, the environment images comprising a first set of images of the simulated scene, a second set of images of the simulated scene and at least a third set of images of a portion of the simulated scene; displaying the first and second set of images on the first display; generating augmented reality images based on the video images and the at least a third set of images; and displaying the augmented reality images on the second display.