User-Mountable Display System with Multi-Depth Zone Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-worn display systems typically present virtual images at a single focal depth, requiring users to refocus when switching between virtual and real-world objects, and lack efficient methods for accurately superimposing virtual images onto ambient scenes at varying depths.

Innovation Solution

A user-mountable display system with a processing unit that generates range data from ambient image data to determine zones for displaying imagery at multiple fixed depths, using two imaging devices and a database to match virtual images with appropriate focal planes, allowing for the superimposition of virtual images at different depths within the ambient scene.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If virtual images are presented at a single specific focal depth, then the display system is simple to implement, but the user must refocus when switching between virtual and real world objects

Engineering Contradiction:
Improveuser focus adjustmentVSAvoiddisplay system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The display system segments the display function into multiple independent image sources, each responsible for presenting virtual images at a specific focal depth. This allows the system to present images at multiple depths simultaneously without requiring a completely complex reconfigurable system, thus improving ease of operation while keeping complexity manageable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system adds the focal depth dimension to the traditional two-dimensional display plane. By introducing multiple image sources that operate at different focal depths (first focal depth and second focal depth), the system transforms a flat 2D display problem into a 3D display solution, allowing users to view virtual and real objects at different depths without refocusing.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If multiple image sources are used to display virtual images at different focal depths, then users can view virtual images in multiple focal planes without refocusing, but the device complexity increases

Engineering Contradiction:
Improvefocal plane flexibilityVSAvoidnumber of image sources
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Each image source is designed to be multi-functional, capable of presenting different types of virtual images (navigation, instrument, warning) at its designated focal depth. The processing unit intelligently routes different virtual image data to appropriate image sources based on the ambient scene analysis, making the system adaptable to various display scenarios without requiring a completely custom configuration for each case.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system incorporates a feedback loop where the processing unit continuously analyzes ambient scene data and adjusts which virtual images are displayed at which focal depths based on the detected environment. This adaptive feedback mechanism allows the system to automatically optimize the display configuration without requiring manual intervention, thereby managing complexity through intelligent automation.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the display field of view is narrower than the range field of view, then the display can focus on specific zones, but the coverage of the ambient scene is reduced

Engineering Contradiction:
Improvezone identification accuracyVSAvoiddisplay field of view coverage
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The system applies local quality by providing different fields of view for different types of information. The display field of view is optimized for displaying virtual images at specific zones with high precision, while the range device provides broader coverage for ambient scene analysis. This allows the system to maintain both precise zone identification and comprehensive scene awareness by assigning different FOV characteristics to different functional components.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to view virtual images in multiple focal planes without needing to refocus, improving the integration of virtual and real-world objects by generating depth maps for accurate and efficient virtual image placement.

Implementation Method 1

a first imaging device arranged to image a first portion (ABC) of an ambient scene; a second imaging device arranged to image a second portion (DEF) of an ambient scene

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

Generating range data may comprise using parallax determinations

Methodology Applied
Scientific EffectParallax: Parallax

Data Source

PatentEP4459359A1User mountable display system and method
Publication Date: 2024.11.06 BAE SYSTEMS PLC
  • EP4459359A1 patent drawingFigure 1
  • EP4459359A1 patent drawingFigure 2
  • EP4459359A1 patent drawingFigure 3

AI summary

There is disclosed a user-mountable display system (200) comprising: a display device (100) for displaying imagery at a first fixed depth and a second fixed depth, the display device having a display field of view (FOV); a range device (10, 22, 24) for generating ambient image data (AID, CD1, CD2) over a range field of view; a processing unit (50) configured to: receive ambient image data; generate range data using the ambient image data; use the range data to determine a first zone (302) of the ambient scene for display of imagery at the first depth, and a second zone (304) of the ambient scene for display of imagery at the second depth; receive virtual image data (VID) representative of at least two images (43a, 43b) for display as virtual images; and process the virtual image data (VID) to: determine from the virtual image data (VID), a virtual image associated with the first zone (302) or associated with the first depth (6), and distribute such first depth imagery (43a) to the display device (100) for display at the first depth (6), and determine from the virtual image data (VID), a virtual image associated with the second zone (304) or associated with the second depth (7), and distribute such second depth imagery (43b) to the display device (100) for display at the second depth (7).