Aircraft Perspective View Using Photo-Based 3D Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current aircraft display systems, such as primary flight displays (PFDs), provide a schematic and inaccurate representation of the surrounding environment, which can be hazardous for navigation due to limited resolution and accuracy of data from radar-based height profiles, leading to potential discrepancies between the displayed view and the actual view outside the cockpit.

Innovation Solution

A method and system that utilize a photo-based three-dimensional model of the Earth's surface with spatially correlated texture to generate a fully realistic perspective view, incorporating primary flight symbology and real-time validation using onboard sensors to ensure accurate and reliable data presentation, allowing pilots to navigate safely by minimizing the difference between the displayed view and the actual view through the window.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If radar-based height profile data is used to generate a synthetic view on the PFD, then the system can provide a representation of the surrounding environment, but the resolution and accuracy are limited (around 3 arc-seconds, approximately 90 metres), leading to potential hazards for navigation

Engineering Contradiction:
Improveresolution and accuracy of surrounding representationVSAvoidnavigation safety
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent uses photo-based three-dimensional models with spatially correlated textures to create photorealistic copies of the actual surrounding environment, replacing the schematic radar-based representations. This allows the display to show a faithful visual copy of what the pilot would see through the window, with accurate building heights, mountain positions, and ground features, thereby resolving the contradiction between representation quality and navigation reliability

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent substitutes radar-based measurement systems with photo-based imaging systems. Instead of using radar tomography to generate height profiles, the system uses photogrammetry and spatially correlated textures from optical imagery, replacing the mechanical/radar measurement approach with an optical imaging approach that provides superior visual fidelity and accuracy for navigation purposes

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If a schematic synthetic view is displayed on the PFD, then the system can show surrounding information, but the view does not match the actual view through the window, requiring pilot adaptation time

Engineering Contradiction:
Improvepilot adaptation timeVSAvoidrealism of surrounding representation
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system creates photorealistic copies of the actual surrounding environment using photo-based three-dimensional models and spatially correlated textures. This ensures the displayed view is a faithful reproduction of what the pilot would see through the window, eliminating the need for adaptation time while preserving complete visual information about the surrounding environment

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent changes the parameters of the display representation from schematic and abstract to photorealistic and detailed. By using high-resolution photo-based imagery with accurate spatial correlations, the system transforms the display from a simplified symbolic representation to a realistic visual copy, thereby improving ease of operation without losing information

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If photo-based three-dimensional models with spatially correlated texture are used, then a fully realistic perspective view can be provided, but the system complexity increases

Engineering Contradiction:
Improveaccuracy of perspective viewVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary actions by pre-processing and storing three-dimensional photo-based models with spatially correlated textures in a database before flight. This allows the aircraft system to quickly retrieve and display accurate perspective views without performing complex real-time processing during flight, thereby maintaining high accuracy while managing system complexity through offline preparation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary database that stores pre-processed photo-based three-dimensional models and spatially correlated textures. This intermediary structure allows the system to separate the complex data processing from the real-time display operation, enabling accurate perspective views to be generated by simply retrieving and rendering pre-computed data rather than performing complex calculations during flight

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3482163B1Displaying system and method for displaying a perspective view of the surrounding of an aircraft in an aircraft
Publication Date: 2021.06.23 SAAB AB
  • EP3482163B1 patent drawingFigure 1~2
  • EP3482163B1 patent drawingFigure 3
  • EP3482163B1 patent drawingFigure 4a~4b

AI summary

The present disclosure relates to a method (300) for displaying a perspective view of the surrounding of an aircraft (100) in an aircraft. The method comprises accessing (310) surrounding information from a database. The surrounding information is photo-based and three-dimensional. The method further comprises processing (320) the accessed surrounding information so that a perspective view of the surrounding of the aircraft is provided. The perspective view of the surrounding correlates to the position of the aircraft and is photo- based with spatially correlated photo-based textures. The method further comprises transmitting (360) the provided perspective view of the surrounding of the aircraft to a displaying unit so that it can be displayed in the aircraft. The present disclosure also relates to a system, an aircraft, a use, a computer program, and a computer program product.