Synchronized 3D Model and Video Display for Aircraft Assembly

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies for displaying complex objects like aircraft lack synchronized, photorealistic representations of both as-built and as-designed conditions, with existing panoramic image-based viewers unable to show current versions and 3D model visualization systems failing to provide accurate, photorealistic views of the physical assembly condition.

Innovation Solution

The integration of interprocess communication between panoramic image viewer and 3D model visualization applications using an API, allowing synchronized display of both panoramic/video images and 3D models at the same viewpoint, enabling side-by-side augmented reality in remote environments through viewpoint alignment and data conversion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If panoramic image-based viewer applications are used to display as-built visual data, then photorealistic representations of the physical assembly condition are provided, but the data is captured for a specific line number aircraft and cannot show current versions or subsequent aircraft

Engineering Contradiction:
Improvephotorealistic representation accuracyVSAvoidapplicability to different aircraft versions
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a virtual copy of the physical aircraft through 3-D modeling. The system generates a 3-D model representation that can be displayed alongside or instead of panoramic images, allowing the same visual data infrastructure to serve multiple aircraft versions by updating the virtual model rather than requiring new panoramic captures for each aircraft variant.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent integrates multiple functions into a single platform that can display both panoramic images and 3-D model visualizations. This unified system allows users to switch between or combine photorealistic panoramic views with configurable 3-D model views, making the system adaptable to different aircraft versions and display preferences without requiring separate applications for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If 3-D model visualization applications are used to show as-designed representations, then data for each specific line number aircraft can be displayed, but the images are non-photorealistic and do not show the physical condition of assembly

Engineering Contradiction:
Improvedata availability for specific aircraftVSAvoidphotorealistic representation quality
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent merges panoramic image viewing and 3-D model visualization into a single integrated system. The application can simultaneously display photorealistic panoramic images and 3-D model representations, allowing users to compare as-built and as-designed views and access both the visual fidelity of panoramic photography and the data specificity of 3-D models for any aircraft version.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of manufacture

If separate applications are used for panoramic image viewing and 3-D model visualization, then each application can optimize its specific function, but synchronized side-by-side display at the same viewpoint is not achieved

Engineering Contradiction:
Improveapplication functionality optimizationVSAvoidsynchronized viewpoint display capability
Core Design Contradiction:
Ease of manufactureVSEase of operation

Solution Approach 1:

The patent combines panoramic image viewing and 3-D model visualization into a single integrated application. The system synchronizes the viewpoints of both display modes, allowing users to navigate and view the aircraft from the same perspective in both panoramic and 3-D model representations simultaneously, while maintaining the functional optimizations of both display types within one unified interface.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10261747B2Synchronized side-by-side display of live video and corresponding virtual environment images
Publication Date: 2019.04.16 THE BOEING CO
  • US10261747B2 patent drawing
  • US10261747B2 patent drawing
  • US10261747B2 patent drawing

AI summary

Systems and methods for synchronized display of visualizations of three-dimensional (3-D) models and video images of aircraft for use in assembly of an aircraft. A video display process is configured to process the video image data so that the video images will have a user-selected viewpoint when displayed. In one embodiment, the user selects a virtual view direction and a smaller field-of-view from a full 360-degree field-of-view. A client request process is configured to construct and transmit a command data string containing encoded data specifying parameter values of the viewpoint representation formatted for 3-D model visualization. A server response process is configured to receive and decode the command data string into the specified parameter values representing the user-selected viewpoint for three-dimensional model visualization. A 3-D model visualization process is configured to process the 3-D model data so that 3-D model visualizations will have the user-selected viewpoint when displayed.