AR Nonconformance Visualization for Aircraft Inspection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current aircraft manufacturing inspection processes are time-consuming and inefficient, relying on physical and paper notes, and disjointed processing systems without accurate metrics for gathering nonconformance information.
Innovation Solution
An augmented reality system utilizing a portable computing device and augmented reality application to visualize nonconformance data by plotting points in a coordinate cube, determining visible nonconformance locations, and overlaying this data onto a live view of the aircraft structure, allowing for efficient identification and resolution of nonconformances.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If physical markers and paper notes are used to record nonconformance locations, then nonconformance information can be captured, but the inspection process becomes time-consuming and inefficient
Solution Approach 1:
The patent replaces physical markers and paper notes with a digital copy of the aircraft structure displayed on a portable computing device. Nonconformance locations are represented as graphical indicators overlaid on the digital model, eliminating the need for physical tagging and paper documentation while maintaining complete information about each nonconformance.
Solution Approach 2:
The patent substitutes the mechanical system of physical markers, three-ring binders, and manual note-taking with an electronic system. The portable computing device stores and displays nonconformance data digitally, replacing the mechanical filing and retrieval process with instant electronic access to all nonconformance information.
2Difficulty of detecting and measuring
If physical markers are placed on aircraft structure to mark nonconformance locations, then nonconformance locations can be identified, but the process requires manual searching and is inefficient
Solution Approach 1:
The patent adds a digital dimension to the physical inspection process. By overlaying graphical indicators on a digital model of the aircraft structure displayed on the portable computing device, the system provides spatial context and precise location information that goes beyond simple physical markers, enabling faster and more accurate identification of nonconformance locations.
Solution Approach 2:
The portable computing device acts as an intermediary between the inspector and the aircraft structure. Instead of directly interacting with physical markers on the aircraft, the inspector interacts with the digital representation, which provides enhanced information including precise coordinates, multiple views, and contextual data about each nonconformance location.
3Adaptability or versatility
If disjointed processing systems are used for inspections, then various inspection tasks can be performed, but accurate metrics for gathering nonconformance information are lacking
Solution Approach 1:
The patent merges multiple inspection tasks and data types into a single integrated system. The portable computing device consolidates nonconformance recording, location tracking, data storage, and visualization into one unified platform, eliminating the disjointed nature of previous systems and enabling accurate metrics through centralized data collection.
Solution Approach 2:
The portable computing device serves multiple functions: it captures nonconformance data, stores information digitally, displays graphical indicators on a 3D model, provides navigation to nonconformance locations, and enables data analysis. This multi-functional approach replaces multiple separate tools and systems while maintaining versatility across different inspection tasks.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method, apparatus, and system for visualizing nonconformance data for a physical object. An augmented reality application in a portable computing device plots, in a defined coordinate cube, points corresponding to nonconformance locations on the physical object. The augmented reality application determines a sub-set of the points plotted that correspond to a region of the physical object visible in an image of the region of the physical object acquired by the portable computing device at a position of the portable computing device, where the sub-set of the points exclude nonconformance locations occluded from view by a physical object structure of the physical object in the image. The augmented reality application displays the nonconformance data for the sub-set of the points visible in the image in association with a sub-set of the nonconformance locations for the physical object in the image displayed on a display system in the portable computing device.