Augmented Reality Structural Health Monitoring System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Structural platforms, such as aircraft, face challenges in detecting damage due to service loads, corrosion, fatigue, and accidental impacts, which can lead to costly and potentially catastrophic failures, as existing monitoring systems require scheduled inspections and are prone to human error and high maintenance costs.

Innovation Solution

Integration of Structural Health Monitoring (SHM) systems with Augmented Reality (AR) technology using RFID tags and sensors like fiber optics or piezoelectric sensors, enabling real-time damage detection and visualization, reducing the need for disassembly and minimizing human interference by providing quick and accurate damage characterization, localization, and quantification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If scheduled manual inspections are used to detect structural damage, then damage can be detected during maintenance, but the process is prone to human error, requires disassembly, and has high maintenance costs

Engineering Contradiction:
Improvedamage detection accuracyVSAvoidinspection system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The structure monitors its own health through embedded sensors that automatically detect damage without requiring external inspection personnel. The SHM system performs self-diagnosis by continuously monitoring structural parameters and comparing them against baseline values, enabling autonomous damage detection and reducing reliance on manual inspections.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical inspection processes with an automated sensor-based monitoring system. Instead of physically examining structures through disassembly and visual inspection, the system uses embedded sensors, signal processing, and data analysis to detect damage, substituting mechanical human labor with electronic monitoring and computational analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If traditional inspection methods are used, then damage can be detected, but accessibility limitations and human error reduce inspection quality and increase costs

Engineering Contradiction:
Improveinspection efficiencyVSAvoiddamage detection accuracy
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The SHM system implements continuous feedback loops where sensor data is constantly monitored, compared against baseline values, and analyzed for anomalies. When damage indicators are detected, the system provides immediate feedback alerts to maintenance personnel, enabling timely intervention and preventing progression of structural damage while maintaining high detection accuracy.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary damage detection and characterization before actual structural failure occurs. By continuously monitoring structural health parameters and identifying early signs of damage, the system enables preventive maintenance actions to be taken beforehand, avoiding catastrophic failures and reducing overall maintenance costs.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If automated SHM systems are implemented, then real-time damage detection is achieved, but system complexity and initial costs increase

Engineering Contradiction:
Improveinspection timeVSAvoidmonitoring system complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The monitoring system is divided into modular functional segments including sensor modules, signal processing modules, data management modules, and user interface modules. Each segment performs a specific function and can be independently configured and maintained. This segmentation reduces overall system complexity by breaking down the complex monitoring task into manageable, standardized components that can be implemented incrementally.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The SHM-AR system allows for early detection of structural damage, reducing maintenance costs and operational risks by providing real-time, automated inspection capabilities, overcoming accessibility limitations and minimizing human error, thus ensuring structural integrity and safety.

Implementation Method 1

sensors like fiber optics or piezoelectric sensors

Methodology Applied
Scientific EffectOptical fiber sensing: Optical Fibre

Implementation Method 2

sensors like fiber optics or piezoelectric sensors

Methodology Applied
Scientific EffectPiezoelectric effect: Piezoelectric Effect

Implementation Method 3

RFID tags installed in a SHM sensors network and in the AR mobile devices

Methodology Applied
Scientific EffectRFID electromagnetic communication: Electromagnetic Induction

Data Source

PatentEP3452798A1Structural health monitoring system with the identification of the damage through a device based in augmented reality technology
Publication Date: 2019.03.13 EMBRAER SA

AI summary

An inspection system for assessing and visualizing structural damage to a structural platform comprises sensors operatively coupled to the structural platform that assess structural damage to or failure of the structural platform. A structural health monitoring processor operatively coupled to the sensors determines structural damage in response to the sensors. At least one RF transponder and associated reader determines the position of the structural platform relative to a user augmented reality viewing device. The user augmented reality viewing device includes a camera that captures images of the structural platform. The user augmented reality viewing device displays real world images of the structural platform and virtual indications of determined structural damage that are dependent on the position and orientation of the user augmented reality viewing device relative to the structural platform.