PHM Sensor Fusion Using Deep Neural Networks for Fault Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for prognostics and health monitoring in complex engineered systems rely heavily on domain knowledge to hand-craft features from sensor data, which can be incomplete and not always available, limiting the effectiveness of fault detection and health evaluation.

Innovation Solution

A method using a deep neural network, specifically a deep belief network, to convert time-series data from PHM sensors into frequency domain data, label target modes, and classify health and prognostic indicators, enabling automated model creation for accurate health monitoring across heterogeneous sensor inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If domain knowledge is used to hand-craft features from sensor data, then fault detection capability is improved, but the method becomes incomplete and unreliable when domain knowledge is not available

Engineering Contradiction:
Improvefault detection capabilityVSAvoidapplicability when domain knowledge is unavailable
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system performs self-service by automatically learning features from raw sensor data through deep neural networks, eliminating the need for external domain knowledge. The network autonomously identifies relevant features and patterns, making the system self-sufficient and adaptable to any application domain without requiring pre-existing expert knowledge.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical process of hand-crafting features by domain experts with an automated computational system. Deep neural networks automatically extract features from sensor data, substituting the manual expert process with an automated learning-based approach that scales across different applications without requiring domain-specific expertise.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If multiple sensor modalities are integrated to capture comprehensive system information, then monitoring accuracy is improved, but data integration complexity increases

Engineering Contradiction:
Improvehealth monitoring accuracyVSAvoiddata integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple heterogeneous sensor modalities into a unified deep neural network model. Different sensor types (vibration, temperature, pressure, etc.) are integrated as input features to the network, which automatically learns how to combine them. This combining approach achieves comprehensive monitoring while managing complexity through the network's automated feature integration capabilities.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The deep neural network serves as a universal processing framework that handles multiple sensor modalities simultaneously. The same network architecture can process different types of sensor data (vibration, temperature, pressure, acoustic emissions) and apply the same learning algorithms, providing a multi-functional solution that reduces overall system complexity despite handling diverse data sources.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If automated deep learning models are used for feature extraction, then reliance on domain knowledge is reduced, but model training complexity increases

Engineering Contradiction:
Improveindependence from domain knowledgeVSAvoidmodel training complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by using unsupervised pre-training followed by supervised fine-tuning. The deep neural network is first pre-trained using autoencoders to learn general feature representations from unlabeled data, then fine-tuned with labeled fault data. This two-stage approach simplifies the overall training process by breaking it into manageable steps and reduces the difficulty of training from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary layer in the form of autoencoders that serve as a bridge between raw sensor data and the final classification task. The autoencoder intermediate layer learns compressed representations of the input data, which then serve as features for the subsequent supervised classification. This intermediary structure simplifies training by creating a hierarchical learning process where general features are learned first, then task-specific features are refined.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11340602B2Sensor data fusion for prognostics and health monitoring
Publication Date: 2022.05.24 RTX CORP
  • US11340602B2 patent drawing
  • US11340602B2 patent drawing
  • US11340602B2 patent drawing

AI summary

A method includes converting time-series data from a plurality of prognostic and health monitoring (PHM) sensors into frequency domain data. One or more portions of the frequency domain data are labeled as indicative of one or more target modes to form labeled target data. A model including a deep neural network is applied to the labeled target data. A result of applying the model is classified as one or more discretized PHM training indicators associated with the one or more target modes. The one or more discretized PHM training indicators are output.