Neural Network Data Loss Prediction for Storage Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for preventing data unavailability and data loss in information systems, such as designing storage systems with high redundancy and backup capabilities, are costly and provide limited insights into customer machine behavior, failing to effectively predict and prevent data unavailability and loss events.
Innovation Solution
A computer-implemented method that learns machine behavior by parsing data storage information using temporal and event-related parameters, formats it for neural network models, trains these models to identify patterns related to data unavailability and loss events, and predicts future events, enabling proactive alerts and improvements in storage system design.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If storage systems are designed with high levels of redundancy and back-up capabilities, then data availability and data loss prevention are improved, but system cost increases significantly
Solution Approach 1:
The patent applies preliminary action by training neural network models on historical data to predict future data unavailability and data loss events before they occur. The system parses historical data storage information, formats it for neural network models, and trains these models to identify patterns that precede critical events. This enables proactive alerting and preventive measures to be taken before failures occur, reducing the need for excessive redundancy while maintaining reliability.
Solution Approach 2:
The patent replaces the mechanical approach of physical redundancy (multiple backup storage systems) with an information-based approach using neural networks and machine learning. Instead of relying on duplicate hardware systems, the invention uses computational models to predict failures and alert operators, substituting complex physical backup infrastructure with intelligent software-based prediction systems.
2Reliability
If conventional redundancy approaches are used, then data protection is improved, but insights into customer machine behavior are limited
Solution Approach 1:
The patent implements feedback by continuously parsing data storage information from customer machines, training neural network models on this data, and using the trained models to generate predictions about future events. The system creates a closed-loop feedback mechanism where historical data informs model training, which then generates predictions that can alert operators to potential issues. This feedback loop provides deep insights into machine behavior patterns while maintaining data protection.
Solution Approach 2:
The patent introduces neural network models as intermediaries between raw data storage information and actionable insights. These models parse and analyze historical data, identifying patterns and relationships that would be difficult to detect through conventional methods. The neural networks serve as a mediator that transforms raw operational data into predictive intelligence, providing both data protection and valuable machine behavior insights simultaneously.
3Measurement precision
If neural network models are trained on parsed data storage information, then prediction accuracy for future events is improved, but data processing time and computational resources increase
Solution Approach 1:
The patent applies preliminary action by pre-parsing data storage information into formats suitable for neural network training before the actual prediction task. The system parses historical data, formats it appropriately, and trains models in advance so that when predictions are needed, the models are already prepared and can provide rapid predictions without requiring intensive real-time processing.
Solution Approach 2:
The patent uses partial action by focusing the neural network training on specific patterns and events that are most predictive of data unavailability and data loss. Rather than analyzing all possible data aspects equally, the system concentrates computational resources on identifying the most relevant patterns, achieving high prediction accuracy with reduced processing requirements compared to comprehensive analysis of all data.
Data Source
AI summary
Methods, apparatus, and processor-readable storage media for learning machine behavior related to install base information and determining event sequences based thereon are provided herein. An example computer-implemented method includes parsing data storage information based at least in part on parameters related to install base information comprising temporal parameters and event-related parameters; formatting the parsed set of data storage information into a parsed set of sequential data storage information compatible with a neural network model; training the neural network model using the parsed set of sequential data storage information and additional training parameters; predicting, by applying the trained neural network model to the parsed set of sequential data storage information, a future data unavailability event and/or a future data loss event; and outputting an alert based at least in part on the predicted future data unavailability event and/or predicted future data loss event.


