Dynamic Data Preprocessing for Server Failure Risk Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In data centers, servers with diverse hardware configurations and measurement methods complicate accurate data analysis, as direct comparison of data from different servers is challenging due to varying specifications and data types, necessitating effective data preprocessing.
Innovation Solution
A data preprocessing device and method that includes a risk level analyzing unit to calculate failure risk using historical and characteristic data, a collection period setting unit to adjust data collection intervals based on risk levels and congestion periods, and a preprocessing unit for normalization, interpolation, and statistical analysis, ensuring uniformity and consistency of data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data collection period is reduced to detect failures faster, then failure detection speed is improved, but system load and data processing complexity increase
Solution Approach 1:
The patent applies dynamics by making the data collection period adjustable rather than fixed. The collection period is dynamically changed based on the calculated failure risk level of each server, allowing the system to adapt between fast detection modes (short collection period) and low-complexity modes (long collection period) as needed
Solution Approach 2:
The patent changes the parameter of data collection period based on risk levels. By modifying this temporal parameter according to the calculated failure risk, the system optimizes the balance between detection speed and processing complexity for different server conditions
2Loss of time
If data collection period is reduced to improve detection timeliness, then failure detection timeliness is improved, but server load increases
Solution Approach 1:
The patent applies local quality by tailoring the data collection period to individual server characteristics and risk levels. Each server receives a customized collection period based on its specific failure risk assessment, rather than applying a uniform collection period across all servers, thereby optimizing the balance between detection timeliness and server load for each local condition
3Ease of operation
If preprocessing operations are performed on diverse server data, then data uniformity is improved, but processing time increases
Solution Approach 1:
The patent applies preliminary action by performing data collection and risk level calculation in advance, before actual failure analysis is needed. By pre-collecting data according to optimized periods and pre-calculating risk levels, the system prepares processed data in advance, reducing the time required for subsequent analysis while maintaining data uniformity
Data Source
AI summary
There are provided a data preprocessing device and a method thereof. A data preprocessing device according to an embodiment of the present disclosure includes a risk level analyzing unit configured to calculate a failure risk level of a target system using failure history information of the target system and characteristic information of the target system; a collection period setting unit configured to determine a data collection period from the target system according to the calculated failure risk level; and a preprocessing unit configured to preprocess data collected from the target system according to the data collection period.