Model training method, disk prediction method and device and electronic equipment

A model training and disk technology, applied in the computer field, can solve the problem of low prediction accuracy

Active Publication Date: 2021-02-23
创新奇智(西安)科技有限公司
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the purpose of this application is to provide a model training method, disk prediction method, device and electronic equipment to improve the prediction accuracy of the existing disk prediction model not high problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model training method, disk prediction method and device and electronic equipment
  • Model training method, disk prediction method and device and electronic equipment
  • Model training method, disk prediction method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0041] Wherein, the ratio of each bucket can be set in advance, for example, the ratio is the ratio of the total number of negative samples to the number of positive samples in the bucket. In one embodiment, the process of sampling the sample data corresponding to the proportion of the bucket from each bucket may be: calculating the average value of the loss value of the positive sample data in each bucket; for each bucket, calculating the The ratio of the average value of the bucket to the sum of the average values ​​of all buckets, and calculate the product of the ratio and the negative sample data, and sample the sample data corresponding to the product from the bucket. In this implementation, the preset ratio of the i-th bucket can be expressed as: in, is the average of the loss values ​​of all positive sample data in the i-th bucket, and p is the number of disks in the negative sample data. If the average value of the loss value of the positive sample data in the buck...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a model training method, a disk prediction method and device and electronic equipment, and belongs to the field of computers. The method comprises the steps that negative sample data representing disk faults and positive sample data representing disk normality are acquired; performing N times of iterative training on the initial model based on the negative sample data andthe positive sample data to obtain a prediction model capable of predicting whether the disk fails or not; and in the ith iterative training process, performing down-sampling on the positive sample byusing a loss value generated by the model obtained by the i-1th iterative training on the positive sample data, and training the model obtained by the i-1th iterative training by using the positive sample data and the negative sample data obtained by sampling. According to the method, when down-sampling is carried out on the positive sample, the positive sample data sampled each time is differentdue to the fact that the loss values generated by the model obtained through iterative training each time on the positive sample data are different, more attention can be paid to difficult samples based on classification difficulty during sampling, so that the precision of the model is improved.

Description

technical field [0001] The present application belongs to the field of computers, and in particular relates to a model training method, a disk prediction method, a device and electronic equipment. Background technique [0002] In recent years, with the development of emerging technologies such as cloud storage, mass data storage technology is developing faster and faster. As the final storage place of data, the disk is one of the most important network devices, and it is also the device that fails most often. The disk failure prediction method based on machine learning has achieved satisfactory prediction results with the help of the powerful learning ability of machine learning algorithms. [0003] At present, the model training in the disk failure prediction method: mostly by marking the disk Self-Monitoring Analysis and Reporting Technology (SMART) log data as normal samples and faulty disk samples, and according to the attribute value of the sample Divide the samples i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/34G06F11/30
CPCG06F11/3447G06F11/3452G06F11/3037
Inventor 黄泽王梦秋胡太祥张泽覃
Owner 创新奇智(西安)科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products