A log file processing method and device

A technology for log files and processing methods, applied in the computer field, can solve problems such as low training efficiency of log analysis models, and achieve the effect of reducing data volume and improving efficiency

Active Publication Date: 2019-06-28
CHINA UNIONPAY
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] An embodiment of the present invention provides a log file processing method to solve the technical problem of low training efficiency of the log analysis model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A log file processing method and device
  • A log file processing method and device
  • A log file processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0032] figure 1 A schematic diagram of the system architecture of a fault analysis system provided by an embodiment of the present invention, such as figure 1 As shown, the failure analysis system can include at least one device (such as figure 1 device 101, device 102, device 103 and device 104) and a central server 110 managing at least one device. Among them, at least one device can be a terminal type electronic device, such as a m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a log file processing method and device. The method comprises the following steps of obtaining M log files respectively generated by the M devices in a presettime period; determining a numerical value corresponding to each log record according to the keyword information of each log record included in the M log files, generating a first vector according tothe numerical values corresponding to the M * N log records, performing dimension reduction processing on the first vector to obtain a second vector, and training the log analysis model by using thesecond vector. In the embodiment of the invention, the data volume input by the model can be reduced by performing dimension reduction processing on the first vector, so that the training efficiency of the log analysis model is improved; moreover, according to the embodiment of the invention, the incidence relation of M * N log records is added into the input data, so that the input information ofmodel training is more comprehensive, and the training effect of the model can be improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a log file processing method and device. Background technique [0002] Analyzing and predicting the running status of equipment based on the log records in log files is a common fault analysis method. Specifically, by obtaining multiple log files generated by the device within a preset time period, the log analysis model can be trained using multiple log records included in the multiple log files to obtain a prediction model; correspondingly, when the device generates a new After the log records are recorded, by using the prediction model to predict the new log records, it can be determined whether the device fails according to the prediction results. [0003] Generally speaking, if you want to train a predictive model with better effect, you usually need tens of thousands of log data. However, the data volume of tens of thousands of log data is relatively large. If tens of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18G06F16/2458
CPCY02D10/00
Inventor 马平清刘彬宋泽锋伍福生简超李兴锋王鑫伟王景隆
Owner CHINA UNIONPAY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap