Log data processing method and device, equipment and storage medium

A data processing and log technology, applied in the field of operation and maintenance, can solve problems such as consuming a lot of human resources, and achieve the effects of efficient detection, effective online monitoring and abnormal detection

Pending Publication Date: 2022-04-12
CHINA TELECOM CLOUD TECH CO LTD
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Operation and maintenance is the most direct and effective method to ensure stability. However, since the storage system has hundreds of hosts and thousands of physical storage nodes, a medium-sized storage system has a large amount of logs and index data. Maintenance of the storage system will consume a lot of human resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data processing method and device, equipment and storage medium
  • Log data processing method and device, equipment and storage medium
  • Log data processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted.

[0042] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a log data processing method and device, electronic equipment and a storage medium, and relates to the technical field of operation and maintenance. The method comprises the following steps: acquiring log keys obtained by clustering first log data according to a target frequency word and category identifiers corresponding to the log keys; obtaining a log category sequence of the to-be-processed log data comprising a first log category identifier and a second log category identifier according to the log key and the category identifier corresponding to the log key, wherein the first log category identifier in the log category sequence of the to-be-processed log data is ranked before the second log category identifier; processing the log category sequence of the to-be-processed log data through the target deep learning model to obtain a predicted post-order log category identifier of the first log category identifier; and comparing the second log category identifier with the predicted post-order log category identifier to detect whether the log data corresponding to the second log category identifier is abnormal or not. According to the method, the log data exception is efficiently detected.

Description

technical field [0001] The present disclosure relates to the technical field of operation and maintenance, and in particular, relates to a log data processing method, device, electronic equipment, and readable storage medium. Background technique [0002] Operation and maintenance work is the operation and maintenance of networks, servers and software, which can reduce the incidence of failures and improve equipment efficiency. Most of the traditional operation and maintenance work is done manually by operation and maintenance personnel. With the rapid expansion of Internet business and the continuous increase of labor costs, it is difficult for this manual operation and maintenance production method to keep up with the pace of the times. [0003] The storage system is the foundation of cloud computing products. It needs to have the ability to access massive files and large-scale concurrent access, while taking into account the requirements of stability, reliability, and ha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30G06N3/04
Inventor 薛强陈孝委吴学含李贵斌李家伟
Owner CHINA TELECOM CLOUD TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap