Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device used for processing unstructured logs

An unstructured and log-based technology, applied in electrical digital data processing, instruments, hardware monitoring, etc., can solve problems such as inefficiency, difficulty in manual detection, time-consuming log messages, etc., and achieve the effect of reducing quantity and ensuring service quality

Active Publication Date: 2017-10-27
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, with the deployment of many large-scale and complex applications, many failed jobs may occur in a short period of time, and it becomes very difficult and inefficient to manually detect the cause of anomalies
First, it is very time-consuming to diagnose anomalies by manually inspecting the large number of log messages generated by large-scale distributed systems
Second, because many large enterprise systems often use third-party components, a single developer or system administrator may not have sufficient awareness of the entire system
In addition, the increasing complexity of distributed systems further reduces the efficiency of manual problem diagnosis

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device used for processing unstructured logs
  • Method and device used for processing unstructured logs
  • Method and device used for processing unstructured logs

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus their repeated descriptions will be omitted.

[0035] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the invention. However, those skilled in the art will appreciate that the technical solutions of the present invention may be practiced without one or more of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The application discloses a method and a device used for processing unstructured logs. The method includes: acquiring abnormal message data; carrying out fault source classification on the abnormal message data through log signatures to extract fault parameters; carrying out sign classification on the abnormal message data through the fault parameters and job signatures to acquire classified data; and processing fault situations according to the classified data. According to the method and the device used for processing the unstructured logs disclosed in the application, a developer can be helped to substantially reduce the number of artificially-checked failing jobs, fault causes are automatically and preliminarily analyzed, and the service quality is ensured.

Description

technical field [0001] The invention relates to the field of computer information processing, in particular to a method and device for processing unstructured logs. Background technique [0002] Usually, distributed system software developers will print log messages to track the running status of the system when developing programs, so as to help determine possible problems when the program is running. People often use system logs generated by distributed systems for troubleshooting and problem diagnosis. However, thousands of failed jobs can occur within a short period of time. Due to the increasing scale and complexity of distributed systems, it is not feasible to manually inspect these jobs one by one to detect anomalies. [0003] In the prior art, most systems generate and collect logs for troubleshooting, and developers and administrators usually detect abnormal conditions by manually checking the logs printed by the system. However, with the deployment of many large...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/34G06F11/30
CPCG06F11/3065G06F11/3476
Inventor 李树海葛胜利
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD