Supercharge Your Innovation With Domain-Expert AI Agents!

Log analysis method and device based on Apriori algorithm

A log and algorithm technology, applied in the field of big data, can solve problems such as heavy load, and achieve the effects of reducing load, improving efficiency, and improving applicability

Pending Publication Date: 2020-05-15
CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD +1
View PDF2 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] This application provides a log analysis method and device based on the Apriori algorithm to solve the technical problem that the system in the prior art has a large load during the calculation of the log association relationship

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log analysis method and device based on Apriori algorithm
  • Log analysis method and device based on Apriori algorithm
  • Log analysis method and device based on Apriori algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] A method of log analysis based on the Apriori algorithm provided in the embodiment of the present application will be further described in detail below in conjunction with the accompanying drawings. The specific implementation of the method may include the following steps (the method flow is as follows: figure 1 shown):

[0055] Step 101, when the server detects the warning information, collect abnormal logs within a preset time window, wherein the abnormal logs refer to logs including preset abnormal keywords.

[0056] A time window may be preset in the server, and the preset time window takes the time point at which the warning message is generated as a reference time, and is a time window of adjustable length. For example, if the duration of the preset time window is three minutes before and after the time point when the warning information is detected, when the server detects the warning information at 14:00, the server will collect the data from 13:57-14:03. A log...

Embodiment 2

[0080] Based on the same inventive concept, the embodiment of the present application also provides a log analysis device based on the Apriori algorithm, see Figure 4 , the device consists of:

[0081] The collection module 401 is configured to collect abnormal logs within a preset time window when warning information is detected, wherein the abnormal logs refer to logs including preset abnormal keywords;

[0082] A processing module 402, configured to preprocess the exception log to obtain a collection of exception logs;

[0083] The determining module 403 is configured to determine a subset whose confidence and support are greater than a preset threshold from the frequent itemsets contained in the set, and use the subset to form an associated event.

[0084] Optionally, the preset time window takes the time point at which the warning message is generated as a reference time, and is a time window of adjustable length.

[0085] Optionally, the processing module 402 is speci...

Embodiment 3

[0095] The embodiment of the present application also provides a server, see Figure 5 , the server includes:

[0096] memory 501, for storing computer instructions;

[0097] The processor 502 is connected to the memory 501 and configured to execute computer instructions in the memory, so as to execute the method as described in Embodiment 1 when executing the computer instructions.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a log analysis method and device based on an Apriori algorithm. The method comprises the following steps: 1, ; when the server detects warning information, the server sends thewarning information; collecting an abnormal log in a preset time window, wherein the abnormal logs refer to logs comprising preset abnormal keywords, the abnormal logs are preprocessed to obtain a set of the abnormal logs, subsets with confidence coefficients and support degrees larger than a preset threshold value are determined from frequent item sets contained in the set, and the subsets are used for forming associated events. The technical problem that in the prior art, the load of a system is large in the log incidence relation calculation process is solved.

Description

technical field [0001] The present application relates to the field of big data technology, in particular to a method and device for log analysis based on the Apriori algorithm. Background technique [0002] During the operation of the big data system, a large amount of log information is generated every day. These log information records the operating status of the system at different times. Fully analyzing and mining these log information can help the operation and maintenance personnel to grasp the status of the big data cluster, and more Good maintenance of the stability of the big data system. Therefore, in order to facilitate operation and maintenance personnel to grasp the status of big data clusters, at present, the big data management system is mainly based on the architecture of the open source search engine ELK (ElasticSearch+Logstash+Kibana), and uses the association rule algorithm Apriori to determine the relationship between different log information. relation...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18G06F16/2458G06F40/242G06F40/279
Inventor 吴文昊
Owner CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com