Distributed type system log inquiry and analysis method and device

A distributed system and system log technology, applied in the direction of multi-programming devices, resource allocation, special data processing applications, etc., can solve the problems of inability to process data of multiple physical nodes at the same time, difficult data processing, low coding efficiency, etc.

Inactive Publication Date: 2018-06-01
MIGU CO LTD +1
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] 3. Script analysis: data of multiple physical nodes cannot be processed at the same time, and script coding usually has strict syntax requirements, and the coding efficiency is low for complex requirements processing
Even with batch scripting tools like pdsh, data processing is relatively difficult

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed type system log inquiry and analysis method and device
  • Distributed type system log inquiry and analysis method and device
  • Distributed type system log inquiry and analysis method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0108] Figure 4 A schematic flowchart of a method for querying and analyzing distributed system logs according to an embodiment of the present invention, such as Figure 4 As shown, the method for querying and analyzing a distributed system log according to an embodiment of the present invention includes the following steps:

[0109] Step 401: After the master node receives the query instruction of the system log, in response to the query instruction, query the system log data stored locally by the master node;

[0110] Wherein, the master node also forwards the query instruction to each working node of the server cluster;

[0111] In the embodiment of the present invention, the basis for determining the master node is: determining the node that performs human-computer interaction with the user as the master node, and determining the remaining nodes in the server as slave nodes.

[0112] In practical applications, the role of the master node is to provide a human-computer int...

Embodiment 2

[0140] Figure 5 It is a schematic structural diagram of a distributed system log query and analysis device according to an embodiment of the present invention, such as Figure 5 As shown, the distributed system log query and analysis device according to the embodiment of the present invention includes: a master node query module 501, a master node forwarding module 502, a master node acquisition module 503, a master node integration module 504, and a master node analysis module 505; wherein,

[0141] The master node query module 501 is used for the master node to query the system log data stored locally by the master node in response to the query instruction after the master node receives the query instruction of the system log;

[0142] The master node forwarding module 502 is configured to forward the query instruction to each working node of the server cluster;

[0143] The master node obtaining module 503 is configured to obtain a query result, where the query result at ...

Embodiment 3

[0171] Image 6 A schematic diagram of the overall workflow of the distributed system log query and analysis method in the system according to the embodiment of the present invention, such as Image 6 As shown, the overall workflow in the system of the distributed system log query analysis method according to the embodiment of the present invention includes the following steps:

[0172] Step 601: Receive a user query instruction;

[0173] Step 602: Parse the query instruction;

[0174] Step 603: Obtain the query mode;

[0175] Step 604: Determine whether there are other working nodes in the server cluster, if it is judged that there is a working node online, go to step 605; if it is judged that no working node is online, go to step 606;

[0176] Step 605: Obtain a list of working nodes in the server cluster, and forward the user query instruction to the working nodes;

[0177] Step 606: the master node and the worker node start executing the query instruction;

[0178] St...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed type system log inquiry and analysis method. The method includes the steps that a main node responds to an inquiry instruction after receiving the inquiry instruction of a system log and inquires about system log data locally stored in the main node; the inquiry instruction is forwarded to all working nodes of server clusters; an inquiry result is obtained, wherein the inquiry result at least comprises the locally-inquired system log data; the working nodes of the server clusters respond to the forwarded inquiry instruction and return system log data; thelocally-inquired system log data and the system log data returned by the working nodes of the server clusters are integrated to obtain integrated data; an instruction for analyzing the integrated datais received, and the analysis instruction is responded to, the integrated data is analyzed, and the analysis result is output. The invention further discloses a distributed type system log inquiry and analysis device and a computer readable storage medium.

Description

technical field [0001] The present invention relates to computer information processing technology, in particular to a distributed system log query and analysis method, device and computer-readable storage medium. Background technique [0002] In a complete application system, the log is a very important part, which is crucial for user behavior analysis, business record analysis, problem backtracking, system fault location, and system performance optimization. In a large-scale application system, in order to improve the throughput and stability of the system, service instances must be distributed on several service nodes, and many server instances generate numerous log information. How to efficiently lock and analyze data from massive logs is a realistic requirement. The existing massive log analysis methods mainly include: [0003] 1. Offline analysis, such as figure 1 As shown in the figure, the main methods include: analysis based on big data ecosystem tools such as ha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F9/50
CPCG06F9/5061G06F16/2471
Inventor 李翰
Owner MIGU CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap