Method for monitoring and managing log data

A technology of data monitoring and management methods, applied in the field of data processing, can solve problems such as long time consumption and unfavorable real-time use, and achieve the effects of reducing equipment load, reducing difficulty, and improving efficiency

Inactive Publication Date: 2019-03-26
武汉雨滴科技有限公司
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, with the continuous increase of system equipment and the expansion of the types and numbers of nodes, the traditional log data extraction and storage methods will consume a lot of system resources to complete, and the whole process will take a long time, during which the operation of the entire system will be affected. It will have a great impact, and it will cause a huge adverse impact in the following important key systems. At the same time, the post-processing and storage of log data in the entire system will continue to perform under pressure, which is not conducive to real-time, high-load used in the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for monitoring and managing log data
  • Method for monitoring and managing log data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The invention will be described in detail below in conjunction with specific embodiments.

[0017] A kind of log data monitoring management method of the present invention, comprises the following steps:

[0018] A step for establishing a standardized log format. The log is composed of a node area, a content area and a flag area. The log priority, time and code line bytes are stored in the node area. In order to facilitate the compatible use of the log, the time adopts the standard The ISO8601 format; the content area is used to express the purpose of log output; the flag area is composed of multiple key-value pairs, and the key-value pairs are separated from each other; logs that do not meet the format requirements are processed using regular expressions.

[0019] Steps for setting up a data monitoring service, including

[0020] Data acquisition, specifically, refers to building an acquisition layer at each node that needs to be collected, and arranging an intermedia...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of data processing, and in particular relates to a method for monitoring and managing log data. The log data monitoring and management method provided by the invention avoids the disadvantages of massive node data collection, improves the efficiency of real-time data processing, and reduces the difficulty of log data management and monitoring through hierarchical node arrangement, and improves multi-process management and organizational efficiency, and reduces equipment load by using corresponding structures and contents such as a distributed lock to coordinate the process of management and data transfer of the task flow.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a method for monitoring and managing log data. Background technique [0002] The log is an important carrier in the system that reflects various data information such as the operating status of each device or node, data transmission status, and abnormal time status. Generally, the log data is stored on the corresponding node device. When needed, such as when evaluating or When analyzing the overall operating status of the system and operating historical data, it is necessary to extract and analyze the log data on each device or node. However, with the continuous increase of system equipment and the expansion of the types and numbers of nodes, the traditional log data extraction and storage methods will consume a lot of system resources to complete, and the whole process will take a long time, during which the operation of the entire system will be affected. I...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24
CPCH04L41/069H04L41/082
Inventor 李刚石淮
Owner 武汉雨滴科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap