Big data-based cloud platform log management system

A management system and big data technology, applied in the field of big data, can solve problems such as unsatisfactory traditional databases, troublesome log statistics and retrieval, powerlessness, etc., to shorten troubleshooting time and business interruption time, meet exchange and processing, and avoid development Effect

A management system and big data technology, applied in the field of big data, can solve problems such as unsatisfactory traditional databases, troublesome log statistics and retrieval, powerlessness, etc., to shorten troubleshooting time and business interruption time, meet exchange and processing, and avoid development Effect

CN112416872APending Publication Date: 2021-02-26SHANXI TISCO INFORMATION & AUTOMATION TECH CO LTD
0 Cites 5 Cited by

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data-based cloud platform log management system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022]In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely below. Obviously, the described embodiments are part of the embodiments of the present invention, not All the embodiments; based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0023]Such asfigure 1As shown, the embodiment of the present invention provides a cloud platform log management system based on big data, including:

[0024]Log collection module: used to analyze and mine log practices through a distributed multi-tasking method. The log time includes security logs, application logs, system logs, and business behavior logs;

[0025]Log preprocessing module: used to filter log events through audit poli...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of big data, and discloses a big data-based cloud platform log management system, which comprises a log collection module used for analyzing and mining logpractices through a distributed multi-task method; a log preprocessing module is used for filtering log events and merging similar events through an auditing strategy, and sending the log events andthe similar events to the real-time detection module and the database system respectively; the database system is used for storing the log events sent by the log preprocessing module; the real-time detection module is used for auditing the processed log event and responding to an auditing result according to a response strategy; and the log analysis module is used for analyzing historical data inthe database system and displaying an analysis result through a chart according to user settings. According to the invention, the working efficiency of operation and maintenance personnel in the operation and maintenance management process and the perception ability of the safety situation can be improved.

Description

Technical field[0001]The invention belongs to the technical field of big data, and specifically relates to a cloud platform log management system based on big data.Background technique[0002]With the continuous development of information technology, users' demands for new services and requirements for service quality are also constantly improving. This brings about a new challenge, that is, the new environment generates a large number of logs that have never been seen before, and brings related problems, such as: log files are stored scattered, large in number, and log files that can be directly accessed have a short storage period , It is extremely inconvenient for operation and maintenance; the log format is inconsistent and the readability is too low; the query is time-consuming and labor-intensive, and the efficiency is low; the correlation of related logs is low and cannot be clearly located; a large number of logs cannot be counted, and the business cannot be accurately analyze...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
26 Feb 2021
Publication
CN112416872A
IPC
G06F16/17; G06F16/182; G06N20/00; G06F21/57
CPC
G06F16/1734; G06F16/182; G06N20/00; G06F21/577
Inventors
石永红; 李鹏