Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data-based cloud platform log management system

A management system and big data technology, applied in the field of big data, can solve problems such as unsatisfactory traditional databases, troublesome log statistics and retrieval, powerlessness, etc., to shorten troubleshooting time and business interruption time, meet exchange and processing, and avoid development Effect

Pending Publication Date: 2021-02-26
SHANXI TISCO INFORMATION & AUTOMATION TECH CO LTD
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, after the centralized management of logs, the statistics and retrieval of logs has become a more troublesome thing. In the prior art, Linux commands such as grep, awk and wc can be used to achieve retrieval and statistics, but for more demanding queries and sorting And statistics and other requirements and a huge number of machines still use this method is inevitably a bit powerless
[0004] Traditional relational databases cannot meet the requirements of the new situation. It is necessary to establish a cloud platform log management system based on big data to improve log management efficiency.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data-based cloud platform log management system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022]In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely below. Obviously, the described embodiments are part of the embodiments of the present invention, not All the embodiments; based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0023]Such asfigure 1As shown, the embodiment of the present invention provides a cloud platform log management system based on big data, including:

[0024]Log collection module: used to analyze and mine log practices through a distributed multi-tasking method. The log time includes security logs, application logs, system logs, and business behavior logs;

[0025]Log preprocessing module: used to filter log events through audit poli...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of big data, and discloses a big data-based cloud platform log management system, which comprises a log collection module used for analyzing and mining logpractices through a distributed multi-task method; a log preprocessing module is used for filtering log events and merging similar events through an auditing strategy, and sending the log events andthe similar events to the real-time detection module and the database system respectively; the database system is used for storing the log events sent by the log preprocessing module; the real-time detection module is used for auditing the processed log event and responding to an auditing result according to a response strategy; and the log analysis module is used for analyzing historical data inthe database system and displaying an analysis result through a chart according to user settings. According to the invention, the working efficiency of operation and maintenance personnel in the operation and maintenance management process and the perception ability of the safety situation can be improved.

Description

Technical field[0001]The invention belongs to the technical field of big data, and specifically relates to a cloud platform log management system based on big data.Background technique[0002]With the continuous development of information technology, users' demands for new services and requirements for service quality are also constantly improving. This brings about a new challenge, that is, the new environment generates a large number of logs that have never been seen before, and brings related problems, such as: log files are stored scattered, large in number, and log files that can be directly accessed have a short storage period , It is extremely inconvenient for operation and maintenance; the log format is inconsistent and the readability is too low; the query is time-consuming and labor-intensive, and the efficiency is low; the correlation of related logs is low and cannot be clearly located; a large number of logs cannot be counted, and the business cannot be accurately analyze...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/17G06F16/182G06N20/00G06F21/57
CPCG06F16/1734G06F16/182G06N20/00G06F21/577
Inventor 石永红李鹏崔伟李志刚李洪杰苗建鹏杨峰光韩国栋张晨祥张航
Owner SHANXI TISCO INFORMATION & AUTOMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products