Log monitoring method and device and server

A technology for logging and monitoring data, applied in the field of big data processing, it can solve the problems that cannot be solved well, the alarm monitoring is not handled uniformly, the usage of statistical function modules cannot be analyzed, the number of active people using the frequency of use, and user operations, etc. Improve the level of intelligence, optimize the log monitoring process, and achieve sufficient results in operation and analysis

Pending Publication Date: 2021-03-16
天津狮拓信息技术有限公司
View PDF0 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Complex monitoring requirements such as user behavior and links generated by each call cannot be well resolved, and the current log monitoring system cannot analyze and count the usage, frequency of use, number of active users, and user operations of each functional module every day
[0004] In addition, for some internal services of the company, such as the daily read and write traffic of databases such as Oracle, the timing scheduling operation of the XXL-JOB distributed task scheduling platform, and the alarm monitoring of the TDH big data processing platform, there is no unified processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log monitoring method and device and server
  • Log monitoring method and device and server
  • Log monitoring method and device and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.

[0051] figure 1 A log monitoring method according to an embodiment of the present invention is shown, the method includes:

[0052] S110, by burying points in the log data generation position of each distribution through the log framework, and obtaining the log data in a unified format according to the preset format of the log data, and then pushing the log data to the distribution through the data processing pipeline for logs such as Logstash ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log monitoring method and device and a server, and the method comprises the steps: obtaining log data through a buried point according to a preset format of the log data, andpushing the log data to a distributed publishing and subscribing system through a data processing pipeline; performing operation processing on log data in the distributed publishing and subscribing system to generate a plurality of items of monitoring data; and setting a data calling interface for monitoring data and front-end communication, and realizing log monitoring through the front end. According to the technical scheme, the distributed publishing and subscribing system serves as a cache and is suitable for data collection services of internet services generating a large amount of data,so that operation analysis of log data is more sufficient, and the log monitoring process is optimized; moreover, the monitoring items are wider and more comprehensive, and the intelligent level of log monitoring is improved.

Description

technical field [0001] The invention relates to the field of big data processing, in particular to a log monitoring method, device and server. Background technique [0002] In the process of business development, software products are continuously developed and iterated, new functions are continuously added, and various services are continuously deployed. In order to detect software and hardware problems and user usage in each service module earlier, a complete set of service log monitoring and alarm system is required. [0003] The current mainstream log monitoring system and some open source solutions only perform simple monitoring on the logs generated by the server, and can only provide simple alarms on the service log ERROR. Complex monitoring requirements such as user behavior and links generated by each call cannot be well resolved, and the current log monitoring system cannot analyze and count the usage, frequency of use, number of active users, and user operations ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30
CPCG06F11/3065G06F11/3068G06F11/3072G06F11/3093G06F2201/80
Inventor 杨路吴松刘冰舰马鸣挥张文涛崔艳楠王雅郭天宇
Owner 天津狮拓信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap