Log data processing method, device and equipment and computer readable storage medium

A data processing and log technology, applied in the field of financial technology, can solve the problems of high operation and maintenance costs and complex systems, and achieve the effect of simplifying the monitoring process and saving costs

Active Publication Date: 2020-06-12
WEBANK (CHINA)
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The main purpose of the present invention is to provide a log data processing method, device, equipment and computer-readable storage medium, aiming at solving the pr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data processing method, device and equipment and computer readable storage medium
  • Log data processing method, device and equipment and computer readable storage medium
  • Log data processing method, device and equipment and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.

[0047] The present invention provides a log data processing device, with reference to figure 1 , figure 1 It is a schematic diagram of the structure of the device hardware operating environment involved in the embodiment of the log data processing device solution of the present invention.

[0048] Such as figure 1 As shown, the log data processing device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log data processing method, device and equipment and a computer readable storage medium, and the method comprises the following steps: collecting business log data of a plurality of systems, and analyzing the business log data according to the log data types of the plurality of systems to generate standard log data; aggregating the standard log data to generate aggregateddata, and performing time zone standardization processing and data completion processing on the aggregated data to obtain aggregated time series data; and counting abnormal keywords in the aggregatedtime series data, and carrying out early warning on the abnormal keywords according to a preset monitoring type. According to the invention, various types of service log data are analyzed into standard log data for aggregation processing; according to the method, the situation that multiple sets of system frameworks are deployed for processing according to different types of log data is avoided,the abnormal time can be reflected through the time sequence of the abnormal keywords in the aggregation time series data, the processing process is simplified, and the operation and maintenance processing cost of the multiple sets of system frameworks is saved.

Description

Technical field [0001] The present invention relates to the technical field of financial technology (Fintech), and in particular to a log data processing method, device, equipment and computer readable storage medium. Background technique [0002] With the continuous development of financial technology (Fintech), especially Internet technology finance, more and more technologies (such as big data, cloud storage, distributed systems, etc.) are applied in the financial field, but the financial industry also proposes various technologies Higher requirements, such as requiring unified processing of all types of log data stored on each device in a distributed system. [0003] Currently, in order to support the unified processing of different types of log data on each device, open source tools such as Filebeat (log collection), Logstash (log collection processing), and ElasticSearch (log storage) are usually used to build a system architecture. [0004] One of the problems brought by this...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/30
CPCG06F11/3082
Inventor 魏帅超郑明华钟志明
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products