Log compression method and device

A compression method and log technology, applied in the field of data processing, can solve the problems of long query log consumption, complex content, and large log file data, so as to improve log query efficiency, avoid large data volume, and reduce time-consuming effects

Active Publication Date: 2019-01-15
ALIBABA GRP HLDG LTD
View PDF12 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The embodiment of the present invention provides a log compression method and device, so as to at least solve the technical problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log compression method and device
  • Log compression method and device
  • Log compression method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] The method of querying logs adopted in the prior art is to collect logs of all servers in the system, and perform unified query from all collected logs. Combined with the characteristics of high log complexity, many useless logs, and large amount of log data in the prior art, it can be known that the log query method in the prior art is inefficient, takes a long time, and occupies more system resources.

[0031] In order to solve the above problems, the present application provides an embodiment of a log compression method, figure 1 It is a schematic diagram of log processing according to Embodiment 1 of the present invention, combined below figure 1 The example shown is to describe the processing method of the above-mentioned log in this application.

[0032] Step S11, collecting logs.

[0033] Specifically, the above log may be at least one log on the front-end device, and the front-end device may be all servers of the target application program. In an optional emb...

Embodiment 2

[0088] According to an embodiment of the present invention, an embodiment of a log compression method is also provided. It should be noted that the steps shown in the flow chart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and , although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0089] The method embodiment provided in Embodiment 1 of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. figure 2 A block diagram of a hardware structure of a computer terminal (or mobile device) for implementing a log compression method is shown. Such as figure 2 As shown, the computer terminal 20 (or mobile device 20) may include one or more (202a, 202b, . or a processing device such as a programmable logic device FPGA), a memory 204 for st...

Embodiment 3

[0172] According to an embodiment of the present invention, a log compression device for implementing the above log compression method is also provided, such as Figure 4 As shown, the device 400 includes:

[0173] The collection module 40 is configured to collect at least one piece of log information generated on the front-end device in real time, wherein the log information is operation information generated by operating at least one application program on the front-end device.

[0174] The compression processing module 42 is configured to perform compression processing on at least one piece of log information collected in real time to obtain a compression result.

[0175] The writing module 44 is used for writing the compression result into a predetermined location.

[0176] It should be noted here that the acquisition module 40, the compression processing module 42 and the writing module 44 correspond to steps S31 to S35 in Embodiment 1, and the examples and application s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log compression method and device. The method comprises the following steps of: collecting at least one piece of log information generated on the front-end equipment in realtime; wherein, the log information is the operation information generated by operating at least one application program on the front-end equipment; compressing at least one piece of log information collected in real time is compressed to obtain a compression result; The compression result is written to a predetermined position. The invention solves the technical problem that the log file data is more and the content is more complex in the prior art, and the query log consumption time is long.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a log compression method and device. Background technique [0002] For Internet applications, it is very important to analyze the running logs of the application. In the prior art, system logs can be recorded through Syslog, and Syslog can receive log records of remote systems, process records including multiple systems in a log in chronological order, and store them in the form of files. [0003] After collecting system logs, you need to analyze and process the logs to obtain information such as the system running status. For example: in order to analyze an application program, obtain the operation log of the application program. And the application program has 100 servers, and each server has two logs, so in order to comprehensively analyze the operation log of the application program, it is necessary to log in to each server, which is complicated and tedious and takes a long t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/174G06F16/16G06F16/27
Inventor 李国忠
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap