Unlock instant, AI-driven research and patent intelligence for your innovation.

Log compression method and device, decompression method and device

A technology of compression method and compression device, which is applied in special data processing applications, instruments, electrical digital data processing, etc., and can solve the problem of low compression ratio

Active Publication Date: 2017-06-16
SHANGHAI DNION INFORMATION & TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing various file compression methods have the problem of low compression rate due to the characteristics of Internet access logs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log compression method and device, decompression method and device
  • Log compression method and device, decompression method and device
  • Log compression method and device, decompression method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0095] The records in the Internet access log are composed of countless user access records, each record is composed of relatively fixed fields, and the same field of different records is long, and there are many repeated characters between the same fields. For example, Internet Protocol (Internet Protocol, referred to as IP) address, Uniform Resource Locator (Uniform Resource Locator, referred to as URL), cookie (referring to the data stored on the user's local terminal by the website in order to identify the user's identity and conduct session tracking), etc.

[0096] The file compression method in the prior art has the problem of low log compression rate because the above-mentioned characteristics of Internet logs are not considered.

[0097] In order to solve the above-mentioned problems in the prior art, the technical solution adopted in the embodiment of the present invention can reduce the number of characters of the merged strings by merging the character strings stored...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a log compression method and device and a log decompression method and device. The log compression method includes the steps that records in logs are read; the records of the logs are stored according to fields, and bit order information of the records in the logs is added to the fields of the stored records; character strings of the fields of the records in the logs are compared with character strings in fields of selected reference records respectively, and the character strings of the fields of the records in the logs are merged so that the merged character strings can be acquired; compressed files are established, wherein the compressed files comprise header information of the compressed files; the acquired merged character strings are compressed and sequentially added to the established compressed files according to location sequences of the fields in the records. By the adoption of the scheme, the compression ratio of the logs can be effectively increased, and the log compression method and device and the log decompression method and device are simple and efficient.

Description

technical field [0001] The invention relates to the technical field of data compression, in particular to a log compression method and device, and a decompression method and device. Background technique [0002] The Internet generates big data. With the continuous development of Internet technology, data will become a strategic resource like energy and materials. How to use data resources to dig deep into innovation and improve efficiency is the goal pursued by many IT companies. The big data generated by the Internet mainly comes from the in-depth analysis of Internet access logs. Therefore, the collection and storage of Internet access logs becomes the key. Especially for log storage, since the uncompressed original log occupies too much storage space, the original log must be compressed to achieve long-term preservation. [0003] In the prior art, there are various file compression methods, which can be applied to the compression of Internet access log records. Howeve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30H03M7/30
CPCG06F16/215H03M7/30
Inventor 乔志刚高亚明顾庆荣
Owner SHANGHAI DNION INFORMATION & TECH