Compression algorithm for internet log data of mobile network

A compression algorithm and mobile network technology, applied in the information field to save storage resources

Inactive Publication Date: 2019-12-06
北京上下文系统软件有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the huge amount of online data, a compression algorithm similar to gzip is usually used to compress the data to about 30% of the original data, but it still needs to use a large amount of storage resources to store these data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Compression algorithm for internet log data of mobile network
  • Compression algorithm for internet log data of mobile network
  • Compression algorithm for internet log data of mobile network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The technical solution of this patent will be further described in detail below in conjunction with specific embodiments.

[0024] see Figure 1-4 , a compression algorithm for log data on a mobile network, comprising the following steps:

[0025] Step 1: Obtain online log data, and perform data analysis according to the source data format;

[0026] Step 2: compress the start time and end time;

[0027] Parse the start time field, and make a difference with the time marked by the file name, and convert the difference into integer data. If the difference exceeds 65536, store 4 bytes and set the flag bit 1 to true, otherwise store 2 bytes the difference;

[0028] Parse the end time field and make a difference with the start time. If the difference is 0, set flag 2 to true, do not store the end time, otherwise store the difference of 2 bytes;

[0029] Step 3: Compress the mobile phone number;

[0030] Parse the mobile phone number field and check whether it has alread...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a compression algorithm for internet log data of a mobile network, which comprises the following steps: 1, acquiring the internet log data, and analyzing the data according to asource data format; 2, compressing the start time and the end time; 3, compressing the mobile phone number; 4, compressing the source IP; 5, compressing the target IP; 6, storing all the compressed fields and the flag bits into a disk. Aiming at the characteristics of the Internet surfing log data, the compression ratio of the Internet surfing log data is optimized from 30% of original data to about 17%, about half of storage resources are saved, and the compression ratio is higher.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a compression algorithm for mobile network surfing log data. Background technique [0002] Mobile network access log data is the data generated when accessing the network through the operator's cellular communication technology, including access start time, access end time, mobile phone number, source IP, destination IP, access URL, etc. Operators need to store these data as File, used for billing, data query and other functions. Due to the huge amount of online data, a compression algorithm similar to gzip is usually used to compress the data to about 30% of the original data, but it still needs to use a large amount of storage resources to store these data. Therefore, a compression algorithm with a higher compression ratio is required. Contents of the invention [0003] The purpose of the present invention is to provide a compression algorithm for mobile network log da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & AuthorityApplications(China)
IPC IPC(8): G06F16/174
CPCG06F16/1744
Inventor苏鹏威
Owner北京上下文系统软件有限公司