Unlock instant, AI-driven research and patent intelligence for your innovation.

A secure log compression storage and retrieval method based on variable length records

A technology for compressing storage and logs, applied in file metadata retrieval, digital data information retrieval, error detection/correction, etc., it can solve the problems of high CPU resource consumption and increase of log storage size, and achieve the goal of improving compression ratio and reducing size. Effect

Active Publication Date: 2019-01-08
南京聚铭网络科技有限公司
View PDF7 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0016] However, it needs to be compared with the benchmark record during log compression and decompression, and there may be a problem of excessive CPU resource consumption in actual operation; in addition, this method needs to add field separators between each field, which will lead to the final log Storage size increases

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A secure log compression storage and retrieval method based on variable length records
  • A secure log compression storage and retrieval method based on variable length records

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] Embodiment 1: see figure 1 , figure 2 , a security log compression storage and retrieval method based on variable-length records, said method comprising the following steps:

[0053] Step 1: Build a log collection environment;

[0054] Step 2: Obtain the pattern distribution data in the log;

[0055] Step 3: Variable-length encoding is performed on the fixed part in the pattern;

[0056] Step 4: establish the word index in the fixed pattern;

[0057] Step 5: carry out variable-length encoding and build index to the change part in the mode;

[0058] Step 6: Restore the log according to the fixed part and variable length part;

[0059] Step 7: Retrieve according to the fixed part, the variable length part and the relationship with the index.

[0060] The step 1 is to build a log collection environment; the details are as follows,

[0061] First of all, the pattern recognition of a log is based on which system or device it comes from, and then it is matched and ext...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a security log compression storage and retrieval method based on variable length records. The method includes the following steps: 1, generating a page map; 2, making a page snapshot; 3, extracting and comparing page sensitive words; 4, comparing and learning page characteristics; 5, monitoring the high-frequency page; 6, monitoring the low-frequency page; 7, backing up aresidual recovery mechanism. This method makes full use of the parsing result of the log in the history, obtains the distribution of different modes of each kind of equipment on the whole, and provides the practical basis for the compression coding.

Description

technical field [0001] The invention relates to a method, in particular to a security log compression storage and retrieval method based on variable-length records, and belongs to the technical field of log storage management. Background technique [0002] Log (Log); [0003] Generally speaking, the so-called logs are generated by various network systems, security systems, operating systems, database systems, application systems, etc., and can record the data sets of the operating status of related systems, which can become key information for tracing related behaviors; logs It can be divided into several categories to distinguish the differences, such as user login, network connection, host process running, etc.; related division basis can refer to national standards. [0004] Log Audit and Management System; [0005] The log audit management system is generally used to collect relevant log information and perform storage, statistics, and correlation processing; the log c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30G06F16/13G06F16/14G06F16/174G06F16/18
CPCG06F11/3065G06F11/3082Y02D10/00
Inventor 陈虎唐开达
Owner 南京聚铭网络科技有限公司