Log storage optimization method and device

A storage optimization and log technology, applied in structured data retrieval, database model, input/output to record carrier, etc., can solve problems such as inefficiency, log entropy is not reduced, etc., to improve analysis efficiency, reduce log entropy, The effect of improving archive efficiency

Active Publication Date: 2020-01-03
EMC IP HLDG CO LLC
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Generally speaking, the method of searching and analyzing logs is very inefficient. In addition, although existing processing methods also adopt compression and deduplication processing, the entropy of logs has not been reduced.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log storage optimization method and device
  • Log storage optimization method and device
  • Log storage optimization method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Various exemplary embodiments of the present disclosure are described in detail below with reference to the accompanying drawings. The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of methods and systems according to various embodiments of the present disclosure. It should be noted that each block in a flowchart or a block diagram may represent a module, a program segment, or a part of a code, and the module, a program segment, or a part of a code may include one or more An executable instruction for a specified logical function. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the present disclosure relate to a log storage optimization method and device, the method comprising: receiving log data; converting the log data into structured data using parsing rules; and encoding the structured data to reduce log data storage. The embodiments of the present disclosure can reduce the storage space of the log and improve the analysis efficiency of the log by performing structural conversion on the log record and compressing and encoding the converted data.

Description

technical field [0001] Embodiments of the present disclosure generally relate to data storage technology, and more specifically relate to a method and device for log storage optimization. Background technique [0002] A log refers to a record of transactions or operations that occur in a system (eg, software, application) or device (eg, server, terminal device). Log data contains ordered records of all activities and behaviors of a system or device, and is generally semi-structured data, such as single-line logs and complex multi-line logs. Technicians typically search, correlate, visualize, analyze, and record log data to identify and resolve operational and security issues with systems or equipment. [0003] Modern software-defined data center (SDDC) architectures are capable of continuously generating log data, often faster than technicians can process it. Due to the exponential growth in the amount of activity and data, the amount of logs generated is also growing rapi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F16/28
CPCG06F16/22G06F16/2379
Inventor 王天青陆明刚陈超徐昊包捷马金龙
Owner EMC IP HLDG CO LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products