Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Extensible log data storage method and device

A data storage and log technology, applied in the computer field, can solve problems such as log data information redundancy

Active Publication Date: 2018-05-15
闪捷信息科技有限公司
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the purpose of the embodiments of the present invention is to provide a scalable log data storage method and device, by setting field dictionaries and pattern dictionaries, etc., effectively solving the problem of a large amount of redundant information in the log data storage process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Extensible log data storage method and device
  • Extensible log data storage method and device
  • Extensible log data storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] see figure 2 and image 3 The scalable log data storage method proposed in this embodiment specifically includes the following steps:

[0042]Step S101: Compare the rate of change of each field in the log data with a preset standard rate of change. What needs to be explained here is that the preset standard rate of change is an a priori value, and the size of the a priori value is related to information such as storage space size and information redundancy requirements. The purpose of comparing the change rate of a field is to distinguish each field in the log data.

[0043] Step S102: When the rate of change is less than the standard rate of change, store the field in the field dictionary, that is, store the field with a small change in the field dictionary. What needs to be explained here is that the field dictionary The storage format of the data in includes the field ID and field content. During the implementation process, the field ID is used to store different...

Embodiment 2

[0057] see Figure 4 , the present embodiment provides an expandable log data storage device including: a rate-of-change comparison module 11 configured to compare the rate of change of each field in the log data with a preset standard rate of change.

[0058] The field storage module 12 is used to store the field in the field dictionary when the rate of change is less than the standard rate of change, wherein the storage format of the data in the field dictionary includes field ID and field content, and the field ID is used to store the fields in each field Different key values, field content is used to store different values ​​in each field.

[0059] Mode storage module 13, for when the rate of change is greater than or equal to the standard rate of change, the field is put into the mode dictionary for storage, wherein, the storage format of the data in the mode dictionary includes mode ID and mode content, and the mode ID is used to store each field Different key values ​​...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an extensible log data storage method and device, and relates to the technical field of computers. The extensible log data storage method comprises the following steps of: firstly comparing a change rate of each field in log data with a preset standard change rate; when the change rate is smaller than the standard change rate, putting the fields in a field dictionary to carry out storage, storing different key values in each field via a field ID, and storing different numerical values in each field via a field content; and when the change rate is greater than or equal tothe standard change rate, putting the field in a mode dictionary to carry out storage, and storing different key values in each field via a mode ID, wherein the mode ID stores different key values ineach field and a mode content stores different numerical values in each field, so as to divide the log data into data with small change rates and data with large change rates. According to the methodand device, key values in the fields can be stored in a dictionary form, so that the problem of mass information redundancy in storage process is avoided.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to an expandable log data storage method and device. Background technique [0002] Log data (English full name is log data) is the internal meaning of a log, that is, log data is the information in a log used to indicate why a log is generated. General log data includes information such as time, client IP, server IP, client host name, server host name, user, operation, etc. After receiving the log data, the log storage device divides the data into strips, or stores the data as a whole as a disk file, its specific storage structure is as follows figure 1 shown. [0003] However, there are most of the repeated data in the log data, such as IP, port, host name, operation type, etc. Storing these log data one by one during the operation will cause this part of the log data to be repeatedly recorded, thus occupying a large amount of disk space. [0004] To sum up, there is currently...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F11/07G06F11/30
CPCG06F11/0775G06F11/0787G06F11/3082
Inventor 张黎隆莉詹金凯付翔尤伟志
Owner 闪捷信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com