Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Flexible log storage and acquisition method

An acquisition method and log technology, which is applied in the field of flexible log storage and acquisition, can solve the problems of complex acquisition and low efficiency, and achieve the effects of reducing reading, reducing space occupation, and reducing the number of visits and data transmission volume

Active Publication Date: 2013-01-16
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF5 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, the length of the data at that time, the writing time, a specific type of data, etc., were very complicated to obtain, and it was necessary to find the corresponding files, find the specified content in a bunch of files, and then compare them, which was very inefficient.
When multiple programs read the same set of incremental log files at the same time, they will need to be recorded separately because of the log nodes, resulting in multiple sets of programs and multiple logs. The required log node records become a many-to-many relationship, no matter which method is used Recording the record node directly is an additional overhead and will cause side problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Flexible log storage and acquisition method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention introduces an index and a data content identification box. When the log hash is recorded, each file that records data has a unique representation of a rule, such as using the data type and unique identification ID provided by the data. The name of the log file is, for example, type_1.log type_2.log. The so-called index concept refers to a general index log file, for example, the name is index.log, and the content placed in it is as follows:

[0025] Each row stores a data index, in order to facilitate data index reading.

[0026] The identification of which file the data content is stored in, such as type and id, through which the corresponding file can be found.

[0027] The data file is stored in the starting line number of the corresponding file or the location identifier of the written content.

[0028] Additional information, such as actions for this type of data, data recording time, data length, etc., are used for fast data screening and p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a flexible log storage and acquisition method, which comprises a data writing process and a data reading process. The method is based on multi-file hash, and under the condition of single file reading-writing entry when a plurality of files are required to be frequently read and written, an index-based file storage and reading mode is provided, so that the files can be conveniently stored in a hash way, and required logs can be easily read.

Description

technical field [0001] The invention relates to a method for storing and obtaining flexible logs. Background technique [0002] Incremental log means that the content in the log file will increase with time, and it is not fixedly provided for one-time reading. The log file is used as a data communication medium, that is to say, it is operated by one or a series of programs to generate certain data information, which is stored in the log file, and then the data is read by one or more files, so that a series of operate. At present, the most commonly used log recording methods are roughly as follows: 1. Write a bunch of content to the log sequentially, and then another program reads the specified log to obtain the content. This is recorded into a single log file. 2. Divide the log file by time, such as by month, day, hour, etc., and record it into multiple files. 3. The log file is divided by a certain identification of the content, such as unique ID, type and other record...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30G06F11/34
Inventor 潘海东梅春任剑锋
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products