Flexible log storage and acquisition method

An acquisition method and log technology, which is applied in the field of flexible log storage and acquisition, can solve the problems of complex acquisition and low efficiency, and achieve the effects of reducing reading, reducing space occupation, and reducing the number of visits and data transmission volume

Active Publication Date: 2013-01-16
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF5 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, the length of the data at that time, the writing time, a specific type of data, etc., were very complicated to obtain, and it was necessary to find the corresponding files, find the specified content in a bunch of files, and then compare them, which was very inefficient.
When multiple programs read the same set of incremental

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Flexible log storage and acquisition method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0024] The present invention introduces an index and data content identification box. When the log is hashed and recorded, each file that records data has a unique representation of the rule, for example, the data type and unique identification ID provided by the data are used. The name of the log file is, for example, type_1.log type_2.log. The so-called index concept refers to a total index log file, for example, the name starts with index.log, and the contents placed in it are the following:

[0025] Each row stores a data index, in order to facilitate data index reading.

[0026] The identification of the file where the data content is stored, such as type, id, through which the corresponding file can be found.

[0027] The starting line number of the data file stored in the corresponding file or the position identification of the written content.

[0028] Additional information, such as actions performed on such data, data recording time, data length, etc., is used for rapid dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a flexible log storage and acquisition method, which comprises a data writing process and a data reading process. The method is based on multi-file hash, and under the condition of single file reading-writing entry when a plurality of files are required to be frequently read and written, an index-based file storage and reading mode is provided, so that the files can be conveniently stored in a hash way, and required logs can be easily read.

Description

technical field [0001] The invention relates to a method for storing and obtaining flexible logs. Background technique [0002] Incremental log means that the content in the log file will increase with time, and it is not fixedly provided for one-time reading. The log file is used as a data communication medium, that is to say, it is operated by one or a series of programs to generate certain data information, which is stored in the log file, and then the data is read by one or more files, so that a series of operate. At present, the most commonly used log recording methods are roughly as follows: 1. Write a bunch of content to the log sequentially, and then another program reads the specified log to obtain the content. This is recorded into a single log file. 2. Divide the log file by time, such as by month, day, hour, etc., and record it into multiple files. 3. The log file is divided by a certain identification of the content, such as unique ID, type and other record...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F11/34
Inventor 潘海东梅春任剑锋
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products