Unlock instant, AI-driven research and patent intelligence for your innovation.

Log file storage method and device

A log file and storage device technology, applied in the field of log file storage methods and devices, can solve the problem of high operation and maintenance costs

Inactive Publication Date: 2017-06-13
JIANGSU TIANLIAN INFORMATION TECH DEV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the HDFS-based log file storage method in the prior art has the problem of high operation and maintenance costs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log file storage method and device
  • Log file storage method and device
  • Log file storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] As mentioned in the background art, in the HDFS-based log file storage method in the prior art, when the local log file fails to be written into the corresponding cloud file, the local file that fails to be written needs to be manually deleted.

[0023] Among them, when appending multiple local log files to the same cloud file fails, the file storage interface provided by HDFS supports failed retransmission when the network connection is not disconnected. However, when the number of upload failures reaches the preset threshold or the network connection is interrupted, HDFS will feed back information about upload failures, and will not delete incomplete log content that has been successfully uploaded. At this time, the existing manual method is generally used to restore the cloud file to the state before writing, which requires a lot of time and energy, and there are problems of complicated operation and low efficiency.

[0024] In order to solve the above-mentioned prob...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Provided are a log file storage method and device. The method comprises the steps that a local log file under a specified catalogue is obtained; the obtained local log file is written into a corresponding cloud file; when it is determined that the obtained local log file fails to be written into the corresponding cloud file, the corresponding cloud file is restored to a state before being written. Accordingly, the expense can be saved while the log file is stored.

Description

technical field [0001] The invention belongs to the technical field of log file processing, and in particular relates to a log file storage method and device. Background technique [0002] A content delivery network (Content Delivery Network, CDN) service provider provides acceleration services for customers through a large number of edge node servers. Every time the client visits, a corresponding log file will be generated. By analyzing and processing log files, valuable information can be obtained, so that customers can be better served. [0003] Apache Hadoop is an open source software framework that supports data-intensive distributed applications and is released under the Apache 2.0 license agreement, and supports applications running on large clusters built on commodity hardware. Hadoop Distributed File System (Hadoop Distributed File System, HDFS) is a core component of Hadoop, which realizes the storage of massive data by building a network-based distributed file s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14G06F17/30H04L29/08
CPCG06F11/1464G06F11/1469G06F11/1471G06F16/172G06F16/1734G06F16/182H04L67/06H04L67/1095H04L67/1097
Inventor 黄凯旋杨宁顾庆荣康凯
Owner JIANGSU TIANLIAN INFORMATION TECH DEV