Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Log file storage method and device

A log file and storage device technology, applied in the field of log file storage methods and devices, can solve problems such as high overhead, achieve the effects of improving efficiency, improving recovery efficiency, and saving manpower, time and resources

Inactive Publication Date: 2017-06-13
JIANGSU TIANLIAN INFORMATION TECH DEV
View PDF3 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the HDFS-based log file storage method in the prior art has the problem of high overhead

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log file storage method and device
  • Log file storage method and device
  • Log file storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] As stated in the background technology, in the HDFS-based log file storage method in the prior art, when the local log file fails to be written into the corresponding cloud file, the received log file is usually written into the corresponding cloud file in real time. When writing a log file, that is, writing a log file to the corresponding cloud file requires a network overhead, which has the problems of low efficiency and high overhead.

[0029] In order to solve the above problems, the technical solution in the embodiment of the present invention compresses and merges the log files of the edge node server received in real time within the corresponding cache time period and then sends them to the cloud, which can save the cost of communication with the cloud when sending the log files. The number of interactions and the total network bandwidth occupied can save the network overhead generated by log file storage and save resources.

[0030] In order to make the above ob...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a log file storage method and device. The method comprises the steps of receiving log files generated by an edge node server in real time within a preset cache period and compressing and merging the log files, thereby obtaining corresponding compressed log files; and when the time corresponding to the finish time of the cache period arrives, uploading the obtained compressed log files to a preset cloud server for storage. According to the scheme, the cost can be reduced when the log files are stored.

Description

technical field [0001] The invention belongs to the technical field of log file processing, and in particular relates to a log file storage method and device. Background technique [0002] A content delivery network (Content Delivery Network, CDN) service provider provides acceleration services for customers through a large number of edge node servers. Every time the client visits, a corresponding log file will be generated. By analyzing and processing log files, valuable information can be obtained, so that customers can be better served. [0003] Apache Hadoop is an open source software framework that supports data-intensive distributed applications and is released under the Apache 2.0 license agreement, and supports applications running on large clusters built on commodity hardware. Hadoop Distributed File System (Hadoop Distributed File System, HDFS) is a core component of Hadoop, which realizes the storage of massive data by building a network-based distributed file s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F17/30G06F11/14
CPCH04L67/06H04L67/1097G06F11/1464G06F11/1469G06F16/1815G06F16/182H04L67/5651H04L67/568
Inventor 黄凯旋杨宁顾庆荣康凯
Owner JIANGSU TIANLIAN INFORMATION TECH DEV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com