Check patentability & draft patents in minutes with Patsnap Eureka AI!

Log writing method and system

A log and subsystem technology, applied in the network field, can solve problems such as insufficient throughput, and achieve the effect of overcoming too small throughput

Active Publication Date: 2018-02-16
GUIZHOU BAISHANCLOUD TECH CO LTD
View PDF10 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problems existing in the prior art, a method and a system for writing logs are provided, the method and system can solve the problem of insufficient throughput when writing logs into HDFS system, and can process messy log files tidy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log writing method and system
  • Log writing method and system
  • Log writing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined arbitrarily with each other.

[0043] The invention provides a method for writing logs. Such as figure 1 As shown, the method includes:

[0044] Step 101, obtaining multiple logs;

[0045] Step ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a log writing method and system. The method comprises the steps that 1, multiple logs are acquired; 2, the logs are divided into N grades according to a requested quantity of domain names contained in the logs, wherein N is a positive integer greater than or equal to 1; and 3, the logs are read respectively and written into an HDFS system according to the grades of the logs. By the adoption of the log writing method and system, disordered log files become clear and ordered after being written into the HDFS system, and access of a certain domain name in a certain time period can be queried rapidly and accurately just through a file name recorded in the HDFS system.

Description

technical field [0001] The invention relates to the network field, in particular to a method and system for writing logs. Background technique [0002] Hadoop Distributed File System (HDFS for short) is a highly fault-tolerant system that can provide high-throughput data access and is very suitable for applications on large-scale data sets. [0003] When a client submits a domain name resolution request, an access log is generated. Depending on the number of times the domain name is accessed, the size of the generated access log files varies. In this way, when the access log files are stored on the HDFS system, due to the large number of small-capacity files, it is necessary to frequently open the files to read the contents, resulting in a system crash. In addition, most of the access log files generated when submitting domain name resolution requests are disorganized. If these disorganized log files are directly written into the HDFS system, subsequent processing will be ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/1734
Inventor 陈亚川苗辉
Owner GUIZHOU BAISHANCLOUD TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More