A log storage method and system

A log and local storage technology, applied in the field of data processing, can solve problems such as poor scalability, data packet loss, and high packet loss rate, and achieve the effects of ensuring data credibility, efficient data storage, and reducing data packet loss

Inactive Publication Date: 2019-02-15
广东网安科技有限公司
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The existing technology has the following disadvantages: the original log is not stored
Database storage is the storage of a single type of database. Relational databases are usually used. Relational databases have a high packet loss rate in the case of large amounts of data, and the retrieval speed for massive data is slow. Multiple indexes are established to enhance retrieval efficiency. , will sacrifice the performance of the server
In addition, when a large amount of data association is involved, multi-table joint query is required, which takes up a lot of resources, the data table design is complicated, and the scalability is not strong
[0007] It is easy to cause data packet loss during peak business hours
Due to the thread design problem of the program, when the business peak period, a large amount of data is read and written, which will inevitably cause the loss of data writing or the jamming of data reading

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A log storage method and system
  • A log storage method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention is described in further detail now in conjunction with accompanying drawing. These drawings are all simplified schematic diagrams, which only illustrate the basic structure of the present invention in a schematic manner, so they only show the configurations related to the present invention.

[0038] Such as figure 1 As shown, the present invention provides a log storage method, and the method is specifically:

[0039] 101. After receiving the log data, the program starts the data receiving thread for data transmission;

[0040] 102. Receive the transmitted data and perform queue processing;

[0041] 103. Invoke the queued processed data and store it in the form of multi-node shunting.

[0042] Step 101, specifically, after receiving log data, the program starts a data receiving thread for data transmission. Before the data is received, the program opens the listening port to monitor the inflow of log data.

[0043] Step 102, queue the received...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log storage method and a log storage system. The log storage method comprises the following steps: after receiving log data, a program starts a data receiving thread for datatransmission; Receiving the transmitted data and performing queue processing; invoking The data after the queue processing is stored in the form of multi-node shunt. The log storage method of the invention is convenient for programs to call and process log data, reduces data packet loss, enhances service high availability, and realizes efficient data storage and extremely strong expansion.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a log storage method and system. Background technique [0002] Logs play a very important role in a complete information system. It can record all behaviors generated by the system and express them according to a certain specification. We can use the information recorded by the log system to troubleshoot the system, optimize the performance of the system, or adjust the behavior of the system based on this information. In the field of security, logs play an especially important role and can be said to be one of the most important tools in security auditing. Therefore, it is particularly important to store and recall log data. [0003] Existing log storage technologies are generally divided into two parts: file system storage and database storage. Log analysis receives log data packets through a specific port, and then converts them into XML, JSON and other data interaction forma...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18G06F16/13G06F16/22
Inventor 许祥宾
Owner 广东网安科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap