Unlock instant, AI-driven research and patent intelligence for your innovation.

A real-time asynchronous log collection method and system

A technology for collecting systems and logs, applied in the field of system security, which can solve problems such as relatively high requirements, inappropriateness, and troublesome deployment.

Active Publication Date: 2019-11-26
GUANGZHOU HUADUO NETWORK TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For the collection of logs, the usual way in the prior art is to synchronize the log files to the target machine through shell scripts, read and analyze the log files on the target server. Due to the time difference, it is generally delayed for more than half an hour, so the obtained The log file does not necessarily contain all the logs of the target server at the current moment. Secondly, it also depends on the server of the business side. You need to log in to the target server to obtain the log file. It is also more troublesome to deploy. For real-time synchronization of larger log files The network card and broadband requirements are relatively high, so with the continuous improvement of business requirements for real-time logs, the existing methods are no longer suitable

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A real-time asynchronous log collection method and system
  • A real-time asynchronous log collection method and system
  • A real-time asynchronous log collection method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention.

[0042] In some processes described in the specification and claims of the present invention and the above-mentioned drawings, a plurality of operations appearing in a specific order are contained, but it should be clearly understood that these operations may not be performed in the order in which they appear herein Execution or parallel execution, the serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. Additionally, these processes can include more or fewer operations, and these operations can be performed sequentially or in parallel. It should be n...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a real-time asynchronous log collection method and system. The method includes: setting a monitoring thread in the service thread of the target server to monitor the writing interface of the log of the target server; when the writing interface is called, obtaining the text information written into the log; The information and the identification of the target server are sent to the target machine, and the text information written in the log of each target server is collected by the target machine. By adopting the invention, the real-time performance of log collection can be improved.

Description

technical field [0001] The present invention relates to the technical field of system security, and more specifically, to a real-time asynchronous log collection method and system. Background technique [0002] Network devices, systems and service programs, etc., will generate an event record called log (log) during operation; each line of log records the description of related operations such as date, time, user and action. When we perform some operations on the system, these log files usually record some relevant content of our operation, which is quite useful for system security staff. For example, if someone detects the system by IPC, the system will quickly record the IP, time, user name, etc. used by the detector in the security log. After using FTP to detect, it will record the IP, time, username used for the probe, etc. [0003] As an Internet company, website monitoring logs are one of the largest sources of data. The daily log volume is at least 1TB, and more tha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/30
CPCG06F11/3065
Inventor 李俊
Owner GUANGZHOU HUADUO NETWORK TECH