System and method for collecting information data generated by a user on Internet

Abstract

The invention relates to a system and method for collecting information data generated by a user on the Internet. The system comprises an agency module, a cluster monitoring module and a cluster receiving module, wherein the agency module is used for collecting information of log data when the log data are generated, adding log types in front of the log data and transmitting the log data to the cluster receiving module according to a transmission protocol, the cluster monitoring module is used for being communicated with the cluster receiving module to judge the service state of a server in the cluster receiving module, and the cluster receiving module is used for carrying out processing according to the types of the log data after the log data are received. The method includes the steps of when the user accesses a webpage and the corresponding log data are generated, collecting the information of the log data, adding the log types in front of the log data, enabling the cluster monitoring module to judge the service state of the server in the cluster receiving module, when the service state is good, feeding the information of a cluster receiving server back to the agency module, and enabling the agency module to send logs to the specified cluster receiving server in the specified transmission protocol mode.

Description

technical field [0001] The invention is applicable to the Internet field, and in particular relates to a system and method for collecting information data generated by users on the Internet. Background technique [0002] With the continuous popularization and development of the Internet, more and more users access the Internet, and these users will generate a large amount of log data information, which is very valuable for Internet companies. At present, there are two general processing methods for logs. One is to create a log file on the local memory of the computer system, and then each module records system logs, user logs, etc. into the file; the other is to record the log information that needs to be recorded. Through the User Datagram Protocol (full name in English: User Datagram Protocol, hereinafter referred to as UDP) to the designated log server, the designated log server may simply store the log in one or several files, or store it in the database. The administra...

AI Technical Summary

Problems solved by technology

However, the existing log storage is only stored in time series without classification, which brings difficulties to the administrator or program to automatically and quickly call the log information, because the initial format of the log information is different according to the type, so The retrieved log information needs to be format-converted according to the different types, which will undoubtedly cause analysis operation delay and increase the complexity of the system, and it is prone to loss in the process of transmitting to the log server. The present invention is dedicated to solving this problem. A technical issue, that is, more secure, real-time, and reliable collection of log data or system log information generated by users surfing the Internet

Images