Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A system and method for collecting information data generated by users on the Internet

An information data and Internet technology, applied in the field of information data systems, can solve problems such as loss, analysis operation delay, and increased system complexity

Active Publication Date: 2016-04-27
ALIBABA (CHINA) CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing log storage is only stored in time series without classification, which brings difficulties to the administrator or program to automatically and quickly call the log information, because the initial format of the log information is different according to the type, so The retrieved log information needs to be format-converted according to the different types, which will undoubtedly cause analysis operation delay and increase the complexity of the system, and it is prone to loss in the process of transmitting to the log server. The present invention is dedicated to solving this problem. A technical issue, that is, more secure, real-time, and reliable collection of log data or system log information generated by users surfing the Internet

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A system and method for collecting information data generated by users on the Internet
  • A system and method for collecting information data generated by users on the Internet
  • A system and method for collecting information data generated by users on the Internet

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0028] The invention realizes a set of safe, real-time and reliable log collection and storage scheme, which includes an agent module, a monitoring cluster module and a receiving cluster module.

[0029] Such as figure 1 As shown, the working diagram of the agent module. The proxy module is implemented as follows:

[0030] Before collecting a type of log, you need to define the type of log and the transmission protocol (support based on TCP protocol, support based on UDP protocol). For example: To collect page access logs (accessLog), define the log type as accessLog, and use the UDP protocol for transmission. After the definition, the type of the log and the transmission protocol are notified to call the proxy module (the so-called proxy module is a computer program that is used as a plug-in for Internet applications (large-scale websites) ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a system and method for collecting information data generated by a user on the Internet. The system comprises an agency module, a cluster monitoring module and a cluster receiving module, wherein the agency module is used for collecting information of log data when the log data are generated, adding log types in front of the log data and transmitting the log data to the cluster receiving module according to a transmission protocol, the cluster monitoring module is used for being communicated with the cluster receiving module to judge the service state of a server in the cluster receiving module, and the cluster receiving module is used for carrying out processing according to the types of the log data after the log data are received. The method includes the steps of when the user accesses a webpage and the corresponding log data are generated, collecting the information of the log data, adding the log types in front of the log data, enabling the cluster monitoring module to judge the service state of the server in the cluster receiving module, when the service state is good, feeding the information of a cluster receiving server back to the agency module, and enabling the agency module to send logs to the specified cluster receiving server in the specified transmission protocol mode.

Description

technical field [0001] The invention is applicable to the Internet field, and in particular relates to a system and method for collecting information data generated by users on the Internet. Background technique [0002] With the continuous popularization and development of the Internet, more and more users access the Internet, and these users will generate a large amount of log data information, which is very valuable for Internet companies. At present, there are two general processing methods for logs. One is to create a log file on the local memory of the computer system, and then each module records system logs, user logs, etc. into the file; the other is to record the log information that needs to be recorded. Through the User Datagram Protocol (full name in English: UserDatagramProtocol, hereinafter referred to as UDP) to the designated log server, the designated log server may simply store the log in one or several files, or store it in the database. Administrators L...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/26H04L29/08
Inventor 崔国祥姚健潘柏宇卢述奇
Owner ALIBABA (CHINA) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products