User internet behavior collecting method and system and user internet behavior analyzing method and system

Abstract

The invention discloses a user internet behavior collecting method and system and a user internet behavior analyzing method and system, wherein fields are increased dynamically according to analysis requirements, and rapidness and efficiency of field increase are ensured at the same time. The technical scheme disclosed by the invention is as follows: the dynamic increase problem of user internet behavior analysis dimensionality is solved by adopting a column-store data architecture, that is to way, fields of a data list are not of a fixed mode, but are increased dynamically according to the analysis requirements, and rapidness and efficiency of the field increase are ensured at the same time. Besides, according to the invention, the problem of low efficiency of mass data traversal query of user internet behaviors is solved by adopting a Key-Value cloud platform parallel query method, the internet behavior of certain user can be analyzed by adopting a Key-Value matched parallel computation query method rather than traversing the whole data list, and thus the query efficiency of user internet behavior analysis is greatly improved.

Description

technical field [0001] The invention relates to a collection and analysis technology of user online behavior, in particular to a collection and analysis technology of user online behavior based on cloud computing column storage. Background technique [0002] In the Internet field, data warehouses are usually used to analyze user online behaviors. The data warehouse stores all user online behavior log information in a data table based on row storage, and then counts and analyzes a certain data through traversal query. Characteristics of users surfing the Internet. [0003] This data warehouse analysis method has the following two disadvantages: [0004] 1. The row storage mode is suitable for data analysis methods with fixed dimensions and fixed fields, and the information of users surfing the Internet includes connection status, data flow and browsing content, etc. With the continuous explosion of Internet content, the analysis of users surfing behavior Dimensions are boun...

AI Technical Summary

Problems solved by technology

[0004] 1. The row storage mode is suitable for data analysis methods with fixed dimensions and fixed fields, and the information of users surfing the Internet includes connection status, data flow, browsing content and many other contents. With the continuous explosion of Internet content, the analysis of users surfing behavior Dimensions are bound to expand continuously, so the row storage mode cannot cope with the dynamic increase of analysis dimensions

[0005] 2. The data warehouse divides the user's online information into multiple rows and stores them in the data table. To analyze the complete online behavior of a user, it is necessary to traverse the entire data table to obtain the complete information of a user. Therefore, the efficiency of data query Low, can no longer support the requirements of mass user online behavior analysis

Images