Internet website group platform system and isolated stream computing method thereof

Abstract

The invention discloses an Internet website group platform system and an isolated stream computing method thereof. The system comprises a stream data access layer, a stream data processing layer, an intermediate data storage layer and a result data archiving layer; the stream data access layer is used for receiving data collected by a collection system and sending the data to the stream data processing layer, the stream data processing layer is used for cleaning and filtering the arrival data, performing comparison according to the current time to eliminate the overtime data, and then calculating the access volume of the online units by using the isolated stream computing method, and the result data archiving layer is used for storing a computing result of the intermediate data storage layer. Parallel counting of the multi-unit access volume and data analysis of the Internet website group platform system are beneficial for the reliable operation of the unit websites, the master on the client groups of the websites in real time, and the detection of different clients on the website access at different regions and different time periods.

Description

technical field [0001] The invention relates to an Internet website group platform system and a parallel isolation flow calculation method thereof, belonging to the technical field of enterprise portal websites. Background technique [0002] In the traditional data processing process, the data is always collected first, and then put into the DB. When people need to query the data through the DB, get the answer or perform related processing. Although this seems very reasonable, the result is very compact and, especially in some specific problems in some real-time search application environments, offline processing similar to MapReduce cannot solve the problem well. This leads to a new data computing structure --- stream computing. It can analyze large-scale flow data in real time during the changing movement process, capture potentially useful information, and send the results to the next computing node. [0003] The earlier representative system is IBM's System S, which i...

AI Technical Summary

Problems solved by technology

[0010] The technical problem to be solved by the present invention is to overcome the defects of the prior art, provide an Internet website group platform system and its parallel isolation flow calculation method, and use the parallel isolation flow algorithm to conduct online analysis on the multi-unit visits of the website group, And the change of access status of each unit of the website group system is recorded and saved in real time, and the offset coefficient of each unit running in the website group is calculated under the average daily operation status, which effectively solves the multi-unit operation of the Internet website group platform system Caused inaccurate issues when counting visits per unit

Images