Rapid web flow collection statistical system and method

A traffic collection and statistics system technology, applied in the field of web traffic collection and statistics system, can solve the problems of large resource consumption, long time, and difficulty in real-time statistics.

Active Publication Date: 2013-11-27
CHINANETCENT TECH
View PDF5 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1) In order to process massive web access logs, and these logs are still scattered, it needs to consume a lot of resources, including bandwidth transmission and machine equipment consumption
[0006] 2) Statistical data delay is large, because it takes a long time to collect, process and analyze web access logs, and because there are many layers in the architecture, it is difficult to achieve real-time statistics even if resources are increased

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rapid web flow collection statistical system and method
  • Rapid web flow collection statistical system and method
  • Rapid web flow collection statistical system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0030] An embodiment of a fast web traffic collection and statistics system

[0031] figure 1 It shows the structure of the preferred embodiment of the fast web traffic collection and statistics system of the present invention. See figure 1 , the system of this embodiment includes a traffic collection and analysis device 1 , a traffic transfer and merging device 2 and a traffic final merging device 3 .

[0032] Traffic collection and analysis device 1 is deployed on content distribution network nodes, and collects and analyzes traffic logs in real time on web servers. The logs only contain basic information required for business traffic data statistics and are formatted (web servers need to record in this log format) traffic log), as long as simple parsing and processing are performed, business traffic data can be quickly obtained. Compared with ge...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a rapid web flow collection statistical system and method. Based on processing on one-machine web server real-time statistical service flow, the web flow real-time statistical aim is achieved with less resource cost. According to the technical scheme, the rapid web flow collection statistical system comprises a flow collection analysis device, a flow transferring merging device and a flow final-merging device. The flow collection analysis device is deployed on a content distribution network node and collects and analyzes a flow log in real time, service flow data for generating a single node are counted, and the service flow data of the single node are sent to the flow transferring merging device. The flow transferring merging device is deployed on a flow transferring merging node, merging counting is carried out on the service flow data of the content distribution network node, middle flow data of a service are generated in real time, and then the middle flow data are transmitted to the flow final-merging device. The flow final-merging device is deployed on a flow final-merging node, merging counting is carried out on the middle flow data of the service in real time, and final flow data of the service are generated.

Description

technical field [0001] The invention relates to web traffic statistics technology, in particular to a system and method for collecting and counting web traffic of content distribution network (CDN) service providers. Background technique [0002] In order to provide effective acceleration services for CDN acceleration customers, CDN service providers generally deploy large-scale CDN nodes. These nodes cover a wide range, even covering the whole world. In order to monitor various traffic data of customers and node application services in real time changes, it is necessary to quickly collect statistics on the web traffic on these nodes. [0003] The existing web traffic statistics technology involves traffic statistics at the business level, for example, to collect and analyze web access logs to collect and analyze traffic data of customers and node application services. [0004] This traditional web traffic statistics technology needs to deal with the web access logs distrib...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/26H04L12/24
Inventor 洪珂邹宁勇张芽
Owner CHINANETCENT TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products