User online behavior data acquisition method in backbone link and system

A data acquisition system and data acquisition technology, applied in the network field, to achieve the effect of improving processing efficiency and speed of capture

Active Publication Date: 2010-12-08
HUAWEI TEHCHNOLOGIES CO LTD
View PDF4 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Generally speaking, the backbone networks of telecom operators mostly use 10G bandwidth (10Gbps) network transmission links. How to quickly and real-time obtain the online behavior data of network users from the transmission links of the bac

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • User online behavior data acquisition method in backbone link and system
  • User online behavior data acquisition method in backbone link and system
  • User online behavior data acquisition method in backbone link and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The present invention will be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the invention are illustrated.

[0039] figure 1 A flowchart showing an embodiment of the method for collecting user online behavior data in the backbone network link of the present invention.

[0040] like figure 1 As shown, in step 102, a data packet including an HTTP (Hypertext Transfer Protocol, Hypertext Transfer Protocol) request message in a backbone network link is captured. For example, on the low-speed backbone network link, the system interrupt method can be used to obtain the serial network link frame data flow from the network card device, and on the high-speed backbone network network link, the high-speed serial network link frame data stream can be obtained from the network card device by software polling. Network link frame data flow, with DMA ( direct Memory Access , direct memory access) to store network li...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a user online behavior data acquisition method in a backbone link. The method comprises the following steps of: capturing a data packet containing a HTTP (Hyper Text Transport Protocol) request message in the backbone link, extracting web page URLs (Uniform Resource Locator) accessed by a user and HTTP field information reflecting user online behavior from the data packet according to the HTTP analysis by adopting parallel processing; filtering the URLs and acquiring web page URLs of which page contents needed to be captured according to a URL mode characteristic tree;and capturing the page contents of the filtered web page URLs in an asynchronous mode. The method and the system of the invention can capture an original data pocket containing a HTTP request messagein a gigabit link in real time, extract a user IP (Internet Protocol) address, web page URL addresses and other related user online information data from the original data pocket in real time, filterthe mass web page URL addresses in real time and capture the page contents in quasi real time.

Description

technical field [0001] The invention relates to network technology, in particular to a method and system for collecting user online behavior data in a backbone network link. Background technique [0002] Based on the needs of various aspects such as statistics and applications, it is necessary to comprehensively collect and obtain the online behavior activity data of Internet users on the transmission link of the backbone network of the telecom operator. Generally speaking, the backbone networks of telecom operators mostly use 10G bandwidth (10Gbps) network transmission links. How to quickly and real-time obtain the online behavior data of network users from the transmission links of the backbone network of telecom operators has many technical problems. great challenges and difficulties. At present, there is no solution for collecting user online behavior data based on the backbone network level of telecom operators in the industry. [0003] The present applicant provides ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08H04L29/06G06F17/30
Inventor 张雁冰胡平刘军王强
Owner HUAWEI TEHCHNOLOGIES CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap