Design and implementation method for user behavior analysis system based on Hadoop

A hadoop cluster and behavior analysis technology, applied in transmission systems, digital transmission systems, electrical components, etc., to achieve the effect of solving network interruptions, improving efficiency, and enhancing capture efficiency

Inactive Publication Date: 2015-03-04
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF3 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This requires application-layer protocol reorganiz

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Design and implementation method for user behavior analysis system based on Hadoop
  • Design and implementation method for user behavior analysis system based on Hadoop
  • Design and implementation method for user behavior analysis system based on Hadoop

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] Below according to accompanying drawing of description, in conjunction with specific embodiment, the present invention is further described:

[0027] A Hadoop-based user behavior analysis system design and implementation method, using the current popular big data processing platform hadoop technology, to realize Hadoop-based user behavior analysis method, first use the high-speed packet capture tool PF_RING to capture the data of the network entrance as user behavior Analyze the data source and store it in a distributed manner, then call the network security development kit tool Libnids to reorganize the data packets, realize the reorganization of TCP / IP, realize the HTTP restoration of the application layer, and then call the Hadoop cluster to use distributed Mapreduce programming to Analyze the network behavior activities of the user application layer, realize the full-layer analysis from the physical layer to the application layer, comprehensively position the user fr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a design and an implementation method for a user behavior analysis system based on Hadoop, the high speed catch package tool PF-RNG is used for catching the data of network inlet as the user behavior analysis data source and storing the data source in a distribution mode, adjusting the network security software development kit tool Libnids for recombining the data packet for realizing recombination for TCP/IP, reducing the application layer HTTP, using Hadoop cluster, using the distributed Mapreduce programme for analyzing the network behavior activity of the user application layer, analyzing from the physical layer to the application layer, positioning the user comprehensively for four-dimension, as search terms for user, shopping trend, website leave message and common website behavior for knowing the user behavior and demand in time, and strategy controlling the user behavior and optimizing the network service for realizing the network intelligence.

Description

technical field [0001] The invention relates to the field of user behavior analysis, in particular to a method for designing and implementing a user behavior analysis system based on Hadoop. Background technique [0002] We live in the data age. With the wide application of the network, the prosperity of social networks and the rapid growth of the number of users, the data is also growing in an explosive way. We have entered the era of big data. The US Internet Data Center pointed out that the data on the Internet will increase by 50% every year and double every two years. At present, more than 90% of the data in the world has only been generated in recent years. Moreover, data does not just refer to the content information that people publish on the Internet. There are countless digital sensors on electric meters, automobiles, and industrial equipment all over the world, which measure and transmit changes in position, humidity, temperature, movement, and vibration at any ti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08H04L12/26
CPCH04L43/045H04L67/1097
Inventor 黄敏刘晶杨晋博
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products