Massive user behavior data acquisition method and system based on message queue

A message queuing and data collection technology, applied in the Internet field, can solve the problems of low processing efficiency and real-time feedback of data, and achieve the effects of large data throughput, efficient data transmission, and improved real-time performance and data collection efficiency.

Inactive Publication Date: 2015-04-29
GUANGDONG NENGLONG EDUCATION
View PDF6 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This kind of processing process results in some data that needs real-time feedback not getting real-time feedback, and the processing efficiency is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Massive user behavior data acquisition method and system based on message queue

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] refer to figure 1 As shown, the mass user behavior data collection method and system based on the message queue provided by the best implementation case of the present invention includes the following steps:

[0028] S1. Implant Javascript scripts in the page, and collect the required information through the objects built in the browser, such as the title of the page, referer, browser language, cookies information, page loading time, logged out pages and event tracking information Wait, encode and stitch the collected information in a predefined format, create an Image object through js, point the src attribute of the Image object to the user behavior data server and carry the spliced ​​parameters, such as:

[0029] image.src=http: / / nenglong.com / 1.gif?domain=localhost&url=http%3A%2F%2Flocalhost%3A8080%2F&title=%E5%90%8C%E6%AD%A5%E8%AF%BE %E5%A0%82%E2%80%94%E2%80%94%E5%90%8C%E6%AD%A5%E8%B5%84%E6%BA%90&referrer=&sh=900&sw=1600&cd=24&lang =zh-CN&account=oos.

[0030] Th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a massive user behavior data acquisition system based on a message queue. The system comprises a log intercept module, a message queue system and a user behavior processor module, wherein the log intercept module is used for filtering and preprocessing of user behavior data; the message queue system is used for transferring and distributing user behavior data packages, and the user behavior processor module is used for real-time processing of the user behavior data, result feedback and batch storage of original data. According to the massive user behavior data acquisition method and system based on the message queue, the message queue is introduced into massive user behavior data acquisition and fully utilized; the characteristics of efficient data transmission, large data throughput, good transverse expansibility and the like are used for massive user behavior data acquisition, so that data acquisition timeliness and data acquisition efficiency are improved, and especially a solution which is stable, efficient and good in timeliness is provided for massive user behavior acquisition of the Internet.

Description

technical field [0001] The invention relates to the field of the Internet, in particular to a method and system for collecting mass user behavior data based on message queues. Background technique [0002] As the data processing capabilities of computers continue to rise and big data becomes the theme of the times, the collection and analysis of user behavior data is becoming more and more important, and the amount of collected data is also increasing. Such as: user name, user ip, request time, request address, response time, page usage track, jump page, browser information, system version, etc. Therefore, the server-side collection system is facing more and more challenges. [0003] In the existing technology, there has been a technology to collect massive user behavior data. The processing method of the technology is generally to asynchronously process the server-side logs and save them in the database or other storage systems, and then use a parallel processing system to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24H04L29/08
Inventor 余敬龙
Owner GUANGDONG NENGLONG EDUCATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap