Method for implementing mobile internet real-time stream data acquisition and analysis

Abstract

The invention discloses a method for implementing mobile internet real-time stream data acquisition and analysis, which comprises real-time acquisition, real-time parsing, data real-time access and real-time analysis. The real-time acquisition is that O domain data is acquired in real time from a light-splitting output point of network element equipment by a converging shunting equipment and afterthe O domain data is processed, the O domain data is sent to probe equipment; and the real-time parsing is that by the probe equipment, each port optical signal received from the converging equipmentis decrypted, a user number is refilled and data which can be read is obtained, and the data is transmitted in real time to an analysis link in a protocol data stream mode. The method has the beneficial effects that real-time acquisition on massive O domain data can be implemented with low investment, complex analysis is completed, real-time application is supported, and real-time perception on amobile user internet behavior is promoted, so that the foundation is laid for real-time scene marketing and service.

Description

technical field [0001] The invention relates to the field of mobile Internet data analysis equipment, and the invention relates to a method for realizing real-time streaming data collection and analysis of the mobile Internet. Background technique [0002] Since the rapid and comprehensive application of TD-SCDMA, WCDMA, TD-LTE, and FDD-LTE mobile communication technologies, the usage habits of mobile phone users have rapidly changed from simply making calls, sending text messages, and multimedia messages to including reading news, reading novels, and chatting. , Sharing Moments, listening to music, following hot dramas, playing games, shopping and other colorful and complex content covering all aspects of life, the population of mobile Internet users has rapidly expanded. How to serve such a large group of people well and obtain corresponding returns at the same time is the top priority of communication operators. [0003] To do a good job of serving users, we must think a...

AI Technical Summary

Problems solved by technology

[0004] In the field of data analysis, the data of users' online behavior data and the data of users' walking and switching in the communication network are collectively referred to as O-domain data. Means: the network operation and optimization department, in order to track network quality, deploys collection probes on each network element equipment warehouse to monitor the load of equipment and the quality of user calls and Internet access, and the application area is relatively narrow; the data analysis department, every day or Obtain more or less O-domain data analyzed from network operations and network optimization every hour, and perform offline data analysis in Oracle, GP or Hive, which is not timely

The amount of data in the O domain is very large. Taking Chongqing Unicom as an example, it is 100G per second. The traditional data processing method is to parse the data into files and then perform fuzzy matching in the database for identification, which is inefficient.

Images