Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mobile terminal big data processing method, device and storage medium

A technology for big data processing and mobile terminals, which is applied in the fields of electrical digital data processing, special data processing applications, digital data information retrieval, etc. It can solve problems such as limitations and achieve the effect of good ductility.

Active Publication Date: 2021-11-12
GUANGDONG SOUTHERN COAST TECHNOLOGY SERVICE CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the traditional analysis of IP flow data is limited to the perspective of traffic aggregation. With the increase of data on mobile terminals (such as mobile phones, etc.) in wireless networks, a more detailed big data system is needed to monitor wireless networks in order to collect a large amount of data traffic from mobile terminals. , store, process, analyze and manage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mobile terminal big data processing method, device and storage medium
  • Mobile terminal big data processing method, device and storage medium
  • Mobile terminal big data processing method, device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060]Such as figure 1 As shown, this embodiment provides a mobile terminal big data architecture, which includes a transport layer, a storage layer, a processing layer, and a display layer, and the transport layer, storage layer, processing layer, and display layer are connected in sequence, and the mobile terminal can be a mobile phone , Tablet PC, etc., the details are as follows:

[0061] 1) Transport layer: Flume is used as the collector, and Kafka is used as the transmitter, where Flume is a distributed massive log collection, aggregation and transmission system, and Kafka is an open source stream processing platform, which is a high-throughput distributed A publish-subscribe message system, which can process all action stream data in consumer-scale websites. The transport layer collects mobile terminal data through Flume and uploads it through the Kafka stream processing platform.

[0062] 2) Storage layer: Receive mobile terminal data uploaded by Kafka. These data can...

Embodiment 2

[0102] Such as Figure 4 As shown, this embodiment provides a mobile terminal big data processing device, the device includes a receiving unit 401, a selection unit 402, an acquisition unit 403 and a processing unit 404, and the specific functions of each unit are as follows:

[0103] The receiving unit 401 is configured to receive mobile terminal data uploaded by the stream processing platform.

[0104]The selection unit 402 is configured to select a storage system to store mobile terminal data according to application requirements.

[0105] The obtaining unit 403 is configured to obtain mobile terminal data.

[0106] The processing unit 404 is configured to use a computing engine and a processing framework to process the data of the mobile terminal; wherein, the computing engine is used to perform stream processing on the data, and the processing framework is used to perform batch processing on the data.

[0107] Further, in the selection unit 402, according to application...

Embodiment 3

[0117] This embodiment provides a storage medium, the storage medium is a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the method for processing big data of the mobile terminal in the above-mentioned embodiment 1 is implemented, as follows :

[0118] Receive mobile terminal data uploaded by the stream processing platform;

[0119] According to application requirements, select a storage system to store mobile terminal data;

[0120] Obtain mobile terminal data;

[0121] The computing engine and the processing framework are used to process the data of the mobile terminal; wherein, the computing engine is used for stream processing the data, and the processing framework is used for batch processing the data.

[0122] Further, the processing of the mobile terminal data by using the computing engine and the processing framework specifically includes:

[0123] Analyze traffic data based on the number ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a mobile terminal big data processing method, device, big data architecture and storage medium, the architecture includes a transmission layer, a storage layer, a processing layer and a presentation layer, and the transmission layer, storage layer, processing layer and presentation layer The layers are connected in sequence; the transport layer is used to collect mobile terminal data and upload it through the stream processing platform; the storage layer is used to receive the mobile terminal data uploaded by the stream processing platform; according to application requirements, a storage system is selected to store mobile terminal data Data; the processing layer is used to obtain mobile terminal data; the mobile terminal data is processed by using a computing engine and a processing framework, the computing engine is used for stream processing the data, and the processing framework is used for batch processing the data ; The display layer is used to display the processed mobile terminal data. The invention can collect, store, process, display and manage mobile terminal data, and can provide users and operators with a safe, stable and effective environment.

Description

technical field [0001] The invention relates to a mobile terminal big data processing method, device, big data architecture and storage medium, and belongs to the field of big data processing and management. Background technique [0002] Big data (big data) is a very popular term in recent years, also known as massive data, which refers to massive, high growth rate and diversified data that require new processing models to have stronger decision-making power, insight and process optimization capabilities. The information assets are mainly used for data integration to facilitate timely analysis of data information. [0003] At present, the traditional analysis of IP flow data is limited to the perspective of traffic aggregation. With the increase of data on mobile terminals (such as mobile phones, etc.) in wireless networks, a more detailed big data system is needed to monitor wireless networks in order to collect a large amount of data traffic from mobile terminals. , stora...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04M1/72403H04L29/06H04L29/08G06F16/2458G06F16/182
CPCH04L67/1097H04L67/10H04L63/08G06F16/182G06F16/2471H04M1/72403
Inventor 张志斌胡梦琪马利滨江友辉陈辉中
Owner GUANGDONG SOUTHERN COAST TECHNOLOGY SERVICE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products