Mobile terminal data flow processing method and system based on spark technology
A mobile terminal and processing method technology, applied in the direction of electrical digital data processing, instrumentation, error detection/correction, etc., can solve the problems of insufficient detail, flexibility, positioning, etc., and achieve the effect of improving user experience
Active Publication Date: 2020-12-25
NANJING PANDA ELECTRONICS +1
View PDF8 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
With this processing method, after the data service center runs for a certain period of time, the database of the data service center will form a large number of mobile terminal operation logs. When a problem occurs on the terminal, the user cannot locate the problem in time through the log
In addition, the message format of the data flow reported by the mobile terminal is fixed, and the content is not detailed enough. When a problem occurs on the terminal, the user cannot accurately locate the problem through the log, which is not flexible enough.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0048] The present invention will be further explained below in combination with specific embodiments and accompanying drawings.
[0049] like figure 2As shown, several users form a user cluster and operate the terminal equipment at the same time. During this process, the mobile terminal application software will record various types of data packets (referred to as packets) generated when the terminal is running, and send them to Background data center (that is, data service center). The back-end data service center will use the SPARK big data cluster for data calculation and analysis of the received data, display the valuable data output by SPARK on the front-end interface, back-end database storage, and other value-added applications based on such data. Among them, value-added applications, for example, use such valuable data as data sources, classify them according to data sensitivity, provide data information query services for different external programs according to ac...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a mobile terminal data steam processing method and system based on a SPARK technology. According to the method, mobile terminal special application software records position information generated during operation of a terminal, an operation track of a user, operating states of all modules in the terminal and other mobile terminal operation log data, the data is transmitted to a background data service center through a wireless network, the data service center uses a big data SPARK cluster for calculation and analysis after receiving the data, and valuable data obtained after processing is subjected to front-end real-time display, background database storage or other value added application based on the data. By use of the method, at the mobile terminal cluster side,all kinds of comprehensive data with a self-defined data stream message format can be sent; and at the data service center side, the SPARK calculation cluster composed of multiple cheap PCs can be adopted to realize analysis and processing of the data, therefore, timeliness is achieved, and data support can be provided for decision making on the upper layer.
Description
technical field [0001] The invention belongs to the technical field of mobile terminal data stream processing, and in particular relates to a mobile terminal data stream processing method and system based on SPARK technology. Background technique [0002] With the rapid development of big data technology and mobile communication technology, data interaction processing between mobile application terminals and background data centers has become an important part of the implementation process of mobile communication projects. [0003] During the interaction process, the mobile terminal will send various structured or semi-structured data generated by its application software to the data center, and the data center will analyze and process the data. However, with the passage of time, the data received by the data center continues to increase to a massive level, and analyzing such data requires higher data processing capabilities. At present, in this type of data processing meth...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/32G06F11/34
CPCG06F11/328G06F11/3452
Inventor 冯建彪
Owner NANJING PANDA ELECTRONICS