Cloud computing platform based massive data processing method

A mass data processing and cloud computing platform technology, applied in the Internet field, can solve problems such as cumbersome calculation process, large manpower and time cost, difficulties, etc., and achieve the effect of improving processing efficiency and saving manpower

Inactive Publication Date: 2016-09-07
成都数联铭品科技有限公司
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It will become more difficult to analyze these implicit correlations in the face of massive amounts of data. If these tasks are implemented one by one by individuals, it will consume huge manpower and time costs; a processing method is urgently needed to help analysts realize this huge The tedious calculation process that provides the results of this analysis

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cloud computing platform based massive data processing method
  • Cloud computing platform based massive data processing method
  • Cloud computing platform based massive data processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0072] The following three pieces of data are used as a small example to illustrate the analysis process of the association relationship. Assuming that the original data is extracted by fields (the set fields include: the first field, the second field, the third field and the fourth field), the extracted data contains such as image 3 In the three data records shown, the information contents corresponding to the first field, second field, third field and fourth field included in the first data record are: A, B, D and E; the second data The information contents corresponding to the first field, second field, third field and fourth field contained in the record are: C, B, F and G; the first field, second field, The information contents corresponding to the third field and the fourth field are: H, F, I in sequence. Assuming that the content corresponding to the first field is used as the starting point of the association analysis, the first data record can form: A-B, A-D, A-E on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to the technical field of Internet information processing, and particularly to a cloud computing platform based massive data processing method. The method comprises by setting filter conditions such as a field and the like, extracting key information elements in each file in original data, and forming a corresponding data record; storing each data record to a database; and based on this, according to the same information elements contained in different data records, using a big data processing framework under a cloud computing platform to abstract an association relation between information elements. The method disclosed by the present invention can analyze associated information and a corresponding association path hidden behind massive target information in the massive Internet information according to requirements and then provide an analysis result to a user through a query port, greatly saves time and manpower costs of related information compilation and analysis for the user, and provides effective technical support for target background analysis, marketing, market segmentation, risk prediction, risk prevention and control, and the like.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a massive data processing method based on a cloud computing platform. Background technique [0002] With the development of society and the advancement of science and technology, the connection between individuals or groups has become closer, and the close connection has promoted the rapid dissemination and growth of information. Today's world has already entered the information age. Growth and accumulation, the era of big data is approaching, the basic characteristics of big data can be described by four "V", that is, large data volume (Volume), various types (Variety), low value density (Value), fast speed and timeliness High (Velocity); as the most important feature: the large amount of data and low value density are the problems that plague the mining and utilization of such massive data information. In the massive data, how to accurately obtain the information that peop...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2455G06F16/27
Inventor 范东来何宏靖
Owner 成都数联铭品科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap