A big data clustering method and system based on cloud computing platform

Abstract

The invention discloses a big data clustering method and system based on a cloud computing platform. Types of data objects; the characteristics of the data objects are refined to create a classification layer dendrogram, and the clustering depth of the data object matches the classification of the classification layer dendrogram from bottom to top; determined according to the direct characteristics of the data object The branch path of the data object in the classification layer dendrogram, and use the transformation model to determine the clustering and sub-items of the data object, so as to classify and cluster the big data; the present invention starts from the direct feature corresponding to the collected data object, and uses Traverse the correlation weights between the direct features of all data objects, select the direct features with large correlation weights and merge them into the same clustering item, and repeat the operation until at least one classification layer dendrogram is generated.

Description

technical field [0001] The invention relates to the technical field of big data clustering, in particular to a big data clustering method and system based on a cloud computing platform. Background technique [0002] Cloud computing is a kind of distributed computing. The specific function is to decompose the huge data calculation processing program into countless small programs through the network "cloud", and then process and analyze these small programs through a system composed of multiple servers to obtain result and return it to the user. In the early days of cloud computing, simply put, it was simple distributed computing, solving task distribution, and merging calculation results. Therefore, cloud computing is also called grid computing. Through this technology, the processing of tens of thousands of data can be completed in a very short period of time, so as to achieve powerful network services. [0003] With the rapid development of information technology, the sc...

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a cloud computing platform-based big data clustering method and system to solve the problem of similarity confusion between different data clusters caused by failure to analyze the relationship between different data objects in the prior art, and The difference is also insufficient, and the technical problem that it cannot play a real big data clustering function

Images