Method and device for sample distributed clustering calculation

Abstract

The invention provides a method and a device for sample distributed clustering calculation. The method comprises that characteristic values of all the samples to be clustered are acquired to constitute a characteristic value set; a calculation speed of each kind of usable calculation equipment is estimated; and before a similarity degree between any two characteristic values in the characteristic value set is less than a preset threshold value, the following steps are repeated, wherein all the characteristic values in the characteristic value set are distributed to at least one kind of calculation equipment according to the calculation speed of each usable calculation equipment, so that the at least one kind of calculation equipment can screen the distributed characteristic values on the premise that processing time satisfies a preset condition, and the similarity degree between any two characteristic values is less than the preset threshold value. The method and the device for the sample distributed clustering calculation provided by the invention can solve the problem that existing clustering algorithms can hardly deal with a large scale of data, can realize the distributed clustering calculation of the large scale of data which can hardly be handled by the prior art, and can effectively increase efficiency of the clustering calculation.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a sample distributed clustering calculation method and device. Background technique [0002] Clustering is a process of dividing a collection of physical or abstract objects into multiple classes composed of similar objects. It is widely used in the processing of various types of information, such as the integration and analysis of news texts, the organization of data files and the index creation, etc. In the prior art, common algorithms can be divided into Partitioning Methods, Hierarchical Methods, Density-Based Methods, Grid-Based Methods, and Model-Based methods. -BasedMethods). [0003] For example, in the partition method, given a data set with N tuples or records, the split method will construct K groups, and each group represents a cluster, K<N. And these K groups meet the following conditions: [0004] (1) Each group contains at least one data record; [000...

AI Technical Summary

Problems solved by technology

[0008] Aiming at the defects in the prior art, the present invention provides a sample distributed clustering calculation method and device, which can solve the problem that existing clustering algorithms are difficult to process large-scale data

Images