A data mining method and system based on apriori algorithm

Abstract

The invention provides a data mining method and system based on an Apriori algorithm. A Boolean matrix is used for realizing the binary coding of an affair, and a counting weight is introduced, and one affair vector can express a plurality of same affair records so as to perform a function of a compressed matrix. When the algorithm operates, one-time scanning is required, the matrix is used for subsequent iterations, and the Boolean matrix is used for successively generating a kth frequent itemset. Compared with the Apriori algorithm in the prior art, the method and the system omit the steps of similar matrix calculation and cutting, a data set is divided into a plurality of data blocks through algorithm thought that the efficiency parallelization of the frequent itemset is improved by the cutting of the line and row vectors of the matrix, then, each data block is scanned to carry out relevant association rule mining, finally, a result mining result is obtained by summarization is obtained, and operation efficiency is greatly improved.

Description

technical field [0001] The technical field of data mining of the present invention particularly relates to a data mining method and system based on the Apriori algorithm. Background technique [0002] Association rule data mining is to find rules of interest and related relationships from huge data sets. These itemsets are often stored in transactional databases. Association rules are one of the core technologies of data mining, and have been extensively studied in both business and academic fields, especially for today in the era of big data. The research and development of association rule technology has always been a hot topic in the industry. [0003] In the prior art, most association rule algorithms can be divided into the following two categories: [0004] (1) Breadth-first algorithm: it searches the data set from bottom to top, first finds the candidate set, and then finds the frequent set from it [0005] (2) Depth-first algorithm: Compared with the breadth-firs...

AI Technical Summary

Problems solved by technology

[0009] In view of the deficiencies in the above-mentioned prior art, the purpose of the present invention is to provide users with a data mining method and system based on the Apriori algorithm, which is used to overcome the data mining algorithm of the prior art to repeatedly scan the transaction database, not only the operation efficiency is low , and the defect of increasing the burden on the computing server

Images