A parallel inference method for large-scale Bayesian networks based on mapreduce

Abstract

The invention relates to a large-scale Bayesian network parallel inference method based on the MapReduce. The large-scale Bayesian network parallel inference method based on the MapReduce aims at overcoming the defects of low inference efficiency, the large calculated amount and the like brought by a large number of nodes in the Bayesian network or multiple conditional probability parameters of all the nodes; breaking the efficiency bottleneck is taken as the main objective, the large-scale Bayesian network is stored by utilizing a distributed database HBase, the relation between HBase query processing and a Bayesian inference task is established, and parallel inference of the Bayesian network is achieved based on the MapReduce. The method better conforms to features of practical problems in the field of data analysis, medical diagnosis, industrial control, economic forecast and the like, has the better goodness of fit, can remove the limitation on the number of the nodes of the Bayesian network, and provides a supporting technology for expression, inference, application and the like of uncertain knowledge.

Description

technical field [0001] The invention discloses a large-scale Bayesian network parallel reasoning method based on MapReduce, which involves storing large-scale Bayesian networks in a distributed database HBase based on MapReduce, and converting probabilistic reasoning of Bayesian networks into data on HBase Query processing, and a method for implementing Bayesian network probabilistic inference based on MapReduce. It belongs to the field of artificial intelligence and information processing. Background technique [0002] With the increasing diversity of data collection methods and data formats, and the rapid growth of data scale, the expression, understanding and application of knowledge contained in data have attracted more and more attention. Bayesian Network (Bayesian Network) uses a graphical model to express uncertainty knowledge that includes both probability distribution and causality, and expresses the interdependence between random variables in a qualitative and qua...

AI Technical Summary

Problems solved by technology

Aiming at the shortcomings of low reasoning efficiency and large amount of calculation caused by the large number of nodes or the large number of conditional probability parameters of each node in a large-scale Bayesian network, with the main goal of overcoming the efficiency bottleneck, the distributed database HBase is used to store large-scale Bayesian networks. Yesnet, establish the relationship between HBase query processing and Bayesian network reasoning tasks, and realize the parallel reasoning of Bayesian network based on MapReduce

Images