Bayesian Network Parameter Learning with Uncertain Evidence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Bayesian network parameter learning algorithms fail to effectively incorporate uncertain evidence, often ignoring or disregarding it, which reduces accuracy and limits the utilization of unstructured data with inherent uncertainty.

Innovation Solution

A method for learning Bayesian network parameters using uncertain evidence, involving the receipt of graph representations and samples with known, unknown, or uncertain values, where an uncertain inference process calculates conditional probability tables and updates them using likelihood ratios and expert estimates, enabling continuous learning and incorporation of uncertain data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If current Bayesian network parameter learning algorithms are used, then the learning process is simple, but uncertain evidence is ignored or disregarded reducing accuracy

Engineering Contradiction:
Improveparameter learning accuracyVSAvoidlearning process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The learning process is segmented into two distinct phases: the Expectation step that handles uncertain evidence through probability propagation, and the Maximization step that updates parameters. This segmentation allows each phase to specialize in handling specific types of evidence without complicating the overall process.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Probability distributions serve as intermediaries between uncertain evidence and parameter updates. The EM algorithm introduces intermediate expected values that bridge the gap between uncertain observations and definitive parameter estimates, enabling accurate learning without direct complex handling of uncertainty.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If uncertain evidence is incorporated into parameter learning, then model accuracy improves, but computational cost increases

Engineering Contradiction:
Improvemodel accuracyVSAvoidcomputational cost
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The EM algorithm provides continuous iteration between expectation and maximization steps, progressively refining parameter estimates. Each iteration builds on previous results, maintaining computational efficiency by reusing previously calculated probability distributions rather than recomputing from scratch.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The algorithm uses the uncertain evidence itself to generate the probability distributions needed for parameter updates. The uncertain data serves dual purposes: as input evidence and as the basis for computing expected values, eliminating the need for separate expensive processing of uncertain evidence.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If uncertain evidence is utilized, then more unstructured data can be used, but the learning algorithm becomes more complex

Engineering Contradiction:
Improvedata utilization capabilityVSAvoidalgorithm complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The EM algorithm framework provides a universal approach that handles multiple types of evidence (certain, uncertain, missing) through the same expectation-maximization mechanism. This multi-functionality allows the algorithm to process diverse unstructured data formats without requiring separate specialized procedures.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The algorithm transforms uncertain evidence into probabilistic parameters that fit the Bayesian network framework. By changing the representation of uncertain evidence from raw unstructured data into probability distributions and expected values, the algorithm maintains simplicity while achieving high adaptability to different data types.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12093848B2Learning parameters of Bayesian network using uncertain evidence
Publication Date: 2024.09.17 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12093848B2 patent drawing
  • US12093848B2 patent drawing
  • US12093848B2 patent drawing

AI summary

A method, system, and computer program product for learning parameters of Bayesian network using uncertain evidence, the method comprising: receiving input comprising graph representation and at least one sample of a Bayesian network, the graph comprising plurality of nodes representing random variables and plurality of directed edges representing conditional dependencies, wherein each of the at least one sample comprising for each node a value selected from the group consisting of: a known value; an unknown value; and an uncertain value; and applying on the input a Bayesian network learning process configured for calculating estimates of conditional probability tables of the Bayesian network using probabilities inferred by applying on the input a Bayesian network uncertain inference process configured for performing inference in a Bayesian network from uncertain evidence.