Causal Influence Model for Bayesian Network Parameter Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The construction of a priori probability distributions for Bayesian belief networks (BBNs) becomes unwieldy due to the exponential explosion of conditional probability table (CPT) values, especially when dealing with multiple parents and states, making it challenging for users to specify and handle these parameters effectively.

Innovation Solution

The introduction of a Causal Influence Model (CIM) that reduces the number of parameters needed for the CPT by using a causal influence matrix, where each parent's influence is represented by a linear function, and further simplification by classifying nodes as Boolean, Ordinal, or Categorical, and assuming promoting or inhibiting influences, allowing for conversion into a CPT using a CPT creation function.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional CPT specification methods are used, then complete probabilistic relationships can be represented, but the number of parameters explodes exponentially with the number of parents and states

Engineering Contradiction:
Improvecompleteness of probabilistic representationVSAvoidnumber of CPT parameters
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent transforms the traditional CPT parameterization approach by introducing a functional representation where conditional probabilities are defined as functions of parent states rather than explicit tables. This changes the parameter space from exponential (number of parent state combinations) to polynomial (number of functions × number of parameters per function), resolving the exponential explosion while maintaining complete probabilistic representation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces conditional probability functions as intermediaries between parent node states and child node probabilities. Instead of directly specifying probabilities for each parent state combination, the system uses functional intermediaries that compute probabilities based on parent configurations, thereby reducing the number of explicit parameters needed.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If detailed CPT values are specified for accurate inference, then probabilistic reasoning accuracy is improved, but user burden and specification time increase significantly

Engineering Contradiction:
Improveprobabilistic inference accuracyVSAvoidCPT specification time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

By changing from explicit probability tables to functional representations, the patent reduces the number of parameters users must specify from exponential to polynomial scale. This allows users to define probabilistic relationships more efficiently while the system handles the computational complexity of maintaining inference accuracy through the functional framework.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If canonical models with many parameters are used, then accurate causal relationships can be captured, but the model becomes difficult to use and specify

Engineering Contradiction:
Improveaccuracy of causal representationVSAvoidease of CPT specification
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent transforms the parameter specification task by introducing functional forms with fewer parameters. Instead of requiring users to specify probabilities for every possible parent state combination, the system uses conditional probability functions that take fewer parameters, making the model both accurate and easier to specify.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The functional representation framework provides a universal approach that works for any number of parents and states. The same functional paradigm handles simple and complex cases uniformly, making the system easier to use across different application scenarios while maintaining accurate causal representation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8849729B2Methods and systems for constructing Bayesian belief networks
Publication Date: 2014.09.30 CHARLES RIVER ANALYTICS INC
  • US8849729B2 patent drawing
  • US8849729B2 patent drawing
  • US8849729B2 patent drawing

AI summary

Methods and systems are described for simplifying a causal influence model that describes influence of parent nodes Xi (i=1, . . . , n) on possible states of the child node Y. The child node Y and each one of the parent nodes Xi (i=1, . . . , n) are assumed to be either a discrete Boolean node having states true and false, a discrete Ordinal node having a plurality of ordered states; and a Categorical node having a plurality of unordered states. The influence of each parent node Xi on the child node Y is assumed to be a promoting influence and an inhibiting influence. User interfaces are described that incorporate these specific node types.