Factor Graph Gaussian Message Passing for Non-Binary Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing algorithms for updating factor graphs, such as Belief Propagation, face inefficiencies with high-cardinality alphabets, leading to increased complexity and memory requirements, particularly in non-binary codes, which limits their application in telecommunications and other fields.

Innovation Solution

The method employs Gaussian-like messages at sum and repetition nodes, parameterized by mean and concentration, allowing for updates independent of alphabet cardinality, introducing D-messages for discrete and limited variables, and using wrapping or sampling operations to manage message complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If Belief Propagation algorithms are used for updating factor graphs with high-cardinality alphabets, then the estimator can handle non-binary codes, but the computational complexity and memory requirements increase significantly

Engineering Contradiction:
Improvecapability to handle non-binary codes with high cardinalityVSAvoidcomputational complexity and memory requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transforms the message representation from full probability distributions (requiring memory proportional to alphabet cardinality) to parameterized Gaussian distributions (requiring only constant memory for mean and variance parameters). This parameterization approach maintains the ability to handle high-cardinality alphabets while reducing computational complexity from O(M) to O(1) where M is the alphabet size.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the exact Belief Propagation update rules (which involve complex convolution operations for high-cardinality alphabets) with approximate update rules based on Gaussian message passing. This substitution maintains the core functionality of the BP algorithm while significantly simplifying the computational mechanics, especially for sum nodes and repetition nodes in the factor graph.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If exact Belief Propagation is used to update all messages in the factor graph, then accurate a posteriori probabilities are obtained, but the number of convolution and multiplication operations increases linearly with the number of variables

Engineering Contradiction:
Improveaccuracy of a posteriori probabilitiesVSAvoidnumber of update operations required
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies approximate Gaussian update rules at sum nodes and repetition nodes instead of exact convolution and multiplication operations. This partial approximation approach maintains sufficient accuracy for practical applications while dramatically reducing the number of operations required, especially in iterative decoding scenarios where the same nodes are updated multiple times.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

By changing from exact probability distribution updates to parameterized Gaussian updates, the patent reduces the computational burden from O(M) operations per node update to O(1) operations, where M is the alphabet cardinality. This parameter-based approach maintains the essential information needed for accurate probability estimation while improving computational efficiency.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10289956B2Method for updating a factor graph of an a posteriori probability estimator
Publication Date: 2019.05.14 POLITECNICO DI TORINO
  • US10289956B2 patent drawing
  • US10289956B2 patent drawing
  • US10289956B2 patent drawing

AI summary

A method for updating a factor graph (10;10′;10″) of an a posteriori probability estimator, the factor graph including at least one repetition node (13;13′;13″) and at least one sum node (11;11′;11″), wherein at least two connections are associated with each node, and wherein each connection is associated with an incoming message at the node and with an outgoing message from the node, wherein the method includes the steps of: storing the nodes' incoming and outgoing messages into memory (12;12′;12″) of the estimator as messages belonging to one same class of wrapped and/or sampled Gaussian messages; updating the node of the factor graph (10;10′;10″) by using a resulting message belonging to the class of incoming messages, the resulting message being obtained by processing the incoming wrapped and/or sampled Gaussian messages.