Factor Graph Message Updates for Low-Complexity Non-Binary Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing algorithms for updating factor graphs in a posteriori probability estimators face inefficiencies due to high complexity and memory requirements, especially when dealing with non-binary codes and high-cardinality alphabets, limiting their applicability in telecommunications and other fields.

Innovation Solution

The method employs Gaussian-like messages and discrete variables parameterized by mean and concentration, using wrapping and sampling operations to reduce complexity and memory needs, introducing classes like wrapped Gaussian and sampled Gaussian messages, which allow for efficient iterative decoding of non-binary codes with high cardinality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If standard BP algorithm is used for updating factor graphs, then exact a posteriori probabilities can be obtained, but computational complexity and memory requirements increase proportionally with the product of cardinalities of symbol alphabets

Engineering Contradiction:
Improveaccuracy of a posteriori probability estimationVSAvoidcomputational complexity and memory requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transforms the message representation from full probability distributions (requiring storage proportional to alphabet cardinality) to parametric forms (Gaussian messages with mean and variance, or exponential forms with amplitude and phase). This parameterization reduces the state space from O(M) to O(1) where M is the alphabet cardinality, while maintaining estimation accuracy through careful selection of parametric families that preserve essential statistical properties

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces simplified message copies (parametric representations) that approximate the full probability distributions. These parametric messages serve as efficient proxies that capture the essential information needed for belief propagation without requiring storage and computation over the entire alphabet space, thereby reducing complexity while preserving accuracy

Inventive Principle:
Principle #26Copying

2Productivity

If non-binary codes with high-cardinality alphabets are used to increase spectral efficiency, then transmission capacity improves, but the complexity of decoding algorithms increases exponentially

Engineering Contradiction:
Improvespectral efficiency and transmission capacityVSAvoiddecoding algorithm complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies parameterization of messages specifically tailored for high-cardinality alphabets, where messages are represented by a fixed number of parameters (e.g., mean and variance for Gaussian messages) regardless of the alphabet size M. This allows the decoding complexity to remain independent of M, enabling the use of high-cardinality non-binary codes to achieve high spectral efficiency without exponential complexity growth

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent segments the complex decoding task into local message passing operations at each factor graph node, where each node performs simple parametric updates based on incoming messages. This segmentation allows the overall decoding complexity to scale linearly with the number of nodes rather than exponentially with alphabet cardinality, making high-cardinality code decoding feasible

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP2715621B1Method for updating a factor graph of an a posteriori probability estimator
Publication Date: 2022.10.05 POLITECNICO DI TORINO
  • EP2715621B1 patent drawingFigure 1
  • EP2715621B1 patent drawingFigure 2
  • EP2715621B1 patent drawingFigure 3

AI summary

A method is described for updating a factor graph (10;10';10") of an a posteriori probability estimator, said factor graph comprising at least one repetition node (13;13';13") and at least one sum node (11;11';11"), wherein at least two connections are associated with each node, and wherein each connection is associated with an incoming message at said node and with an outgoing message from said node, wherein said method comprises the steps of: storing the nodes' incoming and outgoing messages into memory means (12;12';12") of said estimator as messages belonging to one same class of wrapped and/ or sampled Gaussian messages; updating said node of said factor graph (10;10';10") by using a resulting message belonging to said class of incoming messages, said resulting message being obtained by processing said incoming wrapped and/ or sampled Gaussian messages.