Bayesian Filtering Density Morphing for High-Dimensional State Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional particle filtering techniques become inefficient and impractical in high-dimensional state spaces due to issues like sample degeneracy and sample impoverishment, particularly in nonlinear stochastic systems.

Innovation Solution

The method employs density morphing and mode propagation using unscented transformation and variable-bandwidth kernel mixtures to track the evolution of state distributions, maintaining analytic representations and reducing the number of kernels through mode finding and mixture reduction, enabling efficient sampling and interpolation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If particle filtering is used to track state evolution in high-dimensional spaces, then the filtering capability for nonlinear stochastic systems is improved, but the computational efficiency deteriorates due to the need to track an prohibitively large number of samples

Engineering Contradiction:
Improvefiltering capabilityVSAvoidcomputational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the high-dimensional state space tracking problem into lower-dimensional subspaces by identifying and tracking only the significant modes (dominant patterns) of the probability density function. Instead of tracking all samples in the full high-dimensional space, the method decomposes the density into a sum of weighted Gaussian kernels centered at identified modes, effectively segmenting the complex high-dimensional problem into manageable lower-dimensional components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts the essential information from the high-dimensional particle filter by identifying the dominant modes (principal patterns) of the state distribution. Rather than using all particles, the method extracts only the significant modes that capture the majority of the probability mass, discarding redundant samples and maintaining only the essential structural information needed for accurate filtering.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If the number of samples is increased to avoid sample degeneracy in particle filtering, then the estimation accuracy is improved, but the computational complexity and memory requirements increase prohibitively

Engineering Contradiction:
Improveestimation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies dynamics by allowing the number and positions of modes to evolve adaptively over time based on the observed data. The mode identification process dynamically adjusts the representation of the density function, adding or removing modes as needed to capture the current state distribution accurately, rather than using a fixed large number of samples.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameterization of the density representation from a fixed large set of particles to a flexible set of Gaussian kernels with variable parameters (mean, covariance, weight). This parameter change allows the method to achieve high estimation accuracy with fewer effective parameters, as the continuous Gaussian kernels can represent complex distributions more efficiently than discrete particle samples.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If conventional particle filtering is applied to high-dimensional state spaces, then the theoretical framework remains valid, but practical implementation becomes infeasible due to sample impoverishment and degeneracy

Engineering Contradiction:
Improvetheoretical validityVSAvoidpractical implementability
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent substitutes the mechanical particle sampling approach with a continuous density representation using Gaussian kernels. Instead of relying on discrete particle mechanics that suffer from degeneracy and impoverishment in high dimensions, the method uses a continuous probabilistic model that can be efficiently manipulated through analytical operations, replacing the particle-based mechanical system with a more suitable continuous field representation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS7526414B2Density morphing and mode propagation for Bayesian filtering
Publication Date: 2009.04.28 SIEMENS HEALTHINEERS AG
  • US7526414B2 patent drawing
  • US7526414B2 patent drawing
  • US7526414B2 patent drawing

AI summary

A system and method for modeling a dynamic system using Bayesian filtering, includes a prediction module to predict a state model of the dynamic system, the prediction module generates a prediction density having at least one mode, the state model includes a conditional density function including at least one kernel. Approximating module approximates a measurement probability from a sample set through at least one kernel and an update module updates the conditional density function using the measurement probability and the prediction density. A mode finding and mixture reduction module reduces the number of kernels in the conditional density function.