Accelerating CP Decomposition via WHT Sampling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The Alternating Least Squares (ALS) algorithm for canonical polyadic (CP) decomposition consumes significant computing resources, making it inefficient in terms of time and memory usage.

Innovation Solution

An electronic device and method that accelerate CP decomposition by performing Walsh-Hadamard transform (WHT) or discrete cosine transform (DCT) operations on tensor components, followed by random sampling and least square problem solving, reducing computational complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the Alternating Least Squares (ALS) algorithm is used for CP decomposition, then the decomposition can be performed, but significant computing resources are consumed

Engineering Contradiction:
Improvedecomposition accuracyVSAvoidcomputing resources
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by using random sampling to select only a subset of data points for each iteration of the CP decomposition process. Instead of processing the entire tensor data, the method samples a portion of the data to compute factor matrices, which reduces the computational burden while still achieving acceptable decomposition results. This is implemented through the sampling module that randomly selects indices from the tensor dimensions.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent segments the large-scale tensor decomposition problem into smaller, manageable sub-problems by dividing the data into sampled subsets. Each iteration works on a segmented portion of the data rather than the complete dataset, allowing the decomposition to proceed with reduced computational resources. The factor matrices are updated incrementally based on these segmented computations.

Inventive Principle:
Principle #1Segmentation

2Reliability

If the Alternating Least Squares (ALS) algorithm is used for CP decomposition, then the decomposition can be performed, but the execution time is long

Engineering Contradiction:
Improvedecomposition accuracyVSAvoidexecution time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent reduces execution time by performing partial computations through random sampling. Instead of iterating over all data points in each ALS iteration, the method processes only a sampled subset, significantly decreasing the time required for each update step while maintaining the alternating least squares optimization framework for accuracy.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent performs preliminary random sampling to generate initial factor matrices before proceeding with the full decomposition process. This preliminary action creates a starting point that accelerates convergence, reducing the number of iterations needed to achieve accurate results and thereby decreasing overall execution time.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the Alternating Least Squares (ALS) algorithm is used for CP decomposition, then the decomposition can be performed, but memory capacity required is large

Engineering Contradiction:
Improvedecomposition accuracyVSAvoidmemory capacity
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent reduces memory capacity requirements by processing only a sampled portion of the tensor data in each iteration. Instead of loading and manipulating the entire tensor and all factor matrices simultaneously, the method loads only the necessary sampled data points and corresponding factor matrix elements into memory, significantly decreasing the memory footprint while preserving decomposition accuracy.

Inventive Principle:
Principle #16Partial or excessive action

4Use of energy by moving object

If random sampling is used to reduce computational complexity, then computing resources are reduced, but the decomposition accuracy may be affected

Engineering Contradiction:
Improvecomputing resourcesVSAvoiddecomposition accuracy
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The patent implements feedback mechanisms through iterative refinement of the factor matrices based on sampled data. The decomposition process continuously updates the factor matrices by comparing the reconstructed tensor with the original sampled data, and adjusts the matrices to minimize the reconstruction error. This feedback loop ensures that even though only sampled data is processed, the final decomposition achieves high accuracy by progressively refining the solution.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240012873A1Electronic device and method for accelerating canonical polyadic decomposition
Publication Date: 2024.01.11 IND TECH RES INST
  • US20240012873A1 patent drawing
  • US20240012873A1 patent drawing
  • US20240012873A1 patent drawing

AI summary

An electronic device and a method for accelerating canonical polyadic (CP) decomposition are provided. The method includes: performing at least one of a Walsh-Hadamard transform (WHT) operation and a discrete cosine transform (DCT) operation on a first factor matrix, a second factor matrix, and a tensor respectively to update the first factor matrix, the second factor matrix and the tensor; sampling the updated first factor matrix and the updated second factor matrix to generate a first sampled matrix, and sampling an unfolded matrix of the updated tensor to generate a second sampled matrix; solving a least square problem of the first sampled matrix and the second sampled matrix to generate or update a third factor matrix of the tensor so as to update multiple components of the tensor; and outputting multiple components after an updating of multiple components is finished.