Accelerating CP Decomposition via WHT Sampling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The Alternating Least Squares (ALS) algorithm for canonical polyadic (CP) decomposition consumes significant computing resources, making it inefficient in terms of time and memory usage.
Innovation Solution
An electronic device and method that accelerate CP decomposition by performing Walsh-Hadamard transform (WHT) or discrete cosine transform (DCT) operations on tensor components, followed by random sampling and least square problem solving, reducing computational complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the Alternating Least Squares (ALS) algorithm is used for CP decomposition, then the decomposition can be performed, but significant computing resources are consumed
Solution Approach 1:
The patent applies partial action by using random sampling to select only a subset of data points for each iteration of the CP decomposition process. Instead of processing the entire tensor data, the method samples a portion of the data to compute factor matrices, which reduces the computational burden while still achieving acceptable decomposition results. This is implemented through the sampling module that randomly selects indices from the tensor dimensions.
Solution Approach 2:
The patent segments the large-scale tensor decomposition problem into smaller, manageable sub-problems by dividing the data into sampled subsets. Each iteration works on a segmented portion of the data rather than the complete dataset, allowing the decomposition to proceed with reduced computational resources. The factor matrices are updated incrementally based on these segmented computations.
2Reliability
If the Alternating Least Squares (ALS) algorithm is used for CP decomposition, then the decomposition can be performed, but the execution time is long
Solution Approach 1:
The patent reduces execution time by performing partial computations through random sampling. Instead of iterating over all data points in each ALS iteration, the method processes only a sampled subset, significantly decreasing the time required for each update step while maintaining the alternating least squares optimization framework for accuracy.
Solution Approach 2:
The patent performs preliminary random sampling to generate initial factor matrices before proceeding with the full decomposition process. This preliminary action creates a starting point that accelerates convergence, reducing the number of iterations needed to achieve accurate results and thereby decreasing overall execution time.
3Reliability
If the Alternating Least Squares (ALS) algorithm is used for CP decomposition, then the decomposition can be performed, but memory capacity required is large
Solution Approach 1:
The patent reduces memory capacity requirements by processing only a sampled portion of the tensor data in each iteration. Instead of loading and manipulating the entire tensor and all factor matrices simultaneously, the method loads only the necessary sampled data points and corresponding factor matrix elements into memory, significantly decreasing the memory footprint while preserving decomposition accuracy.
4Use of energy by moving object
If random sampling is used to reduce computational complexity, then computing resources are reduced, but the decomposition accuracy may be affected
Solution Approach 1:
The patent implements feedback mechanisms through iterative refinement of the factor matrices based on sampled data. The decomposition process continuously updates the factor matrices by comparing the reconstructed tensor with the original sampled data, and adjusts the matrices to minimize the reconstruction error. This feedback loop ensures that even though only sampled data is processed, the final decomposition achieves high accuracy by progressively refining the solution.
Data Source
AI summary
An electronic device and a method for accelerating canonical polyadic (CP) decomposition are provided. The method includes: performing at least one of a Walsh-Hadamard transform (WHT) operation and a discrete cosine transform (DCT) operation on a first factor matrix, a second factor matrix, and a tensor respectively to update the first factor matrix, the second factor matrix and the tensor; sampling the updated first factor matrix and the updated second factor matrix to generate a first sampled matrix, and sampling an unfolded matrix of the updated tensor to generate a second sampled matrix; solving a least square problem of the first sampled matrix and the second sampled matrix to generate or update a third factor matrix of the tensor so as to update multiple components of the tensor; and outputting multiple components after an updating of multiple components is finished.


