Mixed Precision Linear Equation Solver
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mixed precision computing in machine learning and AI applications faces challenges due to the resilience of noisy computations in reduced precision hardware, which affects the accuracy and efficiency of solving systems of linear equations.
Innovation Solution
A flexible iterative algorithm is employed to determine the most computationally expensive operation in each iteration of solving systems of linear equations, mapping it to a low precision format while performing other operations in high precision, thereby optimizing computation and reducing energy consumption without sacrificing precision.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If reduced precision hardware is used for computing, then energy consumption is reduced and computation speed is improved, but computation accuracy deteriorates due to noisy computations
Solution Approach 1:
The patent applies local quality by using different precision levels for different computational operations within the same system. Specifically, it identifies and separates the most computationally expensive operation (typically matrix-vector multiplication) to be performed in low precision, while other operations are performed in high precision. This localized application of precision optimization resolves the contradiction by allowing speed improvements in critical paths without compromising overall computation accuracy.
Solution Approach 2:
The patent segments the computational process into distinct precision domains. It divides the iterative algorithm into operations that can tolerate low precision (such as the dominant computational kernel) and operations that require high precision (such as convergence checking and parameter updates). This segmentation enables the system to achieve high productivity in the segmented low-precision portion while maintaining accuracy in the high-precision portions.
2Use of energy by stationary object
If reduced precision format is used for all operations, then energy consumption is reduced, but solution accuracy deteriorates
Solution Approach 1:
The patent applies local quality by assigning different precision characteristics to different parts of the computational workflow. The most energy-intensive operation (matrix-vector multiplication) is designated for low precision execution to maximize energy efficiency, while other operations maintain high precision to ensure solution accuracy. This localized precision strategy resolves the energy-accuracy contradiction.
Solution Approach 2:
The patent dynamically changes the precision parameter based on the specific operation being performed. Instead of using a fixed precision level for all operations, it adjusts the precision parameter locally for each computational step, setting low precision for the dominant operation and high precision for other operations. This parameter change strategy enables energy-efficient computation without sacrificing solution accuracy.
3Measurement precision
If high precision is used for all operations, then solution accuracy is maintained, but energy consumption increases and computation speed decreases
Solution Approach 1:
The patent applies local quality by selectively applying high precision only where necessary for maintaining solution accuracy, rather than uniformly across all operations. The dominant computational operation is executed in low precision since it benefits most from speed and energy efficiency, while high precision is applied only to operations critical for accuracy. This resolves the contradiction by localizing high precision usage.
Solution Approach 2:
The patent segments the computational process into high-precision and low-precision portions. By identifying that the most expensive operation can be performed in low precision without significantly impacting final accuracy, it segments this operation from the rest of the workflow that requires high precision. This segmentation reduces overall energy consumption while maintaining solution accuracy.
4Measurement precision
If high precision is used for all operations, then solution accuracy is maintained, but computation speed decreases
Solution Approach 1:
The patent applies local quality by using low precision for the most computationally expensive operation (matrix-vector multiplication) where speed benefits are most significant, while maintaining high precision for other operations. This localized precision optimization resolves the speed-accuracy contradiction by allowing fast computation in the critical path without compromising overall solution accuracy.
Solution Approach 2:
The patent segments the computational workflow into speed-critical operations (performed in low precision) and accuracy-critical operations (performed in high precision). By segmenting the dominant operation from the rest of the workflow and assigning it low precision, the system achieves significant speed improvements while maintaining acceptable solution accuracy through the high-precision segments.
Data Source
AI summary
A method of computation includes receiving, by a requesting device, a system of linear equations, and computing a solution to the system of linear equations by a flexible iterative algorithm. The computing includes, for each iteration, determining a most computationally expensive operation of the iteration, mapping the most expensive operation to a low precision format, performing the most expensive operation according to a low precision, performing other operations of the iteration according to a high precision, and returning the solution to the requesting device.


