Mixed Precision Linear Equation Solver

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mixed precision computing in machine learning and AI applications faces challenges due to the resilience of noisy computations in reduced precision hardware, which affects the accuracy and efficiency of solving systems of linear equations.

Innovation Solution

A flexible iterative algorithm is employed to determine the most computationally expensive operation in each iteration of solving systems of linear equations, mapping it to a low precision format while performing other operations in high precision, thereby optimizing computation and reducing energy consumption without sacrificing precision.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If reduced precision hardware is used for computing, then energy consumption is reduced and computation speed is improved, but computation accuracy deteriorates due to noisy computations

Engineering Contradiction:
Improvecomputation speedVSAvoidcomputation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies local quality by using different precision levels for different computational operations within the same system. Specifically, it identifies and separates the most computationally expensive operation (typically matrix-vector multiplication) to be performed in low precision, while other operations are performed in high precision. This localized application of precision optimization resolves the contradiction by allowing speed improvements in critical paths without compromising overall computation accuracy.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the computational process into distinct precision domains. It divides the iterative algorithm into operations that can tolerate low precision (such as the dominant computational kernel) and operations that require high precision (such as convergence checking and parameter updates). This segmentation enables the system to achieve high productivity in the segmented low-precision portion while maintaining accuracy in the high-precision portions.

Inventive Principle:
Principle #1Segmentation

2Use of energy by stationary object

If reduced precision format is used for all operations, then energy consumption is reduced, but solution accuracy deteriorates

Engineering Contradiction:
Improveenergy consumptionVSAvoidsolution accuracy
Core Design Contradiction:
Use of energy by stationary objectVSMeasurement precision

Solution Approach 1:

The patent applies local quality by assigning different precision characteristics to different parts of the computational workflow. The most energy-intensive operation (matrix-vector multiplication) is designated for low precision execution to maximize energy efficiency, while other operations maintain high precision to ensure solution accuracy. This localized precision strategy resolves the energy-accuracy contradiction.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically changes the precision parameter based on the specific operation being performed. Instead of using a fixed precision level for all operations, it adjusts the precision parameter locally for each computational step, setting low precision for the dominant operation and high precision for other operations. This parameter change strategy enables energy-efficient computation without sacrificing solution accuracy.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If high precision is used for all operations, then solution accuracy is maintained, but energy consumption increases and computation speed decreases

Engineering Contradiction:
Improvesolution accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by stationary object

Solution Approach 1:

The patent applies local quality by selectively applying high precision only where necessary for maintaining solution accuracy, rather than uniformly across all operations. The dominant computational operation is executed in low precision since it benefits most from speed and energy efficiency, while high precision is applied only to operations critical for accuracy. This resolves the contradiction by localizing high precision usage.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the computational process into high-precision and low-precision portions. By identifying that the most expensive operation can be performed in low precision without significantly impacting final accuracy, it segments this operation from the rest of the workflow that requires high precision. This segmentation reduces overall energy consumption while maintaining solution accuracy.

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If high precision is used for all operations, then solution accuracy is maintained, but computation speed decreases

Engineering Contradiction:
Improvesolution accuracyVSAvoidcomputation speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies local quality by using low precision for the most computationally expensive operation (matrix-vector multiplication) where speed benefits are most significant, while maintaining high precision for other operations. This localized precision optimization resolves the speed-accuracy contradiction by allowing fast computation in the critical path without compromising overall solution accuracy.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the computational workflow into speed-critical operations (performed in low precision) and accuracy-critical operations (performed in high precision). By segmenting the dominant operation from the rest of the workflow and assigning it low precision, the system achieves significant speed improvements while maintaining acceptable solution accuracy through the high-precision segments.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240176843A1Solving systems of linear equations using mixed precision
Publication Date: 2024.05.30 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20240176843A1 patent drawing
  • US20240176843A1 patent drawing
  • US20240176843A1 patent drawing

AI summary

A method of computation includes receiving, by a requesting device, a system of linear equations, and computing a solution to the system of linear equations by a flexible iterative algorithm. The computing includes, for each iteration, determining a most computationally expensive operation of the iteration, mapping the most expensive operation to a low precision format, performing the most expensive operation according to a low precision, performing other operations of the iteration according to a high precision, and returning the solution to the requesting device.