Matrix Multiplication Error Correction for Fast Low-Power Processors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern processors face errors due to increased speed, reduced power consumption, and closer transistor spacing, leading to unreliable computations in matrix multiplication.

Innovation Solution

An error correcting module, either in software or hardware, detects and corrects errors in matrix multiplication by calculating expected and actual sums of matrix elements, determining error location and magnitude, and adjusting computational processes to prevent recurrence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the processor speed is increased by increasing the frequency of the internal clock, then the processing speed is improved, but errors in the least reliable transistors occur

Engineering Contradiction:
Improveprocessor speedVSAvoidtransistor reliability
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent applies preliminary action by computing a verification value (sum of all elements in the result matrix) before the matrix multiplication operation completes. This verification value is then compared against the actual result to detect errors before they propagate, allowing the system to operate at higher speeds with acceptable reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by continuously monitoring the computation results through comparison of the verification value against the actual matrix multiplication result. When discrepancies are detected, the system can trigger error correction mechanisms or adjust operating parameters, creating a closed-loop control system that maintains reliability at high speeds.

Inventive Principle:
Principle #23Feedback

2Use of energy by moving object

If the power consumption of the processor is decreased, then energy efficiency is improved, but erroneous computation occurs

Engineering Contradiction:
Improvepower consumptionVSAvoidcomputation reliability
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent computes a verification value in advance that represents the expected sum of all elements in the result matrix. This preliminary computation allows for error detection without requiring additional high-power operations during the main computation, thus maintaining energy efficiency while ensuring computation reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback by comparing the pre-computed verification value with the actual computation result. This lightweight comparison operation consumes minimal power but effectively detects erroneous computations, allowing the processor to maintain low power consumption without sacrificing reliability.

Inventive Principle:
Principle #23Feedback

3Length of moving object

If the distance between transistors is decreased, then the processor size is reduced, but erroneous computation occurs

Engineering Contradiction:
Improvedistance between transistorsVSAvoidcomputation reliability
Core Design Contradiction:
Length of moving objectVSReliability

Solution Approach 1:

The patent applies preliminary action by calculating the verification value (expected sum) before the matrix multiplication completes. This approach allows compact transistor spacing while maintaining reliability, as the error detection mechanism does not require additional physical space beyond the computational logic already present.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback through comparison of the verification value with the actual result, enabling error detection in compact designs. This feedback mechanism allows the processor to maintain small transistor spacing while correcting computational errors through software or control logic.

Inventive Principle:
Principle #23Feedback

4Reliability

If error detection and correction is implemented, then computation reliability is improved, but additional computational overhead is introduced

Engineering Contradiction:
Improvecomputation reliabilityVSAvoidcomputational overhead
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the error detection function into a separate verification step that operates independently from the main matrix multiplication logic. By computing the sum of all elements as a separate verification value and comparing it against the result, the system adds minimal overhead while significantly improving reliability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses copying by creating a verification copy of the computation result through the sum calculation. This verification copy (the sum value) is computed separately and used to validate the main result, providing error detection with minimal additional computational complexity.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3568749B1Error correction in computation
Publication Date: 2026.03.25 GROQ INC
  • EP3568749B1 patent drawingFigure 1
  • EP3568749B1 patent drawingFigure 2A~2C
  • EP3568749B1 patent drawingFigure 3

AI summary

Introduced here is a technique to detect and/or correct errors in computation. The ability to correct errors in computation can increase the speed of the processor, reduce the power consumption of the processor, and reduce the distance between the transistors within the processor because the errors thus generated can be detected and corrected. In one embodiment, an error correcting module, running either in software or in hardware, can detect an error in matrix multiplication, by calculating an expected sum of all elements in the resulting matrix, and an actual sum of all elements in the resulting matrix. When there is a difference between the expected sum and the resulting sum, the error correcting module detects an error. In another embodiment, in addition to detecting the error, the error correcting module can determine the location and the magnitude of the error, thus correcting the erroneous computation.