Convolutional Operation Checksums for Layer-Level Error Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in efficiently detecting errors during machine learning operations, particularly in convolutional neural networks, due to soft errors caused by handling and storage of data.

Innovation Solution

A computer-implemented method and system for detecting errors in convolutional operations by obtaining predicted checksum data, performing the convolution operation, generating output checksum data, and comparing it with the predicted checksum data, while accounting for partial predicted checksum data to correct for a lack of padding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If checksum verification is implemented for error detection in convolutional operations, then reliability is improved, but computational expense increases

Engineering Contradiction:
Improveerror detection capabilityVSAvoidcomputational expense
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing checksums for input data and kernel weights before the convolution operation. These pre-computed checksums enable rapid verification during inference without requiring repeated computational operations, thus improving reliability while controlling computational expense.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses checksums as a copy or representation of data integrity rather than processing the actual data repeatedly. By working with checksum values (which are smaller and fewer in number) instead of the full convolutional data, the system achieves error detection with reduced computational overhead.

Inventive Principle:
Principle #26Copying

2Measurement precision

If padding is added to handle edge cases in convolution, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improveedge case handling accuracyVSAvoiddata structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the essential verification function from the data structure by using checksums. Instead of adding complex padding structures to handle edge cases, the system computes checksums that inherently account for all data including edge regions, simplifying the overall data structure while maintaining precision.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the approach from structural modification (adding padding) to parameter-based solution (using checksum values). By transforming the problem into a checksum verification parameter, the system achieves accurate edge case handling without increasing data structure complexity.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If comprehensive error detection is implemented across all layers, then reliability is improved, but productivity decreases

Engineering Contradiction:
Improveerror detection coverageVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies segmentation by implementing error detection at specific critical points (input data loading, kernel weight storage, and output generation) rather than continuously monitoring all operations. This segmented approach maintains reliable error detection coverage while minimizing the impact on overall processing speed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements self-service error detection where the system verifies its own integrity using pre-computed checksums without requiring external monitoring or complex verification mechanisms. This lightweight self-verification maintains productivity while ensuring reliability.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12346485B2Error detection in convolutional operations
Publication Date: 2025.07.01 ARM LTD
  • US12346485B2 patent drawing
  • US12346485B2 patent drawing
  • US12346485B2 patent drawing

AI summary

Methods and systems for detecting errors when performing a convolutional operation is provided. Predicted checksum data, corresponding to input checksum data and kernel checksum data, is obtained. The convolutional operation is performed to obtain an output feature map. Output checksum data is generated and the predicted checksum data and the output checksum data are compared, the comparing taking account of partial predicted checksum data configured to correct for a lack of padding when performing the convolution operation, wherein the partial predicted checksum data corresponds to input checksum data for a subset of the values in the input feature map and kernel checksum data for a subset of the values in the kernel.