Convolutional Operation Checksums for Layer-Level Error Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently detecting errors during machine learning operations, particularly in convolutional neural networks, due to soft errors caused by handling and storage of data.
Innovation Solution
A computer-implemented method and system for detecting errors in convolutional operations by obtaining predicted checksum data, performing the convolution operation, generating output checksum data, and comparing it with the predicted checksum data, while accounting for partial predicted checksum data to correct for a lack of padding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If checksum verification is implemented for error detection in convolutional operations, then reliability is improved, but computational expense increases
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing checksums for input data and kernel weights before the convolution operation. These pre-computed checksums enable rapid verification during inference without requiring repeated computational operations, thus improving reliability while controlling computational expense.
Solution Approach 2:
The patent uses checksums as a copy or representation of data integrity rather than processing the actual data repeatedly. By working with checksum values (which are smaller and fewer in number) instead of the full convolutional data, the system achieves error detection with reduced computational overhead.
2Measurement precision
If padding is added to handle edge cases in convolution, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent extracts the essential verification function from the data structure by using checksums. Instead of adding complex padding structures to handle edge cases, the system computes checksums that inherently account for all data including edge regions, simplifying the overall data structure while maintaining precision.
Solution Approach 2:
The patent changes the approach from structural modification (adding padding) to parameter-based solution (using checksum values). By transforming the problem into a checksum verification parameter, the system achieves accurate edge case handling without increasing data structure complexity.
3Reliability
If comprehensive error detection is implemented across all layers, then reliability is improved, but productivity decreases
Solution Approach 1:
The patent applies segmentation by implementing error detection at specific critical points (input data loading, kernel weight storage, and output generation) rather than continuously monitoring all operations. This segmented approach maintains reliable error detection coverage while minimizing the impact on overall processing speed.
Solution Approach 2:
The patent implements self-service error detection where the system verifies its own integrity using pre-computed checksums without requiring external monitoring or complex verification mechanisms. This lightweight self-verification maintains productivity while ensuring reliability.
Data Source
AI summary
Methods and systems for detecting errors when performing a convolutional operation is provided. Predicted checksum data, corresponding to input checksum data and kernel checksum data, is obtained. The convolutional operation is performed to obtain an output feature map. Output checksum data is generated and the predicted checksum data and the output checksum data are compared, the comparing taking account of partial predicted checksum data configured to correct for a lack of padding when performing the convolution operation, wherein the partial predicted checksum data corresponds to input checksum data for a subset of the values in the input feature map and kernel checksum data for a subset of the values in the kernel.


