Data Integrity Engine Error Detection via Hash Parity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage systems face inefficiencies in error detection and correction, particularly in RAID arrays, where reconstructing bad data blocks is time-consuming and burdensome on system resources due to the need for redundant data retrieval.
Innovation Solution
A system and method that employs a data integrity engine with a first and second error detection process, using hash functions and parity codes to detect and repair errors, allowing for efficient error correction by reusing parity information and recalculating hashes to reconstruct corrupted data blocks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional RAID arrays use parity data for error detection and correction, then data consistency and redundancy are assured, but the time to reread data blocks for reconstructing bad data blocks increases significantly
Solution Approach 1:
The patent applies hash functions to data blocks before writing them to storage, creating predetermined hash values that are stored alongside the data. When errors occur, these pre-computed hash values enable immediate detection without needing to reread and reprocess the entire data block, thus resolving the contradiction between maintaining data consistency and reducing error correction time
Solution Approach 2:
The patent replaces the mechanical process of rereading physical data blocks for error detection with a computational approach using hash functions. Instead of physically accessing and reprocessing storage media to detect errors, the system uses mathematical hash comparisons, which significantly reduces the time required for error detection and correction while maintaining data reliability
2Reliability
If RAID arrays reread data blocks prior to bad data blocks for reconstruction, then error correction is achieved, but system resources are burdened unnecessarily
Solution Approach 1:
The patent extracts the essential error detection function from the complex process of rereading entire data blocks by using hash values. Instead of requiring the system to process and move large amounts of data through storage channels, only compact hash values need to be compared, thereby reducing system resource usage while maintaining data integrity
Solution Approach 2:
The patent transforms the error detection approach by changing the parameter being checked from the entire data block content to a condensed hash representation. This parameter transformation allows error detection to occur with minimal computational and I/O resources, resolving the contradiction between ensuring data integrity and reducing system resource burden
Data Source
AI summary
A system and method for error detection in a data storage array includes one or more storage medium interconnected with a controller through a network. A data integrity engine in the controller applies a first error detection process to a data object to create one or more data blocks and associated parity codes. First and second error detection processes are applied to detect and repair errors in the data object.