In-situ Cloud Data Verification Checksums
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data verification methods in cloud storage systems are time-consuming and costly due to the need to access and retrieve data from cloud storage systems for auditing, especially when data is encrypted, compressed, or deduplicated, which complicates the process and increases bandwidth usage.
Innovation Solution
Implementing asynchronous in-situ data verification by using a verification checksum computed before data is stored in the cloud, allowing local access within the cloud storage system to compare with a second checksum, reducing the need for data retransmission and enabling secure, efficient data integrity checks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is retrieved from cloud storage system for auditing, then data integrity can be verified, but bandwidth consumption increases and access time increases
Solution Approach 1:
The patent extracts only the essential verification elements (checksums and metadata) from the cloud storage system rather than retrieving the entire dataset. This allows data integrity verification to be performed with minimal bandwidth consumption by comparing stored checksums against newly computed checksums of the data currently in the cloud.
Solution Approach 2:
The patent creates and stores checksums as simplified copies of the original data that can be used for verification purposes. These checksums serve as lightweight representations that enable integrity checking without requiring access to the full data set, thus reducing bandwidth requirements significantly.
2Reliability
If data is retrieved from cloud storage system for auditing, then data integrity can be verified, but access time increases
Solution Approach 1:
The patent extracts only the verification-critical metadata and checksums from the cloud storage system, bypassing the need to retrieve and process the entire data set. This extraction approach dramatically reduces access time while maintaining verification reliability.
Solution Approach 2:
The patent performs preliminary computation of checksums and stores them alongside the data in the cloud storage system. When verification is needed, these pre-computed checksums are immediately available for comparison, eliminating the time-consuming process of computing checksums from scratch during the auditing process.
3Reliability
If conventional auditing methods are used, then data integrity can be checked, but cost increases due to hourly billing
Solution Approach 1:
The patent extracts only the essential verification metadata and checksums from the cloud storage system, minimizing the amount of data that needs to be accessed and processed. This extraction strategy directly reduces the billed operations and access time, thereby lowering costs while maintaining verification capability.
Solution Approach 2:
The patent uses checksums as lightweight copies that enable verification without requiring access to the full data set. This copying approach reduces the computational and access operations billed by the cloud storage system, directly reducing verification costs.
Data Source
AI summary
Example methods and apparatus asynchronously verify data stored in a cloud data storage system. One embodiment comprises a monitoring circuit that determines if a data auditing condition associated with a cloud storage system or archived data stored in the cloud storage system has been met, a metadata mirror circuit that controls a metadata mirror to provide metadata, including a first checksum, associated with the archived data to the apparatus, a checksum circuit that computes a second checksum based on the archived data, a verification circuit that generates an audit of the first checksum and the second checksum by comparing the second checksum with the first checksum, and a reporting circuit that generates a log of the audit, that provides the log to the data storage system, and that provides a notification of a data integrity failure to a user associated with the archived data.