Data Verification via Correlated Slice Fingerprints
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data verification methods in cloud network disk systems fail to detect transmission errors until the entire data file is downloaded, leading to potential fatal impacts during large file uploads or downloads, and are inefficient in determining file upload status within seconds.
Innovation Solution
A data verification method that calculates and verifies fingerprint information for each slice of data by updating it using previous slices, ensuring the fingerprint information is correlated to the sequence of slices, allowing for early detection of tampering or disordered packets, and reducing the time and calculation burden for verifying entire data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional slice verification methods are used, then the verification process is simple, but transmission errors are only detected after the entire file is downloaded
Solution Approach 1:
The patent applies preliminary action by pre-calculating fingerprint information for each data slice before transmission. The receiving party obtains these pre-calculated fingerprints and can immediately verify each slice as it arrives, rather than waiting for complete file download. This allows early error detection without adding verification time to the overall process.
Solution Approach 2:
The patent introduces fingerprint information as an intermediary element between the data slices and the verification process. Instead of directly verifying entire files or relying on simple checksums, the system uses these intermediate fingerprint representations that enable efficient, incremental verification of individual slices, resolving the contradiction between early error detection and verification time.
2Reliability
If fingerprint information is calculated for each slice with sequence correlation, then transmission errors can be detected earlier, but the calculation complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the data into slices and calculating independent fingerprint information for each slice. This segmentation allows the system to verify individual slices separately with sequence correlation, enabling early error detection. The segmentation approach manages calculation complexity by processing smaller, manageable units rather than the entire file at once.
Solution Approach 2:
The patent changes the verification parameter from traditional checksums to fingerprint information that incorporates sequence correlation. This parameter change enables the system to detect not only data corruption but also packet reordering errors, improving reliability while maintaining manageable calculation complexity through efficient fingerprint algorithms.
3Productivity
If verification is performed only after complete file download, then the verification process is simple, but the time required to determine file upload status is extended
Solution Approach 1:
The patent implements continuity of useful action by performing verification continuously as each data slice arrives, rather than waiting for complete file download. The receiving party continuously compares received slice fingerprints with pre-stored fingerprints, enabling real-time error detection and rapid determination of file upload status without interrupting the data transfer process.
Solution Approach 2:
The patent applies feedback by immediately comparing each received slice's fingerprint information with the pre-stored reference fingerprints and providing real-time verification results. This feedback mechanism enables the system to quickly determine file upload status and detect errors early, improving productivity without extending total verification time.
Data Source
Figure 1A
Figure 1B~1C
Figure 2
AI summary
This application discloses a data verification method, including: receiving, fingerprint information of N data slices of to-be-sent data of a second device, wherein the N data slices are obtained by slicing the to-be-sent data; and in the fingerprint information, first fingerprint information corresponding to an ith data slice is obtained by updating second fingerprint information corresponding to an (i-1)h data slice with the ith data slice, and both N and i are integers greater than 1,receiving, the ith data slice from the second device; updating, the received second fingerprint information with the ith data slice to obtain third fingerprint information; and sending, data verification failure indication information to the second device in response to the third fingerprint information not matching the received first fingerprint information.