Data Recovery Agent for Bit Rot Repair
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional file systems face data degradation due to 'bit rot' in large capacity storage media, where cost and efficiency concerns lead to single data copies within the storage medium, making it difficult to locally store backup copies, thus hindering effective data recovery.
Innovation Solution
A data recovery agent and search service are implemented to monitor file system errors, identify and repair corrupted data blocks by sending requests to backup storage devices for uncorrupted copies, using checksum information and location details, and authorizing repairs through security components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If single copy of data is stored within storage media to reduce cost and improve efficiency, then storage cost and efficiency are improved, but data recovery capability deteriorates due to inability to locally repair corrupted data
Solution Approach 1:
The patent segments data protection functionality into two independent parts: (1) single data copy storage for efficiency, and (2) separate backup copy storage for recovery. The file system divides data blocks into regular data blocks and backup data blocks, allowing independent management of storage efficiency and data recovery capabilities.
Solution Approach 2:
The patent introduces an intermediary mechanism (backup data blocks and repair processes) that mediates between the single-copy storage system and data recovery requirements. When bit rot is detected, the repair process acts as an intermediary to retrieve backup copies and restore corrupted data, bridging the gap between efficient single-copy storage and reliable data recovery.
2Reliability
If backup copies are stored locally to enable data repair, then data recovery capability is improved, but storage space requirements worsen due to duplicate data storage
Solution Approach 1:
The patent applies local quality by implementing backup storage selectively rather than universally. Backup copies are stored for specific data blocks that require protection, allowing the system to optimize storage space by creating backups only where needed while maintaining data repair capability for protected blocks.
Solution Approach 2:
The patent creates an asymmetric storage architecture where data blocks and backup data blocks have different roles and properties. Data blocks store primary information while backup data blocks store redundant information, allowing the system to balance storage space consumption with data repair capability through asymmetric data distribution.
Data Source
AI summary
A data recovery agent and search service for repairing bit rot are presented herein. The data recovery agent can receive error event notifications representing respective file system errors. Based on a checksum error corresponding to such notifications, the data recovery agent can determine that a portion of a file has been invalidated or corrupted, obtain checksum information comprising a checksum of a validated version of the portion and location information comprising an offset from a beginning of the file representing a location of the portion, and send such information to a server hosting a data recovery service being configured to obtain a copy of a validated version of the portion from backup storage device(s). Further, the data recovery agent can receive the copy of the validated version from the server, and repair, using the copy, the portion that has been invalidated or corrupted.