WORM VFS for Secure Data Archiving and Compliance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current WORM storage solutions face challenges in efficiently archiving and managing electronic data, including difficulty in finding specific documents, inability to automatically delete data after its retention period, and lack of encryption, which poses security risks and compliance issues with regulatory requirements.
Innovation Solution
A system comprising a WORM VFS with three layers: data encryption/compression, WORM filesystem, and logical volume manager, which maintains an index database for cross-referencing file identification and location, supports only authorized file and filesystem operations, and implements automatic deletion and encryption to ensure secure and compliant data storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If optical WORM storage is used to archive electronic data, then data security and compliance are improved, but data retrieval efficiency and searchability deteriorate
Solution Approach 1:
The system segments data management functions by separating the WORM storage layer (for security and compliance) from the indexing and search functions (for retrieval efficiency). The virtual file system creates logical volumes that present data in a searchable format while the underlying optical storage maintains security constraints.
Solution Approach 2:
A virtual file system acts as an intermediary between the optical WORM storage and user applications. This intermediary layer provides indexing, search capabilities, and data retrieval functions without compromising the security and immutability of the underlying optical storage medium.
2Reliability
If all data is retained on optical WORM storage until the longest retention period, then compliance requirements are met, but storage efficiency and data management flexibility deteriorate
Solution Approach 1:
The system implements dynamic data retention management where data can be deleted from optical storage when its specific retention period expires, even if other data on the same medium has longer retention requirements. This is achieved through the virtual file system's ability to manage individual file lifecycles independently.
Solution Approach 2:
The system performs preliminary actions by establishing retention policies and automatic deletion mechanisms before retention periods expire. The virtual file system monitors data aging and automatically removes expired data, preventing storage waste while ensuring compliance.
3Reliability
If manual processes are used to destroy optical WORM storage media, then data security is maintained, but operational efficiency and automation deteriorate
Solution Approach 1:
The system implements self-service automation where the virtual file system automatically manages the deletion of expired data and coordinates media destruction when retention periods are fulfilled. This eliminates manual intervention while maintaining security through controlled processes.
Solution Approach 2:
The system uses feedback mechanisms to monitor data retention status continuously. When retention periods expire, the system automatically triggers deletion processes and media destruction protocols, creating a closed-loop system that maintains security while improving operational efficiency.
4Productivity
If optical WORM storage media are used without encryption, then storage capacity and access speed are improved, but data security and confidentiality deteriorate
Solution Approach 1:
Data is encrypted before being written to optical WORM storage media. The encryption process occurs in advance during the data ingestion phase, so that when data is retrieved, it remains encrypted and requires decryption for access, maintaining confidentiality without impacting storage capacity or access speed.
Data Source
AI summary
A system and method for Write Once, Read Many (WORM) compliant storage is disclosed. A storage administrator in user space is employed as an interface between the kernel space WORM VFS and the user applications. The storage administrator accesses the WORM VFS through the operating system's Virtual File System. The WORM VFS comprises of three layers: a data encryption\compression layer, the WORM filesystem layer and a logical volume manager. The data encryption\compression layer preprocesses the data as it moves between from the user space and the WORM filesystem layer. The WORM filesystem layer stores the compressed and encrypted data on the physical disk drives in a specialized disk format. The logical volume manager manages the physical disk drives. A NVRAM journal aids in crash recovery.