Document Version Curation via Selective Metadata Retention
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Document management systems face increasing storage costs due to the retention of multiple document versions, which is exacerbated by rapid changes and frequent collaborations, leading to inefficient storage utilization and potential loss of valuable version data.
Innovation Solution
A document version curation approach that selectively retains versions based on criteria such as initial and recent versions, intermediate timelines, and audit trails, using a version analyzer to determine which versions to delete, thereby reducing storage space while preserving valuable document history.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all versions of a document are retained in the document management system, then the ability to recover from errors and adhere to legal requirements is improved, but the storage cost and operating cost increase
Solution Approach 1:
The patent extracts only the essential version information (metadata, checksums, key attributes) from complete document versions, storing full versions only when necessary. This selective extraction maintains recovery capability while dramatically reducing storage requirements.
Solution Approach 2:
The system applies different storage quality levels to different document versions based on their age, importance, and access patterns. Recent and critical versions are stored in full, while older versions are stored as summaries or metadata only, optimizing the balance between recovery capability and storage efficiency.
2Quantity of substance
If a fixed number of document versions are retained, then storage space is reduced, but the availability of specific historical versions cannot be guaranteed
Solution Approach 1:
The system continuously monitors version access patterns, importance ratings, and storage utilization, using this feedback to dynamically adjust which versions are retained in full and which are summarized. This ensures critical versions remain available while adapting to changing requirements.
Solution Approach 2:
The version retention strategy is dynamic rather than static, automatically adjusting the number and type of versions kept based on real-time conditions such as access frequency, document importance, and storage capacity, ensuring optimal balance between space efficiency and version availability.
3Quantity of substance
If Records Management policies are applied to delete old documents, then storage space is reduced, but relief for storage costs in scenarios with many versions in short time is not provided
Solution Approach 1:
The system segments version management into multiple tiers: full versions for recent and critical documents, summarized versions for intermediate documents, and metadata-only entries for older documents. This segmentation allows differentiated storage strategies that improve cost efficiency across the entire version history.
Solution Approach 2:
The system changes the storage parameter from binary (full version or nothing) to a spectrum of representation levels (full, summary, metadata). By adjusting this parameter based on document age, importance, and access patterns, the system achieves better storage cost efficiency while maintaining necessary version availability.
4Quantity of substance
If difference analysis is used to minimize storage requirements, then storage space is reduced, but the solution is only applicable to specific document types and fails with encrypted data
Solution Approach 1:
The system employs a universal version management approach that works with any document type, including encrypted files. Instead of document-specific difference analysis, it uses format-agnostic metadata extraction and checksum-based tracking that can handle any file type, encryption state, or binary format.
Solution Approach 2:
Rather than analyzing and storing only the differences between versions, the system creates lightweight copy representations (metadata, checksums, key attributes) that can be generated for any document type without requiring understanding of the document's internal structure or encryption, thus achieving both space reduction and universal compatibility.
Data Source
AI summary
A system and method for curation of document versions with significantly reduced storage requirements. In some embodiments, all or substantially all versions of a document are at least initially retained. Based on various criteria, versions of the document are selectively deleted while preserving the versions that are likely to provide the highest value. Advantageously, the teachings of embodiments as described can be used in conjunction with various systems, including document versioning, deduplication, and retention systems.