Data Stream Versioning for Efficient Network Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional methods for data storage and transfer over networks are slow, especially for large data sets, leading to inefficiencies in sharing and backup processes, and can result in data loss due to communication delays and concurrent editing issues.
Innovation Solution
A method of storing data in streams of varying sizes, where a 'frozen' data stream is created as a reference to modify, allowing only the changed data to be updated, rather than the entire file, and utilizing B+ trees for efficient indexing and retrieval.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is stored and transferred over a network using traditional methods, then data can be shared and backed up, but the transfer speed is slow and efficiency is reduced
Solution Approach 1:
The patent segments data into data streams of varying sizes, allowing selective transmission of only modified portions rather than entire files. This segmentation enables efficient incremental updates where only changed data blocks are transmitted over the network, significantly improving transfer efficiency and speed.
Solution Approach 2:
The patent creates frozen data streams as immutable copies that serve as references for modifications. When data needs to be updated, instead of transferring and modifying the original large file, the system creates a new data stream that references the frozen copy and only transmits the differences, reducing network transfer requirements.
2Ease of operation
If entire files are transferred and updated over the network, then data can be modified, but time is lost due to transferring unnecessary unchanged data
Solution Approach 1:
The patent extracts only the modified portions of data from the complete file set. By identifying and isolating changed data blocks, the system transfers only these extracted portions over the network rather than entire files, eliminating the time waste associated with transferring unchanged data while maintaining full data modification capability.
Solution Approach 2:
The patent implements dynamic data stream management where data streams can be frozen (made immutable) or unfrozen (modifiable) as needed. This dynamic approach allows the system to optimize between data integrity and modification efficiency, enabling quick updates to specific portions without requiring complete file transfers.
3Productivity
If data streams are made modifiable, then data can be updated efficiently, but data integrity and version control are compromised
Solution Approach 1:
The patent applies preliminary action by freezing data streams before modification. By establishing a frozen (immutable) version of the data stream as a baseline, the system ensures data integrity is maintained while allowing controlled modifications to create new versions. This preliminary freezing action prevents accidental corruption and maintains reliable version control.
Solution Approach 2:
The patent uses frozen data streams as intermediaries between the original data and modified versions. The frozen stream acts as a stable reference point that mediates the modification process, ensuring that changes are deliberately applied to create new versions rather than corrupting existing data, thus maintaining both integrity and version control.
4Quantity of substance
If large data sets are transferred over the network, then complete data can be shared, but communication delays increase and data loss risk rises
Solution Approach 1:
The patent segments large data sets into smaller data streams of varying sizes, allowing selective transmission of only necessary portions. This segmentation reduces the total volume of data transferred over the network, thereby minimizing communication delays and reducing the probability of data loss during transmission while still enabling complete data sharing when needed.
Data Source
AI summary
Data is stored in data streams of varying size over a network so that a particular data stream may be considered as being stored locally or remotely. A request is received to modify a first data stream, and a frozen condition to the effect that said first data stream is not modifiable is identified. A second data stream that comprises a reference to the first data stream is created, and the information contained in said second data stream is modified according to said request.