Stream Data Update Layout for Lower Write Amplification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing memory storage devices face inefficiencies in updating stream data due to high write amplification and stranded capacity when using protocols like NVMe, which lead to reduced longevity and increased power consumption.
Innovation Solution
A method and system for writing stream data updates to a new superblock separate from the existing data, allowing concurrent writing of additional data to utilize unused capacity, and reconciling the data based on stream IDs or logical block addresses without modifying the original data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If stream data updates are written to the same superblock as existing stream data, then data consistency is maintained, but write amplification increases and storage capacity is wasted
Solution Approach 1:
The patent divides the superblock into distinct regions: a first region for storing original stream data and a second region for storing update data. This segmentation allows updates to be written separately without requiring rewriting of the entire superblock, thereby reducing write amplification while maintaining data consistency through logical association of original and update data.
2Reliability
If stream data updates are written to the same superblock as existing stream data, then data consistency is maintained, but storage capacity is wasted
Solution Approach 1:
By segmenting the superblock into first and second regions, the patent enables efficient utilization of storage space. The second region can accommodate update data without displacing original stream data in the first region, eliminating the need to allocate entire superblocks for small updates and thereby reducing stranded capacity.
Solution Approach 2:
The patent introduces a spatial dimension to data storage by creating a hierarchical structure within the superblock. Original stream data resides in the first region while updates are stored in the second region, allowing the system to maintain data consistency through logical relationships rather than physical co-location, thus optimizing storage capacity utilization.
3Productivity
If concurrent writing of multiple data types is performed, then storage efficiency is improved, but data management complexity increases
Solution Approach 1:
The patent applies local quality by assigning specific functions to specific regions: the first region is dedicated to stream data storage while the second region handles update data and non-stream data. This localized functional assignment simplifies data management within each region while enabling concurrent writing operations across regions, thereby improving storage efficiency without proportionally increasing overall complexity.
Data Source
AI summary
In accordance with some embodiments of the present disclosure, a method is performed on a memory storage device for updating data stored in the memory storage device. The method includes writing a first stream data to a first portion of memory, wherein the first stream data includes a plurality of substreams, and writing first additional data to a second portion of memory, wherein the first additional data includes data indicative of an update of at least one substream of the first stream data and is no larger than a substream of the plurality of substreams of the first stream data. Concurrent with writing the first additional data, the method also includes writing second additional data to the second portion of memory, wherein the second additional data includes at least one of data indicative of an update of at least one substream of a second stream data, or non-stream data.