Multi-Layer Data Storage Dynamic Partition Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data storage systems face inefficiencies due to uneven data distribution across partitions, leading to underutilization and saturation issues, as they often receive varying types and rates of data, making it costly and inefficient to pre-allocate storage for all possible data values.
Innovation Solution
A multi-layer data storage system with a system manager, key manager, data managers, and allocation manager that dynamically allocates storage space based on data frequency and capacity, using a key space to assign keys to data subsets and adjust partitions accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If storage space is pre-allocated for all possible data values, then storage capacity is sufficient, but storage cost increases and storage space is inefficiently utilized
Solution Approach 1:
The patent implements dynamic partition adjustment where partition sizes are not fixed but adapt over time based on actual data storage needs. The system continuously monitors data distribution across partitions and automatically reallocates storage space, transforming the static pre-allocation model into a dynamic one that responds to changing data patterns.
Solution Approach 2:
The system employs self-service mechanisms through automated monitoring and reallocation processes. The data storage system autonomously detects partition saturation and under-utilization, then automatically redistributes storage capacity without external intervention, enabling the system to self-optimize its storage efficiency.
2Device complexity
If data storage partitions are fixed, then system complexity is reduced, but adaptability to changing data distribution patterns deteriorates
Solution Approach 1:
The patent incorporates feedback mechanisms where the system continuously monitors data distribution patterns across partitions and uses this information to drive automatic reallocation decisions. The monitoring component tracks data volume and growth patterns, feeding this information back to the reallocation logic which adjusts partition sizes accordingly, creating a closed-loop adaptive system.
Solution Approach 2:
The system performs preliminary actions by pre-establishing monitoring capabilities and reallocation rules before data distribution problems arise. The automated system is prepared in advance to detect saturation and under-utilization conditions, and the reallocation logic is pre-configured to respond appropriately, enabling proactive rather than reactive partition management.
3Productivity
If storage space is dynamically reallocated, then storage efficiency is improved, but system complexity increases
Solution Approach 1:
The system employs self-service mechanisms through automated monitoring and reallocation processes. The data storage system autonomously detects partition saturation and under-utilization, then automatically redistributes storage space without external intervention, enabling the system to self-optimize its storage efficiency.
Solution Approach 2:
The patent implements dynamic partition adjustment where partition sizes are not fixed but adapt over time based on actual data storage needs. The system continuously monitors data distribution across partitions and automatically reallocates storage space, transforming the static pre-allocation model into a dynamic one that responds to changing data patterns.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The disclosed embodiments include data storage systems and methods to store data. In one embodiment, the system includes a storage medium having a plurality of partitions for storing data values of a dataset. The system also includes a system manager operable to receive a data value connected to the system manager and assign a plurality of data subsets of the dataset to the plurality of partitions. The system also includes a key manager operable to assign a key of a key space to each data value of the dataset. The system also includes a top layer data manager and at least one bottom layer data manager, each bottom layer data manager assigned to a data subset. The top layer data manager passes data values to the at least one bottom layer data manager. The system also includes an allocation manager operable to dynamically readjust a storage space of the partition.