Container Merging for File System Storage Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional file systems suffer from internal block fragmentation, leading to inefficient use of storage space and increased metadata overhead when storing large numbers of small data objects, as each object is stored in a separate container, resulting in wasted space and increased directory lookup stress.
Innovation Solution
The method involves packing multiple data objects into a single container, using a containerization approach that divides file system blocks into smaller extents, allowing for efficient storage and metadata management, and enabling the merging of containers to reduce unused space and metadata overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If each data object is stored in a separate container, then data organization and access are simplified, but storage space efficiency deteriorates due to internal block fragmentation
Solution Approach 1:
The patent merges multiple data objects into a single container, combining what were previously separate storage units. This allows the system to maintain simple access patterns while improving storage efficiency by consolidating data that would otherwise be fragmented across multiple containers with wasted space.
Solution Approach 2:
The patent segments the container into multiple extents, dividing the container's storage space into smaller units that can be efficiently allocated to multiple data objects. This segmentation enables fine-grained space management while maintaining the benefits of containerized storage.
2Reliability
If each data object is stored in a separate container, then data integrity is maintained, but metadata overhead increases
Solution Approach 1:
The patent combines multiple data objects into a single container, thereby consolidating the metadata that would otherwise be duplicated across multiple separate containers. This reduces the total metadata overhead while maintaining data integrity through the container's internal structure and extent management.
3Adaptability or versatility
If conventional file systems are used, then compatibility is maintained, but storage efficiency deteriorates due to internal block fragmentation
Solution Approach 1:
The patent implements a containerization layer that nests within the existing file system structure. This nested container extends the file system's functionality by providing multi-object storage capabilities while maintaining compatibility with the underlying file system's block structure and access methods.
Solution Approach 2:
The patent segments the file system's block structure into extents within the container, creating a hierarchical organization that allows efficient allocation of space to multiple data objects while preserving the file system's native block-based operation and compatibility.
Data Source
AI summary
An apparatus and method for merging the data of a first container and a second container into a target container that includes at least one block having a plurality of extents to store data objects. The apparatus may include a storage sever coupled to a plurality of storage devices. The storage server is configured to merge multiple data objects of the plurality of containers that store a data object per each container into a target container that stores multiple data objects within the target container.