Delegated Data Ownership Segments for Storage Bottlenecks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Large files in storage systems often create bottlenecks by tying up resources, leading to delays in accessing other files, especially during transfer or backup, particularly in distributed storage systems where frequent appending occurs.
Innovation Solution
A processor-based method that writes data and metadata of a file into multiple segments controlled by different authorities, allowing delegation of ownership for each range of the file, ensuring data and metadata are closely located for efficient access and reducing bottlenecks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single authority controls all segments of a large file, then data management is simplified, but system bottlenecks occur and access delays increase
Solution Approach 1:
The patent divides a large file into multiple segments, each controlled by a different authority. This segmentation allows parallel processing of different file portions, eliminating the single-point bottleneck while maintaining organized data management through distributed authority control.
2Adaptability or versatility
If data and metadata are stored separately, then storage flexibility increases, but access efficiency decreases due to distant locations
Solution Approach 1:
The patent combines data and its associated metadata into the same storage segment, ensuring they are located closely together. This merging maintains storage flexibility through the segment architecture while dramatically improving access efficiency by eliminating the need to retrieve distant metadata separately.
3Reliability
If frequent appending occurs to large files, then data completeness is maintained, but system resources are tied up and performance degrades
Solution Approach 1:
By segmenting large files and distributing them across multiple authorities, the patent enables parallel appending operations on different segments. This maintains data completeness while preventing resource exhaustion, as multiple authorities can process append operations simultaneously rather than queuing behind a single processing point.
Data Source
AI summary
A processor-based method for locating data and metadata closely together in a storage system is provided. The method includes writing a first range of a file and a first metadata relating to attributes of the file into at least one segment controlled by a first authority of the file. The method includes delegating, by the first authority, a second authority for a second range of the file, and writing the second range of the file and second metadata relating to the attributes of the file into at least one segment controlled by the second authority.