File Classification in Distributed Storage Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed file systems face challenges in efficiently managing file storage and rebalancing across storage servers due to changes in configuration, such as adding or removing servers, which can lead to uneven file distribution and require complex rules to identify suitable storage servers based on multiple characteristics.
Innovation Solution
A file classification module that uses a set of rules arranged in an order to identify and migrate files between storage servers, selecting the appropriate server based on characteristics like location and storage type, ensuring balanced distribution during rebalancing operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple rules are used to identify storage servers based on multiple characteristics, then file storage suitability is improved, but system complexity increases
Solution Approach 1:
The patent segments the file classification process into multiple independent rules, where each rule evaluates a specific characteristic (e.g., storage type, location, security requirements). This allows the complex classification task to be divided into manageable, modular rule evaluations that can be processed sequentially, improving reliability through comprehensive checking while maintaining system manageability through modular design.
Solution Approach 2:
The patent changes the approach from evaluating files based on a single complex criterion to evaluating based on multiple independent parameters or characteristics. Each rule checks a specific parameter (storage type, location, security level), and the combination of these parameter evaluations determines the final storage server selection, thereby improving storage suitability through multi-dimensional assessment.
2Stability of the object's composition
If files are redistributed across storage servers during rebalancing, then storage balance is improved, but processing time increases
Solution Approach 1:
The patent applies preliminary action by pre-establishing classification rules and server characteristics before the rebalancing process begins. During rebalancing, files are quickly matched to appropriate servers by evaluating them against these pre-defined rules, rather than performing complex analysis during the migration process itself. This reduces processing time while achieving balanced distribution.
Solution Approach 2:
The patent uses parameter-based classification to enable rapid file-server matching during rebalancing. By evaluating files based on predefined characteristics (storage type, location, security requirements) rather than comprehensive analysis, the system can quickly determine appropriate destination servers, improving processing speed while maintaining balanced storage distribution across the distributed file system.
Data Source
AI summary
A file may be identified and a plurality of rules associated with a plurality of storage servers may be received. An order for the rules may be identified. A particular storage server of the plurality of storage servers that satisfies a condition for each of the rules in view of the order for the rules and a characteristic associated with each of the plurality of storage servers. The file may be stored at the particular storage server that satisfies the condition for each of the rules.