File storage method and system for distributed file system
A distributed file and system storage technology, applied in the field of distributed file systems, can solve the problems of wasting disk space, reducing the performance of distributed file systems, and data objects occupying large stripes, so as to avoid waste, improve performance and Adaptability and the effect of increasing availability
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0046] Example 1 as image 3 As shown, its specific implementation is as follows:
[0047] The function of adaptively adjusting stripes provided by the present invention includes three module groups: a file attribute parameter collector, an adaptive strategy engine and a strategy executor. Through the mutual cooperation of these three modules, the step of adaptively and dynamically adjusting the strips is jointly realized. The specific implementation steps are as follows:
[0048] The file attribute parameter collector is responsible for collecting various attribute parameters of the file during the process of writing the file into the distributed file system, such as block size, proportion of reading and writing, frequency of reading and writing, file name and other attribute parameters. Then the file attribute parameter collector organically saves these attribute parameters as the input of the subsequent adaptive policy engine. When collecting file attribute parameters, t...
Embodiment 2
[0054] Periodically collect file attribute parameters, or dynamically collect file attribute parameters on demand. Statistical file characteristics based on file attribute parameters. The specific characteristics include at least, within a fixed time period T, the characteristics of all files written into the folder. The characteristics here include file size, file read and write frequency, and file type. Wait.
[0055] Input the feature data collected within T time into the strategy engine generator. The strategy engine generator generates predicted adjustment strategies based on these data. The policy engine generator generates adjustment policies according to specified conditions. The specified condition at least includes: the frequency and size of the file written within T time conform to the specified characteristics. For example, the writing frequency of 1M files reaches more than 80%.
[0056] After the policy engine generator generates the adjustment policy, it com...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com