A file equalization method for an IDFS

An equalization method and file technology, applied in special data processing applications, instruments, electrical digital data processing, etc., can solve the problem of no available storage in old servers, achieve balanced transfer, precise control of balanced frequency and balanced speed, and reduce work volume effect

Inactive Publication Date: 2018-12-11
SHANDONG INSPUR COMML SYST CO LTD
View PDF12 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This will eventually lead to the old server running out of storage when the new server has a lot of free space

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] A file balancing method for IDFS, which is realized by a file index classification module, a file transfer module, a file index search module, a file performance monitoring and task delivery module, and a configuration list optimized for HLS live video on demand;

[0029] The file index classification module is used to classify the stored content; the file index classification module classifies three different files of on-demand, live broadcast and ordinary files. The on-demand broadcast is a file that is almost permanently saved once written and occupies a relatively high proportion of storage capacity; the live broadcast is a file that has been written with a large number of files and has a limited storage time and occupies the highest proportion; the ordinary file is Files whose storage time is between on-demand and live broadcast and occupy the least proportion. The on-demand files are balanced to all servers by the old server, and relatively new files are processed...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a file equalization method for an IDFS. The method is realized by a file index classification module, a file transfer module, a file index search module, a file performance monitoring and task distribution module, and a configuration list of HLS live broadcast on-demand video optimization. The file index classification module is used for classifying and sorting the stored contents. The file transfer module realizes balanced file transfer without stopping the service. The file index searching module realizes the update of the file index on the premise that the file indexcan be cached, and at the same time, the file index searching module does not cause the fault that the file cannot be found. The file performance monitoring and task distribution module realizes storage equalization under the condition that the influence on the performance of the existing network system is reduced as little as possible. The configuration list of the HLS live on-demand video optimization realizes accurate control of the equalization frequency and the equalization speed. The method of the invention can realize the equalization of each storage capacity to the maximum extent andrealize the equalization transfer of files.

Description

technical field [0001] The invention relates to the fields of file indexing, file synchronization, and storage capacity balancing, in particular to a file balancing method for IDFS. Background technique [0002] IDFS is a distributed storage system for a large number of small files such as HLS and posters, and uses MongoDB to store index data. For a video, it can be evenly distributed and stored in all available disks of all available servers, so that uploading and downloading any movie can utilize all disk performance of all servers. At the same time, IDFS supports dynamic expansion, which can easily increase the number of servers or disks to increase the total storage capacity. [0003] However, in the process of dynamic expansion, the available capacity of the new server is greater than that of the original server. When injecting new files, due to the uniform storage strategy, the capacity growth rate of the new and old servers is the same. This would eventually lead to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 刘凯谢恩鹏
Owner SHANDONG INSPUR COMML SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap