File storage method and apparatus for distributed cluster system

A distributed cluster and file storage technology, applied in the storage field, can solve the problems of increasing hardware cost and high cost of SSD hard disk, and achieve the effect of improving performance and fast access speed

Inactive Publication Date: 2016-03-23
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF5 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the high cost of SSD hard drives, this method improves performance by increasing hardware costs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File storage method and apparatus for distributed cluster system
  • File storage method and apparatus for distributed cluster system
  • File storage method and apparatus for distributed cluster system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to enable those skilled in the art to better understand the solution of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0041] A flowchart of a specific implementation of the file storage method of the distributed cluster system provided by the present invention is as follows figure 1 As shown, the method includes:

[0042] Step S101: receiving a request from a client to write a file;

[0043] Step S102: Obtain the size of the file to be written, and compare the size value of the file to be written with a preset threshold;

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a file storage method and apparatus for a distributed cluster system. The method comprises: receiving a file writing request of a client; obtaining the size of a to-be-written file and comparing the size of the to-be-written file with a preset threshold; when the size of the to-be-written file is smaller than the preset threshold, distributing a cache of a preset size to the to-be-written file; and writing the to-be-written file into the cache. According to the file storage method and apparatus, the cache with a certain capacity is distributed to small file storage; and the cache is composed of a memory space of a server and the access speed of a memory is relatively high and is much higher than that of any disk media including an SSD, so that the performance of small file storage can be greatly improved through a cache mechanism.

Description

technical field [0001] The invention relates to the field of storage technology, in particular to a file storage method and device of a distributed cluster system. Background technique [0002] At present, distributed cluster storage is becoming more and more popular, and the purpose is to provide large capacity and high performance through high scalability. However, for the storage of small files (below 256K), such as 4K, 8K, 16K, etc., the performance advantage cannot be reflected. [0003] An implementation scheme for improving small files in a distributed cluster storage system in the prior art is: store small files on the SSD by adding SSD hard disks, and use the high speed of SSD hard disks to improve the performance of small files. However, due to the high cost of SSD hard disks, this method improves performance by increasing hardware costs. This goes against the original intention of building a large-scale cluster storage system with cheap hardware. [0004] There...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0611G06F3/0656G06F3/067
Inventor 胡振
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap