Distributed data storage method and system

A distributed data and storage system technology, applied in the field of distributed data storage methods and systems, can solve the problems of huge number of files, memory consumption, and small storage space

Active Publication Date: 2013-11-06
SHENZHEN TENCENT COMP SYST CO LTD
View PDF3 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Picture or icon files usually occupy a small amount of storage space for a single file, but the number of files is huge, and corresponding huge index items need to exist in the global index, thus consuming a lot of memory

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data storage method and system
  • Distributed data storage method and system
  • Distributed data storage method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] In one embodiment, such as figure 1 Shown, a kind of distributed data storage method, comprises the following steps:

[0065] Step S102, acquiring a data resource and a data identifier corresponding to the data resource.

[0066] The data resources can be in the form of files, character strings, or data streams. The data identifier can be a string or a number, which is used to distinguish data resources. In one embodiment, the data storage request is obtained first, and the data resource and the data identifier corresponding to the data resource are extracted from the data storage request. In another embodiment, after the data resource is acquired, the data identifier corresponding to the data resource can be calculated according to the data resource.

[0067] For example, in a web application, a file upload request is obtained first, and then the file (data resource) and file name (data identifier) ​​are extracted from the file upload request. When the file is larg...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A distributed data storage method comprises the following steps: acquiring data resources and data identification corresponding to the data resources; calculating the hash value of the data identification; calculating the page numbers of disk pages, corresponding to the data resources, in a memory unit according to the hash value and the block numbers of disk blocks in the disk pages; saving the data resources in the disk blocks of the corresponding disk pages according to the page numbers of the disk pages and the block numbers of the disk blocks. Besides, the invention provides a distributed data storage system. The distributed data storage method and system can reduce depletion of the internal memory and improve the storage efficiency.

Description

【Technical field】 [0001] The invention relates to the field of distributed storage, in particular to a distributed data storage method and system. 【Background technique】 [0002] Distributed storage is to disperse and store data resources on multiple independent devices, and each device is an independent storage unit for storing data. Traditional network storage systems use centralized storage servers to store all data resources. Storage servers become the bottleneck of system performance and the focus of reliability and security, which cannot meet the needs of large-scale storage applications. The distributed storage adopts a scalable system structure, uses multiple storage servers to share the storage load, and uses the location server to locate and store information. It not only improves the reliability, availability and access efficiency of the system, but is also easy to expand. Usually when the amount of data reaches terabytes or even petabytes, data resources are sto...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 李雅卿朱建平程彬
Owner SHENZHEN TENCENT COMP SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap