Rapid data memory method for improving concurrent visiting performance in cloud memory system

A cloud storage system and access performance technology, applied in transmission systems, electrical components, etc., can solve the problems of being unable to cope with the intensive mass storage read and write requirements of multiple customers, and achieve the effect of improving high-speed concurrent access performance and high-performance storage support

Active Publication Date: 2013-01-16
NANJING YUNCHUANG LARGE DATA TECH CO LTD
View PDF4 Cites 77 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The existing cloud platform storage is a serial storage method, which cannot meet the intensive mass storage read and write requirements of multiple customers

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rapid data memory method for improving concurrent visiting performance in cloud memory system
  • Rapid data memory method for improving concurrent visiting performance in cloud memory system
  • Rapid data memory method for improving concurrent visiting performance in cloud memory system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0058] The specific implementation is as image 3 As shown, cloud storage is composed of primary and secondary metadata servers, multiple data storage servers, and several access clients. The client read and write process is implemented as follows.

[0059] When the client writes data, the data is divided into blocks, and the blocks can be divided into different sizes. The block size 64M is used for illustration below. When writing data, the request includes fields such as offset (the offset relative to the starting position of the file), size (the size of the currently written data) and data (the actual data currently requested), and the client calculates the block index, block number, and internal offset of the block. The displacement, the calculation process is as follows:

[0060] 1) Get the total number of blocks to be read according to chnum = offset>>26, and start multiple subsequent write data block threads to read the requested data block in parallel according to the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a rapid data memory method for improving concurrent visiting performance in a cloud memory system. The cloud memory system comprises a metadata server, data memory servers and clients, wherein only control signals are transmitted between the metadata server and the clients, and memory data flow is not transmitted between the metadata server and the clients; the memory data flow is transmitted between the clients and the memory servers; a data file which is bigger than a threshold value is uniformly divided into various data blocks which are stored on each data memory server in a distributed way; and single data file can be concurrently read and written.

Description

technical field [0001] The invention relates to the technical field of computer software for a cloud computing platform, in particular to a fast data storage method for improving concurrent access performance in a cloud storage system. Background technique [0002] Modern computers play a very important role in social life. With the development of information technology, more and more cluster application systems are put into use, and different users need to realize unified storage and resource sharing. This poses a challenge to data storage systems. New requirements have been imposed. Different users may access the same data at the same time. A mechanism for sharing and coordinating data reading and writing concurrency and network traffic is explored. It is of great significance for modern large-scale clusters to meet the multi-user and high-concurrency access requirements. important practical significance. [0003] The cloud platform storage in the prior art is a serial st...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
Inventor 张真刘志明赵庆福蒋文佼袁高峰
Owner NANJING YUNCHUANG LARGE DATA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products