Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Performance improving data processing method in cloud storage system

A cloud storage system and data processing technology, applied in the field of cloud storage, can solve problems such as access response, poor read and write performance, and inability to cope with the intensive mass storage read and write requirements of multiple customers, so as to shorten the read and write time and improve the overall utilization rate, increase IOPS and bandwidth effects

Inactive Publication Date: 2014-01-22
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF11 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, most of the cloud storage systems in the existing technology are serial storage methods, and their access response and read / write performance are gradually deteriorating, which cannot meet the intensive mass storage read / write requirements of multiple customers.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Performance improving data processing method in cloud storage system
  • Performance improving data processing method in cloud storage system
  • Performance improving data processing method in cloud storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] A data processing method for improving performance in a cloud storage system, comprising a metadata management system, an online data storage system, a near-line data storage system, an offline data storage system, and a client, characterized in that:

[0045] Only the transmission of control signals is performed between the metadata management system and the client, and the storage data stream is not transmitted;

[0046] Storage data stream transmission between the client and the online data storage system;

[0047] Among them, the online data storage system has high efficiency and high cost, and is used to store active data frequently accessed by the system;

[0048] The nearline data storage system has medium efficiency and medium cost, and mainly stores some data that is not active, has access requirements but is not hot;

[0049] The offline data storage system has low cost and low access efficiency. It is mainly used for system archiving and backup, and is used ...

Embodiment 2

[0051] On the basis of Embodiment 1, in this embodiment, during data transmission, data files larger than the threshold are evenly divided into individual data blocks, which are distributed and stored in each online data storage system. Through the control of the data management system, a single data file is guaranteed Files are read and written concurrently.

Embodiment 3

[0053] On the basis of Embodiment 1, the metadata management system in the system of this embodiment automatically tracks the access frequency of data, and the data automatically flows in the online data storage system, near-line data storage system and offline data storage system, and at the same time it will Delete the backup of the upper level, and make a backup of the index in the metadata management system to ensure the utilization of resources and the effectiveness of access.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the cloud storage field, and discloses a performance improving data processing method in a cloud storage system. The performance improving data processing method relates to a metadata management system, an online data storage system, a near line data storage system, an off-line data storage system and a client terminal. Only control signal transmission is carried out between the metadata management system and the client terminal, storage data flow transmission is not carried out between the metadata management system and the client terminal, and the storage data flow transmission is carried out between the client terminal and the online data storage system. Data are autonomously transmitted among different devices in the cloud storage system so that the devices with different configurations can be effectively used, and the whole use ratio of the cloud storage system is improved. By means of data segmentation, concurrency of data reading and writing is improved, the IOPS and the bandwidth are improved, the reading and writing time is shortened, and the performance is improved. Improvement is carried out on an existing cloud storage system device, the process is completely implemented through software on the basis that hardware accesses are in good conditions, and the implementation and achieving difficulties are small. The performance improving data processing method can be popularized and used on a large data platform.

Description

technical field [0001] The invention relates to the field of cloud storage, in particular to a data processing method for improving access performance in a cloud storage system. technical background [0002] In today's IT management, there is a growing amount of data, more and more cluster applications and cloud storage systems are put into practical use, and there are more and more requirements for multi-user and multi-concurrent access. [0003] However, most of the existing cloud storage systems are serial storage methods, and their access response and read / write performance are gradually deteriorating, which cannot meet the intensive mass storage read / write requirements of multiple customers. [0004] The technical problem to be solved by the present invention is to provide a data processing method for improving performance in a cloud storage system in view of the deficiencies in the prior art. Contents of the invention [0005] The technical problem to be solved ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30G06F3/06
CPCG06F3/067H04L67/1097
Inventor 刘刚
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com