Performance improving data processing method in cloud storage system
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A cloud storage system and data processing technology, applied in the field of cloud storage, can solve problems such as access response, poor read and write performance, and inability to cope with the intensive mass storage read and write requirements of multiple customers, so as to shorten the read and write time and improve the overall utilization rate, increase IOPS and bandwidth effects
Inactive Publication Date: 2014-01-22
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF11 Cites 25 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0003] However, most of the cloud storage systems in the existing technology are serial storage methods, and their access response and read
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0044] A data processing method for improving performance in a cloud storage system, comprising a metadata management system, an online data storage system, a near-line data storage system, an offline data storage system, and a client, characterized in that:
[0045] Only the transmission of control signals is performed between the metadata management system and the client, and the storage data stream is not transmitted;
[0046] Storage data stream transmission between the client and the online data storage system;
[0047] Among them, the online data storage system has high efficiency and high cost, and is used to store active data frequently accessed by the system;
[0048] The nearline data storage system has medium efficiency and medium cost, and mainly stores some data that is not active, has access requirements but is not hot;
[0049] The offline data storage system has low cost and low access efficiency. It is mainly used for system archiving and backup, and is used ...
Embodiment 2
[0051] On the basis of Embodiment 1, in this embodiment, during data transmission, data files larger than the threshold are evenly divided into individual data blocks, which are distributed and stored in each online data storage system. Through the control of the data management system, a single data file is guaranteed Files are read and written concurrently.
Embodiment 3
[0053] On the basis of Embodiment 1, the metadata management system in the system of this embodiment automatically tracks the access frequency of data, and the data automatically flows in the online data storage system, near-line data storage system and offline data storage system, and at the same time it will Delete the backup of the upper level, and make a backup of the index in the metadata management system to ensure the utilization of resources and the effectiveness of access.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
PUM
Login to view more
Abstract
The invention relates to the cloud storage field, and discloses a performance improving data processing method in a cloud storage system. The performance improving data processing method relates to a metadata management system, an online data storage system, a near line data storage system, an off-line data storage system and a client terminal. Only control signal transmission is carried out between the metadata management system and the client terminal, storage data flow transmission is not carried out between the metadata management system and the client terminal, and the storage data flow transmission is carried out between the client terminal and the online data storage system. Data are autonomously transmitted among different devices in the cloud storage system so that the devices with different configurations can be effectively used, and the whole use ratio of the cloud storage system is improved. By means of data segmentation, concurrency of data reading and writing is improved, the IOPS and the bandwidth are improved, the reading and writing time is shortened, and the performance is improved. Improvement is carried out on an existing cloud storage system device, the process is completely implemented through software on the basis that hardware accesses are in good conditions, and the implementation and achieving difficulties are small. The performance improving data processing method can be popularized and used on a large data platform.
Description
technical field [0001] The invention relates to the field of cloud storage, in particular to a data processing method for improving access performance in a cloud storage system. technical background [0002] In today's IT management, there is a growing amount of data, more and more cluster applications and cloud storage systems are put into practical use, and there are more and more requirements for multi-user and multi-concurrent access. [0003] However, most of the existing cloud storage systems are serial storage methods, and their access response and read / write performance are gradually deteriorating, which cannot meet the intensive mass storage read / write requirements of multiple customers. [0004] The technical problem to be solved by the present invention is to provide a data processing method for improving performance in a cloud storage system in view of the deficiencies in the prior art. Contents of the invention [0005] The technical problem to be solved ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to view more 
Login to view more