Information storage processing method
A processing method and information storage technology, applied in the field of big data storage and processing, can solve problems such as energy waste, disk loss, and performance waste, and achieve the effects of reducing addressing operations, improving storage performance, and avoiding read and write overhead
Inactive Publication Date: 2015-07-08
成都博元时代软件有限公司
View PDF3 Cites 22 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Even considering the additional requirements for bandwidth such as video playback, backup and recovery, there is a serious performance waste when using storage clusters, accompanied by serious energy waste and disk loss. In order to calculate the verification data, data writing requires additional Read and write overhead and latency reduce the throughput of the storage cluster
On the other hand, when the data blocks written to the storage cluster are random, the disk needs to address the new data location. At this time, the performance of random read and write transmission is lower than that of sequential read and write transmission.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0016] The following and accompanying appendices illustrating the principles of the invention Figure 1 A detailed description of one or more embodiments of the invention is provided together. The invention is described in connection with such embodiments, but the invention is not limited to any embodiment. The scope of the invention is limited only by the claims and the invention encompasses numerous alternatives, modifications and equivalents. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. These details are provided for the purpose of example and the invention may be practiced according to the claims without some or all of these specific details.
[0017] One aspect of the present invention provides an information storage processing method to improve the write performance of a storage cluster in sequential data storage. figure 1 is a flowchart of a method according to an embodime...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides an information storage processing method. The information storage processing method comprises the steps that non-sequential read-write request addresses are mapped to a continuous actual address space, write data flush with storage cluster bars are cached and structured in a cache, physical address sequentialization write requests are aggregated or split and are organized in a memory cache area into writing requests flush with the storage cluster bars, and thus the complete bars are covered by the write requests on a storage cluster. The storage method is provided, additional read-writer expenditures caused by generation of verification data are avoided in the disc write-in process, addressing operation is effectively reduced through the sequential write-in of data, and the storage performance is improved.
Description
technical field [0001] The invention relates to network storage, in particular to a method for storing and processing large data. Background technique [0002] In a large-scale storage system, in order to improve the reliability of the storage system, improve IO performance, and meet the storage requirements of massive data, multiple storage clusters are combined to form a unified storage device, such as dispersively storing data on different disks in the cluster The above guarantees parallelism, and adopts the redundancy check mechanism to obtain large capacity and high data transmission rate while ensuring data security. For storage systems that read and write data sequentially, the requirements for data transmission bandwidth are generally not strict, but Higher requirements on data reliability and storage space. Even considering the additional requirements for bandwidth such as video playback, backup and recovery, there is a serious performance waste when using storage ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
Inventor 杨立波
Owner 成都博元时代软件有限公司