Distributed storage system and a heterogeneous acceleration method thereof

A distributed storage and heterogeneous technology, applied in the fields of response error generation, instruments, and electrical digital data processing, etc., can solve the problems of high system performance requirements, consumption of large computing resources, low storage space utilization, etc., to reduce data storage. Capacity, reduce development difficulty, and ensure the effect of system performance

Pending Publication Date: 2019-03-19
SHANDONG CHAOYUE DATA CONTROL ELECTRONICS CO LTD
View PDF6 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to improve the reliability of data, the storage system usually adopts two technologies: one is the copy strategy, which stores multiple data copies, usually requires several times the storage space of the data capacity, and the storage space utilization is low; the other is the erasure code Strategy, redundant encoding of data, data recovery through data redundancy information, high utilization of storage space, but consumes a lot of computing resources, high requirements on system performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage system and a heterogeneous acceleration method thereof
  • Distributed storage system and a heterogeneous acceleration method thereof
  • Distributed storage system and a heterogeneous acceleration method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0032] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are to distinguish two entities with the same name but different parameters or parameters that are not the same, see "first" and "second" It is only for the convenience of expression, and should not be construed as a limitation on the embodiments of the present invention, which will not be described one by one in the subsequent embodiments.

[0033] Based on the above purpose, the first aspect of the embodiments of the present invention proposes an embodiment of a heterogeneous acceleration method for a distributed storage system. figure 1 What is shown is a schematic flowchart of the he...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed storage system heterogeneous acceleration method. The method comprises the steps that a client divides to-be-stored data into blocks and sends the blocks to datanodes; the data node calls the FPGA heterogeneous acceleration unit to input the data block into the data compression unit; the data compression unit compresses the data block and stores the compressed data block in a storage disk. The invention further discloses a distributed storage system. The method and the system can meet the system performance and improve the storage space utilization rate.

Description

technical field [0001] The present invention relates to the technical field of computer data distributed storage, and more specifically, to a distributed storage system and a heterogeneous acceleration method thereof. Background technique [0002] The era of the Internet of Things will generate massive and diverse heterogeneous data, which puts forward higher requirements for the storage capacity and performance of the storage system. Due to the advantages of high scalability and high reliability, the distributed storage system has been widely used in the industry. application. [0003] In order to improve the reliability of data, the storage system usually adopts two technologies: one is the copy strategy, which stores multiple data copies, usually requires several times the storage space of the data capacity, and the storage space utilization is low; the other is the erasure code The strategy is to perform redundant encoding on data and restore data through data redundanc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F11/10G06F13/28
CPCG06F3/061G06F3/0658G06F3/067G06F11/1044G06F13/28
Inventor 彭福来于治楼刘毅枫姚春强
Owner SHANDONG CHAOYUE DATA CONTROL ELECTRONICS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products