Unlock instant, AI-driven research and patent intelligence for your innovation.

mpCache hybrid storage system based on SSD (Solid State Disk)

A hybrid storage and cache technology, applied in the field of distributed computing, can solve the problems that it is difficult to meet the price of ordinary HDD hard disks and the acceptance of ordinary data centers, and achieve the effects of high IO speed, improved performance, and guaranteed parallelism

Active Publication Date: 2016-07-27
YANGTZE DELTA REGION INST OF TSINGHUA UNIV ZHEJIANG
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the high price of building a pure SSD storage system is still difficult for ordinary data centers to accept. Even considering the downward trend of SSD prices, the price per GB of SSD will still be difficult to reach the price of ordinary HDD hard disks in the near future

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • mpCache hybrid storage system based on SSD (Solid State Disk)
  • mpCache hybrid storage system based on SSD (Solid State Disk)
  • mpCache hybrid storage system based on SSD (Solid State Disk)

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027]Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0028] The following describes the SSD-based mpCache hybrid storage system according to the embodiments of the present invention with reference to the accompanying drawings.

[0029] figure 2 It is a schematic structural diagram of an SSD-based mpCache hybrid storage system according to an embodiment of the present invention.

[0030] Such as figure 2 As shown, the system includes: multiple mpCache slave nodes 100 (shown as mpCache slave node 101 , mpCache slave node 102 and mpCache slave node 103 in the figure) and mpCache ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an mpCache hybrid storage system based on a SSD (Solid State Disk). The mpCache hybrid storage system comprises a plurality of mpCache slave nodes and a mpCache main node, wherein the mpCache slave nodes are used for caching input data; the mpCache main node is used for globally managing and coordinating the plurality of mpCache slave nodes to guarantee that the input data cached in each mpCache slave node complies with the caching rule of All-or-Nothing. The hybrid storage system of the embodiment provides high IO (Input / Output) speed for an IO intensive task, simultaneously guarantees the intensive task parallelism of the memory, improves MapReduce performance, and is simple and easy in implementation.

Description

technical field [0001] The invention relates to the technical field of distributed computing, in particular to an SSD (SolidStateDisk, solid state disk)-based mpCache hybrid storage system. Background technique [0002] MapReduce is a very attractive programming model for processing large-scale data, and it is a distributed computing model that runs in parallel in a high-performance cluster computing environment. [0003] In the MapReduce model, the Map stage reads the original input data and generates a large number of intermediate key-value key-value pairs. These intermediate results are written to the disk at the end of the Map stage. In the Shuffle stage, these intermediate results are read from the disk. It is read in and sent to the node corresponding to the execution of the Reduce subtask. During the execution of the entire task, the temporary data in the buffer will be written to the disk every time the memory cache space is full. In MapReduce, these intermediate r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0631G06F3/064G06F3/0644G06F3/0656G06F3/068
Inventor 姜进磊王博武永卫郑纬民
Owner YANGTZE DELTA REGION INST OF TSINGHUA UNIV ZHEJIANG