Unlock instant, AI-driven research and patent intelligence for your innovation.

Data distribution method and device based on heterogeneous storage

A data allocation and heterogeneous storage technology, applied in the field of data processing, can solve the problems of no hard disk storage space maximization, no data allocation storage space, increase of data processing volume, etc., to achieve maximum space utilization and optimal access performance Effect

Pending Publication Date: 2021-10-01
ALIBABA GRP HLDG LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Due to the different quantity, performance, and price of different types of hard disks, when there are many hard disks used in the system, the reading and writing pressure on the hard disks will be high, which will lead to a sharp increase in the amount of data to be read and written, and the data processing time will also decrease. Corresponding lengthening, the reason for this situation is that a very important reason is that the data is not reasonably allocated to the storage space of the hard disk, nor is the storage space of the hard disk maximized. Therefore, it is urgent to provide a data allocation method. In order to realize the reasonable allocation of data to the corresponding devices in the storage system, so as to optimize the access performance of the entire storage system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data distribution method and device based on heterogeneous storage
  • Data distribution method and device based on heterogeneous storage
  • Data distribution method and device based on heterogeneous storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the specification. However, this specification can be implemented in many other ways different from those described here, and those skilled in the art can make similar extensions without violating the connotation of this specification, so this specification is not limited by the specific implementations disclosed below.

[0072] Terms used in one or more embodiments of this specification are for the purpose of describing specific embodiments only, and are not intended to limit one or more embodiments of this specification. As used in one or more embodiments of this specification and the appended claims, the singular forms "a", "said" and "the" are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present specification refers t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data distribution method and device based on heterogeneous storage, and the data distribution method based on the heterogeneous storage comprises the steps: obtaining to-be-distributed data, and distributing the to-be-distributed data to a data distribution combination of a storage unit in at least one type of storage cluster according to an access parameter of the storage cluster; calculating the corresponding access overhead of the to-be-distributed data under the data distribution combination, determining a target data distribution combination corresponding to the optimal access overhead according to the access overhead corresponding to the to-be-distributed data, and storing the to-be-distributed data according to a target cluster and a target storage unit recorded in the target data distribution combination; and performing data distribution on the to-be-distributed data.

Description

technical field [0001] The embodiments of this specification relate to the technical field of data processing, and in particular to a data allocation method based on heterogeneous storage. One or more embodiments of this specification also relate to a data distribution device based on heterogeneous storage, a computing device, and a computer-readable storage medium. Background technique [0002] The cloud computing system involves various forms of distributed storage systems. Usually, a heterogeneous storage architecture is used in the distributed storage system. The storage backend is composed of a large number of different types of storage devices, and the hard disk is used as a data storage medium. , which is widely used in the field of cloud computing. [0003] Due to the different quantity, performance, and price of different types of hard disks, when there are many hard disks used in the system, the reading and writing pressure on the hard disks will be greater, which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06
CPCG06F3/0604G06F3/0631G06F3/067G06F3/0685
Inventor 周雁波
Owner ALIBABA GRP HLDG LTD