Data distribution method and device based on heterogeneous storage

A data allocation and heterogeneous storage technology, applied in the field of data processing, can solve the problems of no hard disk storage space maximization, no data allocation storage space, increase of data processing volume, etc., to achieve maximum space utilization and optimal access performance Effect

Pending Publication Date: 2021-10-01
ALIBABA GRP HLDG LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Due to the different quantity, performance, and price of different types of hard disks, when there are many hard disks used in the system, the reading and writing pressure on the hard disks will be high, which will lead to a sharp increase in the amount of data to be read and written, and the data processing time will also decrease. Corresponding lengthening, the reason for this situation is

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data distribution method and device based on heterogeneous storage
  • Data distribution method and device based on heterogeneous storage
  • Data distribution method and device based on heterogeneous storage

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0071] Numerous specific details are set forth in the following description in order to provide a thorough understanding of the present specification. However, the specification can be in many other ways than to the embodiments described herein, those skilled in the art can make similar extensions without departing from the content of the present specification, the present specification is not limited to the specific embodiments disclosed below.

[0072] In the present specification, a term or terms used in the embodiments are merely for the purpose of describing particular embodiments, and not intended to limit the specification, embodiments of one or more embodiments. In one or more embodiments of the present specification and appended claims, the singular forms embodiment used in the book "a", "said" and "the" are intended to include the plural forms unless the context clearly dictates otherwise. It should also be appreciated that the present specification one or more terms use...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data distribution method and device based on heterogeneous storage, and the data distribution method based on the heterogeneous storage comprises the steps: obtaining to-be-distributed data, and distributing the to-be-distributed data to a data distribution combination of a storage unit in at least one type of storage cluster according to an access parameter of the storage cluster; calculating the corresponding access overhead of the to-be-distributed data under the data distribution combination, determining a target data distribution combination corresponding to the optimal access overhead according to the access overhead corresponding to the to-be-distributed data, and storing the to-be-distributed data according to a target cluster and a target storage unit recorded in the target data distribution combination; and performing data distribution on the to-be-distributed data.

Description

technical field [0001] The embodiments of this specification relate to the technical field of data processing, and in particular to a data allocation method based on heterogeneous storage. One or more embodiments of this specification also relate to a data distribution device based on heterogeneous storage, a computing device, and a computer-readable storage medium. Background technique [0002] The cloud computing system involves various forms of distributed storage systems. Usually, a heterogeneous storage architecture is used in the distributed storage system. The storage backend is composed of a large number of different types of storage devices, and the hard disk is used as a data storage medium. , which is widely used in the field of cloud computing. [0003] Due to the different quantity, performance, and price of different types of hard disks, when there are many hard disks used in the system, the reading and writing pressure on the hard disks will be greater, which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/0604G06F3/0631G06F3/067G06F3/0685
Inventor 周雁波
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products