Data value-based multi-copy heterogeneous storage method and framework

A heterogeneous storage, multi-copy technology, applied in the direction of input/output to the record carrier, etc., can solve the problem of inaccurate data value, achieve the effect of system performance and cost optimization, and accurate data value

Inactive Publication Date: 2018-01-09
GUANGDONG POWER GRID CO LTD DONGGUAN POWER SUPPLY BUREAU
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, if only the dynamic value of the data is considered, the data value obtained is often inaccurate.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data value-based multi-copy heterogeneous storage method and framework
  • Data value-based multi-copy heterogeneous storage method and framework

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0024] like figure 1 As shown, the architecture mainly includes four modules: data access record module, data value calculation module, monitoring and mapping module, and migration module. The first three modules are in the name server of the distributed file system, forming a heterogeneous The storage controller, the last module in the data server, is an executor.

[0025] The data access record module is mainly responsible for recording the access information of all data in the system. This module is the entry module of heterogeneous storage, which records the access type, number of accesses and time of each access of all data. The data access frequency can be obtained through the data access record module, so the module needs to send the collected relevant information to the data value calculation module, and the information provided by the module is used to calculate the dynamic value Vd of the data.

[0026] The main task of the data value calculation module is to calcu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data value-based multi-copy heterogeneous storage method. The method comprises the steps of obtaining a dynamic value Vd of data according to a data access frequency, defining a static value Vs of the data according to a data type, and defining a subjective value Vu of the data according to a user demand; calculating a total value V (V=wd*Vd+ws*Vs+wu*Vu) of the data, wherein wd is a weight of the dynamic value, ws is a weight of the static value, wu is a weight of the subjective value, and the sum of wd, ws and wu is equal to 1; comparing the total value of the data with preset first and second thresholds, and dividing the data into high-value data, medium-value data and low-value data; and storing all copies of the low-value data in a disk, storing all copies ofthe high-value data in a solid state disk, storing a copy of the medium-value data in the solid state disk, and storing other copies in the disk. Proper storage policies are selected according to different data values, and the copies are stored in different storage mediums, thereby achieving optimization of system performance and cost.

Description

technical field [0001] The present invention relates to a data heterogeneous storage method, in particular to a multi-copy heterogeneous storage method and architecture based on data value. Background technique [0002] In the distributed storage system, in order to ensure the reliability of the data, the data redundancy method is adopted, that is, the method of storing multiple copies of one data. The number of copies is 3 by default, but for the storage location of the copies, SSD is selected. Or disk storage, the system is randomly selected, so it does not fully consider the characteristics of different storage media, and cannot take advantage of the advantages of heterogeneous storage, so it has a great impact on the storage performance of the system. Although the performance of SSD is largely better than that of disk, it does not mean that SSD can replace disk, because SSD has the characteristic of erasing before writing, that is, the data written to SSD cannot be direc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
Inventor 李晖李惠娟温兆聪吴俊敏
Owner GUANGDONG POWER GRID CO LTD DONGGUAN POWER SUPPLY BUREAU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap