A copy management method of marine monitoring data based on multi-attribute optimization

Abstract

The invention relates to a marine monitoring data copy management method based on multi-attribute optimization. The method comprises the steps that 1, marine monitoring big data is input; 2, marine monitoring big data copies are created; 3, a machine frame for containing nodes is selected; 4, a storage space of the nodes is judged; 5, a node attribute evaluation matrix is established, and the matrix is processed; 6, a weighting matrix of node key attributes is established, and the optimal solution and the worst solution are determined; 7, the relative close degrees of all the nodes to the optimal solution are calculated, and the node with the smallest close degree is selected; 8, a copy layout scheme of the marine monitoring big data is output. The method has the advantages that the data is efficiently distributed in a cloud environment, the copies are reserved as few as possible on the premise that the data reliability is guaranteed, and unnecessary waste of the storage space is reduced; the ever-changing access heat of each piece of data can be obtained; the time for creating or deleting the copies in a copy dynamic mode can be judged; network delay is reduced, and the overall stability of the system is improved.

Description

technical field [0001] The invention relates to the technical field of data monitoring, in particular to a method for managing copies of marine monitoring data based on multi-attribute optimization. Background technique [0002] With the rapid development of ocean observation and forecasting technology and the explosive growth of related data, the development of ocean big data is becoming one of the important applications of scientific big data. Ocean big data mainly includes radar and satellite observation data, numerical prediction model results, and forecast products. According to previous studies on the amount of ocean data, the total amount of global ocean data in 2014 was about 25PB, and it is expected that the total amount of global ocean data will reach 275PB in 2030. In order to better adapt to the processing and analysis of real-time big data of marine monitoring, it is necessary to adopt the distributed storage mode in the cloud environment. However, in the comp...

AI Technical Summary

Problems solved by technology

2) Limit the number of copies created recently by each data server

For the cloud environment for storing marine big data, it has the characteristics of a large number of storage nodes, complex and changeable users, and large differences in node performance. In view of these characteristics, it is necessary to study how to efficiently distribute data objects to the cloud environment to ensure data reliability. It is a challenging problem to reduce unnecessary waste of storage space by keeping as few backups as possible under the premise of security.

[0010] Therefore, there is an urgent need for a method that can efficiently distribute data objects to the cloud environment, retain as few backups as possible while ensuring data reliability, reduce unnecessary waste of storage space, and dynamically change the number of copies according to the number of copies accessed. copy management method, but there is no report on this method

Images