A data migration management system based on Internet access service

By analyzing the characteristics of the migrated objects in the data migration management system, determining their storage methods, and setting corresponding storage device performance requirements, the problem of low rationality of data migration storage in the existing technology is solved, and the efficiency and rationality of data migration are improved.

CN115203161BActive Publication Date: 2025-04-25SHANGHAI DEZAI INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210551630.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-18
Publication Date
2025-04-25
Estimated Expiration
2042-05-18

AI Technical Summary

Technical Problem

In the prior art, the corresponding migration data cannot be stored in different ways through data analysis during data migration, resulting in a reduction in the rationality of data migration storage and the efficiency of data migration cannot be guaranteed.

Method used

It is determined by analyzing the storage methods after migrating the migrated objects, including online storage, near-line storage and offline storage, and setting the performance requirements of the corresponding storage devices according to different storage methods.

Benefits of technology

It improves the operation efficiency of data migration, enhances the rationality of data migration storage, prevents the reduction in efficiency caused by data storage abnormalities, and reduces storage costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115203161B_ABST
    Figure CN115203161B_ABST
Patent Text Reader

Abstract

The present invention discloses a data migration management system based on Internet access service, relates to the technical field of data migration management, solves the technical problem in the prior art that corresponding migration data cannot be stored in different ways through data analysis during data migration, determines the storage mode of the migration object after the migration is completed through analysis, and the storage mode includes online storage, near-line storage and offline storage; it is beneficial to improve the operation efficiency of data migration, enhance the rationality of data migration storage, prevent data migration efficiency from being reduced due to abnormal data storage during data migration, and cause unnecessary waste of storage cost of data migration; performs operation analysis on the storage device of the migration object, judges whether the storage device operates normally when storing the migration object, and prevents the imbalance of resource use of the storage device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data migration management, and in particular to a data migration management system based on Internet access services. Background Art

[0002] From the perspective of information resources, the Internet is an information resource network that integrates information resources from various departments and fields and is shared by network users. Internet access is a high-bandwidth, high-speed physical connection between users and IP WANs through a specific transmission channel for information collection and sharing, using the following transmission technologies; data migration is also known as hierarchical storage management; it is a technology that integrates offline storage with online storage. It uses high-speed, high-capacity non-online storage devices as the next-level devices of disk devices, and then automatically migrates commonly used data on the disk to secondary large-capacity storage devices such as tape libraries (referred to as tape libraries) according to specified policies. When these data need to be used, the hierarchical storage system will automatically transfer these data from the next-level storage device back to the previous-level disk.

[0003] However, in the prior art, it is impossible to store the corresponding migration data in different ways through data analysis during the data migration process, that is, it is impossible to set different performance requirements for the corresponding storage devices; as a result, the rationality of data migration storage is reduced and the efficiency of data migration cannot be guaranteed.

[0004] In view of the above technical defects, a solution is now proposed. Summary of the invention

[0005] The purpose of the present invention is to solve the above-mentioned problems and to propose a data migration management system based on Internet access service. The storage mode of the migration object after migration is determined by analysis, and the storage mode includes online storage, near-line storage and offline storage. It is beneficial to improve the operating efficiency of data migration, enhance the rationality of data migration storage, prevent data storage anomalies during data migration from reducing data migration efficiency, and cause unnecessary waste of data migration storage costs.

[0006] The purpose of the present invention can be achieved through the following technical solutions:

[0007] A data migration management system based on Internet access service, comprising a server, wherein the server comprises:

[0008] The server collects the operation data of the Internet access service and marks it as a migration object; wherein the operation data is represented as text and pictures of the Internet access service;

[0009] The data migration classification unit is used to analyze the migration object and determine the storage method of the migration object after the migration is completed through analysis. The storage method includes online storage, near-line storage and offline storage. After the storage method is determined, the storage method of the migration object and the performance requirements of the corresponding storage device are sent to the server;

[0010] The storage device analysis unit is used to perform operation analysis on the storage device of the migration object to determine whether the storage device operates normally when storing the migration object; generate a device usage analysis qualified signal and a device usage analysis unqualified signal through the operation analysis of the storage device, and send them to the server;

[0011] A stability analysis unit is used to analyze data access and transmission during the migration process of the migration object, determine whether the stability of the data migration is qualified, generate a stability abnormality signal and a stability normal signal through analysis, and send them to the server;

[0012] The migration efficiency analysis unit is used to analyze the operating status of the migration object after completing the data migration. By analyzing the impact analysis after the data migration, it can reflect the effect of the migration object on the data migration. It also generates efficiency analysis abnormal signals and efficiency analysis normal signals through operating status analysis and sends them to the server.

[0013] As a preferred embodiment of the present invention, the operation process of the data migration category classification unit is as follows:

[0014] Analyze the migration objects by category and match the storage method appropriately after category analysis; collect the shortest required access interval and the average required access speed of the migration objects, and compare them with the duration threshold and the required speed threshold respectively:

[0015] If the shortest required access interval of the migration object does not exceed the duration threshold, and the average required access speed of the migration object exceeds the required speed threshold, it is determined that the data storage mode of the migration object is set to online storage, and the data storage device for online storage of the migration object is set, that is, the performance requirements of the storage device for online storage are: the interval time for receiving accesses and the average transmission speed of the storage device both meet the requirements of the migration object for online storage; if the shortest required access interval of the migration object exceeds the duration threshold, or the average required access speed of the migration object does not exceed the required speed threshold, it is determined that the data storage mode of the migration object is set to non-online storage;

[0016] The access frequency and average access data volume of the migration object are collected and compared with the access frequency threshold and access data volume threshold respectively:

[0017] If the access frequency of the migration object does not exceed the access frequency threshold, and the average access data volume of the migration object does not exceed the access data volume threshold, the storage mode of the corresponding migration object is set to near-line storage, that is, the storage device performance requirements of near-line storage are: the corresponding addressing speed exceeds the corresponding addressing speed threshold, and the transmission rate exceeds the corresponding transmission rate threshold; if the access frequency of the migration object exceeds the access frequency threshold, or the average access data volume of the migration object exceeds the access data volume threshold, the storage mode of the corresponding migration object is set to non-near-line storage;

[0018] Collect the number of users who are granted access rights to the migration object and the estimated repair time after data loss occurs on the migration object, and compare them with the user number threshold and repair time threshold respectively:

[0019] If the number of users who are granted access rights to the migration object exceeds the user number threshold, or the estimated repair time after data loss in the migration object does not exceed the repair time threshold, the storage mode of the corresponding migration object will be set to offline storage, that is, the migration object data will be backed up when the Internet is offline; the performance requirements of the storage device for offline storage are: the data transmission speed of the storage device does not exceed the corresponding data transmission speed threshold, and the average single data transmission volume is a fixed value; if the number of users who are granted access rights to the migration object does not exceed the user number threshold, and the estimated repair time after data loss in the migration object exceeds the repair time threshold, the storage mode of the corresponding migration object will be set to non-offline storage.

[0020] As a preferred implementation of the present invention, the operation process of the storage device analysis unit is as follows:

[0021] The storage device is labeled i, where i is a natural number greater than 1. The maximum data storage capacity difference of the storage device and the maximum frequency difference of the storage device performing data storage during the storage of the migration object are collected and marked as CLCi and PCZi respectively; the corresponding utilization rate of the storage device put into use during the storage of the migration object is collected and marked as LYLi;

[0022] The analysis coefficient Xi of the storage device during the storage of the migration object is obtained through analysis, and the analysis coefficient Xi of the storage device during the storage of the migration object is compared with the analysis coefficient threshold:

[0023] If the analysis coefficient Xi of the storage device exceeds the analysis coefficient threshold during the storage of the migration object, the corresponding storage device analysis is judged to be qualified, a device usage analysis qualified signal is generated and the device usage analysis qualified signal is sent to the server; if the analysis coefficient Xi of the storage device does not exceed the analysis coefficient threshold during the storage of the migration object, the corresponding storage device analysis is judged to be unqualified, a device usage analysis unqualified signal is generated and the device usage analysis unqualified signal is sent to the server.

[0024] As a preferred embodiment of the present invention, the operation process of the stability analysis unit is as follows:

[0025] The delay value corresponding to the buffer time when the migration object is accessed during the data migration process and the floating value of the transmission rate corresponding to the data transmission of the migration object are collected, and they are marked as the buffer time delay value and the transmission rate floating value, respectively. The buffer time delay value and the transmission rate floating value are compared with the delay value threshold and the floating value threshold respectively:

[0026] If the buffer time delay value exceeds the delay value threshold, or the transmission rate floating value exceeds the floating value threshold, the corresponding data migration stability analysis is judged to be unqualified, a stability abnormality signal is generated and the stability abnormality signal is sent to the server; if the buffer time delay value does not exceed the delay value threshold, and the transmission rate floating value does not exceed the floating value threshold, the corresponding data migration stability analysis is judged to be qualified, a stability normal signal is generated and the stability normal signal is sent to the server.

[0027] As a preferred embodiment of the present invention, the operation process of the migration efficiency analysis unit is as follows:

[0028] The time when the migration object completes data migration is taken as the starting point. An efficiency analysis time period is established according to the current time point of the system. The average query time of the migration object data and the number of missing migration object data in the efficiency analysis time period are collected and compared with the average query time threshold and missing number threshold respectively:

[0029] If the average query time of the migration object data in the efficiency analysis time period exceeds the average query time threshold, or the number of missing migration object data exceeds the missing number threshold, the data migration of the migration object is determined to be unqualified, an efficiency analysis abnormality signal is generated and sent to the server;

[0030] If the average query time of the migration object data within the efficiency analysis time period does not exceed the average query time threshold, and the number of missing migration object data does not exceed the missing number threshold, the data migration of the migration object is determined to be qualified, and a normal efficiency analysis signal is generated and sent to the server.

[0031] Compared with the prior art, the present invention has the following beneficial effects:

[0032] 1. In the present invention, the storage mode of the migration object after the migration is completed is determined by analyzing, and the storage mode includes online storage, near-line storage and offline storage; it is beneficial to improve the operation efficiency of data migration, enhance the rationality of data migration storage, and prevent data storage abnormalities during data migration from reducing the data migration efficiency, while causing unnecessary waste of data migration storage costs; the storage device of the migration object is analyzed for operation to determine whether the storage device operates normally when storing the migration object, to prevent the uneven use of storage device resources, resulting in a reduction in the life of some storage devices and a waste of investment costs of some storage devices, resulting in a reduction in the storage efficiency of the migration object data storage device;

[0033] 2. In the present invention, the data access and transmission during the migration process of the migration object are analyzed, so as to analyze the stability of the data migration, thereby improving the monitoring of the data migration and preventing the data access and transmission of the Internet access service from being affected during the data migration process, resulting in reduced efficiency of the Internet access service, and indirectly causing reduced work efficiency of the data migration; the running status of the migration object after completing the data migration is analyzed, and the impact analysis after the data migration is analyzed to indirectly reflect the effect of the data migration of the migration object, thereby reflecting the work efficiency of the data migration of the migration object; in addition, it is also beneficial to improve the qualification of the server to control the migration object to perform data migration. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to facilitate understanding by those skilled in the art, the present invention is further described below with reference to the accompanying drawings.

[0035] Figure 1 The present invention is a principle block diagram of a data migration management system based on Internet access service. DETAILED DESCRIPTION

[0036] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0037] See also Figure 1 As shown, a data migration management system based on Internet access service includes a server, the server is communicatively connected with a data migration category classification unit, a storage device analysis unit, a stability analysis unit and a migration efficiency analysis unit, wherein the server is bidirectionally connected with the data migration category classification unit, the storage device analysis unit, the stability analysis unit and the migration efficiency analysis unit;

[0038] It is understandable that the server, as the hub of signal transmission in this system, processes the signals existing in the system operation process in real time so as to meet the management strength of data migration; data migration is the archiving process of moving rarely used or unused files to auxiliary storage systems (such as tapes or optical disks). These files are usually image documents or historical information that need to be easily accessed at any time in the future. Migration work is combined with backup strategies, and regular backups are still required. It also includes computer data migration, migrating data, applications, personalized settings, etc. from old computers (old systems) to new computers (new systems), which is very necessary after system upgrades.

[0039] The Internet access service needs to perform data migration during operation, and when performing data migration, the server collects the operation data of the Internet access service and marks it as a migration object, wherein the operation data is represented as data in the form of text, pictures, etc.;

[0040] The server generates a data migration classification signal and sends the data migration classification signal to the data migration type classification unit. After receiving the data migration classification signal, the data migration classification unit analyzes the migration object and determines the storage method after the migration is completed through analysis. The storage method includes online storage, near-line storage and offline storage. This is conducive to improving the operation efficiency of data migration, enhancing the rationality of data migration storage, preventing data storage anomalies during data migration from reducing data migration efficiency, and causing unnecessary waste of data migration storage costs.

[0041] Analyze the migration objects by category and reasonably match the storage method after category analysis; collect the shortest required access interval and the average required access speed of the migration objects, and compare the shortest required access interval and the average required access speed of the migration objects with the duration threshold and the required speed threshold respectively:

[0042] If the shortest required access interval of the migration object does not exceed the duration threshold, and the average required access speed of the migration object exceeds the required speed threshold, it is determined that the data storage mode of the migration object is set to online storage, and the data storage device for online storage of the migration object is set, that is, the performance requirements of the storage device for online storage are: the interval time for receiving accesses and the average transmission speed of the storage device both meet the requirements of the migration object for online storage; that is, the access interval time and the average transmission speed of the storage device are both within the corresponding threshold range;

[0043] If the shortest required access interval of the migration object exceeds the duration threshold, or the average required access speed of the migration object does not exceed the required speed threshold, it is determined that the data storage mode of the migration object is set to non-online storage;

[0044] The access frequency of the migration object and the average access data volume of the migration object are collected, and the access frequency of the migration object and the average access data volume of the migration object are compared with the access frequency threshold and the access data volume threshold respectively:

[0045] If the access frequency of the migration object does not exceed the access frequency threshold, and the average access data volume of the migration object does not exceed the access data volume threshold, the storage mode of the corresponding migration object is set to near-line storage, that is, the storage device performance requirements of near-line storage are: the corresponding addressing speed exceeds the corresponding addressing speed threshold, and the transmission rate exceeds the corresponding transmission rate threshold; if the access frequency of the migration object exceeds the access frequency threshold, or the average access data volume of the migration object exceeds the access data volume threshold, the storage mode of the corresponding migration object is set to non-near-line storage; it can be understood that near-line storage means that the migration object is not frequently used or has a small access volume;

[0046] The number of users granted access rights to the migration object and the estimated repair time after data loss occurs on the migration object are collected, and the number of users granted access rights to the migration object and the estimated repair time after data loss occurs on the migration object are compared with the user number threshold and the repair time threshold respectively:

[0047] If the number of users granted access rights to the migration object exceeds the user number threshold, or the estimated repair time after data loss of the migration object does not exceed the repair time threshold, the storage mode of the corresponding migration object is set to offline storage, that is, the migration object data is backed up in the Internet offline state; the performance requirements of the storage device for offline storage are: the data transmission speed of the storage device does not exceed the corresponding data transmission speed threshold, and the average single data transmission volume is a fixed value;

[0048] The data transmission speed of the storage device does not exceed the corresponding data transmission speed threshold, and the average single data transmission volume is a fixed value; if the number of users granted access rights to the migration object does not exceed the user number threshold, and the estimated repair time after data loss in the migration object exceeds the repair time threshold, the storage mode of the corresponding migration object is set to non-offline storage;

[0049] Sending the storage method of the migration object and the performance requirements of the corresponding storage device to the server;

[0050] After receiving the storage method of the migration object and the performance requirements of the corresponding storage device, the server stores the data of the migration object in the corresponding storage method and the performance requirements of the corresponding storage device during the migration process; at the same time, when the memory usage of the migration object exists in the storage device, the server generates a storage device analysis signal and sends the storage device analysis signal to the storage device analysis unit; after receiving the storage device analysis signal, the storage device analysis unit performs an operation analysis on the storage device of the migration object to determine whether the storage device operates normally when storing the migration object, so as to prevent the uneven use of storage device resources, resulting in a reduction in the life of some storage devices and a waste of investment costs of some storage devices, resulting in a reduction in the storage efficiency of the migration object data storage device;

[0051] The storage device is labeled i, where i is a natural number greater than 1, and the maximum data storage capacity difference of the storage device and the maximum frequency difference of the storage device performing data storage during the storage of the migration object are collected, and the maximum data storage capacity difference of the storage device and the maximum frequency difference of the storage device performing data storage during the storage of the migration object are marked as CLCi and PCZi respectively; the corresponding utilization rate of the storage device put into use during the storage of the migration object is collected, and the corresponding utilization rate of the storage device put into use during the storage of the migration object is marked as LYLi;

[0052] By formula Obtain the analysis coefficient Xi of the storage device during the storage of the migration object, where a1, a2, and a3 are all preset proportional coefficients, and a1>a2>a3>0, and β is an error correction factor, which is 1.02;

[0053] Compare the analysis coefficient Xi of the storage device during the object migration process with the analysis coefficient threshold:

[0054] If the analysis coefficient Xi of the storage device during the storage of the migration object exceeds the analysis coefficient threshold, the corresponding storage device analysis is determined to be qualified, a device usage analysis qualified signal is generated, and the device usage analysis qualified signal is sent to the server; if the analysis coefficient Xi of the storage device during the storage of the migration object does not exceed the analysis coefficient threshold, the corresponding storage device analysis is determined to be unqualified, a device usage analysis unqualified signal is generated, and the device usage analysis unqualified signal is sent to the server;

[0055] After receiving the signal of unqualified device usage analysis, the server controls the usage of the corresponding storage device, that is, sets a control time threshold. If the storage device's cyclic usage is not completed within the control time threshold, the storage operation frequency of a single storage device is limited; if the number of storage devices of the corresponding type cannot meet the demand, the number of storage devices of the corresponding type is added, and the utilization rate of the storage devices in use is guaranteed to meet the demand;

[0056] After receiving the qualified signal of the equipment use analysis, the server generates a stability analysis signal and sends the stability analysis signal to the stability analysis unit. After receiving the stability analysis signal, the stability analysis unit analyzes the data access and transmission during the migration process of the migration object, thereby analyzing the stability of the data migration, thereby improving the monitoring of the data migration, preventing the data access and transmission of the Internet access service from being affected during the data migration process, resulting in a reduction in the efficiency of the Internet access service, and indirectly causing a reduction in the work efficiency of the data migration;

[0057] The delay value corresponding to the buffer time when the migration object is accessed during the data migration process and the floating value of the corresponding transmission rate when the migration object performs data transmission are collected, and the delay value corresponding to the buffer time when the migration object is accessed during the data migration process and the floating value of the corresponding transmission rate when the migration object performs data transmission are compared with the delay value threshold and the floating value threshold respectively:

[0058] If the delay value corresponding to the buffer time of the migration object being accessed during the data migration process exceeds the delay value threshold, or the floating value of the corresponding transmission rate when the migration object performs data transmission exceeds the floating value threshold, the corresponding data migration stability analysis is determined to be unqualified, and a stability abnormality signal is generated and sent to the server; after the server receives the stability abnormality signal, the access to the migration object is adjusted during the data migration process of the migration object; the access frequency during the data migration process is reduced; the access or operation of the migration object in this application is represented by the operation of the Internet access service;

[0059] If the delay value corresponding to the buffer time of accessing the migration object during the data migration process does not exceed the delay value threshold, and the floating value of the corresponding transmission rate when the migration object performs data transmission does not exceed the floating value threshold, then the corresponding data migration stability analysis is determined to be qualified, a stability normal signal is generated and sent to the server;

[0060] After receiving the normal stability signal, the server generates a migration efficiency analysis signal and sends the migration efficiency analysis signal to the migration efficiency analysis unit. After receiving the migration efficiency analysis signal, the migration efficiency analysis unit analyzes the running state of the migration object after completing the data migration. By analyzing the impact analysis after the data migration, the effect of the migration object performing the data migration can be reflected, thereby reflecting the working efficiency of the migration object data migration. In addition, it is also beneficial to improve the eligibility of the server controlling the migration object to perform data migration.

[0061] The time when the migration object completes data migration is taken as the starting point. An efficiency analysis time period is established according to the current time point of the system. The average query time for the migration object data and the number of missing data of the migration object in the efficiency analysis time period are collected. The average query time for the migration object data and the number of missing data of the migration object in the efficiency analysis time period are compared with the average time threshold and the missing number threshold respectively:

[0062] If the average query time of the migration object data in the efficiency analysis time period exceeds the average query time threshold, or the number of missing migration object data exceeds the missing number threshold, the data migration of the migration object is determined to be unqualified, an efficiency analysis abnormality signal is generated and sent to the server; after receiving the efficiency analysis abnormality signal, the server monitors the storage data of the corresponding migration object, selects the storage device with abnormal storage data and restores the corresponding storage data;

[0063] If the average query time of the migration object data within the efficiency analysis time period does not exceed the average query time threshold, and the number of missing migration object data does not exceed the missing number threshold, the data migration of the migration object is determined to be qualified, and a normal efficiency analysis signal is generated and sent to the server.

[0064] The above formulas are obtained by collecting a large amount of data and performing software simulation, and a formula close to the actual value is selected. The coefficients in the formula are set by technicians in this field according to actual conditions;

[0065] When the present invention is in use, the server collects the operation data of the Internet access service and marks it as a migration object; the migration object is analyzed by the data migration category classification unit, and the storage method of the migration object after the migration is completed is determined through the analysis, and the storage method includes online storage, near-line storage and offline storage; after the storage method is determined, the storage method of the migration object and the performance requirements of the corresponding storage device are sent to the server; the storage device analysis unit performs operation analysis on the storage device of the migration object to determine whether the storage device operates normally when storing the migration object; the stability analysis unit analyzes the data access and transmission during the migration process of the migration object to determine whether the stability of the data migration is qualified; the migration efficiency analysis unit analyzes the operation status of the migration object after the data migration is completed, and the impact analysis after the data migration is analyzed to reflect the effect of the data migration of the migration object.

[0066] The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to only specific implementation methods. Obviously, many modifications and changes can be made according to the content of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can understand and use the present invention well. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. A data migration management system based on Internet access service, comprising a server, characterized in that: The server includes: The server collects the operation data of the Internet access service and marks it as a migration object; wherein the operation data is represented as text and pictures of the Internet access service; The data migration classification unit is used to analyze the migration object and determine the storage method of the migration object after the migration is completed through analysis. The storage method includes online storage, near-line storage and offline storage. After the storage method is determined, the storage method of the migration object and the performance requirements of the corresponding storage device are sent to the server; The storage device analysis unit is used to perform operation analysis on the storage device of the migration object to determine whether the storage device operates normally when storing the migration object; generate a device usage analysis qualified signal and a device usage analysis unqualified signal through the operation analysis of the storage device, and send them to the server; The stability analysis unit is used to analyze the data access and transmission during the migration process of the migration object, determine whether the stability of the data migration is qualified, generate stability abnormality signals and stability normal signals through analysis, and send them to the server; the operation process of the stability analysis unit is as follows: The delay value corresponding to the buffer time when the migration object is accessed during the data migration process and the floating value of the transmission rate corresponding to the data transmission of the migration object are collected, and they are marked as the buffer time delay value and the transmission rate floating value, respectively. The buffer time delay value and the transmission rate floating value are compared with the delay value threshold and the floating value threshold respectively: If the buffer time delay value exceeds the delay value threshold, or the transmission rate floating value exceeds the floating value threshold, the corresponding data migration stability analysis is judged to be unqualified, a stability abnormality signal is generated and the stability abnormality signal is sent to the server; if the buffer time delay value does not exceed the delay value threshold, and the transmission rate floating value does not exceed the floating value threshold, the corresponding data migration stability analysis is judged to be qualified, a stability normal signal is generated and the stability normal signal is sent to the server The migration efficiency analysis unit is used to analyze the running status of the migration object after completing the data migration. By analyzing the impact analysis after the data migration, the effect of the migration object on the data migration is reflected. Through the running status analysis, an efficiency analysis abnormal signal and an efficiency analysis normal signal are generated and sent to the server. The operation process of the migration efficiency analysis unit is as follows: The time when the migration object completes data migration is taken as the starting point. An efficiency analysis time period is established according to the current time point of the system. The average query time of the migration object data and the number of missing migration object data in the efficiency analysis time period are collected and compared with the average query time threshold and missing number threshold respectively: If the average query time of the migration object data in the efficiency analysis time period exceeds the average query time threshold, or the number of missing migration object data exceeds the missing number threshold, the data migration of the migration object is determined to be unqualified, an efficiency analysis abnormality signal is generated and sent to the server; If the average query time of the migration object data within the efficiency analysis time period does not exceed the average query time threshold, and the number of missing migration object data does not exceed the missing number threshold, the data migration of the migration object is determined to be qualified, and a normal efficiency analysis signal is generated and sent to the server.

2. The data migration management system based on Internet access service according to claim 1, characterized in that: The operation process of the data migration classification unit is as follows: Analyze the migration objects by category and match the storage method appropriately after category analysis; collect the shortest required access interval and the average required access speed of the migration objects, and compare them with the duration threshold and the required speed threshold respectively: If the shortest required access interval of the migration object does not exceed the duration threshold, and the average required access speed of the migration object exceeds the required speed threshold, it is determined that the data storage mode of the migration object is set to online storage, and the data storage device for online storage of the migration object is set, that is, the performance requirements of the storage device for online storage are: the interval time for receiving accesses and the average transmission speed of the storage device both meet the requirements of the migration object for online storage; if the shortest required access interval of the migration object exceeds the duration threshold, or the average required access speed of the migration object does not exceed the required speed threshold, it is determined that the data storage mode of the migration object is set to non-online storage; The access frequency and average access data volume of the migration object are collected and compared with the access frequency threshold and access data volume threshold respectively: If the access frequency of the migration object does not exceed the access frequency threshold, and the average access data volume of the migration object does not exceed the access data volume threshold, the storage mode of the corresponding migration object is set to near-line storage, that is, the storage device performance requirements of near-line storage are: the corresponding addressing speed exceeds the corresponding addressing speed threshold, and the transmission rate exceeds the corresponding transmission rate threshold; if the access frequency of the migration object exceeds the access frequency threshold, or the average access data volume of the migration object exceeds the access data volume threshold, the storage mode of the corresponding migration object is set to non-near-line storage; Collect the number of users who are granted access rights to the migration object and the estimated repair time after data loss occurs on the migration object, and compare them with the user number threshold and repair time threshold respectively: If the number of users granted access rights to the migration object exceeds the user number threshold, or the estimated repair time after data loss of the migration object does not exceed the repair time threshold, the storage mode of the corresponding migration object is set to offline storage, that is, the migration object data is backed up in the Internet offline state; the performance requirements of the storage device for offline storage are: the data transmission speed of the storage device does not exceed the corresponding data transmission speed threshold, and the average single data transmission volume is a fixed value; If the number of users who are granted access rights to the migration object does not exceed the user number threshold, and the estimated repair time after data loss on the migration object exceeds the repair time threshold, the storage mode of the corresponding migration object is set to non-offline storage.

3. The data migration management system based on Internet access service according to claim 1, characterized in that: The operation process of the storage device analysis unit is as follows: The storage device is labeled i, where i is a natural number greater than 1, and the maximum data storage capacity difference of the storage device and the maximum frequency difference of the storage device performing data storage during the storage of the migration object are collected and labeled as CLCi and PCZi respectively; Collect the utilization of the storage devices used during the storage of the migration object and mark them as LYLi. By formula Obtain the analysis coefficient Xi of the storage device during the storage of the migration object, where a1, a2, and a3 are all preset proportional coefficients, and a1>a2>a3>0, and β is an error correction factor, which is 1.02; Compare the analysis coefficient Xi of the storage device during the object migration process with the analysis coefficient threshold: If the analysis coefficient Xi of the storage device exceeds the analysis coefficient threshold during the storage of the migration object, the corresponding storage device analysis is judged to be qualified, a device usage analysis qualified signal is generated and the device usage analysis qualified signal is sent to the server; if the analysis coefficient Xi of the storage device does not exceed the analysis coefficient threshold during the storage of the migration object, the corresponding storage device analysis is judged to be unqualified, a device usage analysis unqualified signal is generated and the device usage analysis unqualified signal is sent to the server.

Citation Information

Patent Citations

  • Method and device for automatically generating data analysis report

    CN106326202A

  • Method and device for triggering data migration

    US20130179635A1