Migration method and device for physical file data on cloud disk
By generating migration tag information based on asset valuation, importance, activity and business information, the problem of large migration, long time and affecting business operations during cloud disk file data migration is solved, and efficient and impactless data migration is achieved.
Patent Information
- Application Number
- CN202411690260.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-25
- Publication Date
- 2025-03-11
- Estimated Expiration
- 2044-11-25
AI Technical Summary
During the cloud disk file data migration process, there are problems such as large data migration, long time consumption, and migration affects existing business operations.
By generating migration tag information including migration time and migration method based on asset valuation information, importance information, activity information and business-related information of the user or group, we can then scientifically and orderly divert data migration tasks to avoid channel congestion.
Improve data migration efficiency, avoid migration affecting existing business operations, and ensure orderly progress of business operations.
Smart Images

Figure CN119201005B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of data processing technology, and in particular to a migration method, device and electronic device for cloud disk physical file data. Background Art
[0002] Mobile cloud disks are mainly used to provide information storage, reading, and downloading services to enterprises or individuals through the Internet. With the rapid development of mobile cloud disk technology, data migration technology for physical assets in mobile cloud disks is becoming increasingly important.
[0003] Currently, in the process of cloud disk file data migration, related technologies have problems such as large data migration volume, long time consumption, and data migration affecting existing business operations.
[0004] Therefore, a new technical solution is urgently needed to solve the above technical problems. Summary of the invention
[0005] According to an embodiment of the present application, a migration method, device and electronic device for cloud disk physical file data are provided, which are applicable to cloud disk files. The present application generates migration label information including migration time and migration method according to asset valuation information, importance information of the user or group to which it belongs, activity information of the user or group to which it belongs, and / or relevant information of the business to which it belongs, which is conducive to pre-classifying and marking the files to be migrated, and then executing the corresponding migration operation according to the migration label information, which is conducive to scientifically and orderly diverting data migration tasks, avoiding congestion in data migration channels, improving data migration efficiency, avoiding data migration affecting existing business operations, and ensuring the orderly progress of existing business operations.
[0006] In a first aspect of the present application, a migration method for physical file data of a cloud disk is provided, which is applicable to cloud disk files, and the method includes: obtaining basic information of a target migration file, wherein the target migration file belongs to the same business field, and the basic information includes: asset valuation information, importance information of the user or the group to which it belongs, activity information of the user or the group to which it belongs, and / or relevant information of the business to which it belongs; based on the basic information, generating migration label information, wherein the migration label information includes: migration time and migration method; and performing corresponding migration operations based on the migration label information.
[0007] In some feasible implementations, generating migration label information based on basic information includes: when the asset valuation is less than or equal to a first asset threshold, and / or the importance of the user or group to which it belongs is less than or equal to a preset importance threshold, determining the migration method includes: a subsidiary migration method; determining a target migration time and a target migration window based on information on the number of files to be migrated corresponding to each migration window in each time period, wherein the number of files to be migrated corresponding to the target migration time and the target migration window is less than the number of files to be migrated corresponding to other migration windows at other times; generating first migration label information based on the target migration time, the target migration window and the subsidiary migration method.
[0008] In some feasible implementations, generating migration label information based on basic information also includes: when the asset valuation is greater than a first asset threshold, and / or when the importance of the user or group to which it belongs is greater than a preset importance threshold, determining a migration method including: an independent migration method; when the asset valuation is less than or equal to a second asset threshold, determining a target migration time based on activity, wherein the activity of the user or group corresponding to the target migration time is less than or equal to the preset activity threshold; generating second migration label information based on the target migration time and the independent migration method.
[0009] In some feasible implementations, relevant information includes: business period information. Generating migration label information based on basic information also includes: when the asset valuation is greater than the second asset threshold, determining the target migration time based on the activity information and the business period information, wherein the activity of the user or group corresponding to the target migration time is less than or equal to the preset activity threshold, and the business idle period corresponding to the target migration time is greater than or equal to the preset idle period threshold; generating third migration label information based on the target migration time and the independent migration method.
[0010] In some feasible implementations, the relevant information also includes: business form information. According to the migration tag information, executing the corresponding migration operation includes: creating independent target migration windows to migrate the target migration file according to the business form information and / or business period information.
[0011] In some feasible implementations, the above method also includes: obtaining log information of the target migration file, wherein the log information includes: asset comparison information and / or test data information; determining the amount of damage and / or loss of the target migration file based on the log information; performing a complement operation when the amount of damage is greater than 0 and less than or equal to a preset damage threshold, and / or the amount of loss is greater than 0 and less than or equal to a preset loss threshold; performing a rollback operation when the amount of damage is greater than the preset damage threshold, and / or the amount of loss is greater than the preset loss threshold.
[0012] In some feasible implementations, before obtaining the basic information of the target migration file, the above method also includes: obtaining request message information of the target migration file; determining the registration node information of the user to which the target migration file belongs based on the request message information; when the registration node information is before performing the migration operation, saving the target migration file to the original storage area based on the original protocol; when the registration node information is when or after performing the migration operation, saving the target migration file to the target storage area based on the target protocol.
[0013] In a second aspect of the present application, a migration device for physical file data of a cloud disk is provided, comprising: an acquisition unit for acquiring basic information of a target migration file, wherein the target migration file belongs to the same business field, and the basic information includes: asset valuation information, importance information of the user or the group to which it belongs, activity information of the user or the group to which it belongs, and / or relevant information of the business to which it belongs; a generation unit for generating migration label information based on the basic information, wherein the migration label information includes: migration time and migration method; and an execution unit for executing a corresponding migration operation based on the migration label information.
[0014] In a third aspect of the present application, an electronic device is provided, comprising a processor and a memory, wherein the memory stores computer program instructions, and the computer program instructions are used by the processor to execute the migration method applied to physical file data of a cloud disk as described in any one of the first aspects when the processor is running.
[0015] In a fourth aspect of the present application, a storage medium is provided, on which program instructions are stored, and the program instructions are used to execute the migration method applied to physical file data of a cloud disk as described in any one of the first aspects when running.
[0016] The migration method, device and electronic device for cloud disk physical file data provided in the embodiments of the present application are applicable to cloud disk files, wherein the method includes: obtaining basic information of the target migration file, wherein the target migration file belongs to the same business field, and the basic information includes: asset valuation information, importance information of the user or group to which it belongs, activity information of the user or group to which it belongs, and / or relevant information of the business to which it belongs; generating migration label information based on the basic information, wherein the migration label information includes: migration time and migration method; performing corresponding migration operations based on the migration label information. The present application is conducive to pre-classification and marking of files to be migrated, and is conducive to the scientific and orderly diversion of data migration tasks, avoiding congestion in data migration channels, improving data migration efficiency, avoiding data migration from affecting existing business operations, and ensuring the orderly conduct of existing business operations.
[0017] It should be understood that the contents described in the Summary of the Invention are not intended to limit the key or important features of the embodiments of the present application, nor are they intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The above and other features, advantages and aspects of the embodiments of the present application will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:
[0019] Figure 1 A schematic diagram of a process for migrating physical file data on a cloud disk provided in an embodiment of the present application;
[0020] Figure 2 A structural schematic diagram of a migration device for cloud disk physical file data provided in an embodiment of the present application;
[0021] Figure 3 A structural schematic diagram of an electronic device provided in an embodiment of the present application;
[0022] Figure 4 It is a schematic diagram of the structure of a terminal device or a server suitable for implementing the embodiments of the present application. DETAILED DESCRIPTION
[0023] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.
[0024] In addition, the term "and / or" in this article is only a description of the association relationship between the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.
[0025] According to a first aspect of the present application, the present application provides a migration method applied to physical file data of a cloud disk, which is applicable to cloud disk files. Figure 1 The following is a flow chart of a migration method 100 for cloud disk physical file data provided in an embodiment of the present application. Figure 1 As shown, the method 100 includes:
[0026] Step S110: Obtain basic information of the target migration file, wherein the target migration file belongs to the same business field, and the basic information includes: asset valuation information, importance information of the user or group to which it belongs, activity information of the user or group to which it belongs, and / or relevant information of the business to which it belongs.
[0027] Exemplarily, the business domain to which the target migration file belongs can be determined according to the business department of the user or group to which the target migration file belongs, wherein the business department may include: finance department, human resources department, marketing department, and research and development department, etc. Specifically, when the business department of the user or group to which the target migration file belongs is the finance department, it is determined that the target migration file belongs to the same business domain.
[0028] Exemplarily, the asset valuation information can be determined based on the data volume of the target migration file and the importance of the data to the enterprise, wherein the asset valuation is positively correlated with the data volume and the importance. In some feasible implementations, the asset valuation can be determined based on a first weight assigned by the enterprise to the data volume and a second weight assigned by the enterprise to the importance. Specifically, the asset valuation is equal to the sum of the product of the data volume and the first weight and the product of the importance and the second weight.
[0029] Exemplarily, the above-mentioned importance information can be determined according to the importance of the business department to which the user or group belongs. The importance of the above-mentioned business department can be determined according to the number of people in the business department and / or the cash flow of the business department. It should be noted that the importance of the above-mentioned business department is positively correlated with the number of people in the business department and / or the cash flow of the business department.
[0030] Specifically, when the number of people in the above-mentioned business department is large and / or the cash flow of the business department is high, the importance of the business department to which the user or group belongs is judged to be higher; when the number of people in the above-mentioned business department is small and / or the cash flow of the business department is low, the importance of the business department to which the user or group belongs is judged to be higher.
[0031] Alternatively, the importance information may also be determined based on information about the cumulative active duration of the user or group within a preset period, and / or information about the active frequency of the user or group within a preset time period.
[0032] Specifically, when the cumulative active time of the above-mentioned user or group within three months is less than or equal to the preset time, and / or, when the active frequency of the above-mentioned user or group within three months is less than or equal to the preset active frequency, it is determined that the importance of the above-mentioned target migration file is low. When the cumulative active time of the above-mentioned user or group within three months is greater than the preset time, and / or, when the active frequency of the above-mentioned user or group within three months is greater than the preset active frequency, it is determined that the importance of the above-mentioned target migration file is high.
[0033] It should be noted that, if the user or group does not generate new conversation content and / or file content within three months, it can be determined that the user or group is a deregistered user or the group is disbanded, and the above target migration file has the lowest importance.
[0034] It should be noted that the above activity information may also include active time period information and dormant time period information of the user or group.
[0035] Exemplarily, the activity information of the above-mentioned user or group can be determined based on the conversation generation frequency and / or file generation frequency of the user or group within a preset time period, wherein the activity of the user or group is positively correlated with the conversation generation frequency and / or file generation frequency of the user or group within the preset time period. Specifically, when the conversation generation frequency and / or file generation frequency of the user or group is high between 9:00-18:00, it is determined that the activity of the user or group is high, and the user or group is in the active period at this time. When the conversation generation frequency and / or file generation frequency of the user or group is low between 19:00 and 8:00 the next day, it is determined that the activity of the user or group is low, and the user or group is in the dormant period at this time.
[0036] It should be noted that the above-mentioned relevant information of the business may include: business type information of the business, service duration information, busy period information of the business and / or idle period information of the business, etc.
[0037] Step S120: Generate migration label information according to the basic information, wherein the migration label information includes: migration time and migration method.
[0038] Exemplarily, the migration time and migration method of the target migration file can be determined based on the asset valuation information, the importance information of the user or group to which it belongs, the activity information of the user or group to which it belongs, and / or the relevant information of the business to which it belongs, and the migration label information is generated based on the migration time and migration method. It should be noted that the above migration methods may include: independent migration and subsidiary migration, etc. Among them, the above independent migration means that the target migration file is migrated independently of other files to be migrated, and the above subsidiary migration means that it is migrated together with other files to be migrated.
[0039] For example, when the asset valuation is high and / or the importance of the user or group is high, the migration mode of the target migration file can be determined as independent migration. When the asset valuation is low and / or the importance of the user or group is low, the migration mode of the target migration file can be determined as dependent migration.
[0040] Exemplarily, when the asset valuation is high and / or the user or group is of high importance, an idle period of the business and / or a period of low activity of the user or group, i.e., a dormant period, can be selected as the migration time of the target migration file.
[0041] Step S130: Execute corresponding migration operations according to the migration label information.
[0042] For example, according to the migration time and migration mode included in the migration tag information, the target file can be automatically migrated from the original storage area to the target storage area at the target time in the target migration mode to complete the migration operation of the target migration file.
[0043] Based on this, the migration method for physical file data of a cloud disk provided in the present application is applicable to cloud disk files, and the method includes: obtaining basic information of the target migration file, wherein the target migration file belongs to the same business field, and the basic information includes: asset valuation information, importance information of the user or the group to which it belongs, activity information of the user or the group to which it belongs, and / or relevant information of the business to which it belongs; based on the basic information, generating migration label information, wherein the migration label information includes: migration time and migration method; and performing corresponding migration operations based on the migration label information. The target migration files in this application belong to the same business field, and file migration operations can be performed in batches according to the business field to improve the efficiency of file migration. This application pre-classifies and marks the target migration files in a multi-dimensional and comprehensive manner according to the asset valuation information, the importance information of the user or the group to which it belongs, the activity information of the user or the group to which it belongs, and / or the relevant information of the business to which it belongs, so as to accurately generate migration label information containing the migration time and migration method, which is conducive to the subsequent automatic migration operation of the target migration files according to the above migration label information, accurately performing the automatic migration operation with a specific migration method and migration time, thereby realizing the scientific and orderly diversion of data migration tasks, avoiding congestion in the data migration channel, improving data migration efficiency, avoiding the impact of data migration on existing business operations, and ensuring the orderly progress of existing business operations.
[0044] In some feasible implementations, generating migration label information based on basic information includes: when the asset valuation is less than or equal to a first asset threshold, and / or the importance of the user or group to which it belongs is less than or equal to a preset importance threshold, determining the migration method includes: a subsidiary migration method; determining a target migration time and a target migration window based on information on the number of files to be migrated corresponding to each migration window in each time period, wherein the number of files to be migrated corresponding to the target migration time and the target migration window is less than the number of files to be migrated corresponding to other migration windows at other times; generating first migration label information based on the target migration time, the target migration window and the subsidiary migration method.
[0045] It should be noted that the first asset threshold and the preset importance threshold can be set according to the actual needs of the user or enterprise, and are not specifically limited here. The above-mentioned auxiliary migration method is a migration method that is applied to the same migration window and / or transmission channel as other files to be migrated.
[0046] Exemplarily, when it is determined that the asset valuation of the target migration file is less than or equal to the first asset threshold, and / or the importance of the user or group to which it belongs is less than or equal to a preset importance threshold, information on the number of files to be migrated that are queued for migration in each migration window in each time period is obtained, and the number of files to be migrated that are queued for migration in each migration window in each time period is compared to determine the target migration time and target migration window of the target migration file. When it is determined that at XX / XX / XX time, the number of files to be migrated corresponding to migration window A is less than the number of files to be migrated corresponding to all other migration windows at other times, first migration label information "XX-XX-XX-Aa" is generated according to XX / XX / XX time, migration window A, and subsidiary migration method a, so that the target migration file is migrated from the original storage area to the target storage area together with other files to be migrated in migration window A at XX / XX / XX time to complete the migration operation of the target migration file.
[0047] It should be noted that when it is determined that the asset valuation of the target migration file is less than or equal to the first asset threshold, and / or the importance of the user or group to which it belongs is less than or equal to the preset importance threshold, the migration operation can also be performed by importing and exporting to improve the data migration rate.
[0048] Based on this, the above method automatically and accurately determines that the migration mode of the low-value target migration file is subsidiary migration by determining that the asset valuation of the target migration file is less than or equal to the first asset threshold, and / or the importance of the user or the group to which it belongs is less than or equal to the preset importance threshold, and then automatically and accurately determines the target migration time and target migration window of the target migration file by comparing the number of files to be migrated corresponding to each migration window in each time period, so as to accurately generate the first migration label information, so that the target migration file is automatically migrated from the original storage area to the target storage area together with other files to be migrated at the target migration time and the target migration window. On the one hand, it can realize the automatic and scientific diversion of the migration operation of the target migration file whose asset valuation is less than or equal to the first asset threshold, and / or the importance of the user or the group to which it belongs is less than or equal to the preset importance threshold. On the other hand, it is conducive to the scientific distribution of the load pressure of the migration window, so as to further improve the data migration efficiency, reduce the probability of file migration failure due to congestion of the migration channel, and further improve the data migration quality.
[0049] In some feasible implementations, generating migration label information based on basic information also includes: when the asset valuation is greater than a first asset threshold, and / or when the importance of the user or group to which it belongs is greater than a preset importance threshold, determining a migration method including: an independent migration method; when the asset valuation is less than or equal to a second asset threshold, determining a target migration time based on activity, wherein the activity of the user or group corresponding to the target migration time is less than or equal to the preset activity threshold; generating second migration label information based on the target migration time and the independent migration method.
[0050] It should be noted that the first asset threshold, the preset importance threshold and the second asset threshold can be set according to the actual needs of the user or enterprise, and are not specifically limited here. The independent migration mode is an isolated transmission mode, that is, a migration mode applicable to independent migration windows and independent transmission channels.
[0051] Exemplarily, when it is determined that the asset valuation of the target migration file is greater than a first asset threshold, and / or the importance of the user or group to which it belongs is greater than a preset importance threshold, the migration method of the target migration file is determined to be a migration method of an independent migration window and an independent transmission channel. When it is determined that the asset valuation of the target migration file is less than or equal to a second asset threshold, the activity of the user or group to which the target transmission file belongs is obtained, and based on the above activity, the corresponding moment when the activity of the user or group is less than or equal to the preset activity threshold is determined as the target migration time. Based on the above target migration time and the independent migration method, second migration label information is generated to enable the target transmission file to be migrated from the original storage area to the target storage area via an independent migration window and a migration channel at the above target migration time.
[0052] Specifically, when it is determined that the asset valuation of the target migration file is greater than the first asset threshold, and / or the importance of the user or the group to which it belongs is greater than a preset importance threshold, the migration mode of the above-mentioned target migration file is determined to be a migration mode of an independent migration window and an independent transmission channel. When it is determined that the asset valuation of the target migration file is less than or equal to the second asset threshold, the activity of the user or the group to which the target transmission file belongs is obtained. When the activity of the determined user or the group to which it belongs is less than or equal to the preset activity threshold at XX o'clock in the morning, the target migration time is determined to be XX time. According to the above-mentioned XX time and independent migration mode b, the second migration label information "XX-b" is generated, so that the target migration file is isolated from other migration files at XX time through the independent window b and the independent transmission channel corresponding to the independent window b, and migrated from the original storage area to the target storage area to complete the migration operation of the target migration file.
[0053] Based on this, the above method automatically and accurately determines the migration mode when it is determined that the asset valuation of the target migration file is greater than the first asset threshold, and / or the importance of the user or group to which it belongs is greater than the preset importance threshold, including: an independent migration mode, which is conducive to improving the protection of high-value target migration files; when the second asset threshold is determined or equal to, the moment when the activity of the user or group is less than or equal to the preset activity threshold is determined as the target migration time, which is conducive to migrating the target migration file during the dormant period of the user or group, avoiding the migration operation of the target migration file affecting the user or group's call to the target migration file, so as to reduce the impact of the migration operation of the target file on the user or group; generating the second migration tag information according to the target migration time and the independent migration mode, which is conducive to achieving the automatic migration of the target migration file from the original storage area to the target storage area through the independent migration window and the independent transmission channel at the target migration time, thereby improving the transmission efficiency of the target transmission file.
[0054] In some feasible implementations, relevant information includes: business period information. Generating migration label information based on basic information also includes: when the asset valuation is greater than the second asset threshold, determining the target migration time based on the activity information and the business period information, wherein the activity of the user or group corresponding to the target migration time is less than or equal to the preset activity threshold, and the business idle period corresponding to the target migration time is greater than or equal to the preset idle period threshold; generating third migration label information based on the target migration time and the independent migration method.
[0055] Exemplarily, the second asset threshold may be set according to actual needs of the user or enterprise, and is not specifically limited here.
[0056] Exemplarily, the business period information may include: the frequency of conversations and / or file generation in the business interaction window, and the preset idle period threshold may be determined according to the frequency threshold of conversations and / or file generation in the business interaction window. Specifically, when the frequency of conversations in the business interaction window is less than or equal to the preset frequency threshold, and / or the frequency of file generation in the business interaction window is less than or equal to the preset frequency threshold, it is determined that the business is in an idle period.
[0057] Specifically, when it is determined that the asset valuation of the target migration file is greater than the second asset threshold, and the frequency of conversations and / or file generation in the business interaction window from 0:00 to 2:00 is less than or equal to the preset frequency threshold, and the activity of the user or group from 0:00 to 2:00 is less than or equal to the preset activity threshold, 0:00-2:00 is determined as the target migration time, and according to the above 0:00-2:00 and independent migration method b, third migration label information is generated, so that the target migration file is isolated from other migration files from the original storage area to the target storage area through the independent window b and the independent transmission channel corresponding to the above independent window b at 0:00-2:00, so as to complete the migration operation of the target migration file.
[0058] It should be noted that the above-mentioned preset idle period threshold may include: a preset idle duration threshold.
[0059] Exemplarily, when it is determined that the asset valuation of the target migration file is greater than the second asset threshold, it is determined whether the business is in an idle period based on the frequency of conversations and / or file generation in the business interaction window. When it is determined that the business is in an idle period and the activity of the user or group is less than or equal to the preset activity threshold, it is determined whether the duration of the business in the idle period is greater than or equal to the preset idle duration threshold. When it is determined that the duration of the business in the idle period is greater than or equal to the preset idle duration threshold, the current idle period is determined to be the target migration time, and the third migration label information is generated based on the above target migration time and the independent migration method. It should be noted that the above preset idle duration threshold can be determined based on the data volume of the target migration file, wherein the above preset idle duration threshold is positively correlated with the data volume of the above target migration file, that is, the larger the data volume of the target migration file, the larger the preset idle duration threshold.
[0060] Specifically, when it is determined that the asset valuation of the target migration file is greater than the second asset threshold, and the frequency of conversations and / or file generation in the business interaction window from 0:00 to 2:00 is less than or equal to the preset frequency threshold, 0:00-2:00 is determined to be an idle period, and the idle time from 0:00 to 2:00 is 2 hours, which is greater than the time 1 hour required to migrate the target migration file, then 0:00-2:00 is determined to be the target migration time, and according to the above 0:00-2:00 and the independent migration method b, the third migration label information is generated, so that the target migration file is isolated from other migration files from the original storage area to the target storage area through the independent window b and the independent transmission channel corresponding to the above independent window b at 0:00-2:00, so as to complete the migration operation of the target migration file.
[0061] Based on this, the above method determines that the asset valuation of the target migration file is greater than the second asset threshold, and determines that the activity of the user or group is less than or equal to the preset activity threshold, and the moment when the business idle period is greater than or equal to the preset idle period threshold is the target migration time according to the activity information and business period information. The third migration label information is generated according to the above target migration time and independent migration method, so that the target migration file is isolated from other migration files through an independent window and a corresponding independent transmission channel during the dormant period of the user or group to which it belongs and the idle period of the business, and is migrated from the original storage area to the target storage area. This is beneficial to achieve staggered transmission of the target transmission file and the high-incidence period of business and the high-activity period of the user or group to which it belongs while protecting the migration security of high-value target transmission files, thereby completing the transmission of high-value files without hindering business processes and user or group interactions.
[0062] In some feasible implementations, the relevant information also includes: business form information. According to the migration tag information, executing the corresponding migration operation includes: creating independent target migration windows to migrate the target migration file according to the business form information and / or business period information.
[0063] Exemplarily, the above-mentioned business form information may include: interaction mode and service mode of the target business, etc.
[0064] In some feasible implementations, a target migration window of a specific size and / or shape can be created during an idle period of the target business according to the interaction mode and service mode of the target business to achieve independent migration of the target migration files, wherein the above-mentioned specific size and / or shape matches the above-mentioned interaction mode and / or service mode.
[0065] Based on this, the above method creates independent target migration windows to migrate target migration files according to business form information and / or business period information, so as to avoid the target migration window affecting the business process while ensuring the independent and confidential transmission of high-value target transmission files, thereby ensuring the orderly parallel of business and file migration.
[0066] In some feasible implementations, the above method also includes: obtaining log information of the target migration file, wherein the log information includes: asset comparison information and / or test data information; determining the amount of damage and / or loss of the target migration file based on the log information; performing a complement operation when the amount of damage is greater than 0 and less than or equal to a preset damage threshold, and / or the amount of loss is greater than 0 and less than or equal to a preset loss threshold; performing a rollback operation when the amount of damage is greater than the preset damage threshold, and / or the amount of loss is greater than the preset loss threshold.
[0067] It should be noted that the above-mentioned preset loss threshold and the above-mentioned preset damage threshold can be defined according to the actual needs of users or enterprises, and are not specifically limited here.
[0068] Exemplarily, the asset comparison information can be determined based on the comparison result of the first asset table information and the second asset table information. The first asset table information is the asset table information before the target migration file performs the migration operation. The second asset table information is the asset table information after the target migration file performs the migration operation.
[0069] Specifically, the amount of loss of target migration files can be determined based on the difference between the first asset table information and the second asset table information. When the absolute value of the difference in the number of files between the first asset table information and the second asset table information is greater than 0 and less than or equal to a preset loss threshold, a complement operation is performed; when the absolute value of the difference in the number of files between the first asset table information and the second asset table information is greater than the preset loss threshold, a rollback operation is performed.
[0070] Exemplarily, the test data information in the log information can be retrieved to determine the damage amount of the target transmission file. The test data is the data generated when the target transmission file is transmitted through the transmission channel.
[0071] Specifically, when it is determined that the damage amount of the target transmission file is greater than 0 and less than or equal to a preset damage threshold, a complement operation is performed; when it is determined that the damage amount of the target transmission file is greater than the preset damage threshold, a rollback operation is performed.
[0072] It should be noted that, in the case where it is determined to perform a complement operation, manual intervention may be requested to supplement the data integrity of the target migration file. In the case where it is determined to perform a rollback operation, the rollback operation may be automatically triggered after the migration operation of the target migration file is completed. Alternatively, the rollback operation may also be triggered by manually calling an interface after the migration operation of the target migration file is completed.
[0073] It should be noted that the above rollback operation includes: modifying the migration status of the target migration file to be rolled back, determining the rollback step, limiting access to the above target migration file, rolling back metadata and updating cache, calling the album SAAS interface to roll back album data, resetting the amount of data that has been migrated, MIGRATED SIZE, and the value of the field is 0, wherein the above MIGRATED SIZE is used to indicate the used space of the migration, restoring the storage base type and driver id fields, and invalidating the circle entity cache. In the event of a rollback operation failure, the migration status of the target migration file is modified to rollback failure, and the rollback step value is reduced by 1. Specifically, if the original rollback step value is -2, the rollback step value is updated to -3, and access to the above target migration file is limited. When the rollback operation is successful, a rollback success message queue (Message Queue, MQ) is sent to the search platform and / or sharing platform, so that the search platform generates a rollback file index and / or a new album index, and the sharing platform generates rollback change information, modifies the migration window of the target migration file to initialization, changes the rollback step value to 0, and removes access restrictions on the target migration file.
[0074] Based on this, the above method determines the damage amount and / or loss amount of the target migration file by comparing the log information, which is conducive to realizing the automatic determination of the migration quality of the target migration file. According to the comparison result of the loss amount and the preset loss threshold, and / or the comparison result of the damage amount and the preset damage threshold, it can realize the accurate determination of the execution of the complement operation or the rollback operation, which is conducive to ensuring the data integrity of the target migration file during the migration process, and realizing the automatic processing of the abnormal situation or error situation of the target migration file during the migration process.
[0075] In some feasible implementations, before obtaining the basic information of the target migration file, the above method also includes: obtaining request message information of the target migration file; determining the registration node information of the user to which the target migration file belongs based on the request message information; when the registration node information is before performing the migration operation, saving the target migration file to the original storage area based on the original protocol; when the registration node information is when or after performing the migration operation, saving the target migration file to the target storage area based on the target protocol.
[0076] Exemplarily, a target parameter may be added to the request message, and the target parameter may be stored in the user's login session through backend verification, so as to determine the registration node information of the user to which the target migration file belongs according to the request message information.
[0077] Specifically, taking the start time of the file migration operation as the cutting point, when it is determined that the registration node information is before the migration operation is performed, based on the original protocol, the target migration file is saved to the original file base; when it is determined that the registration node information is when or after the migration operation is performed, based on the target protocol, the target migration file is saved to the target file base. Specifically, the file service adapter component can be configured between the original base and the target base of the application cluster and the file service through the protocol flag to achieve automatic matching of the base to store the above target migration file.
[0078] It should be noted that the target migration file saved to the original file base based on the original protocol is also a subsequent file migration data object. After the target migration file is migrated from the original file base to the target file base, the file protocol flag of the target file is changed to the target protocol to complete the migration operation of the target file.
[0079] Based on this, the above method can accurately determine the registration node information of the user to which the target migration file belongs according to the request message information, partition the target migration file according to the registration node information, and save the target migration file to the target storage area based on the target protocol, which is conducive to avoiding subsequent secondary migration of the above target migration file, and is conducive to reducing the data volume of the file to be migrated, thereby improving data migration efficiency; the registration node information is the target migration file before the migration operation is performed, and the target migration file is saved to the original storage area based on the original protocol, which is conducive to the subsequent overall migration and storage of the target migration file before the migration operation is performed, avoiding the mis-storage of one part of the data and another part of the data in the target migration file, and is conducive to providing convenience for users or groups to call the above data.
[0080] It should be noted that during the target mobile file migration process, a file migration notification can be sent to the system or module associated with the target mobile file to facilitate the system or module's preloading operation, multi-threading operation, asynchronous operation of migration tasks, and caching operation of migration resources.
[0081] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present application.
[0082] The above is an introduction to the method embodiment. The following is a further explanation of the scheme described in this application through an apparatus embodiment.
[0083] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the described module can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0084] According to a second aspect of the present application, the present application provides a migration device for physical file data of a cloud disk. Figure 2 A structural schematic diagram of a migration device 200 for cloud disk physical file data provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the apparatus 200 may include: an acquisition unit 210 , a generation unit 220 , and an execution unit 230 .
[0085] The acquisition unit 210 is used to acquire basic information of the target migration file, wherein the target migration file belongs to the same business field, and the basic information includes: asset valuation information, importance information of the user or group to which it belongs, activity information of the user or group to which it belongs, and / or relevant information of the business to which it belongs.
[0086] The generating unit 220 is used to generate migration label information according to the basic information, wherein the migration label information includes: migration time and migration mode.
[0087] The execution unit 230 is used to execute the corresponding migration operation according to the migration tag information.
[0088] According to a third aspect of the present application, the present application provides an electronic device. Figure 3 FIG. 1 is a structural diagram of an electronic device 300 provided in an embodiment of the present application. Figure 3 As shown, the electronic device 300 includes a processor 310 and a memory 320, wherein the memory 320 stores computer program instructions, and the computer program instructions are used by the processor 310 to execute the migration method applied to cloud disk physical file data as described in any one of the first aspects when the processor 310 is running.
[0089] According to a fourth aspect of the present application, the present application further provides a storage medium on which program instructions are stored, and the program instructions are used to execute the migration method for physical file data of a cloud disk as described in any one of the first aspects at runtime. The storage medium may include, for example, a storage component of a tablet computer, a hard disk of a computer, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disk read-only memory (CD-ROM), a USB memory, or any combination of the above storage media. The computer-readable storage medium may be any combination of one or more computer-readable storage media. Figure 4A schematic diagram of the structure of a terminal device or server suitable for implementing an embodiment of the present application is shown.
[0090] like Figure 4 As shown, the terminal device or server includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 402 or the program loaded from the storage part 408 to the random access memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the terminal device or server are also stored. The CPU 401, the ROM 402, and the RAM 403 are connected to each other through a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.
[0091] The following components are connected to the I / O interface 405: an input section 406 including a keyboard, a mouse, etc.; an output section 407 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 408 including a hard disk, etc.; and a communication section 409 including a network interface card such as a LAN card, a modem, etc. The communication section 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to the I / O interface 405 as needed. A removable medium 411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 410 as needed, so that a computer program read therefrom is installed into the storage section 408 as needed.
[0092] In particular, according to an embodiment of the present application, the above method flow steps can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a machine-readable medium, and the computer program includes a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 409, and / or installed from the removable medium 411. When the computer program is executed by the central processing unit (CPU) 401, the above-mentioned functions defined in the system of the present application are executed.
[0093] It should be noted that the computer-readable medium shown in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
[0094] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of the code, and the aforementioned module, program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0095] The units or modules involved in the embodiments described in the present application may be implemented by software or hardware. The units or modules described may also be arranged in a processor. The names of these units or modules do not, in some cases, constitute limitations on the units or modules themselves.
[0096] As another aspect, the present application further provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable storage medium stores one or more programs, and when the above programs are used by one or more processors to execute the method described in the present application.
[0097] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of application involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned application concept. For example, the above features are replaced with (but not limited to) technical features with similar functions applied in the present application.
Claims
1. A migration method for physical file data of a cloud disk, characterized in that: Applicable to cloud disk files, the method includes: Obtaining basic information of the target migration file, wherein the target migration file belongs to the same business field, and the basic information includes: asset valuation information, importance information of the user or group to which it belongs, activity information of the user or group to which it belongs, and / or relevant information of the business to which it belongs; The asset valuation information is determined according to the data volume of the target migration file and the importance of the data to the enterprise, and the asset valuation is equal to the sum of the product of the data volume of the target migration file and the first weight and the product of the importance of the data to the enterprise and the second weight; The importance information of the user or group is determined based on the number of people in the business department and / or the capital flow of the business department; Generate migration label information according to the basic information, wherein the migration label information includes: migration time and migration mode; Execute corresponding migration operations according to the migration label information; The generating migration label information according to the basic information includes: In the case where the asset valuation is less than or equal to the first asset threshold, and / or the importance of the user or group is less than or equal to a preset importance threshold, determining the migration mode includes: a subsidiary migration mode; Determine the target migration time and the target migration window according to the information about the number of files to be migrated corresponding to each migration window in each time period, wherein the number of files to be migrated corresponding to the target migration window at the target migration time is less than the number of files to be migrated corresponding to other migration windows at other times; generating first migration label information according to the target migration time, the target migration window, and the subsidiary migration mode; The generating migration label information according to the basic information further includes: In the case where the asset valuation is greater than a first asset threshold, and / or the importance of the user or group is greater than a preset importance threshold, determining the migration mode includes: an independent migration mode; In the case where the asset valuation is less than or equal to the second asset threshold, Determining a target migration time according to the activity, wherein the activity of the user or group corresponding to the target migration time is less than or equal to a preset activity threshold; generating second migration label information according to the target migration time and the independent migration mode; The related information includes: business period information, and the generating of migration label information according to the basic information also includes: In the case where the asset valuation is greater than the second asset threshold, Determine the target migration time according to the activity information and the service period information, wherein the activity of the user or group corresponding to the target migration time is less than or equal to a preset activity threshold, and the service idle period corresponding to the target migration time is greater than or equal to a preset idle period threshold; Third migration label information is generated according to the target migration time and the independent migration mode.
2. The method according to claim 1, characterized in that The related information also includes: service form information, and the performing corresponding migration operation according to the migration tag information includes: According to the service form information and / or the service period information, independent target migration windows are created to migrate the target migration files.
3. The method according to any one of claims 1 to 2, characterized in that: Also includes: Obtaining log information of the target migration file, wherein the log information includes: asset comparison information and / or test data information; Determining the amount of damage and / or loss of the target migration file according to the log information; When the damage amount is greater than 0 and less than or equal to a preset damage threshold, and / or the loss amount is greater than 0 and less than or equal to a preset loss threshold, performing a complement operation; When the damage amount is greater than a preset damage threshold, and / or the loss amount is greater than a preset loss threshold, a rollback operation is performed.
4. The method according to claim 3, characterized in that Before obtaining basic information of the target migration file, the method further includes: Obtaining request message information of the target migration file; Determine, according to the request message information, the registration node information of the user to which the target migration file belongs; In a case where the registered node information is before the migration operation is performed, based on the original protocol, saving the target migration file to the original storage area; When the registered node information is at or after the migration operation is performed, the target migration file is saved in the target storage area based on the target protocol.
5. A migration device for physical file data of a cloud disk, characterized in that: include: An acquisition unit, configured to acquire basic information of a target migration file, wherein the target migration file belongs to the same business field, and the basic information includes: asset valuation information, importance information of the user or group to which it belongs, activity information of the user or group to which it belongs, and / or relevant information of the business to which it belongs; The asset valuation information is determined according to the data volume of the target migration file and the importance of the data to the enterprise, and the asset valuation is equal to the sum of the product of the data volume of the target migration file and the first weight and the product of the importance of the data to the enterprise and the second weight; The importance information of the user or group is determined based on the number of people in the business department and / or the capital flow of the business department; A generating unit, configured to generate migration label information according to the basic information, wherein the migration label information includes: migration time and migration mode; An execution unit, configured to execute a corresponding migration operation according to the migration label information; The generating migration label information according to the basic information includes: In the case where the asset valuation is less than or equal to the first asset threshold, and / or the importance of the user or group is less than or equal to a preset importance threshold, determining the migration mode includes: a subsidiary migration mode; Determine the target migration time and the target migration window according to the information about the number of files to be migrated corresponding to each migration window in each time period, wherein the number of files to be migrated corresponding to the target migration window at the target migration time is less than the number of files to be migrated corresponding to other migration windows at other times; generating first migration label information according to the target migration time, the target migration window, and the subsidiary migration mode; The generating migration label information according to the basic information further includes: In the case where the asset valuation is greater than a first asset threshold, and / or the importance of the user or group is greater than a preset importance threshold, determining the migration mode includes: an independent migration mode; In the case where the asset valuation is less than or equal to the second asset threshold, Determining a target migration time according to the activity, wherein the activity of the user or group corresponding to the target migration time is less than or equal to a preset activity threshold; generating second migration label information according to the target migration time and the independent migration mode; The related information includes: business period information, and the generating of migration label information according to the basic information also includes: In the case where the asset valuation is greater than the second asset threshold, Determine the target migration time according to the activity information and the service period information, wherein the activity of the user or group corresponding to the target migration time is less than or equal to a preset activity threshold, and the service idle period corresponding to the target migration time is greater than or equal to a preset idle period threshold; Third migration label information is generated according to the target migration time and the independent migration mode.
6. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores computer program instructions, and the computer program instructions are used by the processor to execute the migration method applied to cloud disk physical file data as described in any one of claims 1 to 4 when the processor is running.
7. A storage medium having program instructions stored thereon, characterized in that: The program instructions are used to execute the migration method applied to physical file data of a cloud disk as described in any one of claims 1 to 4 when running.
Citation Information
Patent Citations
Data migration method, product, equipment and medium
CN118672517A