A processing method and device
By acquiring and analyzing the capacity change information of storage space, generating correlation relationships, and identifying the leakage risks during data migration, the problem of identifying the leakage risks during data migration is solved and data security is guaranteed.
Patent Information
- Application Number
- CN202111644546.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-29
- Publication Date
- 2025-09-23
- Estimated Expiration
- 2041-12-29
AI Technical Summary
During the data migration process, how to identify and prevent data leakage risks becomes a problem.
By obtaining the capacity of the current storage space, determining capacity change information, generating associated information, identifying data migration status, and identifying data leakage risks based on the associated information.
Effectively identify and prevent data leakage risks during data migration to ensure data security.
Smart Images

Figure CN114296654B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a processing method and device. Background Art
[0002] In data management, storage resource migration may occur. During the migration of storage resources, there may be a risk of data leakage. However, how to identify data leakage risks becomes a problem. Summary of the Invention
[0003] This application provides the following technical solutions:
[0004] On one hand, the present application provides a processing method, comprising:
[0005] Get the first capacity of the current storage space;
[0006] determining, based on the first capacity of the current storage space, capacity change information of the first capacity of the current storage space;
[0007] generating first association information including an association relationship between the capacity change information and the current storage space;
[0008] If it is confirmed that first data corresponding to the data in the current storage space has been generated, generating at least second association information including an association relationship between the first association information and the first data, the first data being used to back up or restore the data in the current storage space;
[0009] At least the first association information and the second association information are stored.
[0010] The method further comprises:
[0011] Based on the first association information and the second association information, first output information representing a historical change process of the object associated with the current storage space is determined.
[0012] The method further comprises:
[0013] When migrating a virtual device, and the virtual device is created based on the first data, generating third association information including an association relationship between the second association information and the virtual device;
[0014] The storing of at least the first association information and the second association information includes:
[0015] The first association information, the second association information, and the third association information are stored.
[0016] The method further comprises:
[0017] Second output information representing a historical change process of the virtual device is determined based on the first association information, the second association information, and the third association information.
[0018] The generating of first association information including an association relationship between the capacity change information and the current storage space includes:
[0019] removing interference information from the capacity change information to obtain target change information;
[0020] First association information including an association relationship between the target change information and the current storage space is generated.
[0021] The determining, based on the first capacity of the current storage space, capacity change information of the first capacity of the current storage space includes:
[0022] Based on a resampling window of a set size, the first capacity of the current storage space is sampled according to a set resampling step size to determine capacity change information of the first capacity of the current storage space.
[0023] The step of sampling the first capacity of the current storage space based on the resampling window of the set size according to the set resampling step size, and determining the capacity change information of the first capacity of the current storage space includes:
[0024] Based on a resampling window of a set size, sampling a first capacity of the current storage space according to a set resampling step size that is greater than a set threshold, and determining a maximum capacity and a minimum capacity within the resampling window;
[0025] determining a difference between the maximum capacity and the minimum capacity;
[0026] Anomaly detection is performed on the difference to obtain capacity change information of the first capacity of the current storage space.
[0027] The step of sampling the first capacity of the current storage space based on the resampling window of the set size according to the set resampling step size, and determining the capacity change information of the first capacity of the current storage space includes:
[0028] Based on a resampling window of a set size, sampling a first capacity of the current storage space according to a set resampling step size that is greater than a first set threshold, and determining a maximum capacity and a minimum capacity within the resampling window;
[0029] determining a difference between the maximum capacity and the minimum capacity;
[0030] Performing an abnormality detection on a difference between the maximum capacity and the minimum capacity to obtain a first detection result;
[0031] Based on a resampling window of a set size, sampling the first capacity of the current storage space according to a set resampling step size that is smaller than a second set threshold, and determining a difference between two adjacent resampling windows;
[0032] Performing anomaly detection on the difference between two adjacent resampling windows to obtain a second detection result;
[0033] An OR logic operation is performed on the first detection result and the second detection result to obtain capacity change information of the first capacity of the current storage space.
[0034] The obtaining of the first capacity of the current storage space includes:
[0035] If the current storage space is a storage space corresponding to a virtual device created based on the first data, obtaining a second capacity obtained by monitoring the capacity of the first storage space before the first data is generated, the first storage space being the storage space in which the first data is generated;
[0036] A third capacity is obtained by monitoring the capacity of the current storage space, and the second capacity and the third capacity are concatenated to obtain a first capacity of the current storage space.
[0037] Another aspect of the present application provides a processing device, comprising:
[0038] An obtaining module, configured to obtain a first capacity of a current storage space;
[0039] a first determining module, configured to determine capacity change information of the first capacity of the current storage space based on the first capacity of the current storage space;
[0040] A first generating module, configured to generate first association information including an association relationship between the capacity change information and the current storage space;
[0041] a second generating module configured to generate, upon confirming that first data corresponding to the data in the current storage space has been generated, at least second association information including an association relationship between the first association information and the first data, the first data being used to back up or restore the data in the current storage space;
[0042] A storage module is configured to store at least the first association information and the second association information.
[0043] Compared with the prior art, the present invention has the following advantages:
[0044] By obtaining the first capacity of the current storage space, and based on the first capacity of the current storage space, determining the capacity change information of the first capacity of the current storage space, generating first association information including the association relationship between the capacity change information and the current storage space, the first association information can be used as reference data to determine whether the data in the current storage space has changed. Based on the data change of the current storage space, the data migration status when the current storage space is migrated can be identified, and it can be determined whether there is a risk of leakage of the data in the current storage space.
[0045] When it is confirmed that the first data corresponding to the data in the current storage space has been generated, at least second associated information containing the association relationship between the first associated information and the first data is generated. The first data is used to back up or restore the data in the current storage space. The second associated information can be used as reference data for changes in the first data corresponding to the data in the current storage space. Based on the changes in the first data, the migration status of the first data when it is migrated in the current storage space can be determined. Since the first data can back up or restore the data in the current storage space, by determining the migration status of the first data, it can also be determined whether there is a risk of leakage of the data in the current storage space. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0047] Figure 1 This is a flow chart of a treatment method provided in Example 1 of the present application;
[0048] Figure 2 This is a flow chart of a treatment method provided in Example 2 of the present application;
[0049] Figure 3 This is a flow chart of a treatment method provided in Example 3 of the present application;
[0050] Figure 4 This is a schematic diagram of a data migration scenario provided by this application;
[0051] Figure 5 This is a flow chart of a treatment method provided in Example 4 of the present application;
[0052] Figure 6 This is a flow chart of a treatment method provided in Example 5 of the present application;
[0053] Figure 7This is a flow chart of a treatment method provided in Example 6 of the present application;
[0054] Figure 8 It is a structural schematic diagram of a processing device provided by this application;
[0055] Figure 9 This is a structural diagram of an electronic device provided by this application. DETAILED DESCRIPTION
[0056] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0057] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below with reference to the accompanying drawings and specific implementation methods.
[0058] Reference Figure 1 , is a flow chart of a processing method provided in Example 1 of the present application. The method can be applied to electronic devices. The present application does not limit the product type of the electronic device. For example, Figure 1 As shown, the method may include but is not limited to the following steps:
[0059] Step S101: Obtain a first capacity of a current storage space.
[0060] In this embodiment, there is no limitation on the method for obtaining the first capacity of the current storage space. Specifically, it can be, but is not limited to, using a capacity acquisition device to acquire the first capacity of the current storage space at a set acquisition frequency. The acquisition frequency can be set as needed and is not limited in this application.
[0061] While collecting the first capacity of the current storage space at the set collection frequency, the collection time may be recorded, and the collection time may be used as the time when the capacity of the current storage space changes to the collected first capacity.
[0062] In this embodiment, obtaining the first capacity of the current storage space may also include obtaining the first capacity of the current storage space from information about operations on the current storage space recorded by an operation unit. The operation unit may be used to operate the current storage space to perform operations such as reading and writing data. The information about operations on the current storage space recorded by the operation unit may at least include information related to the capacity of the current storage space, such as the used capacity of the current storage space and / or the remaining capacity of the current storage space.
[0063] The first capacity of the current storage space may include: the used capacity of the current storage space.
[0064] The information on the operation on the current storage space recorded by the operation unit may further include: the time when the capacity of the current storage space changes to the first capacity of the current storage space.
[0065] Of course, the first capacity of the current storage space may also include the remaining capacity of the current storage space. It should be noted that the remaining capacity of the current storage space must be obtained on the basis of keeping the total capacity of the current storage space unchanged to ensure the validity of the remaining capacity of the current storage space.
[0066] In this embodiment, the current storage space may include but is not limited to: a physical current storage space (eg, a current storage space of a physical hard disk) or a virtual current storage space (eg, a current storage space of a virtual hard disk).
[0067] Step S102: Determine capacity change information of the first capacity of the current storage space based on the first capacity of the current storage space.
[0068] It is understandable that as the current storage space is used, the first capacity of the current storage space will change. Based on the obtained first capacity of the current storage space, capacity change information of the first capacity of the current storage space can be determined.
[0069] Determining, based on the first capacity of the current storage space, capacity change information of the first capacity of the current storage space may include:
[0070] S1021: Determine the difference between every two adjacent first capacities of the current storage space.
[0071] In this embodiment, the difference between every two adjacent first capacities of the current storage space may be used as the capacity change information of the first capacity of the current storage space.
[0072] Furthermore, the following process can be performed:
[0073] S1022: Determine whether the difference between every two adjacent first capacities of the current storage space is within a set capacity variation range.
[0074] If the difference between two adjacent first capacities is not within the set capacity variation range, step S1023 is executed.
[0075] S1023. Determine that the difference between two adjacent first capacities of the current storage space that are not within the set capacity change range is outlier data, and obtain the time when the current storage space changes to each of the two adjacent first capacities that are not within the set capacity change range, and use the obtained time as the time of the outlier data.
[0076] In this embodiment, the difference between every two adjacent first capacities of the current storage space, the outlier data, and the time of the outlier data may be used as the capacity change information of the first capacity of the current storage space.
[0077] Step S103: Generate first association information including an association relationship between the capacity change information and the current storage space.
[0078] In this embodiment, the association relationship between all the determined capacity change information and the current storage space may be determined, and first association information including the association relationship between all the determined capacity change information and the current storage space may be generated.
[0079] This embodiment also provides another implementation method for generating the first association information, which may specifically include:
[0080] S1031. Remove interference information from capacity change information to obtain target change information.
[0081] Interference information can be understood as capacity information that affects the accuracy of the capacity changes of the current storage space. For example, the capacity fluctuation information of the storage space generated when the server associated with the current storage space is initially created and the environment is set up.
[0082] S1032: Generate first association information including an association relationship between the target change information and the current storage space.
[0083] Removing interference information from the capacity change information can ensure the accuracy of the target change information, thereby ensuring the generation of more accurate first correlation information.
[0084] Based on the first association information, capacity change information associated with the current storage space can be determined. Based on the capacity change information associated with the current storage space, a process of first capacity change of the current storage space can be determined.
[0085] In addition, based on the process of the first capacity change of the current storage space, it can be determined whether the data in the current storage space has changed. For example, if the process of the first capacity change of the current storage space is a significant change in the used capacity of the current storage space and the time when the used capacity significantly changed, based on the significant change in the used capacity, it can be determined that a large amount of data has been written or deleted from the current storage space, and based on the time when the used capacity significantly changed, it can be determined when a large amount of data has been written or deleted from the current storage space.
[0086] Step S104: When confirming that first data corresponding to the data in the current storage space has been generated, generate at least second association information including an association relationship between the first association information and the first data, wherein the first data is used to back up or restore the data in the current storage space.
[0087] Based on the second association information, first association information associated with the first data can be determined. Based on the first association relationship associated with the first data, at least the creation history and / or change history of the first data can be determined.
[0088] In the case that the current storage space is a virtual current storage space, the first data may be, but is not limited to, a snapshot.
[0089] Step S105: Store at least the first association information and the second association information.
[0090] In this embodiment, by obtaining the first capacity of the current storage space, based on the first capacity of the current storage space, the capacity change information of the first capacity of the current storage space is determined, and first association information containing the association relationship between the capacity change information and the current storage space is generated. The first association information can be used as reference data to determine whether the data in the current storage space has changed. Based on the data change of the current storage space, the data migration status when the current storage space is migrated can be identified, and it can be determined whether there is a risk of leakage of the data in the current storage space.
[0091] When it is confirmed that the first data corresponding to the data in the current storage space has been generated, at least second associated information containing the association relationship between the first associated information and the first data is generated. The first data is used to back up or restore the data in the current storage space. The second associated information can be used as reference data for changes in the first data corresponding to the data in the current storage space. Based on the changes in the first data, the migration status of the first data when it is migrated in the current storage space can be determined. Since the first data can back up or restore the data in the current storage space, by determining the migration status of the first data, it can also be determined whether there is a risk of leakage of the data in the current storage space.
[0092] Based on the result of whether there is a risk of data leakage in the current storage space, it is helpful to perform further operations on the data related to the migration of the current storage space, such as increasing the migration scope (such as migrating the relevant first data); or destroying the current storage space or first data that may cause data leakage risk.
[0093] As another optional embodiment of the present application, refer to Figure 2 , is a flow chart of Example 2 of a processing method provided by this application. This example is mainly an extension of the processing method described in Example 1 above. The method may include but is not limited to the following steps:
[0094] Step S201: Obtain a first capacity of the current storage space.
[0095] Step S202: Determine capacity change information of the first capacity of the current storage space based on the first capacity of the current storage space.
[0096] Step S203: Generate first association information including an association relationship between the capacity change information and the current storage space.
[0097] Step S204: When confirming that first data corresponding to the data in the current storage space has been generated, at least second association information including an association relationship between the first association information and the first data is generated, and the first data is used to back up or restore the data in the current storage space.
[0098] Step S205: Store at least the first association information and the second association information.
[0099] The detailed process of steps S201-S205 can be found in the relevant introduction of steps S101-S105 in Example 1, and will not be repeated here.
[0100] Step S206: Determine first output information representing a historical change process of an object associated with the current storage space based on the first association information and the second association information.
[0101] In this embodiment, the object associated with the current storage space may be, but is not limited to: the capacity of the current storage space or the first data corresponding to the data in the current storage space.
[0102] For an implementation in which the object associated with the current storage space is the capacity of the current storage space, determining first output information representing a historical change process of the object associated with the current storage space based on the first association information and the second association information may include:
[0103] S2061. Based on the first association information, obtain capacity change information of the current storage space.
[0104] S2062: Based on the second association information, obtain first data corresponding to the data in the current storage space associated with the first association information.
[0105] It can be understood that the first data corresponding to the data in the current storage space associated with the first association information can reflect the state of the capacity of the current storage space when the first data is generated.
[0106] S2063: Determine first output information representing a historical change process of the capacity of the current storage space based on the acquired capacity change information of the current storage space and the first data.
[0107] When the first data can reflect the state of the capacity of the current storage space, based on the acquired capacity change information of the current storage space and the first data, the accuracy of the historical change process of the capacity of the current storage space can be guaranteed, thereby improving the accuracy of the first output information.
[0108] In an embodiment where the object associated with the current storage space is first data corresponding to data in the current storage space, determining first output information representing a historical change process of the object associated with the current storage space based on the first association information and the second association information may include:
[0109] S2064: Based on the second association information, obtain first association information associated with the first data corresponding to the data in the current storage space from the stored first association information.
[0110] S2065: Determine first output information representing a historical change process of first data corresponding to the data in the current storage space based on the acquired first association information.
[0111] In this embodiment, the first output information may include but is not limited to: a historical evolution graph and / or a data leakage risk report.
[0112] In this embodiment, based on the first association information and the second association information, first output information representing the historical change process of the object associated with the current storage space is determined, which helps to more intuitively and promptly confirm the data leakage risk and improve user experience.
[0113] As another optional embodiment of the present application, refer to Figure 3 , is a flow chart of Example 3 of a processing method provided by this application. This example is mainly an extension of the processing method described in Example 1 above. The method may include but is not limited to the following steps:
[0114] Step S301: Obtain a first capacity of the current storage space.
[0115] Step S302: Determine capacity change information of the first capacity of the current storage space based on the first capacity of the current storage space.
[0116] Step S303: Generate first association information including an association relationship between the capacity change information and the current storage space.
[0117] Step S304: When confirming that first data corresponding to the data in the current storage space has been generated, at least second association information including an association relationship between the first association information and the first data is generated, and the first data is used to back up or restore the data in the current storage space.
[0118] The detailed process of steps S301-S304 can be found in the relevant introduction of steps S101-S104 in Example 1, and will not be repeated here.
[0119] Step S305: When migrating the virtual device and the virtual device is created based on the first data, generate third association information including an association relationship between the second association information and the virtual device.
[0120] In this embodiment, the virtual device may include but is not limited to: a virtual machine or a cloud hard disk. It is understood that when the virtual device is a cloud hard disk, the cloud hard disk can establish a connection with the virtual machine, and the virtual machine can perform operations such as reading and writing on the cloud hard disk.
[0121] Generating the third association information including the association relationship between the second association information and the virtual device may include, but is not limited to:
[0122] S3051: Obtain second association information including an association relationship between first data used to create a virtual device and first association information.
[0123] S3052: Construct an association relationship between the second association information and the virtual device.
[0124] S3053: Generate third association information including an association relationship between the second association information and the virtual device.
[0125] Based on the third association information, second association information associated with the virtual device can be determined. Based on the second association information associated with the virtual device, at least a creation and / or change history of the virtual device can be determined.
[0126] Step S306: Store at least the first association information, the second association information, and the third association information.
[0127] Step S306 is a specific implementation of step S105 in Example 1.
[0128] In this embodiment, when migrating a virtual device, the migration status of the first data associated with the virtual device when the virtual device is migrated can be determined based on the second association information associated with the virtual device. Since the virtual device is generated based on the first data, at least part of the data in the virtual device can be restored based on the first data. Therefore, by identifying the migration status of the first data, it can be determined whether there is a risk of leakage of the data in the virtual device. For example, Figure 4 As shown, in the resource management process of cloud computing, if cloud hard disk a generates several snapshots, represented as snapshot a1, snapshot a2, and snapshot a3, and cloud hard disk b is created based on snapshot a2, cloud hard disk b generates several snapshots corresponding to the data in cloud hard disk b (e.g., snapshot b1, snapshot b2), cloud hard disk c is created based on snapshot b1, and after determining capacity change information of a first capacity of cloud hard disk c and generating first association information including an association relationship between cloud hard disk c and the capacity change information, if, when generating several snapshots corresponding to the data in cloud hard disk b, at least second association information including an association relationship between the first association information and snapshot b1 is generated, during the migration of cloud hard disk c from tenant A to tenant B, all the data in cloud hard disk c is migrated from tenant A to tenant B, but snapshot b1 is not migrated from tenant A to tenant B. Then, based on the second association information associated with cloud hard disk c and the migration data obtained from tenant B, it can be identified that snapshot b1 was not migrated from tenant A to tenant B, and a risk of data leakage of cloud hard disk c is identified.
[0129] As another optional embodiment of the present application, refer to Figure 5 , is a flow chart of Example 4 of a processing method provided by this application. This example is mainly an extension of the processing method described in Example 3 above. The method may include but is not limited to the following steps:
[0130] Step S401: Obtain a first capacity of the current storage space.
[0131] Step S402: Determine capacity change information of the first capacity of the current storage space based on the first capacity of the current storage space.
[0132] Step S403: Generate first association information including an association relationship between the capacity change information and the current storage space.
[0133] Step S404: When confirming that first data corresponding to the data in the current storage space has been generated, generate at least second association information including an association relationship between the first association information and the first data, the first data being used to back up or restore the data in the current storage space.
[0134] Step S405: When migrating the virtual device and the virtual device is created based on the first data, generate third association information including an association relationship between the second association information and the virtual device.
[0135] Step S406: Store at least the first association information, the second association information, and the third association information.
[0136] The detailed process of steps S401-S406 can be found in the relevant introduction of steps S301-S306 in Example 3, and will not be repeated here.
[0137] Step S407: Determine second output information representing a historical change process of the virtual device based on the first association information, the second association information, and the third association information.
[0138] In this embodiment, determining the second output information representing the historical change process of the virtual device based on the first association information, the second association information, and the third association information may include:
[0139] S4061. Based on the third association information, obtain second association information associated with the virtual device;
[0140] S4062: Based on the acquired second association information, acquire first data used to create the virtual device and first association information associated with the first data used to create the virtual device.
[0141] S4063: Determine second output information representing a historical change process of the virtual device based on the first data used to create the virtual device and the first association information associated with the first data used to create the virtual device.
[0142] The second output information may include but is not limited to: a historical evolution diagram and / or a data leakage risk report.
[0143] In this embodiment, second output information representing the historical change process of the virtual device is determined based on the first association information, the second association information and the third association information, so that the second output information is determined based on more comprehensive information and the accuracy of the second output information is guaranteed.
[0144] As another optional embodiment of the present application, refer to Figure 6 , is a flow chart of Example 5 of a treatment method provided by this application. This example is mainly a refinement of the treatment method described in Example 1 above. The method may include but is not limited to the following steps:
[0145] Step S501: Obtain a first capacity of the current storage space.
[0146] The detailed process of step S501 can be found in the relevant introduction of step S101 in embodiment 1, and will not be repeated here.
[0147] Step S502: Based on a resampling window of a set size, the first capacity of the current storage space is sampled according to a set resampling step size to determine capacity change information of the first capacity of the current storage space.
[0148] The size of the resampling window and the resampling step can be set as needed and are not limited in this application.
[0149] In this embodiment, based on a resampling window of a set size, sampling the first capacity of the current storage space according to a set resampling step size, and determining the capacity change information of the first capacity of the current storage space may include:
[0150] S5021. Based on a resampling window of a set size, sample a first capacity of the current storage space according to a set resampling step size that is larger than a set threshold, and determine a maximum capacity and a minimum capacity within the resampling window.
[0151] S5022: Determine the difference between the maximum capacity and the minimum capacity.
[0152] S5023: Perform an abnormality detection on the difference to obtain capacity change information of the first capacity of the current storage space.
[0153] Anomaly detection on the difference may include but is not limited to:
[0154] Determine whether the difference exceeds a first set difference threshold, and if so, determine that the difference is an abnormal value.
[0155] The first set difference threshold is determined by:
[0156] S50231. Obtain the historical maximum capacity of the current storage space;
[0157] S50232: Using the sampling window, sample the historical first capacity of the current storage space according to the sampling step size, and determine the maximum and minimum historical capacity values within the sampling window;
[0158] S50233. Determine a first difference between the historical maximum capacity and the historical minimum capacity;
[0159] S50234. Determine a first percentage of first differences that are less than the first set upper limit of difference in all first differences by respectively determining whether the first difference is less than each first set upper limit of difference;
[0160] S50235: If the difference between the first percentage and the first set percentage is within the first set range, use the first set difference upper limit corresponding to the first percentage as the first set difference threshold.
[0161] Anomaly detection on the difference may also include but is not limited to:
[0162] S50236. Obtain a second difference between the maximum capacity and the minimum capacity of a historical resampling window adjacent to the resampling window;
[0163] S50237. Determine whether a set fluctuation event occurs between the second difference and the difference.
[0164] If so, the difference is determined to be an outlier.
[0165] The set fluctuation events may include: sudden increase events and / or sudden decrease events.
[0166] In this embodiment, another implementation of sampling the first capacity of the current storage space according to a set resampling step size based on a set resampling window size and determining the capacity change information of the first capacity of the current storage space may include:
[0167] S5024: Based on the resampling window of the set size, sample the first capacity of the current storage space according to a set resampling step size that is larger than the first set threshold, and determine the maximum capacity and the minimum capacity within the resampling window.
[0168] S5025: Determine the difference between the maximum capacity and the minimum capacity.
[0169] S5026: Perform an anomaly detection on the difference between the maximum capacity and the minimum capacity to obtain a first detection result.
[0170] The detailed process of steps S5024-S5026 can be found in the aforementioned steps S5021-S5023, which will not be repeated here.
[0171] S5027: Based on the resampling window of the set size, sample the first capacity of the current storage space according to a set resampling step size that is smaller than a second set threshold, and determine a difference between two adjacent resampling windows.
[0172] In this embodiment, the second set threshold value and the first set threshold value may be the same. Of course, the second set threshold value may also be smaller than the first set threshold value.
[0173] Based on a resampling window of a set size, sampling the first capacity of the current storage space according to a set resampling step size that is smaller than a second set threshold value, and determining the difference between two adjacent resampling windows, which can be understood as:
[0174] S50271. Based on a resampling window of a set size, the first capacity of the current storage space is sampled according to a set resampling step size that is smaller than a second set threshold value to obtain the first capacity within the resampling window, and the first capacity within the resampling window is arithmetic-processed to obtain an arithmetic-processed value of the first capacity within the resampling window.
[0175] In this embodiment, the first capacity in the resampling window is processed to obtain a processed value of the first capacity in the resampling window, which may include but is not limited to:
[0176] Performing an averaging operation on the first capacity within the resampling window to obtain a mean value of the first capacity within the resampling window;
[0177] or, determining a maximum value in the first capacity within the resampling window;
[0178] or, determining a minimum value in a first capacity within a resampling window;
[0179] Alternatively, a median operation is performed on the first capacity within the resampling window to obtain a median of the first capacity within the resampling window.
[0180] S50272: Determine the difference between the operation-processed values of the first capacity in two adjacent resampling windows as the difference between the two adjacent resampling windows.
[0181] It is understandable that the manners of performing the calculation and processing on the first capacity in two adjacent resampling windows may be the same or different.
[0182] When the manner of performing computational processing on the first capacity in two adjacent resampling windows is the same, the types of the computational processed values of the first capacity in the two adjacent resampling windows are the same. Accordingly, determining the difference between the computational processed values of the first capacity in the two adjacent resampling windows as the difference between the two adjacent resampling windows may include:
[0183] Determine the difference between the means of the first capacities in two adjacent resampling windows as the difference between the two adjacent resampling windows;
[0184] Alternatively, the difference between the maximum values of the first capacity in two adjacent resampling windows is determined as the difference value in the two adjacent resampling windows;
[0185] Alternatively, the difference between the minimum values of the first capacity in two adjacent resampling windows is determined as the difference value in the two adjacent resampling windows;
[0186] Alternatively, the difference between the medians of the first capacities in two adjacent resampling windows is determined as the difference between the two adjacent resampling windows.
[0187] In a case where different methods of performing computation on the first capacities in two adjacent resampling windows are used, the types of computationally processed values of the first capacities in the two adjacent resampling windows are different. Accordingly, determining the difference between the computationally processed values of the first capacities in the two adjacent resampling windows as the difference between the two adjacent resampling windows may include:
[0188] The difference between the maximum value of the first capacity of the first resampling window and the minimum value of the first capacity of the second resampling window in the two adjacent resampling windows is determined as the difference between the two adjacent resampling windows.
[0189] The different calculation methods for the first capacities in two adjacent resampling windows can more clearly show the changes in the first capacities in the two adjacent resampling windows.
[0190] S5028. Perform anomaly detection on the difference between two adjacent resampling windows to obtain a second detection result.
[0191] Anomaly detection is performed on the difference between two adjacent resampling windows, which may include:
[0192] It is determined whether the difference between two adjacent resampling windows exceeds a second set difference threshold; if so, the difference is determined to be an abnormal value.
[0193] The second set difference threshold is determined by:
[0194] S50281. Obtain the historical maximum capacity of the current storage space;
[0195] S50282: Using the sampling window, sample the historical first capacity of the current storage space according to the sampling step size, and determine the average value of the historical capacity within the sampling window;
[0196] S50283. Determine a second difference between the average values of historical capacities in two adjacent sampling windows;
[0197] S50284. Determine a second percentage of second differences less than the second set upper limit in all second differences by respectively determining whether the second difference is less than each second set upper limit.
[0198] S50285: If the difference between the second percentage and the second set percentage is within the second set range, use the second set difference upper limit corresponding to the second percentage as the second set difference threshold.
[0199] S5029: Perform an OR logic operation on the first detection result and the second detection result to obtain capacity change information of the first capacity of the current storage space.
[0200] Step S502 is a specific implementation of step S102 in Example 1.
[0201] Step S503: Generate first association information including an association relationship between the capacity change information and the current storage space.
[0202] Step S504: When confirming that first data corresponding to the data in the current storage space has been generated, at least second association information including an association relationship between the first association information and the first data is generated, and the first data is used to back up or restore the data in the current storage space.
[0203] Step S505: Store at least the first association information and the second association information.
[0204] The detailed process of steps S503-S505 can be found in the relevant introduction of steps S103-S105 in Example 1, and will not be repeated here.
[0205] In this embodiment, based on a resampling window of a set size, the first capacity of the current storage space is sampled according to a set resampling step size greater than a first set threshold and a set resampling step size less than a second set threshold, respectively, and then a first detection result and a second detection result are obtained respectively, and an OR logical operation is performed on the first detection result and the second detection result to obtain capacity change information of the first capacity of the current storage space. Compared with the method of determining the capacity change information of the first capacity of the current storage space based on the first detection result or the second detection result, the detection error rate can be reduced and the accuracy of the capacity change information can be improved.
[0206] As another optional embodiment of the present application, refer to Figure 7 , is a flow chart of Example 6 of a treatment method provided by this application. This example is mainly a refinement of the treatment method described in Example 1 above. The method may include but is not limited to the following steps:
[0207] Step S601: If the current storage space is the storage space corresponding to the virtual device created based on the first data, obtain a second capacity obtained by monitoring the capacity of the first storage space before generating the first data, and the first storage space is the storage space for generating the first data.
[0208] If the current storage space is the storage space corresponding to the virtual device created based on the first data, the virtual device created based on the first data may operate on the current storage space based on the data in the first storage space. Therefore, the capacity of the first storage space before generating the first data may affect the capacity change of the current storage space.
[0209] Step S602: Obtain a third capacity obtained by monitoring the capacity of the current storage space, and concatenate the second capacity and the third capacity to obtain the first capacity of the current storage space.
[0210] Step S603: Determine capacity change information of the first capacity of the current storage space based on the first capacity of the current storage space.
[0211] Step S604: Generate first association information including an association relationship between the capacity change information and the current storage space.
[0212] Step S605: When confirming that first data corresponding to the data in the current storage space has been generated, generate at least second association information including an association relationship between the first association information and the first data, where the first data is used to back up or restore the data in the current storage space.
[0213] Step S606: Store at least the first association information and the second association information.
[0214] The detailed process of steps S603-S606 can be found in the relevant introduction of the above embodiments and will not be repeated here.
[0215] In this embodiment, the second capacity obtained by monitoring the capacity of the first storage space before generating the first data and the third capacity obtained by monitoring the capacity of the current storage space are spliced to obtain the first capacity of the current storage space with a longer life cycle. Based on the first capacity of the current storage space with a longer life cycle, the accuracy of the capacity change information of the first capacity can be improved.
[0216] Next, a processing device provided by the present application is introduced. The processing device introduced below and the processing method introduced above can be referenced to each other.
[0217] See Figure 8 The processing device includes: an obtaining module 100, a first determining module 200, a first generating module 300, a second generating module 400 and a storage module 500.
[0218] An obtaining module 100 is configured to obtain a first capacity of a current storage space;
[0219] A first determining module 200 is configured to determine capacity change information of the first capacity of the current storage space based on the first capacity of the current storage space;
[0220] A first generating module 300 is configured to generate first association information including an association relationship between the capacity change information and the current storage space;
[0221] The second generating module 400 is configured to generate, upon confirming that first data corresponding to the data in the current storage space has been generated, at least second association information including an association relationship between the first association information and the first data, the first data being used to back up or restore the data in the current storage space;
[0222] The storage module 500 is configured to store at least the first association information and the second association information.
[0223] In this embodiment, the processing device may further include:
[0224] The second determining module is configured to determine first output information representing a historical change process of an object associated with the current storage space based on the first association information and the second association information.
[0225] In this embodiment, the processing device may further include:
[0226] The third generating module is configured to generate third association information including an association relationship between the second association information and the virtual device when migrating the virtual device and the virtual device is created based on the first data.
[0227] Correspondingly, the storage module 500 is specifically configured to store the first association information, the second association information, and the third association information.
[0228] In this embodiment, the processing device may further include:
[0229] The third determining module is configured to determine second output information representing a historical change process of the virtual device based on the first association information, the second association information, and the third association information.
[0230] In this embodiment, the first generating module 300 may be specifically configured to:
[0231] Remove interference information from capacity change information to obtain target change information;
[0232] First association information including an association relationship between the target change information and the current storage space is generated.
[0233] In this embodiment, the first determining module 200 may be specifically configured to:
[0234] Based on a resampling window of a set size, the first capacity of the current storage space is sampled according to a set resampling step size to determine capacity change information of the first capacity of the current storage space.
[0235] The first determining module 200 may be specifically configured to:
[0236] Based on a resampling window of a set size, sampling a first capacity of the current storage space according to a set resampling step size that is greater than a set threshold, and determining a maximum capacity and a minimum capacity within the resampling window;
[0237] Determine the difference between the maximum capacity and the minimum capacity;
[0238] Anomaly detection is performed on the difference to obtain capacity change information of the first capacity of the current storage space.
[0239] Alternatively, the first determining module 200 may be specifically configured to:
[0240] Based on a resampling window of a set size, sampling a first capacity of the current storage space according to a set resampling step size that is greater than a first set threshold, and determining a maximum capacity and a minimum capacity within the resampling window;
[0241] Determine the difference between the maximum capacity and the minimum capacity;
[0242] Performing an anomaly detection on the difference between the maximum capacity and the minimum capacity to obtain a first detection result;
[0243] Based on a resampling window of a set size, sampling a first capacity of the current storage space according to a set resampling step size that is smaller than a second set threshold, and determining a difference between two adjacent resampling windows;
[0244] Performing anomaly detection on the difference between two adjacent resampling windows to obtain a second detection result;
[0245] An OR logic operation is performed on the first detection result and the second detection result to obtain capacity change information of the first capacity of the current storage space.
[0246] In this embodiment, the obtaining module 100 may be specifically used to:
[0247] If the current storage space is a storage space corresponding to a virtual device created based on the first data, obtaining a second capacity obtained by monitoring the capacity of the first storage space before the first data is generated, the first storage space is the storage space for generating the first data;
[0248] A third capacity is obtained by monitoring the capacity of the current storage space, and the second capacity and the third capacity are concatenated to obtain the first capacity of the current storage space.
[0249] Corresponding to the above-mentioned processing method embodiment provided by the present application, the present application also provides an electronic device embodiment applying the processing method.
[0250] like Figure 9The figure shows a schematic diagram of the structure of an electronic device embodiment 1 provided by the present application. The electronic device may include the following structure:
[0251] Memory 10 and processor 20.
[0252] Memory 10, for storing at least one set of instruction sets;
[0253] The processor 20 is used to call and execute the instruction set in the memory 10, and execute the processing method introduced in any one of the above method embodiments 1-6 by executing the instruction set.
[0254] Corresponding to the above-mentioned processing method embodiment provided by the present application, the present application also provides an embodiment of a storage medium.
[0255] In this embodiment, the storage medium stores a computer program for implementing the processing method described in any one of method embodiments 1-6, and the computer program is executed by the processor to implement the processing method described in any one of embodiments 1-6.
[0256] It should be noted that each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to in detail. For the device embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.
[0257] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or device comprising the element.
[0258] For the convenience of description, the above device is described as being divided into various modules according to their functions. Of course, when implementing this application, the functions of each module can be implemented in the same or multiple software and / or hardware.
[0259] Through the description of the above embodiments, it can be seen that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present application or certain parts of the embodiments.
[0260] The above is a detailed introduction to a processing method and device provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of the present application. At the same time, for those skilled in the art, according to the idea of the present application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A processing method comprising: Get the first capacity of the current storage space; determining, based on the first capacity of the current storage space, capacity change information of the first capacity of the current storage space; generating first association information including an association relationship between the capacity change information and the current storage space; Upon confirming that first data corresponding to the data in the current storage space has been generated, at least second association information including an association relationship between the first association information and the first data is generated, the first data being used to back up or restore the data in the current storage space; wherein the second association information serves as reference data for changes in the first data corresponding to the data in the current storage space, and based on the changes in the first data, a migration status of the first data when migration occurs in the current storage space can be determined, thereby determining whether there is a risk of leakage of the data in the current storage space; At least the first association information and the second association information are stored.
2. The method according to claim 1, further comprising: Based on the first association information and the second association information, first output information representing a historical change process of the object associated with the current storage space is determined.
3. The method according to claim 1, further comprising: When migrating a virtual device, and the virtual device is created based on the first data, generating third association information including an association relationship between the second association information and the virtual device; The storing of at least the first association information and the second association information includes: The first association information, the second association information, and the third association information are stored.
4. The method according to claim 3, further comprising: Second output information representing a historical change process of the virtual device is determined based on the first association information, the second association information, and the third association information.
5. The method according to claim 1, wherein generating first association information including an association relationship between the capacity change information and the current storage space comprises: removing interference information from the capacity change information to obtain target change information; First association information including an association relationship between the target change information and the current storage space is generated.
6. The method according to any one of claims 1 to 5, wherein determining the capacity change information of the first capacity of the current storage space based on the first capacity of the current storage space comprises: Based on a resampling window of a set size, the first capacity of the current storage space is sampled according to a set resampling step size to determine capacity change information of the first capacity of the current storage space.
7. The method according to claim 6, wherein sampling the first capacity of the current storage space according to a set resampling step size based on a set resampling window size and determining the capacity change information of the first capacity of the current storage space comprises: Based on a resampling window of a set size, sampling a first capacity of the current storage space according to a set resampling step size that is greater than a set threshold, and determining a maximum capacity and a minimum capacity within the resampling window; determining a difference between the maximum capacity and the minimum capacity; Anomaly detection is performed on the difference to obtain capacity change information of the first capacity of the current storage space.
8. The method according to claim 6, wherein sampling the first capacity of the current storage space according to a set resampling step size based on a set resampling window size and determining the capacity change information of the first capacity of the current storage space comprises: Based on a resampling window of a set size, sampling a first capacity of the current storage space according to a set resampling step size that is greater than a first set threshold, and determining a maximum capacity and a minimum capacity within the resampling window; determining a difference between the maximum capacity and the minimum capacity; Performing an abnormality detection on a difference between the maximum capacity and the minimum capacity to obtain a first detection result; Based on a resampling window of a set size, sampling the first capacity of the current storage space according to a set resampling step size that is smaller than a second set threshold, and determining a difference between two adjacent resampling windows; Performing anomaly detection on the difference between two adjacent resampling windows to obtain a second detection result; An OR logic operation is performed on the first detection result and the second detection result to obtain capacity change information of the first capacity of the current storage space.
9. The method according to claim 6, wherein obtaining the first capacity of the current storage space comprises: If the current storage space is a storage space corresponding to a virtual device created based on the first data, obtaining a second capacity obtained by monitoring the capacity of the first storage space before the first data is generated, the first storage space being the storage space in which the first data is generated; A third capacity is obtained by monitoring the capacity of the current storage space, and the second capacity and the third capacity are concatenated to obtain a first capacity of the current storage space.
10. A processing device comprising: An obtaining module, configured to obtain a first capacity of a current storage space; a first determining module, configured to determine capacity change information of the first capacity of the current storage space based on the first capacity of the current storage space; A first generating module, configured to generate first association information including an association relationship between the capacity change information and the current storage space; a second generating module configured to, upon confirming that first data corresponding to the data in the current storage space has been generated, generate at least second association information including an association relationship between the first association information and the first data, the first data being used to back up or restore the data in the current storage space; wherein the second association information serves as reference data for changes in the first data corresponding to the data in the current storage space, and based on the changes in the first data, can determine a migration status of the first data when migration occurs in the current storage space, thereby determining whether there is a risk of leakage of the data in the current storage space; A storage module is configured to store at least the first association information and the second association information.
Citation Information
Patent Citations
Complete machine backup and recovery system and method
CN111930569A
Storage apparatus and control method therefor
US20120278569A1