Optimization method, device and equipment of computing power resources and storage medium

Abstract

The application discloses a computing resource optimization method and device, equipment and a storage medium. The method comprises the following steps: obtaining the use demand of a user terminal when using network data and the use computing resource of a network storage device; based on the computing resource demand, the use computing resource is optimized by using a preset optimization mode, and the optimized computing resource is obtained, so that the user terminal normally uses the network data based on the optimized computing resource; wherein the optimization mode is at least one of computing resource allocation, node change and data migration. In the application, at least one of the optimization modes of computing resource allocation, node change and data migration is used to optimize the use computing resource, and the use network resource is indirectly changed when the use computing resource is optimized, so that the cooperation between the computing resource and the network resource is optimized, and the optimization effect is optimized, thereby improving the optimization efficiency of the computing resource.

Description

Technical Field

[0001] This application relates to the field of cloud computing technology, and in particular to a method, apparatus, device and storage medium for optimizing computing resources. Background Technology

[0002] As computing resources become more widely used, more and more data is being stored on computing resources to provide users with efficient and secure storage space.

[0003] Typically, computing resources are physically located far from the user's actual location. When a user uses data from these resources, network or computing resources may not meet the demand. In such cases, optimization of the data or computing power within the resources is necessary. Currently, computing resource optimization involves allocating the best matching region for each computing task based on a comprehensive weight value across different regions. Network resource optimization involves migrating all data from the computing resources to optimized storage devices. However, current optimization methods can lead to congestion of computing nodes or waste of resources and time, failing to achieve optimal optimization results and resulting in reduced optimization efficiency. Summary of the Invention

[0004] The main objective of this application is to provide a method, apparatus, device, and storage medium for optimizing computing resources, aiming to solve the technical problem in the prior art that the optimization effect of computing resources cannot be maximized, resulting in a decrease in the optimization efficiency of computing resources.

[0005] To achieve the above objectives, this application provides a method for optimizing computing resources, which includes:

[0006] Acquire user needs when using network data and the computing resources used by network storage devices;

[0007] Based on the computing power requirements, the computing power resources used are optimized using a preset optimization method to obtain optimized computing power resources, so that the user terminal can use the network data normally based on the optimized computing power resources;

[0008] The optimization method must be at least one of the following: computing power allocation, node modification, and data migration.

[0009] Optionally, the step of optimizing the use of computing power resources using the optimization method to obtain optimized computing power resources includes:

[0010] If the remaining unused resources in the computing nodes of the network storage device and the total number of computing resources used meet the resource requirements of the computing power demand in the usage requirements, then new computing power resources are determined from the remaining resources, and the availability of the new computing power resources is detected.

[0011] If the newly added computing resources are available, then the user terminal is requested to terminate the use of the network data;

[0012] The newly added computing resources are combined with the used computing resources to obtain the merged computing resources, and the merged computing resources are detected.

[0013] If both the merged computing resources and the network resources used by the user terminal meet the usage requirements, then the computing resources are optimized, and the user terminal's use of the network data is restored.

[0014] Optionally, the step of optimizing the use of computing resources by changing the node to obtain optimized computing resources includes:

[0015] If the total computing power does not meet the resource quantity, or the merged computing power resources and the used network resources do not meet the usage requirements, or only the used network resources do not meet the network requirements in the usage requirements, then the merging parameter information of the merged computing power resources will be packaged into a request command.

[0016] Based on the request command, the edge computing node closest to the user terminal is determined, and the request command is sent to the edge computing node so that the edge computing node can allocate the merged computing resources based on the merged parameter information;

[0017] After determining that the edge computing node has completed the allocation of the merged computing resources, the computing node position in the merged parameter information is modified to the edge node position, and the user terminal is requested to stop using the network data.

[0018] Switching the location of the computing node in the network connection to the location of the edge node results in switching computing resources;

[0019] If the switching of computing resources and the use of network resources meet the usage requirements, then the computing resources are optimized, and the user terminal's operation of using the network data is restored.

[0020] Optionally, the step of optimizing the use of computing resources using data migration optimization methods to obtain optimized computing resources further includes:

[0021] If the switching of computing resources and the use of network resources do not meet the usage requirements, then the migration data center closest to the edge computing node is determined;

[0022] The hot data filtered from the network data is transmitted to the migration data center, and the migration progress of the hot data is recorded in real time so that the migration data center can obtain the migration data;

[0023] If the migration progress meets the preset progress, then the user terminal is requested to stop using the network data;

[0024] Create read / write strategies for the migrated data and the unmigrated data in the network data;

[0025] Based on the read / write strategy, the data information of the hot data is updated to obtain optimized computing resources, and the user terminal's operation of using the network data is restored.

[0026] Optionally, after the steps of updating the data information of the hot data based on the read / write strategy to obtain optimized computing resources and restore the user's operation of using the network data, the method further includes:

[0027] If a restore command to restore the hot data is received, then the migration storage information of the migration data center is obtained;

[0028] Based on the storage volume of the hot data in the migration storage information, expand the local data center where the unmigrated data is located;

[0029] Receive the hot data transmitted from the migrated data center and save the hot data to the expanded local data center;

[0030] Create read / write policies for hot data migrated to the local data center and for the non-migrated data, and update the data information of the hot data to complete the optimization and recovery.

[0031] Optionally, the step of creating a read / write strategy for the migrated data and the unmigrated data in the network data includes:

[0032] Determine the accuracy of the migration data;

[0033] If the accuracy of the migrated data meets the preset accuracy requirements, then a read / write strategy is created for the migrated data and the unmigrated data in the network data.

[0034] Optionally, the step of optimizing the use of computing resources based on the computing power requirement using a preset optimization method to obtain optimized computing power resources further includes:

[0035] Based on the computing power requirements, the computing power resources used are optimized using a preset optimization method;

[0036] The system monitors in real time whether the optimized computing resources and network resources used by the user terminal meet the usage requirements. If the usage requirements are met, the optimized computing resources are obtained.

[0037] This application also provides a computing power resource optimization device, which includes:

[0038] The acquisition module is used to acquire the user's usage requirements when using network data and the computing power resources used by network storage devices.

[0039] An optimization module is used to optimize the computing resources used based on the computing power requirements using a preset optimization method to obtain optimized computing resources, so that the user terminal can use the network data normally based on the optimized computing resources.

[0040] The optimization method must be at least one of the following: computing power allocation, node modification, and data migration.

[0041] This application also provides a computing resource optimization device, which is a physical node device. The computing resource optimization device includes: a memory, a processor, and a program for a computing resource optimization method stored in the memory and executable on the processor. When the program for the computing resource optimization method is executed by the processor, it can implement the steps of the computing resource optimization method as described above.

[0042] This application also provides a storage medium storing a program that implements the above-described method for optimizing computing resources. When the program for optimizing computing resources is executed by a processor, it implements the steps of the above-described method for optimizing computing resources.

[0043] This application provides a method, apparatus, device, and storage medium for optimizing computing resources. Compared with existing technologies that fail to achieve optimal optimization results, leading to reduced optimization efficiency, this application obtains the user's usage requirements when using network data and the computing resources used by the network storage device. Based on the computing requirements, the computing resources are optimized using a preset optimization method to obtain optimized computing resources, which are then used by the user to normally use the network data. The optimization method is at least one of computing power allocation, node modification, and data migration. In this application, based on the user's usage requirements when using network data, at least one of the following optimization methods—computing power allocation optimization, node modification optimization, and data migration optimization—is used to optimize the computing power resources of the network storage device to obtain optimized computing power resources. This optimized computing power resources allow the user to use the network data normally. In other words, in this application, at least one of the following optimization methods—computing power allocation, node modification, and data migration—is used to optimize the use of computing power resources. In optimizing the use of computing power resources, the use of network resources is indirectly changed to achieve the best coordination between computing power resources and network resources, thereby achieving the best optimization effect and improving the optimization efficiency of computing power resources. Attached Figure Description

[0044] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0045] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 This is a flowchart illustrating the first embodiment of the method for optimizing computing resources according to this application.

[0047] Figure 2 This is a schematic diagram of the network resource and computing resource optimization process in the computing resource optimization method of this application;

[0048] Figure 3 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of this application;

[0049] Figure 4 This is a schematic diagram of the node optimization process in the method for optimizing computing resources in this application;

[0050] Figure 5 This is a flowchart illustrating the second embodiment of the method for optimizing computing resources according to this application;

[0051] Figure 6 This is a schematic diagram of the data migration optimization process in the method for optimizing computing resources in this application;

[0052] Figure 7 This is a schematic diagram of the resource allocation module in the optimization method for computing power resources in this application;

[0053] Figure 8 This is a schematic diagram of the data migration hot data module in the computing power resource optimization method of this application;

[0054] Figure 9 This is a schematic diagram of the data resource monitoring module in the method for optimizing computing resources in this application.

[0055] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0056] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0057] This application provides a method for optimizing computing resources. In the first embodiment of this method, referring to... Figure 1 Methods for optimizing computing resources include:

[0058] Step S10: Obtain the user's usage requirements when using network data and the computing power resources used by the network storage device;

[0059] Step S20: Based on the computing power requirement, the computing power resources used are optimized using a preset optimization method to obtain optimized computing power resources, so that the user terminal can use the network data normally based on the optimized computing power resources;

[0060] The optimization method must be at least one of the following: computing power allocation, node modification, and data migration.

[0061] This embodiment aims to optimize computing resources by sequentially optimizing computing resource allocation, changing nodes, and migrating data, and to optimize the use of network resources while optimizing the use of computing resources, thereby improving the optimization efficiency of computing resources.

[0062] In this embodiment, it should be noted that the method for optimizing computing resources can be applied to a device for optimizing computing resources, which is subordinate to a device for optimizing computing resources, and the device for optimizing computing resources is subordinate to a system for optimizing computing resources.

[0063] It should be noted that the computing power resources include a resource allocation module, a computing power node modification module, a hot data migration module, and a resource monitoring module. The computing power resources can belong to the computing power network system of cloud computing, or to the computing power network system of big data, etc., and are used to store cloud data, etc., without any specific limitation.

[0064] Specifically, the resource allocation module can allocate the remaining resources in the computing nodes after receiving a message that the computing resources used do not meet the usage requirements, so as to optimize the computing resource allocation. At the same time, during the computing resource allocation optimization process, the time interrupted for users to use network data should be minimized to ensure overall availability.

[0065] Specifically, the computing node modification module can discover the nearest and usable edge computing node to the user terminal, send a request command to the edge computing node, and complete the computing node switching work of computing resources to achieve the optimal position of the computing node, thereby optimizing the computing resources by changing the node.

[0066] Specifically, the hot data migration module can manage the storage of user cold and hot data. When it receives an optimization request, it backs up the hot data to other data centers. After the backup is completed, it merges the data from the two data centers back into a single data partition and retains the file system before the hot data migration, so as to optimize the computing resources through data migration.

[0067] Specifically, refer to Figure 9 The resource monitoring module includes a computing resource monitoring module, a network resource monitoring module, and a processing and analysis module.

[0068] Among them, the computing power resource monitoring module can monitor the computing power information of the computing power nodes that use computing power resources.

[0069] Among them, the network resource monitoring module can detect the network quality and network resource utilization when the user terminal uses network data.

[0070] The processing and analysis module can acquire data monitored by the computing power resource monitoring module and the network resource monitoring module, and analyze whether the use of computing power resources meets the usage requirements, whether the use of network resources meets the usage requirements, whether it is necessary to optimize the use of computing power resources or network resources, and issue specific optimization requests.

[0071] It should be noted that after each optimization, the optimization results need to be checked. If the optimized computing resources and network resources meet the usage requirements, no further optimization will be performed to reduce optimization time and avoid over-optimization that would waste resources and time.

[0072] It should be noted that when optimizing the use of computing resources, the physical distance between computing nodes and users will be shortened, or the physical distance between data centers storing hot data and users will be shortened, in order to reduce the requirements for network resources and thus optimize the use of network resources. In other words, network resources are optimized when computing resources are optimized.

[0073] In this embodiment, the resource monitoring module detects the user's network data usage in real time, analyzes the usage of computing resources and network resources, and determines whether the computing resources need to be optimized based on the usage of computing resources and network resources. If optimization is needed, optimization is carried out in sequence through computing power allocation, node modification and data migration. While optimizing the use of computing resources, the use of network resources is also optimized to dynamically adjust computing resources and network, improve the overall utilization rate of computing resources and network resources, and thus optimize the efficiency of computing resources.

[0074] In this embodiment, reference Figure 2 , Figure 2 This is a schematic diagram of the network resource and computing resource optimization process in the computing resource optimization method of this application.

[0075] The specific steps are as follows:

[0076] Step S10: Obtain the user's usage requirements when using network data and the computing power resources used by the network storage device;

[0077] It should be noted that the usage requirements of users when using network data can be monitored using the resource monitoring module, or by using external resource monitoring devices, to improve the flexibility of optimizing computing resources for network storage devices.

[0078] It should be noted that the resource monitoring module or resource monitoring device can detect the network resources on the user's end, making the optimization of network storage devices more suitable for the user's environment, thereby improving the user experience.

[0079] In this embodiment, the resource monitoring module or resource monitoring device monitors in real time the usage of computing resources in the network storage device and the usage of network resources on the user end when the user end uses network data, so as to optimize the computing resources according to the user end's usage environment and improve the user experience.

[0080] Among them, the computing resources used can be the computing resources that have already been used when the user uses network data.

[0081] Among them, using network resources can refer to network resources that have already been used when the user uses network data.

[0082] It should be noted that the processing and analysis module obtains the computing resources used from the computing resource monitoring module and analyzes whether the use of computing resources meets the computing power requirements. It also obtains the network resources used from the network resource monitoring module and analyzes whether the use of network resources meets the network requirements. Based on the specific analysis results, optimization requests are determined.

[0083] Among them, computing power demand can be the computing power resources that users need to use when using network data.

[0084] Among them, network requirements can be the network resources that a user needs to use when using network data.

[0085] Among them, optimization requests can be requests to optimize the use of computing resources or requests to optimize network resources. In other words, optimization requests are determined based on the specific usage of network data by the user.

[0086] In this embodiment, the monitored usage is analyzed, and the resources that need to be optimized are determined based on the analysis. That is, it is analyzed whether the computing power resources used meet the computing power requirements of the user. If not, an optimization request for optimizing the use of computing power resources is obtained. If they meet, it is then analyzed whether the use of network resources meets the network requirements of the user. If not, an optimization request for optimizing the use of network resources is obtained.

[0087] Step S20: Based on the computing power requirement, the computing power resources used are optimized using a preset optimization method to obtain optimized computing power resources, so that the user terminal can use the network data normally based on the optimized computing power resources;

[0088] The optimization method must be at least one of the following: computing power allocation, node modification, and data migration.

[0089] In this embodiment, before optimizing the allocation of computing power, changing nodes, and migrating data using computing power resources, it is necessary to determine the specific optimization request. If the optimization request aims to optimize the use of computing power resources, then the allocation of computing power, changing nodes, and migrating data are optimized sequentially.

[0090] In this embodiment, if the optimization request aims to optimize the use of network resources, then the use of computing resources is optimized by changing nodes and data migration. In the process of optimizing the use of computing resources, the physical distance from the computing node to the user terminal is reduced, or the storage location of hot data in the network data is changed, so as to reduce the user terminal's use of network resources and thus optimize the network resources of the user terminal.

[0091] In this embodiment, by optimizing the use of computing resources and optimizing the use of network resources during the optimization process, the computing resources and network resources are dynamically adjusted to maximize their utilization, reduce the waste of computing resources and network resources, and enable users to smoothly use network data through the optimized computing resources and optimized network computing resources, thereby improving the user experience.

[0092] Specifically, the step of optimizing the use of computing power resources using the optimization method to obtain optimized computing power resources includes:

[0093] Step A10: If the remaining unused resources in the computing nodes of the network storage device and the total number of computing resources used meet the resource requirements of the computing power demand in the usage requirements, then new computing power resources are determined from the remaining resources, and the availability of the new computing power resources is detected.

[0094] In this embodiment, the optimization of computing power allocation is performed in the resource allocation module. The resource management module in the resource allocation module analyzes the unused computing power resources, i.e. the remaining resources, in the computing power nodes of the network storage device, and checks whether the total amount of computing power of the remaining resources and the used resources meets the required amount of computing power.

[0095] Specifically, refer to Figure 7 The resource allocation module also includes a computing resource pre-allocation module, a computing resource merging module, and a system control module.

[0096] In this embodiment, if the total computing power meets the resource requirements of Sun's computing power needs, the computing power resource pre-allocation module determines the new computing power resources that need to be added from the remaining resources, places the new computing power resources in a pre-allocation state, and detects the availability of the new computing power resources in the pre-allocation state to ensure the availability of the new computing power resources. That is, by detecting the usage of the new computing power resources, the availability of the new computing power resources is guaranteed.

[0097] It should be noted that after new computing resources are allocated, the allocated new resources will be considered as used resources. That is, the remaining resources after the new computing resources are allocated do not include the new computing resources. In subsequent tests, if the new computing resources are unavailable and need to be replaced, the unavailable new computing resources will be avoided from being selected repeatedly, thereby improving allocation efficiency.

[0098] Step A20: If the newly added computing resources are available, then request the user terminal to terminate the use of the network data;

[0099] In this embodiment, if the newly added computing resources are successfully used, the system control module sends a termination operation request to the user terminal so that the user terminal stops using network data.

[0100] In this embodiment, if the newly added computing resources cannot be successfully used, other remaining resources are used to replace the unusable new computing resources until the new computing resources are successfully used. That is, the availability of the new computing resources meets the preset availability requirements. The availability requirements can be set by the user.

[0101] In this embodiment, after the new computing resources are allocated, requesting the user to terminate the use of network data can reduce the time the user cannot use network data, thereby improving the user experience.

[0102] Step A30: Merge the newly added computing power resources with the used computing power resources to obtain merged computing power resources, and detect the merged computing power resources;

[0103] In this embodiment, after determining that the user has terminated the use of network data, the newly added computing resources and the used computing resources are merged by the computing resource merging module to obtain merged computing resources. The merged computing resources are then tested to ensure that they can be used normally.

[0104] Step A40: If both the merged computing resources and the network resources used by the user terminal meet the usage requirements, then the optimized computing resources are obtained, and the user terminal's use of the network data is restored.

[0105] In this embodiment, if the user continues to use network data during the process of merging newly added computing resources and using existing computing resources, it may cause the network data received by the user to be corrupted or garbled. To prevent the user from using network data normally, it is necessary to ensure that the merged computing resources and network resources meet the usage requirements and optimize the computing resources. Then, the system control module should restore the user's network data usage and stop further optimization of computing resources or network resources.

[0106] In this embodiment, when optimized use of computing resources is required, the resource allocation module first determines the new computing resources from the remaining resources in the computing nodes of the network storage device, pre-allocates the new computing resources, and checks the availability of the pre-allocated new computing resources. After confirming the availability of the new computing resources, the system requests the user to stop using network data to facilitate merging the new computing resources with the existing computing resources. After merging is complete, the system control module sends a request to resume use to the user, enabling the user to resume using network data. That is, in this embodiment, the user is only requested to operate when merging new computing resources with existing computing resources, avoiding garbled or incorrect network data used by the user, reducing the time the user cannot use network data, and improving the user experience.

[0107] Specifically, refer to Figure 4 The step of optimizing the use of computing resources by changing the node to obtain optimized computing resources includes:

[0108] Step B10: If the total number of computing power does not meet the number of resources, or the merged computing power resources and the used network resources do not meet the usage requirements, or only the used network resources do not meet the network requirements in the usage requirements, then the merged parameter information of the merged computing power resources is packaged into a request command.

[0109] In this embodiment, if the total computing power is insufficient to meet the required computing power resources, or if merging computing power resources and using network resources do not meet the usage requirements, or if the optimization request is to optimize the use of network resources, then the computing power node modification module is activated. This module determines the computing power nodes around the user terminal, sorts them according to the distance between the computing power nodes and the user terminal, and packages the merging parameter information for merging computing power resources into a request command, or modifies the computing power nodes of the network storage device (corresponding to...) Figure 4 The computing power parameter information of the original computing power node in the process is packaged into a request command.

[0110] Step B20: Based on the request command, determine the edge computing node closest to the user terminal, and send the request command to the edge computing node so that the edge computing node can allocate the merged computing resources based on the merged parameter information;

[0111] In this embodiment, the available edge computing node closest to the user terminal is determined by sending a request command. After determining the edge computing node, the merging parameter information can be directly sent to the edge computing node, thereby reducing optimization steps and improving the optimization rate of computing resources.

[0112] In this embodiment, after the edge computing node receives the request command, it allocates or uses computing resources, and tests the availability of the merged or used computing resources. After confirming availability, it sends a resource preparation completion instruction to the computing node of the network storage device and starts the computing resource monitoring probe.

[0113] Step B30: After determining that the edge computing node has completed the allocation of the merged computing resources, modify the computing node position in the merged parameter information to the edge node position, and request the user terminal to stop using the network data;

[0114] In this embodiment, after determining that the edge computing node has completed the allocation of merged computing resources or used computing resources, the computing node position in the merged parameter information is modified to the edge node position. That is, the computing node information associated with the network storage data is modified, and a request to stop using network data is sent to the user terminal to request the user terminal to stop using network data.

[0115] Step B40: Switch the location of the computing node in the network connection to the location of the edge node to obtain switched computing resources;

[0116] In this embodiment, after determining that the user terminal has stopped using network data, the location of the computing node connected to the network is switched to an edge node location, shortening the physical distance between the computing node and the user terminal to optimize the use of network resources. This achieves the switching of network resources. Furthermore, stopping the user terminal's use of network data when switching the computing node connected to the network can prevent abnormalities from occurring during the user terminal's use of network data, thereby improving the user experience.

[0117] Step B50: If the switching of computing resources and the use of network resources meet the usage requirements, then the computing resources are optimized, and the user terminal's use of the network data is restored.

[0118] In this embodiment, the switching of computing resources and network resources after changing the computing address is determined. Once the usage needs are met, the operation of the user terminal using network data is restored, so as to minimize the time that the user cannot use network data and improve the user experience.

[0119] In this embodiment, if the use of computing resources and network computing resources still cannot meet the usage requirements after optimization of computing power allocation, or if the computing power allocation cannot be optimized, or if the optimization request is to optimize the use of network resources, then the computing resources are further optimized by changing the nodes. During the optimization process, the user is only requested to stop using network data if it will affect the user's use of network data, so as to avoid abnormalities in the network data used by the user. After the optimization is completed, the relevant computing resources in the computing power nodes of the network storage device are released, and the user's operation of using network data is restored in a timely manner to improve the user experience.

[0120] Specifically, refer to Figure 6 The step of optimizing the use of computing resources using the data migration optimization method to obtain optimized computing resources further includes:

[0121] Step C10: If the switching of computing resources and the use of network resources do not meet the usage requirements, then determine the migration data center closest to the edge computing node;

[0122] In this embodiment, if switching computing resources and using network resources still cannot meet the usage requirements after changing the node optimization, or if using computing resources and switching network resources still cannot meet the usage requirements, then data migration optimization is performed on the use of computing resources.

[0123] Reference Figure 8 It should be noted that data migration optimization is accomplished through the hot data migration module, which includes a hot and cold data management module, a migration backup module, a file system component module, and a system control module. The system control module is the same as the system control module within the resource allocation module.

[0124] In this embodiment, the migration backup module first determines the migration data center closest to the edge computing node and uses this migration data center as the migration destination.

[0125] Step C20: Transmit the hot data filtered from the network data to the migration data center, and record the migration progress of the hot data in real time so that the migration data center can obtain the migration data;

[0126] In this embodiment, before transmitting hot data, the migration backup module needs to obtain the hot data information from the hot and cold data management. The data information includes, but is not limited to, the amount of hot data and the file system. The data information is then migrated to the migration destination, i.e., the migration data center, so that the migration data center can allocate sufficient storage space for the hot data based on the received data information and send a preparation completion instruction to the migration backup model.

[0127] In this embodiment, the migration backup module starts migrating hot data to the migration data center only after receiving the preparation completion instruction, and records the migration progress of hot data in real time, so as to send a stop operation request to the user terminal in a timely manner, thereby reducing the time that the migration data module waits for the user terminal to stop the operation.

[0128] Step C30: If the migration progress meets the preset progress, then request the user terminal to stop using the network data;

[0129] The preset progress can be a percentage of the total amount of hot data that needs to be migrated, such as 99%, 95%, etc., which can be set freely by the user.

[0130] In this embodiment, when the migration progress meets the preset progress, the system control module requests the user to stop using network data to avoid the optimization process and the user's use from affecting each other.

[0131] It should be noted that during the hot data transmission process, the transmitted hot data needs to be backed up so that the backed-up hot data can be used to determine the accuracy of the migration data.

[0132] Step C40: Create a read / write strategy for the migrated data and the unmigrated data in the network data;

[0133] In this embodiment, after determining that the user has terminated the use of network data, the file system component module uses the data center where the hot data was stored before optimization and the relevant information of the file system to establish a relationship between the migrated hot data and the unmigrated cold data, or restore the relationship between the hot data and the cold data.

[0134] In this embodiment, when constructing the relationship between migrated hot data and unmigrated cold data, or restoring the relationship between hot data and cold data, a read / write strategy for migrated data and unmigrated data is created to ensure that the terminal can continue to operate on the data used when it stopped.

[0135] Step C50: Based on the read / write strategy, update the data information of the hot data to obtain optimized computing resources and optimized network resources, and restore the user terminal's operation of using the network data.

[0136] In this embodiment, the hot data information in the hot and cold data management module is updated through a read / write strategy so that after the user terminal operation is restored, the user terminal can continue to use the hot data in the network data and resume the user terminal's operation of using network data.

[0137] Specifically, the step of creating a read / write strategy for the migrated data and the unmigrated data in the network data includes:

[0138] Step C40: Determine the accuracy of the migration data;

[0139] Step C50: If the accuracy of the migrated data meets the preset accuracy requirements, then create a read / write strategy for the migrated data and the unmigrated data in the network data.

[0140] In this embodiment, before creating the read / write strategy for the migrated data and the unmigrated data in the network data, it is necessary to continue backing up the hot data until all the hot data has been backed up. The backed-up hot data is then compared with the migrated data to ensure the accuracy of the migrated data and thus avoid errors or unusability of the migrated data.

[0141] Specifically, the step of optimizing the computing resources used based on the computing power requirement using a preset optimization method to obtain optimized computing resources further includes:

[0142] Step D10: Based on the computing power requirement, optimize the computing power resources used using a preset optimization method;

[0143] Step D20: Monitor in real time whether the optimized computing resources and network resources used by the user terminal meet the usage requirements. If the usage requirements are met, the optimized computing resources are obtained.

[0144] It should be noted that when optimizing the use of computing resources, the optimization process needs to be monitored in real time, and the optimization effect needs to be detected in a timely manner after each stage of optimization. That is, after optimizing the allocation of computing resources, the allocated and optimized computing resources need to be tested. If the allocated and optimized computing resources and network resources meet the usage requirements, then no further node optimization is needed, and the optimized computing resources and optimized network resources are obtained directly. The optimized network resources are the network resources used.

[0145] In this embodiment, if the usage requirements are met by modifying the optimized computing and network resources of the nodes, then no further data migration optimization is needed, and the optimized computing and network resources are directly obtained.

[0146] In this embodiment, each optimization module performs real-time monitoring of the optimized computing and network resources. If the optimized computing and network resources meet the usage requirements, the optimized computing and network resources are directly obtained and do not need to be further optimized by subsequent optimization modules. This allows for reasonable optimization of computing and network resources, reduces resource waste, saves optimization time, and improves the optimization efficiency of computing resources.

[0147] In this embodiment, optimization is performed sequentially through computing power allocation, node modification, and data migration. This hierarchical optimization of computing resources ensures reasonable resource allocation, avoids resource waste, and minimizes the impact on user network data usage during the optimization process. Furthermore, it reduces the time users are unable to access network data during optimization, thereby improving the efficiency of computing resource optimization and enhancing the user experience.

[0148] This application provides a method, apparatus, device, and storage medium for optimizing computing resources. Compared with existing technologies that fail to achieve optimal optimization results, leading to reduced optimization efficiency, this application obtains the user's usage requirements when using network data and the computing resources used by the network storage device. Based on the computing requirements, the computing resources are optimized using a preset optimization method to obtain optimized computing resources, which are then used by the user to normally use the network data. The optimization method is at least one of computing power allocation, node modification, and data migration. In this application, based on the user's usage requirements when using network data, at least one of the following optimization methods—computing power allocation optimization, node modification optimization, and data migration optimization—is used to optimize the computing power resources of the network storage device to obtain optimized computing power resources. This optimized computing power resources allow the user to use the network data normally. In other words, in this application, at least one of the following optimization methods—computing power allocation, node modification, and data migration—is used to optimize the use of computing power resources. In optimizing the use of computing power resources, the use of network resources is indirectly changed to achieve the best coordination between computing power resources and network resources, thereby achieving the best optimization effect and improving the optimization efficiency of computing power resources.

[0149] Furthermore, based on the above embodiments of this application, another embodiment of this application is provided, in which reference is made to... Figure 5 After the steps of updating the data information of the hot data based on the read / write strategy to obtain optimized computing resources and optimized network resources, and restoring the user terminal's operation of using the network data, the method further includes:

[0150] Step S01: If a restore command to restore the hot data is received, then obtain the migration storage information of the migration data center;

[0151] In this embodiment, when the migration backup module receives the restore command for restoring hot data, it obtains the data center where the cold data is located and the migration storage information of the data center where the hot data is located from the cold and hot data management module, and sends the migration storage information to the data center where the cold data is located.

[0152] The data center where the cold data is located can be a local data center with computing resources, or it can be a data center of other nodes.

[0153] Step S02: Based on the storage amount of the hot data in the migration storage information, expand the local data center where the unmigrated data is located;

[0154] The storage capacity includes at least the amount of hot data migrated during the migration process and the amount of newly generated hot data during subsequent use.

[0155] In this embodiment, the local data center is expanded by increasing the storage capacity so that it can store all the hot data, ensuring that the hot data is not lost after the restoration and migration.

[0156] Step S03: Receive the hot data transmitted from the migrated data center and save the hot data to the expanded local data center;

[0157] In this embodiment, after receiving the preparation completion instruction from the data center where the hot data is located, the migration backup module begins receiving the hot data. It then saves the hot data to the expanded local data center, ensuring that hot and cold data are stored in the same data center. The module also records the migration progress of the hot data in real time and sends a stop operation request to the user terminal in a timely manner, reducing the time the migration module waits for the user terminal to stop the operation.

[0158] Step S04: Create read / write policies for hot data migrated to the local data center and non-migrated data, and update the data information of the hot data to complete the optimization and recovery.

[0159] In this embodiment, the hot data after restoration and migration is recreated, along with the read / write strategy for cold data and the relationship between hot and cold data, so that users can use the restored hot data normally.

[0160] Furthermore, based on the above embodiments of this application, another embodiment of this application is provided. In this embodiment, the step of monitoring the user terminal's use of network data includes:

[0161] Step E10: Monitor the hard disk I / O read / write, CPU utilization, memory utilization, and GPU utilization when the user terminal uses network data to determine the usage of computing resources.

[0162] Step E20: Monitor network latency, jitter, and packet loss when the user terminal uses network data to determine the usage of network resources.

[0163] In this embodiment, the computing resource information of the computing nodes of the network storage device is monitored by the computing resource monitoring module. The computing resource information includes, but is not limited to, hard disk I / O read / write status, CPU utilization, memory utilization, GPU utilization, etc.

[0164] In this embodiment, the network resource monitoring module monitors the quality and utilization of network resources at the user end. The quality and utilization of network resources include, but are not limited to, network latency, network jitter, and network packet loss rate.

[0165] In this embodiment, the utilization of computing resources is comprehensively analyzed by detecting hard disk I / O read / write, CPU utilization, memory utilization, GPU utilization, etc., or by detecting user-end network latency, network jitter, network packet loss rate, etc., to comprehensively analyze the utilization of network resources. Based on the comprehensive analysis, the reliability of the obtained optimization requests is increased.

[0166] Reference Figure 3 , Figure 3 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of this application.

[0167] like Figure 3 As shown, the optimization device for this computing resource may include: a processor 1001, such as a CPU, a memory 1005, and a communication bus 1002. The communication bus 1002 is used to establish communication between the processor 1001 and the memory 1005. The memory 1005 may be a high-speed RAM or a stable, non-volatile memory, such as a disk drive. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0168] Optionally, the optimization equipment for this computing resource may also include a rectangular user interface, a network interface, a camera, RF (Radio Frequency) circuitry, sensors, audio circuitry, a WiFi module, etc. The rectangular user interface may include a display screen and an input submodule such as a keyboard. Optionally, the rectangular user interface may also include standard wired or wireless interfaces. The network interface may optionally include standard wired or wireless interfaces (such as a Wi-Fi interface).

[0169] Those skilled in the art will understand that Figure 3 The computing resource optimization equipment shown does not constitute a limitation on computing resource optimization equipment, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0170] like Figure 3As shown, the memory 1005, as a storage medium, may include an operating system, a network communication module, and a computing resource optimization program. The operating system is a program that manages and controls the hardware and software resources of the computing resource optimization device, supporting the operation of the computing resource optimization program and other software and programs. The network communication module is used to enable communication between the various components within the memory 1005, as well as communication with other hardware and software in the computing resource optimization system.

[0171] exist Figure 3 In the computing resource optimization device shown, the processor 1001 is used to execute the computing resource optimization program stored in the memory 1005 to implement the steps of the computing resource optimization method described above.

[0172] The specific implementation method of the computing power resource optimization device in this application is basically the same as the various embodiments of the computing power resource optimization method described above, and will not be repeated here.

[0173] This application also provides a computing power resource optimization device, which includes:

[0174] The acquisition module is used to acquire the user's usage requirements when using network data and the computing power resources used by network storage devices.

[0175] An optimization module is used to optimize the computing resources used based on the computing power requirements using a preset optimization method to obtain optimized computing resources, so that the user terminal can use the network data normally based on the optimized computing resources.

[0176] The optimization method must be at least one of the following: computing power allocation, node modification, and data migration.

[0177] Optionally, the optimization module includes:

[0178] The first detection submodule is used to determine new computing resources from the remaining resources and detect the availability of the new computing resources if the remaining resources not used by the user terminal in the computing power nodes of the network storage device and the total number of computing power resources used meet the number of resources required for computing power demand in the usage requirements.

[0179] The first request module is used to request the user terminal to terminate the use of the network data if the newly added computing resources are available.

[0180] The merging module is used to merge the newly added computing resources with the used computing resources to obtain merged computing resources, and to detect the merged computing resources.

[0181] The first detection unit is configured to optimize the computing resources and restore the user's use of the network data if both the merged computing resources and the network resources used by the user terminal meet the usage requirements.

[0182] Optionally, the optimization module further includes:

[0183] The second detection submodule is used to package the merging parameter information of the merged computing power resources into a request command if the total number of computing power resources does not meet the number of resources, or the merged computing power resources and the network resources used do not meet the usage requirements, or only the network resources used do not meet the network requirements in the usage requirements.

[0184] The sending module is used to determine the edge computing node closest to the user terminal based on the request command, and send the request command to the edge computing node so that the edge computing node can allocate the merged computing resources based on the merged parameter information;

[0185] The modification module is used to modify the computing node position in the merging parameter information to the edge node position after determining that the edge computing node has completed the allocation of the merged computing resources, and to request the user terminal to stop using the network data.

[0186] A switching module is used to switch the location of the computing node in the network connection to the location of the edge node, thereby switching computing resources.

[0187] The second detection unit is used to optimize computing resources and restore the user terminal's operation of using the network data if the switching of computing resources and the use of network resources meet the usage requirements.

[0188] Optionally, the optimization module further includes:

[0189] The third detection submodule is used to determine the migration data center closest to the edge computing node if the switching computing resources and the network resources used do not meet the usage requirements.

[0190] The transmission module is used to transmit the hot data filtered from the network data to the migration data center, and record the migration progress of the hot data in real time, so that the migration data center can obtain the migration data;

[0191] The second request module is used to request the user terminal to stop using the network data if the migration progress meets the preset progress.

[0192] The first creation module is used to create read / write strategies for the migrated data and the unmigrated data in the network data;

[0193] The update module is used to update the data information of the hot data based on the read / write strategy, thereby optimizing computing resources and restoring the user terminal's operation of using the network data.

[0194] Optionally, the computing power resource optimization device further includes:

[0195] The acquisition module is used to acquire the migration storage information of the migration data center if a restoration instruction to restore the hot data is received.

[0196] An expansion module is used to expand the local data center where the unmigrated data is located based on the storage volume of the hot data in the migration storage information;

[0197] A receiving module is used to receive the hot data transmitted by the migrated data center and save the hot data to the expanded local data center;

[0198] The second creation module is used to create read / write strategies for hot data migrated to the local data center and non-migrated data, and to update the data information of the hot data to complete the optimization and restoration.

[0199] Optionally, the first creation module includes:

[0200] The determination module is used to determine the accuracy of the migration data;

[0201] A submodule is created to create a read / write strategy for the migrated data and the unmigrated data in the network data if the accuracy of the migrated data meets a preset accuracy requirement.

[0202] Optionally, the optimization module further includes:

[0203] An optimization unit is used to optimize the computing resources used based on the computing power requirements and using a preset optimization method.

[0204] The monitoring module is used to monitor in real time whether the optimized computing resources and network resources used by the user terminal meet the usage requirements. If the usage requirements are met, the optimized computing resources are obtained.

[0205] The specific implementation of the computing power resource optimization device of this application is basically the same as the embodiments of the computing power resource optimization method described above, and will not be repeated here.

[0206] This application provides a storage medium that stores one or more programs, which can be executed by one or more processors to implement the steps of the computing resource optimization method described above.

[0207] The specific implementation of the storage medium in this application is basically the same as the embodiments of the above-mentioned optimization methods for computing resources, and will not be repeated here.

[0208] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0209] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0210] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods of the various embodiments of the present invention.

[0211] The above are merely preferred embodiments of the present invention and do not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention’s specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A method for optimizing computing resources, characterized in that, The optimization method for the computing resources includes: Acquire user needs when using network data and the computing resources used by network storage devices; Based on the computing power requirements, the computing power resources used are optimized using a preset optimization method to obtain optimized computing power resources, so that the user terminal can use the network data normally based on the optimized computing power resources; Among them, the optimization method is at least one of computing power allocation, node change and data migration; The optimization method for using computing power allocation to optimize the use of computing power resources, resulting in optimized computing power resources, includes the following steps: If the remaining unused resources in the computing nodes of the network storage device and the total number of computing resources used meet the resource requirements of the computing power demand in the usage requirements, then new computing power resources are determined from the remaining resources, and the availability of the new computing power resources is detected. If the newly added computing resources are available, then the user terminal is requested to terminate the use of the network data; The newly added computing resources are combined with the used computing resources to obtain the merged computing resources, and the merged computing resources are detected. If both the merged computing resources and the network resources used by the user terminal meet the usage requirements, then the computing resources are optimized, and the user terminal's use of the network data is restored. The step of optimizing the use of computing resources by using a node-changing optimization method to obtain optimized computing resources includes: If the total computing power does not meet the resource quantity, or the merged computing power resources and the used network resources do not meet the usage requirements, or only the used network resources do not meet the network requirements in the usage requirements, then the merging parameter information of the merged computing power resources will be packaged into a request command. Based on the request command, the edge computing node closest to the user terminal is determined, and the request command is sent to the edge computing node so that the edge computing node can allocate the merged computing resources based on the merged parameter information; After determining that the edge computing node has completed the allocation of the merged computing resources, the computing node position in the merged parameter information is modified to the edge node position, and the user terminal is requested to stop using the network data. Switching the location of the computing node in the network connection to the location of the edge node results in switching computing resources; If the switching of computing resources and the use of network resources meet the usage requirements, then the computing resources are optimized, and the user terminal's use of the network data is restored. The step of optimizing the use of computing resources using the data migration optimization method to obtain optimized computing resources further includes: If the switching of computing resources and the use of network resources do not meet the usage requirements, then the migration data center closest to the edge computing node is determined; The hot data filtered from the network data is transmitted to the migration data center, and the migration progress of the hot data is recorded in real time so that the migration data center can obtain the migration data; If the migration progress meets the preset progress, then the user terminal is requested to stop using the network data; Create read / write strategies for the migrated data and the unmigrated data in the network data; Based on the read / write strategy, the data information of the hot data is updated to obtain optimized computing resources, and the user terminal's operation of using the network data is restored.

2. The method for optimizing computing resources as described in claim 1, characterized in that, After the steps of updating the data information of the hot data based on the read / write strategy, obtaining optimized computing resources, and restoring the user's operation of using the network data, the method further includes: If a restore command to restore the hot data is received, then the migration storage information of the migration data center is obtained; Based on the storage volume of the hot data in the migration storage information, expand the local data center where the unmigrated data is located; Receive the hot data transmitted from the migrated data center and save the hot data to the expanded local data center; Create read / write policies for hot data migrated to the local data center and for the non-migrated data, and update the data information of the hot data to complete the optimization and recovery.

3. The method for optimizing computing resources as described in claim 1, characterized in that, The step of creating a read / write strategy for the migrated data and the unmigrated data in the network data includes: Determine the accuracy of the migration data; If the accuracy of the migrated data meets the preset accuracy requirements, then a read / write strategy is created for the migrated data and the unmigrated data in the network data.

4. The method for optimizing computing resources as described in claim 1, characterized in that, The step of optimizing the computing resources used based on the computing power requirement using a preset optimization method to obtain optimized computing resources further includes: Based on the computing power requirements, the computing power resources used are optimized using a preset optimization method; The system monitors in real time whether the optimized computing resources and network resources used by the user terminal meet the usage requirements. If the usage requirements are met, the optimized computing resources are obtained.

5. A device for optimizing computing resources, characterized in that, The computing power resource optimization device includes: The acquisition module is used to acquire the user's usage requirements when using network data and the computing power resources used by network storage devices. An optimization module is used to optimize the computing resources used based on the computing power requirements using a preset optimization method to obtain optimized computing resources, so that the user terminal can use the network data normally based on the optimized computing resources. Among them, the optimization method is at least one of computing power allocation, node change and data migration; The computing power resource optimization device is also used to achieve: If the remaining unused resources in the computing nodes of the network storage device and the total number of computing resources used meet the resource requirements of the computing power demand in the usage requirements, then new computing power resources are determined from the remaining resources, and the availability of the new computing power resources is detected. If the newly added computing resources are available, then the user terminal is requested to terminate the use of the network data; The newly added computing resources are combined with the used computing resources to obtain the merged computing resources, and the merged computing resources are detected. If both the merged computing resources and the network resources used by the user terminal meet the usage requirements, then the computing resources are optimized, and the user terminal's use of the network data is restored. The computing power resource optimization device is also used to achieve: If the total computing power does not meet the resource quantity, or the merged computing power resources and the used network resources do not meet the usage requirements, or only the used network resources do not meet the network requirements in the usage requirements, then the merging parameter information of the merged computing power resources will be packaged into a request command. Based on the request command, the edge computing node closest to the user terminal is determined, and the request command is sent to the edge computing node so that the edge computing node can allocate the merged computing resources based on the merged parameter information; After determining that the edge computing node has completed the allocation of the merged computing resources, the computing node position in the merged parameter information is modified to the edge node position, and the user terminal is requested to stop using the network data. Switching the location of the computing node in the network connection to the location of the edge node results in switching computing resources; If the switching of computing resources and the use of network resources meet the usage requirements, then the computing resources are optimized, and the user terminal's use of the network data is restored. The computing power resource optimization device is also used to achieve: If the switching of computing resources and the use of network resources do not meet the usage requirements, then the migration data center closest to the edge computing node is determined; The hot data filtered from the network data is transmitted to the migration data center, and the migration progress of the hot data is recorded in real time so that the migration data center can obtain the migration data; If the migration progress meets the preset progress, then the user terminal is requested to stop using the network data; Create read / write strategies for the migrated data and the unmigrated data in the network data; Based on the read / write strategy, the data information of the hot data is updated to obtain optimized computing resources, and the user terminal's operation of using the network data is restored.

6. A device for optimizing computing resources, characterized in that, The computing resource optimization device includes: a memory, a processor, and a program stored in the memory for implementing the computing resource optimization method. The memory is used to store programs that implement methods for optimizing computing resources; The processor is used to execute a program that implements a method for optimizing computing resources, so as to implement the steps of the method for optimizing computing resources as claimed in any one of claims 1 to 4.

7. A storage medium, characterized in that, The storage medium stores a program for implementing a method for optimizing computing resources. The program for implementing the method for optimizing computing resources is executed by a processor to implement the steps of the method for optimizing computing resources as described in any one of claims 1 to 4.

Images