Storage resource scheduling system and method, electronic equipment and storage medium

Abstract

The invention provides a storage resource scheduling system and method, electronic equipment and a storage medium, relates to the technical field of storage resource scheduling, and is used for scheduling storage resources meeting the storage requirements of a user terminal to store data of the user terminal. The storage resource scheduling system comprises at least one edge gateway used for being connected with a user terminal and at least one data center gateway used for being connected with a data center, wherein storage resource information of the data center connected with each data center gateway is stored in the edge gateway; the edge gateway is also used for collecting storage demand parameters of to-be-stored data of the user terminal; based on the storage demand parameters and the storage resource information of the data centers connected with the data center gateways, determining a target data center of which the storage resources are matched with the storage demand parameters; establishing a data transmission channel with the target data center; and transmitting the to-be-stored data of the user terminal to the storage resource of the target data center for storage through the data transmission channel.

Description

Technical Field

[0001] This application relates to the field of storage resource scheduling technology, and in particular to a storage resource scheduling system, method, electronic device and storage medium. Background Technology

[0002] While data center clusters are now widely distributed, resource constraints and errors still exist in some areas. Some data centers are underutilized, while areas with high demand face storage resource shortages. Therefore, optimizing storage resource allocation and improving storage resource utilization is an important issue.

[0003] Currently, service providers mainly adjust resource distribution through three types of solutions: first, underlying data balancing (such as data sharding rebalancing); second, operation and maintenance-driven data migration; and third, agent-layer intervention scheduling. Although these solutions can improve the overall resource utilization rate to a certain extent, they do not fully consider users' personalized needs for storage services. Service providers have blind spots in understanding users' usage needs and habits, and can only passively follow up and adjust the distribution, resulting in unreasonable utilization of resources. Summary of the Invention

[0004] This application provides a storage resource scheduling system, method, electronic device, and storage medium for scheduling storage resources to meet the storage needs of user terminals in order to store the data of user terminals.

[0005] To achieve the above objectives, this application adopts the following technical solution: In a first aspect, this application provides a storage resource scheduling system, including at least one edge gateway and at least one data center gateway. The edge gateway is used to connect to user terminals, and the data center gateway is used to connect to data centers. The edge gateway stores storage resource information of the data centers connected to each data center gateway. The edge gateway is also used to collect storage requirement parameters of the data to be stored from user terminals, and based on the storage requirement parameters and the storage resource information of the data centers connected to each data center gateway, to determine the target data center that matches the storage resources with the storage requirement parameters. Edge gateways are also used to establish data transmission channels with target data centers and transmit data to be stored from user terminals to storage resources in target data centers via these channels.

[0006] The technical solution provided in this application brings at least the following beneficial effects: In the storage resource scheduling system, edge gateways connect to user terminals, while data center gateways connect to data centers providing storage resources. The edge gateway collects storage requirement parameters from user terminals regarding the data to be stored, and then combines this with storage resource information from various data centers stored in the edge gateway to match the most suitable storage resources for the data. Finally, a data transmission channel is established between the edge gateway and the target data center to transfer the data to be stored from the user terminal to the storage resources in the target data center. The storage requirement parameters characterize the storage needs of the user terminal, ensuring that the storage resources in the target data center matched by the edge gateway can meet those needs. Idle data center storage resources can be precisely allocated to user terminals with corresponding requirements, alleviating situations where some nodes experience storage resource shortages while others are idle, thus significantly improving the overall utilization rate of storage resources.

[0007] Optionally, the storage resource scheduling system also includes a controller connected to the data center gateway; the controller is used to obtain storage resource information of the data centers connected to the data center gateway; the controller is also used to send the obtained storage resource information of each data center to each edge gateway, so that the edge gateway stores the storage resource information of each data center.

[0008] Optionally, the storage resource scheduling system also includes a resource management platform, with the controller connected to the resource management platform; the controller is also used to input the acquired storage resource information of each data center into the resource management platform; the resource management platform is used to display the storage resource information of each data center input by the controller, and to receive and respond to the management operations of the administrator on the storage resource information.

[0009] Optionally, the storage resource scheduling system also includes a domain name server, which establishes a connection with the edge gateway; the domain name server is used to obtain the target address and target domain name of the edge gateway, and to determine and store the mapping relationship between the target address and the target domain name of the edge gateway.

[0010] Optionally, the edge gateway is specifically used to: obtain the storage message body sent by the user terminal, which encapsulates the storage requirement parameters of the user terminal's data to be stored; and parse the storage requirement parameters of the user terminal's data to be stored from the storage message body.

[0011] Optionally, storage requirements parameters may include one or more of the following: data purpose, data read / write latency, data throughput, storage type, storage tier, disaster recovery requirements, and storage price; data center storage resources may include one or more of the following: object storage resources, block storage resources, and file storage resources.

[0012] Optionally, storage requirement parameters include required parameters and non-required parameters. Required parameters include data read / write latency, data throughput, storage type, and disaster recovery requirements. Non-required parameters include data usage, storage tier, and storage price. The edge gateway is specifically used to: determine the target data center based on the storage resource information of the data centers connected to each data center gateway, and the data center that meets all required parameters and meets the most non-required parameters.

[0013] Secondly, this application provides a storage resource scheduling method, applied to the edge gateway provided in the first aspect. The method includes: collecting storage requirement parameters of the data to be stored from user terminals; determining a target data center whose storage resources match the storage requirement parameters based on the storage requirement parameters and the storage resource information of the data centers connected to each data center gateway; establishing a data transmission channel with the target data center; and transmitting the data to be stored from the user terminals to the storage resources of the target data center through the data transmission channel.

[0014] Optionally, the storage requirement parameters of the user terminal's data to be stored are collected, including: obtaining the storage message body sent by the user terminal, which encapsulates the storage requirement parameters of the user terminal's data to be stored; and parsing the storage requirement parameters of the user terminal's data to be stored from the storage message body.

[0015] Optionally, storage requirements parameters may include one or more of the following: data purpose, data read / write latency, data throughput, storage type, storage tier, disaster recovery requirements, and storage price; data center storage resources may include one or more of the following: object storage resources, block storage resources, and file storage resources.

[0016] Optionally, storage requirement parameters include required parameters and non-required parameters. Required parameters include data read / write latency, data throughput, storage type, and disaster recovery requirements. Non-required parameters include data usage, storage tier, and storage price. Based on the storage requirement parameters and the storage resource information of the data centers connected to each data center gateway, the target data centers that match the storage resources with the storage requirement parameters are determined. This includes: based on the storage resource information of the data centers connected to each data center gateway, the data centers that meet all required parameters and meet the most non-required parameters are identified as the target data centers.

[0017] Thirdly, this application provides a computer-readable storage medium storing computer instructions that, when executed on a computer, cause the computer to perform any of the aforementioned storage resource scheduling methods.

[0018] Fourthly, this application provides an electronic device, including: a processor and a memory; the memory is used to store computer execution instructions, the processor is connected to the memory, and when the electronic device is running, the processor executes the computer execution instructions stored in the memory to cause the electronic device to perform any of the above-mentioned storage resource scheduling methods.

[0019] Fifthly, this application provides a computer program product containing computer execution instructions, which, when run on a computer, causes the computer to execute any of the aforementioned storage resource scheduling methods.

[0020] In the specific implementation of this application, the names of the components of the aforementioned device do not limit the device itself. In actual implementation, these components may appear under other names. As long as the function of each component is similar to the specific implementation of this application, it falls within the scope of the claims of this application and its equivalents.

[0021] Furthermore, the technical effects of any of the design methods in aspects two through five can be found in the technical effects of the different design methods in aspect one above, and will not be repeated here. Attached Figure Description

[0022] Figure 1 This is a schematic diagram of the structure of a storage resource scheduling system provided in an embodiment of this application; Figure 2 This is a schematic diagram illustrating an application scenario of a storage resource scheduling system provided in an embodiment of this application; Figure 3 A flowchart illustrating a storage resource scheduling process provided in an embodiment of this application; Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application; Figure 5 This is a schematic diagram of the structure of another electronic device provided in an embodiment of this application; Figure 6 This is a flowchart illustrating a storage resource scheduling method provided in an embodiment of this application. Detailed Implementation

[0023] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0024] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0025] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "connected" and "linked" should be interpreted broadly, for example, as a fixed connection, a detachable connection, or an integral connection. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances. Furthermore, when describing pipelines, the terms "connected" and "linked" as used in this application have the meaning of establishing electrical connection. The specific meaning needs to be understood in conjunction with the context.

[0026] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0027] As described in the background section, current storage resource scheduling schemes do not fully consider users' personalized needs for storage services. Service providers have blind spots in understanding users' usage needs and habits, and can only passively follow up and adjust the distribution, resulting in unreasonable utilization of resources.

[0028] To address the aforementioned issues, this application provides a storage resource scheduling system. The system includes at least one edge gateway and at least one data center gateway. The edge gateway connects to user terminals, and the data center gateway connects to data centers providing storage resources. The edge gateway collects storage requirement parameters of the data to be stored from the user terminal, and then combines this with storage resource information from various data centers stored in the edge gateway to match the most suitable storage resource for the data to be stored. Finally, a data transmission channel is established between the edge gateway and the target data center, through which the data to be stored from the user terminal is transferred to the storage resources in the target data center. The storage requirement parameters characterize the storage needs of the user terminal, thus ensuring that the storage resources in the target data center matched by the edge gateway can meet the storage needs of the user terminal. Idle data center storage resources can be accurately allocated to user terminals with corresponding needs, alleviating storage resource shortages on some nodes.

[0029] Figure 1 The diagram illustrates one structure of this storage resource scheduling system. For example... Figure 1As shown, the storage resource scheduling system 1 includes at least one edge gateway 10 and at least one data center gateway 20.

[0030] The edge gateway 10 is used to connect user terminals, and one edge gateway 10 can connect multiple user terminals. The data center gateway 20 is used to connect data centers, and one data center gateway 20 can connect multiple data centers.

[0031] The edge gateway 10 stores storage resource information of the data centers connected to each data center gateway. The edge gateway 10 is also used to: collect storage requirement parameters of the data to be stored from user terminals; determine the target data center whose storage resources match the storage requirement parameters based on the storage requirement parameters and the storage resource information of the data centers connected to each data center gateway; establish a data transmission channel with the target data center; and transmit the data to be stored from the user terminals to the storage resources of the target data center through the data transmission channel.

[0032] In some embodiments, the edge gateway 10 is specifically used to: obtain a storage message body sent by a user terminal, wherein the storage message body encapsulates storage requirement parameters of the user terminal's data to be stored; and parse the storage requirement parameters of the user terminal's data to be stored from the storage message body.

[0033] The storage requirements parameters include one or more of the following: data purpose, data read / write latency, data throughput, storage type, storage tier, disaster recovery requirements, and storage price; the data center's storage resources include one or more of the following: object storage resources, block storage resources, and file storage resources.

[0034] Example 1, storage resource parameters can be: Data purpose: Video data; Data read / write latency: Read latency ≤ 30ms, write latency ≤ 200ms; Data throughput: 3Mb; Storage type: Object storage; Storage tiers: Supports cold storage; Disaster recovery requirements: Support disaster recovery; Storage price: the lower the better.

[0035] Example 2, storage resource parameters are: Data purpose: Small to medium-sized database data; Data read / write latency: Read latency ≤ 40ms, Write latency ≤ 40ms; Data throughput: 800Mb; Storage type: Block storage; Storage tiers: None; Disaster recovery requirements: None; Storage price: the lower the better.

[0036] In some embodiments, the edge gateway 10 first receives a storage request from the user terminal, and then sends a parameter request to the user terminal, instructing the user terminal to encapsulate the storage requirement parameters in a storage message body and send it to the edge gateway 10. Alternatively, the edge gateway 10 receives a storage message body that includes not only the data to be stored but also the storage requirement parameters.

[0037] In some embodiments, storage requirement parameters can be divided into required parameters and non-required parameters. Required parameters include data read / write latency, data throughput, storage type, and disaster recovery requirements. Non-required parameters include data usage, storage tier, and storage price. Specifically, the edge gateway 10 is used to: determine the target data center based on the storage resource information of the data centers connected to each data center gateway 20, and the data center that meets all required parameters and the most non-required parameters.

[0038] For example, suppose the storage requirement parameters shown in Example 1 above are the storage requirement parameters of user terminal 1 connected to edge gateway 1, and the storage requirement parameters shown in Example 2 above are the storage requirement parameters of user terminal 2 connected to edge gateway 2. Figure 2 As shown, edge gateway 1 stores the storage resource information of the data centers connected to data center gateways 1-5 respectively. Taking the case where there is only one network link between the edge gateway and the data center gateway, the total read and write latency of the network link between edge gateway 1 and data center gateways 1-5 are 1ms, 3ms, 4ms, 6ms, and 10ms respectively. The total read and write latency of the network link between edge gateway 2 and data center gateways 1-5 are 6ms, 3ms, 2ms, 1ms, and 1ms respectively. Data center gateway 1 connects to a data center that provides object storage and file storage resources with a data throughput of 1000Mb, supports disaster recovery, and supports cold storage; data center gateway 2 connects to a data center that provides block storage resources with a data throughput of 1000Mb, supports disaster recovery, and supports cold storage; data center gateway 3 connects to a data center that provides block storage resources with a data throughput of 1000Mb, supports disaster recovery, and supports cold storage; data center gateway 4 connects to a data center that provides object storage resources with a data throughput of 1000Mb, supports disaster recovery, and supports cold storage; data center gateway 5 connects to a data center that provides file storage resources with a data throughput of 1000Mb, supports disaster recovery, and supports cold storage.

[0039] The storage price of the object storage resources provided by the data center connected to data center gateway 1 is higher than that of the object storage resources provided by the data center connected to data center gateway 4. Both the object storage resources provided by the data center connected to data center gateway 1 and the data center connected to data center gateway 4 meet the required parameters in the storage requirement parameters shown in Example 1. However, the object storage resources provided by the data center connected to data center gateway 4 also meet various non-required parameters. Therefore, edge gateway 1 determines the data center connected to data center gateway 4 as the target data center and determines the object storage resources provided by the target data center as the target storage resources. Finally, the data to be stored in the user terminal is stored in the target storage resources.

[0040] The storage price of the block storage resources provided by the data center connected to data center gateway 2 is higher than that of the block storage resources provided by the data center connected to data center gateway 3. The block storage resources provided by the data center connected to data center gateway 2 and the data center connected to data center gateway 4 both meet the required parameters in the storage requirement parameters shown in Example 2. However, the block storage resources provided by the data center connected to data center gateway 4 also meet all the non-required parameters. Therefore, edge gateway 2 determines the data center connected to data center gateway 4 as the target data center and determines the block storage resources provided by the target data center as the target storage resources. Finally, the data to be stored in the user terminal is stored in the target storage resources.

[0041] Optionally, the edge gateway 10 sends the matching status of storage resources of each data center with storage demand parameters to the user terminal, so that the user can select a suitable data center. The edge gateway 10 receives the data center selected by the user terminal and determines the data center selected by the user as the target data center.

[0042] In some embodiments, the storage resource scheduling system 1 further includes a controller, which is connected to both the edge gateway 10 and the data center gateway 20. The controller is configured to: acquire storage resource information of the data centers connected to the data center gateway 20; and send the acquired storage resource information of each data center to each edge gateway 10, so that the edge gateway 10 stores the storage resource information of each data center. The storage resource information may include storage type, disaster recovery status, storage tier, storage price, etc.

[0043] Specifically, after the data center gateway 20 connects to the controller, it proactively reports the storage resource information of the data centers it connects to, thereby allowing the controller to obtain the storage resource information of the data centers connected to the data center gateway 20. Alternatively, if the controller has permission to access the storage resource information of the data centers connected to the data center gateway 20, it proactively accesses and obtains the storage resource information of the data centers connected to the data center gateway 20 after the data center gateway 20 connects to the controller.

[0044] In some embodiments, multiple network links exist between the edge gateway 10 and the data center gateway 20. These network links can be those relayed through intermediate nodes or direct network links without relaying through intermediate nodes. The edge gateway 10 determines the read / write latency of each network link, and then, in conjunction with the storage resource information of each data center, matches the data center with the appropriate storage requirements parameters, ultimately selecting one network link as the data transmission channel for data transmission.

[0045] In some embodiments, the network link is an actual physical link. When data transmission is not required, the network link does not need to remain connected. When data transmission is required, for example, when the edge gateway 10 determines the network link between itself and the data center gateway 20 connected to the target data center, the connection of the network link is restored. In this way, more link resources can be freed up when business is not busy, ensuring the smooth operation of other services.

[0046] In some embodiments, the network link between the edge gateway 10 and the data center gateway 20 connected to the target data center should meet the data read / write latency requirements in the storage requirement parameters, and may also meet any one or more of the following conditions: ① direct network links are preferred; ② the lower the data read / write latency, the higher the priority.

[0047] In some embodiments, the storage resource scheduling system 1 further includes a resource management platform, and the controller is connected to the resource management platform. The controller is also used to input the acquired storage resource information of each data center into the resource management platform. The resource management platform is used to display the storage resource information of each data center input by the controller, and to receive and respond to management operations of the administrator on the storage resource information.

[0048] In some embodiments, the controller may first enter the storage resource information into the resource management platform, and then broadcast the storage resource information entered in the resource management platform to each edge gateway 10. Alternatively, after the data center gateway 20 is connected to the controller, the controller obtains the storage resource information of the data center connected to the data center gateway 20, and the controller sends it to both the resource management platform and the edge gateway 10.

[0049] In some embodiments, the resource management platform can be deployed in an electronic device with a human-computer interaction device. For example, the resource management platform can be deployed on a computer with interactive devices such as a display screen, mouse, and keyboard.

[0050] In some embodiments, the storage resource scheduling system 1 further includes a Domain Name System (DNS) server, which establishes a connection with the edge gateway 10. The DNS server is used to obtain the target address and target domain name of the edge gateway 10, and to determine and store the mapping relationship between the target address and the target domain name of the edge gateway 10.

[0051] In some embodiments, the domain name server also interfaces with the user terminal. When the user terminal has storage needs, it sends the domain name to the domain name server. The domain name server finds the corresponding address based on the mapping relationship, enabling the user terminal to access the corresponding edge gateway 10 based on the address found by the domain name server.

[0052] Combining the aforementioned edge gateway 10, data center gateway 20, controller, resource management platform, and domain name server, such as Figure 3 As shown below, the storage resource scheduling process provided in this application is described from the perspective of the overall process: 1. Data Center Registration: The data center gateway access controller grants the controller permission to access the storage resource information provided by the data center connected to the data center gateway. Thus, the controller accesses each data center connected to the data center gateway, obtains the storage resource information of the data center connected to the data center gateway, and completes the registration process of the data center at the controller.

[0053] 2. Storage Resource Information Registration: The controller sends the acquired storage resource information to the resource management platform. The resource management platform registers and stores the storage resource information provided by the data centers connected to each data center gateway. Administrators can log in to the resource management platform to view and manage the storage resource information entered in the resource management platform.

[0054] 3. Storage resource information synchronization: The controller sends the storage resource information of the data centers connected to each data center gateway to each edge gateway, so that the edge gateway can store the storage resource information of each data center.

[0055] 4. Edge gateway domain name and address matching: After the edge gateway is established, the IP address and domain name of the edge gateway must be reported to the domain name server so that the domain name server can determine and store the mapping relationship between the IP address and the domain name of the edge gateway.

[0056] 5. User terminal access to the edge gateway: The user enters the domain name of the edge gateway they want to access in the user terminal. The user terminal accesses the domain name server and requests the corresponding IP address from the domain name server. Based on the domain name and mapping relationship, the domain name server returns the IP address corresponding to the edge gateway to the user terminal, so that the user terminal can access the edge gateway based on the IP address.

[0057] 6. Storage Resource Request: The user terminal sends a message body encapsulating resource requirement parameters to the edge gateway. Based on the resource requirement parameters and the storage resource information of the data centers connected to each data center gateway stored therein, the edge gateway determines the matching target data center. Thus, the edge gateway establishes a data transmission channel between the data center gateway connected to the target data center to meet the storage needs of the user terminal.

[0058] In some embodiments, the hardware structure of the edge gateway 10 can be as follows: Figure 4 The illustrated electronic device includes a processor 101, a memory 102, a communication interface 103, and a bus 104. The memory 102 exists independently of the processor 101. The processor 101, the memory 102, and the communication interface 103 are connected via the bus 104.

[0059] Processor 101 is the control center of the electronic device. It can be a single processor or a collective term for multiple processing elements. For example, processor 101 can be a general-purpose central processing unit (CPU) or other general-purpose processors. Among them, the general-purpose processor can be a microprocessor or any conventional processor.

[0060] As one embodiment, processor 101 may include one or more CPUs, for example Figure 4 CPU 0 and CPU 1 are shown in the diagram.

[0061] The memory 102 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), disk storage medium or other magnetic storage device, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0062] The memory 102 can be connected to the processor 101 via the bus 104 and is used to store instructions or program code. When the processor 101 calls and executes the instructions or program code stored in the memory 102, it can implement the storage resource scheduling method provided in this embodiment of the invention.

[0063] The communication interface 103 is used to connect with other devices via a communication network. The communication network can be Ethernet, a wireless access network, a wireless local area network (WLAN), etc. The communication interface 103 may include a receiving unit for receiving data and a transmitting unit for sending data.

[0064] Bus 104 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 4 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0065] In other embodiments, the memory 102 may also be integrated with the processor 101. For example... Figure 5 As shown, the electronic device may include a processor 105 and a communication interface 106, with the processor 105 coupled to the communication interface 106.

[0066] The functions of processor 105 can be referred to in the description of processor 101 above. In addition, processor 105 also has storage functions, which can be referred to in the description of memory 102 above.

[0067] The communication interface 106 is used to provide data to the processor 105. The communication interface 106 can be an internal interface of the electronic device or an external interface of the electronic device (equivalent to the communication interface 103).

[0068] It should be pointed out that, Figure 4 (or Figure 5 The structures shown in the diagram do not constitute a limitation on the electronic device, except... Figure 4 (or Figure 5 In addition to the components shown in the diagram, the electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0069] The following is in conjunction with the above. Figure 1 The storage resource scheduling system shown and the above Figure 4 (or Figure 5 The electronic device shown in the illustration will be used to provide a detailed description of the storage resource scheduling method provided in the embodiments of this application.

[0070] Figure 6 A flowchart of a storage resource scheduling method provided in this application embodiment, the method being executed by the aforementioned edge gateway 10, includes the following steps: S101. Collect the storage requirement parameters of the data to be stored from the user terminal.

[0071] In some embodiments, step S101 may specifically be implemented as follows: obtaining a storage message body sent by the user terminal, wherein the storage message body encapsulates storage requirement parameters of the user terminal's data to be stored; and parsing the storage requirement parameters of the user terminal's data to be stored from the storage message body. In some embodiments, the storage requirement parameters include one or more of the following: data purpose, data read / write latency, data throughput, storage type, storage tier, disaster recovery requirements, and storage price; the data center's storage resources include one or more of the following: object storage resources, block storage resources, and file storage resources.

[0072] S102. Based on the storage requirement parameters and the storage resource information of the data centers connected to each data center gateway, determine the target data center whose storage resources match the storage requirement parameters.

[0073] In some embodiments, storage requirement parameters can be divided into required parameters and non-required parameters. Required parameters include data read / write latency, data throughput, storage type, and disaster recovery requirements. Non-required parameters include data usage, storage tier, and storage price. Step S102 can be specifically implemented as follows: based on the storage resource information of the data centers connected to each data center gateway, the data center that meets all required parameters and meets the most non-required parameters is determined as the target data center.

[0074] S103. Establish a data transmission channel with the target data center.

[0075] S104. The data to be stored from the user terminal is transmitted to the storage resources of the target data center through the data transmission channel.

[0076] Figure 6The technical solution described above offers at least the following benefits: The edge gateway connects to the user terminal, and the data center gateway connects to the data center providing storage resources. The edge gateway collects the storage requirement parameters of the data to be stored from the user terminal, and then combines this with the storage resource information of each data center stored in the edge gateway to match the most suitable storage resource for the data to be stored. Finally, a data transmission channel is established between the edge gateway and the target data center, through which the data to be stored from the user terminal is transferred to the storage resources in the target data center. The storage requirement parameters characterize the storage needs of the user terminal, thus ensuring that the storage resources in the target data center matched by the edge gateway can meet the storage needs of the user terminal. Idle data center storage resources can be accurately allocated to user terminals with corresponding needs, alleviating storage resource constraints on some nodes.

[0077] This application also provides a computer-readable storage medium, including computer-executable instructions that, when run on a computer, cause the computer to execute any of the storage resource scheduling methods provided in the above embodiments.

[0078] This application also provides an electronic device, including a processor and a memory. The memory is used to store computer execution instructions. The processor is connected to the memory. When the electronic device is running, the processor executes the computer execution instructions stored in the memory, so that the electronic device executes any of the storage resource scheduling methods provided in the above embodiments.

[0079] This application also provides a computer program product containing computer execution instructions, which, when run on a computer, causes the computer to execute any of the storage resource scheduling methods provided in the above embodiments.

[0080] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented using software programs, implementation can be, in whole or in part, in the form of a computer program product. This computer program product includes one or more computer-executable instructions. When these computer-executable instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer-executable instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer-executable instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device containing one or more servers, data centers, etc., that can be integrated with the medium. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks, SSDs).

[0081] Although this application has been described herein in conjunction with various embodiments, those skilled in the art, by reviewing the accompanying drawings, disclosure, and appended claims, will understand and implement other variations of the disclosed embodiments in carrying out the claimed application. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple instances. A single processor or other unit can implement several functions listed in the claims. While different dependent claims may recite certain measures, this does not mean that these measures cannot be combined to produce good results.

[0082] Although this application has been described in conjunction with specific features and embodiments, it is obvious that various modifications and combinations can be made thereto without departing from the spirit and scope of this application. Accordingly, this specification and drawings are merely exemplary illustrations of this application as defined by the appended claims, and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of this application. Clearly, those skilled in the art can make various alterations and modifications to this application without departing from the spirit and scope of this application. Thus, if such modifications and modifications of this application fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and modifications.

[0083] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A storage resource scheduling system, characterized in that, The storage resource scheduling system comprises at least one edge gateway and at least one data center gateway, the edge gateway is used for connecting a user terminal, the data center gateway is used for connecting a data center, and storage resource information of the data center connected by each data center gateway is stored in the edge gateway; The edge gateway is further used for collecting storage demand parameters of the to-be-stored data of the user terminal, and determining a target data center in which storage resources match the storage demand parameters based on the storage demand parameters and the storage resource information of the data center connected by each data center gateway. The edge gateway is further used for establishing a data transmission channel with the target data center, and transmitting the to-be-stored data of the user terminal to the storage resources of the target data center through the data transmission channel.

2. The storage resource scheduling system of claim 1, wherein, The storage resource scheduling system further comprises a controller connected with the data center gateway; The controller is used for acquiring the storage resource information of the data center connected by the data center gateway; The controller is further used for sending the acquired storage resource information of each data center to each edge gateway, so that the storage resource information of each data center is stored in the edge gateway.

3. The storage resource scheduling system of claim 2, wherein, The storage resource scheduling system further comprises a resource management platform, and the controller is connected with the resource management platform; The controller is further used for inputting the acquired storage resource information of each data center into the resource management platform; The resource management platform is used for displaying the storage resource information of each data center input by the controller, and receiving and responding to a management operation of a management personnel on the storage resource information.

4. The storage resource scheduling system of claim 1, wherein, The storage resource scheduling system further comprises a domain name server connected with the edge gateway; The domain name server is used for acquiring a target address and a target domain name of the edge gateway, and determining and storing a mapping relationship between the target address and the target domain name of the edge gateway.

5. The storage resource scheduling system of claim 1, wherein, The edge gateway is specifically used for: Acquiring a storage message body sent by the user terminal, and encapsulating storage demand parameters of to-be-stored data of the user terminal in the storage message body; Parses the storage demand parameters of the to-be-stored data of the user terminal from the storage message body.

6. The storage resource scheduling system of claim 1, wherein, The storage demand parameters comprise one or more of data use, data read-write delay, data throughput, storage type, storage hierarchy, disaster recovery demand, and storage price; and the storage resources of the data center comprise one or more of object storage resources, block storage resources, and file storage resources.

7. The storage resource scheduling system of claim 6, wherein, The storage demand parameters comprise necessary parameters and non-necessary parameters, the necessary parameters comprise data read-write delay, data throughput, storage type, and disaster recovery demand, and the non-necessary parameters comprise data use, storage hierarchy, and storage price. The edge gateway is specifically used for: Based on the storage resource information of the data center connected by each data center gateway, determining a data center satisfying all necessary parameters and satisfying the most non-necessary parameters as a target data center.

8. A storage resource scheduling method, characterized by, The method is applied to an edge gateway in the storage resource scheduling system of any one of claims 1-7; the method comprises: Collecting storage requirement parameters of to-be-stored data of a user terminal; Based on the storage requirement parameters and storage resource information of data centers connected by each data center gateway, determining a target data center in which storage resources match the storage requirement parameters; Establishing a data transmission channel with the target data center; Transmitting the to-be-stored data of the user terminal to the storage resources of the target data center through the data transmission channel.

9. The method of claim 8, wherein, The collection of the storage requirement parameters of the to-be-stored data of the user terminal comprises: Obtaining a storage message body sent by the user terminal, the storage message body encapsulating the storage requirement parameters of the to-be-stored data of the user terminal; Obtaining the storage requirement parameters of the to-be-stored data of the user terminal from the storage message body.

10. The method of claim 8, wherein, The storage requirement parameters include one or more of data usage, data read-write delay, data throughput, storage type, storage hierarchy, disaster recovery requirement, and storage price; the storage resources of the data center include one or more of object storage resources, block storage resources, and file storage resources.

11. The method of claim 10, wherein, The storage requirement parameters include necessary parameters and non-necessary parameters, the necessary parameters include data read-write delay, data throughput, storage type, and disaster recovery requirement, and the non-necessary parameters include data usage, storage hierarchy, and storage price. Based on the storage requirement parameters and storage resource information of data centers connected by each data center gateway, determining a target data center in which storage resources match the storage requirement parameters comprises: Based on the storage resource information of data centers connected by each data center gateway, determining a target data center that meets all necessary parameters and meets the most non-necessary parameters.

12. An electronic device, comprising: The electronic device comprises a memory and a processor; The memory and the processor are coupled; The memory is used to store computer instructions; When the processor executes the computer instructions, the electronic device executes the storage resource scheduling method of any one of claims 8-11.

13. A computer-readable storage medium, characterized in that, The computer instructions, when executed on a computer, cause the computer to execute the storage resource scheduling method of any one of claims 8-11.

Images