File processing method, system and device, electronic equipment and storage medium

Abstract

The invention provides a file processing method, system and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a file processing signal generated by accessing a target file; calling a preset equalization algorithm to calculate and obtain a target gateway address meeting a preset access condition, wherein the preset access condition is a pre-configured condition for ensuring flow equalization between the virtual network interfaces; transmitting the file processing signal to a target virtual gateway corresponding to the target gateway address, wherein the target virtual gateway is a virtual network interface used for accessing the storage space of the target file; and processing the target file in the storage space through the target virtual gateway. According to the embodiment of the invention, when the file storage resource is accessed through the virtual gateway interface, a plurality of users do not need to share the same gateway interface, and the gateway interface meeting the condition is determined through the equalization algorithm, so that the load between the virtual gateway interfaces is relatively balanced, and the flow balance between different gateways is ensured.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to a file processing method and system, device, electronic device and storage medium. Background Art

[0002] Due to the high investment cost and difficult maintenance of information technology (IT) infrastructure construction, public cloud services that provide users with IT infrastructure resources such as computing, storage and network in a shared manner have developed rapidly. In the public cloud technology architecture, public cloud tenant-level resource isolation is achieved through virtual private cloud (VPC). The storage location of public cloud files is located in the public cloud infrastructure layer. User services deployed in the cloud server of the user's VPC can access the file storage resources of the infrastructure layer through a unified gateway interface, thereby realizing operations such as file data writing, reading and modification.

[0003] The file storage gateway interface service of traditional public clouds is generally deployed on multiple physical servers (physical gateway interface) at the infrastructure layer. The cloud servers within the VPC need to be connected to the physical gateway interface to realize the needs of user services within the cloud servers to access file storage resources.

[0004] However, when a physical gateway interface is used to access file storage resources, the same physical gateway interface needs to carry access from multiple users, and when multiple users share the same physical gateway interface, the balance of traffic between different physical gateway interfaces may not be guaranteed. Summary of the invention

[0005] The present disclosure provides a method and system, device, electronic device and storage medium for file processing. The main purpose is to solve the problem that when a physical gateway interface is used to access file storage resources, the same physical gateway interface needs to carry access by multiple users, and when multiple users share the same physical gateway interface, the balance of traffic between different physical gateway interfaces may not be guaranteed.

[0006] According to a first aspect of the present disclosure, a method for file processing is provided, comprising:

[0007] Get the file processing signal generated by accessing the target file;

[0008] Calling a preset balancing algorithm to calculate a target gateway address that satisfies a preset access condition, wherein the preset access condition is a pre-configured condition for ensuring traffic balance between virtual network interfaces;

[0009] Transmitting the file processing signal to a target virtual gateway corresponding to the target gateway address, wherein the target virtual gateway is a virtual network interface for accessing a storage space of the target file;

[0010] The target file in the storage space is processed through the target virtual gateway.

[0011] Optionally, before obtaining the file processing signal generated by accessing the target file, the method further includes:

[0012] Obtaining a gateway address corresponding to each virtual gateway, wherein the virtual gateways at least include the target virtual gateway;

[0013] Acquire the routing address information of the storage space, and create a mapping relationship between the virtual gateway and the storage space according to the gateway address corresponding to the virtual gateway and the routing address information;

[0014] The file resources in the storage space are mapped to the virtual gateway through the mapping relationship, and the access protocol of the file resources is converted into a standard access protocol based on the virtual gateway.

[0015] Optionally, after transmitting the file processing signal to the target virtual gateway corresponding to the target gateway address, the method further includes:

[0016] Obtaining gateway information of the target virtual gateway;

[0017] In the case where it is determined according to the gateway information that the target virtual gateway is abnormal, calling the preset balancing algorithm to calculate and obtain other gateway addresses that meet the preset access conditions;

[0018] The file processing signal is transmitted to other virtual gateways corresponding to the other gateway addresses, where the other virtual gateways are virtual gateways other than the target virtual gateway.

[0019] Optionally, before obtaining the file processing signal generated by accessing the target file, the method further includes:

[0020] In response to a configuration instruction of a virtual private cloud, obtaining a unique intranet address of the virtual private cloud, wherein the virtual private cloud is a service platform for executing file processing tasks;

[0021] Based on the virtual gateway creation request in the configuration instruction and the first configuration information, create a first preset number of the virtual gateways in the virtual private cloud, and bind each of the virtual gateways to the unique intranet address;

[0022] Based on the virtual gateway balancer creation request in the configuration instruction and the second configuration information, the virtual gateway balancer is created in the virtual private cloud, and the virtual gateway balancer is bound to the unique intranet address, and the virtual gateway balancer is used to call a preset balancing algorithm to calculate a target gateway address that meets the preset access condition;

[0023] Based on the cloud server creation request in the configuration instruction and the third configuration information, create a second preset number of cloud servers in the virtual private cloud, and bind the cloud servers to the unique intranet address, wherein the cloud servers are used to obtain a file processing signal generated by accessing a target file;

[0024] Based on the public network interface creation request in the configuration instruction and the fourth configuration information, the second preset number of public network interfaces are created in the virtual private cloud, and the public network interface is bound to the cloud server, wherein the public network interface is the interface for the cloud server to access the public network.

[0025] According to a second aspect of the present disclosure, a virtual private cloud is provided, wherein the virtual private cloud is used to execute the method described in the first aspect, including: a cloud server, a virtual gateway balancer, a virtual gateway,

[0026] The cloud server is used to obtain a file processing signal generated by accessing a target file;

[0027] The preset virtual gateway balancer is used to call a preset balancing algorithm to calculate a target gateway address that meets a preset access condition, where the preset access condition is a pre-configured condition that ensures traffic balance between virtual network interfaces;

[0028] The preset virtual gateway equalizer is further used to transmit the file processing signal to a target virtual gateway corresponding to the target gateway address, where the target virtual gateway is a virtual network interface for accessing a storage space of the target file;

[0029] The virtual gateway is used to process the target file in the storage space.

[0030] Optionally, the virtual private cloud further includes: a public network interface,

[0031] The public network interface is the interface through which the cloud server accesses the public network.

[0032] According to a third aspect of the present disclosure, there is provided a device for file processing, comprising:

[0033] A first acquisition unit, used for acquiring a file processing signal generated by accessing a target file;

[0034] A calling unit, configured to call a preset balancing algorithm to calculate a target gateway address that satisfies a preset access condition, wherein the preset access condition is a pre-configured condition for ensuring traffic balance between virtual network interfaces;

[0035] A transmission unit, used to transmit the file processing signal to a target virtual gateway corresponding to the target gateway address, wherein the target virtual gateway is a virtual network interface for accessing a storage space of the target file;

[0036] A processing unit is used to process the target file in the storage space through the target virtual gateway.

[0037] Optionally, the device further comprises:

[0038] A second acquisition unit is used to acquire a gateway address corresponding to each virtual gateway, wherein the virtual gateways at least include the target virtual gateway;

[0039] The second acquisition unit is further used to acquire routing address information of the storage space, and create a mapping relationship between the virtual gateway and the storage space according to the gateway address corresponding to the virtual gateway and the routing address information;

[0040] A mapping unit, configured to map the file resources in the storage space to the virtual gateway through the mapping relationship;

[0041] A conversion unit is used to convert the access protocol of the file resource into a standard access protocol based on the virtual gateway.

[0042] Optionally, the first acquisition unit is further used to acquire gateway information of the target virtual gateway;

[0043] The calling unit is further configured to, when it is determined according to the gateway information that the target virtual gateway is abnormal, call the preset balancing algorithm to calculate and obtain other gateway addresses that meet the preset access conditions;

[0044] The transmission unit is further configured to transmit the file processing signal to other virtual gateways corresponding to the other gateway addresses, where the other virtual gateways are virtual gateways other than the target virtual gateway.

[0045] Optionally, the second acquisition unit is further used to, in response to a configuration instruction of a virtual private cloud, acquire a unique intranet address of the virtual private cloud, wherein the virtual private cloud is a service platform for executing file processing tasks;

[0046] The device also includes:

[0047] A creating unit, configured to create a first preset number of virtual gateways in the virtual private cloud based on the virtual gateway creation request in the configuration instruction and the first configuration information, and bind each of the virtual gateways to the unique intranet address;

[0048] The creation unit is further used to create the virtual gateway balancer in the virtual private cloud based on the virtual gateway balancer creation request in the configuration instruction and the second configuration information, and bind the virtual gateway balancer to the unique intranet address, and the virtual gateway balancer is used to call a preset balancing algorithm to calculate a target gateway address that meets the preset access condition;

[0049] The creation unit is further used to create a second preset number of cloud servers in the virtual private cloud based on the cloud server creation request in the configuration instruction and the third configuration information, and bind the cloud servers to the unique intranet address, wherein the cloud servers are used to obtain the file processing signal generated by accessing the target file;

[0050] The creation unit is also used to create the second preset number of public network interfaces in the virtual private cloud based on the public network interface creation request in the configuration instruction and the fourth configuration information, and bind the public network interface to the cloud server, wherein the public network interface is the interface for the cloud server to access the public network.

[0051] According to a fourth aspect of the present disclosure, there is provided an electronic device, including:

[0052] at least one processor; and

[0053] a memory communicatively connected to the at least one processor; wherein,

[0054] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect.

[0055] According to a fifth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method described in the first aspect.

[0056] According to a sixth aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the method described in the first aspect is implemented.

[0057] The file processing method, system, device, electronic device and storage medium provided by the present disclosure obtain a file processing signal generated by accessing a target file; call a preset balancing algorithm to calculate a target gateway address that meets a preset access condition, wherein the preset access condition is a pre-configured condition that ensures traffic balance between virtual network interfaces; transmit the file processing signal to a target virtual gateway corresponding to the target gateway address, wherein the target virtual gateway is a virtual network interface for accessing the storage space of the target file; and process the target file in the storage space through the target virtual gateway. Compared with the related art, when accessing file storage resources through a virtual gateway interface, the embodiment of the present disclosure can dynamically expand the number of virtual gateways as needed to enhance its dynamic expansion capability, without the need for multiple users to share the same gateway interface, and by determining a gateway interface that meets the conditions through a balancing algorithm, it is possible to achieve a relatively balanced load between virtual gateway interfaces, thereby ensuring traffic balance between different gateways.

[0058] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0060] Figure 1 A flowchart of a method for processing a file provided by an embodiment of the present disclosure;

[0061] Figure 2 A schematic diagram of a file processing principle provided by an embodiment of the present disclosure;

[0062] Figure 3 A schematic diagram of a mapping configuration process between a virtual gateway and a storage space provided in an embodiment of the present disclosure;

[0063] Figure 4 A schematic diagram of a virtual resource activation process provided by an embodiment of the present disclosure;

[0064] Figure 5 A schematic diagram of the structure and workflow of a virtual private cloud provided by an embodiment of the present disclosure;

[0065] Figure 6 A schematic diagram of the structure of a file processing device provided by an embodiment of the present disclosure;

[0066] Figure 7 A schematic diagram of the structure of another file processing device provided by an embodiment of the present disclosure;

[0067] Figure 8 A schematic block diagram of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0068] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0069] The following describes the file processing method, device, electronic device and storage medium of the embodiments of the present disclosure with reference to the accompanying drawings.

[0070] Figure 1 A flowchart of a file processing method provided by an embodiment of the present disclosure.

[0071] like Figure 1 As shown, the method comprises the following steps:

[0072] Step 101: Acquire a file processing signal generated by accessing a target file.

[0073] The method for accessing a target file described in the present disclosure has application scenarios including but not limited to: virtual private cloud services in a public cloud scenario, accessing files from a physical device, etc. Specifically, the embodiments of the present disclosure do not limit the application scenarios of the present disclosure.

[0074] In order to facilitate understanding of the implementation process of the embodiments of the present disclosure, the following description will be given using a virtual private cloud service in a public cloud scenario as an example of an application scenario.

[0075] In an embodiment of the present disclosure, the file processing signal is a traffic signal generated after a user initiates an instruction to access a target file. The file processing signal triggers a corresponding module to call an algorithm to determine the best path to access the target file. In a virtual private cloud service, the location where the file processing signal is generated is a cloud server, and the file processing signal is acquired by a virtual gateway balancer. The cloud server and the virtual gateway balancer are virtual resources that the user has subscribed and activated in advance in the virtual cloud service.

[0076] Step 102: Call a preset balancing algorithm to calculate a target gateway address that satisfies a preset access condition, where the preset access condition is a pre-configured condition that ensures traffic balance between virtual network interfaces.

[0077] In an embodiment of the present disclosure, the preset balancing algorithm is a custom-set algorithm, which is used to determine a virtual network interface that meets the preset access condition. The preset access condition is a custom-set condition, for example: ensuring traffic balance between virtual network interfaces, ensuring that the virtual network interface is not overloaded, ensuring the operating efficiency of the virtual network interface, etc. Specifically, the embodiment of the present disclosure does not limit the preset balancing algorithm and the preset access condition.

[0078] Among them, in the virtual private cloud service, the location for calling the preset balancing algorithm is the virtual gateway balancer.

[0079] Step 103: Transmit the file processing signal to a target virtual gateway corresponding to the target gateway address, where the target virtual gateway is a virtual network interface for accessing a storage space of the target file.

[0080] In the disclosed embodiment, the virtual gateway, also called a virtual gateway interface, will encapsulate a layer of standard file access protocol for the file storage space subscribed by the user, so that the user can use the file storage space resources through the standard file access protocol. To ensure the active-active nature of the gateway interface, the gateway interfaces connected to the same file storage space generally have no less than two, identical virtual gateways.

[0081] Step 104: Process the target file in the storage space through the target virtual gateway.

[0082] In the embodiment of the present disclosure, the storage space is a file storage space for storing file resources that is selected and ordered by the user based on business needs. In public cloud file storage, standard file access protocols (NFS protocol and CIFS protocol) are generally supported, while the storage space generally only supports private file access protocols, such as Fuse. Therefore, when accessing file resources in the storage space through the target virtual gateway, the storage space is generally mapped to the virtual gateway, and the conversion from the private protocol to the standard file access protocol is implemented in the virtual gateway.

[0083] The process of mapping the storage space to the virtual gateway needs to be configured and mapped in advance.

[0084] In order to facilitate understanding of the implementation principle of the embodiment of the present disclosure, a schematic diagram of the principle of file processing is provided, as shown in FIG. Figure 2As shown, the public cloud platform represents the application scenario of the present disclosure as a virtual private cloud service under the public cloud scenario, and VPC is a virtual private cloud service. The file storage infrastructure includes the storage space. When the user logs in to the public cloud platform and creates a VPC resource management space, the user switches to the file storage management platform interface to order file storage resources and activate storage space. By specifying the VPC, the virtual gateway interface and the virtual gateway balancer are activated in sequence, and the mapping of storage space and the standard file access protocol conversion are implemented in the virtual gateway interface. The virtual gateway interface is automatically configured as the backend forwarding node of the virtual gateway balancer. At the same time, the cloud server and the public network interface are activated under the same VPC, so that the cloud server can access the file storage usage requirements through the standard protocol. The user can connect to the cloud server through the public network interface to realize the public cloud file storage resource usage requirements.

[0085] The file processing method provided by the present disclosure obtains a file processing signal generated by accessing a target file; calls a preset balancing algorithm to calculate a target gateway address that meets a preset access condition, wherein the preset access condition is a pre-configured condition that ensures traffic balance between virtual network interfaces; transmits the file processing signal to a target virtual gateway corresponding to the target gateway address, wherein the target virtual gateway is a virtual network interface for accessing a storage space of the target file; and processes the target file in the storage space through the target virtual gateway. Compared with related technologies, when accessing file storage resources through a virtual gateway interface, the embodiment of the present disclosure can dynamically expand the number of virtual gateways as needed to enhance its dynamic expansion capability, without the need for multiple users to share the same gateway interface, and by determining a gateway interface that meets the conditions through a balancing algorithm, it is possible to achieve a relatively balanced load between virtual gateway interfaces, thereby ensuring traffic balance between different gateways.

[0086] In one possible implementation of the embodiment of the present disclosure, the storage space needs to be mapped to the virtual gateway in advance so that the file resources in the storage space can be directly accessed through the virtual gateway. Therefore, in order to access the storage space, the embodiment of the present disclosure provides a schematic diagram of the mapping configuration process between the virtual gateway and the storage space, as shown in FIG. Figure 3 As shown, including:

[0087] Step 301: Obtain a gateway address corresponding to each virtual gateway, wherein the virtual gateways at least include the target virtual gateway.

[0088] In the embodiment of the present disclosure, the gateway address is the unique address information of the virtual gateway, the number of the virtual gateways is custom set, and the gateway address contains the unique address information corresponding to all virtual gateways.

[0089] Step 302: Obtain routing address information of the storage space, and create a mapping relationship between the virtual gateway and the storage space according to the gateway address corresponding to the virtual gateway and the routing address information.

[0090] In the embodiment of the present disclosure, the routing address information is unique address information used to determine the address of the storage space. Through the routing address information and the gateway address, all virtual gateways can be connected to the storage space, and a mapping relationship between the virtual gateway and the storage space can be created through a connection channel, and the file resources in the storage space can be mapped to the virtual gateway according to the connection channel.

[0091] The connection method between the virtual gateway and the storage space includes but is not limited to: connecting the virtual gateway and the storage space through a network connectivity method between the VPC virtual layer and the infrastructure layer (for example, a network connector) so that users can access the subscribed infrastructure layer resources (for example, storage space) within the VPC.

[0092] Step 303: Map the file resources in the storage space to the virtual gateway through the mapping relationship, and convert the access protocol of the file resources into a standard access protocol based on the virtual gateway.

[0093] In the embodiments of the present disclosure, since standard file access protocols (NFS protocol and CIFS protocol) are generally supported in public cloud file storage, and the storage space generally only supports private file access protocols, such as Fuse, it is necessary to convert the file resources in the storage space into standard file access protocols through a virtual gateway.

[0094] In one implementable manner of the embodiment of the present disclosure, a gateway interface for accessing a target file may fail, resulting in a failure to access the target file normally. Therefore, in order to ensure smooth access to the target file, the following method may be used but is not limited to: obtaining gateway information of the target virtual gateway; when it is determined that the target virtual gateway is abnormal according to the gateway information, calling the preset balancing algorithm to calculate other gateway addresses that meet the preset access conditions; transmitting the file processing signal to other virtual gateways corresponding to the other gateway addresses, where the other virtual gateways are virtual gateways other than the target virtual gateway.

[0095] In one implementable manner of an embodiment of the present disclosure, in a virtual private cloud service in a public cloud scenario, when accessing a target file through a virtual gateway, it is necessary to configure the device in advance to meet the execution conditions of the method described in the present disclosure, that is, when performing file processing, it is necessary to pre-configure the prerequisites, and the prerequisites include but are not limited to: building file storage resources, building basic component supporting resources, etc.

[0096] Among them, regarding the construction of file storage resources, it includes: constructing file storage resources (the storage space) at the public cloud infrastructure layer, completing the file storage server rack, installing the operating system, and network configuration, and completing the file storage software deployment and installation in accordance with the file storage public cloud solution, so that it meets the requirements for public cloud infrastructure construction and has the conditions for ordering file storage resources.

[0097] Regarding the construction of supporting resources for basic components, it includes: building supporting component resources such as virtualization and balancers at the public cloud infrastructure layer, and completing the construction of supporting resources such as virtual gateway interfaces and virtual gateway balancers; at the same time, the public cloud infrastructure layer must have supporting resources such as cloud servers and public network interfaces, and meet the public cloud subscription requirements. In the public cloud software defined network (SDN) architecture, complete the construction of VPC infrastructure to enable user-level resource isolation functions, and provide VPC virtual layer and infrastructure layer network connectivity methods (for example: network connectors) so that users can access the subscribed infrastructure layer resources within the VPC. At the same time, complete the construction of public network interface resources.

[0098] In one implementable manner of the disclosed embodiment, after the above-mentioned prerequisites are configured, the user needs to activate the virtual private cloud service and activate the corresponding service resources in the virtual private cloud service (for example, create a virtual gateway, a cloud server, etc. in the virtual private cloud service) before the file processing operation can be performed in the virtual private cloud service through the virtual gateway. Therefore, in order to provide the prerequisite for the access processing of the target file, the following method can also be adopted but is not limited to: in response to the configuration instruction of the virtual private cloud, obtain the unique intranet address of the virtual private cloud, wherein the virtual private cloud is a service platform for executing file processing tasks; based on the virtual gateway creation request in the configuration instruction and the first configuration information, create a first preset number of the virtual gateways in the virtual private cloud, and bind each of the virtual gateways to the unique intranet address; based on the virtual gateway creation request in the configuration instruction and the first configuration information, The virtual gateway balancer is created in the virtual private cloud based on the cloud server creation request and the second configuration information, and the virtual gateway balancer is created in the virtual private cloud, and the virtual gateway balancer is bound to the unique intranet address, and the virtual gateway balancer is used to call a preset balancing algorithm to calculate a target gateway address that meets the preset access conditions; based on the cloud server creation request and the third configuration information in the configuration instruction, a second preset number of cloud servers are created in the virtual private cloud, and the cloud servers are bound to the unique intranet address, wherein the cloud servers are used to obtain file processing signals generated by accessing target files; based on the public network interface creation request and the fourth configuration information in the configuration instruction, a second preset number of public network interfaces are created in the virtual private cloud, and the public network interfaces are bound to the cloud servers, wherein the public network interfaces are interfaces for the cloud servers to access the public network.

[0099] In order to facilitate understanding of the implementation process of the embodiment of the present disclosure, the embodiment of the present disclosure provides a schematic diagram of the process of opening a virtual resource, such as Figure 4As shown, each infrastructure resource is the supporting resource of the construction basic components constructed in the above prerequisites, and each management platform is a creation platform for the corresponding virtual resources that need to be activated. Specifically, the creation process of various virtual resources includes but is not limited to: (1) the user uses a public cloud account to log in to the public cloud platform and prepares to order various basic resources; (2) the user switches to the public cloud VPC ordering management interface, activates VPC infrastructure resources, creates VPC resource isolation space, and opens up the network path between VPC and public cloud infrastructure; (3) the user switches to the file storage ordering management interface, activates file storage resources (storage space), and needs to select the ordered storage space size, the availability zone (AZ) to which the resource pool belongs, and other options in turn, and issue the ordering file storage infrastructure resource operation to complete the file storage resource ordering; (4) the user switches to the virtual gateway management interface, and issues the virtual gateway infrastructure resource activation operation. The virtual gateway interface is created and bound to the VPC resource isolation space to achieve resource isolation. (5) The user switches to the virtual gateway balancer management interface, activates balancer infrastructure resources, and orders a virtual gateway balancer. The virtual gateway balancer is also bound to the VPC resource isolation space to achieve resource isolation. (6) The user switches to the cloud server management interface, activates cloud server infrastructure resources, and orders a cloud server. The cloud server is also bound to the VPC resource isolation space. The cloud server enables users to access file storage through the cloud server by mapping the file storage resources according to the virtual gateway interface. (7) The user switches to the public network interface service management platform, activates public network infrastructure resources, orders public network interface services, and binds the public network interface services to the cloud server, so that customer services can connect to the cloud server according to the public network service interface, thereby using public cloud infrastructure resources.

[0100] Related to the above-mentioned file processing method, Figure 5 A schematic diagram of the structure and workflow of a virtual private cloud provided by an embodiment of the present disclosure is shown in FIG. Figure 5 As shown, it includes: cloud server, virtual gateway balancer, virtual gateway,

[0101] The cloud server is used to obtain a file processing signal generated by accessing a target file;

[0102] The preset virtual gateway balancer is used to call a preset balancing algorithm to calculate a target gateway address that meets a preset access condition, where the preset access condition is a pre-configured condition that ensures traffic balance between virtual network interfaces;

[0103] The preset virtual gateway equalizer is further used to transmit the file processing signal to a target virtual gateway corresponding to the target gateway address, where the target virtual gateway is a virtual network interface for accessing a storage space of the target file;

[0104] The virtual gateway is used to process the target file in the storage space.

[0105] In one possible implementation of the embodiment of the present disclosure, the virtual private cloud further includes: a public network interface,

[0106] The public network interface is the interface through which the cloud server accesses the public network.

[0107] The file processing system at least includes the virtual private cloud, such as Figure 5 As shown, file storage instance (storage space): File storage instance belongs to the public cloud file storage infrastructure resources. Through the file storage system's Create, Unsubscribe, Destroy, Modify Config and other interfaces, users can apply for, release, and reconfigure file storage resources. In the file storage resource management interface, users can select resource pools and order file storage instances of the required capacity as needed according to business needs. After the order is successful, file storage instance resources of the specified capacity will be created on demand at the file storage infrastructure layer. File storage instance is a file storage space of a specified size ordered by the user. The user can use the storage space to implement operations such as file storage and access. The storage space is unique to the user, and other customers cannot perceive the storage space and cannot operate the file data in the storage space.

[0108] VPC (Virtual Private Cloud): Public cloud provides users with independent resource management space through VPC virtual private cloud. Users can only see the resources within their VPC, and the VPC resource management spaces of different users are isolated from each other, which can maximize the independence and security of the public cloud resources ordered by users. In the VPC virtual private cloud management interface, users select a specified resource pool and create a VPC under the resource pool (Note: All file storage instances and their supporting components are generally created in the same resource pool, and it is also applicable to cross-resource pool scenarios).

[0109] Virtual gateway interface (virtual gateway): The virtual gateway interface encapsulates a layer of standard file access protocol for the file storage instance ordered by the user, so that the user can use the file storage instance resources through the standard file access protocol. To ensure the active-active gateway interface, for the same file storage instance, the system generally has no less than two virtual gateways with equal roles. In the virtual gateway management interface, the user selects a specified resource pool, and creates a virtual gateway interface in the resource pool using a specified image. The virtual gateway interface is located in the VPC virtual private cloud, and the virtual gateway interface is bound to the VPC intranet IP address.

[0110] Virtual gateway balancer: The introduction of the virtual gateway balancer is mainly to ensure the load balancing and high availability requirements between the user's virtual gateway interfaces. First of all, load balancing mainly solves the virtual gateway balancer. User access traffic is sent to the virtual gateway balancer first. The virtual gateway balancer can decide which backend virtual gateway interface to forward the traffic to based on its own balancing algorithm. Secondly, high availability mainly solves when one of the virtual gateway interfaces fails. With the help of the backend virtual gateway health check mechanism configured by the virtual gateway balancer, the faulty backend can be discovered in time and the fault switching can be completed in time, thereby ensuring business continuity. In the virtual gateway balancer management interface, the user selects a specified resource pool and creates a virtual gateway balancer with a specified configuration (type, bandwidth size). The virtual gateway balancer is located in the VPC virtual private cloud, and the virtual gateway balancer is bound to the VPC intranet IP address.

[0111] Cloud server: In the public cloud file storage usage plan, the cloud server plays the role of file storage client. By mapping file storage resources to the cloud server, user services can achieve real-time access to file storage resources through the cloud server, and implement operations such as adding, deleting, modifying, and checking file data. In the cloud server management interface, the user selects a specified resource pool and creates a cloud server with a specified configuration (cloud server type, cloud server CPU, cloud server memory, and cloud server operating system, etc.). The cloud server is located in the VPC virtual private cloud, and the VPC intranet IP address is bound to the cloud server.

[0112] Public network interface: The public network interface is strongly related to the cloud server. The cloud server is an internal resource of the public cloud and is generally not interoperable with the external Internet. The public cloud platform generally provides a public network access interface and binds the public network access interface to the cloud server, which can achieve connectivity between the public cloud intranet cloud server and the public Internet, thereby providing a service entry for public network business access for users' services after they go to the cloud. In the public network resource management interface, the user selects a specified resource pool and creates a public network interface with a specified configuration (for example: bandwidth size, IPv4 / IPv6, etc.) (one public network interface is bound to each cloud server). The public network interface only needs to be associated with the cloud server, and does not need to be associated with the VPC virtual private cloud.

[0113] In summary, the embodiments of the present disclosure can achieve the following effects:

[0114] 1. When the embodiment of the present disclosure accesses file storage resources through a virtual gateway interface, the number of virtual gateways can be dynamically expanded as needed to enhance its dynamic expansion capability. There is no need for multiple users to share the same gateway interface. By determining the qualified gateway interface through a balancing algorithm, the load between the virtual gateway interfaces can be relatively balanced, thereby ensuring traffic balance between different gateways.

[0115] 2. The disclosed embodiment places the file storage service gateway interface in the VPC tenant virtual layer through a user-level virtual gateway interface, dynamically expands the number of virtual gateways as needed, and enhances its dynamic expansion capability; at the same time, the file storage physical gateway interface is no longer shared between tenants, which can effectively solve the performance crowding problem of sharing the physical gateway interface between multiple tenants.

[0116] 3. The disclosed embodiment ensures gateway load balancing through a virtual gateway balancing strategy: tenant access traffic passes through the virtual gateway balancer first and then to the virtual gateway interface, so that the load between virtual gateway interfaces is relatively balanced, thereby ensuring the consistency of tenant gateway loads and avoiding load imbalance problems between different gateways of tenants.

[0117] 4. The disclosed embodiments reduce gateway resource consumption by creating user-level gateway resources on demand: VPC tenant-level gateway services are implemented on demand, and gateway services required by tenants can be opened instantly on demand without the need to pre-deploy a large number of physical gateway services, thereby reducing the problem of continuous resource consumption caused by long-term operation of physical gateway services.

[0118] Corresponding to the above-mentioned file processing method, the present invention also provides a file processing device. Since the device embodiment of the present invention corresponds to the above-mentioned method embodiment, details not disclosed in the device embodiment can be referred to the above-mentioned method embodiment, and will not be repeated in the present invention.

[0119] Figure 6 A schematic diagram of a file processing device provided by an embodiment of the present disclosure is shown in FIG. Figure 6 As shown, including:

[0120] A first acquisition unit 61 is used to acquire a file processing signal generated by accessing a target file;

[0121] A calling unit 62 is used to call a preset balancing algorithm to calculate a target gateway address that meets a preset access condition, where the preset access condition is a pre-configured condition for ensuring traffic balance between virtual network interfaces;

[0122] A transmission unit 63, configured to transmit the file processing signal to a target virtual gateway corresponding to the target gateway address, wherein the target virtual gateway is a virtual network interface for accessing a storage space of the target file;

[0123] The processing unit 64 is configured to process the target file in the storage space through the target virtual gateway.

[0124] The file processing device provided by the present disclosure obtains a file processing signal generated by accessing a target file; calls a preset balancing algorithm to calculate a target gateway address that meets a preset access condition, wherein the preset access condition is a pre-configured condition to ensure traffic balance between virtual network interfaces; transmits the file processing signal to a target virtual gateway corresponding to the target gateway address, wherein the target virtual gateway is a virtual network interface for accessing a storage space of the target file; and processes the target file in the storage space through the target virtual gateway. Compared with the related art, when accessing file storage resources through a virtual gateway interface, the embodiment of the present disclosure can dynamically expand the number of virtual gateways as needed, thereby enhancing its dynamic expansion capability, without the need for multiple users to share the same gateway interface, and by determining a gateway interface that meets the conditions through a balancing algorithm, it is possible to achieve a relatively balanced load between virtual gateway interfaces, thereby ensuring traffic balance between different gateways.

[0125] Furthermore, in a possible implementation of the embodiment of the present disclosure, as Figure 7 As shown, the device also includes:

[0126] A second acquisition unit 65 is configured to acquire a gateway address corresponding to each virtual gateway, wherein the virtual gateways at least include the target virtual gateway;

[0127] The second acquisition unit 65 is further used to acquire the routing address information of the storage space, and create a mapping relationship between the virtual gateway and the storage space according to the gateway address corresponding to the virtual gateway and the routing address information;

[0128] A mapping unit 66, configured to map the file resources in the storage space to the virtual gateway through the mapping relationship;

[0129] The conversion unit 67 is used to convert the access protocol of the file resource into a standard access protocol based on the virtual gateway.

[0130] Further, in a possible implementation of the embodiment of the present disclosure, the first acquisition unit 61 is further used to acquire gateway information of the target virtual gateway;

[0131] The calling unit 62 is also used to, when it is determined according to the gateway information that the target virtual gateway is abnormal, call the preset balancing algorithm to calculate and obtain other gateway addresses that meet the preset access conditions;

[0132] The transmission unit 63 is further configured to transmit the file processing signal to other virtual gateways corresponding to the other gateway addresses, where the other virtual gateways are virtual gateways other than the target virtual gateway.

[0133] Further, in a possible implementation of the embodiment of the present disclosure, the second acquisition unit 65 is further used to, in response to a configuration instruction of a virtual private cloud, acquire a unique intranet address of the virtual private cloud, wherein the virtual private cloud is a service platform for executing file processing tasks;

[0134] like Figure 7 As shown, the device also includes:

[0135] A creation unit 68, configured to create a first preset number of virtual gateways in the virtual private cloud based on the virtual gateway creation request in the configuration instruction and the first configuration information, and bind each of the virtual gateways to the unique intranet address;

[0136] The creation unit 68 is further used to create the virtual gateway balancer in the virtual private cloud based on the virtual gateway balancer creation request in the configuration instruction and the second configuration information, and bind the virtual gateway balancer to the unique intranet address, and the virtual gateway balancer is used to call a preset balancing algorithm to calculate a target gateway address that meets the preset access condition;

[0137] The creation unit 68 is further configured to create a second preset number of cloud servers in the virtual private cloud based on the cloud server creation request in the configuration instruction and the third configuration information, and bind the cloud servers to the unique intranet address, wherein the cloud servers are used to obtain the file processing signal generated by accessing the target file;

[0138] The creation unit 68 is also used to create the second preset number of public network interfaces in the virtual private cloud based on the public network interface creation request in the configuration instruction and the fourth configuration information, and bind the public network interface to the cloud server, wherein the public network interface is the interface for the cloud server to access the public network.

[0139] It should be noted that the above explanation of the method embodiment is also applicable to the device of the embodiment of the present disclosure, and the principle is the same, which is no longer limited in the embodiment of the present disclosure.

[0140] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0141] Figure 8A schematic block diagram of an example electronic device 800 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0142] like Figure 8 As shown, the device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a ROM (Read-Only Memory) 802 or a computer program loaded from a storage unit 808 to a RAM (Random Access Memory) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An I / O (Input / Output) interface 805 is also connected to the bus 804.

[0143] A number of components in the device 800 are connected to the I / O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0144] The computing unit 801 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a CPU (Central Processing Unit), a GPU (Graphic Processing Units), various dedicated AI (Artificial Intelligence) computing chips, various computing units running machine learning model algorithms, a DSP (Digital Signal Processor), and any appropriate processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as a method for file processing. For example, in some embodiments, the method for file processing may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to execute the aforementioned file processing method in any other appropriate manner (for example, by means of firmware).

[0145] Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, FPGAs (Field Programmable Gate Arrays), ASICs (Application-Specific Integrated Circuits), ASSPs (Application Specific Standard Products), SOCs (System On Chips), CPLDs (Complex Programmable Logic Devices), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that may be executed and / or interpreted on a programmable system including at least one programmable processor that may be a special purpose or general purpose programmable processor that may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0146] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0147] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a RAM, a ROM, an EPROM (Electrically Programmable Read-Only-Memory) or a flash memory, an optical fiber, a CD-ROM (Compact Dis sc Read-Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0148] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball), through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0149] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (Local Area Network), WAN (Wide Area Network), the Internet, and blockchain networks.

[0150] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0151] It should be noted that artificial intelligence is a discipline that studies how computers can simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), and includes both hardware-level and software-level technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, as well as machine learning / deep learning, big data processing technology, knowledge graph technology, and other major directions.

[0152] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0153] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for file processing, characterized in that: include: Get the file processing signal generated by accessing the target file; Calling a preset balancing algorithm to calculate a target gateway address that satisfies a preset access condition, wherein the preset access condition is a pre-configured condition for ensuring traffic balance between virtual network interfaces; Transmitting the file processing signal to a target virtual gateway corresponding to the target gateway address, wherein the target virtual gateway is a virtual network interface for accessing a storage space of the target file; The target file in the storage space is processed through the target virtual gateway.

2. The method according to claim 1, characterized in that Before obtaining the file processing signal generated by accessing the target file, the method further includes: Obtaining a gateway address corresponding to each virtual gateway, wherein the virtual gateways at least include the target virtual gateway; Acquire the routing address information of the storage space, and create a mapping relationship between the virtual gateway and the storage space according to the gateway address corresponding to the virtual gateway and the routing address information; The file resources in the storage space are mapped to the virtual gateway through the mapping relationship, and the access protocol of the file resources is converted into a standard access protocol based on the virtual gateway.

3. The method according to claim 2, characterized in that After transmitting the file processing signal to the target virtual gateway corresponding to the target gateway address, the method further includes: Obtaining gateway information of the target virtual gateway; In the case where it is determined according to the gateway information that the target virtual gateway is abnormal, calling the preset balancing algorithm to calculate and obtain other gateway addresses that meet the preset access conditions; The file processing signal is transmitted to other virtual gateways corresponding to the other gateway addresses, where the other virtual gateways are virtual gateways other than the target virtual gateway.

4. The method according to claim 1, characterized in that: Before obtaining the file processing signal generated by accessing the target file, the method further includes: In response to a configuration instruction of a virtual private cloud, obtaining a unique intranet address of the virtual private cloud, wherein the virtual private cloud is a service platform for executing file processing tasks; Based on the virtual gateway creation request in the configuration instruction and the first configuration information, create a first preset number of the virtual gateways in the virtual private cloud, and bind each of the virtual gateways to the unique intranet address; Based on the virtual gateway balancer creation request in the configuration instruction and the second configuration information, the virtual gateway balancer is created in the virtual private cloud, and the virtual gateway balancer is bound to the unique intranet address, and the virtual gateway balancer is used to call a preset balancing algorithm to calculate a target gateway address that meets the preset access condition; Based on the cloud server creation request in the configuration instruction and the third configuration information, create a second preset number of cloud servers in the virtual private cloud, and bind the cloud servers to the unique intranet address, wherein the cloud servers are used to obtain a file processing signal generated by accessing a target file; Based on the public network interface creation request in the configuration instruction and the fourth configuration information, the second preset number of public network interfaces are created in the virtual private cloud, and the public network interface is bound to the cloud server, wherein the public network interface is the interface for the cloud server to access the public network.

5. A virtual private cloud, characterized in that: The virtual private cloud is used to execute the method according to any one of claims 1 to 4, comprising: a cloud server, a virtual gateway balancer, and a virtual gateway. The cloud server is used to obtain a file processing signal generated by accessing a target file; The preset virtual gateway balancer is used to call a preset balancing algorithm to calculate a target gateway address that meets a preset access condition, where the preset access condition is a pre-configured condition that ensures traffic balance between virtual network interfaces; The preset virtual gateway equalizer is further used to transmit the file processing signal to a target virtual gateway corresponding to the target gateway address, where the target virtual gateway is a virtual network interface for accessing a storage space of the target file; The virtual gateway is used to process the target file in the storage space.

6. The virtual private cloud according to claim 5, characterized in that: The virtual private cloud also includes: a public network interface, The public network interface is the interface through which the cloud server accesses the public network.

7. A file processing device, characterized in that: include: A first acquisition unit, used for acquiring a file processing signal generated by accessing a target file; A calling unit, configured to call a preset balancing algorithm to calculate a target gateway address that satisfies a preset access condition, wherein the preset access condition is a pre-configured condition for ensuring traffic balance between virtual network interfaces; A transmission unit, used to transmit the file processing signal to a target virtual gateway corresponding to the target gateway address, wherein the target virtual gateway is a virtual network interface for accessing a storage space of the target file; A processing unit is used to process the target file in the storage space through the target virtual gateway.

8. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 4.

9. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-4.

10. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 4.

Images