Load-balanced network service management method and device and medium

By analyzing client requests and distributing them to multiple cloud servers, combining intelligent forwarding strategies and monitoring isolation mechanisms, the traffic allocation problem in big data network cloud services is solved, system performance and stability are improved, and management costs are reduced.

CN119211246APending Publication Date: 2024-12-27GUANGDONG POWER GRID CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411313792.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-20
Publication Date
2024-12-27

AI Technical Summary

Technical Problem

The existing technology is difficult to achieve reasonable allocation of traffic in big data network cloud services, resulting in overloading of cloud servers, low service efficiency and poor stability.

Method used

By analyzing client access requests, dynamically selecting and adjusting the number of cloud servers, distributing access traffic to multiple cloud servers, adopting intelligent forwarding strategies to avoid single point of pressure, achieving load balancing, and ensuring system stability by monitoring and isolating abnormal servers. .

Benefits of technology

Improves the overall performance and stability of the system, reduces management complexity and cost, supports high concurrency and large-scale access, and avoids system crashes and service outages.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119211246A_ABST
    Figure CN119211246A_ABST
Patent Text Reader

Abstract

The invention discloses a load-balanced network service management method and device and a medium. The method comprises the following steps: acquiring an access request sent by a client; analyzing a domain name in the access request to obtain a target access address of the first target cloud server; determining a plurality of second cloud servers according to the target access address; and distributing the access traffic of the first target cloud server to a plurality of second cloud servers, controlling the plurality of second cloud servers to respond to the access request, and providing a cloud service for the client. According to the load-balanced network service management method and device and the medium, the second cloud server is determined by analyzing the domain name, so that load balancing can be realized, and overload of a single cloud server is avoided; through the flow distribution and response control mode, the flexibility and expandability of the system are improved, the requirements of service development are met, and the problems that reasonable flow distribution is difficult to achieve, and overload faults of the cloud server are avoided can be solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of network technology, and in particular to a load-balanced network service management method, device and medium. Background Art

[0002] The popularity of the Internet and the development of technologies such as the Internet of Things and social media have led to an exponential growth in the amount of data generated by people every day. These data include not only traditional structured data, but also a large amount of unstructured data, such as pictures, audio, video, etc. This explosive growth in data volume makes traditional data management methods unsustainable and requires more efficient and intelligent big data management methods to handle. Therefore, for enterprise-level big data management, while providing big data network cloud services, it is also necessary to achieve reasonable distribution of traffic, avoid overload failures of cloud servers, and improve the service efficiency and stability of cloud servers. At present, it is mainly based on business needs and load changes to automatically adjust the number, configuration and layout of cloud servers to achieve dynamic expansion and contraction of resources.

[0003] However, due to the high technical complexity, huge and dynamic data volume, changing user needs, system dynamics and cost considerations, it is difficult to achieve reasonable distribution of traffic and avoid cloud server overload while providing big data network cloud services, resulting in low service efficiency and poor stability. Summary of the invention

[0004] The present invention provides a load-balanced network service management method, device and medium, which are applicable to a network service system to solve the problem of difficulty in achieving reasonable distribution of traffic and avoid overload failure of a cloud server.

[0005] Get the access request sent by the client;

[0006] Parsing the domain name in the access request to obtain a target access address of the first target cloud server;

[0007] Determine a number of second cloud servers according to the target access address;

[0008] Distribute the access traffic of the first target cloud server to the plurality of second cloud servers, control the plurality of second cloud servers to respond to the access request, and provide cloud services for the client.

[0009] The present invention can dynamically select and adjust the number of second cloud servers according to the demand of the first target cloud server to ensure efficient use of system resources and scalability of services; by distributing access traffic to several second cloud servers, load balancing can be achieved to avoid overloading of a single server, thereby improving the overall performance and stability of the system. In addition, through a unified traffic distribution and management mechanism, centralized control and management of multiple second cloud servers can be achieved, reducing the complexity and cost of management. In the face of high concurrency and large-scale access, the collaborative work of multiple second cloud servers can efficiently process client access requests to avoid system crashes or service interruptions.

[0010] Compared with the prior art, the present invention determines the second cloud server by resolving the domain name, which can achieve load balancing and avoid overloading of a single cloud server; by distributing traffic and controlling responses, it not only improves the flexibility and scalability of the system, but also meets the needs of business development. Therefore, it can solve the problem of difficulty in achieving reasonable distribution of traffic and avoid overload failures of cloud servers.

[0011] As a preferred solution, the access traffic of the first target cloud server is distributed to the plurality of second cloud servers, and the plurality of second cloud servers are controlled to respond to the access request to provide cloud services for the client, specifically:

[0012] Distributing the access traffic of the first target cloud server to the plurality of second cloud servers according to a forwarding strategy; wherein the forwarding strategy is established according to the functions of different cloud servers, the load capacity of the communication channel and the load capacity of the cloud server itself;

[0013] Controlling the plurality of second cloud servers to provide a plurality of responsive services to the private network, and integrating the plurality of responsive services in the private network to obtain a comprehensive responsive service;

[0014] The access request of the client is responded to through the comprehensive response service to provide cloud services for the client.

[0015] This preferred solution distributes access traffic to multiple second cloud servers through intelligent forwarding strategies, avoiding the problem of excessive pressure at a single point and improving the overall performance and stability of the system; and when the first target cloud server or a second cloud server fails, since the traffic is dispersed to multiple servers, the system can automatically isolate the failed server to ensure that other servers continue to provide services, thereby reducing the risk of service interruption. Since the forwarding strategy can be customized according to the functions of different cloud servers, it can support complex business logic and data processing.

[0016] As a preferred solution, the domain name in the access request is parsed to obtain the target access address of the first target cloud server, specifically:

[0017] Resolving the access request through cloud DNS to obtain the domain name of the first target cloud server;

[0018] The target access address corresponding to the domain name is obtained by querying a preset mapping database.

[0019] In this preferred solution, since the preset mapping database can be dynamically updated, when the IP address of the cloud server changes, it is only necessary to update the records in the mapping database. There is no need to make large-scale adjustments to the DNS resolution service, which facilitates users to manage and configure domain name resolution and reduces management costs.

[0020] As a preferred solution, the mapping database is specifically:

[0021] The mapping database is established according to the mutual mapping relationship between the domain name and the IP address of the cloud server.

[0022] In this preferred solution, the mapping database is established based on the mutual mapping relationship between the domain name and IP address of the cloud server. Therefore, the mapping relationship between the domain name and the IP address can be dynamically added, deleted or modified to adapt to changes in the cloud server configuration. This flexible change method enables the system to easily respond to changes in business needs.

[0023] As a preferred solution, before determining a plurality of second cloud servers according to the target access address, the method further includes:

[0024] Monitoring the operating status of each cloud server in a cloud server set; wherein the cloud server set refers to a cloud server set where the plurality of second cloud servers are located;

[0025] If the operating status of the cloud server set is abnormal, disconnect the abnormal cloud server in the cloud server set from the preset private network.

[0026] This preferred solution can quickly isolate abnormal cloud servers from the cloud server set by timely monitoring and identifying them, preventing their failures from spreading to the entire system, thereby protecting other normally operating cloud servers from being affected.

[0027] As a preferred solution, the network service system includes a cloud server, a load balancing module, a private network, a gateway and a cloud DNS;

[0028] Wherein, the cloud server is used to provide cloud services;

[0029] The load balancing module is used to monitor access services and provide access traffic distribution control services;

[0030] The private network is used to provide a secure and isolated virtual network environment;

[0031] The gateway is used to establish a communication connection between networks;

[0032] The cloud DNS is used to provide domain name resolution services.

[0033] The present invention also provides a load-balanced network service management device, which is applicable to a network service system and includes a data module, an address module, a service module and a distribution module;

[0034] Wherein, the data module is used to obtain the access request sent by the client;

[0035] The address module is used to resolve the domain name in the access request to obtain a target access address of the first target cloud server;

[0036] The service module is used to determine a number of second cloud servers according to the target access address;

[0037] The distribution module is used to distribute the access traffic of the first target cloud server to the plurality of second cloud servers, control the plurality of second cloud servers to respond to the access request, and provide cloud services for the client.

[0038] As a preferred solution, the distribution module includes a distribution unit, an integration unit and a response unit;

[0039] The distribution unit is used to distribute the access traffic of the first target cloud server to the plurality of second cloud servers according to the forwarding strategy; wherein the forwarding strategy is established according to the functions of different cloud servers, the load capacity of the communication channel and the load capacity of the cloud server itself;

[0040] The integration unit is used to control the plurality of second cloud servers to provide the plurality of response services to the private network, and integrate the plurality of response services in the private network to obtain an integrated response service;

[0041] The response unit is used to respond to the access request of the client through the comprehensive response service to provide cloud services for the client.

[0042] As a preferred solution, the address module includes a parsing unit and a query unit;

[0043] The parsing unit is used to parse the access request through the cloud DNS to obtain the domain name of the first target cloud server;

[0044] The query unit is used to query the target access address corresponding to the domain name according to a preset mapping database.

[0045] As a preferred solution, the mapping database is specifically:

[0046] The mapping database is established according to the mutual mapping relationship between the domain name and the IP address of the cloud server.

[0047] As a preferred solution, the service module further includes a monitoring unit and an exclusion unit;

[0048] The monitoring unit is used to monitor the operating status of each cloud server in the cloud server set; wherein the cloud server set refers to the cloud server set where the plurality of second cloud servers are located;

[0049] The exclusion unit is used to disconnect the abnormal cloud server in the cloud server set from the preset private network if the operating status of the cloud server set is abnormal.

[0050] As a preferred solution, the network service system includes a cloud server, a load balancing module, a private network, a gateway and a cloud DNS;

[0051] Wherein, the cloud server is used to provide cloud services;

[0052] The load balancing module is used to monitor access services and provide access traffic distribution control services;

[0053] The private network is used to provide a secure and isolated virtual network environment;

[0054] The gateway is used to establish a communication connection between networks;

[0055] The cloud DNS is used to provide domain name resolution services.

[0056] The present application also provides a storage medium, on which a computer program is stored. The computer program is called and executed by a computer to implement the load-balanced network service management method as described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 It is a flow chart of a load-balanced network service management method provided in an embodiment of the present application;

[0058] Figure 2 It is a data interaction diagram provided in an embodiment of the present application;

[0059] Figure 3 It is a structural diagram of a load-balanced network service management device provided in an embodiment of the present application;

[0060] Figure 4 It is a schematic block diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0062] In the description of this application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise specified, "several" means two or more.

[0063] A load-balanced network service management method provided in an embodiment of the present application is mainly used in situations where traffic needs to be reasonably distributed to avoid overload failures of cloud servers and to ensure the network security of private networks.

[0064] Embodiment 1:

[0065] See also Figure 1 The embodiment of the present application provides a load-balanced network service management method, which is applicable to a network service system, including S1 to S4, and the specific implementation steps are as follows:

[0066] S1. Get the access request sent by the client.

[0067] Step S1 of the embodiment of the present application is specifically as follows:

[0068] Get the access request sent by the client.

[0069] It should be noted that the network service system in the embodiment of the present application includes a cloud server, a load balancing module, a private network, a gateway and a cloud DNS; the following is a specific description:

[0070] 1) Cloud Virtual Machine (CVM), used to provide cloud services; a cloud server can be a single server or a server cluster. A cloud server can provide secure and reliable elastic computing services, and can expand or reduce computing resources in real time to adapt to changing business needs.

[0071] 2) Load balancing module, used to monitor access services and provide access traffic distribution control services; and load balancing is a traffic distribution control service that distributes access traffic to multiple backend cloud servers according to forwarding strategies; in addition, the load balancing module includes a fault monitoring unit and an access control unit;

[0072] For the load balancing module, the load balancing module can be an elastic load balancing (ELB); the load balancing module can be composed of a load balancer, a listener and a backend server; the fault monitoring unit can be a listener, and the access control unit can include a load balancer and a backend server; the fault monitoring unit can provide monitoring-level access control, configure an IP address segment whitelist based on the monitoring results, and set that only IP addresses in the whitelist are allowed to access the load balancing.

[0073] 3) Private network, used to provide a secure and isolated virtual network environment; the private network includes a network configuration unit, which is used to provide custom network configuration services so that users can configure the network environment on demand;

[0074] In addition, local data centers and private networks can be connected to seamlessly migrate local application services to the cloud to form cloud services.

[0075] A private network can be a user's own private network on the cloud, and the user has full control over the private network; for example, the user can select the IP address range, configure the routing table and gateway, etc. You can also use cloud resources such as cloud servers, cloud databases, and load balancing in your own private network; you can also connect the private network to other private networks or local networks to form an on-demand customized network environment, so as to achieve smooth migration of applications to the cloud and expansion of data centers. For example, a private network can be connected to other private networks, so that the private network can share cloud server resources in other private networks, and then call cloud server resources in other private networks to provide cloud services;

[0076] In addition, the private network can also be a completely isolated virtual network environment with flexible configuration to meet different application scenarios, such as deploying applications that actively access the public network, cross-availability zone disaster recovery, business system isolation, and building a hybrid cloud.

[0077] Generally, a VPC consists of at least one private network segment, one virtual router, and at least one switch. When creating a VPC and a switch, you need to specify the private network segment used by the VPC in the form of a CIDR address block. The virtual router (vRouter) is the hub of the VPC. As an important functional component in the VPC, it can connect the switches in the VPC and is also a gateway device that connects the VPC to other networks. The switch (vSwitch) is the basic network device that makes up the VPC and is used to connect different cloud resources. After creating a VPC, you can create a switch to divide one or more subnets for the VPC, and different switches in the same VPC can communicate with each other.

[0078] 4) Gateway, used to establish communication connections between networks, which can be used for both wide area network interconnection and local area network interconnection;

[0079] In addition, the gateway includes a network address translation NAT (Network Address Translator) gateway and a virtual private network VPN (Virtual Private Network) gateway; the NAT gateway is used to provide access services between the public network and the cloud server, and the VPN gateway is used to establish a communication connection between the private network and the external network; wherein the external network includes a local database, a private network and a terminal.

[0080] Specifically, first of all, NAT Gateway is a public network gateway that can provide NAT proxy (SNAT (Source Network Address Translation) and DNAT (Source Network Address Translation)) functions, with 10Gbps-level forwarding capabilities and cross-availability zone disaster recovery capabilities. As a gateway device, NAT Gateway needs to be bound to a public network IP to work properly. After creating a NAT Gateway, you can bind an elastic public network IP to the NAT Gateway.

[0081] Secondly, the NAT gateway is suitable for scenarios where private network-type cloud server instances actively access the public network or are accessed by the public network, such as: building an SNAT gateway to access public network services, and building a DNAT gateway to provide public network services.

[0082] Again, VPN gateway is a network connection service based on the external network (integrated data network, etc.). By establishing an encrypted channel, it can achieve secure and controllable private network interconnection between the enterprise's local data center, corporate office network or external network (integrated data network, etc.) terminals and proprietary networks.

[0083] Finally, common application scenarios of VPN gateways include: establishing connections between private networks and local data centers, establishing connections between private networks, establishing connections between private networks and clients, and establishing connections between clients and sites.

[0084] 5) Cloud DNS (Domain Name System) is used to provide domain name resolution services. Cloud DNS is a set of DNS products running in the cloud environment, which can provide domain name resolution services for enterprise intranet environments (cloud networks, cloud classic networks, and enterprise-built IDC intranets);

[0085] Specifically, first of all, by setting the corresponding rules and policies between domain names and IP addresses, cloud DNS can redirect domain name access requests from clients to cloud product resources in the cloud platform, self-built business applications in the cloud platform, business systems in the enterprise intranet, and service resources of external network (integrated data network, etc.) service providers.

[0086] Secondly, as a basic core network service, cloud DNS controls the entrance of enterprise cloud traffic. In addition to providing basic domain name resolution services, it can also provide a variety of traffic load and scheduling services for applications.

[0087] To apply the embodiments of this application, please refer to Figure 2 , Figure 2 is a data interaction diagram provided in an embodiment of the present application, which shows the composition of the network service system and the interactive form of data; Figure 2 As shown, the network service system includes a cloud server, a load balancing module, a private network, a gateway and a cloud DNS.

[0088] S2. Parse the domain name in the access request to obtain the target access address of the first target cloud server.

[0089] Step S2 of the embodiment of the present application includes S2.1 to S2.2, wherein S2.1 is a process of establishing a mapping database, and S2.2 is a process of obtaining a target access address, specifically:

[0090] S2.1. Establish a mapping database based on the mutual mapping relationship between the domain name and IP address of the cloud server.

[0091] In embodiment S2.1 of the present application, the mapping database is established based on the mutual mapping relationship between the domain name and the IP address of the cloud server. Therefore, the mapping relationship between the domain name and the IP address can be dynamically added, deleted or modified to adapt to changes in the cloud server configuration. This flexible change method enables the system to easily respond to changes in business needs.

[0092] S2.2, resolve the access request through cloud DNS to obtain the domain name of the first target cloud server;

[0093] Based on the preset domain name resolution rules, the target access address corresponding to the domain name is obtained by querying the mapping database.

[0094] In embodiment S2.2 of the present application, since the preset mapping database can be dynamically updated, when the IP address of the cloud server changes, it is only necessary to update the records in the mapping database, without the need for large-scale adjustments to the DNS resolution service. This facilitates users to manage and configure domain name resolution, reduces management costs, and enables users to access the Internet more conveniently without having to remember IP number strings that can be directly read by machines.

[0095] S3. Determine a number of second cloud servers according to the target access address.

[0096] Step S3 of the embodiment of the present application includes S3.1 to S3.2, wherein S3.1 is a process of troubleshooting, and S3.2 is a process of determining a number of second cloud servers, specifically:

[0097] S3.1. Use the fault monitoring unit of the load balancing module to periodically (for example, once every 100 ms) monitor the operating status of each cloud server in the cloud server set; wherein the cloud server set refers to the cloud server set where the plurality of second cloud servers are located;

[0098] If the operating status of the cloud server set is abnormal, the abnormal cloud server in the cloud server set will be automatically isolated and disconnected from the private network to eliminate single point failure; if the cloud server set is running normally, the access traffic will be distributed normally afterwards.

[0099] Embodiment S3.1 of the present application can promptly monitor and identify abnormal cloud servers and isolate them from the cloud server set to prevent their failures from spreading to the entire system, thereby protecting other cloud servers operating normally from being affected.

[0100] S3.2. Determine a number of second cloud servers according to the target access address.

[0101] In embodiment S3.2 of the present application, since each cloud server has a unique corresponding IP address, the cloud server in the private network can be redirected according to the target access address, and then the cloud server resources can be called to provide cloud services.

[0102] S4. Distribute the access traffic of the first target cloud server to several second cloud servers, control the several second cloud servers to respond to the access request, and provide cloud services for the client.

[0103] Step S4 of the embodiment of the present application includes S4.1 to S4.2, wherein S4.1 is a process of distributing traffic, and S4.2 is a process of providing cloud services to the client, specifically:

[0104] S4.1. Use the access control unit of the load balancing module to distribute the access traffic of the first target cloud server to several second cloud servers according to the forwarding strategy; specifically: the load balancing virtualizes the cloud server instances of several second cloud servers added in the same region into a high-performance and highly available backend service pool by setting the virtual service address, and distributes the requests from the client to the cloud server instances in the backend server pool according to the forwarding strategy.

[0105] According to the forwarding strategy, the load balancing module is used to configure the load threshold range of several second cloud servers, so as to configure different performance guarantee specifications for different business types; among which, the performance guarantee specifications involve the number of concurrent connections, the number of new connections per second and the number of query requests per second, and can also support single-instance listening bandwidth configuration, and configure different bandwidth limit values ​​for different listening ports within the same VIP.

[0106] Among them, the forwarding strategy is established according to the functions of different cloud servers, the load capacity of the communication channel and the load capacity of the cloud server itself.

[0107] Embodiment S4.1 of the present application can ensure that the access traffic allocated to each cloud server can operate and respond normally according to the forwarding strategy, avoid problems such as data congestion, and improve the efficiency of cloud services.

[0108] S4.2, controlling a plurality of second cloud servers to provide a plurality of response services to the private network, and integrating the plurality of response services in the private network to obtain a comprehensive response service;

[0109] Respond to the client's access request through comprehensive response services and provide cloud services to the client based on the gateway.

[0110] It should be noted that it is also possible to indirectly connect to the private network through other private networks or local networks, respond to the corresponding services first, and then feed back the response results to the private network to respond to the client's access request, and provide cloud services to the client according to the gateway. The responses of each cloud server can be executed concurrently or in sequence according to the response order.

[0111] Embodiment S4 of the present application distributes access traffic to multiple second cloud servers through intelligent forwarding strategies, avoiding the problem of excessive pressure on a single point and improving the overall performance and stability of the system; and when the first target cloud server or a second cloud server fails, since the traffic is dispersed to multiple servers, the system can automatically isolate the failed server to ensure that other servers continue to provide services, thereby reducing the risk of service interruption. Since the forwarding strategy can be customized according to the functions of different cloud servers, it can support complex business logic and data processing.

[0112] Overall, this embodiment has the following beneficial effects:

[0113] The domain name resolution service of the cloud DNS of the present invention facilitates users to quickly access the target address, and reduces the difficulty of access operations of the access address of the cloud server, thereby improving the service convenience and service efficiency of the cloud service system. According to the demand of the first target cloud server, the number of second cloud servers can be dynamically selected and adjusted to ensure efficient utilization of system resources and scalability of services; by distributing access traffic to several second cloud servers, load balancing can be achieved to avoid overloading of a single server, thereby improving the overall performance and stability of the system. In addition, through a unified traffic distribution and management mechanism, centralized control and management of multiple second cloud servers can be achieved, reducing the complexity and cost of management. In the face of high concurrency and large-scale access, the collaborative work of multiple second cloud servers can efficiently process client access requests to avoid system crashes or service interruptions;

[0114] In addition, the network service system provided by the present invention can isolate the external network through the secure isolated virtual network environment provided by the proprietary network, thereby improving the security of the proprietary network; through the load balancing module, it can monitor the access business and provide access traffic distribution control services, thereby improving the service efficiency of the cloud server; through the gateway and cloud DNS, data interaction between the proprietary network and the external network can be realized, and the network security of the proprietary network can be guaranteed, thereby improving the data management security of big data.

[0115] Embodiment 2:

[0116] See also Figure 3 , an embodiment of the present application provides a load-balanced network service management device, including a data module 10, an address module 20, a service module 30 and a distribution module 40;

[0117] Wherein, the data module 10 is used to obtain the access request sent by the client;

[0118] An address module 20, configured to resolve the domain name in the access request and obtain a target access address of the first target cloud server;

[0119] A service module 30, configured to determine a number of second cloud servers according to the target access address;

[0120] The distribution module 40 is used to distribute the access traffic of the first target cloud server to a plurality of second cloud servers, control the plurality of second cloud servers to respond to the access request, and provide cloud services for the client.

[0121] In one embodiment, the data module 10 is specifically:

[0122] Get the access request sent by the client.

[0123] It should be noted that the network service system in the embodiment of the present application includes a cloud server, a load balancing module, a private network, a gateway and a cloud DNS; the following is a specific description:

[0124] 1) Cloud Virtual Machine (CVM), used to provide cloud services; a cloud server can be a single server or a server cluster. A cloud server can provide secure and reliable elastic computing services, and can expand or reduce computing resources in real time to adapt to changing business needs.

[0125] 2) Load balancing module, used to monitor access services and provide access traffic distribution control services; and load balancing is a traffic distribution control service that distributes access traffic to multiple backend cloud servers according to forwarding strategies; in addition, the load balancing module includes a fault monitoring unit and an access control unit;

[0126] For the load balancing module, the load balancing module can be an elastic load balancing (ELB); the load balancing module can be composed of a load balancer, a listener and a backend server; the fault monitoring unit can be a listener, and the access control unit can include a load balancer and a backend server; the fault monitoring unit can provide monitoring-level access control, configure an IP address segment whitelist based on the monitoring results, and set that only IP addresses in the whitelist are allowed to access the load balancing.

[0127] 3) Private network, used to provide a secure and isolated virtual network environment; the private network includes a network configuration unit, which is used to provide custom network configuration services so that users can configure the network environment on demand;

[0128] In addition, local data centers and private networks can be connected to seamlessly migrate local application services to the cloud to form cloud services.

[0129] A private network can be a user's own private network on the cloud, and the user has full control over the private network; for example, the user can select the IP address range, configure the routing table and gateway, etc. You can also use cloud resources such as cloud servers, cloud databases, and load balancing in your own private network; you can also connect the private network to other private networks or local networks to form an on-demand customized network environment, so as to achieve smooth migration of applications to the cloud and expansion of data centers. For example, a private network can be connected to other private networks, so that the private network can share cloud server resources in other private networks, and then call cloud server resources in other private networks to provide cloud services;

[0130] In addition, the private network can also be a completely isolated virtual network environment with flexible configuration to meet different application scenarios, such as deploying applications that actively access the public network, cross-availability zone disaster recovery, business system isolation, and building a hybrid cloud.

[0131] Generally, a VPC consists of at least one private network segment, one virtual router, and at least one switch. When creating a VPC and a switch, you need to specify the private network segment used by the VPC in the form of a CIDR address block. The virtual router (vRouter) is the hub of the VPC. As an important functional component in the VPC, it can connect the switches in the VPC and is also a gateway device that connects the VPC to other networks. The switch (vSwitch) is the basic network device that makes up the VPC and is used to connect different cloud resources. After creating a VPC, you can create a switch to divide one or more subnets for the VPC, and different switches in the same VPC can communicate with each other.

[0132] 4) Gateway, used to establish communication connections between networks, which can be used for both wide area network interconnection and local area network interconnection;

[0133] In addition, the gateway includes a network address translation NAT (Network Address Translator) gateway and a virtual private network VPN (Virtual Private Network) gateway; the NAT gateway is used to provide access services between the public network and the cloud server, and the VPN gateway is used to establish a communication connection between the private network and the external network; wherein the external network includes a local database, a private network and a terminal.

[0134] Specifically, first of all, NAT Gateway is a public network gateway that can provide NAT proxy (SNAT (Source Network Address Translation) and DNAT (Source Network Address Translation)) functions, with 10Gbps-level forwarding capabilities and cross-availability zone disaster recovery capabilities. As a gateway device, NAT Gateway needs to be bound to a public network IP to work properly. After creating a NAT Gateway, you can bind an elastic public network IP to the NAT Gateway.

[0135] Secondly, the NAT gateway is suitable for scenarios where private network-type cloud server instances actively access the public network or are accessed by the public network, such as: building an SNAT gateway to access public network services, and building a DNAT gateway to provide public network services.

[0136] Again, VPN gateway is a network connection service based on the external network (integrated data network, etc.). By establishing an encrypted channel, it can achieve secure and controllable private network interconnection between the enterprise's local data center, corporate office network or external network (integrated data network, etc.) terminals and proprietary networks.

[0137] Finally, common application scenarios of VPN gateways include: establishing connections between private networks and local data centers, establishing connections between private networks, establishing connections between private networks and clients, and establishing connections between clients and sites.

[0138] 5) Cloud DNS (Domain Name System) is used to provide domain name resolution services. Cloud DNS is a set of DNS products running in the cloud environment, which can provide domain name resolution services for enterprise intranet environments (cloud networks, cloud classic networks, and enterprise-built IDC intranets);

[0139] Specifically, first of all, by setting the corresponding rules and policies between domain names and IP addresses, cloud DNS can redirect domain name access requests from clients to cloud product resources in the cloud platform, self-built business applications in the cloud platform, business systems in the enterprise intranet, and service resources of external network (integrated data network, etc.) service providers.

[0140] Secondly, as a basic core network service, cloud DNS controls the entrance of enterprise cloud traffic. In addition to providing basic domain name resolution services, it can also provide a variety of traffic load and scheduling services for applications.

[0141] To apply the embodiments of this application, please refer to Figure 2 , Figure 2is a data interaction diagram provided in an embodiment of the present application, which shows the composition of the network service system and the interactive form of data; Figure 2 As shown, the network service system includes a cloud server, a load balancing module, a private network, a gateway and a cloud DNS.

[0142] In one embodiment, the address module 20 includes a database unit, a parsing unit and a query unit, wherein the database unit is a process of establishing a mapping database, and the parsing unit and the query unit are processes of obtaining a target access address, specifically:

[0143] The database unit is used to establish a mapping database according to the mutual mapping relationship between the domain name and the IP address of the cloud server.

[0144] In the database unit of the embodiment of the present application, the mapping database is established based on the mutual mapping relationship between the domain name and the IP address of the cloud server. Therefore, the mapping relationship between the domain name and the IP address can be dynamically added, deleted or modified to adapt to changes in the cloud server configuration. This flexible change method enables the system to easily respond to changes in business needs.

[0145] A resolution unit, configured to resolve the access request through the cloud DNS to obtain the domain name of the first target cloud server;

[0146] The query unit is also used to obtain a target access address corresponding to the domain name according to a mapping database query based on a preset domain name resolution rule.

[0147] In the resolution unit and query unit of the embodiment of the present application, since the preset mapping database can be dynamically updated, when the IP address of the cloud server changes, it is only necessary to update the records in the mapping database, without the need for large-scale adjustments to the DNS resolution service, which facilitates users to manage and configure domain name resolution, reduces management costs, and enables users to access the Internet more conveniently without having to remember IP number strings that can be directly read by machines.

[0148] In one embodiment, the service module 30 includes a monitoring unit, an elimination unit, and a server unit, wherein the monitoring unit and the elimination unit are processes for troubleshooting, and the server unit is a process for determining a number of second cloud servers, specifically:

[0149] A monitoring unit, used to periodically (e.g., once every 100 ms) monitor the operating status of each cloud server in the cloud server set using the fault monitoring unit of the load balancing module; wherein the cloud server set refers to a cloud server set where the plurality of second cloud servers are located;

[0150] The exclusion unit is used to automatically isolate and disconnect the abnormal cloud server in the cloud server set from the private network if the operating status of the cloud server set is abnormal, so as to eliminate single point failure; if the cloud server set operates normally, the access traffic will be distributed normally afterwards.

[0151] The monitoring unit and the elimination unit of the embodiment of the present application can promptly isolate abnormal cloud servers from the cloud server set by timely monitoring and identifying the abnormal cloud servers, thereby preventing the failure from spreading to the entire system, thereby protecting other normally operating cloud servers from being affected.

[0152] The server unit is used to determine a number of second cloud servers according to the target access address.

[0153] In the server unit of the embodiment of the present application, since each cloud server has a unique corresponding IP address, the cloud server in the private network can be redirected according to the target access address, and then the cloud server resources can be called to provide cloud services.

[0154] In one embodiment, the distribution module 40 includes a distribution unit, an integration unit and a response unit, wherein the distribution unit is a process of performing traffic distribution, and the integration unit and the response unit are processes of providing cloud services to the client, specifically:

[0155] The distribution unit is used to use the access control unit of the load balancing module to distribute the access traffic of the first target cloud server to several second cloud servers according to the forwarding strategy; specifically: the load balancing virtualizes the cloud server instances of several second cloud servers added in the same region into a high-performance and highly available backend service pool by setting the virtual service address, and distributes the requests from the client to the cloud server instances in the backend server pool according to the forwarding strategy.

[0156] The distribution unit is also used to configure the load threshold range of several second cloud servers using the load balancing module according to the forwarding strategy, so as to configure different performance guarantee specifications for different business types; among which, the performance guarantee specifications involve the number of concurrent connections, the number of new connections per second and the number of query requests per second, and can also support single-instance listening bandwidth configuration, and configure different bandwidth limit values ​​for different listening ports within the same VIP.

[0157] Among them, the forwarding strategy is established according to the functions of different cloud servers, the load capacity of the communication channel and the load capacity of the cloud server itself.

[0158] The distribution unit of the embodiment of the present application can ensure that the access traffic allocated to each cloud server can operate and respond normally according to the forwarding strategy, avoid problems such as data congestion, and improve the efficiency of cloud services.

[0159] an integration unit, used for controlling the plurality of second cloud servers to provide the plurality of response services to the private network, and integrating the plurality of response services in the private network to obtain an integrated response service;

[0160] The response unit is used to respond to the client's access request through a comprehensive response service and provide cloud services to the client according to the gateway.

[0161] It should be noted that it is also possible to indirectly connect to the private network through other private networks or local networks, respond to the corresponding services first, and then feed back the response results to the private network to respond to the client's access request, and provide cloud services to the client according to the gateway. The responses of each cloud server can be executed concurrently or in sequence according to the response order.

[0162] The distribution module 40 of the embodiment of the present application distributes the access traffic to multiple second cloud servers through an intelligent forwarding strategy, avoiding the problem of excessive pressure on a single point and improving the overall performance and stability of the system; and when the first target cloud server or a second cloud server fails, since the traffic is dispersed to multiple servers, the system can automatically isolate the failed server to ensure that other servers continue to provide services, thereby reducing the risk of service interruption. Since the forwarding strategy can be customized according to the functions of different cloud servers, it can support complex business logic and data processing.

[0163] To apply the embodiments of this application, please refer to Figure 4 , Figure 4 is a schematic block diagram of the structure of a computer device provided in an embodiment of the present application, indicating that a load-balanced network service management device in the second embodiment of the present application can be implemented in the form of a computer program, that is, the computer program can be used in Figure 4 Run on the computer device shown;

[0164] See also Figure 4 The computer device shown may be a server. Figure 4 In the embodiment, the computer device includes a processor, a memory and a network interface connected via a system bus, wherein the memory may include a non-volatile storage medium and an internal memory;

[0165] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, which, when executed, can cause the processor to execute any network service method for data security management;

[0166] The processor is used to provide computing and control capabilities to support the operation of the entire computer equipment;

[0167] The internal memory provides an environment for the operation of a computer program in a non-volatile storage medium, and when the computer program is executed by a processor, the processor can execute any network service method for data security management;

[0168] This network interface is used for network communication, such as sending assigned tasks, etc. Figure 4 The structure shown in the figure is only a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0169] It should be understood that the processor can be a central processing unit (CPU), and the processor can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.; among which, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0170] Overall, this embodiment has the following beneficial effects:

[0171] The domain name resolution service of the cloud DNS of the present invention facilitates users to quickly access the target address, and reduces the difficulty of access operations of the access address of the cloud server, thereby improving the service convenience and service efficiency of the cloud service system. According to the demand of the first target cloud server, the number of second cloud servers can be dynamically selected and adjusted to ensure efficient utilization of system resources and scalability of services; by distributing access traffic to several second cloud servers, load balancing can be achieved to avoid overloading of a single server, thereby improving the overall performance and stability of the system. In addition, through a unified traffic distribution and management mechanism, centralized control and management of multiple second cloud servers can be achieved, reducing the complexity and cost of management. In the face of high concurrency and large-scale access, the collaborative work of multiple second cloud servers can efficiently process client access requests to avoid system crashes or service interruptions;

[0172] In addition, the network service system provided by the present invention can isolate the external network through the secure isolated virtual network environment provided by the proprietary network, thereby improving the security of the proprietary network; through the load balancing module, it can monitor the access business and provide access traffic distribution control services, thereby improving the service efficiency of the cloud server; through the gateway and cloud DNS, data interaction between the proprietary network and the external network can be realized, and the network security of the proprietary network can be guaranteed, thereby improving the data management security of big data.

[0173] Embodiment three:

[0174] The embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the load-balanced network service management method;

[0175] Wherein, the load-balanced network service management method, if implemented in the form of a software functional unit and used as an independent product, can be stored in a computer-readable storage medium. Based on such an understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc.

[0176] The above are preferred embodiments of the present invention. It should be noted that, for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications are also considered to be within the scope of protection of the present invention.

Claims

1. A load-balanced network service management method, characterized in that: Applicable to network service systems, including: Get the access request sent by the client; Parsing the domain name in the access request to obtain a target access address of the first target cloud server; Determine a number of second cloud servers according to the target access address; Distribute the access traffic of the first target cloud server to the plurality of second cloud servers, control the plurality of second cloud servers to respond to the access request, and provide cloud services for the client.

2. A load-balanced network service management method as claimed in claim 1, characterized in that: Distribute the access traffic of the first target cloud server to the plurality of second cloud servers, control the plurality of second cloud servers to respond to the access request, and provide cloud services for the client, specifically: Distributing the access traffic of the first target cloud server to the plurality of second cloud servers according to a forwarding strategy; wherein the forwarding strategy is established according to the functions of different cloud servers, the load capacity of the communication channel and the load capacity of the cloud server itself; Controlling the plurality of second cloud servers to provide a plurality of responsive services to the private network, and integrating the plurality of responsive services in the private network to obtain a comprehensive responsive service; The access request of the client is responded to through the comprehensive response service to provide cloud services for the client.

3. A load-balanced network service management method as claimed in claim 1, characterized in that: Parse the domain name in the access request to obtain the target access address of the first target cloud server, specifically: Resolving the access request through cloud DNS to obtain the domain name of the first target cloud server; The target access address corresponding to the domain name is obtained by querying a preset mapping database.

4. A load-balanced network service management method as claimed in claim 3, characterized in that: The mapping database is specifically: The mapping database is established according to the mutual mapping relationship between the domain name and the IP address of the cloud server.

5. A load-balanced network service management method as claimed in claim 1, characterized in that: Before determining a plurality of second cloud servers according to the target access address, the method further includes: Monitoring the operating status of each cloud server in a cloud server set; wherein the cloud server set refers to a cloud server set where the plurality of second cloud servers are located; If the operating status of the cloud server set is abnormal, disconnect the abnormal cloud server in the cloud server set from the preset private network.

6. A load-balanced network service management method as claimed in claim 1, characterized in that: The network service system includes a cloud server, a load balancing module, a private network, a gateway and a cloud DNS; Wherein, the cloud server is used to provide cloud services; The load balancing module is used to monitor access services and provide access traffic distribution control services; The private network is used to provide a secure and isolated virtual network environment; The gateway is used to establish a communication connection between networks; The cloud DNS is used to provide domain name resolution services.

7. A load-balanced network service management device, characterized in that: Applicable to network service system, including data module, address module, service module and distribution module; Wherein, the data module is used to obtain the access request sent by the client; The address module is used to resolve the domain name in the access request to obtain a target access address of the first target cloud server; The service module is used to determine a number of second cloud servers according to the target access address; The distribution module is used to distribute the access traffic of the first target cloud server to the plurality of second cloud servers, control the plurality of second cloud servers to respond to the access request, and provide cloud services for the client.

8. A load-balanced network service management device as claimed in claim 7, characterized in that: The distribution module includes a distribution unit, an integration unit and a response unit; The distribution unit is used to distribute the access traffic of the first target cloud server to the plurality of second cloud servers according to the forwarding strategy; wherein the forwarding strategy is established according to the functions of different cloud servers, the load capacity of the communication channel and the load capacity of the cloud server itself; The integration unit is used to control the plurality of second cloud servers to provide a plurality of responsive services to the private network, and integrate the plurality of responsive services in the private network to obtain an integrated responsive service; The response unit is used to respond to the access request of the client through the comprehensive response service to provide cloud services for the client.

9. A load-balanced network service management device as claimed in claim 7, characterized in that: The address module includes a parsing unit and a query unit; The parsing unit is used to parse the access request through the cloud DNS to obtain the domain name of the first target cloud server; The query unit is used to query the target access address corresponding to the domain name according to a preset mapping database.

10. A load-balanced network service management device as claimed in claim 9, characterized in that: The mapping database is specifically: The mapping database is established according to the mutual mapping relationship between the domain name and the IP address of the cloud server.

11. A load-balanced network service management device as claimed in claim 7, characterized in that: The service module also includes a monitoring unit and an exclusion unit; The monitoring unit is used to monitor the operating status of each cloud server in the cloud server set; wherein the cloud server set refers to the cloud server set where the plurality of second cloud servers are located; The exclusion unit is used to disconnect the abnormal cloud server in the cloud server set from the preset private network if the operating status of the cloud server set is abnormal.

12. A load-balanced network service management device as claimed in claim 7, characterized in that: The network service system includes a cloud server, a load balancing module, a private network, a gateway and a cloud DNS; Wherein, the cloud server is used to provide cloud services; The load balancing module is used to monitor access services and provide access traffic distribution control services; The private network is used to provide a secure and isolated virtual network environment; The gateway is used to establish a communication connection between networks; The cloud DNS is used to provide domain name resolution services.

13. A storage medium, characterized in that: The storage medium stores a computer program, which is called and executed by a computer to implement a load-balanced network service management method as described in any one of claims 1 to 6 above.