Cloud gateway system, data processing method, device, and storage medium

Abstract

The application discloses a cloud gateway system, a data processing method, equipment and a storage medium. The cloud gateway system comprises at least one cloud gateway, wherein the cloud gateway comprises a configuration management container, a webpage container, a routing container and a data plane container; the configuration management container receives configuration information from a north controller and from the webpage container, modifies gateway configuration information in a configuration information database according to the configuration information by using a preset configuration management strategy, and sends the gateway configuration information to the routing container and the data plane container; the webpage container receives configuration setting information input by a user based on a webpage, and determines the configuration setting information as configuration information; the routing container generates a routing table according to related information in the received gateway configuration information, and sends the routing table to the data plane container; and the data plane container performs forwarding processing on a received data packet according to network configuration information in the received gateway configuration information and the routing table. The cloud gateway system has the beneficial effects of elasticity, scalability, strong function isolation and on-demand customization.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of cloud service, and particularly relates to a cloud gateway system, a data processing method, equipment and a storage medium. BACKGROUND

[0002] In recent years, various new services based on Internet of Things, industrial Internet and 4K / 8K related technologies are emerging, and at the same time, the popularity of cloud computing, cloud native and other technologies makes cloud network convergence become a general trend. Cloud network convergence is a new network architecture that closely combines various information technologies and cloud service modes. In order to adapt to the development of cloud network convergence, it is urgent to build a cloud gateway system with high performance to provide faster network update iteration rate, more open network management and control capability and more flexible business deployment capability.

[0003] However, the existing cloud gateway system has problems such as limited application function expansion, poor function isolation and inability to realize on-demand customization. SUMMARY

[0004] The present application provides a cloud gateway system, a data processing method, equipment and a storage medium to solve the problems of the existing cloud gateway system, such as limited application function expansion, poor function isolation and inability to realize on-demand customization.

[0005] According to an aspect of the present application, a cloud gateway system is provided, the system comprising at least one cloud gateway, wherein the cloud gateway comprises a configuration management container, a web container, a routing container and a data plane container:

[0006] The configuration management container is configured to receive first configuration information from a northbound controller and second configuration information from the web container, modify gateway configuration information in a configuration information database according to the first configuration information or the second configuration information using a preset configuration management strategy, and send the modified gateway configuration information to the routing container and the data plane container through the configuration information database;

[0007] The web container is configured to receive configuration setting information input by a user based on a web page, and determine the second configuration information according to the configuration setting information;

[0008] The routing container is configured to generate a routing table according to routing protocol information in the received gateway configuration information, and send the routing table to the data plane container;

[0009] The data plane container is configured to perform forwarding processing on the received data packet according to network configuration information in the received gateway configuration information and the routing table.

[0010] According to another aspect of the present application, a data processing method based on a cloud gateway system is provided, which is applied to the cloud gateway system of any embodiment of the present application, and the method comprises:

[0011] The configuration management container receives first configuration information from the northbound controller and second configuration information from the web container, modifies gateway configuration information in a configuration information database according to the first configuration information or the second configuration information by using a preset configuration management strategy, and sends the modified gateway configuration information to the routing container and the data plane container through the configuration information database;

[0012] The web container receives configuration setting information input by a user based on a webpage, and determines the second configuration information according to the configuration setting information;

[0013] The routing container generates a routing table according to routing protocol information in the received gateway configuration information, and sends the routing table to the data plane container;

[0014] The data plane container performs forwarding processing on a received data packet according to network configuration information in the received gateway configuration information and the routing table.

[0015] According to another aspect of the present application, an electronic device is provided, and the electronic device comprises:

[0016] at least one processor; and

[0017] a memory connected to the at least one processor in communication; wherein

[0018] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the corresponding functions of the cloud gateway system of any embodiment of the present application.

[0019] According to another aspect of the present application, a computer readable storage medium is provided, and the computer readable storage medium stores computer instructions for enabling a processor to perform the corresponding functions of the cloud gateway system of any embodiment of the present application when the processor executes the computer instructions.

[0020] The technical scheme provided by the embodiment of the application comprises at least one cloud gateway in the cloud gateway system, wherein the cloud gateway comprises a configuration management container, a webpage container, a routing container and a data plane container; the configuration management container is configured to receive first configuration information from a north controller and second configuration information from the webpage container, modify gateway configuration information in a configuration information database according to the first configuration information or the second configuration information by using a preset configuration management strategy, and send the modified gateway configuration information to the routing container and the data plane container through the configuration information database; the webpage container is configured to receive configuration setting information input by a user based on a webpage, and determine the second configuration information according to the configuration setting information; the routing container is configured to generate a routing table according to routing protocol information in the received gateway configuration information, and send the routing table to the data plane container; and the data plane container is configured to forward a received data packet according to network configuration information in the received gateway configuration information and the routing table. By using the above technical scheme, the configuration management container and / or the webpage container can provide configuration information of the cloud gateway, wherein the configuration information provided by the webpage container is configured by the user on demand. Then, the routing container and the data plane container receive the configuration information and obtain relevant information required by themselves from the configuration information, the routing container generates a routing table according to the obtained information and sends the routing table to the data plane container, and the data plane container realizes the forwarding of the data packet according to the obtained information and the routing table provided by the routing container. The problems of the existing cloud gateway system, such as limited application function expansion, poor function isolation and inability to realize on-demand customization, are solved. The cloud gateway system of the application is constructed based on the containerization technology, the functions of the cloud gateway are finely divided and deployed in each container, the elastic scalability of the cloud gateway functions is realized by the containerization technology, the isolation of the cloud gateway functions is enhanced, and the user can customize on demand through the webpage container, thereby effectively improving the flexibility and security of the cloud gateway system.

[0021] It should be understood that the content described in this part is not intended to identify key or important features of the embodiments of the application, nor is it used to limit the scope of the application. Other features of the application will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the application, the following will briefly introduce the drawings needed to be used in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the application, and other drawings can also be obtained by those skilled in the art without creative effort.

[0023] Figure 1 A structural schematic diagram of a cloud gateway system provided by the first embodiment of the application is shown in the figure.

[0024] Figure 2A structural schematic diagram of a cloud gateway provided by an embodiment of the present application is provided.

[0025] Figure 3 A working flow diagram of a configuration checking module provided by an embodiment of the present application is provided.

[0026] Figure 4 A structural schematic diagram of a cloud gateway system provided by the second embodiment of the present application is provided.

[0027] Figure 5 A structural schematic diagram of cloud gateway monitoring and scheduling provided by an embodiment of the present application is provided.

[0028] Figure 6 A flow chart of a data processing method based on a cloud gateway system provided by the third embodiment of the present application is provided.

[0029] Figure 7 A structural schematic diagram of an electronic device provided by the fourth embodiment of the present application is provided. DETAILED DESCRIPTION

[0030] In order to make the personnel in the technical field better understand the present application scheme, the technical scheme in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by the person skilled in the art without creative labor should belong to the scope of protection of the present application.

[0031] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not necessarily limit to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0032] Embodiment one

[0033] Figure 1A structural schematic diagram of a cloud gateway system provided for an embodiment of the present application includes at least one cloud gateway 10, wherein the cloud gateway includes a configuration management container 101, a webpage container 102, a routing container 103, and a data plane container 104. Only two cloud gateways are shown in the diagram as illustrative, and the configuration and / or number of cloud gateways can be set according to actual needs, which can be greater than two, and can be denoted as N. The cloud gateway in the cloud gateway system can be implemented in the form of hardware and / or software, and can be integrated in a computer device such as a server. The embodiment can be applicable to the case of deploying cloud gateways according to business conditions.

[0034] Specifically, the configuration management container 101 is configured to receive first configuration information from a northbound controller and second configuration information from the webpage container, modify gateway configuration information in a configuration information database according to the first configuration information or the second configuration information by using a preset configuration management strategy, and send the modified gateway configuration information to the routing container and the data plane container through the configuration information database; the webpage container 102 is configured to receive configuration setting information input by a user based on a webpage, and determine the second configuration information according to the configuration setting information; the routing container 103 is configured to generate a routing table according to routing protocol information in the received gateway configuration information, and send the routing table to the data plane container; and the data plane container 104 is configured to forward a received data packet according to network configuration information in the received gateway configuration information and the routing table.

[0035] In the embodiment, the northbound controller is configured to implement unified distribution and modification of cloud gateway configuration information, and generally implements communication with the cloud gateway through a control flow. For example, the northbound controller can be an OVN (open virtual network) controller. The configuration information includes information for controlling how a data flow is forwarded. For example, configuration information for creating a VXLAN (virtual extensible local area network) includes a tunnel alias, a destination IP (Internet Protocol), a source IP, a type, whether to enable MAC (Media Access Control) learning, a destination port, and the like. The first configuration information includes configuration information sent by the northbound controller, and is generally suitable for modification of a large number of configuration information. The second configuration information includes configuration information sent by the webpage container, and is generally suitable for user fine tuning. The configuration information database includes a database for storing set configuration information. The gateway configuration information includes set configuration information, which can be dynamically modified according to the first configuration information or the second configuration information. The preset configuration management strategy includes a strategy for deciding to modify the gateway configuration information in the configuration information database according to the first configuration information or the second configuration information.

[0036] Specifically, the configuration management container provides a plug-in architecture, and information interaction with the web container and the northbound controller is implemented through specific plug-ins. The configuration management container can receive first configuration information from the northbound controller and second configuration information from the web container. According to a preset configuration management policy, the configuration management container is allowed to receive only one kind of configuration information at the same time. For example, if a user only needs to fine-tune the configuration information, the configuration management container is allowed to receive only the second configuration information from the web container; if the user needs to make more modifications to the configuration information, the configuration management container is allowed to receive only the first configuration information from the northbound controller. The configuration management container selectively receives the configuration information, modifies the gateway configuration information in the configuration information database according to the received configuration information, and actively sends the modified configuration information to the routing container and the data plane container. In this embodiment, if it is determined that the configuration management container can receive only one kind of configuration information when the cloud gateway is deployed, the configuration management container only receives this kind of configuration information during use. If the configuration management container is allowed to receive configuration information according to actual conditions when the cloud gateway is deployed, the configuration management container receives configuration information according to the preset configuration management policy.

[0037] Optionally, considering that the first configuration information or the second configuration information received by the configuration management container may have a non-uniform data format, the first configuration information or the second configuration information needs to be format-converted after being obtained. For example, the first configuration information received from the OVN controller is directly stored in the Vtepdb database, and the format of the first configuration information is different from the OVSDB format required by the data plane container. Therefore, the configuration information needs to be converted into the OVSDB format, and the gateway configuration information in the configuration information database is modified according to the format-converted first configuration information or the format-converted second configuration information by using the preset configuration management policy.

[0038] In this embodiment, the configuration setting information includes cloud gateway configuration information set by a user according to actual needs.

[0039] Specifically, the web container is based on a high-performance web server Nginx. The web container provides a web front-end interface that allows a user to operate. The user can input configuration setting information on the web front-end according to actual needs to set the cloud gateway, and then determine the configuration setting information as the second configuration information and send the second configuration information to the configuration management container for storage. In this way, the user can autonomously customize and configure the network on demand.

[0040] In this embodiment, the routing protocol information is included in the gateway configuration information and is used to determine a routing table on which a data packet is forwarded.

[0041] Specifically, the routing container integrates various mainstream routing protocols such as BGP (Border Gateway Protocol), OSPF (Open Shortest Path First), etc., and can generate a routing table according to configuration information to assist the data plane to complete basic data forwarding functions. After the configuration management container sends the gateway configuration information to the routing container, the routing container obtains routing protocol information in the gateway configuration information by parsing, and then selects a specified routing protocol according to the routing protocol information and updates the routing table, and then sends the routing table to the data plane container to assist the data plane container to forward data packets to a specified destination.

[0042] In this embodiment, the network configuration information is contained in the gateway configuration information, which is used to determine what operation is performed on the data packet, such as packet loss operation on a certain data packet, etc.

[0043] Specifically, the data plane container is mainly the data plane of the gateway, and supports various forwarding protocols such as IPV4 (Internet Protocol 4), IPV6 (Internet Protocol 6), tunnel, MPLS (Multiprotocol Label Switching), etc. After the configuration management container sends the gateway configuration information to the data plane container, the data plane container obtains network configuration information in the gateway configuration information by parsing, determines the forwarding protocol such as IPV4 and IPV6 protocol, etc., and performs forwarding processing on the received data packet according to the forwarding protocol and the obtained routing table.

[0044] The technical scheme provided by the embodiment of the application comprises at least one cloud gateway in a cloud gateway system, wherein the cloud gateway comprises a configuration management container, a webpage container, a routing container and a data plane container; the configuration management container is configured to receive first configuration information from a north controller and second configuration information from the webpage container, modify gateway configuration information in a configuration information database according to the first configuration information or the second configuration information by using a preset configuration management strategy, and send the modified gateway configuration information to the routing container and the data plane container through the configuration information database; the webpage container is configured to receive configuration setting information input by a user based on a webpage, and determine the second configuration information according to the configuration setting information; the routing container is configured to generate a routing table according to routing protocol information in the received gateway configuration information, and send the routing table to the data plane container; and the data plane container is configured to forward a received data packet according to network configuration information in the received gateway configuration information and the routing table. By using the above technical scheme, the configuration management container and / or the webpage container can provide configuration information of the cloud gateway, wherein the configuration information provided by the webpage container is configured by the user on demand. Then, the routing container and the data plane container receive the configuration information and obtain relevant information required by themselves from the configuration information, the routing container generates a routing table according to the obtained information and sends the routing table to the data plane container, and the data plane container realizes the forwarding of the data packet according to the obtained information and the routing table provided by the routing container. The problems of the existing cloud gateway system, such as limited application function expansion, poor function isolation and inability to realize on-demand customization, are solved. The cloud gateway system of the application is constructed based on containerization technology, the functions of the cloud gateway are finely divided and deployed in each container, the elasticity of the cloud gateway functions is realized by using the containerization technology, the isolation of the cloud gateway functions is enhanced, and the user can customize on demand through the webpage container, thereby effectively improving the flexibility and security of the cloud gateway system.

[0045] In some embodiments, a VPP (Vector Packet Processing) is deployed in the data plane container, and the received data packet is forwarded by using the VPP. By using the above technical scheme, the rate of forwarding the data packet by the cloud gateway is effectively improved.

[0046] In the embodiment, the VPP is an extensible data forwarding framework, which provides the functions of an out-of-box network switch or router and can realize high-performance traffic forwarding.

[0047] Specifically, in order to improve the rate of data packet forwarding, the VPP framework is used in the data plane container to forward the data packet. The data plane container transmits network configuration information to the VPP, and the VPP generates a corresponding forwarding processing graph architecture according to the received network configuration information. The architecture uses a graph node to process the data packet, and each graph node can exist as a logical unit and can complete a relatively independent task, such as implementing the tasks of VLAN (Virtual LAN) tag processing and MPLS tag processing respectively. Further, the VPP receives the data packet, and in order to achieve high parallelization of data packet processing, the VPP converts the scalar data packet into a vector data packet, and then processes the vector data packet through each graph node to complete the forwarding of the data packet.

[0048] Exemplarily, Figure 2A cloud gateway structure schematic diagram provided by an embodiment of the present application can be seen to include an Oam container as a configuration management container, a Web container as a web page container, a VPP container as a data plane container, and a routing container in the cloud gateway. The containers communicate with each other using corresponding interfaces, such as Restful interfaces, grpc interfaces, Go-vtep interfaces, and Ovs interfaces for implementing communication between the Web container and the Oam container. The Oam container obtains configuration information of an OVN controller through the Go-vtep interface, stores the configuration information in a vtepdb database, and updates gateway configuration information in a Configdb library in the format of OVSDB by parsing the data format of the configuration information to the format of the OVSDB through a VPP GW driver in the Oam container. The Oam container can also communicate with the Web container through a Restful interface, obtain configuration information of the Web container, and update gateway configuration information in the Configdb library in the format of OVSDB by parsing the data format of the configuration information to the format of the OVSDB through an APi-core. Further, the Configdb sends the gateway configuration information of the Configdb library to the VPP container and the routing container through an Ovs interface. The routing container sends a routing table generated by a specified routing protocol to a data processing module in the VPP container by parsing routing protocol information in the configuration information, to assist in forwarding data packets to a specified destination. The VPP container obtains network configuration information from the gateway configuration information and transmits the network configuration information to the VPP through a Go vpp api interface, to tell the VPP to perform what kind of forwarding (such as IPV4, IPV6, etc.), and generate a corresponding forwarding processing graph architecture, to prepare to receive data packets and process them, and further implement data forwarding in combination with the routing table. In some embodiments, a configuration checking module is deployed in the web page container, and the configuration checking module is configured to check configuration setting information; wherein the second configuration information is determined according to the configuration setting information, including: in the case of passing the check, the second configuration information is determined according to the configuration setting information; wherein the setting operation corresponding to the configuration setting information includes at least one of adding, modifying, and deleting; the check content of the configuration setting information includes specification check of a modified field input by a user, existence check of a gateway configuration table, field existence check in the gateway configuration table, and correlation check of the gateway configuration table, wherein the gateway configuration table is configured to store gateway configuration information. Through the above technical solution, the security of the cloud gateway and the cloud gateway system is effectively improved.

[0049] In the embodiment, the configuration checking module can be applied in the web container for checking the configuration setting information of the user when the user configures the cloud gateway, so as to avoid network failure caused by operation error. The setting operation corresponding to the configuration setting information can be understood as an operation allowed to be performed on the gateway configuration table by the user, including at least one of adding, modifying and deleting. The gateway configuration table is stored in the configuration information database and is used to store the set gateway configuration information. The specification checking of the modified field includes checking whether the content input by the user on the webpage conforms to the specification, for example, the user is allowed to input a number, but the user inputs a letter, which does not conform to the specification. The existence checking of the gateway configuration table includes checking whether the table to be operated by the user exists in the configuration information database, if the table exists, the user is allowed to operate, if the table does not exist, the user is prompted to operate incorrectly. The field existence checking in the gateway configuration table includes checking whether the corresponding field in the table to be operated by the user exists, if the field exists, the user is allowed to operate, if the field does not exist, the user is prompted to operate incorrectly. The association checking of the gateway configuration table includes checking whether the table to be operated by the user is associated with other tables.

[0050] Specifically, in order to protect the security of the cloud gateway and avoid network failure caused by user operation error, the configuration checking module is deployed in the web container to check the configuration setting information input by the user. The setting operation allowed to be performed on the gateway configuration table by the user in the web container includes at least one of adding, modifying and deleting. After determining the setting operation of the user, the configuration setting information input by the user is checked according to the setting operation, including the specification checking of the modified field input by the user, the existence checking of the gateway configuration table, the field existence checking in the gateway configuration table and the association checking of the gateway configuration table.

[0051] For example, when the user wants to add a gateway configuration table, the user inputs the ID of the gateway configuration table to be added on the webpage. The configuration checking module first performs the specification checking of the modified field, that is, checks whether the ID input by the user on the webpage conforms to the specification, if the ID conforms to the specification, the existence checking of the gateway configuration table is further performed, that is, checks whether the table with the same ID exists in the gateway configuration table, if the table does not exist, the table is added to the configuration information database. Then, the association checking of the gateway configuration table is performed, if the newly added table needs to be associated, the content of the associated table is updated. If the checking content does not conform to the specification in the checking process, an error message is popped up on the webpage to remind the user that the operation is incorrect.

[0052] In some embodiments, for the deletion operation, the corresponding check content includes: judging whether the first gateway configuration table currently required to be deleted exists an associated second gateway configuration table, if yes, judging whether the second gateway configuration table allows to be unbound with the first gateway configuration table, and judging whether the gateway configuration information associated with the first gateway configuration table in the second gateway configuration table allows to be deleted, if all of them are allowed, it is determined that the check is passed. Through the above embodiments, the robustness of the cloud gateway is effectively enhanced.

[0053] In the present embodiment, the first gateway configuration table includes the gateway configuration table in the configuration information database determined according to the ID information of the table input by the user. The second gateway configuration table includes the gateway configuration table associated with the first gateway configuration table according to certain fields.

[0054] Specifically, when the user wants to delete a gateway configuration table, the ID of the gateway configuration table to be deleted is input on the webpage, and then the configuration check module will first perform the specification check of the modified field, that is, check whether the ID input by the user on the webpage conforms to the specification, if it conforms to the specification, further perform the existence check of the gateway configuration table, that is, check whether the table with the same ID exists in the gateway configuration table, if it exists, it is determined as the first gateway configuration table, and then perform the associativity check of the gateway configuration table, that is, check whether there is an associated second gateway configuration table according to the related field of the first gateway configuration table, if it exists, further judge whether the second gateway configuration table allows to be unbound with the first gateway configuration table, and judge whether the gateway configuration information associated with the first gateway configuration table in the second gateway configuration table allows to be deleted, if all of them are allowed, the user can delete the table. In the check process of the deletion operation, if one of the checks is not allowed, an error message will be popped up on the page to remind the user that the operation is wrong and the table is not allowed to be deleted.

[0055] Exemplarily, Figure 3The workflow schematic diagram of the configuration checking module provided by the embodiment of the present application can be seen that the user can add, delete and modify the gateway configuration table. If the user needs to add a field in the table, when the user inputs serverName and OVSDB, the configuration checking module needs to modify the specification of the field and initialize the configuration checking return information. If there is no problem, considering that the tables in the configuration information database are stored by categories, the type of the table input by the user can be checked first, and the existence of the gateway configuration table is further checked, that is, whether the table with the same ID exists in the table of the type to which it belongs. If it exists, the existence of the field in the gateway configuration table is checked. If the related field does not exist, the field input by the user is inserted (the information entry in the figure is the field added by the user), and the relevance of the gateway configuration table is checked, that is, the table associated with it is found, and the corresponding field is updated, so as to complete the user configuration and output the completed configuration information. If a certain checking link does not comply with the corresponding rule, the page will output error information to remind the user that the operation is wrong.

[0056] For example, if the user needs to delete the table, when the user inputs serverName and OVSDB, the configuration checking module needs to modify the specification of the field and initialize the configuration checking return information. If there is no problem, considering that the tables in the configuration information database are stored by categories, the type of the table input by the user can be checked first, and the existence of the gateway configuration table is further checked, that is, whether the table with the same ID exists in the table of the type to which it belongs. If it exists, the relevance of the gateway configuration table is checked, that is, the table associated with it is found, all fields related to the table in the associated table are deleted, and then the table is deleted, so as to complete the user configuration and output the completed configuration information. If a certain checking link does not comply with the corresponding rule, the page will output error information to remind the user that the operation is wrong.

[0057] For example, if the user needs to modify the content of the table, when the user inputs serverName and OVSDB, the configuration checking module needs to modify the specification of the field and initialize the configuration checking return information. If there is no problem, considering that the tables in the configuration information database are stored by categories, the type of the table input by the user can be checked first, and the existence of the gateway configuration table is further checked, that is, whether the table with the same ID exists in the table of the type to which it belongs. If it exists, the existence of the field in the gateway configuration table is checked. If the related field exists, the relevance of the gateway configuration table is checked, that is, the table associated with it is found, and the corresponding field in the associated table is updated, and then the field in the table is updated, so as to complete the user configuration and output the completed configuration information. If a certain checking link does not comply with the corresponding rule, the page will output error information to remind the user that the operation is wrong.

[0058] Embodiment Two

[0059] Figure 4 A structural schematic diagram of a cloud gateway system provided for Embodiment Two of the present application is shown in the figure. The system comprises a central control panel 21 in addition to the cloud gateway 20. The central control panel 21 comprises a gateway management module 211, and the cloud gateway 20 of the system comprises a traffic monitoring service 205.

[0060] Specifically, the traffic monitoring service 205 is configured to monitor the traffic load in the cloud gateway to which it belongs, and send an overload signal to the gateway management module when the traffic load is greater than a first preset threshold, and send a low-load signal to the gateway management module when the traffic load is less than a second preset threshold. The gateway management module 211 is configured to add a gateway when the overload signal is received, and delete a gateway when the low-load signal is received.

[0061] In this embodiment, the traffic monitoring service is configured to monitor the traffic load in the cloud gateway to which it belongs, and is generally deployed in the local cloud gateway. The purpose of setting the traffic monitoring service is to save resources and prevent resource waste. The traffic load can be understood as the total traffic flowing through the cloud gateway. The first preset threshold comprises the maximum traffic loadable by the cloud gateway, which is generally set according to the business requirements and historical log records. The second preset threshold comprises the minimum traffic loadable by the cloud gateway, which is generally set according to the business requirements and historical log records.

[0062] Specifically, considering the variability of the network environment, business requirements change, equipment failure, and other situations, which will affect the size of the traffic load. When large-scale traffic continuously arrives at a certain cloud gateway, the cloud gateway cannot respond in time, which may cause the cloud gateway to become a network bottleneck, thereby reducing the overall network throughput and affecting the business performance. Therefore, it is necessary to monitor the load of the cloud gateway and adjust the gateway cluster in real time according to the monitoring situation to cope with the dynamically changing traffic load and ensure stable and reliable cloud gateway services. The traffic monitoring service is deployed in each cloud gateway to monitor the traffic load in the cloud gateway to which it belongs in real time, and determine whether the traffic load is greater than the maximum traffic loadable. If so, the traffic monitoring service sends an overload signal to the gateway management module, or determines whether the traffic load is less than the minimum traffic loadable. If so, the traffic monitoring service sends a low-load signal to the gateway management module. Then, the gateway management module adds a gateway when the overload signal is received, and deletes a gateway when the low-load signal is received.

[0063] Optionally, if the traffic load is neither greater than the maximum traffic loadable nor less than the minimum traffic loadable, no message is sent to the gateway management module, and normal traffic forwarding can be performed.

[0064] The cloud gateway system provided by the embodiment of the present application can create a single cloud gateway while monitoring the load condition of the cloud gateway. Specifically, the cloud gateway system further comprises a central control panel and a gateway management module inside the central control panel, and a traffic monitoring service is set in the cloud gateway. The traffic monitoring service is configured to monitor the traffic load in the cloud gateway, and send an overload signal to the gateway management module when the traffic load is greater than a first preset threshold, and send a low load signal to the gateway management module when the traffic load is less than a second preset threshold. The gateway management module is configured to add a gateway when the overload signal is received, and delete a gateway when the low load signal is received. Through the above technical solution, the burst condition (traffic surge or sudden drop) can be responded to in time, and the throughput capacity of the entire network is effectively improved, and the business performance is improved. In some embodiments, monitoring the traffic load in the cloud gateway comprises: extracting the five-tuple information of the flow data packet, performing preset hash calculation on the five-tuple information to obtain a data flow identifier; and searching for a corresponding target statistical entry from a traffic load state table according to the data flow identifier, and updating the data packet data amount in the target statistical entry, wherein the traffic load state table contains at least one statistical entry, and the data packet data amount in the statistical entry is used to record the total traffic of the data flow to which the corresponding data flow identifier belongs, and the sum of the data packet data amounts in all statistical entries is used to measure the traffic load of the cloud gateway. Through the above technical solution, the traffic load in the cloud gateway can be accurately calculated.

[0065] In the embodiment, the five-tuple information includes the source IP, destination IP, source port, destination port and protocol type of the flow data packet. The preset hash includes an algorithm set in advance in the traffic monitoring service. The data flow identifier is used to identify different data flows. The traffic load state table is used to record the size of the flow data flowing through the cloud gateway. The target statistical entry is stored in the traffic load state table.

[0066] Specifically, when the traffic monitoring service detects that a flow data packet enters the gateway port, the source IP, destination IP, source port, destination port and protocol type of the flow data packet are extracted, and the data flow identifier is obtained through hash calculation to identify different flows. Then, the traffic load state table is searched according to the data flow identifier, and if the corresponding target statistical entry is found, the size of the flow in the target statistical entry is updated, wherein the size of the flow is obtained by calculating the sum of the sizes of all data packets in the flow, and the size of the data packet is contained in the size information of the data packet. Then, the sum of the sizes of all flows in the traffic load state table is calculated as the traffic load of the cloud gateway.

[0067] In some embodiments, the increasing the gateway upon receiving the overload signal comprises: upon receiving the overload signal, obtaining target gateway configuration information in a target configuration information database in the target cloud gateway, and constructing a new cloud gateway according to the target gateway configuration information. Through the above technical solution, the processing of the service can be ensured in the same environment, the stability of the traffic processing is enhanced, and the processing efficiency of the service is effectively improved.

[0068] In the embodiment, the target configuration information database comprises a database for storing the cloud gateway information configured according to the service requirement. The target gateway configuration information comprises the cloud gateway information configured according to the service requirement.

[0069] Specifically, in order to ensure that the processing of the service can be implemented in the same environment, when the gateway management module receives the overload signal, the cloud gateway in which the overload occurs is further determined, and the related configuration information stored in the target configuration information database when the cloud gateway is configured is obtained, and then the related configuration information is issued to the newly constructed cloud gateway to complete the configuration, so as to implement the increasing of the gateway.

[0070] Exemplarily, Figure 5A cloud gateway monitoring and scheduling structure diagram provided by the embodiment of the present application includes a configuration module, a monitoring module, a scheduling management module and a cloud gateway module in the central control plane, which are used to jointly complete the functions of the gateway management module. The cloud gateway module is mainly responsible for implementing the construction, configuration and centralized management of the cloud gateway, and the module can perceive the cloud gateway in each cluster. When the configuration module establishes the cloud gateway for each service, the configuration information of the corresponding cloud gateway is stored. Specifically, the data packet entering the gateway port triggers the monitoring service, and then the monitoring service extracts the source IP, destination IP, source port, destination port and protocol type of the flow data packet to obtain Flow.id through hash calculation, which is used to identify different flows. Then, the traffic load state table can be searched according to Flow.id, if the corresponding table entry (the entry corresponds to the record in the table) is found in the state table, the packet num field in the table entry corresponding to Flow.id is updated, wherein the packet num field is used to record the total size of the flow, otherwise, a new record of Flow.id is created. The traffic monitoring service regularly calculates the size of all flows in the state table, and compares it with the threshold range ConL~ConH issued by the monitoring module in the central control plane, wherein ConH represents the maximum value of the loadable traffic of the cloud gateway, and ConL represents the minimum value of the loadable traffic of the cloud gateway. If the value is greater than the threshold ConH, an overload signal (including the gateway IP) is sent to the monitoring module in the central control plane, and the monitoring module immediately sends a capacity expansion request to the scheduling management module. Otherwise, if the value is less than the threshold ConL, a low load signal is sent to the monitoring module in the central control plane, and the monitoring module immediately sends a capacity reduction request to the scheduling management module. Otherwise, no message is sent to the central control plane, and normal traffic forwarding can be performed. The scheduling management module sends an execution scheduling instruction (capacity expansion / capacity reduction) to the cloud gateway module according to the received request type (overload / low load). Then, the cloud gateway module obtains the gateway configuration information from the configuration module to complete the capacity expansion / reduction.

[0071] Embodiment three

[0072] Figure 6 A flowchart of a data processing method based on a cloud gateway system provided by the third embodiment of the present application is provided. The method can be applied to the cloud gateway system provided by the embodiment of the present application. As shown in the figure, Figure 6 the method comprises:

[0073] S301, the first configuration information from the northward controller and the second configuration information from the web container are received through the configuration management container, the gateway configuration information in the configuration information database is modified according to the first configuration information or the second configuration information by using a preset configuration management strategy, and the modified gateway configuration information is sent to the routing container and the data plane container through the configuration information database.

[0074] S302, receiving configuration setting information input by a user based on a webpage through the webpage container, and determining second configuration information according to the configuration setting information.

[0075] S303, generating a routing table according to routing protocol information in the received gateway configuration information through the routing container, and sending the routing table to the data plane container.

[0076] S304, performing forwarding processing on the received data packet according to network configuration information in the received gateway configuration information and the routing table through the data plane container.

[0077] The data processing scheme based on the cloud gateway system provided in the embodiment of the application receives first configuration information from a north controller and second configuration information from a webpage container through a configuration management container, modifies gateway configuration information in a configuration information database according to the first configuration information or the second configuration information by using a preset configuration management strategy, and sends the modified gateway configuration information to a routing container and a data plane container through the configuration information database. The configuration setting information input by a user based on a webpage is received through the webpage container, and second configuration information is determined according to the configuration setting information. A routing table is generated according to routing protocol information in the received gateway configuration information through the routing container, and the routing table is sent to the data plane container. The received data packet is processed for forwarding through the data plane container according to network configuration information in the received gateway configuration information and the routing table. By using the above technical scheme, the configuration management container and / or the webpage container can provide configuration information of the cloud gateway, wherein the configuration information provided by the webpage container is configured by the user on demand. Then, the routing container and the data plane container receive the configuration information and obtain related information required by themselves from the configuration information. The routing container generates a routing table according to the obtained information and sends the routing table to the data plane container. The data plane container realizes forwarding of a data packet according to the obtained information and the routing table provided by the routing container. The problems of the existing cloud gateway system, such as limited application function expansion, poor function isolation, and inability to realize on-demand customization, are solved. The cloud gateway system of the application is constructed based on containerization technology. The functions of the cloud gateway are finely divided and deployed in containers. The elasticity of the cloud gateway functions is realized by using the containerization technology. The isolation of the cloud gateway functions is enhanced. The user can customize on demand through the webpage container. The flexibility and security of the cloud gateway system are effectively improved.

[0078] Optionally, a vector data packet processing framework VPP is deployed in the data plane container. The data packet is processed for forwarding through the data plane container according to the network configuration information in the received gateway configuration information and the routing table, including:

[0079] The data plane container is configured to forward the received data packet according to the network configuration information in the received gateway configuration information and the routing table and by using the VPP.

[0080] Optionally, the web container is deployed with a configuration checking module, and the configuration checking module is configured to check the configuration setting information.

[0081] The web container is configured to receive the configuration setting information input by a user based on a webpage, and determine the second configuration information according to the configuration setting information in the case of passing the check.

[0082] Optionally, for the deletion operation, the corresponding checking content includes: judging whether the first gateway configuration table currently to be deleted has an associated second gateway configuration table, if yes, judging whether the second gateway configuration table is allowed to be unbound with the first gateway configuration table, and judging whether the gateway configuration information associated with the first gateway configuration table in the second gateway configuration table is allowed to be deleted, if both are allowed, the check is passed.

[0083] Optionally, the data processing method based on the cloud gateway system further includes a central control panel, and the central control panel includes a gateway management module; the cloud gateway further includes a traffic monitoring service; the method further includes:

[0084] The traffic monitoring service is configured to monitor the traffic load of the cloud gateway, and send an overload signal to the gateway management module when the traffic load is greater than a first preset threshold, and send a low load signal to the gateway management module when the traffic load is less than a second preset threshold.

[0085] The gateway management module is configured to add a gateway when the overload signal is received, and delete a gateway when the low load signal is received.

[0086] Optionally, the monitoring of the traffic load of the cloud gateway includes:

[0087] The five-tuple information of the flow data packet is extracted, and a preset hash calculation is performed on the five-tuple information to obtain a data flow identifier.

[0088] According to the data flow identifier, a corresponding target statistical entry is found from a traffic load state table, and packet data in the target statistical entry is updated, wherein the traffic load state table contains at least one statistical entry, and packet data in the statistical entry is used to record total traffic of a data flow to which the corresponding data flow identifier belongs, and a total sum of packet data in all statistical entries is used to measure traffic load of the cloud gateway.

[0089] Optionally, the increasing of the gateway when the overload signal is received comprises:

[0090] When the overload signal is received, target gateway configuration information in a target configuration information database in the target cloud gateway is acquired, and a new cloud gateway is constructed according to the target gateway configuration information.

[0091] Embodiment four

[0092] Figure 7 A structural schematic diagram of an electronic device is provided for embodiment four of the present application. The electronic device 40 is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart phones, wearable devices (e.g., headsets, glasses, watches, etc.), and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not intended to limit the implementations of the present application described and / or claimed in this document.

[0093] As shown in Figure 7 The electronic device 40 includes at least one processor 41, and a memory, such as a read-only memory (ROM) 42, a random access memory (RAM) 43, etc., which are communicatively connected to the at least one processor 41, wherein the memory stores computer programs that can be executed by the at least one processor, and the processor 41 can perform various appropriate actions and processes according to the computer programs stored in the read-only memory (ROM) 42 or loaded from the storage unit 48 into the random access memory (RAM) 43. In the RAM 43, various programs and data required for the operation of the electronic device 40 can also be stored. The processor 41, the ROM 42, and the RAM 43 are connected to each other through a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0094] A number of components in the electronic device 40 are connected to the I / O interface 45, including: an input unit 46, such as a keyboard, a mouse, etc.; an output unit 47, such as various types of displays, speakers, etc.; a storage unit 48, such as a magnetic disk, an optical disk, etc.; and a communication unit 49, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 49 allows the electronic device 40 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.

[0095] The processor 41 can be various general and / or special purpose processing components with processing and computing capabilities. Some examples of the processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 41 performs various systems and processes described above, such as the cloud gateway system.

[0096] In some embodiments, the cloud gateway system can be implemented as a computer program tangibly embodied in a computer readable storage medium, such as the storage unit 48. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 40 via the ROM 42 and / or the communication unit 49. When the computer program is loaded onto the RAM 43 and executed by the processor 41, one or more steps of the cloud gateway system described above can be performed. Alternatively, in other embodiments, the processor 41 can be configured to perform the cloud gateway system by any other appropriate means, such as by means of firmware.

[0097] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a programmable logic device (PLD), a computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0098] Computer programs used to implement the system of the present application can be written in any combination of one or more programming languages. These computer programs can be implemented in a high level procedural or object oriented programming language to communicate with a computer processing unit or processing units. Programs can be compiled or interpreted from readable program instructions for execution by the computer processing unit(s), which can be specifically designed or constructed for the intended purposes. Alternatively, programs can be provided in an encrypted format for decryption and execution by the computer processing unit(s).

[0099] In the context of the present application, a computer readable storage medium can be a tangible medium that can contain or store the program for use by or in connection with the instruction execution system, apparatus, or device. The computer readable storage medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium can be a machine readable signal medium. More specific examples of the machine readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disk drives, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fibers, portable compact disc read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0100] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0101] The systems and techniques described herein can be implemented in a computing system that includes a back end component, e.g., as a data server, or that includes a middleware component, e.g., an application server, or that includes a front end component, e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described herein, or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network. Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0102] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. A server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and VPS service.

[0103] It should be understood that the various forms of flow shown above can be re-ordered, added to, or deleted from without departing from the scope of the present disclosure. For example, the steps recited in the present disclosure can be executed in parallel, executed in series, or executed in different orders, as long as the desired results of the technical solutions of the present disclosure can be achieved, and the present disclosure is not limited herein.

[0104] The specific implementation described above does not constitute a limitation on the scope of protection of the present application. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A cloud gateway system, characterized by, The system comprises at least one cloud gateway, wherein the cloud gateway comprises a configuration management container, a webpage container, a routing container and a data plane container; The configuration management container is configured to receive first configuration information from a northbound controller and second configuration information from the webpage container, modify gateway configuration information in a configuration information database according to the first configuration information or the second configuration information by using a preset configuration management strategy, and send the modified gateway configuration information to the routing container and the data plane container through the configuration information database; The webpage container is configured to receive configuration setting information input by a user based on a webpage, and determine the second configuration information according to the configuration setting information; The routing container is configured to generate a routing table according to routing protocol information in the received gateway configuration information, and send the routing table to the data plane container; The data plane container is configured to perform forwarding processing on a received data packet according to network configuration information in the received gateway configuration information and the routing table; The webpage container is provided with a configuration checking module, and the configuration checking module is configured to check the configuration setting information; The determination of the second configuration information according to the configuration setting information comprises: In the case of passing the check, the second configuration information is determined according to the configuration setting information; The setting operation corresponding to the configuration setting information comprises at least one of adding, modifying and deleting, and the checking content of the configuration setting information comprises specification checking of a modified field input by a user, existence checking of a gateway configuration table, field existence checking in the gateway configuration table, and association checking of the gateway configuration table, wherein the gateway configuration table is configured to store gateway configuration information; For the deleting operation, the corresponding checking content comprises: judging whether a first gateway configuration table to be deleted currently has an associated second gateway configuration table, if there is, judging whether the second gateway configuration table is allowed to be unbound with the first gateway configuration table, and judging whether gateway configuration information associated with the first gateway configuration table in the second gateway configuration table is allowed to be deleted, if all are allowed, it is determined that the check is passed, wherein the first gateway configuration table comprises gateway configuration information in the configuration information database determined according to table ID information input by a user, and the second gateway configuration table comprises a gateway configuration table associated with the first gateway configuration table according to a field.

2. The system of claim 1, wherein, The data plane container is provided with a vector data packet processing framework VPP, and the VPP is used to perform forwarding processing on the received data packet.

3. The system of claim 1, wherein, The system further comprises a central control panel, wherein the central control panel comprises a gateway management module, and the cloud gateway further comprises a traffic monitoring service; The traffic monitoring service is configured to monitor traffic load in the cloud gateway, and send an overload signal to the gateway management module when the traffic load is greater than a first preset threshold, and send a low load signal to the gateway management module when the traffic load is less than a second preset threshold. The gateway management module is configured to add a gateway when an overload signal is received and delete a gateway when an underload signal is received.

4. The system of claim 3, wherein, The monitoring of the traffic load in the cloud gateway comprises: extracting quintuple information of the flow data packet, performing preset hash calculation on the quintuple information to obtain a data flow identifier; finding a corresponding target statistical entry from a traffic load state table according to the data flow identifier, and updating data packet data volume in the target statistical entry, wherein the traffic load state table comprises at least one statistical entry, and the data packet data volume in the statistical entry is used to record total traffic of a data flow corresponding to the data flow identifier, and the sum of the data packet data volume in all statistical entries is used to measure the traffic load of the cloud gateway.

5. The system of claim 3, wherein, The adding of the gateway when the overload signal is received comprises: when the overload signal is received, obtaining target gateway configuration information in a target configuration information database in a target cloud gateway, and constructing a new cloud gateway according to the target gateway configuration information.

6. A data processing method based on a cloud gateway system, characterized by, The method is applied to the cloud gateway system of any one of claims 1-5, and the method comprises: receiving first configuration information from a northbound controller and second configuration information from the web container through the configuration management container, modifying gateway configuration information in a configuration information database according to the first configuration information or the second configuration information by using a preset configuration management strategy, and sending the modified gateway configuration information to the routing container and the data plane container through the configuration information database; receiving configuration setting information input by a user based on a webpage through the web container, and determining the second configuration information according to the configuration setting information; generating a routing table according to routing protocol information in the received gateway configuration information through the routing container, and sending the routing table to the data plane container; performing forwarding processing on the received data packet according to network configuration information in the received gateway configuration information and the routing table through the data plane container; performing checking on the configuration setting information through a configuration checking module deployed in the web container, wherein the receiving of the configuration setting information input by the user based on the webpage through the web container and the determining of the second configuration information according to the configuration setting information comprise: receiving the configuration setting information input by the user based on the webpage through the web container, and determining the second configuration information according to the configuration setting information in the case of passing the checking, wherein the configuration setting information corresponds to at least one of adding, modifying and deleting, and the checking content of the configuration setting information comprises specification checking of a modified field input by the user, existence checking of a gateway configuration table, existence checking of a field in the gateway configuration table, and association checking of the gateway configuration table, wherein the gateway configuration table is used to store gateway configuration information; For the deletion operation, the corresponding check content includes: judging whether the first gateway configuration table currently needing to be deleted exists an associated second gateway configuration table, if exists, judging whether the second gateway configuration table allows to be unbound with the first gateway configuration table, and judging whether the gateway configuration information associated with the first gateway configuration table in the second gateway configuration table allows to be deleted, if all are allowed, it is determined that the check is passed, wherein the first gateway configuration table includes the gateway configuration table in the configuration information database determined according to the table ID information input by the user, and the second gateway configuration table includes the gateway configuration table associated with the first gateway configuration table according to the field.

7. An electronic device, comprising: The electronic device includes: at least one processor; and a memory connected with the at least one processor in communication; wherein The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the computer program to implement the corresponding functions of the cloud gateway system according to any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer instructions for enabling the processor to implement the corresponding functions of the cloud gateway system according to any one of claims 1-5 when executed.

Images