Method and device for multicast high-availability market data distribution

Abstract

The application discloses a multicast high-availability market information distribution method and device, and only one multicast flow needs to be sent from a market information center to a public cloud, optimal multicast replication is realized, bandwidth cost from the market information center to each member center is saved, and an elastic scalable group of multicast receivers is innovatively proposed, and in order to save bandwidth between AZs, a member of an elastic scalable group in a nearby AZ is selected as a multicast receiver, only when members in the same scalable group in the same AZ all fail, members in another AZ in the scalable group are selected as receivers, bandwidth is saved, and the cross-AZ high-availability effect is achieved, the multicast gateway cross-AZ deployment is realized, a unicast vxlan tunnel is established with a POP access point, and automatic nearby optimal selection reception to a market information source is realized according to different BGP AZ number lengths.

Description

Technical Field

[0001] The present invention relates to the technical field of network address translation in data communications, and in particular to a method and device for multicast high-availability market information distribution. Background Art

[0002] When a customer's securities and stock business is deployed on a cloud host in a public cloud, multicast support is required within the public cloud. Currently, major market centers have implemented disaster recovery for market sources. For example, the five major futures exchanges have established primary and backup trading centers. Service providers currently use IDCs to achieve high availability of market centers, but the member units' own multicast disaster recovery systems are not sound.

[0003] (1) When a member unit’s computer room fails, the entire member unit cannot receive market information.

[0004] (2) Secondly, each member unit needs to deploy two dedicated lines to connect to the production center and disaster recovery center, which is also costly. The market information required by other member units is the same, and the market information center sends a copy of the market information to each member unit, which also consumes a lot of network bandwidth.

[0005] (3) Third, if each member unit deploys two market information servers in two computer rooms, firstly, the number of dedicated lines will increase, and secondly, the two market information servers will be separated from each other. Two sets of certificates will also be required, which will increase the cost. In addition, the two market information servers will consume bandwidth when receiving market information. Summary of the Invention

[0006] This section provides an overview of some aspects of the present invention and briefly introduces some preferred embodiments. Simplifications or omissions may be made in this section, the abstract, and the title of the invention to avoid obscuring the purpose of this section, the abstract, and the title of the invention. Such simplifications or omissions should not be construed as limiting the scope of the invention.

[0007] In view of the problems existing in the above-mentioned existing method and device for multicast high-availability market information distribution, the present invention is proposed.

[0008] Therefore, the purpose of the present invention is to provide a method and device for multicast high-availability market information distribution, which is to solve the above-mentioned problems.

[0009] In order to solve the above technical problems, the present invention provides the following technical solutions:.

[0010] As a method for multicast high-availability market information distribution described in the present invention, the process method is as follows:

[0011] S1. Deploy a multicast gateway (MCGW) across multiple AZs in a clustered manner. For example, deploy one MCGW in AZ1 and one in AZ2.

[0012] S2. The multicast gateway MCGW synchronizes multicast entry information through the DCI interconnection link between the two AZs;

[0013] S3. Each member unit will encrypt and pre-install the authentication certificate on the MCGW multicast gateway, which will then be forwarded to major market centers for certificate authentication.

[0014] S4. Each member unit creates a multicast receiver elastic scaling group. Each scaling group has at least one market information server in each AZ. The priorities of the elastic scaling group members are set. For example, for member unit 1, multicast receiver elastic scaling group 1 has two members, and market information server 1 has a priority of 100 and market information server 2 has a priority of 50, indicating that market information server 1 is preferred for receiving market information.

[0015] S5. Each member of the elastic scaling group joins the multicast group according to the following logic. This innovative approach uses the query message sent by the multicast gateway received by the market information server network card within a certain period of time to determine the reachability of the network card and the MCGW. This allows only one network card on the same market information server to join the multicast group at a time, ensuring that the market information server does not receive the same multicast message from two network cards at the same time, causing market information server processing anomalies.

[0016] S6. Configure the IP addresses of the production center and disaster recovery center on the multicast gateway MCGW, and set the multicast source priority. For example, set the production center to 100 and the disaster recovery center to 50. It is assumed that the larger the number, the higher the priority.

[0017] S7: Based on the priority of the multicast source, the production center is selected to initiate unicast certificate authentication. If the unicast of the production center is unreachable, the MCGW attempts to initiate certificate authentication with the disaster recovery center. At this time, since the unicast route from MCGW2 to the disaster recovery center has a higher priority, the authentication will be initiated through MCGW2 first.

[0018] S8. The multicast gateway uses VIP and POP devices to establish a VXLAN unicast tunnel. Multicast traffic enters from the POP devices in the two AZs and is encapsulated in the VXLAN tunnel to enter the multicast gateway. When the production center sends market information as a multicast source, both MCGW1 and MCGW2 publish VIP BGP routes to POPs. However, POP1 receives the VIP route from MCGW1 because it has a shorter AS number and is preferred. Therefore, MCGW1 receives the multicast market information from the production center.

[0019] S9. After receiving the message, the MCGW can query the AZ and scaling group information described in the market server based on the OVS address information, record the multicast group IGMP report message, and generate a multicast entry.

[0020] S10. Each member of the MCGW periodically checks the multicast group members for activity through IGMP queries. If no response is received after a timeout, the multicast group is deleted.

[0021] S11. When the network card of market information server 1 in elastic scaling group 1 fails, the IGMP query messages sent by MCGW1 and MCGW2 time out without a response. Upon detecting the failure, network card A in the multicast table is deleted. At the same time, the market information server of the member unit also detects that it is unreachable and uses another network card to send an IGMP Join request to MCGW.

[0022] S12: When member unit server 1 fails and network cards A and B are unreachable, MCGW1 selects network card E in AZ2. The multicast market information will pass through the production center to MCGW1, then to the DCI interconnection link, and finally to network card E. An alarm will be sent and a new virtual machine will be automatically launched as the market information server for member units in AZ1.

[0023] S13. When AZ1 fails, MCGW2 detects that member MCGW1 is no longer active due to an inter-group synchronization message timeout. It then initiates unicast authentication with the disaster recovery center based on the certificate installed by the member organization. It then detects that network adapters A, B, C, and D are unreachable. It then queries the multicast table and selects a receiver in another AZ, AZ2. It then changes AZ2's multicast table entry to receive multicast data and selects network adapters E and G for multicast market data.

[0024] As a preferred solution of the multicast high-availability market information distribution method described in the present invention, multiple member units are placed on a public cloud platform, and resources are isolated through VPC. In order to save dedicated line costs and achieve AZ and high availability at the same time, the production center and AZ1 are interconnected, and the disaster recovery center of the market information center and AZ2 are interconnected.

[0025] As a preferred solution of the multicast high-availability market information distribution method described in the present invention, the elastic scaling group of member unit 1 is market information servers 1-100 and market information servers 3-50, and the elastic scaling group 2 of member unit 2 is market information servers 2 and 4.

[0026] As a preferred solution of the multicast high-availability market information distribution method described in the present invention, the market information server of each member unit will select the network card with the highest member priority to forward the multicast market information, such as member unit 1 selects network card A of market information server 1 to receive market information.

[0027] As a preferred solution of the method for multicast high-availability market distribution described in the present invention, wherein: each market server in the multicast elastic scaling group selects a network card to send an IGMP Join multicast group joining message to the outside. After this IGMP join message reaches the OVS of the market server, the OVS adds vxlan encapsulation according to the flow table, the outer vxlan address source IP uses the OVS address, and the destination IP address uses the MCGW cluster VIP address.

[0028] As a preferred solution of the multicast high-availability market information distribution method described in the present invention, the market information is transmitted from the disaster recovery center through the multicast gateway member MCGW2 to the network card E and the network card G, thereby achieving continuous reception of market information of member units 1 and 2.

[0029] As a preferred solution of the method for multicast high-availability market information distribution described in the present invention, the VXLAN is the abbreviation of Virtual eXtensible LAN, which is an extensible virtual local area network, and the IGMP is the abbreviation of Internet Group Management Protocol, which is Internet Group Management Protocol snooping.

[0030] As a preferred solution of the method for multicast high-availability market information distribution described in the present invention, the VTEP is the abbreviation of VXLAN Tunnel End Point, that is, the VXLAN tunnel endpoint, the VSI is the abbreviation of Virtual Switch Instance, that is, the virtual switching instance, and the VTEP is a virtual switching instance that provides a Layer 2 switching service for VXLAN.

[0031] As a preferred solution of the method for multicast high-availability market information distribution described in the present invention, the method uses a device for multicast high-availability market information distribution, including multiple switches and routers. When the server composed of the switches and routers is running, the method for multicast high-availability market information distribution described in any one of claims 1-8 is used.

[0032] The present invention also provides a device, comprising: a multicast high-availability market information distribution device as described in claim 9, wherein the device is mainly composed of multiple switches and routers, and is externally assembled with a server shell.

[0033] Beneficial effects of the present invention:

[0034] 1. Only one copy of multicast traffic needs to be sent from the market center to the public cloud, achieving optimal multicast replication and saving bandwidth costs from the market center to each member center.

[0035] 2. We introduced an elastic scaling group for multicast receivers. To save inter-AZ bandwidth, members of the nearest AZ in the elastic scaling group are selected as multicast receivers. Only when all members in the same AZ in the scaling group fail will members of another AZ in the scaling group be selected as receivers. This not only saves bandwidth but also achieves cross-AZ high availability.

[0036] 3. Implement cross-AZ deployment of multicast gateways, establish unicast vxlan tunnels with POP access points, and automatically select the nearest preferred receiver to the market source based on the length of the BGPAZ number;

[0037] 4. Reusing the existing IGMP query and report mechanisms, this innovatively implements reverse health checks of multicast receivers on multicast gateways. This allows multicast gateways to switch receivers without sending additional probe messages, while also enabling the market information server to switch network cards. This achieves high availability at the AZ level for member units' market information reception.

[0038] 5. The multicast gateway receives the IGMP report join message carrying VXLAN encapsulation from the market information server network card, obtains the multicast group joining information, and can query the market information server AZ information based on the VXLAN encapsulation. Then the multicast gateway preferentially receives market information from the market information server in the same AZ as the multicast source, thereby reducing the bandwidth occupied by the DCI cross-AZ link. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive effort. Among them:

[0040] Figure 1 A flowchart of a method for multicast high-availability market information distribution proposed by the present invention;

[0041] Figure 2 This is a logical flow diagram of the elastic scaling group of the present invention;

[0042] Figure 3 A schematic diagram of the processing logic of the multicast gateway of the present invention;

[0043] Figure 4 This is a schematic diagram of the detection process when AZ1 fails in the present invention. DETAILED DESCRIPTION

[0044] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0045] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0046] Secondly, the term "one embodiment" or "embodiment" herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in various places throughout this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive of other embodiments.

[0047] Furthermore, the present invention is described in detail with reference to schematic diagrams. For ease of illustration, when describing the embodiments of the present invention, cross-sectional views illustrating device structures may be partially enlarged and not to scale. Furthermore, the schematic diagrams are merely illustrative and should not limit the scope of protection of the present invention. Furthermore, in actual production, the three-dimensional dimensions of length, width, and depth should be included.

[0048] Reference Figure 1-4 The present invention provides a method for multicast high-availability market information distribution, the process is as follows:

[0049] S1. Deploy a multicast gateway (MCGW) across multiple AZs in a clustered manner. For example, deploy one MCGW in AZ1 and one in AZ2.

[0050] S2. The multicast gateway MCGW synchronizes multicast entry information through the DCI interconnection link between the two AZs;

[0051] S3. Each member unit will encrypt and pre-install the authentication certificate on the MCGW multicast gateway, which will then be forwarded to major market centers for certificate authentication.

[0052] S4. Each member unit creates a multicast receiver elastic scaling group. Each scaling group has at least one market information server in each AZ. The priorities of the elastic scaling group members are set. For example, for member unit 1, multicast receiver elastic scaling group 1 has two members, and market information server 1 has a priority of 100 and market information server 2 has a priority of 50, indicating that market information server 1 is preferred for receiving market information.

[0053] S5. Each member of the elastic scaling group joins the multicast group according to the following logic. This innovative approach uses the query message sent by the multicast gateway received by the market information server network card within a certain period of time to determine the reachability of the network card and the MCGW. This allows only one network card on the same market information server to join the multicast group at a time, ensuring that the market information server does not receive the same multicast message from two network cards at the same time, causing market information server processing anomalies.

[0054] S6. Configure the IP addresses of the production center and disaster recovery center on the multicast gateway MCGW, and set the multicast source priority. For example, set the production center to 100 and the disaster recovery center to 50. It is assumed that the larger the number, the higher the priority.

[0055] S7: Based on the priority of the multicast source, the production center is selected to initiate unicast certificate authentication. If the unicast of the production center is unreachable, the MCGW attempts to initiate certificate authentication with the disaster recovery center. At this time, since the unicast route from MCGW2 to the disaster recovery center has a higher priority, the authentication will be initiated through MCGW2 first.

[0056] S8. The multicast gateway uses VIP and POP devices to establish a VXLAN unicast tunnel. Multicast traffic enters from the POP devices in the two AZs and is encapsulated in the VXLAN tunnel to enter the multicast gateway. When the production center sends market information as a multicast source, both MCGW1 and MCGW2 publish VIP BGP routes to POPs. However, POP1 receives the VIP route from MCGW1 because it has a shorter AS number and is preferred. Therefore, MCGW1 receives the multicast market information from the production center.

[0057] S9. After receiving the message, MCGW can query the AZ and scaling group information of the market server based on the OVS address information, record the multicast group IGMP report message, and generate a multicast table entry.

[0058] S10. Each member of the MCGW periodically checks the multicast group members through IGMP query. If no response is received after the timeout, the multicast group is deleted.

[0059]

[0060]

[0061] S11. When the network card of market information server 1 in elastic scaling group 1 fails, the IGMP query messages sent by MCGW1 and MCGW2 time out without a response. Upon detecting the failure, network card A in the multicast table is deleted. At the same time, the market information server of the member unit also detects that it is unreachable and uses another network card to send an IGMP Join request to MCGW.

[0062]

[0063] S12: When member unit server 1 fails and network cards A and B are unreachable, MCGW1 selects network card E in AZ2. The multicast market information will pass through the production center to MCGW1, then to the DCI interconnection link, and finally to network card E. An alarm will be sent and a new virtual machine will be automatically launched as the market information server for member units in AZ1.

[0064]

[0065] S13. When AZ1 fails, MCGW2 detects that member MCGW1 is no longer active due to an inter-group synchronization message timeout. It then initiates unicast authentication with the disaster recovery center based on the certificate installed by the member organization. It then detects that network adapters A, B, C, and D are unreachable. It then queries the multicast table and selects a receiver in another AZ, AZ2. It then changes AZ2's multicast table entry to receive multicast data and selects network adapters E and G for multicast market data.

[0066] Among them, multiple member units are placed on the public cloud platform, and resources are isolated through VPC. In order to save dedicated line costs while achieving AZ and high availability, the production center is interconnected with AZ1, and the disaster recovery center of the market center is interconnected with AZ2.

[0067] Furthermore, the elastic scaling group of member unit 1 is composed of market servers 1-100 and market servers 3-50, while the elastic scaling group 2 of member unit 2 is composed of market servers 2 and 4.

[0068] Furthermore, the market information server of each member unit will select the network card with the highest member priority to forward the multicast market information. For example, member unit 1 selects network card A of market information server 1 to receive market information.

[0069] Furthermore, each market server in the multicast elastic scaling group selects a network card to send an IGMPJoin multicast group joining message. After this IGMP join message reaches the OVS of the market server, the OVS adds vxlan encapsulation according to the flow table. The outer vxlan address source IP uses the OVS address, and the destination IP address uses the MCGW cluster VIP address.

[0070] Furthermore, the market information is transmitted from the disaster recovery center through the multicast gateway member MCGW2 to the network card E and the network card G, thereby achieving continuous reception of market information of member units 1 and 2.

[0071] Furthermore, VXLAN is the abbreviation of Virtual eXtensible LAN, which is an extensible virtual local area network, and IGMP is the abbreviation of Internet Group Management Protocol, which is Internet Group Management Protocol.

[0072] Furthermore, VTEP is the abbreviation of VXLAN Tunnel End Point, that is, the VXLAN tunnel endpoint, and VSI is the abbreviation of Virtual Switch Instance, that is, a virtual switch instance. VTEP is a virtual switch instance that provides Layer 2 switching services for a VXLAN.

[0073] Furthermore, the method uses a multicast high-availability market information distribution device, including multiple switches and routers. When the server composed of the switches and routers is running, the multicast high-availability market information distribution method described in any one of claims 1-8 is used.

[0074] The present invention also provides a device, including a multicast high-availability market information distribution device as described in claim 9, wherein the device is mainly composed of multiple switches and routers, and is externally assembled with a server housing.

[0075] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A method for multicast high-availability market information distribution, characterized by: The process method is as follows: S1. Deploy a multicast gateway (MCGW) in a cluster across multiple AZs, with one in AZ1 and one in AZ2. S2. The multicast gateway MCGW synchronizes multicast entry information through the DCI interconnection link between the two AZs; S3. Each member unit will encrypt and pre-install the authentication certificate on the MCGW multicast gateway, which will then be used to authenticate the certificate to various market centers. S4. Each member unit creates a multicast receiver elastic scaling group. Each scaling group has at least one market information server in each AZ. The priorities of the elastic scaling group members are set. For example, member unit 1's multicast receiver elastic scaling group 1 has two members, with market information server 1's priority set to 100 and market information server 2's priority set to 50. This means that market information server 1 is preferred for receiving market information. S5. Each member of the elastic scaling group joins the multicast group according to the following logic. The reachability between the network card and the MCGW is determined by the query message sent by the multicast gateway received by the network card of the market information server within a certain period of time. This also ensures that only one network card of the same market information server joins the multicast group at a time, ensuring that the market information server does not receive the same multicast message from two network cards at the same time, causing market information server processing anomalies. S6. Configure the IP addresses of the production center and disaster recovery center on the multicast gateway MCGW, and set the multicast source priority. Set the production center priority to 100 and the disaster recovery center priority to 50, assuming that the larger the number, the higher the priority. S7: Based on the priority of the multicast source, the production center is prioritized to initiate unicast certificate authentication. If the production center is unreachable, the MCGW attempts to initiate certificate authentication with the disaster recovery center. At this time, since the unicast route from MCGW2 to the disaster recovery center has a higher priority, MCGW2 will be prioritized to initiate authentication. S8. The multicast gateway uses VIP and POP devices to establish a VXLAN unicast tunnel. Multicast traffic enters from the POP devices in the two AZs and is encapsulated in the VXLAN tunnel to enter the multicast gateway. When the production center sends market information as a multicast source, both MCGW1 and MCGW2 publish VIP BGP routes to POPs. However, POP1 receives the VIP route from MCGW1 because it has a shorter AS number and is preferred. Therefore, MCGW1 receives the multicast market information from the production center. S9. After receiving the message, the MCGW can query the AZ and scaling group information described in the market server based on the OVS address information, record the multicast group IGMP report message, and generate a multicast entry. S10. Each member of the MCGW periodically checks the multicast group members for activity through IGMP queries. If no response is received after a timeout, the multicast group is deleted. S11. When the network card of market information server 1 in elastic scaling group 1 fails, the IGMP query messages sent by MCGW1 and MCGW2 time out without a response. Upon detecting the failure, network card A in the multicast table is deleted. At the same time, the market information server of the member unit also detects that it is unreachable and uses another network card to send an IGMP Join request to MCGW. S12. When member unit server 1 fails and network cards A and B are unreachable, MCGW1 selects network card E in AZ2. The multicast market information will pass through the production center to MCGW1, then to the DCI interconnection link, and finally to network card E. At the same time, an alarm is sent and a new virtual machine is automatically launched as the market information server for member units in AZ1. S13. When the entire AZ1 fails, MCGW2 detects that member MCGW1 is no longer active through the timeout of the inter-group synchronization message. It will initiate a unicast authentication to the disaster recovery center based on the certificate installed by the member unit, and detect that network cards A, B, C, and D are all unreachable. It queries the multicast table and selects another AZ, namely the receiver of AZ2, and changes the multicast table entry of AZ2 to receive multicast. It chooses to send multicast market data to network cards E and G.

2. The method for multicast high-availability market information distribution according to claim 1, characterized in that: Multiple member units are placed on the public cloud platform and resources are isolated through VPC. In order to save dedicated line costs while achieving AZ and high availability, the production center is interconnected with AZ1, and the disaster recovery center of the market center is interconnected with AZ2.

3. The method for multicast high-availability market information distribution according to claim 2, characterized in that: The elastic scaling group of member unit 1 is composed of market servers 1-100 and market servers 3-50, while the elastic scaling group 2 of member unit 2 is composed of market servers 2 and 4.

4. The method for multicast high-availability market information distribution according to claim 3, characterized in that: The market information server of each member unit will select the network card with the highest member priority to forward the multicast market information. Member unit 1 selects network card A of market information server 1 to receive market information.

5. The method for multicast high-availability market information distribution according to claim 4, characterized in that: Each market server in the multicast elastic scaling group selects a network card to send an IGMP Join multicast group joining message. After this IGMP Join message reaches the OVS of the market server, the OVS adds vxlan encapsulation according to the flow table. The outer vxlan address source IP uses the OVS address, and the destination IP address uses the MCGW cluster VIP address.

6. The method for multicast high-availability market information distribution according to claim 5, characterized in that: The market information is transmitted from the disaster recovery center through the multicast gateway member MCGW2 to the network card E and the network card G, thereby achieving continuous reception of market information of the member units 1 and 2.

7. The method for multicast high-availability market information distribution according to claim 6, characterized in that: The VXLAN is the abbreviation of Virtual eXtensible LAN, which can be used to extend virtual local area network, and the IGMP is the abbreviation of Internet Group Management Protocol, which can be used to monitor Internet Group Management Protocol.

8. A device for multicast high-availability market information distribution, characterized in that: The invention comprises a plurality of switches and routers, and the switches and routers execute the multicast high-availability market information distribution method according to any one of claims 1 to 7 when in operation.

Images