A high-speed data synchronization backup system and method for edge servers

通过在物联网感知设备与边缘服务器之间的FPGA开发板互联,建立同步和心跳链路,解决了缓存系统缺乏备份机制的问题,实现了在设备故障时的快速切换和数据同步,确保了高速 , stable data transmission.

CN113986612BActive Publication Date: 2024-11-08WUHAN UNIV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111190672.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-13
Publication Date
2024-11-08
Estimated Expiration
2041-10-13

AI Technical Summary

Technical Problem

The cache system between the existing IoT sensing devices and edge servers lacks a backup mechanism, which leads to interruption of data transmission in case of device failure and causes a large amount of data loss, especially in scenarios where data transmission stability and continuity are required.

Method used

Two FPGA development boards are interconnected through optical fiber to establish a synchronization link and a heartbeat link to monitor the other party's status in real time. If the motherboard fails, the backup board will replace the motherboard for data cache and output tasks, and synchronize the data when the motherboard is restored to ensure the data High-speed and stable transmission.

Benefits of technology

It realizes rapid switching in the event of equipment failure, reduces data losses, ensures the stability and continuity of high-speed data transmission, and has the characteristics of flexible configuration, high throughput, and low power consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113986612B_ABST
    Figure CN113986612B_ABST
Patent Text Reader

Abstract

The present invention belongs to the technical field of Internet of Things, and discloses a high-speed data synchronization backup system and method for edge servers. The present invention receives data from an Internet of Things sensing device through an optical fiber splitter, divides the data into two completely identical signals, and synchronously sends them to two FPGA development boards. A synchronization link is established between the two boards through a QSFP+ optical module, and a heartbeat link is established through an SFP+ optical module; an FPGA development board that performs data caching tasks and data output tasks is selected according to heartbeat monitoring information, and the two boards are controlled to perform synchronous data backup through a synchronization link; the FPGA development board that performs data output tasks transmits data to the optical fiber splitter through an optical fiber, and finally sends the data to an edge server. The present invention has the characteristics of high speed, high throughput, fast switching, and low power consumption, and has the advantages of low cost and low power consumption, and can ensure the stable transmission of high-speed data and reduce data loss caused by equipment failure.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of Internet of Things, and more specifically, relates to a high-speed data synchronization backup system and method for an edge server. Background Art

[0002] With the development of IoT technology, the number of IoT sensing devices such as sensors has exploded, generating a large amount of high-speed real-time data, which has brought challenges to the data transmission mechanism in the field of edge computing. The instantaneous data volume generated by a large number of sensing devices often far exceeds the data receiving capacity of the edge server. Therefore, it is necessary to add a cache device between the sensing device and the edge server to buffer the high-speed data from the sensing device. The existing caching method uses a single cache channel and lacks a backup mechanism. Once the device fails, it will cause data transmission interruption and cause a large amount of data loss. However, some scenarios have high requirements for the stability and continuity of data transmission, such as time series data with time tags and intelligent driving data that need to be processed in real time. Such data requires real-time transmission of data collected by the sensing device, and data loss during the transmission process will cause damage to the subsequent data processing process. Therefore, high requirements are put forward for the speed, stability, and continuity of data transmission. Summary of the invention

[0003] The present invention provides an edge server high-speed data synchronization backup system and method to solve the problem in the prior art that the cache system between the Internet of Things sensing device and the edge server and the corresponding cache method lack a backup mechanism, which will cause a large amount of data loss when the device fails.

[0004] The present invention provides a high-speed data synchronization and backup method for an edge server, which receives data from an Internet of Things sensing device through a first optical fiber splitter, divides the data into two completely identical signals, and synchronously sends the signals to two FPGA development boards through optical fibers, which are respectively recorded as an FPGA main board and an FPGA backup board;

[0005] The FPGA main board and the FPGA standby board are interconnected via optical fiber, a synchronization link is established between the two boards via a QSFP+ optical module, and a heartbeat link is established between the two boards via a first SFP+ optical module; the two boards mutually send heartbeat signals via the heartbeat link to perform real-time heartbeat monitoring, select an FPGA development board that performs data caching tasks and data output tasks based on the heartbeat monitoring information, and control the two boards to perform synchronous data backup via the synchronization link;

[0006] The FPGA development board that performs the data output task transmits the data to the second fiber optic splitter via the optical fiber, and the second fiber optic splitter sends the data to the edge server via the optical fiber.

[0007] Preferably, the two FPGA development boards both input data through the input end SFP+ optical module and output data through the output end SFP+ optical module; the FPGA development board receives data when the input end SFP+ optical module is turned on, and outputs data when the FPGA development board turns on the output end SFP+ optical module.

[0008] Preferably, when it is determined that the FPGA mainboard is operating normally based on the heartbeat monitoring information, the FPGA mainboard performs a data caching task and a data output task;

[0009] When it is determined based on the heartbeat monitoring information that the FPGA main board fails and the FPGA standby board operates normally, the FPGA standby board replaces the FPGA main board to perform data caching tasks and data output tasks;

[0010] When it is determined based on the heartbeat monitoring information that the FPGA main board fault has been recovered and the FPGA standby board is operating normally, the FPGA standby board synchronizes its cached data to the FPGA main board through the synchronization link, and the FPGA main board resumes executing data caching tasks and data output tasks.

[0011] Preferably, when it is determined based on the heartbeat monitoring information that the FPGA main board is operating normally and the FPGA standby board fails, the FPGA main board performs a data caching task and a data output task;

[0012] When it is determined based on the heartbeat monitoring information that the FPGA main board and the FPGA standby board are operating normally, the FPGA main board performs data caching tasks and data output tasks, and synchronizes its cached data to the FPGA standby board in real time through the synchronization link.

[0013] Preferably, when both the FPGA main board and the FPGA standby board are operating normally, the FPGA main board receives and decodes the data signal from the input SFP+ optical module through the first GTX IP core, and writes the data into the DDR write buffer and synchronization buffer of the board respectively after the four-channel buffer formed by the FIFO IP core performs shunting buffering; the DDR write address is generated by the DDR read-write controller of the board, and when the DDR write buffer data is filled with a preset size, the data block is written to the specified address of the DDR memory through the MIG IP core; the FPGA main board generates a DDR read address through the DDR read-write controller of the board, and uses the MIG IP core to sequentially read the cached data from the DDR memory, and after being cached by the DDR read buffer of the board, sends it to the second GTX IP core; the second GTX IP core encodes the data and transmits it to the output SFP+ optical module; the FPGA main board sends the data in the synchronization buffer of the board and the corresponding DDR write address to the third GTX in real time. The IP core is encoded and sent to the FPGA standby board through the synchronization link; after receiving the synchronized data information, the FPGA standby board writes the data into the synchronization buffer of the board and writes the data block of the preset size into the specified address of the DDR memory of the board;

[0014] The FPGA main board sends a heartbeat signal to the fourth GTX IP core of the board in real time and encodes it. The heartbeat signal includes the DDR read address of the board and is sent to the FPGA standby board through the heartbeat link. The FPGA standby board sends a heartbeat signal to the fourth GTX IP core of the board in real time and encodes it. The heartbeat information includes the status information of the synchronization buffer of the board and is sent to the FPGA main board through the heartbeat link.

[0015] Preferably, when the FPGA backup board replaces the FPGA main board to perform data caching tasks and data output tasks, the FPGA backup board turns on the input SFP+ optical module of the board to receive upstream data; the FPGA backup board turns on the output SFP+ optical module of the board, and starting from the last acquired DDR read address of the FPGA main board, reads data from the DDR memory of the FPGA backup board, and outputs it to the edge server via the output SFP+ optical module.

[0016] Preferably, when it is determined based on the heartbeat monitoring information that one party has recovered from the fault, the FPGA development board that executes the data caching task and the data output task synchronizes the data of the board to the FPGA development board that has recovered from the fault.

[0017] Preferably, when the FPGA main board recovers from a fault, the FPGA standby board sends the current DDR write address WR_ADDR of the board to the FPGA main board through the heartbeat link; the FPGA main board turns on the input SFP+ optical module to receive upstream data, and writes the data starting from WR_ADDR to the DDR memory of the board; the FPGA standby board synchronizes the data in the DDR memory of the board to the same position of the DDR memory of the FPGA main board in sequence starting from WR_ADDR in the low address direction through the synchronization link; and obtains in real time through the synchronization controller the DDR read address rd_addr_out of the FPGA standby board outputting data to the downstream and the DDR read address rd_addr_out of the FPGA standby board outputting data to the downstream. The FPGA mainboard synchronizes the data of the DDR read address rd_addr_sync; when rd_addr_out and rd_addr_sync are the same, the address is recorded as SYNC_ADDR, indicating that the DDR memories of the FPGA mainboard and the FPGA standby board have been synchronized, and the FPGA standby board sends SYNC_ADDR and a synchronization completion signal to the FPGA mainboard through the heartbeat link, and the FPGA standby board turns off the output SFP+ optical module and the input SFP+ optical module of the board; the FPGA mainboard turns on the output SFP+ optical module, reads the data in the DDR memory normally from SYNC_ADDR, and outputs it to the edge server;

[0018] When the FPGA standby board recovers from the fault, the FPGA main board sends the current DDR write address WR_ADDR of the board to the FPGA standby board through the heartbeat link; the FPGA main board synchronizes the data in the DDR memory of the board to the same position of the DDR memory of the FPGA standby board in sequence, starting from WR_ADDR and moving toward the lower address through the synchronization link; the DDR read address rd_addr_out of the FPGA main board outputting data downstream and the DDR read address rd_addr_sync of the FPGA main board synchronizing data to the FPGA standby board are obtained in real time through the synchronization controller; when rd_addr_out and rd_addr_sync are the same, the address is recorded as SYNC_ADDR, indicating that the DDR memories of the FPGA standby board and the FPGA main board have been synchronized, and the FPGA standby board and the FPGA main board have resumed normal working status.

[0019] The present invention provides an edge server high-speed data synchronization backup system, comprising: a first optical fiber splitter, an FPGA main board, an FPGA backup board, and a second optical fiber splitter;

[0020] The FPGA main board and the FPGA standby board have the same structure, and each of the FPGA development boards is connected with a first SFP+ optical module, an input SFP+ optical module, an output SFP+ optical module, and a QSFP+ optical module;

[0021] The input end of the first optical fiber splitter is connected to the IoT sensing device, and the output end of the first optical fiber splitter is respectively connected to the input end SFP+ optical module of the FPGA main board and the input end SFP+ optical module of the FPGA standby board; the output end SFP+ optical module of the FPGA main board and the output end SFP+ optical module of the FPGA standby board are both connected to the input end of the second optical fiber splitter, and the output end of the second optical fiber splitter is connected to the edge server;

[0022] The edge server high-speed data synchronization and backup system is used to implement the steps in the above-mentioned edge server high-speed data synchronization and backup method.

[0023] Preferably, each of the FPGA development boards is also connected with: a DDR memory, an FPGA chip; wherein the cache and control module running in the FPGA chip includes: a FIFO, a DDR write buffer, a synchronization buffer, a DDR read / write controller, a MIGIP core, a DDR read buffer, a synchronization controller, a first GTX IP core, a second GTX IP core, a third GTX IP core and a fourth GTX IP core;

[0024] The edge server high-speed data synchronization and backup system is used to implement the steps in the above-mentioned edge server high-speed data synchronization and backup method.

[0025] One or more technical solutions provided in the present invention have at least the following technical effects or advantages:

[0026] In the invention, two FPGA development boards are interconnected through optical fiber, and the FPGA mainboard receives and caches data from the IoT sensing device (referred to as the upstream device). When the edge server (referred to as the downstream device) is idle, the data is transferred to the downstream device through the optical fiber; at the same time, the FPGA mainboard synchronizes the data to the FPGA standby board in real time through the synchronization link. The two boards send heartbeat signals to each other through the heartbeat link to monitor each other's status in real time. If the FPGA mainboard fails, the FPGA standby board immediately replaces the FPGA mainboard, is responsible for receiving upstream data, and sends the cached data to the downstream device. When the FPGA mainboard recovers its function, the FPGA standby board synchronizes the cached data to the FPGA mainboard, and then returns the task to the FPGA mainboard. The present invention uses FPGA as the main device, can realize flexible construction and configuration of the system, and has the characteristics of high speed, high throughput, fast switching, and low power consumption. The present invention uses QSFP+ and SFP+ optical modules to transmit data through optical fiber, which can reduce the delay of data transmission and synchronization; the use of optical fiber splitters can efficiently shunt and converge optical signals. As an optical fiber tandem device, it does not require power supply and has the advantages of low cost and low power consumption. The present invention can realize high-speed data synchronization and backup between dual boards through optical fiber communication, and can realize rapid switching when a single board fails, thereby ensuring stable transmission of high-speed data and greatly reducing data loss caused by equipment failure. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 A hardware connection diagram of an edge server high-speed data synchronization backup system provided by an embodiment of the present invention;

[0028] Figure 2 An overall framework diagram of a high-speed data synchronization and backup method for an edge server provided by an embodiment of the present invention;

[0029] Figure 3 A schematic diagram of a data synchronization mechanism in a high-speed data synchronization backup method for an edge server provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0030] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0031] Embodiment 1:

[0032] Embodiment 1 provides a method for high-speed data synchronization and backup of edge servers, see Figure 1 , Figure 2, receiving data from the IoT sensing device through a first optical fiber splitter, dividing the data into two completely identical signals, and synchronously sending the signals to two FPGA development boards through optical fiber, which are respectively recorded as an FPGA main board and an FPGA backup board; the FPGA main board and the FPGA backup board are interconnected through optical fiber, a synchronization link is established between the two boards through a QSFP+ optical module, and a heartbeat link is established between the two boards through a first SFP+ optical module; the two boards send heartbeat signals to each other through the heartbeat link to perform real-time heartbeat monitoring, select an FPGA development board that performs data caching tasks and data output tasks according to the heartbeat monitoring information, and control the two boards to perform synchronous data backup through the synchronization link; the FPGA development board that performs the data output task transmits the data to the second optical fiber splitter through the optical fiber, and the second optical fiber splitter sends the data to the edge server through the optical fiber.

[0033] The two FPGA development boards both input data through the input end SFP+ optical module and output data through the output end SFP+ optical module; the FPGA development board receives data when the input end SFP+ optical module is turned on, and outputs data when the output end SFP+ optical module is turned on.

[0034] When it is determined based on the heartbeat monitoring information that the FPGA main board is operating normally, the FPGA main board executes data caching tasks and data output tasks; when it is determined based on the heartbeat monitoring information that the FPGA main board fails and the FPGA standby board is operating normally, the FPGA standby board replaces the FPGA main board to execute data caching tasks and data output tasks; when it is determined based on the heartbeat monitoring information that the FPGA main board failure is recovered and the FPGA standby board is operating normally, the FPGA standby board synchronizes its cached data to the FPGA main board through the synchronization link, and the FPGA main board restarts to execute data caching tasks and data output tasks.

[0035] When it is determined based on the heartbeat monitoring information that one party has recovered from the fault, the FPGA development board that executes the data caching task and the data output task synchronizes the data of the board to the FPGA development board that has recovered from the fault.

[0036] Embodiment 2:

[0037] Embodiment 2 provides an edge server high-speed data synchronization backup system, see Figure 1 , Figure 2, including: a first optical fiber splitter, an FPGA main board, an FPGA spare board, and a second optical fiber splitter; the structures of the two FPGA development boards, the FPGA main board and the FPGA spare board, are the same, and each of the FPGA development boards includes a first SFP+ optical module, an input end SFP+ optical module, an output end SFP+ optical module, and a QSFP+ optical module; the input end of the first optical fiber splitter is connected to an Internet of Things sensing device, and the output end of the first optical fiber splitter is respectively connected to the input end SFP+ optical module of the FPGA main board and the input end SFP+ optical module of the FPGA spare board; the output end SFP+ optical module of the FPGA main board and the output end SFP+ optical module of the FPGA spare board are both connected to the input end of the second optical fiber splitter, and the output end of the second optical fiber splitter is connected to an edge server.

[0038] Each of the FPGA development boards also includes: a DDR memory, an FPGA chip; wherein the cache and control modules running in the FPGA chip include: a FIFO, a DDR write buffer, a synchronization buffer, a DDR read-write controller, a MIG IP core, a DDR read buffer, a synchronization controller, a first GTX IP core, a second GTX IP core, a third GTX IP core, and a fourth GTX IP core.

[0039] The DDR memory port is connected to the pin of the FPGA chip for bidirectional data transmission; the pin of the FPGA chip is connected to the ports of the SFP+ optical module and the QSFP+ optical module; the first GTX IP core receives the data of the input SFP+ optical module and decodes it, and sends it to the FIFO; the FIFO caches the received data and then sends it to the DDR write buffer and synchronization buffer; the DDR write buffer caches the received data and then sends it to the MIG IP core; the MIG IP core connects the pins of the FPGA chip and the DDR memory for data transmission (that is, data transmission between the FPGA chip and the DDR memory is realized through pin connection), and connects the DDR write buffer, read buffer, the DDR read-write controller, the synchronization buffer, and the synchronization controller, writes the data in the DDR write buffer or the synchronization buffer into the DDR memory, reads the data in the DDR memory into the DDR read buffer or the synchronization buffer, and sends the relevant read and write addresses to the synchronization controller; the DDR read buffer receives data from the MIG IP core and caches it, and then sends the data to the second GTX IP core; the second GTX The IP core is connected to the output SFP+ optical module, encodes the received data and sends it to the output SFP+ optical module; the DDR read-write controller generates the DDR memory read-write address and control signal, and generates the read-write control signal of the FIFO, DDR write buffer, and DDR read buffer; the synchronization buffer realizes bidirectional data transmission, receives the data sent by the FIFO or the MIG IP core and the DDR write address sent by the synchronization controller and caches it, then packs the data and address and sends it to the third GTX IP core, or receives the data and address information from the third GTX IP core, sends it to the MIGIP core, and writes the data to the DDR memory; the third GTX IP core is connected to the QSFP+ optical module to realize bidirectional communication, encodes the data and address from the synchronization buffer and sends it to the QSFP+ optical module, or receives the data and address information from the QSFP+ optical module and decodes it and sends it to the synchronization buffer; the synchronization controller is connected to the first GTX IP core, the second GTX IP core, the fourth GTX IP core, the synchronization buffer, and the MIG IP core, and receives the data and address information from the MIG The IP core obtains the DDR write address and sends it to the synchronization buffer, generates heartbeat information and sends it to the fourth GTX IP core, or receives heartbeat information from the fourth GTX IP core, and controls the switches of the first GTX IP core and the second GTX IP core accordingly;The fourth GTX IP core is connected to the first SFP+ optical module to realize bidirectional data communication, encode the heartbeat data from the synchronization controller and send it to the first SFP+ optical module, or receive the heartbeat data from the first SFP+ optical module and decode it and send it to the synchronization controller. ;

[0040] The edge server high-speed data synchronization backup system provided in Example 2 is used to implement the steps in the edge server high-speed data synchronization backup method described in Example 1.

[0041] The present invention is further described below.

[0042] This embodiment adopts a data synchronization mechanism to perform real-time backup of high-speed data from upstream devices, and performs rapid task switching when equipment failure occurs and failure recovery occurs, thereby ensuring high-speed, stable and continuous data transmission. Figure 1 Shown is a schematic diagram of hardware connection of this embodiment.

[0043] See also Figure 1 , Figure 2 ,This embodiment is implemented through the following technical solution: an edge server high-speed data synchronization and backup system, including a data input part, a data synchronization and backup part, and a data output part.

[0044] The input part includes a first fiber optic splitter, an input SFP+ optical module, and a first GTX IP core; it is used to receive data from an upstream device (i.e., an IoT sensing device) and control the enablement of FPGA data reception.

[0045] The first fiber optic splitter is used to split the data of the upstream device and divide the input optical signal into two completely identical paths. This process only changes the intensity of the light and does not affect the content and properties of the transmitted signal.

[0046] The input SFP+ optical module is used to receive optical signals through optical fibers and transmit the data to the next module after being decoded by the first GTX IP core.

[0047] The first GTX IP core is used to decode the data from the input SFP+ optical module, transmit the data to the synchronous backup part, and control the switch of the input SFP+ optical module according to the information of the synchronous controller.

[0048] The synchronization backup part includes FIFO, DDR write buffer, MIG IP core, DDR memory, DDR read buffer, DDR read and write controller, synchronization buffer, the third GTX IP core, QSFP+ optical module, synchronization controller, the fourth GTX IP core, and the first SFP+ optical module; it is used to temporarily cache the received high-speed data, synchronize and back up the received data in real time, and monitor the working status of the FPGA development board.

[0049] FIFO is used to receive and buffer data from the input part and send it to the DDR write buffer and synchronization buffer.

[0050] DDR write buffer, used to cache data from FIFO and written to DDR memory by MIG IP core.

[0051] The MIG IP core is used to control the reading and writing of the DDR memory, write the data in the DDR write buffer to the DDR memory, and write the data in the DDR memory to the DDR read buffer.

[0052] DDR memory, used to cache data from the DDR write buffer and output data to the DDR read buffer.

[0053] DDR read buffer is used to receive data from DDR memory and send it to the data output part.

[0054] The DDR read / write controller is used to generate control signals and read / write addresses of the DDR memory, and to generate read / write control signals for the FIFO, DDR read buffer, and DDR write buffer.

[0055] The synchronization buffer realizes bidirectional data transmission and is used to cache the received synchronization data or the synchronization data to be sent.

[0056] The third GTX IP core can perform bidirectional communication and is used to encode the data in the synchronization buffer and send it to the QSFP+ optical module, or receive data from the QSFP+ optical module and send it to the synchronization buffer after decoding.

[0057] QSFP+ optical module is used to send and receive data through optical fiber to form a synchronous link.

[0058] The synchronization controller is used to generate and monitor heartbeat information, and generate control signals related to data synchronization based on the heartbeat information.

[0059] The fourth GTX IP core can perform bidirectional communication, and is used to encode the heartbeat information and send it to the first SFP+ optical module, or receive the heartbeat information from the first SFP+ optical module and decode it.

[0060] The first SFP+ optical module is used to send and receive heartbeat information through optical fiber to form a heartbeat link.

[0061] The output part includes a second fiber optic splitter, an output SFP+ optical module, and a second GTX IP core; it is used to control the FPGA data output enable and transfer the data to the downstream device (ie, the edge server).

[0062] The second GTX IP core is used to encode the data from the synchronous backup part and send it to the output end SFP+ optical module, and control the switch of the output end SFP+ optical module according to the information of the synchronous controller.

[0063] The output end SFP+ optical module is used to receive data from the second GTX IP core and convert it into an optical signal for output through optical fiber.

[0064] The second optical fiber splitter is used to merge the optical signals output by the two FPGA development boards. Only one FPGA development board outputs a signal at the same time.

[0065] This embodiment also provides a method for high-speed data synchronization and backup of an edge server, comprising: a first optical fiber splitter receives data from an upstream device, divides the data into two paths, and synchronously sends the data to the receiving-end SFP+ optical modules of FPGA0 (i.e., the FPGA main board) and FPGA1 (i.e., the FPGA backup board); a first GTX IP core determines whether the FPGA development board where it is located turns on the input-end SFP+ optical module and receives data based on a heartbeat monitoring signal; and the data received by the input-end SFP+ optical module is sent by the first GTX IP core to the synchronization and backup part.

[0066] Among them, the four-channel buffer composed of the FIFO IP core performs shunt buffering on the received data. Under the control of the MIGIP core, the data is written to the onboard DDR memory through the DDR write buffer; under the control of the synchronization controller, the data in the synchronization buffer and the memory write address are sent to the standby board through the QSFP+ optical module in real time; the synchronization controller transmits heartbeat signals between the two boards in real time through the first SFP+ optical module to control the data input, data output, and the start and termination of data synchronization of the FPGA development board.

[0067] The data output part sequentially reads the cached data from the DDR memory and sends it to the second fiber optic splitter via the output end SFP+ optical module, thereby outputting the data to the downstream device.

[0068] The present invention relates to a data synchronization mechanism, specifically: FPGA0 and FPGA1 respectively input and output data through SFP+ optical modules, send synchronization data and related information such as storage addresses between the two boards through QSFP+ optical modules, and send heartbeat signals to each other through SFP+ optical modules. When the system is operating normally, FPGA0 serves as a main board and FPGA1 serves as a standby board. FPGA0 is responsible for receiving upstream data and caching the data to a specified address of a DDR memory according to a data block of a specified size; at the same time, the data block and the corresponding address are sent to FPGA1 through the QSFP+ optical module, and FPGA1 is backed up to its onboard DDR memory; FPGA0 reads data from the DDR memory in sequence according to the specified size, sends it to a downstream device through the output end SFP+ optical module, and at the same time sends the read address as heartbeat information to FPGA1 through the first SFP+ optical module. When FPGA1 fails and resumes normal operation, that is, when FPGA0 detects that the heartbeat signal disappears and reacquires the heartbeat signal, FPGA0 copies the data in its DDR memory to FPGA1 through the QSFP+ optical module and recovers to a normal state. When FPGA0 fails, FPGA1 detects that the heartbeat disappears, immediately starts the input SFP+ optical module to receive data, and starts to output data to the downstream device from the next address of the DDR read address last synchronized by FPGA0; when FPGA0 resumes normal operation, FPGA1 copies the data in its DDR memory to FPGA0, and FPGA0 starts to receive data. After the data synchronization of the two boards is completed, FPGA1 switches to FPGA0 and starts normal operation.

[0069] The QSFP+ optical module can transmit 4 channels of 10Gbps data simultaneously, with a total transmission speed of 40Gbps; the SFP+ optical module can transmit one channel of 10Gbps data; the system can achieve up to 1GB / s of data transmission, caching and synchronous backup.

[0070] This embodiment also provides an edge server high-speed data synchronization backup method, including the following steps:

[0071] 1. Use the first fiber optic splitter to split the input data signal into two identical signals and send them to the input SFP+ optical modules of the two FPGA development boards;

[0072] 2. Use the QSFP+ optical module to establish a synchronous link between the two boards. The FPGA main board caches the received data into the DDR memory and backs up the data to the FPGA standby board through the synchronous link.

[0073] 3. A heartbeat link is established between the two boards through the first SFP+ optical module. The two boards monitor each other's status through the heartbeat signal and control data synchronization and backup;

[0074] 4. When the FPGA main board fails, the standby board takes over the main board to complete the data output task;

[0075] 5. After the fault is restored, the standby board synchronizes the data to the main board, and the main board resumes its task;

[0076] 6. The FPGA development board responsible for data output sends the data to the second fiber optic splitter through the output SFP+ optical module, and then sends it to the downstream device.

[0077] When it comes to specific implementation, Figure 2 The figure shows the overall framework of a high-speed data synchronization backup method for an edge server provided by this embodiment, and the specific description is as follows:

[0078] S1, data splitting input. Use a 1-to-2 fiber optic splitter, the input end of the splitter is connected to the upstream data transmission line, and the output end is connected to the input SFP+ optical modules of the two FPGA development boards through optical fibers, and the two completely identical optical signals are transmitted to the two development boards respectively;

[0079] S2: Establish a synchronization link between the two boards. The FPGA main board caches the input data and synchronizes the data to the standby board. S2 specifically includes the following sub-steps:

[0080] S21, establish a bidirectional synchronous link between the two boards through QSFP+ optical modules and optical fibers for data synchronization and backup;

[0081] S22, the mainboard FPGA0 receives the data signal from the input SFP+ optical module through the first GTX IP core, and after preliminary processing such as decoding, writes the data into the DDR write buffer and the data synchronization buffer with a width of 32 bits respectively;

[0082] S23, the DDR read / write controller generates a write address, and when the DDR write buffer is full of the specified size, the data block is written to the specified address of the DDR memory through the MIG IP core (the normal reading and writing of the DDR memory is cyclically written and read from the low address to the high address in accordance with the first-in-first-out strategy, and the following places without special instructions are read and written according to this strategy);

[0083] S24, under the control of the synchronization controller, the data in the data synchronization buffer and the corresponding DDR write address are sent to the standby board FPGA1 through the synchronization link in real time;

[0084] S25, FPGA1 receives the synchronized data information, writes the data into the synchronization buffer, and writes the data block of the specified size into the specified address of the DDR memory according to S23.

[0085] S3. Establish a heartbeat link between the two boards, perform real-time heartbeat monitoring, and control the synchronous backup process according to the heartbeat situation. A two-way communication link is established between the two boards through the first SFP+ optical module and the optical fiber, and a heartbeat signal is sent to the other party in real time through this link. If one party does not receive the heartbeat signal, it is determined that the other party has a fault and is processed accordingly. The specific situations are classified as follows:

[0086] S31, if FPGA0 detects that FPGA1 fails, FPGA0 operates normally; when FPGA0 detects that FPGA1 recovers, FPGA0 synchronizes the data in its DDR memory to the DDR memory of FPGA1 through the synchronization link, and resumes normal operation after the backup is completed (refer to S5 for the specific steps);

[0087] S32, if FPGA1 detects that FPGA0 fails, FPGA1 takes over the data cache and output tasks from FPGA0 (see S4 for specific steps); when FPGA1 detects that FPGA0 recovers to normal, the DDR memory data of FPGA1 is synchronized to the DDR memory of FPGA0, and after the synchronization is completed, FPGA0 is responsible for the data output task again (see S5 for specific steps);

[0088] S4: When the main board FPGA0 fails, the standby board FPGA1 takes over the task. The specific steps are as follows:

[0089] S41, FPGA1 fails to obtain the heartbeat signal, and determines that FPGA0 is faulty;

[0090] S42, FPGA1 turns on the input SFP+ optical module to receive upstream data;

[0091] S43, synchronously with S42, FPGA1 turns on the output SFP+ optical module, starts from the last acquired DDR read address of FPGA0, reads data from the DDR memory of FPGA1, and outputs it to the downstream device via the output SFP+ optical module.

[0092] After S5 and FPGA0 recover from the fault, the standby board synchronizes the data to the main board, and the main board resumes the task. Figure 3 As shown, the specific steps are as follows:

[0093] S51, FPGA1 reacquires the heartbeat signal and determines that FPGA0 has returned to normal;

[0094] S52, FPGA1 sends the current DDR write address (WR_ADDR) to FPGA0 through the heartbeat link;

[0095] S53, synchronously with S52, FPGA0 turns on the input SFP+ optical module, starts receiving data, and writes the data to the DDR memory starting from WR_ADDR;

[0096] S54, synchronously with S52, FPGA1 synchronizes the data in the DDR memory to the same position of the DDR memory of FPGA0 in sequence, starting from WR_ADDR and moving toward the lower address, through the synchronization link;

[0097] S55, the synchronization controller determines in real time the DDR read address (rd_addr_out) of the downstream output data of FPGA1 and the DDR read address (rd_addr_sync) of the synchronization data to FPGA0;

[0098] S56, when rd_addr_out and rd_addr_sync are the same (the address is recorded as SYNC_ADDR), it means that the DDR memories of FPGA0 and FPGA1 have been synchronized, FPGA1 sends SYNC_ADDR and synchronization completion signal to FPGA0 through the heartbeat link, and FPGA1 turns off the output and input SFP+ optical modules;

[0099] S57, FPGA0 turns on the output SFP+ optical module, reads the data in the DDR memory normally starting from SYNC_ADDR, and outputs it to the downstream device.

[0100] S6, data output. The specific process is as follows:

[0101] S61, using a 1-to-2 fiber optic splitter, the input end of the splitter is connected to the output SFP+ optical modules of the two FPGA development boards through optical fibers, and the output end of the splitter is connected to the downstream receiving device; according to S2-S5, only one FPGA will output data at the same time, so the data finally output by the splitter is also the data output by only one FPGA, and the two inputs of the splitter will not cause signal conflict;

[0102] S62, FPGA generates a DDR read address through the DDR read / write controller, reads the cached data from the DDR memory sequentially through the MIG IP core, and sends it to the second GTX IP core;

[0103] S63, the second GTX IP core encodes the data and transmits it to the output end SFP+ optical module, which converts it into an optical signal and then outputs it through the optical fiber.

[0104] An edge server high-speed data synchronization backup system and method provided by an embodiment of the present invention at least includes the following technical effects:

[0105] The present invention is based on the Internet of Things technology, and realizes high-speed, stable and continuous data transmission in the edge computing field through high-speed data synchronization and backup. The system involved in the present invention is composed of an FPGA development board, an SFP+ optical module, a QSFP+ optical module, an optical fiber, and an optical fiber splitter, and can be flexibly deployed in edge computing devices. Using FPGA as a master control device, high-speed and parallel data processing can be achieved, flexible configuration is supported, and low power consumption is provided. Using QSFP+ and SFP+ optical modules to transmit data through optical fibers, the speeds can reach 40Gpbs and 10Gbps respectively, which can reduce the delay of data transmission and synchronization. Using an optical fiber splitter, optical signals can be efficiently diverted and converged. As an optical fiber tandem device, it does not require power supply and has the advantages of low cost and low power consumption. The data synchronization mechanism of the present invention can realize high-speed and stable synchronization and backup of data, can realize rapid task switching between dual boards, and greatly reduce the data loss caused by equipment failure.

[0106] Finally, it should be noted that the above specific implementation methods are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to examples, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention, which should be included in the scope of the claims of the present invention.

Claims

1. A high-speed data synchronization backup method for edge servers, It is characterized in that The data from the IoT sensing device is received through the first optical fiber splitter, and the data is divided into two completely identical signals, which are synchronously sent to two FPGA development boards through optical fibers, which are respectively recorded as the FPGA main board and the FPGA standby board; The FPGA main board and the FPGA standby board are interconnected via optical fiber, a synchronization link is established between the two boards via a QSFP+ optical module, and a heartbeat link is established between the two boards via a first SFP+ optical module; the two boards mutually send heartbeat signals via the heartbeat link to perform real-time heartbeat monitoring, select an FPGA development board that performs data caching tasks and data output tasks based on the heartbeat monitoring information, and control the two boards to perform synchronous data backup via the synchronization link; The FPGA development board that performs the data output task transmits the data to the second fiber optic splitter via the optical fiber, and the second fiber optic splitter sends the data to the edge server via the optical fiber; When it is determined based on the heartbeat monitoring information that one party has recovered from the fault, the FPGA development board that performs the data caching task and the data output task synchronizes the data of the board to the FPGA development board that has recovered from the fault; When the FPGA main board recovers from the fault, the FPGA standby board sends the current DDR write address WR_ADDR of the board to the FPGA main board through the heartbeat link; the FPGA main board turns on the input SFP+ optical module, receives upstream data, and writes the data from WR_ADDR to the DDR memory of the board; the FPGA standby board synchronizes the data in the DDR memory of the board to the same position of the DDR memory of the FPGA main board in sequence from WR_ADDR to the lower address direction through the synchronization link; the DDR read address rd_addr_out of the FPGA standby board outputting data to the downstream and the DDR read address rd_addr_out of the FPGA standby board outputting data to the downstream are obtained in real time through the synchronization controller. FPGA mainboard synchronizes data in DDR read address rd_addr_sync; when rd_addr_out and rd_addr_sync are the same, the address is recorded as SYNC_ADDR, indicating that the DDR memories of the FPGA mainboard and the FPGA standby board have been synchronized, and the FPGA standby board sends SYNC_ADDR and synchronization completion signal to the FPGA mainboard through the heartbeat link, and the FPGA standby board turns off the output SFP+ optical module and the input SFP+ optical module of the board; the FPGA mainboard turns on the output SFP+ optical module, reads the data in the DDR memory normally from SYNC_ADDR, and outputs it to the edge server; When the FPGA standby board recovers from a fault, the FPGA main board sends the current DDR write address WR_ADDR of the board to the FPGA standby board through the heartbeat link; The FPGA main board synchronizes the data in the DDR memory of the board to the same position of the DDR memory of the FPGA standby board in sequence, starting from WR_ADDR and moving toward the lower address direction, through the synchronization link; obtains in real time through the synchronization controller the DDR read address rd_addr_out of the FPGA main board outputting data downstream and the DDR read address rd_addr_sync of the FPGA main board synchronizing data to the FPGA standby board; when rd_addr_out and rd_addr_sync are the same, the address is recorded as SYNC_ADDR, indicating that the DDR memories of the FPGA standby board and the FPGA main board have been synchronized, and the FPGA standby board and the FPGA main board have resumed normal working status.

2. According to the edge server high-speed data synchronization backup method of claim 1, It is characterized in that The two FPGA development boards both input data through the input end SFP+ optical module and output data through the output end SFP+ optical module; the FPGA development board receives data when the input end SFP+ optical module is turned on, and outputs data when the output end SFP+ optical module is turned on.

3. According to the edge server high-speed data synchronization backup method of claim 1, It is characterized in that When it is determined based on the heartbeat monitoring information that the FPGA mainboard is operating normally, the FPGA mainboard executes a data caching task and a data output task; When it is determined based on the heartbeat monitoring information that the FPGA main board fails and the FPGA standby board operates normally, the FPGA standby board replaces the FPGA main board to perform data caching tasks and data output tasks; When it is determined based on the heartbeat monitoring information that the FPGA main board fault has been recovered and the FPGA standby board is operating normally, the FPGA standby board synchronizes its cached data to the FPGA main board through the synchronization link, and the FPGA main board resumes executing data caching tasks and data output tasks.

4. The edge server high-speed data synchronization backup method according to claim 3, It is characterized in that When it is determined based on the heartbeat monitoring information that the FPGA main board is operating normally and the FPGA standby board fails, the FPGA main board performs a data caching task and a data output task; When it is determined based on the heartbeat monitoring information that the FPGA main board and the FPGA standby board are operating normally, the FPGA main board performs data caching tasks and data output tasks, and synchronizes its cached data to the FPGA standby board in real time through the synchronization link.

5. The edge server high-speed data synchronization backup method according to claim 4, It is characterized in that When the FPGA main board and the FPGA standby board are operating normally, the FPGA main board receives and decodes the data signal from the input SFP+ optical module through the first GTX IP core, and writes the data to the DDR write buffer and synchronization buffer of the board respectively after the four-channel buffer composed of the FIFO IP core performs shunting buffering; the DDR write address is generated by the DDR read-write controller of the board, and when the DDR write buffer data is filled with a preset size, the data block is written to the specified address of the DDR memory through the MIG IP core; the FPGA main board generates a DDR read address through the DDR read-write controller of the board, and uses the MIG IP core to sequentially read the cached data from the DDR memory, and sends it to the second GTX IP core after being cached by the DDR read buffer of the board; The second GTX IP core encodes the data and transmits it to the output end SFP+ optical module; the FPGA main board sends the data in the synchronization buffer of the board and the corresponding DDR write address to the third GTX IP core in real time and encodes them, and sends them to the FPGA standby board through the synchronization link; after receiving the synchronized data information, the FPGA standby board writes the data into the synchronization buffer of the board, and writes the data block of the preset size into the specified address of the DDR memory of the board; The FPGA main board sends a heartbeat signal to the fourth GTX IP core of the board in real time and encodes it. The heartbeat signal includes the DDR read address of the board and is sent to the FPGA standby board through the heartbeat link. The FPGA standby board sends a heartbeat signal to the fourth GTX IP core of the board in real time and encodes it. The heartbeat information includes the status information of the synchronization buffer of the board and is sent to the FPGA main board through the heartbeat link.

6. The edge server high-speed data synchronization backup method according to claim 5, It is characterized in that When the FPGA backup board replaces the FPGA main board to perform data caching tasks and data output tasks, the FPGA backup board turns on the input SFP+ optical module of the board to receive upstream data; the FPGA backup board turns on the output SFP+ optical module of the board, and starts from the last obtained DDR read address of the FPGA main board, reads data from the DDR memory of the FPGA backup board, and outputs it to the edge server via the output SFP+ optical module.

7. A high-speed data synchronization and backup system for edge servers, It is characterized in that include: A first optical fiber splitter, an FPGA main board, an FPGA backup board, and a second optical fiber splitter; The FPGA main board and the FPGA standby board have the same structure, and each of the FPGA development boards is connected with a first SFP+ optical module, an input SFP+ optical module, an output SFP+ optical module, and a QSFP+ optical module; The input end of the first optical fiber splitter is connected to the IoT sensing device, and the output end of the first optical fiber splitter is respectively connected to the input end SFP+ optical module of the FPGA main board and the input end SFP+ optical module of the FPGA standby board; the output end SFP+ optical module of the FPGA main board and the output end SFP+ optical module of the FPGA standby board are both connected to the input end of the second optical fiber splitter, and the output end of the second optical fiber splitter is connected to the edge server; The edge server high-speed data synchronization and backup system is used to implement the steps in the edge server high-speed data synchronization and backup method according to any one of claims 1 to 4.

8. The edge server high-speed data synchronization backup system according to claim 7, It is characterized in that Each of the FPGA development boards is also connected with: DDR memory, FPGA chip; wherein the cache and control modules running in the FPGA chip include: FIFO, DDR write buffer, synchronization buffer, DDR read and write controller, MIG IP core, DDR read buffer, synchronization controller, first GTX IP core, second GTX IP core, third GTX IP core and fourth GTX IP core; The edge server high-speed data synchronization and backup system is used to implement the steps in the edge server high-speed data synchronization and backup method according to any one of claims 1 to 6.