A 40Gbps high-speed communication system and method based on FPGA
Through the 40Gbps high-speed communication system based on FPGA, using PCI Express, DDR4 multi-frame buffer and JESD204B protocol, the problem that existing communication networks are difficult to support high-speed data transmission is solved, and an efficient and secure 40Gbps communication system is realized.
Patent Information
- Application Number
- CN202111658957.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-30
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2041-12-30
AI Technical Summary
Existing communication networks are difficult to support high-speed data transmission, especially in the explosive growth of data volume caused by the rapid development of the Internet industry, and traditional communication methods are difficult to meet the needs of high transmission rates.
A 40Gbps high-speed communication system based on FPGA is designed, including a host computer, a data adapter, a high-speed baseband board and an AD/DA daughter card, through the PCI Express interface, DDR4 multi-frame buffer, JESD204B protocol and Aurora 64b/66b protocol It realizes high-speed data transmission and signal conversion, and builds a bidirectional 40Gbps communication system from the transmitting end to the receiving end.
It realizes a bidirectional 40Gbps high-speed communication system from the transmitter end to the receiver end, with faster transmission speed than USB 3.0 and higher data security. The effective bit rate of Aurora 64b/66b protocol can reach 96.97%, and a single bandwidth can reach up to 16.375Gbps. Meets the needs of high-speed data communication.
Smart Images

Figure CN114297118B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of high-speed data acquisition, and in particular relates to a 40Gbps high-speed communication system and method based on FPGA. Background Art
[0002] With the rapid development of the Internet industry, more and more terminal devices are connected to the Internet, which leads to an explosive growth in the amount of data. However, the existing communication network is difficult to support the communication of such a large amount of data. It is extremely important to study communication methods with higher transmission rates.
[0003] Due to the advantages of optical fiber such as large communication capacity, long transmission distance, low signal interference, and good transmission quality, optical fiber plays an increasingly important role in the field of communication. As the requirements for hardware speed in industrial systems increase day by day, the requirements for data communication rates between hardware are also getting higher and higher. Therefore, optical fiber is widely used in data exchange between hardware.
[0004] Field Programmable Gate Array, or FPGA, is a relatively mature product of programmable devices after PAL, GAL, and CPLD. Its low latency, high connectivity, and parallel transmission characteristics make FPGA one of the best platforms for achieving high-speed data transmission. Summary of the invention
[0005] In order to achieve the above object, the technical solution of the present invention is as follows: A 40Gbps high-speed communication system based on FPGA, including a host computer and an FPGA part, wherein the FPGA part includes a data transfer board, a high-speed baseband board, a DA daughter card and an AD daughter card, wherein:
[0006] The host computer is connected to the data transfer board, and the host computer includes a parameter setting module and a data drawing module. The parameter setting module selects appropriate parameters to generate frame data, sends data to the data transfer board, and receives control instructions and data from the FPGA part; the data drawing module performs algorithm analysis on the recovered frame data, compares it with the sent data, draws the corresponding constellation diagram, and completes the verification of the communication link;
[0007] The data adapter board includes a PCIE interface and a DDR4 multi-frame buffer; the high-speed baseband board includes an AD_RAM logic module, a DA_RAM logic module, and a JESD204B protocol module. The data adapter board and the high-speed baseband board also include an optical fiber transceiver logic module. The data adapter board communicates with the high-speed baseband board through the optical fiber transceiver logic module, the PCIE interface communicates with the host computer, the DDR4 multi-frame buffer is connected to the PCIE interface, and data is exchanged with the host computer through the PCIE interface. The AD_RAM logic module and the DA_RAM logic module exchange data with the AD subcard and the DA subcard through the JESD204B protocol module.
[0008] Preferably, the PCIE interface communicates with the host computer by reading and writing the AXI bus.
[0009] Preferably, the DDR4 multi-frame buffer is directly connected to the PCIE interface via an AXI Interconnect.
[0010] Preferably, the optical fiber transceiver logic module completes the communication between the data adapter board and the high-speed baseband board through a four-channel SFP interface.
[0011] Preferably, the data exchange between the data adapter board and the high-speed baseband board adopts the Aurora 64b / 66b high-speed serial protocol.
[0012] Based on the above purpose, the present invention also provides a 40Gbps high-speed communication method based on FPGA, using the above-mentioned 40Gbps high-speed communication system based on FPGA, comprising the following steps:
[0013] S1, the host computer sends the frame data and write control instructions to be sent to the DLL program;
[0014] S2, the DLL program calls the PCIE driver to send data and control instructions to the PCIE interface of the data adapter board;
[0015] S3, the PCIE interface stores the received data into the memory space of the corresponding DDR4 multi-frame buffer according to the control instruction;
[0016] S4, after waiting for the host computer to send a write completion control command, the data adapter board converts the frame data into an SFP optical fiber signal, and the optical fiber signal is internally transmitted by the Aurora 64b / 66b protocol;
[0017] S5, sends the SFP optical fiber signal to the high-speed baseband board, and the high-speed baseband board stores the received optical fiber signal in the DA_RAM logic module;
[0018] S6, converts to stream data stream according to the protocol, and the stream data stream is then converted to high-speed serial data by JESD204B high-speed serial protocol and passed to the DA daughter card;
[0019] S7, the DA daughter card converts the digital signal into an analog signal and sends it to the AD daughter card through the FIFO, and the high-speed AD daughter card converts the analog signal into a digital signal and sends it back to the high-speed baseband board;
[0020] S8, the JESD204B protocol converts the high-speed serial data stream into a stream data stream and stores it in the AD_RAM logic module;
[0021] S9, converting the received stream data into optical fiber signals and sending them to the optical fiber transceiver logic module;
[0022] S10, converting the optical fiber signal into frame data through the optical fiber transceiver logic module and storing it in the memory space of the DDR4 multi-frame buffer;
[0023] S11, the data transfer board transmits a read control instruction to the host computer through the PCIE interface;
[0024] S12, after the DLL program receives the read control instruction, the host computer reads the frame data cached in the memory space of the DDR4 multi-frame buffer to the host computer through the PCIE interface;
[0025] S13, the host computer compares the sent and received data to verify whether the data link is open.
[0026] The beneficial effects of the present invention include at least:
[0027] 1. The present invention has relatively complete functions, including QSFP, PCIE, DDR4 memory space and AD / DA daughter card, and builds a complete high-speed communication system with a bidirectional 40Gbps from the transmitting end to the receiving end. It is also equipped with host computer software, which is relatively easy to operate;
[0028] 2. The data exchange between the host computer and the data adapter board of the present invention adopts the PCI Express 3.0X8 standard protocol, and its theoretical communication rate is 8GT / s. The transmission speed is faster than that of USB 3.0, and the data is not easily lost, and the security is higher;
[0029] 3. The data exchange between the data adapter board and the high-speed baseband board of the present invention adopts the Aurora 64b / 66b high-speed serial protocol. The data signal and the SFP optical fiber signal are converted to each other through the Aurora 64b / 66b high-speed serial protocol; the effective code rate of the Aurora64b / 66b protocol can reach 96.97%, and the single-channel bandwidth can reach up to 16.375Gbps. Under the 156.25M clock, each data point is represented by 64 bits, and 4 data points are represented by 256 bits. 256bit*156.25M can reach a data transmission rate of 40Gbps, and a single-channel SFP between the data adapter board and the high-speed baseband board can reach 10Gbps;
[0030] 4. The data exchange between the high-speed baseband board and the AD / DA daughter card of the present invention adopts the JESD204B high-speed serial protocol, which can convert optical fiber signals and stream data flows into each other. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1The overall structural block diagram of the 40Gbps high-speed communication system based on FPGA of the present invention;
[0032] Figure 2 This is a specific structural block diagram of a 40Gbps high-speed communication system based on FPGA of the present invention;
[0033] Figure 3 This is a diagram of the host computer system interface of the FPGA-based 40Gbps high-speed communication system of the present invention;
[0034] Figure 4 This is a waveform diagram of optical fiber logic data acquisition of a 40Gbps high-speed communication system based on FPGA of the present invention;
[0035] Figure 5 This is a waveform diagram of the interaction between optical fiber logic and RAM logic in the FPGA-based 40Gbps high-speed communication system of the present invention;
[0036] Figure 6 This is a diagram of AD / DA signal transmission and reception of a 40Gbps high-speed communication system based on FPGA of the present invention;
[0037] Figure 7 This is a waveform diagram of optical fiber logic recovery data of a 40Gbps high-speed communication system based on FPGA of the present invention;
[0038] Figure 8 This is a constellation diagram of the data transmitted and received by the 40Gbps high-speed communication system based on FPGA of the present invention;
[0039] Fig. 9 This is a diagram of the internal data format conversion of the DLL of the FPGA-based 40Gbps high-speed communication system of the present invention. DETAILED DESCRIPTION
[0040] The preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
[0041] See also Figure 1 , Figure 2 A 40Gbps high-speed communication system based on FPGA includes a host computer 10 and an FPGA part, wherein the FPGA part includes a data transfer board 20, a high-speed baseband board 30, a DA subcard 41 and an AD subcard 42, wherein:
[0042] The host computer 10 is connected to the data transfer board 20. The host computer 10 includes a parameter setting module 11 and a data drawing module 12. The parameter setting module 11 selects appropriate parameters to generate frame data, sends data to the data transfer board 20, and receives control instructions and data from the FPGA part; the data drawing module 12 performs algorithm analysis on the recovered frame data, compares it with the sent data, draws the corresponding constellation diagram, and completes the verification of the communication link;
[0043] The data adapter board 20 includes a PCIE interface 21 and a DDR4 multi-frame buffer 22, and also includes an FPGA chip and its minimum system circuit. This part is not a distinguishing technical feature of the present invention, so it is not repeated; the high-speed baseband board 30 includes an AD_RAM logic module 32, a DA_RAM logic module 31, and a JESD204B protocol module 33. The data adapter board 20 and the high-speed baseband board 30 also include an optical fiber transceiver logic module 23. The data adapter board 20 and the high-speed baseband board 30 communicate with each other through the optical fiber transceiver logic module 23, the PCIE interface 21 communicates with the host computer 10, the DDR4 multi-frame buffer 22 is connected to the PCIE interface 21, and data is exchanged with the host computer 10 through the PCIE interface 21. The AD_RAM logic module 32 and the DA_RAM logic module 31 exchange data with the AD subcard 42 and the DA subcard 41 through the JESD204B protocol module 33.
[0044] In a specific embodiment, the data transfer board 20 may adopt an XCKu040 board, and the high-speed baseband board 30 may adopt an XCVu11p board.
[0045] The PCIE interface 21 communicates with the host computer 10 by reading and writing the AXI bus. The DDR4 multi-frame buffer 22 is directly connected to the PCIE interface 21 via AXIInterconnect. The optical fiber transceiver logic module 23 completes the communication between the data adapter board 20 and the high-speed baseband board 30 through the four-channel SFP interface. The data exchange between the data adapter board 20 and the high-speed baseband board 30 adopts the Aurora 64b / 66b high-speed serial protocol.
[0046] In the above system, the FPGA part is divided into two parts:
[0047] The first is the data transfer board 20 part: the data transfer board 20 includes an XCKu040 board, which has two data paths, one is the memory mapping of the AXI bus, and the other is the register mapping interface of AXI_Lite. Through the former, the PCIE data exchanged between the host computer 10 and the XCKu040 board can be directly mapped to the memory space of the DDR4 multi-frame buffer 22; through the latter, the control instructions exchanged between the host computer 10 and the XCKu040 board are mapped to the AXI_Lite interface, so large data transmission can be achieved through the AXI bus interface, and the transmission of control instructions can be achieved through the AXI_Lite interface. In addition, 4 AXI_GPIOs are added, which are used to transmit write control instructions, transmit the write completion control instructions of the host computer 10, transmit read control instructions, and transmit read completion control instructions. The host computer 10 can monitor these control registers in real time and exchange lightweight data with them, which will not affect the normal PCIE large data stream transmission.
[0048] The second is the high-speed baseband board 30 part: the high-speed baseband board 30 includes an XCVu11p board card, equipped with an AD daughter card 42 and a DA daughter card 41. The data adapter board 20 and the high-speed baseband board 30 are connected through a four-channel fiber optic pluggable transceiver QSFP. The data exchange complies with the Aurora64b / 66b protocol to convert the data signal into a fiber optic signal. The sent fiber optic signal is stored in the DA_RAM logic module 31, and the high-speed data is sent to the DA daughter card 41 through the high-speed serial port via the JESD204B protocol. The DA daughter card 41 converts the digital signal into an analog signal and sends it to the AD daughter card 42 through the FIFO, and converts the analog signal into a digital signal through the high-speed AD daughter card 42 and returns it to the XCVu11p board. The high-speed serial data stream is converted into a stream data stream by the JESD204B protocol and stored in the AD_RAM logic module 32; then the received stream data stream is converted into a fiber optic signal and sent to the fiber optic transceiver logic module 23. The XCKu040 board converts the fiber optic signal into frame data through the fiber optic transceiver logic module 23 and stores it in the memory space of the DDR4 multi-frame buffer 22.
[0049] In the above system, the host computer 10 part is mainly divided into two parts: one is to draw the interface of the host computer 10, and the other is to write a DLL program so that the MATLAB program can call the PCIE driver to send and receive data. The interface of the host computer 10 contains various parameters required to generate frame data and a graphics drawing area. The MATLAB algorithm generates different frame data according to the parameters, and each bit of data is represented by 16 bits. After MATLAB calls the DLL program, the DLL program first splits each bit of the frame data into high 8 bits and low 8 bits, and then sends a write control instruction. The PCIE interface 21 stores the data in the DDR4 memory space according to the write control instruction. After the data is sent, the DLL program sends a write completion control instruction to notify the XCKu040 board that the data has been sent. When the host computer 10 receives data, the XCKu040 board sends a read control instruction to the host computer 10 through the PCIE interface 21. After receiving the instruction, the DLL program starts to read data from the memory space of the DDR4 multi-frame buffer 22. After reading is completed, the DLL program sends a read completion control instruction to the XCKu040 board to notify the hardware host computer 10 that the reading has been completed. The read data is spliced according to the splitting rules, and then the spliced data is returned to the host computer 10. After verifying that the data is correct, the link loop verification is completed.
[0050] The present invention also provides a 40Gbps high-speed communication method based on FPGA, using the above-mentioned 40Gbps high-speed communication system based on FPGA, comprising the following steps:
[0051] S1, the host computer 10 sends the frame data and write control instructions to be sent to the DLL program;
[0052] S2, the DLL program calls the PCIE driver to send data and control instructions to the PCIE interface 21 of the data adapter board 20;
[0053] S3, the PCIE interface 21 stores the received data into the memory space of the corresponding DDR4 multi-frame buffer 22 according to the control instruction;
[0054] S4, after waiting for the host computer 10 to send a write completion control instruction, the data adapter board 20 converts the frame data into an SFP optical fiber signal, and the optical fiber signal is internally transmitted by the Aurora 64b / 66b protocol;
[0055] S5, sending the SFP optical fiber signal to the high-speed baseband board 30, and the high-speed baseband board 30 stores the received optical fiber signal in the DA_RAM logic module;
[0056] S6, converting to stream data stream according to the protocol, and the stream data stream is then converted to high-speed serial data by JESD204B high-speed serial protocol and transmitted to DA daughter card 41;
[0057] S7, the DA daughter card 41 converts the digital signal into an analog signal and sends it to the AD daughter card 42 through the FIFO, and the high-speed AD daughter card 42 converts the analog signal into a digital signal and sends it back to the high-speed baseband board 30;
[0058] S8, converting the high-speed serial data stream into a stream data stream by the JESD204B protocol and storing it in the AD_RAM logic module 32;
[0059] S9, converting the received stream data into an optical fiber signal and sending it to the optical fiber transceiver logic module 23;
[0060] S10, converting the optical fiber signal into frame data through the optical fiber transceiver logic module 23 and storing it in the memory space of the DDR4 multi-frame buffer 22;
[0061] S11, the data transfer board 20 transmits a read control instruction to the host computer 10 through the PCIE interface 21;
[0062] S12, after the DLL program receives the read control instruction, the host computer 10 reads the frame data cached in the memory space of the DDR4 multi-frame buffer 22 to the host computer 10 through the PCIE interface 21;
[0063] S13, the host computer 10 compares the sent and received data to verify whether the data link is open.
[0064] For the host computer 10 interface, see Figure 3The present invention builds a complete high-speed communication system platform with a bidirectional speed of 40Gbps from the transmitting end to the receiving end. First, set appropriate parameters on the upper computer 10 interface, generate the sending data, select the appropriate AXI bus address and GPIO control instructions, and click to send data. After that, the data will be transmitted to the XCKu040 board through the DLL program calling the PCIE driver. The XCKu040 board stores the data in the memory space of the DDR4 multi-frame buffer 22. The optical fiber reads the data from the memory space of the DDR4 multi-frame buffer 22 through the FIFO. See Figure 4 Then the data signal is converted into an SFP optical fiber signal through the Aurora 64b / 66b protocol. The optical fiber signal is transmitted to the XCVu11p board, i.e., the high-speed baseband board 30, through a four-channel optical fiber pluggable transceiver QSFP. After the optical fiber transceiver logic module 23 obtains the data, it needs to interact with the AD_RAM logic module 32 and the DA_RAM logic module 31. See Figure 5 The XCVu11p board stores the received optical fiber signal in the DA_RAM logic module and converts it into a stream data stream according to the protocol. The stream data stream is converted into high-speed serial data by the JESD204B high-speed serial protocol and is passed to the DA daughter card 41. The DA daughter card 41 sends the data signal to the AD daughter card 42 through the FIFO, and the data is converted into a digital signal and returned to the XCVu11p board through the high-speed AD daughter card 42. The data exchange between the high-speed baseband board 30 and the AD daughter card 42 and the DA daughter card 41 is shown in Figure 6 The JESD204B protocol module 33 converts the high-speed serial data stream into a stream data stream and stores it in the AD_RAM logic module 32, and then converts the received stream data stream into an optical fiber signal and sends it to the optical fiber transceiver logic module 23. The XCKu040 board receives the received data through the optical fiber processing logic module and temporarily stores the data in the memory space of the DDR4 multi-frame buffer 22. The optical fiber recovery data can be found in Figure 7 The XCKu040 board, i.e., the data transfer board 20, transmits a read control instruction to the host computer 10 through the PCIE interface 21. After the DLL program receives the read control instruction, the host computer 10 reads the frame data cached in the memory space of the DDR4 multi-frame buffer 22 to the MATLAB host computer 10 through the PCIE interface 21. The data drawing module 12 of the host computer 10 draws a constellation diagram for the received and sent data. The drawing results are shown in Figure 8 Due to the influence of the external environment and the errors in the hardware of the AD subcard 42 and the DA subcard 41, the received and sent data may not be completely consistent. However, the points on the constellation diagram tend to be consistent, so it can be considered that the data has completed a relatively accurate loop in the high-speed communication link.
[0065] The transmission of data of the host computer 10 of the present invention is completed through the DLL program. The driver lays the foundation for building the DLL program. According to the communication process of PCIE reading and writing the memory space of the DDR4 multi-frame buffer 22, a DLL program that can be called by MATLAB is generated, and through actual changes, it can be well combined with the MATLAB algorithm. There are two main functions in the DLL program: a write function and a read function: the function completed by the write function is to read the data and control instructions written into the DDR4 multi-frame buffer 22 provided in the MATLAB algorithm. Because the data read from MATLAB is a 16-bit signed number, and the 8-bit unsigned number is used in PCIE communication, it is necessary to perform negative number conversion and splitting in the write function; the read function is the inverse process of the write function, see Fig. 9 , MATLAB data is transferred from the host computer 10 to the memory space of the DDR4 multi-frame buffer 22 by calling the DLL program.
[0066] In practice, when using the DLL program to receive the read control instruction, the host computer 10 may not be able to receive the control instruction in time, so the program is designed to read the control instruction all the time until the corresponding control instruction is received and then exit the program. If the hardware cannot feedback the control instruction to the host computer 10, the DLL program will continue to perform program detection, causing the host computer 10 program to crash, so a timeout detection is added to the control instruction detection program. If the set detection time of 5 seconds is exceeded, the DLL program automatically exits and returns an error message to MATLAB.
[0067] Finally, it should be noted that the above preferred embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail through the above preferred embodiments, those skilled in the art should understand that various changes can be made in form and details without departing from the scope defined by the claims of the present invention.
Claims
1. A 40Gbps high-speed communication method based on FPGA, characterized in that: The FPGA-based 40Gbps high-speed communication system used includes a host computer and an FPGA part, wherein the FPGA part includes a data transfer board, a high-speed baseband board, a DA daughter card and an AD daughter card, wherein: The host computer is connected to the data transfer board, and the host computer includes a parameter setting module and a data drawing module. The parameter setting module selects appropriate parameters to generate frame data, sends data to the data transfer board, and receives control instructions and data from the FPGA part; the data drawing module performs algorithm analysis on the recovered frame data, compares it with the sent data, draws the corresponding constellation diagram, and completes the verification of the communication link; The data adapter board includes a PCIE interface and a DDR4 multi-frame buffer; the high-speed baseband board includes an AD_RAM logic module, a DA_RAM logic module, and a JESD204B protocol module. The data adapter board and the high-speed baseband board also include an optical fiber transceiver logic module. The data adapter board communicates with the high-speed baseband board through the optical fiber transceiver logic module, the PCIE interface communicates with the host computer, the DDR4 multi-frame buffer is connected to the PCIE interface, and data is exchanged with the host computer through the PCIE interface. The AD_RAM logic module and the DA_RAM logic module exchange data with the AD subcard and the DA subcard through the JESD204B protocol module; The PCIE interface communicates with the host computer by reading and writing the AXI bus; The DDR4 multi-frame buffer is directly connected to the PCIE interface via AXI Interconnect; The optical fiber transceiver logic module completes the communication between the data adapter board and the high-speed baseband board through a four-channel SFP interface; The data exchange between the data adapter board and the high-speed baseband board adopts the Aurora 64b / 66b high-speed serial protocol; The method comprises the following steps: S1, the host computer sends the frame data and write control instructions to be sent to the DLL program; S2, the DLL program calls the PCIE driver to send data and control instructions to the PCIE interface of the data adapter board; S3, the PCIE interface stores the received data into the memory space of the corresponding DDR4 multi-frame buffer according to the control instruction; S4, after waiting for the host computer to send a write completion control command, the data adapter board converts the frame data into an SFP optical fiber signal, and the optical fiber signal is internally transmitted by the Aurora 64b / 66b protocol; S5, sends the SFP optical fiber signal to the high-speed baseband board, and the high-speed baseband board stores the received optical fiber signal in the DA_RAM logic module; S6, converts to stream data stream according to the protocol, and the stream data stream is then converted to high-speed serial data by JESD204B high-speed serial protocol and passed to the DA daughter card; S7, the DA daughter card converts the digital signal into an analog signal and sends it to the AD daughter card through the FIFO, and the high-speed AD daughter card converts the analog signal into a digital signal and sends it back to the high-speed baseband board; S8, the JESD204B protocol converts the high-speed serial data stream into a stream data stream and stores it in the AD_RAM logic module; S9, converting the received stream data into optical fiber signals and sending them to the optical fiber transceiver logic module; S10, converting the optical fiber signal into frame data through the optical fiber transceiver logic module and storing it in the memory space of the DDR4 multi-frame buffer; S11, the data transfer board transmits a read control instruction to the host computer through the PCIE interface; S12, after the DLL program receives the read control instruction, the host computer reads the frame data cached in the memory space of the DDR4 multi-frame buffer to the host computer through the PCIE interface; S13, the host computer compares the sent and received data to verify whether the data link is open.
Citation Information
Patent Citations
Point-to-point industrial series real-time communication system based on optical fibre and its control method
CN101047447A
Remote sensing data entry processing structure based on FPGA system
CN103678206A
Multi-channel broadband signal high-speed acquisition and transmission system based on JESD204B protocol
CN107145299A
Inter-board image real-time transmission system based on optical fibers
CN111464799A
Distributed data transmission system and method based on FPGA
CN112947156A
