Transaction data processing method, apparatus and electronic device

Abstract

The application relates to the computer technical field, in particular to a transaction data processing method and device and electronic equipment. The method comprises the following steps: obtaining original transaction data, and performing hardware decoding processing on the original transaction data to obtain hardware decoding data; determining transmission information and recording processing time corresponding to the hardware decoding data; the transmission information is transmission information of a fiber interface corresponding to a DPU network card; performing strategy calculation processing on the hardware decoding data according to a preset strategy to generate a transaction order; transmitting the hardware decoding data and the processing time to a software monitoring system and transmitting the transaction order to a software order system through the fiber interface according to the transmission information; the software monitoring system is used for monitoring the processing performance of the transaction data according to the hardware decoding data and the processing time, and adjusting the transmission information according to the processing performance. The application can improve the accuracy and real-time performance of monitoring the transaction data processing link performance.

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to a transaction data processing method, apparatus and electronic device. Background Technology

[0002] In high-frequency quantitative futures trading, high latency is typically required in the trading data processing chain to ensure timely access to real-time market information. Therefore, monitoring the performance of the trading data processing chain is crucial.

[0003] Currently, the typical method for monitoring the performance of transaction data processing links is to capture transaction data packets at the network layer and then use relevant software to parse and analyze these packets to obtain the performance information of each link in the transaction data processing chain. However, this packet capture analysis method usually has a certain lag, and because the packet capture tools used to capture transaction data packets typically consume some network bandwidth, the data transmission speed of the main path (the path through which transaction data packets are transmitted) decreases, which also has a certain impact on the performance of the transaction data processing link. Summary of the Invention

[0004] To address the aforementioned technical problems, this application provides a transaction data processing method, apparatus, and electronic device that can improve the accuracy and real-time performance of monitoring the transaction data processing link.

[0005] In a first aspect, this application provides a transaction data processing method applied to a DPU network card, comprising: acquiring raw transaction data and performing hardware decoding processing on the raw transaction data to obtain hardware decoded data; determining transmission information and recording the processing time corresponding to the hardware decoded data; the transmission information being the transmission information of the fiber optic interface corresponding to the DPU network card; performing strategy calculation processing on the hardware decoded data according to a preset strategy to generate a transaction report; transmitting the hardware decoded data and processing time to a software monitoring system through the fiber optic interface according to the transmission information, and transmitting the transaction report to a software reporting system; the software monitoring system is used to monitor the processing performance of the transaction data according to the hardware decoded data and processing time, and adjust the transmission information according to the processing performance.

[0006] Secondly, this application provides a transaction data processing device applied to a DPU network card, comprising: an acquisition module for acquiring raw transaction data and performing hardware decoding processing on the raw transaction data to obtain hardware decoded data; a determination module for determining transmission information and recording the processing time corresponding to the hardware decoded data; the transmission information is the transmission information of the fiber optic interface corresponding to the DPU network card; a processing module for performing strategy calculation processing on the hardware decoded data according to a preset strategy to generate a transaction report; and a transmission module for transmitting the hardware decoded data and processing time to a software monitoring system through the fiber optic interface according to the transmission information, and transmitting the transaction report to a software reporting system; the software monitoring system is used to monitor the processing performance of the transaction data according to the hardware decoded data and processing time, and adjust the transmission information according to the processing performance.

[0007] Thirdly, this application provides a transaction data processing method applied to a software monitoring system, comprising: receiving hardware decoding data and processing time from a DPU network card; the hardware decoding data is obtained by decoding the original transaction data, and the processing time is the processing time corresponding to the hardware decoding data; performing performance analysis processing on the hardware decoding data and processing time to obtain a processing result; adjusting the transmission information according to the processing result; the transmission information is the transmission information of the fiber optic interface corresponding to the DPU network card.

[0008] Fourthly, this application provides a transaction data processing device for use in a software monitoring system, comprising: a receiving module for receiving hardware decoding data and processing time from a DPU network card; the hardware decoding data is obtained by decoding the original transaction data, and the processing time is the processing time corresponding to the hardware decoding data; an analysis module for performing performance analysis on the hardware decoding data and processing time to obtain processing results; and an adjustment module for adjusting transmission information according to the processing results; the transmission information is the transmission information of the fiber optic interface corresponding to the DPU network card.

[0009] Fifthly, this application provides an electronic device, including: a DPU network card, a processor, a memory, programmable logic loaded on the DPU network card, and a computer program stored in the memory and executable on the processor. When the programmable logic is executed by the DPU network card, it implements the transaction data processing method of the first aspect, or when the computer program is executed by the processor, it implements the transaction data processing method of the third aspect.

[0010] In a sixth aspect, this application provides a computer-readable storage medium, comprising: storing a computer program on the computer-readable storage medium, wherein the computer program, when executed by a processor, implements the transaction data processing method as described in the third aspect.

[0011] In a seventh aspect, this application provides a computer program product, comprising: when the computer program product is run on a computer, causing the computer to implement the transaction data processing method as described in the third aspect.

[0012] The technical solution provided in this application has the following advantages compared with the prior art: First, the DPU network card acquires the original transaction data and performs hardware decoding processing on the original transaction data to obtain hardware decoded data. Then, it determines the transmission information and records the processing time corresponding to the hardware decoded data. The transmission information is the transmission information of the fiber optic interface corresponding to the DPU network card. Next, it performs strategy calculation processing on the hardware decoded data according to a preset strategy to generate a transaction report. Then, the DPU network card transmits the hardware decoded data and processing time to the software monitoring system through the fiber optic interface according to the transmission information, and also transmits the transaction report to the software reporting system. Then, the software monitoring system receives the hardware decoded data and processing time from the DPU network card, performs performance analysis processing on the hardware decoded data and processing time, obtains the processing result, and finally, the software monitoring system adjusts the transmission information according to the processing result. In this way, the DPU network card can first record the processing time corresponding to the hardware decoded data and directly transmit this processing time to the software monitoring system, avoiding the lag in performance monitoring caused by using related software to decode and analyze the time after packet capture, thus improving the real-time performance of the monitored transaction data processing link. Secondly, the system enables direct transmission of hardware decoding data, processing time, and transaction reports at the physical layer via the fiber optic interface. This avoids the risk of information leakage that may arise from traditional methods using protocols such as Transmission Control Protocol (TCP) and User Datagram Protocol (UDP) to transmit transaction data at the network layer, thus improving transmission security and speed. Furthermore, it ensures the real-time performance and accuracy of the monitored transaction data processing link. Finally, the software monitoring system can dynamically adjust the transmission information of the DPU network card's fiber optic interface based on the obtained hardware decoding data and processing time, enhancing the flexibility and controllability of transaction data processing. Attached Figure Description

[0013] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0014] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 This is one of the application scenario diagrams of a transaction data processing method provided in the embodiments of this application;

[0016] Figure 2 This is a second schematic diagram illustrating an application scenario of a transaction data processing method provided in an embodiment of this application.

[0017] Figure 3 One of the flowcharts illustrating the transaction data processing method provided in the embodiments of this application;

[0018] Figure 4 This is a schematic diagram of the structure of a DPU network card provided in an embodiment of this application;

[0019] Figure 5 A second schematic flowchart illustrating the transaction data processing method provided in this application embodiment;

[0020] Figure 6 The third flowchart illustrating the transaction data processing method provided in this application embodiment;

[0021] Figure 7 The fourth flowchart illustrating the transaction data processing method provided in this application embodiment;

[0022] Figure 8 Fifth flowchart illustrating the transaction data processing method provided in this application embodiment;

[0023] Figure 9 A flowchart illustrating the transaction data processing method provided in this application embodiment is shown in Figure 6.

[0024] Figure 10 This is one of the structural schematic diagrams of the transaction data processing apparatus provided in the embodiments of this application;

[0025] Figure 11 This is a second schematic diagram of the structure of the transaction data processing device provided in the embodiments of this application;

[0026] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0027] To better understand the above-mentioned objectives, features, and advantages of this application, the solution of this application will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described in these embodiments can be combined with each other.

[0028] Many specific details are set forth in the following description in order to provide a full understanding of this application, but this application may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some embodiments of this application, and not all embodiments.

[0029] Figure 1 This is a schematic diagram of a scenario architecture for a transaction data processing method provided in an embodiment of this application. Figure 1 As shown, the scenario architecture provided in this application embodiment includes: server 100 and electronic device 200.

[0030] The electronic device 200 provided in this application embodiment can have various implementation forms, such as mobile phone, personal computer (PC), smart TV, laser projection device, television, monitor, wearable device, vehicle device, electronic table, etc.

[0031] In some embodiments, when the electronic device 200 receives a transaction data processing instruction, it can communicate with the server 100. The electronic device 200 may communicate with the server 100 via a local area network (LAN) or a wireless local area network (WLAN).

[0032] In some embodiments, server 100 may be a server that provides various services, such as a server that supports hardware decoding data decoded by electronic device 200. Server 100 may perform policy calculations on the hardware decoding data and feed the processing results back to electronic device 200. Server 100 may be a server cluster or multiple server clusters, and may include one or more types of servers.

[0033] It should be noted that the transaction data processing method provided in this application embodiment can be executed by server 100, electronic device 200, or jointly by server 100 and electronic device 200. This application does not limit this.

[0034] Figure 2 This is a schematic diagram of a scenario architecture for another transaction data processing method provided in an embodiment of this application. For example... Figure 2 As shown, the scenario architecture provided in this application embodiment includes: exchange 300, DPU network card 400, software monitoring system 500, and software reporting system 600.

[0035] In some embodiments, when the DPU network card 400 receives a transaction data processing instruction, it can communicate with the exchange 300, the software monitoring system 500, and the software order placement system 600. For example, the DPU network card 400 can communicate with the exchange 300 via LAN or WLAN; the DPU network card 400 can communicate with the software monitoring system 500 and the software order placement system 600 via a fiber optic interface.

[0036] In some embodiments, Exchange 300 may be a platform for providing trading of financial assets (such as stocks, bonds, futures, foreign exchange, cryptocurrencies, etc.) for both buyers and sellers.

[0037] The transaction data processing method provided in this application embodiment can be jointly executed by the exchange 300, DPU network card 400, software monitoring system 500, and software order placement system 600.

[0038] In some embodiments, the DPU network card 400 may be the DPU network card of the server 100 or the DPU network card of the electronic device 200.

[0039] In some embodiments, the software monitoring system 500 and the software reporting system 600 may be located simultaneously in the server 100, or simultaneously in the electronic device 200, or there may be one server 100 and one electronic device 200. This application does not limit this.

[0040] The transaction data processing method provided in this application can be executed by a transaction data processing device, which can be hardware or software. When the transaction data processing device is hardware, it can be various electronic devices with transaction data processing functions, including but not limited to mobile phones, computers, tablets, televisions, smart TVs, in-vehicle devices, smart vehicles, laser projection devices, monitors, electronic bulletin boards, electronic tables, etc. When the transaction data processing device is software, it can be installed in the above-listed electronic devices. It can be implemented as multiple software programs or software modules, or as a single software program or software module. No specific limitations are made here.

[0041] Figure 3 This is a flowchart illustrating the transaction data processing method provided in the embodiments of this application, as shown below. Figure 3 As shown, the transaction data processing method may include the following steps:

[0042] The S11 and DPU network cards acquire the raw transaction data and perform hardware decoding on the raw transaction data to obtain hardware decoded data.

[0043] First, obtain the raw trading data. This raw trading data can be market data corresponding to high-frequency quantitative futures trading.

[0044] Specifically, the DPU network card can obtain raw trading data corresponding to high-frequency quantitative trading in futures from the exchange. For example, in... Figure 2 In the scenario shown, the DPU network card 400 can establish internet communication with the exchange 300 and obtain raw transaction data from the exchange 300.

[0045] Secondly, the original transaction data is hardware decoded to obtain hardware decoded data.

[0046] Specifically, a hardware decoding acceleration module can be generated using a Field-Programmable Gate Array (FPGA) and loaded onto the DPU network card to perform hardware decoding processing on the original transaction data, thereby obtaining hardware decoded data and improving the decoding speed of the original transaction data.

[0047] S12 and DPU network cards determine the transmission information and record the processing time corresponding to the hardware decoding data.

[0048] First, determine the transmission information. This transmission information refers to the transmission information of the fiber optic interface corresponding to the DPU network card.

[0049] Specifically, the method for determining the transmission information can be to read the transmission information from the target register in real time. The transmission information in the target register is pre-stored. The target register is a register of the DPU network card, used to store data that the DPU network card needs to access quickly during data processing, such as transmission information.

[0050] Secondly, record the processing time corresponding to the hardware decoding data.

[0051] Specifically, a timestamp capture module can be generated using an FPGA and loaded onto the DPU network card to capture and record the corresponding timestamps at various stages of the transaction data processing link.

[0052] The S13 and DPU network cards perform strategy calculations on the hardware decoding data according to preset strategies to generate transaction reports.

[0053] The preset strategy is pre-written and is used to guide the generation of transaction orders.

[0054] Specifically, a hardware strategy module can be generated using an FPGA and loaded onto the DPU network card to make decisions and report data based on a preset strategy for hardware decoding.

[0055] The S14 and DPU network cards transmit transaction orders to the software reporting system via fiber optic interfaces based on the transmission information.

[0056] The transmission information includes at least interface information and path information for transmitting transaction reports. The interface information indicates the optical fiber interface for transmitting transaction reports, and the path information indicates the path corresponding to the optical fiber interface for transmitting transaction reports.

[0057] Specifically, the method of transmitting transaction orders to the software reporting system through the fiber optic interface based on the transmission information can be that the transaction order is transmitted from the fiber optic interface to the software reporting system based on the transmission information.

[0058] The S15 and DPU network cards transmit hardware decoding data and processing time to the software monitoring system through the fiber optic interface based on the transmitted information.

[0059] The software monitoring system monitors the processing performance of transaction data based on hardware decoding data and processing time, and adjusts transmission information accordingly. The transmission information includes at least interface information and path information for transmitting hardware decoding data and processing time. The interface information indicates the fiber optic interface used for transmitting hardware decoding data and processing time, and the path information indicates the path corresponding to the fiber optic interface used for transmitting hardware decoding data and processing time.

[0060] Specifically, the method of transmitting hardware decoding data and processing time to the software monitoring system through the fiber optic interface based on the transmission information can be that the hardware decoding data and processing time are transmitted to the software monitoring system from the path corresponding to the fiber optic interface based on the transmission information.

[0061] S21. The software monitoring system performs performance analysis on the hardware decoding data and processing time to obtain the processing results.

[0062] Specifically, after receiving the hardware decoding data and processing time, the software monitoring system checks the legality and correctness of the transaction data based on the hardware decoding data, such as whether the transaction time is reasonable and whether the transaction price is correct; and determines the performance of each stage of the transaction data processing link based on the processing time.

[0063] S22. The software monitoring system adjusts the transmitted information based on the processing results.

[0064] The transmission information refers to the transmission information of the fiber optic interface corresponding to the DPU network card.

[0065] Specifically, the software monitoring system adjusts the way information is transmitted based on the processing results. This can be achieved by adjusting the allocation of channel resources in the transmission information based on the performance of each stage of the transaction data processing link.

[0066] In the above scheme, firstly, the DPU network card acquires the raw transaction data and performs hardware decoding to obtain hardware-decoded data. Then, it determines the transmission information and records the processing time corresponding to the hardware-decoded data. The transmission information refers to the transmission information of the fiber optic interface corresponding to the DPU network card. Next, it performs strategy calculations on the hardware-decoded data according to a preset strategy to generate a transaction report. Then, the DPU network card transmits the hardware-decoded data and processing time to the software monitoring system via the fiber optic interface, and also transmits the transaction report to the software reporting system. The software monitoring system then receives the hardware-decoded data and processing time from the DPU network card, performs performance analysis on the hardware-decoded data and processing time, obtains the processing result, and finally adjusts the transmission information based on the processing result. In this way, the DPU network card can record the processing time corresponding to the hardware-decoded data and directly transmit this processing time to the software monitoring system, avoiding the performance monitoring lag caused by capturing packets and then using related software for decoding and analysis, thus improving the real-time performance monitoring of the transaction data processing link. Secondly, the system enables direct transmission of hardware decoding data, processing time, and transaction reports at the physical layer via the fiber optic interface. This avoids the risk of information leakage that may arise from traditional methods using protocols such as Transmission Control Protocol (TCP) and User Datagram Protocol (UDP) to transmit transaction data at the network layer, thus improving transmission security and speed. Furthermore, it ensures the real-time performance and accuracy of the monitored transaction data processing link. Finally, the software monitoring system can dynamically adjust the transmission information of the DPU network card's fiber optic interface based on the obtained hardware decoding data and processing time, enhancing the flexibility and controllability of transaction data processing.

[0067] In some embodiments, the DPU network card records the processing time corresponding to the hardware decoding data in the following ways: the DPU network card records the start time of receiving the original transaction data, the end time of receiving the data, the start time of decoding the data, and the end time of decoding the data; the start time of transmitting the hardware decoding data and the end time of transmitting the transaction report.

[0068] Specifically, a timestamp extraction module can be used to extract corresponding timestamps at various stages of the transaction data processing chain. For example, when receiving raw transaction data, the timestamp extraction module extracts the start time of reception; when receiving raw transaction data ends, it extracts the end time of reception. When decoding raw transaction data begins, it extracts the start time of decoding; when decoding raw transaction data ends, it extracts the end time of decoding. When hardware decoding data transmission begins, it extracts the start time of transmission; when hardware decoding data transmission ends, it extracts the end time of transmission. When transaction report transmission begins, it extracts the start time of transmission; when transaction report transmission ends, it extracts the end time of transmission.

[0069] In the above solution, the processing time of each processing stage corresponding to the hardware decoding data can be recorded through the DPU network card, so that the processing time can be directly transmitted to the software monitoring system in the future. This avoids the performance monitoring lag caused by using relevant software to decode and analyze the time after packet capture, and improves the real-time performance of the transaction data processing link.

[0070] In some embodiments, the transmission information includes first transmission information and second transmission information; the first transmission information is transmission information of a first fiber optic interface, and the second transmission information is transmission information of a second fiber optic interface. For example, in... Figure 4 The DPU network card shown uses an FPGA board based on the Kernel Processing Unit (KPU) architecture, including two fiber optic interfaces, fiber optic interface 1 and fiber optic interface 2, to implement the transaction data processing method of this application.

[0071] In some embodiments, the first fiber optic interface and the second fiber optic interface simultaneously support uplink and downlink data transmission, and support data transmission at a speed not less than a bandwidth threshold. The bandwidth threshold is preset, for example, a default value, or a value set by relevant personnel based on actual conditions. For example, the bandwidth threshold could be 10G.

[0072] like Figure 5 As shown, the DPU network card transmits hardware decoding data and processing time to the software monitoring system via the fiber optic interface, and transmits transaction orders to the software reporting system, which may include the following steps:

[0073] S141 and DPU network cards transmit hardware decoding data and processing time to the software monitoring system through the first optical fiber interface according to the first transmission information.

[0074] Specifically, the DPU network card transmits the hardware decoding data and processing time from the path corresponding to the first fiber optic interface to the software monitoring system based on the first transmission information.

[0075] S151 and DPU network cards transmit transaction orders to the software reporting system through the second fiber optic interface based on the second transmission information.

[0076] Specifically, the DPU network card transmits the transaction order from the path corresponding to the second fiber optic interface to the software reporting system based on the second transmission information.

[0077] In the above scheme, the DPU network card transmits hardware decoding data and processing time to the software monitoring system through the first fiber optic interface based on the first transmission information, and transmits transaction orders to the software order reporting system through the second fiber optic interface based on the second transmission information. This solves the problem of excessive latency caused by pure software and network layer data transmission in high-frequency futures trading scenarios by using two fiber optic interfaces to connect the hardware and software. Furthermore, using a single fiber optic interface to transmit transaction orders achieves a transmission latency as low as hundreds of nanoseconds, while the other fiber optic interface handles the transmission of hardware decoding data and processing time, thus isolating performance monitoring and transaction order reporting hardware and ensuring the transmission quality of transaction orders, hardware decoding data, and processing time.

[0078] In some embodiments, the transmission information includes data path information for transmitting hardware decoding data, time path information for transmitting processing time, and order path information for transmitting transaction orders. For example... Figure 6 As shown, the method by which the DPU network card transmits hardware decoding data and processing time to the software monitoring system and transaction orders to the software reporting system may include the following steps:

[0079] S142, the DPU network card determines at least one data path based on the data path information, and transmits the hardware decoded data from at least one data path to the software monitoring system.

[0080] Specifically, the DPU network card transmits hardware decoded data to the software monitoring system from at least one data path by streaming the hardware decoded data across at least one data path. The type of hardware decoded data transmitted in each data path is configurable; for example, one type of hardware decoded data can be transmitted in one data path, or multiple types of hardware decoded data can be transmitted in one data path, or one type of hardware decoded data can be transmitted in multiple data paths, or multiple types of hardware decoded data can be transmitted in multiple data paths.

[0081] The types of hardware decoding data can be categorized according to the transaction type they correspond to, such as grouping hardware decoding data for the same item into the same type, or grouping hardware decoding data for the same price into the same type; alternatively, they can be categorized according to the account type they correspond to, for example, different accounts may have different hardware decoding data. This application does not limit the scope of the categorization.

[0082] S142, the DPU network card determines at least one time path based on the time path information, and transmits the processing time from at least one time path to the software monitoring system.

[0083] Specifically, the DPU network card transmits processing time from at least one time path to the software monitoring system by streaming the processing time across at least one time path. The type of processing time transmitted in each time path is configurable; for example, one type of processing time can be transmitted in one time path, or multiple types of processing time can be transmitted in one time path, or one type of processing time can be transmitted across multiple time paths, or multiple types of processing time can be transmitted across multiple time paths.

[0084] The type of processing time can correspond to the type of hardware decoded data, that is, the type of hardware decoded data corresponding to the processing time is determined as the type of processing time.

[0085] S142 and DPU network cards determine at least one order channel based on the order channel information and transmit the transaction order from at least one order channel to the software order system.

[0086] Specifically, the DPU network card transmits transaction orders from at least one order path to the software order processing system by streaming the transaction orders across at least one order path. The type of transaction order transmitted in each order path is configurable; for example, one type of transaction order can be transmitted in one order path, or multiple types of transaction orders can be transmitted in one order path, or one type of transaction order can be transmitted across multiple order paths, or multiple types of transaction orders can be transmitted across multiple order paths.

[0087] The classification method for transaction order types can be the same as the classification method for hardware decoding data types, which will not be elaborated here.

[0088] In the above solution, the DPU network card can transmit transaction reports, hardware decoding data, and processing time through different channels of different fiber optic interfaces according to the data path information, time path information, and report path information in the transmission information. This enables hardware isolation between performance monitoring and transaction reporting, ensuring the transmission quality of transaction reports, hardware decoding data, and processing time.

[0089] In some embodiments, the DPU network interface card (NIC) transmits hardware decoding data and processing time to the software monitoring system and transaction reports to the software reporting system. This includes ensuring that the size of each transmitted data item is less than or equal to one cache. For example, when the cache size is 128 bytes, the data size of each transmitted data item corresponding to a transaction report is 128 bytes; the data size of each transmitted data item corresponding to hardware decoding data is 64 bytes; and the data size of each transmitted data item corresponding to processing time is 64 bytes.

[0090] In some embodiments, hardware decoding data may include information such as target number, processing time, transaction volume, transaction amount, and buy / sell price; processing time may include information such as reception start time, reception end time, decoding start time, decoding end time, transmission start time, transmission end time, transmission start time, and transmission end time; transaction report may include information such as target number, business time, transaction volume, transaction amount, buy / sell price, and quantity.

[0091] In the above solution, the DPU network card can keep the data size within a cache during the transmission of transaction reports, hardware decoding of data, and processing time. This avoids the problem of complex data processing by software providers (such as software monitoring systems and software reporting systems) due to large differences in the size of data transmitted in the path, thus improving the efficiency of software data processing.

[0092] In some embodiments, such as Figure 7 As shown, after transmitting hardware decoding data and processing time to the software monitoring system, the transaction data processing method further includes the following steps:

[0093] S16, the DPU network card reads new transmission information from the target register.

[0094] The transmission information in the target register is the transmission information adjusted according to the hardware decoded data and processing time.

[0095] Specifically, the target register can include the identifier (data_type_id) of the module responsible for transmitting transaction reports, processing time, and hardware decoding data for each DPU network card. This way, when the DPU network card reads new transmission information from the target register, it can obtain the transmission information configured for each module based on the identifier.

[0096] When the new transmission information differs from the original transmission information, the S17 and DPU network cards transmit new hardware decoding data, new processing time, and new transaction reports according to the new transmission information.

[0097] In the above scheme, the DPU network card reads new transmission information from the target register. When the new transmission information differs from the existing transmission information, it transmits new hardware decoding data, new processing time, and new transaction reports according to the new transmission information. In this way, the transmission method of new hardware decoding data, new processing time, and new transaction reports can be dynamically adjusted according to the content stored in the target register, improving the flexibility and controllability of transaction data processing.

[0098] In some embodiments, the processing time includes the start time of receiving the original transaction data, the end time of receiving the data, the start time of decoding, the end time of decoding, the start time of transmitting the hardware decoded data, the end time of transmitting the transaction report, and the start time of transmitting the transaction report, wherein the transaction report is generated based on the hardware decoded data. Figure 8 As shown, the software monitoring system performs performance analysis on hardware decoding data and processing time to obtain the processing results, which may include the following steps:

[0099] S211. The software monitoring system calculates the reception duration of the original transaction data based on the reception start time and reception end time.

[0100] Specifically, the difference between the end time and the start time of reception is determined as the reception duration of the original transaction data.

[0101] S212. The software monitoring system calculates the decoding duration of the original transaction data based on the decoding start time and decoding end time.

[0102] Specifically, the difference between the end time and the start time of decoding is determined as the decoding time of the original transaction data.

[0103] S213. The software monitoring system calculates the data transmission duration of the hardware decoded data based on the start and end times of transmission.

[0104] Specifically, the difference between the end time and the start time of transmission is determined as the data transmission duration for hardware decoding.

[0105] S214. The software monitoring system calculates the transmission duration of the transaction order based on the transmission start time and transmission end time.

[0106] Specifically, the difference between the end time and the start time of the transmission is determined as the transmission duration of the transaction order.

[0107] S215. The software monitoring system detects whether the hardware decoding data is abnormal according to preset rules and obtains the detection results.

[0108] Among them, the preset rules are obtained in advance and may include the transaction price range of goods, the normal transaction time range, etc., which are used to detect the rationality and correctness of the transaction.

[0109] In the above solution, the software monitoring system can perform performance analysis on the processing time of the DPU network card transmission and the hardware decoding data to obtain the duration of each stage of the transaction data processing link and the detection results. This allows relevant personnel to understand the performance of each stage of the transaction data processing link in a timely manner, improving the real-time performance and accuracy of monitoring the transaction data processing link performance.

[0110] In some embodiments, the transmission information includes the number of data paths for transmitting hardware decoding data, the number of time paths for transmitting processing time, and the number of order paths for transmitting transaction orders. The software monitoring system adjusts the transmission information based on the processing results, which may involve reducing the first number and / or increasing the second number when the order transmission time exceeds a first threshold. Here, the first number is the number of data paths or time paths; the second number is the number of order paths. The first threshold is preset, for example, a default value, or a value set by relevant personnel based on actual conditions.

[0111] In some embodiments, reducing the first quantity and / or increasing the second quantity can be achieved by changing the transmission information in the target register. For example, the second quantity can be changed by changing the value corresponding to the identifier of the module responsible for transmitting transaction orders in the target register; the number of time paths in the first quantity can be changed by changing the value corresponding to the identifier of the processing time module; and the number of data paths in the first quantity can be changed by changing the value corresponding to the identifier of the hardware decoding data module.

[0112] In the above scheme, the software monitoring system can dynamically adjust the number of order channels, data channels, and time channels according to the order transmission time, thereby improving the flexibility and controllability of transaction data processing.

[0113] In some embodiments, such as Figure 9 As shown, after obtaining the processing result, the transaction data processing method also includes the following steps:

[0114] S23. When the detection results show that the hardware decoding data is abnormal, the software monitoring system sends the first prompt message.

[0115] The first notification message is used to indicate abnormal transaction data.

[0116] For example, when an unreasonable transaction time is detected for a certain transaction order, a first prompt message is sent to indicate that the transaction time of the transaction order is abnormal; when an excessively high or low price is detected for a certain transaction order, a first prompt message is sent to indicate that the transaction price of the transaction order is abnormal.

[0117] S24. When the target duration exceeds the second threshold, the software monitoring system sends a second prompt message.

[0118] The second prompt message is used to indicate an abnormality in the processing stage corresponding to the target duration; the target duration is any one of the receiving duration, decoding duration, data transmission duration, and report transmission duration.

[0119] In some embodiments, the second thresholds corresponding to the receiving duration, decoding duration, data transmission duration, and report transmission duration may be the same or different, and the second threshold corresponding to the report transmission duration is greater than the first threshold.

[0120] In the above solution, the software monitoring system can promptly issue prompts when there are abnormalities in hardware decoding data, or when there are any abnormalities in the receiving time, decoding time, data transmission time, or report transmission time. This avoids the problem of abnormalities in the transaction data processing link not being reported, ensures that each stage of the transaction data processing link can operate normally, and improves the overall stability of the system.

[0121] In some embodiments, before determining the transmission information, the transaction data processing method further includes initializing hardware resources. Specifically, the hardware resources can be initialized by enabling and disabling the target register address corresponding to each path descriptor, and determining whether the path transmission is a transaction report, processing time, or hardware decoded data based on the data_type_id.

[0122] In some embodiments, after hardware decoding of the original transaction data to obtain hardware decoded data, the transaction data processing method further includes copying the hardware decoded data and using the copied hardware decoded data for the software monitoring system to monitor the performance of each stage of the transaction data processing link.

[0123] This application embodiment can divide the transaction data processing device into functional modules according to the above method example. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing unit. The integrated modules can be implemented in hardware or as software functional modules. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0124] like Figure 10 The diagram shows a transaction data processing apparatus provided in an embodiment of this application, applied to a DPU network card. The transaction data processing apparatus includes an acquisition module 81, a determination module 82, a processing module 83, and a transmission module 84.

[0125] The acquisition module 81 is used to acquire raw transaction data and perform hardware decoding processing on the raw transaction data to obtain hardware decoded data; the determination module 82 is used to determine the transmission information and record the processing time corresponding to the hardware decoded data; the transmission information is the transmission information of the fiber optic interface corresponding to the DPU network card; the processing module 83 is used to perform strategy calculation processing on the hardware decoded data according to a preset strategy to generate a transaction report; the transmission module 84 is used to transmit the hardware decoded data and processing time to the software monitoring system through the fiber optic interface according to the transmission information, and to transmit the transaction report to the software reporting system; the software monitoring system is used to monitor the processing performance of the transaction data according to the hardware decoded data and processing time, and adjust the transmission information according to the processing performance.

[0126] In some embodiments, the determining module 82 includes a recording submodule; the recording submodule is used to record the start time of receiving the original transaction data, the end time of receiving the data, the start time of decoding the data, and the end time of decoding the data; the start time of transmitting the hardware decoded data and the end time of transmitting the transaction report.

[0127] In some embodiments, the transmission information includes first transmission information and second transmission information; the first transmission information is transmission information of the first optical fiber interface, and the second transmission information is transmission information of the second optical fiber interface; the transmission module 84 is specifically used for: transmitting hardware decoding data and processing time to the software monitoring system through the first optical fiber interface according to the first transmission information; and transmitting transaction orders to the software reporting system through the second optical fiber interface according to the second transmission information.

[0128] In some embodiments, the transmission information includes data path information for transmitting hardware decoded data, time path information for transmitting processing time, and order path information for transmitting transaction orders; the transmission module 84 is specifically configured to: determine at least one data path based on the data path information and transmit hardware decoded data from at least one data path to the software monitoring system; determine at least one time path based on the time path information and transmit processing time from at least one time path to the software monitoring system; and determine at least one order path based on the order path information and transmit transaction orders from at least one order path to the software order system.

[0129] In some embodiments, the transmission module 84 is specifically used to: when transmitting hardware decoding data and processing time to the software monitoring system, and when transmitting transaction orders to the software reporting system, the data size of each transmitted data is less than or equal to a cache.

[0130] In some embodiments, the acquisition module 81 is further configured to read new transmission information from the target register after transmitting hardware decoding data and processing time to the software monitoring system; the transmission information in the target register is the transmission information adjusted according to the hardware decoding data and processing time; the transmission module 84 is further configured to transmit new hardware decoding data, new processing time and new transaction order according to the new transmission information when the new transmission information is different from the original transmission information.

[0131] The transaction data processing device provided in this embodiment can execute the transaction data processing method provided in the above method embodiment. Its implementation principle and technical effect are similar to the above method, and will not be repeated here.

[0132] like Figure 11 As shown, a transaction data processing apparatus provided in an embodiment of this application is applied to a software monitoring system. The transaction data processing apparatus includes a receiving module 91, an analysis module 92, and an adjustment module 93.

[0133] The receiving module 91 is used to receive hardware decoding data and processing time from the DPU network card; the hardware decoding data is obtained by decoding the original transaction data, and the processing time is the processing time corresponding to the hardware decoding data; the analysis module 92 is used to perform performance analysis on the hardware decoding data and processing time to obtain the processing result; the adjustment module 93 is used to adjust the transmission information according to the processing result; the transmission information is the transmission information of the fiber optic interface corresponding to the DPU network card.

[0134] In some embodiments, the processing time includes the start time of receiving the original transaction data, the end time of receiving the original transaction data, the start time of decoding the original transaction data, the end time of decoding the original transaction data, the start time of transmitting the hardware decoded data, and the end time of transmitting the transaction report. The transaction report is generated based on the hardware decoded data. The analysis module 92 is specifically used for: calculating the reception duration of the original transaction data based on the start time and the end time of receiving the original transaction data; calculating the decoding duration of the original transaction data based on the start time and the end time of decoding the original transaction data; calculating the data transmission duration of the hardware decoded data based on the start time and the end time of transmitting the hardware decoded data; calculating the report transmission duration of the transaction report based on the start time and the end time of transmitting the hardware decoded data; and detecting whether the hardware decoded data is abnormal according to preset rules to obtain the detection result.

[0135] In some embodiments, the transmission information includes the number of data paths for transmitting hardware decoding data, the number of time paths for transmitting processing time, and the number of order paths for transmitting transaction orders; the adjustment module 93 is specifically used to: reduce the first number and / or increase the second number when the order transmission time is greater than the first threshold; the first number is the number of data paths or the number of time paths; the second number is the number of order paths.

[0136] In some embodiments, the transaction data processing apparatus further includes a sending module; the sending module 94 is configured to: send a first prompt message when the detection result shows that the hardware decoding data is abnormal; the first prompt message is used to indicate that the transaction data is abnormal; and send a second prompt message when the target duration is greater than a second threshold; the second prompt message is used to indicate that the processing stage corresponding to the target duration is abnormal; the target duration is any one of the receiving duration, decoding duration, data transmission duration, and report transmission duration.

[0137] The transaction data processing device provided in this embodiment can execute the transaction data processing method provided in the above method embodiment. Its implementation principle and technical effect are similar to the above method, and will not be repeated here.

[0138] Figure 12 This is an electronic device illustrated according to an exemplary embodiment. The electronic device may include a DPU network card 905 and a processor 902. The DPU network card 905 is used to execute programmable logic, and the processor 902 is used to execute application code, thereby implementing the transaction data processing method of this application.

[0139] The processor 902 may be a central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of the program of the present application.

[0140] The DPU network card 905 includes programmable logic that allows users to configure it to implement the transaction data processing method described in this application.

[0141] like Figure 12 As shown, the electronic device may further include a memory 903. The memory 903 stores application code that executes the scheme of this application, and its execution is controlled by the processor 902.

[0142] Memory 903 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. Memory 903 may exist independently and be connected to processor 902 via bus 904. Memory 903 may also be integrated with processor 902.

[0143] like Figure 12 As shown, the electronic device may also include a communication interface 901, wherein the communication interface 901, processor 902, and memory 903 may be coupled to each other, for example, through a bus 904. The communication interface 901 is used for information interaction with other devices, for example, supporting information interaction between the electronic device and other devices.

[0144] It should be pointed out that, Figure 12 The device structure shown does not constitute a limitation on the electronic device, except... Figure 12 In addition to the components shown, the electronic device may include more or fewer components than illustrated, or combine certain components, or have different component arrangements. Furthermore, the electronic device provided in this embodiment can execute the transaction data processing method provided in the above-described method embodiments; its implementation principle and technical effects are similar to the above methods, and will not be repeated here.

[0145] This application provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the various processes of the transaction data processing method in the above-described method embodiments and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0146] The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.

[0147] This application provides a computer program product that stores a computer program. When the computer program is executed by a processor, it implements the various processes of the transaction data processing method in the above-described method embodiments and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0148] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program code.

[0149] In this application, memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, like read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0150] In this application, computer-readable media includes both permanent and non-permanent, removable and non-removable storage media. Storage media can implement information storage using any method or technology; the information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data and carrier waves.

[0151] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0152] The above description is merely a specific embodiment of this application, enabling those skilled in the art to understand or implement this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A transaction data processing method characterized by, Applied to a DPU network card, comprising: Obtaining original transaction data, and performing hardware decoding processing on the original transaction data to obtain hardware decoding data; Determine the transmission information, and record the processing time corresponding to the hardware decoding data; The transmission information is the transmission information of the optical fiber interface corresponding to the DPU network card; According to the preset strategy, the hardware decoding data is calculated and processed to generate a transaction order; According to the transmission information, the hardware decoding data and the processing time are transmitted to the software monitoring system through the optical fiber interface, and the transaction order is transmitted to the software order system; The software monitoring system is used for monitoring the processing performance of the transaction data according to the hardware decoding data and the processing time, and adjusting the transmission information according to the processing performance; The transmission information includes first transmission information and second transmission information; The first transmission information is the transmission information of the first optical fiber interface, and the second transmission information is the transmission information of the second optical fiber interface; According to the transmission information, the hardware decoding data and the processing time are transmitted to the software monitoring system through the optical fiber interface, and the transaction order is transmitted to the software order system, comprising: According to the first transmission information, the hardware decoding data and the processing time are transmitted to the software monitoring system through the first optical fiber interface; According to the second transmission information, the transaction order is transmitted to the software order system through the second optical fiber interface; The transmission information includes data path information for transmitting the hardware decoding data, time path information for transmitting the processing time, and order path information for transmitting the transaction order; The hardware decoding data and the processing time are transmitted to the software monitoring system, and the transaction order is transmitted to the software order system, comprising: According to the data path information, at least one data path is determined, and the hardware decoding data is transmitted from the at least one data path to the software monitoring system; According to the time path information, at least one time path is determined, and the processing time is transmitted from the at least one time path to the software monitoring system; According to the order path information, at least one order path is determined, and the transaction order is transmitted from the at least one order path to the software order system.

2. The transaction data processing method of claim 1, wherein, The record of the processing time corresponding to the hardware decoding data comprises: Record the receiving start time, receiving end time, decoding start time and decoding end time of the original transaction data; The start transmission time and end transmission time of the hardware decoding data; The transmission start time and transmission end time of the transaction order.

3. The transaction data processing method of claim 1, wherein, The hardware decoding data and the processing time are transmitted to the software monitoring system, and the transaction order is transmitted to the software order system, comprising: When transmitting the hardware decoding data and the processing time to the software monitoring system and transmitting the transaction order to the software order system, the data size of each transmission data is less than or equal to a cache.

4. The transaction data processing method of claim 1, wherein, After transmitting the hardware decoding data and the processing time to the software monitoring system, the method further comprises: reading new transmission information from a target register; the transmission information in the target register is transmission information adjusted according to the hardware decoding data and the processing time; when the new transmission information is different from the transmission information, transmitting new hardware decoding data, new processing time and new transaction order according to the new transmission information.

5. A transaction data processing method characterized by, The application is applied to a software monitoring system, comprising: receiving hardware decoding data and processing time from a DPU network card; the hardware decoding data is obtained by decoding original transaction data, and the processing time is a processing time corresponding to the hardware decoding data; performing performance analysis processing on the hardware decoding data and the processing time to obtain a processing result; adjusting transmission information according to the processing result; the transmission information is transmission information of a fiber interface corresponding to the DPU network card; the transmission information comprises a data path quantity for transmitting the hardware decoding data, a time path quantity for transmitting the processing time and an order path quantity for transmitting a transaction order; the adjusting of the transmission information according to the processing result comprises: when order transmission duration is greater than a first threshold, reducing a first quantity and / or increasing a second quantity; the first quantity is the data path quantity or the time path quantity; and the second quantity is the order path quantity.

6. The transaction data processing method according to claim 5, characterized by, the processing time comprises a receiving start time, a receiving end time, a decoding start time and a decoding end time of the original transaction data, a start transmission time and an end transmission time of the hardware decoding data, a transmission start time and a transmission end time of a transaction order, and the transaction order is generated according to the hardware decoding data; the performance analysis processing on the hardware decoding data and the processing time to obtain a processing result comprises: calculating a receiving duration of the original transaction data according to the receiving start time and the receiving end time; calculating a decoding duration of the original transaction data according to the decoding start time and the decoding end time; calculating a data transmission duration of the hardware decoding data according to the start transmission time and the end transmission time; calculating an order transmission duration of the transaction order according to the transmission start time and the transmission end time; detecting whether the hardware decoding data is abnormal according to a preset rule to obtain a detection result.

7. The transaction data processing method according to claim 6, characterized by, after obtaining the processing result, the method further comprises: when the detection result shows that the hardware decoding data is abnormal, sending a first prompt information; the first prompt information is used for prompting transaction data abnormality; when a target duration is greater than a second threshold, sending a second prompt information; the second prompt information is used for prompting abnormality of a processing stage corresponding to the target duration; the target duration is any one of the receiving duration, the decoding duration, the data transmission duration and the order transmission duration.

8. A transaction data processing apparatus characterized by comprising: The application is applied to a DPU network card, comprising: an acquisition module, configured to acquire original transaction data, and perform hardware decoding processing on the original transaction data to obtain hardware decoding data; The determination module is configured to determine transmission information and record processing time corresponding to the hardware decoding data; the transmission information is transmission information of a fiber interface corresponding to the DPU network card; The processing module is configured to perform policy calculation processing on the hardware decoding data according to a preset policy to generate a transaction order; The transmission module is configured to transmit the hardware decoding data and the processing time to a software monitoring system and transmit the transaction order to a software order system through the fiber interface according to the transmission information; the software monitoring system is configured to monitor processing performance of transaction data according to the hardware decoding data and the processing time, and adjust the transmission information according to the processing performance; The transmission information includes first transmission information and second transmission information; the first transmission information is transmission information of a first fiber interface, and the second transmission information is transmission information of a second fiber interface; The transmission module is specifically configured to transmit the hardware decoding data and the processing time to the software monitoring system through the first fiber interface according to the first transmission information, and transmit the transaction order to the software order system through the second fiber interface according to the second transmission information; The transmission information includes data path information for transmitting the hardware decoding data, time path information for transmitting the processing time, and order path information for transmitting the transaction order; The transmission module is specifically configured to determine at least one data path according to the data path information, and transmit the hardware decoding data from the at least one data path to the software monitoring system; determine at least one time path according to the time path information, and transmit the processing time from the at least one time path to the software monitoring system; and determine at least one order path according to the order path information, and transmit the transaction order from the at least one order path to the software order system.

9. A transaction data processing apparatus characterized by comprising: Applied to a software monitoring system, comprising: The receiving module is configured to receive hardware decoding data and processing time from a DPU network card; the hardware decoding data is obtained after original transaction data is decoded, and the processing time is processing time corresponding to the hardware decoding data; The analysis module is configured to perform performance analysis processing on the hardware decoding data and the processing time to obtain a processing result; The adjustment module is configured to adjust transmission information according to the processing result; the transmission information is transmission information of a fiber interface corresponding to the DPU network card; The transmission information includes a number of data paths for transmitting the hardware decoding data, a number of time paths for transmitting the processing time, and a number of order paths for transmitting transaction orders; The adjustment module is specifically configured to reduce a first number and / or increase a second number when an order transmission duration is greater than a first threshold; the first number is the number of data paths or the number of time paths; and the second number is the number of order paths.

10. An electronic device, comprising: Comprising: A DPU network card, a processor, a memory, programmable logic loaded on the DPU network card, and a computer program stored on the memory and executable on the processor, the programmable logic being implemented by the DPU network card when executed to implement the transaction data processing method as claimed in any one of claims 1 to 4, or the computer program being implemented by the processor when executed to implement the transaction data processing method as claimed in any one of claims 5 to 7.

Images