System and method for transmission of mass high-energy physical experimental data

Abstract

The invention relates to a system for the transmission of mass high-energy physical experimental data. The system comprises a multipath source data scanning module, a data buffer area module, an efficient polling module, a transmitting optimization module, a transmitting module, a data buffer area automatic release module, efficient receiving modules, data validation modules, receiving optimization modules, storage modules, a user management configuration module and a monitoring module, wherein the multipath source data scanning module, the data buffer area module, the efficient polling module, the transmitting optimization module, the transmitting module and the data buffer area automatic release module are located in a source-end efficient transmitting module, and the efficient receiving modules, the data validation modules, the receiving optimization modules and the storage modules are located at the destination end. The invention also relates to a method for the transmission of the mass high-energy physical experimental data, and the method comprises three steps. According to the system and the method, the multipath parallel transmission of the high-energy physical experimental data is realized based on a GridFTP (Grid File Transfer Protocol), and the function of each module of the system can be configured through a user management configuration interface, so that the graphic monitoring of stages during the process of system operation and no mutual interference during the process of multipath transmission are realized, and the problems of single transmission destinations, single configurable items, system instability, difficulty in extension and the like of the existing data transmission system are sovled.

Description

(1) Technical field [0001] The invention belongs to the field of network transmission of computing systems, and in particular relates to a transmission system and a transmission method for large batches of data in high-energy physics experiments. (2) Background technology [0002] GridFTP (standard file transfer protocol for grid computing) is a new data transfer protocol developed by the Globus project team. The interoperability among them provides a common and extensible underlying data transmission protocol. GridFTP not only supports Kerberos security mechanism and GSI security mechanism, but also supports integrity check, security authentication, reliable data transmission and fault-tolerant transmission; and in GridFTP, we can effectively improve data transmission performance by automatically adjusting the TCP buffer / Window size. Because of the above features, GridFTP is safer, faster and more efficient. [0003] PostgreSQL is an open source object-relational database...

AI Technical Summary

Problems solved by technology

[0007] Aiming at the problems of single transmission destination, single configurable items, unstable system and difficult expansion of the traditional data transmission system, the present invention provides a transmission system and transmission method for large quantities of data in high-energy physics experiments. Efficient multi-stream parallel transmission of large batches of data, stable and easily scalable data transmission system and transmission method

Images