API data transmission method and device based on data-in-data platform, equipment and medium

Abstract

The invention relates to an API data transmission method and device based on a data-in-data platform, computer equipment and a storage medium. The method comprises the steps of obtaining a to-be-transmitted API data packet, and converting the to-be-transmitted API data packet into a plurality of data sub-packets; determining a transmission thread corresponding to each transmission path used for transmitting the data subpackages, counting the number of threads completing a preset workload in the transmission thread, and calculating a task processing degree value; obtaining the current queue length of the target transmission thread; according to the task processing degree value and the current queue length, determining a target distribution number of data subpackages of the target transmission thread; employing the target transmission thread for transmitting the data sub-packets of the target distribution number to a data medium station; and continuing to determine the target transmission thread until the data sub-packet transmission is finished. By adopting the method, the transmission tasks of the transmission threads can be relatively balanced, the congestion risk of the transmission threads can be reduced, the transmission threads can be prevented from being idle, and thus the transmission efficiency of the transmission threads is improved.

Description

technical field [0001] The present application relates to the technical field of data transmission, in particular to an API data transmission method, device, computer equipment and storage medium based on a data center. Background technique [0002] With the rapid development of information technology, the popularity of government and enterprise digitization is getting higher and higher. The data middle platform is the precipitation of the business and data of each business unit in the process of digital transformation of government and enterprises, and the construction of data construction, management, and use systems including data technology, data governance, and data operation to realize data empowerment. It is a new type of informatization The core of the application framework system. [0003] In the application of government and enterprise digitization, the front-end uses API (Application Programming Interface, application program interface) services to transmit data ...

AI Technical Summary

Problems solved by technology

[0003] In the application of government and enterprise digitization, the front-end uses API (Application Programming Interface, application program interface) services to transmit data with the data center, and in order to improve the efficiency of data transmission, generally set up multiple transmission paths, and use different transmission threads to Each transmission path performs transmission control; at the same time, in order to balance the task load of each transmission thread, it generally assigns a preset fixed number of data packets to each transmission thread in turn; but because the time required to transmit each data packet is different, The transmission rate of each transmission thread is different. According to the current method, the transmission thread will be congested or the transmission thread will be idle, resulting in low transmission efficiency.

Images