Data transmission method, system and device, and storage medium

Abstract

Provided in the present disclosure are a data transmission method, system and device that can perform data processing on source data sent by a source system to a target system, and a storage medium. The data transmission system is configured to: generate component configuration information for a data transmission flow between a source system and a target system; generate a running relationship graph of the data transmission flow on the basis of the component configuration information; and load corresponding components on the basis of the running relationship graph, and execute, according to an execution order in the running relationship graph, functions corresponding to the components.

Description

Data transmission method, system, device and storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application is based on the Chinese patent application with application number 202311571495.9 and application date of November 22, 2023, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby introduced into this application in its entirety. Technical Field

[0003] The present disclosure relates to the field of Internet of Things, and in particular to a data transmission method, system, device and storage medium. Background Art

[0004] With the continuous development of the Internet of Things (IoT) and the increasing abundance of data resources, the market demand for data interaction is gradually increasing. To ensure data accuracy and security, the need for external system interaction is also increasing. Consequently, there is a growing demand for service development to support data exchange and transmission between IoT industry systems. Currently, many cross-system data transmission methods proposed only perform transmission functions, often without further data processing for the target system. This makes these cross-system data transmission methods unsuitable for widespread reuse in data transmission scenarios. Cross-system transmission methods are limited in scope and can only be used with source and target systems that support them. In specific scenarios, corresponding data forwarding services must be developed to implement these functions.

[0005] Summary of the Invention

[0006] The purpose of the embodiments of the present disclosure is to provide a data transmission method, system, device and storage medium that can process data transmitted from a source system to a target system, realize the decoupling of the source data acquisition, data processing and data output processes, and enable the cross-system data transmission method to be widely reused in multiple data transmission scenarios.

[0007] To achieve the above objectives, the present disclosure provides a data transmission system, including:

[0008] a management module for generating component configuration information for a data transmission flow between a source system and a target system; wherein the data transmission flow is composed of a plurality of components, including a data source component for acquiring source data from the source system, a data operation component for performing data processing on the source data, and a data output component for outputting the processed data to the target system;

[0009] A generating module, configured to generate an operation relationship diagram of the data transmission flow according to the component configuration information;

[0010] The operation module is used to load the corresponding components according to the operation relationship diagram and execute the corresponding functions of the components according to the execution order in the operation relationship diagram.

[0011] As an implementation method, the data transmission system further includes:

[0012] The configuration module is configured to generate a transmission identifier for the data transmission stream and establish a mapping relationship between the transmission identifier and component information of components in the data transmission stream.

[0013] As an implementation manner, each data transmission flow in the data transmission system corresponds to an operation relationship diagram, and each of the data transmission flows includes a data source component, at least one data operation component and at least one data output component.

[0014] As an implementation, the data transmission system is pre-installed with the plurality of components, and the component configuration information is generated according to a developer's editing operation on the components; wherein the editing operation includes at least one of adding, deleting, and updating.

[0015] As an implementation manner, the configuration module is further configured to:

[0016] storing the component configuration information in a database, and sending the component configuration information to the generating module;

[0017] The generating module is notified to generate a corresponding data stream transmission service according to the component configuration information, and the running module is notified to run the data stream transmission service.

[0018] As an implementation mode, the operation module is further configured to:

[0019] Acquiring configurable resources of the data transmission system;

[0020] An upper limit number of configuring the data transmission flows is determined according to the configurable resources.

[0021] As an implementation manner, the component information includes component name, component classification, component function description, component configuration parameters and component output parameters, and the component information complies with the parameter definition in the basic component specification.

[0022] To achieve the above objectives, the present disclosure further provides a data transmission method applicable to the data transmission system described in any of the above embodiments. The data transmission method includes:

[0023] Upon receiving source data to be sent from a source system to a target system, searching for an operation relationship diagram corresponding to a data transmission flow between the source system and the target system;

[0024] The source data is processed according to the operation relationship diagram to send the processed data to the target system.

[0025] To achieve the above objectives, an embodiment of the present disclosure also provides a data transmission device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, it implements the data transmission method described in the above embodiments.

[0026] To achieve the above-mentioned purpose, an embodiment of the present disclosure further provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the data transmission method as described in the above-mentioned embodiment.

[0027] Compared with the prior art, the present disclosure provides a data transmission method, system, device and storage medium that can process source data sent from a source system to a target system. This data transmission system can generate component configuration information of the data transmission flow between the source system and the target system, and generate an operation relationship diagram of the data transmission flow based on the component configuration information, so that the corresponding components can be loaded according to the operation relationship diagram, and the corresponding functions of the components can be executed according to the execution order in the operation relationship diagram, thereby completing the functions of obtaining source data, processing the source data and outputting the processed data to the target system. It can realize the logical processing process of any data in the cross-system data transmission process, assemble the data transmission logic process according to the basic functional components, complete the cross-system data transmission function, and achieve wide reuse in multiple data transmission scenarios.

[0028] Furthermore, components within the data transmission system can be customized to form a data transmission flow operation diagram. By running this data transmission flow, cross-system data transmission services can be deployed and operated. When the required data between the source and target systems changes, new cross-system data transmission capabilities can be quickly implemented by editing the data transmission flow configuration. Furthermore, even if a cross-system data transmission flow already exists in the system, a new one can be established as long as system resources are sufficient, without having to restart the service to add the new flow configuration. This allows for dynamic deployment of cross-system data transmission services. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] FIG1 is a structural block diagram of a data transmission system provided by an embodiment of the present disclosure;

[0030] FIG2 is a flowchart of a data transmission system according to an embodiment of the present disclosure;

[0031] 3 is a schematic diagram of a management interface provided by a data transmission system according to an embodiment of the present disclosure;

[0032] FIG4 is an operational relationship diagram of a first data transmission flow provided by an embodiment of the present disclosure;

[0033] FIG5 is an operational relationship diagram of a second data transmission flow provided by an embodiment of the present disclosure;

[0034] FIG6 is a flowchart of a data transmission method provided by an embodiment of the present disclosure;

[0035] FIG7 is a structural block diagram of a data transmission device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0036] The following will be combined with the accompanying drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. Obviously, the embodiments described are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0037] Referring to FIG1 , FIG1 is a block diagram of a data transmission system 100 provided in an embodiment of the present disclosure. The data transmission system 100 can process source data sent by a source system to a target system. The system is located between the source system and the target system as an intermediate platform. Both the source system and the target system are IoT systems. When the IoT system acts as a transmitter, the IoT system is the source system. When the IoT system acts as a receiver, the IoT system is the target system. The data transmission system can connect to multiple source systems and multiple target systems. The data transmission system 100 shown in FIG1 can receive source data sent by source systems 1 to n and send the processed data to the corresponding target systems 1 to m.

[0038] Specifically, the data transmission system 100 includes:

[0039] A management module 11 is used to generate component configuration information of a data transmission flow between a source system and a target system;

[0040] A generating module 13, configured to generate an operation relationship diagram of the data transmission flow according to the component configuration information;

[0041] The running module 14 is configured to load corresponding components according to the running relationship diagram and execute the functions corresponding to the components according to the execution order in the running relationship diagram.

[0042] Specifically, the data transmission flow consists of several components, including a data source component for acquiring source data from the source system, a data operation component for processing the source data, and a data output component for outputting the processed data to the target system. For example, the functions and examples of the three components can be found in Table 1.

[0043] Table 1 Functions and examples of components

[0044] Specifically, the component information of the component includes the component name, component classification, component function description, component configuration parameters, and component output parameters. The component information complies with the parameter definition in the basic component specification. The basic component specification specifies the parameter definition of the component. When configuring the component, development must be carried out in accordance with the basic component specification. The component must implement changeable and configurable configuration parameters, and the input data format and output data format must comply with the data format defined in the specification. For the specific parameter definition in the basic component specification, please refer to Table 2.

[0045] Table 2 Parameter definitions of basic component specifications

[0046] Furthermore, the data transmission system 100 further includes:

[0047] The configuration module 12 is used to store the component configuration information in a database and send the component configuration information to the generation module 13; it is also used to notify the generation module 13 to generate a corresponding data stream transmission service according to the component configuration information, and to notify the operation module 14 to run the data stream transmission service.

[0048] In the embodiments of the present disclosure, each module may be a circuit that implements a corresponding function, such as the management module 11 may be a management circuit for generating component configuration information of a data transmission flow between a source system and a target system; the generation module 13 may be a generation circuit for generating an operation relationship diagram of the data transmission flow according to the component configuration information; the operation module 14 may be an operation circuit for loading corresponding components according to the operation relationship diagram, and executing the functions corresponding to the components according to the execution order in the operation relationship diagram; the configuration module 12 may be a configuration circuit for storing the component configuration information in a database, and sending the component configuration information to the generation circuit; wherein the configuration circuit is also used to notify the generation circuit to generate a corresponding data stream transmission service according to the component configuration information, and to notify the operation circuit to run the data stream transmission service.

[0049] Referring to FIG. 2 , FIG. 2 is a flowchart of the data transmission system provided by an embodiment of the present disclosure. The management module 11 provides a cross-system data flow transmission management interface for managing cross-system data transmission flows created by developers. When the data transmission system 100 is load balanced, developers can configure data transmission flows on demand. The management module 11 sends the generated component configuration information of the data transmission flow between the source system and the target system to the configuration module 12. The configuration module 12 provides a cross-system data transmission flow configuration service, stores the component configuration information in a database to achieve configuration persistence, such as writing the component configuration information to a persistent storage database MySQL, and sends the component configuration information to the generation module 13. The generation module 13 provides a cross-system data transmission flow generation service, generates a corresponding data flow transmission service based on the component configuration information, and generates an operation relationship diagram for the data transmission flow. The operation relationship diagram is submitted to the operation module 14. The operation module 14 provides a cross-system transmission operation service and can execute this operation relationship diagram. When data needs to be transmitted between the source system and the corresponding target system, the operation relationship diagram is automatically called to perform data processing and transmission functions.

[0050] Specifically, the management module 11 is used to generate component configuration information for the data transmission flow between the source system and the target system. The data transmission system is pre-installed with the components, and the component configuration information is generated based on developer editing operations on the components; these editing operations include at least one of adding, deleting, and updating. When a new data transmission flow is created or the required data between the source and target systems changes, editing the data transmission flow's component configuration quickly implements new cross-system data transmission functionality.

[0051] For example, see Figure 3, which is a schematic diagram of a management interface provided by a data transmission system according to an embodiment of the present disclosure. This interface is used to display the configuration of data transmission flow components and the logical relationship between component function execution, making it easier for users to generate cross-system data transmission flow services. The management interface includes a component selection interface, a data transmission flow assembly interface, and a component information display interface.

[0052] The left side of Figure 3 shows the component selection interface, which displays the data source component, data output component, and data operation component provided by the data transmission system. Furthermore, if a large number of components are pre-installed in the transmission system, the display position of each major component category in the component selection interface can default to only displaying some commonly used components, while the remaining less commonly used components are hidden. Developers can search for components by searching, scrolling down, scrolling up, moving, etc.; alternatively, developers can customize which components are displayed first and which components are hidden. The middle figure of Figure 3 shows the data transmission flow assembly interface. Developers can select any component from the component selection interface by double-clicking, dragging, copying, etc., and place this component in the data transmission flow assembly interface. They can add data flows between components to build logical relationships between each component, thereby generating an operational relationship diagram of the data transmission flow. For example, they can select the Kafka Consumer component from the data source component, the MySQL Writer component from the data output component, and the data mapping, data traversal, and conditional branch components from the data operation component. They can add data flows between components to build logical relationships between these components to complete the configuration of the data transmission flow. The figure on the right side of Figure 3 represents the component information display interface, which is used to display the component information of each component. Developers can present the component information of this component by clicking or selecting the component, such as displaying component information such as component name, component configuration parameters and component function description.

[0053] Specifically, each data transmission flow in the data transmission system corresponds to an operation relationship diagram, and each data transmission flow includes a data source component, at least one data operation component and at least one data output component.

[0054] For example, a data transmission flow operational relationship diagram is constructed based on a directed acyclic graph. The components required for this data transmission flow are placed in the directed acyclic graph. The entire graph contains only one data source component, to which no other components can transmit data. There can be multiple data output components and data operation components, with each data output component corresponding to a branch of processing logic. The data transmission direction is used as an edge of the directed acyclic graph to connect and organize the different logical sequences of data during cross-system data transmission, generating a complete data transmission processing chain. By fully implementing this graph, the cross-system data transmission function can be realized.

[0055] Refer to Figure 4, which is an operation relationship diagram of the first data transmission flow provided by an embodiment of the present disclosure. There is only one data transmission link in the data transmission flow, which contains a data source component, a data operation component and a data output component. The source data sent by the source system passes through the data source component, the data operation component and the data output component in sequence and is transmitted to the target system, thereby completing the function of obtaining data from the source system and transmitting it to the target system.

[0056] Referring to Figure 5, Figure 5 is an operational relationship diagram of the second data transmission flow provided by an embodiment of the present disclosure. The data transmission flow includes two data transmission links, including a data source component, seven data operation components, and two data output components. The entire data transmission link starts with the source data component obtaining source data from the source system, and then transmits the data backward to the data operation component for data segmentation or filtering, developing two (or more) different branches. Each branch is then subjected to targeted data processing (such as conditional query, traversal, conversion, etc.), and finally sent to different storage media of the target system through the data output component, thereby completing the function of obtaining data from the source system and transmitting it to the target system.

[0057] In the data transmission system, when the source system needs to establish data transmission with the target system, the developer can dynamically configure the data transmission streams of the source system and the target system with the help of the management module 11 according to the data that the source system needs to send, and plan which data operation components should be used. The components in the data transmission system can be reused in different data transmission streams. The same processing process only needs to define a basic functional component specification, such as defining the configuration required by the Kafka consumer, such as the Kafka cluster address, consumer group, data topic, data partition key, consumer location, etc. It is only necessary to define a Kafka consumer component such as the above example and develop and implement it. The component can be reused indefinitely in the system. As long as a cross-system data transmission stream needs to be configured, the Kafka consumer component can be reused and configured with the new source system-provided Kafka cluster address, data topic, and other configurations. The implementation process changes from developing Kafka Consumer code countless times to implementing Kafka Consumer component code once, which greatly saves development time and development costs.

[0058] Specifically, the configuration module 12 is further configured to generate a transmission identifier for the data transmission flow, and establish a mapping relationship between the transmission identifier and component information of components in the data transmission flow.

[0059] Exemplarily, the configuration module 12 is primarily configured to receive configuration information (including component information and their logical relationships) for all components of a cross-system data transmission flow configured through the front-end web cross-system data transmission flow management page, and simultaneously notify the cross-system data transmission flow generation service and the cross-system data transmission flow operation service to generate and operate the corresponding cross-system data transmission flow service. The entire system management cross-system data transmission flow generation process involves generating a unique transmission identifier (system ID) for each data transmission flow, mapping the data transmission flow configuration information to the unique ID, and writing the configuration information to the persistent storage database MySQL.

[0060] Specifically, the generation module 13 is used to generate a corresponding cross-system data transmission flow service according to the cross-system data transmission flow configuration information sent by the configuration module 12, and after obtaining the command to run the cross-system data transmission flow, submit the generated operation relationship diagram of the cross-system data transmission flow service to the operation module 14 for execution.

[0061] Specifically, the operation module 14 is responsible for the operation functions of all data transmission flows in the entire system, allocates a certain amount of memory space for each data transmission flow, loads all components according to pre-defined components and operation relationship diagrams, and initializes all components, executes component functions according to the execution order in the diagram, and transmits the execution results to the next component until it reaches the last component (generally the data output component), thereby completing the entire cross-system data transmission flow and realizing the function of cross-system data transmission.

[0062] Furthermore, the operation module 14 is further configured to: obtain configurable resources of the data transmission system; and determine an upper limit number of configured data transmission flows according to the configurable resources.

[0063] Exemplarily, the configurable resources are the CPU and memory resources of the data transmission system. The execution module configures the number of data transmission streams supported by the system based on the CPU and memory resources to ensure system stability. If a new data transmission stream is required but the existing CPU and memory resources cannot support it, developers can expand the data transmission system.

[0064] Compared with the existing technology, the data transmission system provided by the present invention can process the source data sent by the source system to the target system. This data transmission system can generate component configuration information of the data transmission flow between the source system and the target system, and generate an operation relationship diagram of the data transmission flow based on the component configuration information, so that the corresponding components can be loaded according to the operation relationship diagram, and the corresponding functions of the components can be executed according to the execution order in the operation relationship diagram, thereby completing the functions of obtaining source data, processing the source data, and outputting the processed data to the target system. It can realize the logical processing process of any data in the cross-system data transmission process, assemble the data transmission logic process according to the basic functional components, complete the cross-system data transmission function, and achieve wide reuse in multiple data transmission scenarios.

[0065] Furthermore, components within the data transmission system can be customized to form a data transmission flow operation diagram. By running this data transmission flow, cross-system data transmission services can be deployed and operated. When the required data between the source and target systems changes, new cross-system data transmission capabilities can be quickly implemented by editing the data transmission flow configuration. Furthermore, even if a cross-system data transmission flow already exists in the system, a new one can be established as long as system resources are sufficient, without having to restart the service to add the new flow configuration. This allows for dynamic deployment of cross-system data transmission services.

[0066] 6 , which is a flowchart of a data transmission method provided by an embodiment of the present disclosure. The data transmission method is implemented by the data transmission system described in the above embodiment. The data transmission method includes:

[0067] S1. Upon receiving source data to be sent from a source system to a target system, searching for an operation relationship diagram corresponding to a data transmission flow between the source system and the target system;

[0068] S2. Process the source data according to the operation relationship diagram to send the processed data to the target system.

[0069] For example, when the source system needs to establish data transmission with the target system, the developer can dynamically configure the data transmission flow between the source system and the target system with the help of the data transmission system according to the data that the source system needs to send, and plan which data operation components should be used. The components in the data transmission system can be reused in different data transmission flows. After the data transmission flow between the source system and the target system is constructed, this data transmission flow is bound to the corresponding source system and target system. When the source data to be sent to the target system by the source system is received, the operation relationship diagram corresponding to the data transmission flow between the source system and the target system is searched through this binding relationship, and then the source data is processed according to the operation relationship diagram to send the processed data to the target system, thereby completing the data transmission and processing process from the source system to the target system.

[0070] Compared with the existing technology, the data transmission method provided by the present invention can process the source data sent by the source system to the target system. This data transmission system can generate component configuration information of the data transmission flow between the source system and the target system, and generate an operation relationship diagram of the data transmission flow based on the component configuration information, so that the corresponding components can be loaded according to the operation relationship diagram, and the corresponding functions of the components can be executed according to the execution order in the operation relationship diagram, thereby completing the functions of obtaining source data, processing the source data, and outputting the processed data to the target system. It can realize the logical processing process of any data in the cross-system data transmission process, assemble the data transmission logic process according to the basic functional components, complete the cross-system data transmission function, and achieve wide reuse in multiple data transmission scenarios.

[0071] Furthermore, components within the data transmission system can be customized to form a data transmission flow operation diagram. By running this data transmission flow, cross-system data transmission services can be deployed and operated. When the required data between the source and target systems changes, new cross-system data transmission capabilities can be quickly implemented by editing the data transmission flow configuration. Furthermore, even if a cross-system data transmission flow already exists in the system, a new one can be established as long as system resources are sufficient, without having to restart the service to add the new flow configuration. This allows for dynamic deployment of cross-system data transmission services.

[0072] Referring to FIG. 7 , FIG. 7 is a block diagram of a data transmission device 200 provided in an embodiment of the present disclosure. The data transmission device 200 includes a processor 21, a memory 22, and a computer program stored in the memory 22 and executable on the processor 21. When the processor 21 executes the computer program, the steps in the aforementioned various data transmission method embodiments, such as steps S1 to S2, are implemented.

[0073] For example, the computer program may be divided into one or more modules / units, which are stored in the memory 22 and executed by the processor 21 to implement the present disclosure. The one or more modules / units may be a series of computer program instruction segments capable of implementing specific functions, and the instruction segments are used to describe the execution process of the computer program in the data transmission device 200.

[0074] The data transmission device 200 may include, but is not limited to, a processor 21 and a memory 22. Those skilled in the art will appreciate that the schematic diagram is merely an example of the data transmission device 200 and does not limit the data transmission device 200. The data transmission device 200 may include more or fewer components than shown, or may combine certain components or different components. For example, the data transmission device 200 may also include input and output devices, network access devices, buses, and the like.

[0075] The processor 21 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor. The processor 21 is the control center of the data transmission device 200, and connects various parts of the entire data transmission device 200 using various interfaces and lines.

[0076] The memory 22 can be used to store the computer programs and / or modules. The processor 21 implements the various functions of the data transmission device 200 by running or executing the computer programs and / or modules stored in the memory 22 and accessing the data stored in the memory 22. The memory 22 may mainly include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as a sound playback function, an image playback function, etc.); the data storage area may store data generated based on the use of the mobile phone (such as audio data, a phone book, etc.). In addition, the memory 22 may include high-speed random access memory and non-volatile memory, such as a hard disk, internal memory, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, at least one disk storage device, a flash memory device, or other volatile solid-state storage device.

[0077] Wherein, if the module / unit integrated in the data transmission device 200 is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present disclosure implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor 21, it can implement the steps of the above-mentioned various method embodiments. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc.

[0078] The above is an embodiment of the present disclosure. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present disclosure. These improvements and modifications are also considered to be within the scope of protection of the present disclosure.

Claims

1. A data transmission system, comprising: A management module, used to generate component configuration information of a data transmission flow between a source system and a target system; wherein the data transmission flow is composed of a plurality of components, including a data source component for obtaining source data from the source system, a data operation component for performing data processing on the source data, and a data output component for outputting processed data to the target system; A generating module, used for generating an operation relationship diagram of the data transmission flow according to the component configuration information; The operation module is used to load the corresponding components according to the operation relationship diagram, and execute the functions corresponding to the components according to the execution order in the operation relationship diagram.

2. The data transmission system according to claim 1, wherein: The data transmission system further comprises: The configuration module is used to generate a transmission identifier of the data transmission stream and establish a mapping relationship between the transmission identifier and component information of components in the data transmission stream.

3. The data transmission system according to claim 1 or 2, wherein: Each data transmission flow in the data transmission system corresponds to an operation relationship diagram, and each of the data transmission flows includes a data source component, at least one data operation component and at least one data output component.

4. The data transmission system according to any one of claims 1 to 3, wherein: The data transmission system is pre-installed with the plurality of components, and the component configuration information is generated according to the editing operation of the developer on the components; wherein the editing operation includes at least one of adding, deleting and updating.

5. The data transmission system according to any one of claims 2 to 4, wherein: The configuration module is also used to: storing the component configuration information in a database, and sending the component configuration information to the generation module; The generating module is notified to generate a corresponding data stream transmission service according to the component configuration information, and the running module is notified to run the data stream transmission service.

6. The data transmission system according to any one of claims 1 to 5, wherein: The operation module is also used for: Acquiring configurable resources of the data transmission system; An upper limit number of configuring the data transmission stream is determined according to the configurable resources.

7. The data transmission system according to any one of claims 2 to 6, wherein: The component information includes component name, component classification, component function description, component configuration parameters and component output parameters, and the component information complies with parameter definitions in basic component specifications.

8. A data transmission method, applicable to the data transmission system according to any one of claims 1 to 7, the data transmission method comprising: When receiving source data to be sent from a source system to a target system, searching for an operation relationship diagram corresponding to a data transmission flow between the source system and the target system; The source data is processed according to the operation relationship diagram to send the processed data to the target system.

9. A data transmission device, comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor implements the data transmission method according to claim 8 when executing the computer program.

10. A computer-readable storage medium, the computer-readable storage medium comprising a stored computer program, wherein: When the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the data transmission method as claimed in claim 8.

Images