A data expansion method and system for an information platform

Abstract

The present invention discloses a data expansion method and system for an information platform, comprising: using a first data transmission interface deployed on the information platform to obtain first data uploaded by a first server, performing data access to the first data obtained by the first data transmission interface according to the configuration of a deployed second data transmission interface, during the data access process, obtaining a data conversion rule corresponding to the first data from a preset data conversion rule table, performing format conversion on the first data according to the data conversion rule, obtaining second data corresponding to the second server, sending the second data to the second server through the second data transmission interface so that the second server processes the second data, and receiving a notification message generated by the second server according to the processing result through the second data transmission interface, thereby improving the data compatibility and data processing efficiency of the information platform.

Description

Technical Field

[0001] The present invention relates to the field of data communication technology, and in particular to a method and system for expanding data on an information platform. Background Art

[0002] With the rapid growth of information in modern society and the emergence of electronic information platforms, various electronic information carried by the Internet are becoming more and more numerous. Therefore, in order to meet the needs of transmitting massive amounts of electronic information data, many companies have begun to build large-scale information platforms. In the overall implementation process of large-scale information platforms, the constructed information platforms need to be connected to many different servers so that the different servers can transmit data through the information platforms. Existing solutions usually use the following two methods to transmit data between servers.

[0003] The first method is one-to-one data transmission, that is, a one-to-one data transmission channel between servers is established in the information platform. This data transmission method requires re-modification of the data transmission channel constructed in the information platform when a new server is connected to the information platform, which not only requires a huge workload, but also causes poor scalability of the information platform.

[0004] The second method is broadcast data transmission, that is, the server broadcasts the data it needs to transmit to all other servers in a broadcast manner. However, this transmission method will cause other servers to receive a lot of data they do not need, wasting server space. At the same time, during the broadcast process, the information platform needs to transmit a huge amount of useless data, which increases the data processing burden of the information platform and reduces the accuracy and efficiency of data transmission. Summary of the invention

[0005] In order to solve the above technical problems, the present invention discloses a data expansion method and system for an information platform, which improves the data compatibility and data processing efficiency of the information platform and reduces the space waste rate of the server.

[0006] In order to achieve the above object, the present invention discloses an information platform data expansion method, comprising:

[0007] Deploy a plurality of data transmission interfaces on the information platform to be expanded, and configure each of the plurality of data transmission interfaces;

[0008] Determine, according to the data transmission request received by the information platform, a first data type of a first server for sending data and a second data type of a second server for receiving data to which the data transmission request belongs;

[0009] Start the first data transmission interface and the second data transmission interface according to the first data type, the second data type and the configuration, and obtain the first data sent by the first server through the first data transmission interface;

[0010] Determine a processing method for the data transmission request through the configuration of the second data transmission interface, respond to the data transmission request according to the processing method, and control the second data transmission interface to access the first data acquired by the first data transmission interface;

[0011] In the data access process, in response to the data transmission request, a data conversion rule corresponding to the first data is obtained from a preset data conversion rule table, and the first data is formatted according to the data conversion rule to obtain second data corresponding to the second server;

[0012] The second data is sent to the second server through the second data transmission interface so that the second server processes the second data, and a notification message generated by the second server according to the processing result is received through the second data transmission interface.

[0013] The present invention discloses a data expansion method for an information platform. First, a plurality of data transmission interfaces are deployed on the information platform, and each data transmission interface is configured so that, subsequently, through the configuration of the data transmission interfaces, one data transmission interface can receive data sent by a plurality of servers or send data to a plurality of servers through one data transmission interface, thereby avoiding the technical problem of heavy workload caused by constructing a one-to-one data transmission channel for servers in the prior art. Meanwhile, when a new server appears for data transmission, data transmission can be realized by matching the data transmission interface corresponding to the type of the new server, thereby greatly improving the scalability of the information platform.

[0014] Next, the data transmission request received by the information platform is parsed to determine the first server and the second server at both ends of the data transmission, and the data transmission interface matching the above-mentioned servers is determined. Accurate data transmission between servers is achieved through the data transmission interface, which improves the accuracy of data transmission while avoiding the processing of useless data, thereby improving the efficiency of data transmission. Furthermore, after starting the first data transmission corresponding to the first server, after obtaining the first data to be uploaded by the first server, considering that the corresponding data types in different data transmission interfaces are different, the data transmission request is first processed using the configuration of the second data transmission interface, so that the second data transmission interface can access the first data transmission interface according to the processed data transmission request, and in the process of access, the first data is converted into a format according to the matched data conversion rule to obtain the second data acceptable to the second server. Therefore, the present invention uses one data conversion to complete the data transmission between different servers, avoiding the technical problem of repeated data conversion caused by setting a unified format on the information platform in the prior art, effectively reducing the data that needs to be processed by the information platform, and improving the efficiency of data processing.

[0015] As a preferred example, the step of deploying a plurality of data transmission interfaces on the information platform to be expanded and configuring each of the plurality of data transmission interfaces includes:

[0016] Accessing a storage space for data recording in the information platform, obtaining a plurality of data transmission records within a preset time period stored in the storage space, and determining a number of servers connected to the information platform according to the plurality of data transmission records; wherein the data transmission record includes a server identifier and a data transmission time;

[0017] Determine the data transmission interfaces to be deployed according to the plurality of servers and configure interface parameters for each of the data transmission interfaces; wherein the interface parameters include data transmission type, data source connection port, transmission mode, interface name and data sending method.

[0018] The present invention obtains the data transmission records saved in the information platform and determines the multiple servers that transmit data to the information platform within a certain period of time, so as to avoid the waste of time caused by the arrangement of useless transmission interfaces and improve the efficiency of data transmission. At the same time, the corresponding data transmission interfaces are deployed according to the above-mentioned determined servers, so that a many-to-many data transmission channel can be realized through the data transmission interface, thereby improving the scalability of the platform and ensuring accurate data transmission between servers.

[0019] As a preferred example, according to the data transmission request received by the information platform, determining the first data type of the first server for sending data and the second data type of the second server for receiving data to which the data transmission request belongs includes:

[0020] Parsing the data transmission request to determine a first identifier of a first server for sending data and a second identifier of a second server for receiving data;

[0021] A table for recording server information in the information platform is queried according to the first identifier and the second identifier to determine a first data type of the first server and a second data type of the second server.

[0022] The present invention identifies the data types of servers at both ends of data transmission so as to subsequently match a data transmission interface with the same data type, so that the matched transmission interface can directly obtain the data uploaded by the server, avoiding data conversion between the transmission interface and the server, and improving the efficiency of data processing.

[0023] As a preferred example, starting the first data transmission interface and the second data transmission interface according to the first data type, the second data type and the configuration, and obtaining the first data sent by the first server through the first data transmission interface includes:

[0024] Matching the first data type and the second data type with the interface parameters of each data transmission interface respectively, and determining a first data transmission interface corresponding to the first server and a second data transmission interface corresponding to the second server;

[0025] Starting the first data transmission interface to read the first data from the first server;

[0026] The first data is parsed, and the parsed first data is packaged into data blocks and stored in the first data transmission interface.

[0027] The present invention matches the data type of the server with the transmission interface, so that one data transmission port interface can match multiple servers, solves the technical problem of poor platform scalability caused by one-to-one servers in the prior art, improves data compatibility, and uses the transmission interface to package, store and transmit data, avoiding data occupation in the platform and improving the platform's data processing efficiency.

[0028] As a preferred example, determining the processing mode of the data transmission request through the configuration of the second data transmission interface, responding to the data transmission request according to the processing mode, and controlling the second data transmission interface to perform data access on the first data acquired by the first data transmission interface includes:

[0029] Parsing the configuration of the second data transmission interface to determine the interface type of the second data transmission interface, and determining the processing method according to the interface type; wherein the processing content of processing the data transmission request in the processing method corresponds to the interface type of the second data transmission interface;

[0030] Converting the data transmission request into a first format; wherein the data transmission request includes descriptor information of the first data;

[0031] The data transmission request converted into the first format is sent to the second data transmission interface, so that the second data transmission interface accesses a data block corresponding to the data transmission request in the data stored in the first data transmission interface.

[0032] In order to solve the problem of data transmission between transmission interfaces of different interface types, the present invention uses the interface type to convert the format of the descriptor information of the first data in the data transmission request, so that the second data transmission interface can access the first data according to the description information after the format conversion, so that the information platform can support data access between different types of transmission interfaces and improve data compatibility.

[0033] As a preferred example, in response to the data transmission request, obtaining a data conversion rule corresponding to the first data from a preset data conversion rule table, and performing format conversion on the first data according to the data conversion rule to obtain second data corresponding to the second server, includes:

[0034] Constructing a rule index corresponding to the first data according to the first data type and the second data type;

[0035] According to the rule index, spatial indexing is performed from a preset data conversion rule table through a preset spatial indexing algorithm to determine the data conversion rule corresponding to the first data; wherein the data conversion rule includes any one or more rules of custom field value, field name, field type, unit conversion rule and field matching priority.

[0036] The present invention constructs an index between the two types of data and uses a spatial index algorithm to traverse the set data conversion rule table to accurately obtain the corresponding data conversion rules, thereby improving the accuracy of data format conversion. At the same time, the present invention can improve the efficiency of data conversion by presetting different data conversion rules in advance.

[0037] As a preferred example, the receiving, through the second data transmission interface, a notification message generated by the second server according to the processing result, includes:

[0038] receiving a notification message sent by the second data transmission interface, and converting the notification message into a second format; wherein the notification message indicates that the data transmission is completed;

[0039] The notification message converted into the second format is sent to the first data transmission interface, and the converted notification message is sent to the first server through the first data transmission interface.

[0040] The present invention utilizes the transmission interface to transmit a notification message to complete data transmission between servers, so that the server can subsequently detect the quality of data transmission according to the notification message.

[0041] On the other hand, the present invention also discloses an information platform data expansion system, including an interface configuration module, a request parsing module, an interface startup module, a data access module, a data conversion module and a data transmission module;

[0042] The interface configuration module is used to deploy a plurality of data transmission interfaces on the information platform to be expanded, and configure each of the plurality of data transmission interfaces;

[0043] The request parsing module is used to determine, according to the data transmission request received by the information platform, a first data type of a first server for sending data and a second data type of a second server for receiving data to which the data transmission request belongs;

[0044] The interface startup module is used to start the first data transmission interface and the second data transmission interface according to the first data type, the second data type and the configuration, and obtain the first data sent by the first server through the first data transmission interface;

[0045] The data access module is used to determine the processing method of the data transmission request through the configuration of the second data transmission interface, respond to the data transmission request according to the processing method, and control the second data transmission interface to perform data access on the first data acquired by the first data transmission interface;

[0046] The data conversion module is used to obtain the data conversion rule corresponding to the first data from a preset data conversion rule table in response to the data transmission request during the data access process, and perform format conversion on the first data according to the data conversion rule to obtain the second data corresponding to the second server;

[0047] The data transmission module is used to send the second data to the second server through the second data transmission interface so that the second server processes the second data, and receive a notification message generated by the second server according to the processing result through the second data transmission interface.

[0048] The present invention discloses an information platform data expansion system, which first deploys multiple data transmission interfaces on the information platform, and configures each data transmission interface so that subsequently, through the configuration of the data transmission interfaces, one data transmission interface can receive data sent by multiple servers or send data to multiple servers through one data transmission interface, thereby avoiding the technical problem of heavy workload caused by building a one-to-one data transmission channel for servers in the prior art. At the same time, when a new server appears for data transmission, data transmission can be realized by matching the data transmission interface corresponding to the type of the new server, thereby greatly improving the scalability of the information platform.

[0049] Next, the data transmission request received by the information platform is parsed to determine the first server and the second server at both ends of the data transmission, and the data transmission interface matching the above-mentioned servers is determined. Accurate data transmission between servers is achieved through the data transmission interface, which improves the accuracy of data transmission while avoiding the processing of useless data, thereby improving the efficiency of data transmission. Furthermore, after starting the first data transmission corresponding to the first server, after obtaining the first data to be uploaded by the first server, considering that the corresponding data types in different data transmission interfaces are different, the data transmission request is first processed using the configuration of the second data transmission interface, so that the second data transmission interface can access the first data transmission interface according to the processed data transmission request, and in the process of access, the first data is converted into a format according to the matched data conversion rule to obtain the second data acceptable to the second server. Therefore, the present invention uses one data conversion to complete the data transmission between different servers, avoiding the technical problem of repeated data conversion caused by setting a unified format on the information platform in the prior art, effectively reducing the data that needs to be processed by the information platform, and improving the efficiency of data processing.

[0050] As a preferred example, the interface configuration module includes a space access unit and an interface deployment unit;

[0051] The space access unit is used to access the storage space for data recording in the information platform, obtain multiple data transmission records stored in the storage space within a preset time period, and determine a number of servers connected to the information platform according to the multiple data transmission records; wherein the data transmission record includes a server identifier and a data transmission time;

[0052] The interface deployment unit is used to determine the data transmission interfaces to be deployed according to the plurality of servers and configure interface parameters for each of the data transmission interfaces; wherein the interface parameters include data transmission type, data source connection port, transmission mode, interface name and data sending method.

[0053] The present invention obtains the data transmission records saved in the information platform and determines the multiple servers that transmit data to the information platform within a certain period of time, so as to avoid the waste of time caused by the arrangement of useless transmission interfaces and improve the efficiency of data transmission. At the same time, the corresponding data transmission interfaces are deployed according to the above-mentioned determined servers, so that a many-to-many data transmission channel can be realized through the data transmission interface, thereby improving the scalability of the platform and ensuring accurate data transmission between servers.

[0054] As a preferred example, the request parsing module includes an identification parsing unit and an identification matching unit;

[0055] The identification resolution unit is used to resolve the data transmission request to determine a first identification of a first server for sending data and a second identification of a second server for receiving data;

[0056] The identifier matching unit is used to query a table for recording server information in the information platform according to the first identifier and the second identifier, and determine a first data type of the first server and a second data type of the second server.

[0057] The present invention identifies the data types of servers at both ends of data transmission so as to subsequently match a data transmission interface with the same data type, so that the matched transmission interface can directly obtain the data uploaded by the server, avoiding data conversion between the transmission interface and the server, and improving the efficiency of data processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1 : A flow chart of a method for expanding data on an information platform disclosed in an embodiment of the present invention;

[0059] Figure 2 : A structural diagram of an information platform data expansion system disclosed in an embodiment of the present invention;

[0060] Figure 3: A flow chart of a method for expanding data on an information platform disclosed in another embodiment of the present invention. DETAILED DESCRIPTION

[0061] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0062] Embodiment 1

[0063] This embodiment discloses a method for expanding data on an information platform. For the specific implementation process of the expansion method, please refer to Figure 1 , mainly including steps 101 to 106, the steps mainly include:

[0064] Step 101: deploy a plurality of data transmission interfaces on an information platform to be expanded, and configure each of the plurality of data transmission interfaces.

[0065] In this embodiment, this step mainly includes: accessing the storage space for data recording in the information platform, obtaining multiple data transmission records saved in the storage space within a preset time period, and determining a number of servers connected to the information platform based on the multiple data transmission records; wherein the data transmission record includes a server identifier and a data transmission time; determining the data transmission interface to be deployed based on the several servers and configuring the interface parameters of each data transmission interface; wherein the interface parameters include data transmission type, data source connection port, transmission mode, interface name and data sending method.

[0066] In this embodiment, this step obtains the data transmission records saved in the information platform to determine the multiple servers that transmit data to the information platform within a certain period of time, thereby avoiding the waste of time caused by the arrangement of useless transmission interfaces and improving the efficiency of data transmission. At the same time, the corresponding data transmission interfaces are deployed according to the above-mentioned determined servers, so that a many-to-many data transmission channel can be realized through the data transmission interface, thereby improving the scalability of the platform and ensuring accurate data transmission between servers.

[0067] Step 102: According to the data transmission request received by the information platform, determine the first data type of the first server for sending data and the second data type of the second server for receiving data to which the data transmission request belongs.

[0068] In this embodiment, this step mainly includes: parsing the data transmission request to determine a first identifier of a first server for sending data and a second identifier of a second server for receiving data;

[0069] A table for recording server information in the information platform is queried according to the first identifier and the second identifier to determine a first data type of the first server and a second data type of the second server.

[0070] In this embodiment, this step identifies the data types of the servers at both ends of the data transmission so that a data transmission interface with the same data type can be subsequently matched, so that the matched transmission interface can directly obtain the data uploaded by the server, avoiding data conversion between the transmission interface and the server, and improving the efficiency of data processing.

[0071] Step 103: start a first data transmission interface and a second data transmission interface according to the first data type, the second data type and the configuration, and obtain first data sent by the first server through the first data transmission interface.

[0072] In this embodiment, this step mainly includes: matching the first data type and the second data type with the interface parameters of each data transmission interface respectively, determining the first data transmission interface corresponding to the first server and the second data transmission interface corresponding to the second server; starting the first data transmission interface to read the first data from the first server; parsing the first data, and packaging the parsed first data into data blocks and saving them in the first data transmission interface.

[0073] In this embodiment, this step uses the data type of the server to match the transmission interface, so that one data transmission port interface can match multiple servers, solving the technical problem of poor platform scalability caused by one-to-one servers in the prior art, improving data compatibility, and at the same time using the transmission interface to package, store and transmit data, avoiding data occupation in the platform and improving the platform's data processing efficiency.

[0074] Step 104: Determine a processing method for the data transmission request through the configuration of the second data transmission interface, respond to the data transmission request according to the processing method, and control the second data transmission interface to access the first data obtained by the first data transmission interface.

[0075] In this embodiment, this step mainly includes: parsing the configuration of the second data transmission interface to determine the interface type of the second data transmission interface, and determining the processing method according to the interface type; wherein the processing content of the data transmission request processed by the processing method corresponds to the interface type of the second data transmission interface; converting the data transmission request to a first format; wherein the data transmission request includes descriptor information of the first data; sending the data transmission request converted to the first format to the second data transmission interface, so that the second data transmission interface accesses the data block corresponding to the data transmission request in the data stored in the first data transmission interface.

[0076] In this embodiment, in order to solve the data transmission between transmission interfaces of different interface types, this step uses the interface type to convert the format of the descriptor information of the first data in the data transmission request, so that the second data transmission interface can access the first data according to the description information after the format conversion, so that the information platform can support data access between different types of transmission interfaces and improve data compatibility.

[0077] Step 105: During the data access process, in response to the data transmission request, obtain the data conversion rule corresponding to the first data from a preset data conversion rule table, and perform format conversion on the first data according to the data conversion rule to obtain the second data corresponding to the second server.

[0078] In this embodiment, this step mainly includes: constructing a rule index corresponding to the first data based on the first data type and the second data type; based on the rule index, performing spatial indexing from a preset data conversion rule table through a preset spatial indexing algorithm to determine the data conversion rule corresponding to the first data; wherein the data conversion rule includes any one or more rules of custom field value, field name, field type, unit conversion rule and field matching priority.

[0079] In this embodiment, this step constructs an index between the two types of data and uses a spatial index algorithm to traverse the set data conversion rule table to accurately obtain the corresponding data conversion rules, thereby improving the accuracy of data format conversion. At the same time, the present invention can improve the efficiency of data conversion by presetting different data conversion rules in advance.

[0080] Step 106: Send the second data to the second server through the second data transmission interface, so that the second server processes the second data, and receive a notification message generated by the second server according to the processing result through the second data transmission interface.

[0081] In this embodiment, this step mainly includes: receiving a notification message sent by the second data transmission interface, and converting the notification message into a second format; wherein the notification message indicates the end of data transmission; sending the notification message converted into the second format to the first data transmission interface, and sending the converted notification message to the first server through the first data transmission interface.

[0082] In this embodiment, this step utilizes the transmission interface to transmit a notification message to complete data transmission between servers, so that the server can subsequently detect the quality of data transmission according to the notification message.

[0083] On the other hand, this embodiment also discloses an information platform data expansion system. For the specific structure of the expansion system, please refer to Figure 2 , mainly includes an interface configuration module 201, a request parsing module 202, an interface startup module 203, a data access module 204, a data conversion module 205 and a data transmission module 206.

[0084] The interface configuration module 201 is used to deploy a plurality of data transmission interfaces on the information platform to be expanded, and configure each of the plurality of data transmission interfaces.

[0085] The request parsing module 202 is used to determine the first data type of the first server for sending data and the second data type of the second server for receiving data to which the data transmission request belongs according to the data transmission request received by the information platform.

[0086] The interface startup module 203 is used to start the first data transmission interface and the second data transmission interface according to the first data type, the second data type and the configuration, and obtain the first data sent by the first server through the first data transmission interface.

[0087] The data access module 204 is used to determine the processing method of the data transmission request through the configuration of the second data transmission interface, respond to the data transmission request according to the processing method, and control the second data transmission interface to access the first data obtained by the first data transmission interface.

[0088] The data conversion module 205 is used to obtain the data conversion rules corresponding to the first data from a preset data conversion rule table in response to the data transmission request during the data access process, and convert the format of the first data according to the data conversion rules to obtain the second data corresponding to the second server.

[0089] The data transmission module 206 is used to send the second data to the second server through the second data transmission interface so that the second server processes the second data, and receive a notification message generated by the second server according to the processing result through the second data transmission interface.

[0090] In this embodiment, the interface configuration module 201 includes a space access unit and an interface deployment unit.

[0091] The space access unit is used to access the storage space for data recording in the information platform, obtain multiple data transmission records stored in the storage space within a preset time period, and determine a number of servers connected to the information platform based on the multiple data transmission records; wherein the data transmission record includes a server identifier and a data transmission time.

[0092] The interface deployment unit is used to determine the data transmission interfaces to be deployed according to the plurality of servers and configure interface parameters for each of the data transmission interfaces; wherein the interface parameters include data transmission type, data source connection port, transmission mode, interface name and data sending method.

[0093] In this embodiment, the request resolution module 202 includes an identification resolution unit and an identification matching unit.

[0094] The identifier resolution unit is used to resolve the data transmission request to determine a first identifier of a first server for sending data and a second identifier of a second server for receiving data.

[0095] The identifier matching unit is used to query a table for recording server information in the information platform according to the first identifier and the second identifier, and determine a first data type of the first server and a second data type of the second server.

[0096] Embodiment 2

[0097] This embodiment further discloses a method for expanding data on an information platform. For the specific implementation process of the expansion method, please refer to Figure 3 , mainly including steps 301 to 306, the steps are mainly:

[0098] Step 301: access the storage space of the information platform to obtain the data transmission record of the information platform, deploy a number of data transmission interfaces on the information platform according to the data transmission record, and configure each data transmission interface.

[0099] In this embodiment, this step mainly includes: accessing the multiple data transmission records saved in the storage space within a preset time period, and determining a number of servers connected to the information platform based on the multiple data transmission records, determining the data transmission interfaces to be deployed based on the several servers and configuring the interface parameters of each data transmission interface.

[0100] Specifically, in this embodiment, the database for storing data transmission records in the information platform is first queried. Specifically, the data transmission records can be stored in the form of configuration files, relationship tables, etc. In order to respond to changes in the addition or deletion of servers in the information platform, the data transmission records in a recent period of time are queried from the database, and a number of servers that actually send data to the information platform are determined from the data transmission records, wherein the data transmission record includes the identifier of the server that sends or receives data, and the time when the data transmission record is generated, wherein the identifier of the server can be the server number, feature code, etc. that can uniquely identify the server.

[0101] After determining a plurality of server terminals for data transmission with the information platform, a plurality of data transmission interfaces are deployed on the information platform according to the same features and distinguishing features of the plurality of servers for data transmission, so that the data transmission of the corresponding servers can be realized through the data transmission interfaces. Preferably, after the data transmission interface is deployed, the data transmission interface needs to be set so that the data transmission interface has the function of data transmission. Optionally, the data transmission type and the data source connection port of each data transmission interface are set, wherein the data transmission type can be one or more combinations of data transmission types of opc da / ua server, osipi, DTU device, relational database or industry protocol, and the data source connection port can be set to one or more combinations of various communication ports in the prior art. Further, the data transmission mode and interface name of each data transmission interface are set, wherein the data transmission mode can be set to one or more combinations of existing communication protocol transmission according to scene requirements, and the interface name can be customized. The data sending mode of each data transmission interface is set, wherein the change data sending refers to data collection and update only when the tag data changes according to the set scanning frequency; the data sending value is based on the set scanning frequency, and the data will be collected and updated regardless of whether the tag data changes.

[0102] Step 302: Parse the received data transmission request to determine the first server that sends the data and its corresponding first data type and the second server that receives the data and its corresponding second data type.

[0103] In this embodiment, this step mainly includes: parsing the data transmission request, determining the first identifier of the first server and the second identifier of the second server, querying the table for recording server information in the information platform according to the first identifier and the second identifier, and determining the first data type of the first server and the second data type of the second server.

[0104] Specifically, in this embodiment, before parsing the data transmission request, the information platform and the server communicate through a communication protocol. After the server is connected to the network, it will publish its own terminal identification and data type and other information to the information platform through the communication protocol. The information platform saves the information of each server in the form of a table.

[0105] After receiving the data transmission request, this embodiment first parses the data transmission request to determine the first identifier of the first server and the second identifier of the second server at both ends of the data transmission. The accuracy of data transmission is ensured by parsing the identifiers to avoid data transmission errors. After parsing and determining the first identifier and the second identifier, the table for storing server information in the information platform is queried to determine the first data type of the first server and the data type of the second server.

[0106] Step 303: Start the first data transmission interface and the second data transmission interface according to the configuration and the first data type and the second data type, and obtain the first data sent by the first server through the first data transmission interface.

[0107] In this embodiment, the step mainly includes: matching the first data type and the second data type with the interface parameters of each data transmission interface respectively, determining the first data transmission interface corresponding to the first server and the second data transmission interface corresponding to the second server, starting the first data transmission interface to read the first data from the first server, parsing the first data, and packaging the parsed first data into data blocks and saving them in the first data transmission interface.

[0108] Specifically, the data type of the server is matched with the data transmission type configured for each data transmission interface, and a first data transmission interface that can be used to transmit data of the first server and a second data transmission interface that can be used to transmit data of the second server are determined, thereby enabling servers corresponding to different data types to be connected to a unified information platform through the data transmission interfaces.

[0109] After matching the corresponding first data transmission interface, the first data transmission interface is started. The first data transmission interface reads the first data to be uploaded from the specified data source, namely the first server. The first data transmission interface parses the read or received first data, and packages the parsed data into data blocks and saves them, thereby avoiding the data processing volume of the information platform and improving the efficiency of data processing.

[0110] Step 304: Determine a processing method for the data transmission request according to the configuration of the second data transmission interface, respond to the data transmission request according to the processing method, and control the second data transmission interface to access the first data obtained by the first data transmission interface.

[0111] In this embodiment, the step is specifically: determining the interface type of the second data transmission interface according to the configuration, and converting the data transmission request into a first format according to the interface type, so that the second data transmission interface accesses the first data in the data saved by the first data transmission interface according to the data transmission request after format conversion.

[0112] Specifically, since data cannot be directly accessed between data transmission interfaces of different interface types, this embodiment sets different processing methods for processing data transmission requests according to different interface types, wherein the processing content of the processing method when processing the data processing request corresponds to the interface type of the transmission interface, that is, the transmission interface corresponding to the data processing request is different, and the processing content such as data format and data content when processing the data specified by the transmission interface of the data processing request is correspondingly different. This embodiment takes the transmission interface as the Virtio interface as an example. When the driver sends a data processing request, it is implemented by updating the register in the Virtio interface. The corresponding processing content is the register read and write content. The Virtio register module will know the address and number of ready-to-use descriptors based on this update operation, and tell the descriptor engine in the subsequent DMA interface the address and number of descriptors to be read.

[0113] Preferably, the data transmission requests are sent in sequence in the form of a buffer queue. After obtaining the buffer queue, each data transmission processing request is converted to the first format in sequence. It should be noted that the conversion to the first format can be understood as: information conversion from the protocol format corresponding to the first data transmission interface to the protocol format corresponding to the second data transmission interface. Different data transmission interfaces have different conversion methods when performing format conversion, wherein the descriptor information may include: the address, size and other information of at least one descriptor. The data transmission request converted from the first format is sent to the second data transmission interface, wherein after the conversion to the first format, the descriptor information in the data transmission request can be recognized by the second data transmission interface, and the second data transmission interface reads the first data corresponding to the descriptor information in the data specified by the first data transmission interface.

[0114] Step 305: In response to the data transmission request, a data conversion rule corresponding to the first data is obtained from a preset data conversion rule table, and the format of the first data is converted according to the data conversion rule to obtain second data corresponding to the second server.

[0115] In this embodiment, the step is specifically as follows: searching a pre-constructed data conversion rule table according to the first data type and the second data type to determine the data conversion rule corresponding to the first data, and then, according to the data conversion rule, performing format conversion on the first data through a preset format conversion program to obtain the second data.

[0116] Specifically, in this embodiment, the format conversion rule corresponding to the first data type is searched from a preset data conversion rule table according to the correspondence between the first data type and the second data type; wherein the format conversion rule includes any one of a data type, a data name, a unit conversion rule, and a data matching priority, and format conversion is performed on each data in the first data according to the format conversion rule to obtain the second data.

[0117] Specifically, corresponding format conversion rules can be specified according to the corresponding relationship between the data types corresponding to the servers at both ends of the data transmission, and the format conversion rules can be used to convert the first data of the first server into second data that conforms to the format of the second server. In this embodiment, a set of format conversion programs is written in advance and deployed at a specific location in the memory. The format conversion program will query the rule table at regular intervals and parse each read first data into the second data according to the corresponding format conversion rules. By setting up only one set of adapters, the adaptation rules can be dynamically configured, and the source data can be dynamically increased, which significantly reduces the amount of code.

[0118] Furthermore, after pre-setting the format conversion program, the acquired format conversion rules are used to determine, through the preset format conversion program, from a preset rule table any one or more format conversion rules including data name, data type, unit conversion rules and data matching priority corresponding to the data uploaded by each server.

[0119] Step 306: Send the second data to the second server through the second data transmission interface, so that the second server processes the second data, and receive a notification message generated by the second server according to the processing result through the second data transmission interface.

[0120] In this embodiment, the step is specifically: receiving the notification message sent by the second data transmission interface, and converting the notification message to a second format; wherein the notification message indicates the end of data transmission, sending the notification message converted by the second format to the first data transmission interface, and sending the converted notification message to the first server through the first data transmission interface.

[0121] The present embodiment discloses a method and system for expanding data on an information platform. First, a plurality of data transmission interfaces are deployed on the information platform, and each data transmission interface is configured so that, subsequently, through the configuration of the data transmission interfaces, one data transmission interface can receive data sent by a plurality of servers or send data to a plurality of servers through one data transmission interface, thereby avoiding the technical problem of heavy workload caused by constructing a one-to-one data transmission channel between servers in the prior art. Meanwhile, when a new server appears for data transmission, data transmission can be realized by matching the data transmission interface corresponding to the type of the new server, thereby greatly improving the scalability of the information platform.

[0122] Next, the data transmission request received by the information platform is parsed to determine the first server and the second server at both ends of the data transmission, and the data transmission interface matching the above-mentioned servers is determined. Accurate data transmission between servers is achieved through the data transmission interface, which improves the accuracy of data transmission while avoiding the processing of useless data, thereby improving the efficiency of data transmission. Furthermore, after starting the first data transmission corresponding to the first server, after obtaining the first data to be uploaded by the first server, considering that the corresponding data types in different data transmission interfaces are different, the data transmission request is first processed using the configuration of the second data transmission interface, so that the second data transmission interface can access the first data transmission interface according to the processed data transmission request, and in the process of access, the first data is converted into a format according to the matched data conversion rule to obtain the second data acceptable to the second server. Therefore, the present invention uses one data conversion to complete the data transmission between different servers, avoiding the technical problem of repeated data conversion caused by setting a unified format on the information platform in the prior art, effectively reducing the data that needs to be processed by the information platform, and improving the efficiency of data processing.

[0123] The specific embodiments described above further illustrate the purpose, technical solutions and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. It is particularly pointed out that for those skilled in the art, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of protection of the present invention.

Claims

1. A data expansion method for an information platform, characterized in that: include: Deploy a plurality of data transmission interfaces on the information platform to be expanded, and configure each of the plurality of data transmission interfaces; Determine, according to the data transmission request received by the information platform, a first data type of a first server for sending data and a second data type of a second server for receiving data to which the data transmission request belongs; The first data transmission interface and the second data transmission interface are started according to the first data type, the second data type and the configuration, and the first data sent by the first server is obtained through the first data transmission interface; wherein the first data type and the second data type are matched with the interface parameters of each data transmission interface respectively, and the first data transmission interface corresponding to the first server and the second data transmission interface corresponding to the second server are determined; the first data transmission interface is started to read the first data from the first server; the first data is parsed, and the parsed first data is packaged into a data block and stored in the first data transmission interface; Determine a processing method for the data transmission request through the configuration of the second data transmission interface, respond to the data transmission request according to the processing method, and control the second data transmission interface to access the first data acquired by the first data transmission interface; In the data access process, in response to the data transmission request, a data conversion rule corresponding to the first data is obtained from a preset data conversion rule table, and the first data is formatted according to the data conversion rule to obtain second data corresponding to the second server; The second data is sent to the second server through the second data transmission interface so that the second server processes the second data, and a notification message generated by the second server according to the processing result is received through the second data transmission interface.

2. The method for expanding data on an information platform according to claim 1, characterized in that: The step of deploying a plurality of data transmission interfaces on the information platform to be expanded and configuring each of the plurality of data transmission interfaces includes: Accessing a storage space for data recording in the information platform, obtaining a plurality of data transmission records within a preset time period stored in the storage space, and determining a number of servers connected to the information platform according to the plurality of data transmission records; wherein the data transmission record includes a server identifier and a data transmission time; Determine the data transmission interfaces to be deployed according to the plurality of servers and configure interface parameters for each of the data transmission interfaces; wherein the interface parameters include data transmission type, data source connection port, transmission mode, interface name and data sending method.

3. The method for expanding data on an information platform according to claim 1, characterized in that: The step of determining, according to the data transmission request received by the information platform, a first data type of a first server for sending data and a second data type of a second server for receiving data to which the data transmission request belongs, comprises: Parsing the data transmission request to determine a first identifier of a first server for sending data and a second identifier of a second server for receiving data; A table for recording server information in the information platform is queried according to the first identifier and the second identifier to determine a first data type of the first server and a second data type of the second server.

4. The method for expanding data on an information platform according to claim 1, characterized in that: The method of determining a processing mode of the data transmission request by configuring the second data transmission interface, responding to the data transmission request according to the processing mode, and controlling the second data transmission interface to access the first data acquired by the first data transmission interface includes: Parsing the configuration of the second data transmission interface to determine the interface type of the second data transmission interface, and determining the processing method according to the interface type; wherein the processing content of processing the data transmission request in the processing method corresponds to the interface type of the second data transmission interface; Converting the data transmission request into a first format; wherein the data transmission request includes descriptor information of the first data; The data transmission request converted into the first format is sent to the second data transmission interface, so that the second data transmission interface accesses a data block corresponding to the data transmission request in the data stored in the first data transmission interface.

5. The method for expanding data on an information platform according to claim 1, characterized in that: The step of acquiring a data conversion rule corresponding to the first data from a preset data conversion rule table in response to the data transmission request, and performing format conversion on the first data according to the data conversion rule to obtain second data corresponding to the second server includes: Searching a pre-constructed data conversion rule table according to the first data type and the second data type to determine a data conversion rule corresponding to the first data; wherein the data conversion rule includes any one or more of a custom field value, a field name, a field type, a unit conversion rule, and a field matching priority; According to the data conversion rule, the first data is format converted by a preset format conversion program to obtain the second data.

6. The method for expanding data on an information platform according to claim 1, characterized in that: The receiving, through the second data transmission interface, a notification message generated by the second server according to the processing result, includes: receiving a notification message sent by the second data transmission interface, and converting the notification message into a second format; wherein the notification message indicates that the data transmission is completed; The notification message converted into the second format is sent to the first data transmission interface, and the converted notification message is sent to the first server through the first data transmission interface.

7. An information platform data expansion system, characterized in that: It includes an interface configuration module, a request parsing module, an interface startup module, a data access module, a data conversion module and a data transmission module; The interface configuration module is used to deploy a plurality of data transmission interfaces on the information platform to be expanded, and configure each of the plurality of data transmission interfaces; The request parsing module is used to determine, according to the data transmission request received by the information platform, a first data type of a first server for sending data and a second data type of a second server for receiving data to which the data transmission request belongs; The interface startup module is used to start the first data transmission interface and the second data transmission interface according to the first data type, the second data type and the configuration, and obtain the first data sent by the first server through the first data transmission interface; wherein the first data type and the second data type are matched with the interface parameters of each data transmission interface respectively, and the first data transmission interface corresponding to the first server and the second data transmission interface corresponding to the second server are determined; the first data transmission interface is started to read the first data from the first server; the first data is parsed, and the parsed first data is packaged into a data block and stored in the first data transmission interface; The data access module is used to determine the processing method of the data transmission request through the configuration of the second data transmission interface, respond to the data transmission request according to the processing method, and control the second data transmission interface to perform data access on the first data acquired by the first data transmission interface; The data conversion module is used to obtain the data conversion rule corresponding to the first data from a preset data conversion rule table in response to the data transmission request during the data access process, and perform format conversion on the first data according to the data conversion rule to obtain the second data corresponding to the second server; The data transmission module is used to send the second data to the second server through the second data transmission interface so that the second server processes the second data, and receive a notification message generated by the second server according to the processing result through the second data transmission interface.

8. The information platform data expansion system according to claim 7, characterized in that: The interface configuration module includes a space access unit and an interface deployment unit; The space access unit is used to access the storage space for data recording in the information platform, obtain multiple data transmission records stored in the storage space within a preset time period, and determine a number of servers connected to the information platform according to the multiple data transmission records; wherein the data transmission record includes a server identifier and a data transmission time; The interface deployment unit is used to determine the data transmission interfaces to be deployed according to the plurality of servers and configure interface parameters for each of the data transmission interfaces; wherein the interface parameters include data transmission type, data source connection port, transmission mode, interface name and data sending method.

9. The information platform data expansion system according to claim 7, characterized in that: The request parsing module includes an identification parsing unit and an identification matching unit; The identification resolution unit is used to resolve the data transmission request to determine a first identification of a first server for sending data and a second identification of a second server for receiving data; The identifier matching unit is used to query a table for recording server information in the information platform according to the first identifier and the second identifier, and determine a first data type of the first server and a second data type of the second server.

Images