Data interfacing method, apparatus, device, and storage medium
By calling heterogeneous data scripts and connecting to an isolated gateway, the problem of customized development when connecting data from multiple vendors is solved, achieving efficient data connection and reducing costs.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-17
- Publication Date
- 2026-03-31
AI Technical Summary
In existing technologies, data integration with multiple vendors requires customized development, resulting in poor timeliness and increasing the workload and timeliness of version development.
By calling a heterogeneous data script to collect heterogeneous data, inputting it into a preset text file and storing it in a heterogeneous database, accessing the heterogeneous database to obtain the target heterogeneous data, and connecting with the isolation gateway through the external interface to transmit the target heterogeneous data, data connection without customized development is achieved.
It improved data integration efficiency, reduced data error rates and integration costs, and enabled heterogeneous data integration between different vendors.
Smart Images

Figure CN115202717B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computers, and specifically to a data interface method, apparatus, device, and storage medium. Background Technology
[0002] Currently, existing financial and banking service companies generally need to connect with multiple brand vendors for data exchange during operation. However, the existing data exchange method involves customized development according to the requirements of brand vendors, designing table structures to store and exchange data based on the outgoing fields. This leads to an increase in the workload of the version process and a delay in the launch time required for scenarios that require rapid integration and launch. Summary of the Invention
[0003] This application provides a data docking method, apparatus, device, and storage medium, aiming to solve the technical problem in the prior art that data docking between multiple vendors requires customized development and has poor timeliness.
[0004] On one hand, embodiments of this application provide a data docking method, which includes the following steps:
[0005] Heterogeneous data is collected by calling a heterogeneous data script, wherein the heterogeneous data script is a DSP big data script;
[0006] The heterogeneous data is entered into a preset text file to generate a heterogeneous data text file, and the heterogeneous data text file is stored in a preset heterogeneous database, wherein the heterogeneous database is a database that stores several different types of heterogeneous data.
[0007] Access the heterogeneous database to obtain target heterogeneous data, and match the external interface based on the target heterogeneous data;
[0008] The target heterogeneous data is transmitted by connecting to a preset isolation gateway via the external interface, wherein the isolation gateway is a protocol converter that interfaces with terminals from various manufacturers.
[0009] In one possible implementation of this application, the data script is invoked to collect the heterogeneous data to be interfaced, including:
[0010] Obtain the data type of the heterogeneous data to be collected, configure a preset script template file according to the data type, and generate a heterogeneous data script;
[0011] The heterogeneous data script is invoked to interface with a preset big data platform to collect a number of heterogeneous data from the big data platform.
[0012] In one possible implementation of this application, the step of inputting the heterogeneous data into a preset text file, generating a heterogeneous data text file, and storing the heterogeneous data text file into a preset heterogeneous database includes:
[0013] The acquired heterogeneous data is entered into a preset text file to generate a heterogeneous data text file;
[0014] Perform text recognition on the heterogeneous data text file to determine the heterogeneous data in the heterogeneous data text file;
[0015] The heterogeneous data is saved to a preset heterogeneous database according to the data type of the heterogeneous data.
[0016] In one possible implementation of this application,
[0017] The process of accessing the heterogeneous database to obtain target heterogeneous data and matching the external interface based on the target heterogeneous data includes:
[0018] In response to a data outbound request, obtain the terminal identifier and target outbound field associated with the data outbound request;
[0019] The heterogeneous database is traversed according to the target outgoing field to obtain the target heterogeneous data pointed to by the data outgoing request;
[0020] The target heterogeneous data and the terminal identifier are matched for external transmission to determine the external transmission interface of the target heterogeneous data.
[0021] In one possible implementation of this application, the step of transmitting the target heterogeneous data by connecting the external interface to a preset isolation gateway includes:
[0022] The isolation gateway is driven to establish a communication connection with the terminal corresponding to the terminal identifier based on the terminal identifier;
[0023] The target heterogeneous data is transmitted to the external interface, and then connected to the isolation gateway based on the external interface.
[0024] The isolation gateway is driven to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier.
[0025] In one possible implementation of this application, after driving the isolation gateway to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier, the method further includes:
[0026] Receive the outgoing feedback information of the target heterogeneous data, and determine the outgoing status of the target heterogeneous data based on the outgoing feedback information;
[0027] If the outbound status is outbound failure, then parse the target heterogeneous data and obtain the data to be resent from the target heterogeneous data;
[0028] The isolation gateway is driven to transmit the data to be retransmitted to the terminal corresponding to the terminal identifier.
[0029] In one possible implementation of this application, storing the heterogeneous data text into a preset heterogeneous database includes:
[0030] Obtain the heterogeneous data extension fields of the pre-created heterogeneous database;
[0031] Receive a business change message and obtain the field change rules of the heterogeneous data pointed to by the business change message;
[0032] Configure the heterogeneous data extension field according to the field change rules, associate the heterogeneous data with the heterogeneous data extension field, and save it to the preset heterogeneous database.
[0033] On the other hand, this application provides a data docking device, the data docking device comprising:
[0034] The data acquisition module is configured to call a heterogeneous data script to collect heterogeneous data;
[0035] The data entry module is configured to input the heterogeneous data into a preset text file, generate a heterogeneous data text file, and store the heterogeneous data text file into a preset heterogeneous database.
[0036] The outbound matching module is configured to access the heterogeneous database to obtain target heterogeneous data and match outbound interfaces based on the target heterogeneous data;
[0037] The data transmission module is configured to connect with a preset isolation gateway through the transmission interface to transmit the target heterogeneous data.
[0038] On the other hand, this application also provides a data interface device, the data interface device comprising:
[0039] One or more processors;
[0040] Memory; and
[0041] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the data interface method.
[0042] On the other hand, this application also provides a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to execute the steps in the data docking method.
[0043] This application collects heterogeneous data by calling a heterogeneous data script; the collected heterogeneous data is then entered into a preset text file, generating a heterogeneous text file, which is then stored in a preset heterogeneous database. This allows for the configuration and storage of heterogeneous data without requiring specific code development. After storing the heterogeneous data in the heterogeneous database, the database is accessed to retrieve the target heterogeneous data. An external interface is matched based on this target heterogeneous data, and the interface connects to an isolation gateway. The isolation gateway then transmits the target heterogeneous data to the corresponding vendor's receiving terminal. This enables configuration and connection of different heterogeneous data without requiring programming development, improving data connection efficiency, reducing data error rates, and lowering data connection costs. Attached Figure Description
[0044] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0045] Figure 1 This is a schematic diagram illustrating a scenario of the data docking method in an embodiment of this application;
[0046] Figure 2 This is a flowchart illustrating one embodiment of the data interoperability method in this application.
[0047] Figure 3 A flowchart illustrating a heterogeneous embodiment of the data interoperability method for determining the data interoperability status provided in this application.
[0048] Figure 4 This is a schematic diagram of a process in an embodiment of the data docking method of this application, which stores heterogeneous data text files into a preset heterogeneous database.
[0049] Figure 5 This is a schematic diagram of one embodiment of the data docking device in this application.
[0050] Figure 6 This is a schematic diagram of one embodiment of the data docking device in this application. Detailed Implementation
[0051] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0052] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of the stated features. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.
[0053] In this application, the term "exemplary" is used to mean "serving as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use the invention. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that the invention can be made without using these specific details. In other instances, well-known structures and processes will not be described in detail to avoid obscuring the description of the invention with unnecessary detail. Therefore, the invention is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.
[0054] Currently, existing financial and banking service companies generally need to connect with multiple brand vendors for data exchange during operation. However, the existing data exchange method involves customized development according to the requirements of brand vendors, designing table structures to store and exchange data based on the outgoing fields. This leads to an increase in the workload of the version process and a delay in the launch time required for scenarios that require rapid integration and launch.
[0055] Based on this, this application proposes a data docking method, apparatus, device, and computer-readable storage medium to solve the technical problem in the prior art that data docking between multiple vendors requires customized development and has poor timeliness.
[0056] The data docking method in this embodiment of the invention is applied to a data docking device, which is set in a data docking equipment. The data docking equipment is equipped with one or more processors, a memory, and one or more application programs. The one or more application programs are stored in the memory and configured to be executed by the processor to implement the data docking method. The data docking equipment can be a smart terminal, such as a mobile phone, tablet computer, smart TV, network device, and smart computer. Optionally, the data docking equipment can also be a server or a service cluster composed of multiple servers.
[0057] like Figure 1 As shown, Figure 1 This is a schematic diagram of a data docking method according to an embodiment of the present application. The data docking scenario in this embodiment includes a data docking device 100 (the data docking device 100 integrates a data docking apparatus), and the data docking device 100 is equipped with a computer-readable storage medium corresponding to the data docking method to execute the steps of the data docking method.
[0058] Understandable Figure 1 The data docking devices in the data docking method scenario shown, or the devices contained in the data docking devices, do not constitute a limitation on the embodiments of the present invention. That is, the number or type of data docking devices in the data docking method scenario, or the number or type of devices contained in each device, do not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be considered as equivalent substitutions or derivatives of the technical solutions claimed in the embodiments of the present invention.
[0059] In this embodiment of the invention, the data interface device 100 is mainly used for:
[0060] Call the heterogeneous data script to collect heterogeneous data;
[0061] The heterogeneous data is entered into a preset text file to generate a heterogeneous data text file, and the heterogeneous data text file is stored in a preset heterogeneous database.
[0062] Access the heterogeneous database to obtain target heterogeneous data, and match the external interface based on the target heterogeneous data;
[0063] The target heterogeneous data is transmitted by connecting to a preset isolation gateway through the external interface.
[0064] In this embodiment of the invention, the data docking device 100 can be an independent data docking device, such as a mobile phone, tablet computer, smart TV, network device, server and smart computer, or a data docking network or data docking cluster composed of multiple data docking devices.
[0065] This application provides a data docking method, apparatus, device, and computer-readable storage medium, which will be described in detail below.
[0066] It will be understood by those skilled in the art that Figure 1 The application environment shown is only one application scenario related to the solution of this application and does not constitute a limitation on the application scenario of this application. Other application environments may include more than one application scenario. Figure 1 The number of data connection devices shown, or the data connection network connections, for example Figure 1 Only one data docking device is shown in the figure. It can be understood that the scenario of this data docking method may also include one or more data docking devices, which are not limited here. The data docking device may also include a memory for storing heterogeneous data and other data.
[0067] It should be noted that, Figure 1 The schematic diagram of the data docking method shown is merely an example. The scenarios of the data docking method described in the embodiments of the present invention are intended to more clearly illustrate the technical solutions of the embodiments of the present invention and do not constitute a limitation on the technical solutions provided in the embodiments of the present invention.
[0068] Based on the scenarios described above for data docking methods, various embodiments of the data docking method disclosed in this invention are proposed.
[0069] like Figure 2 As shown, Figure 2 This is a flowchart illustrating one embodiment of the data docking method in this application. The data docking method includes the following steps 201-204:
[0070] 201. Call the heterogeneous data script to collect heterogeneous data;
[0071] The data docking method in this embodiment is applied to a data docking device. The type and number of data docking devices are not specifically limited. That is, the data docking device can be one or more intelligent terminals or servers that monitor the operation of logistics nodes. In a specific embodiment, the data docking device is an intelligent computer.
[0072] The data docking device is configured to establish communication connections with various vendors, acquire and store heterogeneous data from each vendor, and send target heterogeneous data to the corresponding vendor. Specifically, during operation, the data docking device receives data docking requests. These requests can be user-initiated; for example, a data docking personnel from a financial institution or bank could click the data docking button on the device to initiate a data docking request for one or more vendors. Furthermore, the data docking nodes are pre-programmed with a scheduled docking process that automatically triggers data docking requests within a preset time period. The data docking request is an instruction to the data docking device to acquire heterogeneous data from various vendors and / or send target heterogeneous data to the corresponding vendor.
[0073] Upon receiving a data connection request, the data connection device invokes a pre-defined heterogeneous data script to collect the heterogeneous data from the target vendor. Specifically, each vendor's smart terminal and data connection device connect to a pre-defined big data platform for data connection. The corresponding smart terminal from each vendor transmits the heterogeneous data to be connected to the big data platform. The data connection device establishes a communication connection with the big data platform and invokes the pre-defined heterogeneous data script to periodically collect the heterogeneous data from the target vendor from the big data platform.
[0074] Specifically, after receiving a data connection request, the data connection device obtains the data type of the heterogeneous data to be collected, and generates a heterogeneous data script for collecting the heterogeneous data by configuring a preset script template file according to the data type.
[0075] After configuring the heterogeneous data, the data docking device calls upon the heterogeneous data and a preset big data platform to dock, collecting several heterogeneous data points from the big data platform. Optionally, the heterogeneous data script can also be configured to set a timed docking command to periodically collect data from the big data platform. Optionally, the heterogeneous data script can be a DSP big data script.
[0076] Optionally, in one specific embodiment, the big data platform establishes a communication connection with the core system and channel system of auto finance. The core system and channel system of auto finance upload heterogeneous data to the big data platform. The data docking device generates a heterogeneous data script corresponding to the heterogeneous data of the core system and channel system of auto finance, and collects the heterogeneous data of the core system and channel system of auto finance through the heterogeneous data script.
[0077] 202. Input the heterogeneous data into a preset text file to generate a heterogeneous data text file, and store the heterogeneous data text file into a preset heterogeneous database;
[0078] After collecting heterogeneous data from the big data platform via a heterogeneous data script, the data docking device inputs the heterogeneous data into a preset text file, generates a heterogeneous data text file, and then stores this heterogeneous data text file in a preset heterogeneous database. The heterogeneous database stores several data tables corresponding to different types of heterogeneous data.
[0079] Specifically, before collecting heterogeneous data, the data docking device pre-creates a heterogeneous database and defines the fields of the data tables in the heterogeneous database, thereby aggregating the data tables corresponding to several different types of heterogeneous data to obtain a heterogeneous database.
[0080] After inputting heterogeneous data into a preset text file to generate a heterogeneous data text file, the data interface device further parses this heterogeneous data text file through the Horae (an active interval task executor) platform to determine the heterogeneous data within it. Specifically, after acquiring the heterogeneous data text file, the data interface device inputs it into the Horae platform. The Horae platform generates a parsing task queue and asynchronously performs natural language processing on the heterogeneous data in the text file to obtain the various heterogeneous data items carried within it. These heterogeneous data items include text fields and corresponding parameters. The heterogeneous data text fields vary depending on the interface manufacturer. Optionally, when the interface manufacturer is an automobile manufacturer, the heterogeneous data text fields may include document number, contract number, parking lot type, sending date, and creation date.
[0081] After asynchronously recognizing heterogeneous data in a heterogeneous data text file, the data docking device stores the recognized heterogeneous data into the corresponding fields of the heterogeneous data text database. Optionally, in one specific embodiment, after asynchronously recognizing the heterogeneous data text file, the data docking device determines that the parking lot type in the heterogeneous data text file is a first parking lot type, and then stores this first parking lot type into the parking lot type field of the heterogeneous database corresponding to the heterogeneous data. This achieves the storage of heterogeneous data in the database.
[0082] 203. Access heterogeneous databases to obtain target heterogeneous data, and match external interfaces based on the target heterogeneous data;
[0083] After parsing the heterogeneous data text file, obtaining the heterogeneous data and storing it in a preset heterogeneous database, the data docking device receives a data outgoing request. Upon receiving the data outgoing request, it accesses the heterogeneous database, obtains the target heterogeneous data, and matches the corresponding outgoing docking interface based on the target heterogeneous data.
[0084] Specifically, after receiving a data transmission request from the corresponding manufacturer, the data interface device obtains the terminal identifier associated with the data transmission request.
[0085] Optionally, after obtaining the terminal identifier of the data transmission request, the data interface device performs a security verification on the terminal identifier to determine the legitimacy of the data transmission request. Specifically, the data interface device obtains the verification data from the terminal identifier and compares it with the verification data stored in the data interface device. If the verification data matches the verification data, the data transmission request is determined to be a legitimate data transmission request. Optionally, the data interface device may also use other verification methods that can achieve the effect of legitimacy verification.
[0086] After receiving a data outbound request, the data interface device obtains the target outbound field of the request and determines the target heterogeneous data to be retrieved based on this field. Specifically, the data interface device accesses a heterogeneous database, reads the heterogeneous data stored in the database, and retrieves the target heterogeneous data corresponding to the target outbound field. The data interface device then retrieves the target heterogeneous data corresponding to the data outbound request.
[0087] Specifically, the data interface device pre-sets different outbound interface interfaces for terminals from different manufacturers and for different types of heterogeneous data. These different outbound interface interfaces connect to terminals from different manufacturers and for heterogeneous data of different data types. After determining the target heterogeneous data and the terminal identifier, the data interface device performs outbound matching based on the target heterogeneous data and the terminal identifier of the data outbound request, thereby determining the outbound interface for the target heterogeneous data.
[0088] 204. Connect the external interface to the preset isolation gateway to transmit the target heterogeneous data.
[0089] After matching the target heterogeneous data's outgoing interface according to the data type and terminal identifier, the data interface device connects to a pre-defined isolation gateway via that outgoing interface and transmits the target heterogeneous data to the terminal corresponding to the terminal identifier. The isolation gateway is a protocol converter pre-defined by the data interface device for connecting to terminals from different manufacturers and transmitting target heterogeneous data to the corresponding terminals via different outgoing interfaces.
[0090] Specifically, the data docking device drives the isolation gateway to establish a communication connection with the terminal corresponding to the terminal identifier based on the terminal identifier. After the isolation gateway establishes a communication connection with the terminal, it drives the isolation gateway to switch to the outgoing docking interface corresponding to the outgoing data, transmits the target heterogeneous data to the outgoing docking interface, and docks with the isolation gateway based on the outgoing docking interface. After the docking is completed, it drives the isolation gateway to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier, thus realizing data docking.
[0091] In this embodiment, the data interface device collects heterogeneous data by calling a heterogeneous data script; it then inputs the collected heterogeneous data into a preset text file, generates a heterogeneous text file, and stores this heterogeneous data text file in a preset heterogeneous database. This allows for the configuration and storage of heterogeneous data without the need for specific code development. After storing the heterogeneous data in the heterogeneous database, the device accesses the database to obtain the target heterogeneous data. Based on this target heterogeneous data, it matches an external interface and connects with an isolation gateway. The isolation gateway then transmits the target heterogeneous data to the corresponding vendor's receiving terminal. This enables configuration and interface for different heterogeneous data without the need for programming development, improving data interface efficiency, reducing data error rates, and lowering data interface costs.
[0092] like Figure 3 As shown, Figure 3 This is a flowchart illustrating a heterogeneous embodiment of the data docking method for determining the data docking status, as provided in the embodiments of this application.
[0093] Based on the above embodiments, in this application embodiment, after the driver isolation gateway transmits the target heterogeneous data to the terminal corresponding to the terminal identifier, it further determines the outward status of the target heterogeneous data based on the outward feedback information. Specifically, it includes steps 301-303:
[0094] 301. Receive the outgoing feedback information of the target heterogeneous data, and determine the outgoing status of the target heterogeneous data based on the outgoing feedback information;
[0095] 302. If the outbound status is outbound failure, then parse the target heterogeneous data and obtain the data to be resent from the target heterogeneous data;
[0096] 303. Drive the isolation gateway to transmit the data to be retransmitted to the terminal corresponding to the terminal identifier.
[0097] In this embodiment, after the data docking device drives the isolation gateway to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier, it sends an outgoing status query request to the terminal corresponding to the terminal identifier after a preset waiting time. The outgoing status query request is an operation instruction to request the terminal receiving the target heterogeneous data to transmit outgoing feedback information.
[0098] After sending an outgoing status query request to the terminal corresponding to the terminal identifier, the data docking device receives outgoing feedback information related to the target heterogeneous data transmitted by the terminal based on the outgoing status query request. The data docking device parses the outgoing feedback information and determines the outgoing status of the target heterogeneous data based on the outgoing feedback information.
[0099] Optionally, if the data docking device receives feedback information indicating that the target heterogeneous data transmission failed, it determines that the transmission status of the target heterogeneous data is a transmission failure. In this case, the data docking device switches to the backup transmission docking interface and retransmits the transmission data to the terminal according to the backup transmission docking interface.
[0100] Optionally, in another embodiment, if the outgoing feedback information received by the data docking device indicates that the target heterogeneous data portion failed to be transmitted, the data docking device parses the target heterogeneous data and compares the target heterogeneous data with the transmitted target heterogeneous data to determine the data to be retransmitted in the target heterogeneous data, wherein the data to be retransmitted is the portion of the target heterogeneous data that failed to be transmitted.
[0101] After identifying the data to be resent, the data docking device switches to the backup external interface for the target heterogeneous data and transmits the data to be resent to the isolation gateway through the backup external interface. The isolation gateway then retransmits the data to be resent to the terminal corresponding to the terminal identifier through the backup external interface and determines the resentment status of the data. The data docking device determines that the data to be resent has been successfully resent when it receives the resentment success information transmitted by the terminal.
[0102] Optionally, if the data docking device receives feedback that the target heterogeneous data has been successfully sent, the data docking device determines that the outgoing status of the target heterogeneous data is successful and continues to transmit new target heterogeneous data to the terminal corresponding to the terminal identifier.
[0103] In this embodiment, after the data docking device calls the isolation gateway to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier, it receives the outgoing feedback information corresponding to the target heterogeneous data sent by the terminal, and determines the outgoing status of the target heterogeneous data based on the outgoing feedback information; when it determines that the outgoing status of the target data is outgoing failure based on the outgoing feedback information, it parses the target outgoing information, determines the data to be retransmitted in the target heterogeneous data, and drives the isolation gateway to transmit the data to be retransmitted to the terminal corresponding to the terminal identifier, thereby ensuring the integrity and correctness of the target heterogeneous data and improving the accuracy of data docking.
[0104] like Figure 4 As shown, Figure 4 This is a schematic diagram of a process in an embodiment of the data docking method of this application, which stores heterogeneous data text files into a preset heterogeneous database.
[0105] Based on the above embodiments, this application embodiment also reserves extended fields for heterogeneous data tables in heterogeneous databases, and dynamically updates the heterogeneous database according to these extended fields. Specifically, it includes steps 401-403:
[0106] 401. Obtain the heterogeneous data extended fields of the pre-created heterogeneous database;
[0107] 402. Receive a business change message and obtain the field change rules of the heterogeneous data pointed to by the business change message;
[0108] 403. Configure the heterogeneous data extension field according to the field change rules, associate the heterogeneous data with the heterogeneous data extension field, and save it to the preset heterogeneous database.
[0109] In this embodiment, after the data docking device collects heterogeneous data to be docked from the big data platform through a heterogeneous data script, it enters the heterogeneous data into a preset text file, generates a heterogeneous data text file, and stores the heterogeneous data text file in a preset heterogeneous database. The heterogeneous database stores several data tables corresponding to different types of heterogeneous data.
[0110] Specifically, after powering on, the data docking device creates different database tables based on the heterogeneous data of the docking vendor, and sets fixed fields and extended fields for the heterogeneous data of that vendor in these database tables. The fixed fields for the heterogeneous data are the field content of a certain parameter of the heterogeneous data, defined by the data docking device according to the actual application scenario. In one specific embodiment, the fixed fields for the vendor's heterogeneous data include document number, contract number, parking lot type, sending date, and creation date.
[0111] Specifically, the data interface device is also equipped with modifiable heterogeneous data extension fields to adapt to changes in the business of the interface vendors. During operation, the data interface device receives business change messages transmitted by the interface vendors and obtains the field change rules of the heterogeneous data pointed to in the business change message. These field change rules are operation instructions that request the data interface device to change or extend the corresponding fields of the target heterogeneous data.
[0112] After receiving a business change message from the vendor, the data docking device obtains the field change rule, locates the heterogeneous data pointed to by the field change rule, configures the heterogeneous data extension field according to the field change rule, and after receiving the heterogeneous data from the vendor, performs text parsing on the heterogeneous data, associates the heterogeneous data with the configured heterogeneous data extension field, and stores it in a preset heterogeneous database.
[0113] In this embodiment, when creating a heterogeneous database, the data docking device pre-creates the heterogeneous data extension field of the heterogeneous database. During operation, it receives the service change message transmitted by the docking vendor, obtains the heterogeneous data pointed to by the service change message, obtains the field change rules of the heterogeneous data, configures the heterogeneous data extension field according to the field change rules, and stores the heterogeneous data and the heterogeneous data extension field in the heterogeneous database in association, thereby realizing dynamic matching of heterogeneous data and improving the scalability of heterogeneous data storage.
[0114] To better implement the data docking method in the embodiments of this application, a data docking device is also provided in the embodiments of this application, such as... Figure 5 As shown, Figure 5 This is a schematic diagram of one embodiment of a data docking device. The data docking device 500 includes the following modules 501 to 504:
[0115] Data acquisition module 501 is configured to call a heterogeneous data script to acquire heterogeneous data;
[0116] The data entry module 502 is configured to enter the heterogeneous data into a preset text file, generate a heterogeneous data text file, and store the heterogeneous data text file into a preset heterogeneous database.
[0117] The outbound matching module 503 is configured to access a heterogeneous database to obtain target heterogeneous data and match an outbound interface based on the target heterogeneous data.
[0118] The data transmission module 504 is configured to connect with a preset isolation gateway through the transmission interface to transmit the target heterogeneous data.
[0119] In some embodiments of this application, the data docking device calls a data script to collect heterogeneous data to be docked, including:
[0120] Obtain the data type of the heterogeneous data to be collected, configure a preset script template file according to the data type, and generate a heterogeneous data script;
[0121] The heterogeneous data script is invoked to interface with a preset big data platform to collect a number of heterogeneous data from the big data platform.
[0122] In some embodiments of this application, the data interface device inputs the heterogeneous data into a preset text file, generates a heterogeneous data text file, and stores the heterogeneous data text file into a preset heterogeneous database, including:
[0123] The acquired heterogeneous data is entered into a preset text file to generate a heterogeneous data text file;
[0124] Perform text recognition on the heterogeneous data text file to determine the heterogeneous data in the heterogeneous data text file;
[0125] The heterogeneous data is saved to a preset heterogeneous database according to its data type. In some embodiments of this application, the data interface device accesses the heterogeneous database to obtain target heterogeneous data, and matches an external interface interface according to the target heterogeneous data, including:
[0126] In response to a data outbound request, obtain the terminal identifier and target outbound field associated with the data outbound request;
[0127] The heterogeneous database is traversed according to the target outgoing field to obtain the target heterogeneous data pointed to by the data outgoing request;
[0128] Based on the target heterogeneous data and the terminal identifier, an outbound matching process is performed to determine the outbound interface for the target heterogeneous data. In some embodiments of this application, the data interface device interfaces with an isolation gateway according to the outbound interface to transmit the target heterogeneous data, including:
[0129] The isolation gateway is driven to establish a communication connection with the terminal corresponding to the terminal identifier based on the terminal identifier;
[0130] The target heterogeneous data is transmitted to the external interface, and then connected to the isolation gateway based on the external interface.
[0131] The isolation gateway is driven to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier.
[0132] In some embodiments of this application, after the data docking device drives the isolation gateway to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier, it further includes:
[0133] Receive the outgoing feedback information of the target heterogeneous data, and determine the outgoing status of the target heterogeneous data based on the outgoing feedback information;
[0134] If the outbound status is outbound failure, then parse the target heterogeneous data and obtain the data to be resent from the target heterogeneous data;
[0135] The isolation gateway is driven to transmit the data to be retransmitted to the terminal corresponding to the terminal identifier.
[0136] In some embodiments of this application, the data interface device stores the heterogeneous data text into a preset heterogeneous database, including:
[0137] Obtain the heterogeneous data extension fields of the pre-created heterogeneous database;
[0138] Receive a business change message and obtain the field change rules of the heterogeneous data pointed to by the business change message;
[0139] Configure the heterogeneous data extension field according to the field change rules, associate the heterogeneous data with the heterogeneous data extension field, and save it to the preset heterogeneous database.
[0140] In this embodiment, the data interface device collects heterogeneous data by calling a heterogeneous data script; it then inputs the collected heterogeneous data into a preset text file, generates a heterogeneous text file, and stores this heterogeneous data text file in a preset heterogeneous database. This allows for the configuration and storage of heterogeneous data without requiring specific code development. After storing the heterogeneous data in the heterogeneous database, the device accesses the database to obtain the target heterogeneous data. Based on this target heterogeneous data, it matches an external interface and connects to an isolation gateway. The isolation gateway then transmits the target heterogeneous data to the corresponding vendor's receiving terminal. This enables configuration and interface for different types of heterogeneous data, achieving heterogeneous data interface between different vendors without the need for programming development, improving data interface efficiency, reducing data error rates, and lowering data interface costs.
[0141] This invention also provides a data interface device, such as... Figure 6 As shown, Figure 6 This is a schematic diagram of one embodiment of the data docking device provided in this application.
[0142] The data docking device integrates any one of the data docking apparatuses provided in the embodiments of the present invention, and the data docking device includes:
[0143] One or more processors;
[0144] Memory; and
[0145] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor from the steps of the data docking method described in any of the above embodiments of the data docking method.
[0146] Specifically, the data interface device may include components such as a processor 601 with one or more processing cores, a memory 602 with one or more computer-readable storage media, a power supply 603, and an input unit 604. Those skilled in the art will understand that... Figure 6 The data interface device structure shown does not constitute a limitation on the data interface device. It may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:
[0147] The processor 601 is the control center of the data docking device. It connects various parts of the data docking device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 602, and by calling data stored in the memory 602, it performs various functions and processes data, thereby providing overall monitoring of the data docking device. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 601.
[0148] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the data interface device, etc. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.
[0149] The data interface device also includes a power supply 603 that supplies power to the various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 603 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.
[0150] The data interface device may also include an input unit 604, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
[0151] Although not shown, the data docking device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the data docking device loads the executable files corresponding to the processes of one or more applications into the memory 602 according to the following instructions, and the processor 601 runs the applications stored in the memory 602 to realize various functions, as follows:
[0152] Call the heterogeneous data script to collect heterogeneous data;
[0153] The heterogeneous data is entered into a preset text file to generate a heterogeneous data text file, and the heterogeneous data text file is stored in a preset heterogeneous database.
[0154] Access heterogeneous databases to obtain target heterogeneous data, and match external interfaces based on the target heterogeneous data;
[0155] The target heterogeneous data is transmitted by connecting to a preset isolation gateway through the external interface. In the above embodiments, the descriptions of each embodiment have different focuses. Parts not detailed in a particular embodiment can be found in the detailed descriptions of other embodiments above, and will not be repeated here.
[0156] In practice, each of the above units or structures can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units or structures, please refer to the previous method embodiments, which will not be repeated here.
[0157] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.
[0158] The data docking method provided by the embodiments of this application has been described in detail above. Specific embodiments have been used to illustrate the principle and implementation of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core idea of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation and application scope based on the idea of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.
Claims
1. A data interfacing method, characterized by, The data docking method comprises: calling a heterogeneous data script to collect heterogeneous data, wherein the heterogeneous data script is a batch timing task big data script; entering the heterogeneous data into a preset text file to generate a heterogeneous data text file, and storing the heterogeneous data text file into a preset heterogeneous database, wherein the heterogeneous database is a database for storing several different types of heterogeneous data; in response to a data external sending request, obtaining a terminal identifier and a target external sending field associated with the data external sending request; traversing the heterogeneous database according to the target external sending field to obtain target heterogeneous data pointed to by the data external sending request; performing external sending matching according to the target heterogeneous data and the terminal identifier to determine an external sending docking interface of the target heterogeneous data; docking the external sending docking interface with a preset isolation gateway to transmit the target heterogeneous data, wherein the isolation gateway is a protocol converter for docking with each vendor terminal; the entering of the heterogeneous data into the preset text file to generate the heterogeneous data text file, and the storing of the heterogeneous data text file into the preset heterogeneous database, comprises: entering the obtained heterogeneous data into the preset text file to generate the heterogeneous data text file; performing text recognition on the heterogeneous data text file to determine the heterogeneous data in the heterogeneous data text file; saving the heterogeneous data to the preset heterogeneous database according to the data type of the heterogeneous data; the storing of the heterogeneous data text file into the preset heterogeneous database, comprises: obtaining a heterogeneous data extension field of the heterogeneous database created in advance; receiving a business change message to obtain a field change rule of heterogeneous data pointed to by the business change message; configuring the heterogeneous data extension field according to the field change rule, and saving the heterogeneous data associated with the heterogeneous data extension field to the preset heterogeneous database.
2. The data docking method of claim 1, wherein, the calling of the heterogeneous data script to collect the heterogeneous data, comprises: obtaining the data type of the heterogeneous data to be collected, configuring a preset script template file according to the data type to generate a heterogeneous data script; calling the heterogeneous data script to dock with a preset big data platform to collect several heterogeneous data of the big data platform.
3. The data docking method of claim 1, wherein, the docking of the external sending docking interface with the preset isolation gateway to transmit the target heterogeneous data, comprises: driving the isolation gateway to establish a communication connection with a terminal corresponding to the terminal identifier according to the terminal identifier; transmitting the target heterogeneous data to the external sending docking interface based on the docking of the external sending docking interface with the isolation gateway; driving the isolation gateway to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier.
4. The data docking method of claim 3, wherein, after the driving of the isolation gateway to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier, further comprising: receiving external sending feedback information of the target heterogeneous data, and determining an external sending state of the target heterogeneous data according to the external sending feedback information; if the external sending state is external sending failure, analyzing the target heterogeneous data to obtain to-be-retransmitted data in the target heterogeneous data; The isolated gateway is driven to transmit the to-be-retransmitted data to a terminal corresponding to the terminal identifier.
5. A data docking device, characterized by The data interfacing apparatus comprises: a data acquisition module configured to invoke a heterogeneous data script to acquire heterogeneous data; a data warehousing module configured to record the heterogeneous data into a preset text file, generate a heterogeneous data text file, and store the heterogeneous data text file into a preset heterogeneous database; an outgoing matching module configured to, in response to a data outgoing request, acquire a terminal identifier and a target outgoing field associated with the data outgoing request, traverse the heterogeneous database according to the target outgoing field, acquire target heterogeneous data pointed to by the data outgoing request, and perform outgoing matching according to the target heterogeneous data and the terminal identifier to determine an outgoing interfacing interface of the target heterogeneous data; a data outgoing module configured to interface the outgoing interfacing interface with a preset isolated gateway to transmit the target heterogeneous data; The data interfacing apparatus records the heterogeneous data into a preset text file, generates a heterogeneous data text file, and stores the heterogeneous data text file into a preset heterogeneous database, which comprises: recording the acquired heterogeneous data into a preset text file to generate a heterogeneous data text file; performing text recognition on the heterogeneous data text file to determine heterogeneous data in the heterogeneous data text file; saving the heterogeneous data to a preset heterogeneous database according to a data type of the heterogeneous data; The data interfacing apparatus stores the heterogeneous data text file into a preset heterogeneous database, which comprises: acquiring a heterogeneous data extension field of the heterogeneous database created in advance; receiving a service change message to acquire a field change rule of heterogeneous data pointed to by the service change message; configuring the heterogeneous data extension field according to the field change rule, associating the heterogeneous data with the heterogeneous data extension field, and saving to a preset heterogeneous database.
6. A data docking device, characterized by The data interfacing apparatus comprises: one or more processors; a memory; and one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the data interfacing method of any one of claims 1 to 4.
7. A computer readable storage medium characterized in that, A computer program is stored thereon, and the computer program is loaded by a processor to execute steps of the data interfacing method of any one of claims 1 to 4.
Citation Information
Patent Citations
Heterogeneous processing method and apparatus thereof
CN102630087A
Heterogeneous system integration method and device, computer equipment and storage medium
CN111683066A