A data access method, device, apparatus, system and storage medium

Abstract

The application discloses a data access method, device, equipment, system and storage medium. The application relates to the technical field of big data. The method comprises the following steps: a data access center acquires an interface document according to identification information of the interface document; the interface document is a document containing a preset association relationship between a data source platform and the data access center; the data access center acquires platform data of the data source platform, and converts the platform data into a first data model of the data access center according to the interface document; a second data model of the data access center is generated according to the first data model and a preset model rule of the data access center, and the generated first data model is converted into the second data model. The technical scheme of the application can achieve the technical effects of not needing to customize data access development for each platform, reducing data access cost and improving data access efficiency.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of big data, and particularly relate to a data access method, device, equipment, system and storage medium. BACKGROUND

[0002] In the prior art, a data center needs to continuously access massive platform data during construction for comprehensive processing.

[0003] When data is accessed, platform data needs to be converted into data meeting the requirements of the data center. Since the data of each platform has differences in format, etc., each platform needs to have its own independent logical conversion rule, and usually needs to be customized and developed for each platform, which results in a large amount of resources being consumed and the efficiency of data access being reduced. SUMMARY

[0004] Embodiments of the present application provide a data access method, device, equipment, system and storage medium to solve the problem of a large amount of resources being consumed and low efficiency of data access.

[0005] In a first aspect, embodiments of the present application provide a data access method, comprising:

[0006] The data access center acquires an interface document according to identification information of the interface document, wherein the interface document is a document containing a preset association relationship between a data source platform and the data access center;

[0007] The data access center acquires platform data of the data source platform, and converts the platform data into a first data model of the data access center according to the interface document;

[0008] A second data model of the data access center is generated according to the first data model and a preset model rule of the data access center.

[0009] In a second aspect, embodiments of the present application further provide a data access device, comprising:

[0010] An interface document acquisition module is configured to acquire, by a data access center, an interface document according to identification information of the interface document, wherein the interface document is a document containing a preset association relationship between a data source platform and the data access center;

[0011] A first model conversion module is configured to acquire, by the data access center, platform data of the data source platform, and convert the platform data into a first data model of the data access center according to the interface document;

[0012] The second model generation module is configured to generate a second data model of the data access center according to the first data model and preset model rules of the data access center.

[0013] In a third aspect, an electronic device is provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the data access method according to any of the embodiments of the present application when executing the program.

[0014] In a fourth aspect, a computer readable storage medium is provided, which stores a computer program executable by a processor to implement the data access method according to any of the embodiments of the present application.

[0015] In a fifth aspect, a computer program product is provided, which includes a computer program executable by a processor to implement the data access method according to any of the embodiments of the present application.

[0016] In the embodiments of the present application, the data access center obtains the interface document according to the identification information of the interface document, wherein the interface document is a document containing a preset association relationship between the data source platform and the data access center; the data access center obtains platform data of the data source platform, and converts the platform data into a first data model of the data access center according to the interface document, so that the converted platform data meets the data use requirements of the data access center, realizes the unification of data standards, and when the data standards are changed, the interface document can be directly modified without the need for customized development for each platform, thereby reducing the cost of data access and improving the efficiency of data access. Different data models and different data rules in different data source platforms can be accessed to the same data access center, and the rapid construction of the data access center is realized.

[0017] According to the first data model and the preset model rules of the data access center, a second data model of the data access center is generated, and the generated first data model is converted into the second data model, so that the data is suitable for the data access center, facilitating the subsequent use of the data access center, and improving the effectiveness of data access. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be considered as limiting the scope. For those skilled in the art, other related drawings can also be obtained without creative labor.

[0019] Figure 1The flow of the data access method provided for the embodiment of the present application Figure One ;

[0020] Figure 2 The flow of the data access method provided for the embodiment of the present application Figure Two ;

[0021] Figure 3 The flow of the data access method provided for the embodiment of the present application Figure Three ;

[0022] Figure 4 The flow of the data access method provided for the embodiment of the present application Figure Four ;

[0023] Figure 5 The flow of the data access method provided for the embodiment of the present application Figure Five ;

[0024] Figure 6 The structural schematic diagram of a data access device provided for the embodiment of the present application

[0025] Figure 7 The structural schematic diagram of an electronic device for implementing the embodiment of the present application. DETAILED DESCRIPTION

[0026] The present application will be further described below in conjunction with the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only the parts related to the present application are shown in the drawings, but not all the structures.

[0027] It should be noted that: similar labels and letters represent similar items in the following drawings, therefore, once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings. At the same time, in the description of the present application, the terms "first", "second" and the like are only used to distinguish the description, and cannot be understood as indicating or implying relative importance. The acquisition, storage, use, processing and the like of data in the technical solution of the present application all comply with the relevant provisions of national laws and regulations.

[0028] The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0029] Figure 1 The flow of the data access method provided for the embodiment of the present application Figure One . As shown in Figure 1 , the data access method comprises:

[0030] In step 110, the data access center acquires the interface document according to the identification information of the interface document; the interface document is a document containing a preset association relationship between the data source platform and the data access center.

[0031] The data access center is used for uniformly accessing data of each platform, and can be a user data center, which is not limited in the embodiment. Each data access center can access data of one or more platforms.

[0032] The identification information of the interface document can be a document ID or other information used for uniquely identifying the identity of the document. According to the identification information, the interface document can be acquired by querying the preset position where each interface document is stored according to the identification information before the platform data of the platform is acquired.

[0033] The interface document includes a preset association relationship between the data source platform and the data access center, wherein the data source platform is a platform providing data sources, and the preset association relationship can include a physical model relationship and a data rule, a code value conversion relationship, etc. between the data source platform and the data access center, which is not limited in the embodiment.

[0034] Optionally, before the data access center acquires the interface document according to the identification information of the interface document, the method further includes:

[0035] According to the preset association relationship between the data source platform and the data access center, the interface document is generated;

[0036] The interface document is imported into a second database of the data access center, and the identification information of the interface document is determined.

[0037] According to the preset association relationship between the data source platform and the data access center, the interface document is generated, wherein the preset association relationship can be determined in advance by the data source platform and the data access center.

[0038] The generated interface document is imported into a second database of the data access center, and the interface document is identified by unique identification information. The interface documents corresponding to different data source platforms can be stored in the same database, so that the interface documents can be uniformly queried according to the identification information in subsequent use, and the query efficiency of the interface document is improved.

[0039] In step 120, the data access center acquires platform data of the data source platform, and converts the platform data into a first data model of the data access center according to the interface document.

[0040] The platform data of the data source platform is data that the data source platform needs to provide to the data access center, and the acquisition mode can be that the data source platform transmits to the data storage position of the data access center, which is not limited in the embodiment.

[0041] According to the interface document, the platform data is converted into the first data model of the data access center. The data access center can automatically generate a data processing conversion script of the data source platform according to the content of the interface document, and call the script to perform standardized processing on the platform data of the data source platform, for example, converting the platform data into data conforming to the data format of the data access center, and the first data model is composed of the standardized processed data. The first data model can be composed of different tables containing data.

[0042] Optionally, the data access center obtains the platform data of the data source platform, including:

[0043] The data source platform generates platform data in a preset format according to the data acquisition requirement of the data access center.

[0044] The data access center obtains the platform data in the preset format from the data source platform.

[0045] The data source platform generates platform data in a preset format according to the data acquisition requirement of the data access center. The data acquisition requirement can be a data format acquisition requirement. For example, the data acquisition requirement of the data access center is to generate information in an EXCEL format. The data source platform generates a copy of the platform data in the EXCEL format and sends it to the data access center, so that the data access center obtains the platform data in the preset format.

[0046] By generating platform data in a preset format, the platform data transmitted by each data source platform to the data access center is in a unified format, which solves the problem that the data access platform needs to use multiple ways to process data if the obtained platform data formats are not unified, and increases the processing difficulty. Through format unification, the data processing efficiency of the data access center is improved.

[0047] Step 130, generating a second data model of the data access center according to the first data model and a preset model rule of the data access center.

[0048] The preset model rule is a rule for processing data in the first data model, for example, merging, splitting or retaining the data as is. For example, if the first data model includes table A and table B, according to the first data model and the preset model rule of the data access center, the second data model of the data access center can be generated by merging table A and table B, splitting table A into A1 and A2, merging A1 with other tables in the data center, or retaining the original table A and table B, etc. This embodiment is not limited thereto.

[0049] According to the preset model rule, the first data model is adjusted to generate the second data model of the data access center.

[0050] The embodiment obtains the interface document according to the identification information of the interface document by the data access center, wherein the interface document is a document containing a preset association relationship between the data source platform and the data access center; the data access center obtains platform data of the data source platform, and converts the platform data into a first data model of the data access center according to the interface document, so that the converted platform data meets the data use requirements of the data access center, realizes the unification of data standards, and when the data standards are changed, the interface document can be directly modified, without the need for customized development for each platform, thereby reducing the cost of data access and improving the efficiency of data access. Different data models and different data rules in different data source platforms can be accessed to the same data access center, and the rapid construction of the data access center is realized.

[0051] According to the first data model and the preset model rule of the data access center, a second data model of the data access center is generated, the generated first data model is converted into the second data model, so that the data is suitable for the data access center, and the data access center is convenient for subsequent direct use, thereby improving the effectiveness of data access.

[0052] Figure 2 The data access method provided by the embodiment of the application Figure Two As shown in Figure 2 , the data access method comprises the following steps:

[0053] Step 210, the data access center obtains the interface document according to the identification information of the interface document; wherein the interface document is a document containing a preset association relationship between the data source platform and the data access center.

[0054] Step 220, the data access center obtains data information and table structure information from the data source platform.

[0055] The data information is the data of the data source platform that needs to be accessed to the data access center, for example, account information, personal basic information, authentication information, associated enterprise information, etc. The range of the data information can be determined in advance, for example, all the data in the data source platform is accessed, or part of the data is accessed, and the embodiment does not limit this.

[0056] The table structure information is the structure information of the table storing the data in the data source platform, for example, the table name, the contained fields, the field name, the field type, the width, etc. of each field. The table structure information of the table storing the range of the obtained data information can be obtained according to the determined range.

[0057] Optionally, the data information is obtained from the data source platform, comprising:

[0058] Obtaining the data information from the data source platform to the preset storage location of the data access center;

[0059] Reading the data information from the preset storage location to the local of the data access center in response to the data read operation.

[0060] Obtaining the data information from the data source platform to the preset storage location of the data access center can be a directory specified by the data source platform for sending the data information to the data access center, wherein the preset storage location can be located in the cloud of the data access center.

[0061] Reading the data information from the preset storage location to the local of the data access center in response to the data read operation, wherein the data read operation can be issued by the data access center for reading the corresponding data information, which can be issued at a time or when the data information is needed; and when reading the data information, all unread data can be read, or part of the unread data can be read, which is not limited by the embodiment.

[0062] By obtaining the data information from the data source platform to the preset storage location of the data access center, the data information is temporarily stored, and the data information is read from the preset storage location to the local of the data access center in response to the data read operation, so that the required data information is read to the local of the data access center, which avoids increasing the pressure of the data access center by reading a large amount of data at a time, and reads the data information from the preset storage location when the data access center actually needs the data information, thereby speeding up the data read speed.

[0063] Optionally, loading the data information into the target table comprises:

[0064] According to the table information of the target table, the data information related to the target table is loaded into the target table from the local of the data access center.

[0065] According to the table information of the target table, the data information related to the target table is loaded into the target table from the local of the data access center. Wherein, the table information can be the table name information of the target table, the data information can have a preset association relationship with the table name information, according to the table name information of the target table, the data information related to the target table in the local of the data access center is determined, so that the data information related to the target table is loaded into the target table. The data information loaded in the target table is associated with the target table, which improves the accuracy of data loading.

[0066] Step 230, generating a table creation statement according to the table structure information, and executing the table creation statement in the first database of the data access center to obtain the target table.

[0067] The table structure information is used for generating a table building statement, and the table building statement is used for creating a new table.

[0068] The table building statement is executed in the first database of the data access center to obtain the target table, that is, the target table is created in the first database of the data access center by executing the table building statement, and the target table is the table established by the table building statement.

[0069] It should be noted that the first database and the second database can be the same database or different databases, and the embodiment does not limit this.

[0070] In step 240, the data information is loaded into the target table, and the data information is converted into the first data model of the data access center according to the interface document.

[0071] The data information is loaded into the target table, which can be loaded into the target table according to the position of the data information in the table of the data source platform. The data information in the target table is standardized according to the interface document, and is converted into the first data model of the data access center.

[0072] In step 250, a second data model of the data access center is generated according to the first data model and a preset model rule of the data access center.

[0073] The data information and the table structure information are obtained, the table building statement is generated according to the table structure information, and the table building statement is executed in the first database of the data access center to obtain the target table, so that the established target table can restore the corresponding table in the data source platform, thereby the data information can be loaded into the target table according to the original position of the data in the table, avoiding omission, so that the data source platform data information can be completely obtained, and the integrity of the information acquisition is improved.

[0074] Figure 3 The data access method provided by the embodiment of the application Figure Three As shown in Figure 3 , the data access method comprises the following steps.

[0075] In step 310, the data access center obtains an interface document according to identification information of the interface document, and the interface document is a document containing a preset association relationship between the data source platform and the data access center.

[0076] In step 320, the data access center obtains platform data of the data source platform, and converts the platform data into a first data model of the data access center according to the interface document.

[0077] Step 330, generating a second data model of the data access center according to the first data model and preset model rules of the data access center.

[0078] Step 340, judging whether the platform data is same data as historical center data of the data access center.

[0079] Optionally, steps 340-360 can be executed synchronously in the process of obtaining the platform data or in the process of executing step 330, and the embodiment is not limited in this regard.

[0080] Judging whether the platform data is same data as historical center data of the data access center, wherein the historical center data of the data access center is data stored in the data access center historically, and whether the platform data is same as the historical center data can be judged by data identification, and exemplarily, if the platform data is user data, whether there is same user identification data in the historical center data can be judged according to the user identification.

[0081] Step 350, if yes, obtaining a first data identification and adding the first data identification to the platform data.

[0082] If the platform data is same data as the historical center data of the data access center, it indicates that the data access center has obtained the platform data, which can be obtained from the data source platform or from other data source platforms, and the embodiment is not limited in this regard.

[0083] Obtaining a first data identification, which can be an existing identification, and adding the first data identification to the platform data which is same as the historical center data of the data access center.

[0084] Step 360, if no, generating a second data identification and adding the second data identification to the platform data.

[0085] If the platform data is different from the historical center data of the data access center, it indicates that the platform data is all new data, and then the second data identification is generated, which is an identification indicating that the data is new data, and the second data identification is added to the platform data which is different from the historical center data of the data access center.

[0086] Optionally, after judging whether the platform data is same data as the historical center data of the data access center, the method further comprises:

[0087] If yes, determining whether the data access center obtains the same data according to preset data processing rules.

[0088] If the platform data is the same data as the historical center data of the data access center, the data access center is determined whether to obtain the platform data according to a preset data processing rule.

[0089] The preset data processing rule is a rule for determining whether to obtain the same data. For example, if the preset data processing rule is to obtain the same data, the platform data can be obtained to the data access center, which facilitates subsequent processing such as cross-authentication in the data access center.

[0090] According to the preset data processing rule, whether the data access center obtains the platform data is determined, which avoids directly filtering out the same data, thereby affecting the subsequent data processing. The effectiveness of data acquisition is improved.

[0091] The first data identifier is added to the same data in the platform data as the historical center data of the data access center, which facilitates subsequent analysis of each platform data. For example, if the platform data of platform A and platform B both include data with the same first data identifier, it indicates that the same data exists in platform A and platform B, and the data in platform A and platform B can be cross-authenticated and analyzed, thereby improving the efficiency of data processing and analysis. The second data identifier is added to the data in the platform data that is different from the historical center data of the data access center, which facilitates the induction and arrangement of the data and improves the effectiveness of data acquisition.

[0092] Figure 4 The data access method provided by the embodiment of the present application Figure Four . As Figure 4 shown, the data access method comprises:

[0093] Step 410, the data access center obtains the interface document according to the identification information of the interface document; wherein the interface document is a document containing the preset association relationship between the data source platform and the data access center.

[0094] Step 420, the data access center obtains the platform data of the data source platform, and converts the platform data into a first data model of the data access center according to the interface document.

[0095] Step 430, a second data model of the data access center is generated according to the first data model and a preset model rule of the data access center.

[0096] Step 440, in response to a change operation of the preset model rule, the preset model rule is changed.

[0097] The change operation of the preset model rule can be performed by the data access center, and the change of the preset model rule can be adding, deleting, modifying, etc. The present embodiment does not limit this.

[0098] Step 450, read the change information of the preset model rule, and update the second data model according to the change information.

[0099] Read the change information of the preset model rule, wherein the change information is the information of the changed part in the preset model rule. According to the change information, the second data model can be updated only by the changed part, or the second data model can be updated as a whole, and the embodiment does not limit this.

[0100] By changing the preset model rule, the second data model is updated, so that the second data model generated according to the platform automatically adapts to the changed preset model rule, improving the updating efficiency of the second data model. And the platform data can automatically generate the second data model according to the latest preset model rule when generating the second data model, without changing each platform, improving the model generation efficiency, and adapting to the rapid iteration of the data access center.

[0101] Figure 5 The data access method provided by the embodiment of the present application Figure Five As shown in Figure 5 , the data access method comprises:

[0102] Step 510, the data access center acquires the interface document according to the identification information of the interface document; wherein the interface document is a document containing the preset association relationship between the data source platform and the data access center.

[0103] Step 520, the data access center acquires the platform data of the data source platform, and determines the newly added data associated with the data source platform in the data access center according to the interface document.

[0104] According to the interface rule in the interface document, the statistical method is determined, and the platform data already accessed to the data access center is automatically counted, which can be counted in the dimensions of account, enterprise, user, etc. for example.

[0105] Step 530, determine the output data of the data source platform according to the interface document.

[0106] According to the interface rule in the interface document, the statistical method is determined, and the platform data output by the source platform is automatically counted, which can be counted in the dimensions of account, enterprise, user, etc. for example.

[0107] Step 540, judge whether there is a difference between the newly added data and the output data to obtain a judgment result.

[0108] The newly added data and the output data obtained by the same statistical method are compared, and it is judged whether there is a difference. The obtained judgment result can be: if there is a difference, the part with the difference is identified; if there is no difference, the judgment result is determined to be passed.

[0109] Step 550, according to the judgment result and the interface document, the platform data is converted into the first data model of the data access center.

[0110] According to the judgment result and the interface document, the platform data is converted into the first data model of the data access center, if the data amount identified in the judgment result exceeds the preset threshold, the corresponding prompt can be performed to determine whether to continue the conversion operation of the first data model.

[0111] If the judgment result is passed, or the data amount identified in the judgment result is less than the preset threshold, the platform data can be converted into the first data model of the data access center according to the interface document.

[0112] Step 560, according to the first data model and the preset model rule of the data access center, the second data model of the data access center is generated.

[0113] By determining the new data associated with the data source platform in the data access center according to the interface document, determining the output data of the data source platform according to the interface document, and judging whether the new data and the output data exist difference, the automatic data verification of the data access center data and the data source platform data is realized, avoiding the influence of the platform data in the transmission process. And the statistical standard of the new data and the output data is unified, and the accuracy of the data verification is improved.

[0114] Figure 6 A structural diagram of a data access device provided by the embodiment of the application is provided. The device can be realized by hardware and / or software, and can execute the data access method provided by any embodiment of the application, and has the corresponding function modules and beneficial effects of the execution method. As shown in the figure, the device includes: Figure 6

[0115] The interface document acquisition module 610 is used for the data access center to acquire the interface document according to the identification information of the interface document; wherein the interface document is a document containing the preset association relationship between the data source platform and the data access center;

[0116] The first model conversion module 620 is used for the data access center to acquire the platform data of the data source platform, and convert the platform data into the first data model of the data access center according to the interface document;

[0117] The second model generation module 630 is used for generating the second data model of the data access center according to the first data model and the preset model rule of the data access center.

[0118] ​Optionally, the platform data comprises data information and table structure information.

[0119] The first model conversion module comprises:

[0120] An information acquisition unit is configured to acquire the data information and the table structure information from the data source platform by the data access center.

[0121] A table building statement execution unit is configured to generate a table building statement according to the table structure information, and execute the table building statement in a first database of the data access center to obtain a target table.

[0122] An information loading unit is configured to load the data information into the target table.

[0123] Correspondingly, the first model conversion module comprises:

[0124] A first model conversion unit is configured to convert the data information into a first data model of the data access center according to the interface document.

[0125] Optionally, the information acquisition unit comprises:

[0126] An information acquisition subunit is configured to acquire the data information from the data source platform to a preset storage location of the data access center.

[0127] An information reading subunit is configured to read the data information from the preset storage location to a local of the data access center in response to a data reading operation.

[0128] Optionally, the information loading unit comprises:

[0129] An information loading subunit is configured to load data information related to the target table into the target table from the local of the data access center according to table information of the target table.

[0130] Optionally, the first model conversion module comprises:

[0131] A data generation unit is configured to generate the platform data in a preset format according to a data acquisition requirement of the data access center by the data source platform.

[0132] A data acquisition unit is configured to acquire the platform data in the preset format from the data source platform by the data access center.

[0133] Optionally, the apparatus further comprises:

[0134] A same data judgment module is configured to judge whether the platform data is same data same as historical center data of the data access center.

[0135] a first identifier adding module, configured to, if the same data judging module judges yes, acquire a first data identifier and add the first data identifier to the platform data;

[0136] a second identifier adding module, configured to, if the same data judging module judges no, generate a second data identifier and add the second data identifier to the platform data.

[0137] Optionally, the apparatus further comprises:

[0138] a data acquisition determining module, configured to, if the same data judging module judges yes, determine whether the data access center acquires the same data according to a preset data processing rule.

[0139] Optionally, the apparatus further comprises:

[0140] a rule changing module, configured to, in response to a changing operation of the preset model rule, change the preset model rule;

[0141] a model updating module, configured to read changing information of the preset model rule and update the second data model according to the changing information.

[0142] Optionally, the apparatus further comprises:

[0143] a new data determining module, configured to, after the first model converting module executes that the data access center acquires the platform data of the data source platform, determine new data associated with the data source platform in the data access center according to the interface document;

[0144] an output data determining module, configured to determine output data of the data source platform according to the interface document;

[0145] a data difference judging module, configured to judge whether there is a difference between the new data and the output data to acquire a judging result.

[0146] Optionally, the apparatus further comprises:

[0147] an interface document generating module, configured to, before the interface document acquiring module, generate the interface document according to the preset association relationship between the data source platform and the data access center;

[0148] an identifier information determining module, configured to import the interface document into a second database of the data access center and determine the identifier information of the interface document.

[0149] Figure 7A schematic diagram of an electronic device 10 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0150] like Figure 7 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 may also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0151] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0152] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as data access methods.

[0153] In some embodiments, the data access method can be implemented as a computer program tangibly embodied in a computer readable storage medium, e.g., storage unit 18. In some embodiments, parts or all of the computer program can be loaded and / or installed onto electronic device 10 via, e.g., ROM 12 and / or communication unit 19. When the computer program is loaded onto RAM 13 and executed by processor 11 as described above, one or more steps of the data access method described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the data access method by other means, e.g., with the aid of firmware.

[0154] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, specially designed application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0155] Computer programs used to implement the methods of the application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the computer program, when executed, can implement the functions / acts specified in the flowcharts and / or block diagrams. The computer program can be executed entirely on a machine, partially on a machine, partially on a machine and partially on a remote machine or entirely on a remote machine or server.

[0156] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer-readable storage medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of a machine-readable storage medium will include one or more lines of a program of instructions in a transitory signal, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0157] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0158] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0159] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. Servers can be cloud servers, also known as cloud computing servers or cloud hosts, which are a host product in the cloud computing service system to solve the defects of great management difficulty and weak business scalability in traditional physical hosts and VPS services.

[0160] It should be understood that the various forms of flow shown above can be reordered, additional steps added, or steps deleted. For example, the steps described in the present application can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions of the present application can be achieved, and the present application is not limited herein.

[0161] The embodiment of the present application further provides a computer program product, comprising a computer program which, when executed by a processor, implements the data access method provided in any embodiment of the present application.

[0162] The computer program product can be written in one or more programming languages or combinations of languages to implement the techniques of the present application, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0163] Note that the above only describes the preferred embodiments of the present application and the technical principles applied. Those skilled in the art will understand that the present application is not limited to the specific embodiments herein, and those skilled in the art can make various obvious changes, readjustments and substitutions without departing from the scope of the present application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments, and can include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A data access method, characterized by, The method comprises the following steps: The data access center acquires the interface document according to the identification information of the interface document; The interface document is a document containing a preset association relationship between a data source platform and the data access center, wherein the preset association relationship comprises a physical model mapping relationship, a data rule conversion relationship and a code value mapping relationship; The data access center acquires platform data of the data source platform and converts the platform data into a first data model of the data access center according to the interface document, wherein the first data model is a data model conforming to a data format standard of the data access center; According to the first data model and a preset model rule of the data access center, a second data model of the data access center is generated, wherein the second data model is a data model directly called by the data access center according to business requirements; The platform data comprises data information and table structure information; The data access center acquires platform data of the data source platform, comprising: The data access center acquires the data information and the table structure information from the data source platform; According to the table structure information, a table creation statement is generated and executed in a first database of the data access center to obtain a target table; The data information is loaded into the target table; According to the interface document, the platform data is converted into a first data model of the data access center, comprising: According to the interface document, the data information is converted into a first data model of the data access center.

2. The method of claim 1, wherein, The data information is acquired from the data source platform, comprising: The data information is acquired from the data source platform to a preset storage location of the data access center; In response to a data reading operation, the data information is read from the preset storage location to the data access center locally.

3. The method of claim 2, wherein, The data information is loaded into the target table, comprising: According to the table information of the target table, the data information related to the target table is loaded into the target table from the data access center locally.

4. The method of claim 1, wherein, The data access center acquires platform data of the data source platform, comprising: The data source platform generates platform data in a preset format according to the data acquisition requirements of the data access center; The data access center acquires the platform data in the preset format from the data source platform.

5. The method of claim 1, wherein, Further comprising: It is judged whether the platform data is the same data as the historical center data of the data access center; If yes, a first data identifier is acquired and added to the platform data; If no, a second data identifier is generated and added to the platform data.

6. The method of claim 5, wherein, After judging whether the platform data is the same data as the historical center data of the data access center, further comprising: If yes, it is determined whether the data access center acquires the same data according to a preset data processing rule.

7. The method of claim 1, wherein, Further comprising: In response to a change operation of the preset model rule, the preset model rule is changed; Change information of the preset model rule is read, and the second data model is updated according to the change information.

8. The method of claim 1, wherein, After the data access center acquires the platform data of the data source platform, the method further comprises: determining new data associated with the data source platform in the data access center according to the interface document; determining output data of the data source platform according to the interface document; judging whether the new data and the output data are different to obtain a judgment result.

9. The method of claim 1, wherein, Before the data access center acquires the interface document according to the identification information of the interface document, the method further comprises: generating the interface document according to the preset association relationship between the data source platform and the data access center; importing the interface document into a second database of the data access center and determining the identification information of the interface document.

10. A data access device, characterized by The method comprises: an interface document acquisition module, configured to acquire the interface document by the data access center according to identification information of the interface document; wherein the interface document is a document containing a preset association relationship between a data source platform and the data access center, and the preset association relationship comprises a physical model mapping relationship, a data rule conversion relationship and a code value mapping relationship; a first model conversion module, configured to acquire platform data of the data source platform by the data access center, and convert the platform data into a first data model of the data access center according to the interface document, wherein the first data model is a data model conforming to a data format standard of the data access center; a second model generation module, configured to generate a second data model of the data access center according to the first data model and a preset model rule of the data access center, wherein the second data model is a data model directly called by the data access center according to business requirements; the platform data comprises data information and table structure information; the first model conversion module comprises: an information acquisition unit, configured to acquire the data information and the table structure information from the data source platform by the data access center; a table creation statement execution unit, configured to generate a table creation statement according to the table structure information, and execute the table creation statement in a first database of the data access center to obtain a target table; an information loading unit, configured to load the data information into the target table; correspondingly, the first model conversion module comprises: a first model conversion unit, configured to convert the data information into the first data model of the data access center according to the interface document.

11. An electronic device, comprising: A computer program product, comprising a memory, a processor and a computer program stored in the memory and executable by the processor, wherein the processor implements the data access method according to any one of claims 1-9 when executing the computer program.

12. A computer readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the data access method according to any one of claims 1-9.

13. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the data access method according to any one of claims 1-9.

Images