Data acquisition method and device, computer device and storage medium

Abstract

The application relates to the field of financial data systems, and provides a data acquisition method, device and equipment and a computer storage medium, the method comprising the following steps: calling a data interface of a data link layer, and acquiring first data in an independent financial data source system; if the first data does not satisfy a data demand condition, acquiring second data of the independent financial data source system through a preset data acquisition algorithm; and if neither the first data nor the second data satisfies the data demand condition, acquiring third data of the independent financial data source system through a preset data import component. The combination of multiple data acquisition modes reduces the cost of cross-system data acquisition. The method can be applied to a cloud server of a big data and artificial intelligence platform cloud computing service, and can also be applied to data acquisition between financial systems.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of financial data systems, and in particular to a data acquisition method and device, a computer device and a storage medium. BACKGROUND

[0002] Due to different data storage locations, data formats, data compatibility, and other reasons, independent systems are difficult to interact with other systems, resulting in that even if a large amount of data is entered in an independent system, it cannot be associated with related data in other systems, and the value of the data cannot be played, which is easy to form a "data island". For example, for a financial platform, there may be different business systems such as a customer account system, a financial transaction system, and a page browsing system.

[0003] At present, in order to avoid the formation of a "data island" in each independent system of a financial platform, a cross-system data acquisition scheme is proposed. Since many data cannot be obtained through a general interface, the existing cross-system data acquisition method is completed through a special interface that defines data structure and data content in advance. However, the customized special interface has poor flexibility, and once the data structure of the data source system changes, the special interface needs to be modified, otherwise the required data cannot be obtained through the special interface. This results in high design and maintenance costs, so how to reduce the cost of inter-system data acquisition has become a problem to be solved. SUMMARY

[0004] The main purpose of the present application is to provide a data acquisition method, device, equipment and computer storage medium, which aims to reduce the complexity of cross-system data acquisition of a financial platform, improve the efficiency of cross-system data acquisition, and reduce the cost of customized data interfaces.

[0005] In a first aspect, the present application provides a data acquisition method applied to a target system of a cross-system data system, the cross-system data system comprising the target system and at least one independent financial data source system, wherein the data of the target system and the data of the independent financial data source system are independently stored, and the data acquisition method comprises the following steps:

[0006] calling a data interface of a data link layer to acquire first data in the independent financial data source system;

[0007] if the first data does not meet the data requirement condition, acquiring second data of the independent financial data source system through a preset data grabbing algorithm;

[0008] if neither the first data nor the second data meets the data requirement condition, acquiring third data of the independent financial data source system through a preset data import component.

[0009] In a second aspect, the present application provides a data acquisition device, comprising:

[0010] a first data acquisition module, configured to call a data interface of a data link layer to acquire first data in the independent financial data source system;

[0011] a second data acquisition module, configured to acquire second data of the independent financial data source system by a preset data acquisition algorithm if the first data does not meet the data requirement condition;

[0012] a third data acquisition module, configured to acquire third data of the independent financial data source system by a preset data import component if neither the first data nor the second data meets the data requirement condition.

[0013] In a third aspect, the present application provides a computer device, comprising a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the data acquisition method as described above.

[0014] In a fourth aspect, the present application provides a computer readable storage medium, having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the data acquisition method as described above.

[0015] The present application provides a data acquisition method, device, equipment and computer storage medium, the present application calls a data interface of a data link layer to acquire first data in the independent financial data source system; if the first data does not meet the data requirement condition, the second data of the independent financial data source system is acquired by a preset data acquisition algorithm; if neither the first data nor the second data meets the data requirement condition, the third data of the independent financial data source system is acquired by a preset data import component. Since the data acquisition between systems is performed in multiple ways, and the data from the data source system is judged to determine whether the data from the data source system meets the requirement, the complexity of cross-system data acquisition of the financial platform is reduced, the cross-system data acquisition efficiency is improved, and the cost of customized data interface is reduced. BRIEF DESCRIPTION OF DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0017] Figure 1A flowchart of a data acquisition method provided by an embodiment of the present application is shown in FIG. 1.

[0018] Figure 2 A use scenario diagram of a data acquisition method provided by an embodiment of the present application is shown in FIG. 2.

[0019] Figure 3 A schematic block diagram of a data acquisition apparatus provided by an embodiment of the present application is shown in FIG. 3.

[0020] Figure 4 A structural schematic block diagram of a computer device related to an embodiment of the present application is shown in FIG. 4. DETAILED DESCRIPTION

[0021] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0022] The flowchart shown in the drawings is only an example and does not necessarily include all the contents and operations / steps, nor does it necessarily execute in the order described. For example, some operations / steps can be further decomposed, combined or partially merged, so the actual execution order may be changed according to the actual situation.

[0023] The embodiments of the present application provide a data acquisition method, apparatus, computer device and computer readable storage medium.

[0024] Some embodiments of the present application will be described in detail below with reference to the drawings. In the case of no conflict, the embodiments described below and the features in the embodiments can be combined with each other.

[0025] Please refer to Figure 1 , Figure 1 A flowchart of a data acquisition method provided by an embodiment of the present application is shown in FIG. 1. The data acquisition method can be used between a terminal and / or a server to realize data acquisition between mutually independent subsystems in a cross-system data system, for example, data acquisition between mutually independent subsystems in a financial platform. The terminal can be an electronic device such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, a personal digital assistant and a wearable device; the server can be an independent server, a server cluster, a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks (CDN), and basic cloud computing services such as big data and artificial intelligence platforms.

[0026] Please refer to Figure 2 , Figure 2 is an embodiment of the present application provides a use scenario. As shown in Figure 2 , the target system obtains first data, second data and third data of the independent financial data source system, wherein the target system and the independent financial data source system can run in the terminal and / or server.

[0027] As shown in Figure 1 , the data acquisition method comprises steps S101 to S103.

[0028] Step S101, calling the data interface of the data link layer, obtaining the first data in the independent financial data source system.

[0029] Exemplarily, the systems independent of each other cannot interact with each other, for example, the business systems of the same platform realizing different functions, the customer account system, the financial transaction system, the page browsing system and the like of the financial platform cannot share data to form data islands; or the business systems of different departments of the same enterprise cannot share data to form data islands.

[0030] Exemplarily, the subsystems of the cross-system data system are independent of each other, the cross-system data system comprises the target system and at least one independent financial data source system, the data of the target system and the data of the independent financial data source system are independent of each other, are stored independently, and have different data logical structures.

[0031] Exemplarily, the data of the target system and the data of the at least one independent financial data source system can be stored in different databases, and are stored according to different data names and data formats, which leads to difficulty in interaction between the two.

[0032] Exemplarily, when the target system needs to obtain data from the independent financial data source system, the data interface independent of the protocol can be used to obtain the data in the independent financial data source system supporting different protocols.

[0033] In some embodiments, the data interface is an open data interface; by calling the data interface of the data link layer, the first data in the independent financial data source system is obtained, comprising: judging whether the data amount of the first data in the independent financial data source system is less than a preset data amount; if the data amount of the first data is less than the preset data amount, the first data in the independent financial data source system is obtained through the open data interface.

[0034] Exemplarily, the first data is all the data in the independent financial data source system that can be obtained by the target system through the data interface of the data link layer.

[0035] Exemplarily, some data source systems provide an open data-link interface (ODI) at the data link layer, so that the target system can obtain data from the data source system through the open data-link interface.

[0036] Exemplarily, when the target system obtains the first data through the open data-link interface in a case where the open data-link interface supports a large number of data fields, a large amount of first data can be received at one time, which brings pressure to the normal operation of the data link and the target system. In order to avoid the target system from collapsing due to a large amount of data entering the target system at the same time, the amount of first data that can be obtained through the open data-link interface is counted before the first data is obtained through the open data-link interface.

[0037] Exemplarily, the target system can determine the amount of data that can be obtained through the data interface of the data link layer, and determine whether to obtain the first data through the data interface according to the amount of data.

[0038] Exemplarily, if the amount of first data is less than a preset amount of data, it indicates that it is safe for the target system to obtain the first data through the open data-link interface, and the target system will not collapse due to the amount of first data being too large. In this case, the target system obtains the first data through the data interface of the data link layer. If the amount of first data is greater than or equal to the preset amount of data, it indicates that the target system can collapse due to the amount of first data being too large when obtaining the first data through the open data-link interface. In this case, in order to ensure system safety, the target system avoids obtaining the first data through the open data-link interface, for example, directly obtains the second data of the data source system through the preset data grabbing algorithm.

[0039] Exemplarily, the preset amount of data can be determined according to actual conditions, for example, the size of the preset amount of data can be set according to the data receiving capacity of the target system. Specifically, the preset amount of data can be set to 128 MB, but is not limited thereto.

[0040] Exemplarily, some data source systems do not provide an open data-link interface, or the open data-link interface of the data source system cannot be called, so that the first data cannot be obtained through the data interface of the data link layer. In this case, the target system can directly obtain the second data of the data source system through the preset data grabbing algorithm.

[0041] In some embodiments, before the first data is obtained through the preset data grabbing algorithm if the first data does not meet the data requirement condition, the method further includes: performing field matching on a first data field in the first data and a requirement field of the target system, to determine whether the first data field covers the requirement field.

[0042] Exemplarily, the data fields between the target system and the data source system are not the same. For example, the same data can correspond to different data names in different subsystems, or be stored based on different data formats, etc. Therefore, before obtaining the data from the data source system, it is not determined which data can be obtained, and after obtaining the first data from the data source system, the first data is judged according to the data demand condition of the target system.

[0043] Exemplarily, the demand field represents the field required by the target system to obtain from the data source system. Since the target system cannot know in advance the data name of the field required to be obtained in the data source system, the demand field of the target system can be, for example, the data name of the data required by the target system to be obtained locally.

[0044] Exemplarily, the field matching of the first data field in the first data and the demand field of the target system can be, for example, according to a preset field comparison list, determining the correspondence between the first data field and the demand field, and matching the first data field and the demand field; of course, it is not limited to this, and the data field of the first data can also be matched to the data field of the target system according to the data structure and / or data name, etc., to obtain the first data field of the first data. For example, according to the similarity of the data structure and / or data name of the first data and the data in the target system, the first data field of the first data is determined, which is not limited herein.

[0045] In step S102, if the first data does not satisfy the data demand condition, the second data of the independent financial data source system is obtained through a preset data grabbing algorithm.

[0046] Exemplarily, by grabbing the data interacted between the independent financial data source system and the server, the second data related to the business processing of the independent financial data source system can be obtained.

[0047] Exemplarily, the second data includes: data sent by the independent financial data source system to the server and / or data received by the independent financial data source system from the server.

[0048] In some embodiments, the second data of the data source system is obtained through a preset data grabbing method, including: based on a preset server address, grabbing the interactive message between the independent financial data source system and the server to obtain an interactive data file; and parsing the interactive data file to obtain the second data.

[0049] Exemplarily, the server interacted with the independent financial data source system is determined through the server address, so as to determine the transmission link between the independent financial data source system and the server, and the interactive message is obtained in the transmission link.

[0050] Exemplarily, the interaction data file can be a json file, and the target system obtains the second data in the json file by parsing the json file. The json (JavaScript Object Notation) is a data exchange format, and the json file has the characteristics of convenient transmission and parsing. The data obtained by the crawling is sent to the target system in the format of the json file. Since the json file uses a text format independent of programming languages to store and represent data, the target system can parse the json file into the required format based on a local parsing package.

[0051] In some embodiments, before the third data of the independent financial data source system is obtained by the preset data import component, the method further includes: performing field matching between the first data field and the second data field in the second data and the requirement field of the target system, to determine whether the first data field and the second data field cover the requirement field.

[0052] It can be understood that if the target system does not perform step S101, for example, because the data volume of the first data is greater than or equal to the preset data volume, the target system does not obtain the first data through the data interface, and then determining whether the first data field and the second data field cover the requirement field is actually determining whether the second data field covers the requirement field. If the target system performs step S101, it is necessary to determine whether the first data field and the second data field cover the requirement field, that is, to determine whether the intersection of the first data field and the second data field covers the requirement field.

[0053] Step S103, if the first data and the second data do not meet the data requirement condition, obtaining the third data of the independent financial data source system through a preset data import component.

[0054] Exemplarily, the data import component can import at least part of the data in the independent financial data source system to the target system, for example, by pre-configuring the key parameters of the target data to obtain the target data in the independent financial data source system.

[0055] In some embodiments, before the third data of the independent financial data source system is acquired by the preset data import component, the method further comprises: configuring key parameters for the data import component, so as to instruct the data import component to import data of the independent financial data source system into the target system according to the key parameters, wherein the key parameters comprise at least one of a data source system address, a data source system port number, a data source system name, a data source system password, a data source system directory, a data source name, a file acquisition method, and a transmission protocol.

[0056] For example, the data import component can determine the location of the third data through the preset key parameters, for example, determine the independent financial data source system for acquiring the third data through one or more of the data source system address, the data source system port number, and the data source system name; determine the location of the third data in the independent financial data source system through one or more of the data source system directory and the data source name; and determine the way of acquiring the third data through the file acquisition method and the transmission protocol, wherein the file acquisition method may, for example, include a socket method, a file sharing server method, a Java message service method, etc., and the transmission protocol may, for example, include a tcp / UDP protocol, an ftp protocol, etc., without limitation.

[0057] In some embodiments, the third data of the independent financial data source system is acquired by the preset data import component, comprising: based on a preset time interval, acquiring the changed data from the independent financial data source system by the data import component as the third data.

[0058] For example, the data import component can import the target data changed in the data source system based on a preset time interval, i.e., incremental import of the target data.

[0059] The preset time interval can be set according to actual needs, for example, importing the target data changed in the data source system every 1 hour, of course, without limitation.

[0060] In some embodiments, the third data of the independent financial data source system is acquired by the preset data import component, further comprising: in response to a selection operation of the user on the data in the independent financial data source system, acquiring the data selected by the user by the data import component as the third data.

[0061] For example, the data import component can also manually import the target data, for example, selecting the target data from the data available to the data import component, and importing the target data selected by the user.

[0062] Exemplarily, after obtaining the third data of the data source system through the preset data import component, the method further includes: judging whether the third data meets the data requirement condition.

[0063] It can be understood that judging whether the third data meets the data requirement condition includes: judging whether at least one of the first data and the second data and the third data meets the data requirement condition. That is, judging whether the first data and the third data meet the data requirement condition, judging whether the second data and the third data meet the data requirement condition, or judging whether the first data, the second data and the third data meet any one of the data requirement conditions.

[0064] Exemplarily, if at least one of the first data and the second data and the third data cannot cover the requirement field, the fields in the requirement field that are not covered are outputted, so as to further process the fields in the requirement field that cannot be successfully obtained, for example, manually synchronizing the requirement field.

[0065] In some embodiments, before obtaining the first data in the independent financial data source system through the data interface of the calling data link layer, the method further includes: sending an interaction request for requesting data interaction to the independent financial data source system.

[0066] Exemplarily, since the data fields between the target system and the independent financial data source system are not the same, the target system cannot know in advance the data fields that need to be transmitted by the independent financial data source system, but the target system can request interaction with the independent financial data source system by sending an interaction request to the independent financial data source system in advance.

[0067] The data acquisition method provided by the above embodiments can obtain the first data in the independent financial data source system through the data interface of the calling data link layer, judge whether the first data meets the data requirement condition of the target system, obtain the second data of the independent financial data source system through a preset data acquisition algorithm if the first data does not meet the data requirement condition, judge whether the second data meets the data requirement condition, and obtain the third data of the independent financial data source system through a preset data import component if the first data and the second data do not meet the data requirement condition. This can reduce the complexity of cross-system data acquisition, improve the cross-system data acquisition efficiency of the financial platform, and reduce the cost of customized data interfaces.

[0068] Please refer to Figure 3 , Figure 3 is a schematic diagram of a data acquisition device according to an embodiment of the present application. The data acquisition device can be configured in a server or terminal that deploys a financial platform, and is used to execute the data acquisition method described above.

[0069] AsFigure 3 The data acquisition device shown includes a first data acquisition module 110, a second data acquisition module 120, and a third data acquisition module 130.

[0070] The first data acquisition module 110 is configured to call a data interface of a data link layer to acquire first data in an independent financial data source system.

[0071] The second data acquisition module 120 is configured to acquire second data in the independent financial data source system by using a preset data acquisition algorithm if the first data does not meet the data requirement condition.

[0072] The third data acquisition module 130 is configured to acquire third data in the independent financial data source system by using a preset data import component if neither the first data nor the second data meets the data requirement condition.

[0073] The data acquisition device shown includes a first data acquisition module 110, a second data acquisition module 120, and a third data acquisition module 130.

[0074] The first field matching module is configured to perform field matching between a first data field in the first data and a requirement field of the target system to determine whether the first data field covers the requirement field.

[0075] The second field matching module is configured to perform field matching between the first data field and a second data field in the second data and the requirement field of the target system to determine whether the first data field and the second data field cover the requirement field.

[0076] The third data acquisition module 130 includes an incremental data import module.

[0077] The incremental data import module is configured to acquire changed data from the independent financial data source system as the third data by using the data import component based on a preset time interval.

[0078] The third data acquisition module 130 includes a manual data import module.

[0079] The manual data import module is configured to acquire data selected by a user from the independent financial data source system as the third data by using the data import component in response to a selection operation of the user.

[0080] The third data acquisition module 130 includes a key parameter configuration module.

[0081] A key parameter configuration module is configured to configure key parameters for the data import component to instruct the data import component to import data of the independent financial data source system into the target system according to the key parameters, wherein the key parameters include at least one of a data source system address, a data source system port number, a data source system name, a data source system password, a data source system directory, a data source name, a file acquisition mode, and a transmission protocol.

[0082] The first data acquisition module 110 further includes a data amount judgment module and a first data acquisition submodule.

[0083] The data amount judgment module is configured to judge whether a data amount of the first data in the independent financial data source system is less than a preset data amount.

[0084] The first data acquisition submodule is configured to acquire the first data in the independent financial data source system through the open data interface if the data amount of the first data is less than the preset data amount.

[0085] The second data acquisition module 130 further includes a data file grabbing module and a data file parsing module.

[0086] The data file grabbing module is configured to grab interactive message between the independent financial data source system and the server as an interactive data file based on a preset server address.

[0087] The data file parsing module is configured to parse the interactive data file to obtain the second data.

[0088] It should be noted that, for the convenience and brevity of description, the specific working process of the above-described device and each module and unit can refer to the corresponding process in the foregoing method embodiments, which will not be described herein.

[0089] The methods and apparatus of this application can be used in a variety of general purpose or special purpose computing system environments or configurations. Examples of computing systems, environments, and / or configurations that can be used with this application include personal computer systems, server computer systems, handheld or laptop device computing systems, multiprocessor systems, microprocessor-based systems, set top box, programmable consumer electronics, network PC systems, minicomputer systems, mainframe computer systems, distributed computing environments that include any of the above systems or devices, and the like. This application can be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, and the like, that perform particular tasks or implement particular abstract data types. This application can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules can be located in both local and remote computer storage media including memory storage devices.

[0090] By way of example, the methods and apparatus described above can be implemented in the form of a computer program that can run on a computer device such as the one shown in Figure 4 .

[0091] Referring now to the figures, and more particularly to Figure 4 , Figure 4 a block diagram of a computer device is provided. The computer device can be a server or a terminal.

[0092] As shown in Figure 4 , the computer device includes a processor, a memory, and a network interface connected through a system bus. The memory can include a storage medium and an internal memory.

[0093] The storage medium can store an operating system and a computer program. The computer program includes program instructions that, when executed, cause the processor to perform any one of the data acquisition methods.

[0094] The processor is configured to provide computing and control capabilities to support the operation of the entire computer device.

[0095] The internal memory provides an environment for the execution of the computer program in the storage medium, which, when executed by the processor, causes the processor to perform any one of the data acquisition methods.

[0096] The network interface is configured to perform network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that the structure shown in Figure 4 is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0097] It should be understood that the processor can be a central processing unit (CPU), and can also be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0098] In one embodiment, the processor is configured to run a computer program stored in the memory to implement the following steps:

[0099] calling a data interface of a data link layer to obtain first data in the independent financial data source system;

[0100] if the first data does not meet the data requirement condition, obtaining second data in the independent financial data source system by a preset data crawling algorithm;

[0101] if neither the first data nor the second data meets the data requirement condition, obtaining third data in the independent financial data source system by a preset data import component.

[0102] In one embodiment, before implementing the step of obtaining the second data in the independent financial data source system by the preset data crawling algorithm if the first data does not meet the data requirement condition, the processor is configured to implement:

[0103] performing field matching on a first data field in the first data and a requirement field of the target system to determine whether the first data field covers the requirement field.

[0104] In one embodiment, before implementing the step of obtaining the third data in the independent financial data source system by the preset data import component if neither the first data nor the second data meets the data requirement condition, the processor is configured to implement:

[0105] performing field matching on the first data field and a second data field in the second data and the requirement field of the target system to determine whether the first data field and the second data field cover the requirement field.

[0106] In one embodiment, the processor, when implementing the third data acquisition from the independent financial data source system through the preset data import component, is configured to:

[0107] acquire, as the third data, changed data from the independent financial data source system through the data import component based on a preset time interval.

[0108] In one embodiment, the processor, when implementing the third data acquisition from the independent financial data source system through the preset data import component, is configured to:

[0109] acquire, as the third data, user-selected data through the data import component in response to a selection operation of the user on data in the independent financial data source system.

[0110] In one embodiment, the processor, before implementing the third data acquisition from the independent financial data source system through the preset data import component, is configured to:

[0111] configure key parameters for the data import component so as to instruct the data import component to import data of the independent financial data source system into the target system according to the key parameters, wherein the key parameters include at least one of a data source system address, a data source system port number, a data source system name, a data source system password, a data source system directory, a data source name, a file acquisition mode, and a transmission protocol.

[0112] In one embodiment, the processor, when implementing the calling of the data interface of the data link layer to acquire the first data in the independent financial data source system, is configured to:

[0113] determine whether a data volume of the first data in the independent financial data source system is less than a preset data volume;

[0114] if the data volume of the first data is less than the preset data volume, acquire the first data in the independent financial data source system through the open data interface.

[0115] In one embodiment, the processor, when implementing the second data acquisition from the independent financial data source system through the preset data acquisition algorithm, is configured to:

[0116] based on a preset server address, capture an interactive message between the independent financial data source system and the server as an interactive data file;

[0117] perform analysis on the interactive data file to obtain the second data.

[0118] It should be noted that the skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the data acquisition described above can refer to the corresponding process in the foregoing data acquisition control method embodiment, and will not be described here.

[0119] The embodiments of the present application further provide a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program includes program instructions. The method implemented by the program instructions can refer to each embodiment of the data acquisition method of the present application.

[0120] The computer readable storage medium can be an internal storage unit of the computer device, for example, a hard disk or a memory of the computer device. The computer readable storage medium can also be an external storage device of the computer device, for example, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc.

[0121] It should be understood that the terms used in the specification of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and the appended claims of the present application, unless otherwise clearly indicated by the context, the singular forms "a", "an" and "the" are intended to include the plural forms as well.

[0122] It should also be understood that the term "and / or" used in the specification and the appended claims of the present application means any combination of one or more of the associated listed items and all possible combinations, and includes these combinations. It should be noted that in this document, the terms "include", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or system including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or system. Without more limitations, the element defined by the statement "including a" does not exclude the presence of another identical element in the process, method, article or system including the element.

[0123] The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical range disclosed by the present application, and these modifications or replacements should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A data acquisition method, characterized by, The method is applied to a target system of a cross-system data system, the cross-system data system comprising the target system and at least one independent financial data source system, wherein data of the target system and data of the independent financial data source system are independently stored, and the method comprises: calling a data interface of a data link layer to obtain first data in the independent financial data source system, wherein the data interface is a data link layer protocol-independent data interface; if the first data does not meet a data requirement condition, obtaining second data of the independent financial data source system through a preset data grabbing algorithm; if neither the first data nor the second data meets the data requirement condition, obtaining third data of the independent financial data source system through a preset data import component; wherein the obtaining of the second data of the independent financial data source system through the preset data grabbing algorithm comprises: grabbing, based on a preset server address, interactive messages between the independent financial data source system and the server as interactive data files; parsing the interactive data files to obtain the second data.

2. The data acquisition method of claim 1, wherein, Before the obtaining of the second data of the independent financial data source system through the preset data grabbing algorithm if the first data does not meet the data requirement condition, the method further comprises: performing field matching on a first data field in the first data and a requirement field of the target system to determine whether the first data field covers the requirement field; Before the obtaining of the third data of the independent financial data source system through the preset data import component if neither the first data nor the second data meets the data requirement condition, the method further comprises: performing field matching on the first data field and a second data field in the second data and the requirement field of the target system to determine whether the first data field and the second data field cover the requirement field.

3. The data acquisition method of claim 1, wherein, The obtaining of the third data of the independent financial data source system through the preset data import component comprises: based on a preset time interval, obtaining, through the data import component, data that has changed in the independent financial data source system as the third data.

4. The data acquisition method of claim 1, wherein, The obtaining of the third data of the independent financial data source system through the preset data import component further comprises: in response to a selection operation of a user on data in the independent financial data source system, obtaining, through the data import component, data selected by the user as the third data.

5. The data acquisition method according to any one of claims 3 or 4, characterized in that, Before the obtaining of the third data of the independent financial data source system through the preset data import component, the method further comprises: configuring a key parameter for the data import component to instruct the data import component to import data of the independent financial data source system into the target system according to the key parameter, wherein the key parameter comprises at least one of a data source system address, a data source system port number, a data source system name, a data source system password, a data source system directory, a data source name, a file acquisition mode, and a transmission protocol.

6. The data acquisition method of claim 1, wherein, The data interface is an open data interface; the data interface of the data link layer is called to obtain the first data in the independent financial data source system, and the method comprises the steps of: determining whether the data amount of the first data in the independent financial data source system is less than a preset data amount; if the data amount of the first data is less than the preset data amount, the first data in the independent financial data source system is obtained through the open data interface.

7. A data acquisition device, characterized by The data acquisition device comprises: a first data acquisition module for calling a data interface of a data link layer to obtain first data in an independent financial data source system, wherein the data interface is a data link layer and protocol independent data interface; a second data acquisition module for obtaining second data of the independent financial data source system through a preset data acquisition algorithm if the first data does not meet a data requirement condition; a third data acquisition module for obtaining third data of the independent financial data source system through a preset data import component if neither the first data nor the second data meets the data requirement condition; wherein the second data of the independent financial data source system is obtained through a preset data acquisition algorithm, which comprises: based on a preset server address, interactive messages between the independent financial data source system and the server are captured as interactive data files; the interactive data files are parsed to obtain the second data.

8. A computer device, comprising: The computer device comprises a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the data acquisition method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, wherein when the computer program is executed by the processor, the steps of the data acquisition method according to any one of claims 1 to 6 are implemented.

Images