Data extraction method, system, computer device and readable storage medium

Abstract

The present invention provides a data extraction method, which includes: receiving rental data sent by an SFTP server, wherein the rental data is extracted from a storage system by a kettle tool and stored in the SFTP server; the kettle tool is a tool obtained by configuring the permissions of users pre-stored in the storage system; the rental data is stored in a transfer table; the transfer table is inserted into a target table of a user terminal to display the data in the user terminal; the data extraction method, system, computer device and readable storage medium provided by the embodiments of the present invention; permission authentication and the use of the SFTP server as a data transfer station improve the security of obtaining data; the micro-leasing service system efficiently extracts rental data from the SFTP server by the kettle tool every day, avoiding mutual calls between systems and the transmission of large data, and speeding up the speed at which users access data.

Description

Technical Field

[0001] The present invention relates to the field of data processing, and in particular to a data extraction method, system, computer equipment and readable storage medium. Background Art

[0002] With the continuous development of cloud storage and cloud computing technologies, data extraction and data mining have become the mainstay of many Internet industries. Especially in the field of business systems, how to ensure that users can obtain the latest consulting information and push more accurate information to users has become a difficult problem. Existing technologies usually extract data from local systems and save them in the database of the cloud platform. Business systems are usually built on relational databases composed of most users. Users need to upload user data to the cloud database and share the data in the database through the cloud platform.

[0003] However, during the data extraction process, user information is easily leaked, and the speed of extracting data from the local database is slow. How to ensure the security of data extraction while improving the data extraction speed has become a problem to be solved. Summary of the Invention

[0004] The purpose of the present invention is to provide a data extraction method, system, computer device and readable storage medium to solve the following problem: slow data extraction speed.

[0005] One aspect of an embodiment of the present invention provides a data extraction method for a rental service system, wherein the rental service system includes a transfer table. The method includes:

[0006] Receiving lease data sent by the SFTP server, the lease data being data extracted from the storage system by a kettle tool and stored in the SFTP server; the kettle tool being a tool obtained by configuring the permissions of a user pre-stored in the storage system;

[0007] Storing the lease data in the transfer table;

[0008] The transfer table is inserted into the target table of the user terminal to display the data in the user terminal.

[0009] Furthermore, after the step of receiving the lease data sent by the SFTP server, the method further includes:

[0010] Access the device system through the gateway;

[0011] Obtaining device information in the device system;

[0012] Insert the device information into the transfer table.

[0013] Furthermore, the step of obtaining device information in the device system includes:

[0014] The device information in the device system is extracted according to the authority of the user.

[0015] Furthermore, before the step of receiving the lease data sent by the SFTP server, the method further includes:

[0016] parsing the lease data by the storage system; the lease data including user information and contract information;

[0017] Scoring the user through the storage system based on the rental data;

[0018] According to the scoring result, the user's permissions are matched in a preset data table in the storage system.

[0019] Furthermore, the step of scoring the user through the storage system based on the rental data includes:

[0020] Users are scored according to the following formula:

[0021] M=σ1X+σ2Y

[0022] Wherein, M is the user's rating result, X is the score of the user information, Y is the score of the contract information, σ1 is the weight corresponding to the user information, and σ2 is the weight corresponding to the contract information.

[0023] Furthermore, after the step of receiving the lease data sent by the SFTP server, the method further includes:

[0024] The operation extracted from the storage system and stored in the SFTP server is used as a first execution script, and a first kjb file is created according to the first execution script;

[0025] The operation of receiving the lease data sent by the SFTP server is used as the second execution script, and a second kjb file is created according to the second execution script; wherein, the first kjb file and the second kjb file are format types for saving files by the kettle tool.

[0026] Furthermore, after the step of creating a second kjb file according to the second execution script, the method further includes:

[0027] The first kjb file and the second kjb file are executed in sequence at regular intervals. When the execution of any one of the first kjb file and the second kjb file fails, the execution is stopped.

[0028] One aspect of an embodiment of the present invention further provides a data extraction system, the data extraction system comprising:

[0029] The extraction module is used to receive the lease data sent by the SFTP server. The lease data is extracted from the storage system by the kettle tool and stored in the SFTP server; the kettle tool is a tool obtained by configuring the user's permissions pre-stored in the storage system.

[0030] The display module is used to store the lease data in a transfer table; and insert the transfer table into a target table of a user terminal to display the data in the user terminal.

[0031] An aspect of an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned data extraction method when executing the computer program.

[0032] One aspect of an embodiment of the present invention provides a computer-readable storage medium, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned data extraction method when executing the computer program.

[0033] The data extraction method, system, computer device and readable storage medium provided by the embodiments of the present invention first obtain user permissions, configure the kettle tool according to the user permissions, and then extract the rental data to the SFTP server through the kettle tool; permission authentication is required before receiving the data and the SFTP server is used as a transfer station for data extraction, thereby improving the security of data extraction; the micro-leasing service system efficiently extracts the rental data from the SFTP server through the kettle tool every day, avoiding mutual calls between various systems and the transmission of large data. At the same time, the rental service system already stores relevant information of users and devices. At this time, the user can query the rental data and device information after logging into the app, thereby speeding up the user's access to data. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 The flowchart of the data extraction method according to the first embodiment of the present invention is schematically shown;

[0035] Figure 2 Schematically shows Figure 1 The sub-step diagram of step S100 in FIG.

[0036] Figure 3 A block diagram of a data extraction system according to a second embodiment of the present application is schematically shown; and

[0037] Figure 4The following schematically shows a hardware architecture diagram of a computer device suitable for implementing the data extraction method according to the third embodiment of the present application. DETAILED DESCRIPTION

[0038] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0039] It should be noted that the descriptions of "first", "second", etc. in the embodiments of the present invention are for descriptive purposes only and should not be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between the various embodiments can be combined with each other, but this must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0040] In the description of the present invention, it should be understood that the numerical labels before the steps do not identify the order in which the steps are executed, but are only used to facilitate the description of the present invention and to distinguish each step, and therefore should not be understood as a limitation of the present invention.

[0041] The embodiment of the present application mainly includes three systems and one server, wherein the three systems include a storage system, a rental service system, and an equipment system, and the one server includes an SFTP server.

[0042] The storage system and the leasing service system are composed of one or more computer devices. The one or more computer devices may include virtualized computing instances. The computer devices may load virtual machines based on virtual images and / or other data defining specific software (e.g., operating systems, specialized applications, servers) for simulation. As the demand for different types of processing services changes, different virtual machines may be loaded and / or terminated on the one or more computer devices.

[0043] The gateway may include various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, proxy devices, and / or the like. The gateway may include physical links, such as coaxial cable links, twisted pair cable links, fiber optic links, combinations thereof, and / or the like. The gateway may include wireless links, such as cellular links, satellite links, Wi-Fi links, and / or the like.

[0044] User terminals can be configured to access the content and services of the software control center. User terminals can include any type of computer device, such as terminal devices: mobile devices, tablet devices, laptop computers, smart devices (e.g., smart clothing, smart watches, smart speakers, smart glasses), virtual reality headsets, gaming devices, set-top boxes, digital streaming devices, robots, in-vehicle terminals, smart TVs, TV boxes, e-book readers, MP3 (Moving Picture Experts Group Audio Layer III) players, MP4 (Moving Picture Experts Group Audio Layer IV) players, etc. User terminals can also include non-terminal devices, such as gateways and switches.

[0045] The user terminal can be configured with associated accounts or account information to facilitate the control and management of the rental service system.

[0046] The following describes the process of data extraction method from the perspective of the leasing service system as the execution subject;

[0047] Example 1

[0048] Figure 1 The flowchart of the data extraction method according to the first embodiment of the present invention is schematically shown.

[0049] like Figure 1 As shown, the data extraction method may include steps S100 to S102, wherein:

[0050] Step S100: receiving lease data sent by an SFTP server, wherein the lease data is extracted from a storage system by a kettle tool and stored in the SFTP server; the kettle tool is a tool obtained by configuring the permissions of a user pre-stored in the storage system.

[0051] Oracle Database, also known as Oracle RDBMS or simply Oracle, is a relational database management system developed by Oracle Corporation. It has consistently held a leading position in the database field. The Oracle database system is considered the world's most popular relational database management system, offering excellent portability, ease of use, and powerful functionality. It is suitable for a wide range of large, medium, and small computer environments. It is a highly efficient, reliable, and high-throughput database solution.

[0052] As a preferred solution, the storage system described in this embodiment is provided with an Oracle database, which imports the rental data in the business system into the Oracle database every day. The Oracle database is provided with a data table, which records the permissions corresponding to each rating level.

[0053] To further illustrate the step of obtaining user permissions, before the step of receiving the rental data sent by the SFTP server, Figure 2 Shown, including:

[0054] Step S100-1: parsing the rental data through the storage system; the rental data includes user information and contract information;

[0055] Step S100-2: Score the user through the storage system based on the rental data;

[0056] Specifically, the user information includes the user's name, account number, age, and category; categories are categorized as individual or company, etc.; contract information includes the user's historical contract amounts, contract overdues, and the number of contracts signed. The system scores the user based on the user information and contract information. Specifically, it extracts key information that has a significant impact on purchasing power, such as age in the user information. As purchasing power increases with age, the system can assign different weights to the age in the user information for different age groups. It can also be based on user categories. For example, the purchasing power of a company is generally higher than that of an individual, so the system will assign a higher weight to the company. Similarly, in contract information, factors that affect purchasing power include the contract amount, contract overdues, and historical contract amounts. The more overdues, the lower the credit rating, and the lower the weight assigned. The larger the contract amount, the stronger the purchasing power. Based on the above influencing factors, the system automatically scores the key information in the user information and contract information, thereby assigning a score to the user information and the contract information.

[0057] Then the user is scored according to the following formula:

[0058] M=σ1X+σ2Y

[0059] Among them, M is the user's scoring result, X is the score of the user information, Y is the score of the contract information, σ1 is the weight corresponding to the user information, σ2 is the weight corresponding to the contract information, and σ1+σ2=1.

[0060] Step S100 - 3 : According to the scoring result, matching the user's permissions in the preset data table in the storage system.

[0061] The preset data table is shown in Table 1:

[0062]

[0063]

[0064] Table 1: Preset data table

[0065] First, the user's score is calculated using the above formula. Then, based on the user's score, the user's permissions are configured in the above data table. Then, based on the user's permissions, devices with corresponding prices are pushed to the user. Through the configuration of the above permissions, intelligent information recommendation is realized, making the information push more accurate.

[0066] Preferably, after obtaining the user's permissions, the kettle tool is configured according to the user's permissions.

[0067] Specifically, ETL (Extract-Transform-Load, which is the process of extracting, transforming, and loading data) is a process that often involves processing, transforming, and migrating various data for enterprise or industry applications. Therefore, understanding and mastering the use of an ETL tool is essential. Kettle supports a graphical GUI design interface, which can then be used in the form of a workflow. It has a relatively stable performance in simple or complex data extraction, quality inspection, data cleaning, data conversion, and data filtering. Most importantly, through our skilled application of it, we have reduced a lot of R&D workload and improved our work efficiency.

[0068] The kettle tool is an open source ETL tool written in pure Java. It can run on Windows, Linux, and Unix and can manage data from different databases.

[0069] Specifically, different permissions are configured for users based on their ratings, thereby limiting the price of the device. This allows the kettle tool to extract device information based on the price of the device. Therefore, different user permissions will be configured as different kettle tools that perform different tasks to selectively extract data.

[0070] Leased data is extracted from the storage system using the Kettle tool and stored on an SFTP server. Specifically, SFTP stands for Secure File Transfer Protocol, providing a secure, encrypted method for transferring files over the Internet. SFTP shares nearly identical syntax and functionality with FTP. SFTP, part of SSH, is a secure method for transferring files to Blogger's server.

[0071] Specifically, data extracted through the SFTP server does not rely on the table structure of the storage system or the rental service system. After extracting data through the kettle tool, the output data can be reorganized. User data, including customer information and contract information, will ultimately be stored in the storage system. The storage system will import data files to the SFTP server every day. Data uploaded to the SFTP server can be obtained by other systems at any time. The micro-leasing service system will also use the kettle tool in the ETL to efficiently extract actual usage data into the system database every day, avoiding mutual calls between systems and the transmission of big data, and speeding up customer access to data. Relevant systems are all deployed in the intranet to ensure data security. At the same time, the micro-leasing service system stores leasing data and other related information. At this time, by logging into the app through the user terminal, user information and contract information can be queried.

[0072] Step S101: storing the lease data in the transfer table.

[0073] Specifically, the transfer table is a data table for temporarily storing data, which can be extracted by the user terminal at any time. The data in the transfer table can be updated and reorganized at any time, and the original data is replaced by the new data, thereby ensuring the timeliness and validity of the data.

[0074] Preferably, after the step of receiving the lease data sent by the SFTP server, the method further includes:

[0075] Step S100A: Access the device system through the gateway;

[0076] Step S100B: Acquire device information in the device system;

[0077] Step S100C: inserting the device information into the transfer table.

[0078] Specifically, when users use supplier and other related functions, the micro-leasing service system accesses the device system through the intermediate subsystem channel gateway. The device system can include several, where each type of device corresponds to a set of device systems. Each set of device systems includes suppliers and corresponding device information. The device information may include the price, model, function introduction, etc. of the equipment. By regularly updating the device system, each device system corresponds to a type of equipment and supplier information. By obtaining the model and price information of the supplier and its equipment in real time, the device information is finally displayed on the user's app page.

[0079] Furthermore, the step of obtaining device information in the device system includes:

[0080] Step S100B-1: extracting the device information in the device system according to the user's authority.

[0081] Specifically, the user can be scored through step S100-3, the user's authority can be obtained according to the preset data table, and the device information can be extracted according to the user's authority to obtain the device of the corresponding price range, and then the device information of the corresponding price can be inserted into the rental service system.

[0082] Step S102: inserting the transfer table into the target table of the user terminal to display data in the user terminal.

[0083] Furthermore, after the step of receiving the lease data sent by the SFTP server, the method further includes:

[0084] Step S100D: extracting the operation obtained from the storage system and stored in the SFTP server as a first execution script, and creating a first kjb file according to the first execution script;

[0085] Step S100E: The operation of receiving the rental data sent by the SFTP server is used as a second execution script, and a second kjb file is created according to the second execution script; wherein the first kjb file and the second kjb file are format types for saving files by the kettle tool.

[0086] Furthermore, after the step of creating a second kjb file according to the second execution script, the method further includes:

[0087] Step S100F: Execute the first kjb file and the second kjb file in sequence at regular intervals. When the execution of any one of the first kjb file and the second kjb file fails, stop executing.

[0088] Specifically, ktr and kjb are two format types for saving files in the kettel tool; each time the kettel tool executes a task, a kjb and ktr file will be constructed, so that the development file does not need to enter code every time. Each kjb file package or ktr file package can represent an operation. The next time it is used, the order of controls can be rearranged by directly dragging and dropping the kjb file package or ktr file package through the visual interface of the kettel tool. The execution order of operations can be changed by changing the execution position of the kjb file package or ktr file package.

[0089] Example 2

[0090] Figure 3A block diagram schematically illustrates a data extraction system according to the present invention. The extraction system can be divided into program modules. One or more program modules are stored in a storage medium and executed by a processor to implement the embodiments of the present invention. A program module, as referred to in the embodiments of the present invention, refers to a series of computer program instruction segments that can perform specific functions. The following description will specifically describe the functions of each program module in this embodiment.

[0091] like Figure 3 As shown, the extraction system 130 may include an extraction module 131 and a display module 132.

[0092] The extraction module 131 is configured to receive lease data sent by the SFTP server, wherein the lease data is extracted from the storage system using a kettle tool and stored in the SFTP server; the kettle tool is a tool configured using user permissions pre-stored in the storage system;

[0093] The display module 132 is configured to store the lease data in a transfer table and insert the transfer table into a target table of a user terminal to display the data in the user terminal.

[0094] The extraction module 131 is further configured to access a device system through a gateway; obtain device information in the device system; and insert the device information into the transfer table.

[0095] The extraction module 131 is further configured to extract the device information in the device system according to the user's authority.

[0096] The extraction module 131 is further configured to parse the lease data through the storage system; the lease data includes user information and contract information; score the user through the storage system based on the lease data; and match the user's permissions in a preset data table in the storage system based on the scoring result.

[0097] The extraction module 131 is further configured to score the user according to the following formula:

[0098] M=σ1X+σ2Y

[0099] Wherein, M is the user's rating result, X is the score of the user information, Y is the score of the contract information, σ1 is the weight corresponding to the user information, and σ2 is the weight corresponding to the contract information.

[0100] The extraction module 131 is also used to use the operation extracted from the storage system and stored in the SFTP server as the first execution script, and create a first kjb file according to the first execution script; use the operation of receiving the rental data sent by the SFTP server as the second execution script, and create a second kjb file according to the second execution script; wherein, the first kjb file and the second kjb file are the format types of the kettle tool for saving files.

[0101] The extraction module 131 is further configured to execute the first kjb file and the second kjb file in sequence at a fixed time, and stop executing when the execution of any one of the first kjb file and the second kjb file fails.

[0102] Example 3

[0103] Figure 4 The hardware architecture diagram of a computer device 6 suitable for implementing the data extraction method according to the third embodiment of the present invention is schematically shown. In this embodiment, the computer device 6 is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions. For example, it can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a rack server, a blade server, a tower server or a cabinet server (including an independent server or a server cluster composed of multiple servers), a gateway, etc. Figure 4 As shown, the computer device 6 includes at least but is not limited to: a memory 141, a processor 142, and a network interface 143 that can be interconnected through a system bus.

[0104] The memory 141 includes at least one type of computer-readable storage medium, including flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, a magnetic disk, an optical disk, etc. In some embodiments, the memory 141 may be an internal storage module of the computer device 6, such as the hard disk or memory of the computer device 6. In other embodiments, the memory 141 may also be an external storage device of the computer device 6, such as a plug-in hard disk equipped on the computer device 6, a SmartMedia Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. Of course, the memory 141 may also include both the internal storage module of the computer device 6 and its external storage device. In this embodiment, the memory 141 is generally used to store the operating system and various application software installed on the computer device 6, such as the program code of the data extraction method. In addition, the memory 141 can also be used to temporarily store various types of data that have been output or are to be output.

[0105] In some embodiments, the processor 142 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip. The processor 142 is generally used to control the overall operation of the computer device 6, such as performing control and processing related to data exchange or communication with the computer device 6. In this embodiment, the processor 142 is used to execute program code stored in the memory 141 or process data.

[0106] The network interface 143 may include a wireless network interface or a wired network interface. The network interface 143 is generally used to establish a communication link between the computer device 6 and other computer devices. For example, the network interface 143 is used to connect the computer device 6 to an external terminal via a network, establishing a data transmission channel and a communication link between the computer device 6 and the external terminal. The network can be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile Communications (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth, or Wi-Fi.

[0107] It should be pointed out that Figure 4 Only a computer device having components 141 - 143 is shown, but it should be understood that implementing all of the shown components is not a requirement, and greater or fewer components may alternatively be implemented.

[0108] In this embodiment, the data extraction method stored in the memory 141 may also be divided into one or more program modules and executed by a processor (processor 142 in this embodiment) to complete the embodiment of the present invention.

[0109] Example 4

[0110] The present invention also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the data extraction method in the embodiment are implemented.

[0111] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as the hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk equipped with the computer device, a smart memory card (SMC), a secure digital (SD) card, a flash memory card, etc. Of course, the computer-readable storage medium may also include both the internal storage unit of the computer device and its external storage device. In this embodiment, the computer-readable storage medium is generally used to store the operating system and various application software installed on the computer device, such as the program code of the abnormal account identification method in the embodiment. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are about to be output.

[0112] Obviously, those skilled in the art should understand that the various modules or steps of the above-mentioned embodiments of the present invention can be implemented using a general-purpose computing device, they can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices. Alternatively, they can be implemented using program code executable by the computing device, so that they can be stored in a storage device and executed by the computing device. In some cases, the steps shown or described can be performed in a different order than herein, or they can be made into separate integrated circuit modules, or multiple modules or steps can be made into a single integrated circuit module for implementation. Thus, the embodiments of the present invention are not limited to any specific combination of hardware and software.

[0113] The above are only preferred embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A data extraction method for a rental service system, wherein the rental service system includes a transfer table, characterized in that: The method comprises: Receiving lease data sent by the SFTP server, the lease data being data extracted from the storage system by a kettle tool and stored in the SFTP server; the kettle tool being a tool obtained by configuring the permissions of a user pre-stored in the storage system; Storing the lease data in the transfer table; Inserting the transfer table into the target table of the user terminal to display the data in the user terminal; Before receiving the lease data sent by the SFTP server, the following steps are also included: parsing the lease data by the storage system; the lease data including user information and contract information; Scoring the user through the storage system based on the rental data; According to the scoring results, matching the user's permissions in the preset data table in the storage system; After receiving the lease data sent by the SFTP server, the following steps are also included: The operation extracted from the storage system and stored in the SFTP server is used as a first execution script, and a first kjb file is created according to the first execution script; The operation of receiving the lease data sent by the SFTP server is used as the second execution script, and a second kjb file is created according to the second execution script; wherein, the first kjb file and the second kjb file are format types for saving files by the kettle tool.

2. The data extraction method according to claim 1, characterized in that: After receiving the lease data sent by the SFTP server, the following steps are also included: Access the device system through the gateway; Obtaining device information in the device system; Insert the device information into the transfer table.

3. The data extraction method according to claim 2, characterized in that: The step of obtaining device information in the device system includes: The device information in the device system is extracted according to the authority of the user.

4. The data extraction method according to claim 1, wherein: The step of scoring the user through the storage system according to the rental data includes: Users are scored according to the following formula: Wherein, M is the user's rating result, X is the score of the user information, and Y is the score of the contract information. is the weight corresponding to the user information, is the weight corresponding to the contract information.

5. The data extraction method according to claim 1, wherein: After the step of creating the second kjb file according to the second execution script, the method includes: The first kjb file and the second kjb file are executed in sequence at regular intervals. When the execution of any one of the first kjb file and the second kjb file fails, the execution is stopped.

6. A data extraction system, characterized in that: The data extraction system comprises: An extraction module is configured to receive lease data sent by an SFTP server, wherein the lease data is extracted from the storage system using a kettle tool and stored in the SFTP server; the kettle tool is a tool configured using user permissions pre-stored in the storage system; A display module, configured to store the lease data in a transfer table; and insert the transfer table into a target table of a user terminal to display the data in the user terminal; Before receiving the lease data sent by the SFTP server, it also includes: parsing the lease data by the storage system; the lease data including user information and contract information; Scoring the user through the storage system based on the rental data; According to the scoring results, matching the user's permissions in the preset data table in the storage system; After receiving the lease data sent by the SFTP server, it also includes: The operation extracted from the storage system and stored in the SFTP server is used as a first execution script, and a first kjb file is created according to the first execution script; The operation of receiving the lease data sent by the SFTP server is used as the second execution script, and a second kjb file is created according to the second execution script; wherein, the first kjb file and the second kjb file are format types for saving files by the kettle tool.

7. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, it is used to implement the steps of the data extraction method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that A computer program is stored therein, and the computer program can be executed by at least one processor to enable the at least one processor to perform the steps of the data extraction method according to any one of claims 1 to 5.

Images