Data extraction method and device, computer device, and storage medium

Abstract

The embodiment of the application belongs to the field of big data, and relates to a data extraction method, comprising the following steps: judging whether a data extraction request input by a user through a client is received; wherein the data extraction request carries target space encoding and data acquisition parameters; if yes, the target space encoding and the data acquisition parameters are parsed from the data extraction request; a target interface corresponding to the target space encoding is acquired, and a data acquisition SQL statement corresponding to the target interface is acquired; the data acquisition SQL statement is reorganized and processed based on the data acquisition parameters to obtain a corresponding target data acquisition SQL statement; the target data acquisition SQL statement is run to obtain corresponding target data; and the target data is returned to the client through the target interface. The application also provides a data extraction device, a computer device and a storage medium. In addition, the application also relates to blockchain technology, and the target data can be stored in the blockchain. Through the application, the development cost of interface-based data extraction can be reduced, and the efficiency of data extraction can be improved.

Description

Technical Field

[0001] This application relates to the field of big data technology, and in particular to data extraction methods, apparatus, computer equipment and storage media. Background Technology

[0002] Data service interfaces are being used more and more widely in the field of big data. Data platforms process and accumulate various types of data, such as basic data, marketing data, and user profile data, and need to provide data extraction services to external systems through interfaces.

[0003] With the advent of the big data era, fintech has gradually enabled information-based office work. Various organizations often have business needs for data extraction based on interfaces, driven by their own business development requirements. However, in interface-based data extraction processes, the interfaces created by developers often only implement one type of data retrieval logic. If different personnel have different data retrieval needs, new data retrieval logic needs to be written to create new interfaces to meet those needs. This approach tends to result in high development costs for data extraction, and the repeated writing of data retrieval logic requirements consumes significant human and time resources, leading to low efficiency in data extraction. Summary of the Invention

[0004] The purpose of this application is to provide a data extraction method, apparatus, computer equipment, and storage medium to solve the technical problem that in existing interface-based data extraction business processes, if different personnel have different data retrieval needs, new data retrieval logic needs to be written to create new interfaces to meet the data retrieval needs. This approach tends to result in high development costs for data extraction, and the repeated writing of data retrieval logic requirements consumes a lot of human and time resources, leading to low efficiency in data extraction.

[0005] To address the aforementioned technical problems, this application provides a data extraction method, employing the following technical solution:

[0006] Determine whether a data extraction request has been received from the user via the client; wherein the data extraction request carries the target space encoding and data retrieval parameters;

[0007] If so, parse the target space code and the data retrieval parameters from the data extraction request;

[0008] Obtain the target interface corresponding to the target space code, and obtain the data retrieval SQL statement corresponding to the target interface;

[0009] Based on the data retrieval parameters, the data retrieval SQL statement is reorganized to obtain the corresponding target data retrieval SQL statement;

[0010] Run the target data retrieval SQL statement to obtain the corresponding target data;

[0011] The target data is returned to the client through the target interface.

[0012] Furthermore, the step of reorganizing the data retrieval SQL statement based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement specifically includes:

[0013] The data retrieval SQL statement is parsed to obtain all the first data retrieval conditions contained in the data retrieval SQL statement; wherein, the number of the first data retrieval conditions includes multiple conditions.

[0014] Filter out the second data retrieval conditions that match the data retrieval parameters from all the first data retrieval conditions, and mark the data retrieval conditions other than the second data retrieval conditions from all the first data retrieval conditions as the third data retrieval conditions;

[0015] Based on the third data retrieval condition, the first data retrieval condition in the first data retrieval SQL statement is removed to obtain the processed first data retrieval SQL statement.

[0016] Based on the data retrieval parameters, the second data retrieval condition in the first data retrieval SQL statement is conditionally assigned to obtain the processed second data retrieval SQL statement;

[0017] Use the second data retrieval SQL statement as the target data retrieval SQL statement.

[0018] Furthermore, the step of running the target data retrieval SQL statement to obtain the corresponding target data specifically includes:

[0019] Run the target data retrieval SQL statement and parse out the fourth data retrieval condition and data source contained within the target data retrieval SQL statement;

[0020] Based on the fourth data retrieval condition, the data retrieval data source is queried, and the query data corresponding to the fourth data retrieval condition is retrieved from the data retrieval data source;

[0021] The query data is used as the target data.

[0022] Furthermore, before the steps of obtaining the target interface corresponding to the target space code and obtaining the data retrieval SQL statement corresponding to the target interface, the method further includes:

[0023] Receive an interface construction request corresponding to the target interface input by the target user;

[0024] Displays the preset interface configuration page;

[0025] Receive the interface parameters, the target space code, and the data retrieval logic rules corresponding to the data retrieval SQL statement input by the target user on the interface configuration page;

[0026] The target interface is constructed based on the interface parameters, the target space encoding, and the data retrieval logic rules.

[0027] Furthermore, after the step of running the target data retrieval SQL statement to obtain the corresponding target data, the method further includes:

[0028] Determine whether a data query request corresponding to the target data has been received from the user input;

[0029] If so, obtain the indicator identifiers of each indicator data contained in the target data, and display the check page containing the indicator identifiers;

[0030] Receive the specified check mark selected by the user on the check mark page;

[0031] Filter the target data to select the specified data corresponding to the check mark;

[0032] Display the specified data.

[0033] Furthermore, after the step of returning the target data to the client through the target interface, the method further includes:

[0034] Retrieve the preset interface level table;

[0035] Based on the target space number, obtain the target level corresponding to the target interface from the interface level table;

[0036] Determine the target storage method corresponding to the target level;

[0037] The target data is stored based on the target storage method.

[0038] Furthermore, the data extraction method also includes:

[0039] Determine whether a data adjustment request for the target interface triggered by the user has been received;

[0040] If so, display the preset adjustment page;

[0041] Receive adjustment information input by the user on the adjustment page;

[0042] Based on the adjustment information, the target interface is adjusted accordingly.

[0043] To address the aforementioned technical problems, this application also provides a data extraction device, which employs the following technical solution:

[0044] The first judgment module is used to determine whether a data extraction request input by the user through the client has been received; wherein the data extraction request carries the target space encoding and data retrieval parameters;

[0045] The parsing module is used to parse the target space code and the data retrieval parameters from the data extraction request if the condition is met.

[0046] The first acquisition module is used to acquire the target interface corresponding to the target space code and to acquire the data retrieval SQL statement corresponding to the target interface;

[0047] The first processing module is used to reorganize the data retrieval SQL statement based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement.

[0048] The execution module is used to run the target data retrieval SQL statement to obtain the corresponding target data;

[0049] The second processing module is used to return the target data to the client through the target interface.

[0050] To address the aforementioned technical problems, this application also provides a computer device that employs the following technical solution:

[0051] Determine whether a data extraction request has been received from the user via the client; wherein the data extraction request carries the target space encoding and data retrieval parameters;

[0052] If so, parse the target space code and the data retrieval parameters from the data extraction request;

[0053] Obtain the target interface corresponding to the target space code, and obtain the data retrieval SQL statement corresponding to the target interface;

[0054] Based on the data retrieval parameters, the data retrieval SQL statement is reorganized to obtain the corresponding target data retrieval SQL statement;

[0055] Run the target data retrieval SQL statement to obtain the corresponding target data;

[0056] The target data is returned to the client through the target interface.

[0057] To address the aforementioned technical problems, this application also provides a computer-readable storage medium, employing the technical solution described below:

[0058] Determine whether a data extraction request has been received from the user via the client; wherein the data extraction request carries the target space encoding and data retrieval parameters;

[0059] If so, parse the target space code and the data retrieval parameters from the data extraction request;

[0060] Obtain the target interface corresponding to the target space code, and obtain the data retrieval SQL statement corresponding to the target interface;

[0061] Based on the data retrieval parameters, the data retrieval SQL statement is reorganized to obtain the corresponding target data retrieval SQL statement;

[0062] Run the target data retrieval SQL statement to obtain the corresponding target data;

[0063] The target data is returned to the client through the target interface.

[0064] Compared with the prior art, the embodiments of this application have the following main advantages:

[0065] This embodiment first determines whether a data extraction request input by a user through a client has been received. If so, the target space code and the data retrieval parameters are parsed from the data extraction request. Then, the target interface corresponding to the target space code is obtained, and the data retrieval SQL statement corresponding to the target interface is obtained. Next, the data retrieval SQL statement is reorganized based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement. Subsequently, the target data retrieval SQL statement is executed to obtain the corresponding target data. Finally, the target data is returned to the client through the target interface. This embodiment can determine the corresponding target interface based on the target space code input by the user, and can intelligently reorganize the data retrieval SQL statement of the target interface based on the data retrieval parameters input by the user, so as to quickly and accurately obtain the target data retrieval SQL statement corresponding to the user's individual needs, thereby enabling multiple data retrieval logics to be implemented in the same interface. By simply having the user input dynamic data retrieval parameters, the system can intelligently reassemble the data retrieval SQL statement of the target interface based on these parameters. The system can then retrieve the target data that the user needs by running the reassembled data retrieval SQL statement. This eliminates the need for users to write a corresponding interface for each set of data retrieval conditions, greatly reducing repetitive workload, lowering the development cost of interface-based data retrieval, improving data retrieval efficiency, and enhancing the user experience. Attached Figure Description

[0066] To more clearly illustrate the solutions in this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0067] Figure 1 This is an exemplary system architecture diagram to which this application can be applied;

[0068] Figure 2 A flowchart of an embodiment of the data extraction method according to this application;

[0069] Figure 3 This is a schematic diagram of the structure of one embodiment of the data extraction apparatus according to this application;

[0070] Figure 4 This is a schematic diagram of the structure of one embodiment of the computer device according to this application. Detailed Implementation

[0071] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains; the terminology used herein in the specification of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "comprising" and "having," and any variations thereof, in the specification, claims, and foregoing drawings of this application, are intended to cover non-exclusive inclusion. The terms "first," "second," etc., in the specification, claims, or foregoing drawings of this application are used to distinguish different objects, not to describe a particular order.

[0072] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0073] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

[0074] like Figure 1As shown, system architecture 100 may include terminal devices 101, 102, and 103, a network 104, and a server 105. Network 104 serves as the medium for providing communication links between terminal devices 101, 102, and 103 and server 105. Network 104 may include various connection types, such as wired or wireless communication links, or fiber optic cables, etc.

[0075] Users can use terminal devices 101, 102, and 103 to interact with server 105 via network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, and 103, such as web browser applications, shopping applications, search applications, instant messaging tools, email clients, social media platform software, etc.

[0076] Terminal devices 101, 102, and 103 can be various electronic devices with displays and support web browsing, including but not limited to smartphones, tablets, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III), MP4 players (Moving Picture Experts Group Audio Layer IV), laptops, and desktop computers, etc.

[0077] Server 105 can be a server that provides various services, such as a backend server that supports the pages displayed on terminal devices 101, 102, and 103.

[0078] It should be noted that the data extraction method provided in this application embodiment is generally executed by a server / terminal device, and correspondingly, the data extraction device is generally set in the server / terminal device.

[0079] It should be understood that Figure 1 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of terminal devices, networks, and servers can be included.

[0080] Continue to refer to Figure 2 A flowchart of an embodiment of the data extraction method according to this application is shown. The data extraction method includes the following steps:

[0081] Step S201: Determine whether a data extraction request input by the user through the client has been received; wherein the data extraction request carries the target space encoding and data retrieval parameters.

[0082] In this embodiment, the data extraction method operates on an electronic device (e.g., Figure 1 The server / terminal device shown can acquire the image to be checked via wired or wireless connection. It should be noted that the aforementioned wireless connection methods include, but are not limited to, 3G / 4G / 5G, WiFi, Bluetooth, WiMAX, Zigbee, UWB (ultra-wideband), and other currently known or future wireless connection methods. The aforementioned data extraction request is a user-triggered data extraction request corresponding to the target interface. The target space code is the unique identifier of the target interface. All interfaces are assigned to a space; the generated interface's URL must include the space code. The space code is primarily used for space-based resource isolation of services. If a request in one space is blocked, it will not affect requests in other spaces. It also supports limiting the concurrent requests by space, and the backend can dynamically adjust the request concurrency of each space based on the call volume of each space. Furthermore, the aforementioned data retrieval parameters include at least the data retrieval condition data and may also include parameters corresponding to that data retrieval condition data.

[0083] Step S202: If yes, parse the target space code and the data retrieval parameters from the data extraction request.

[0084] In this embodiment, the target space code and the data retrieval parameters can be extracted from the data extraction request by parsing the data extraction request.

[0085] Step S203: Obtain the target interface corresponding to the target space code, and obtain the data retrieval SQL statement corresponding to the target interface.

[0086] In this embodiment, a correspondence between the target interface and the target space code and the data retrieval SQL statement is pre-created, and the relevant information of the target interface is stored accordingly based on the correspondence.

[0087] Step S204: Based on the data retrieval parameters, the data retrieval SQL statement is reorganized to obtain the corresponding target data retrieval SQL statement.

[0088] In this embodiment, the specific implementation process of reorganizing the data retrieval SQL statement based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement will be further described in detail in subsequent specific embodiments of this application, and will not be elaborated on here. Specifically, after the interface is created, it is necessary to write SQL corresponding to the data retrieval logic of the interface. The interface supports custom parameters, mainly used for dynamic conditional data filtering. For example, if the interface contains many data retrieval conditions, such as certain fields equaling certain values, developers can define the filtering values ​​as parameters and pass them through the interface. Parameters are not mandatory. The backend service will parse the SQL, extract the user-defined parameters from the SQL, and automatically adapt them according to the interface parameters, assigning values ​​to the conditions. Of course, users can configure many parameters. When users do not pass parameters, the backend will adapt the SQL and remove the corresponding SQL conditions according to the user-configured parameters, achieving dynamic combination of conditional filtering. This avoids writing an interface for each set of conditions, thus reducing workload duplication.

[0089] Step S205: Run the target data retrieval SQL statement to obtain the corresponding target data.

[0090] In this embodiment, the specific implementation process of running the target data retrieval SQL statement to obtain the corresponding target data will be further described in detail in subsequent specific embodiments of this application, and will not be elaborated on here.

[0091] Step S206: Return the target data to the client through the target interface.

[0092] In this embodiment, the target data is returned to the client through the target interface, allowing the user to process subsequent business based on the extracted target data.

[0093] This application first determines whether a data extraction request input by a user through a client has been received. If so, it parses the target space code and the data retrieval parameters from the data extraction request. Then, it obtains the target interface corresponding to the target space code and the data retrieval SQL statement corresponding to the target interface. Next, it reassembles the data retrieval SQL statement based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement. Subsequently, it runs the target data retrieval SQL statement to obtain the corresponding target data. Finally, it returns the target data to the client through the target interface. This application can determine the corresponding target interface based on the target space code input by the user and can intelligently reassemble the data retrieval SQL statement of the target interface based on the data retrieval parameters input by the user, so as to quickly and accurately obtain the target data retrieval SQL statement corresponding to the user's individual needs, thereby enabling multiple data retrieval logics to be implemented in the same interface. By simply having the user input dynamic data retrieval parameters, the system can intelligently reassemble the data retrieval SQL statement of the target interface based on these parameters. The system can then retrieve the target data that the user needs by running the reassembled data retrieval SQL statement. This eliminates the need for users to write a corresponding interface for each set of data retrieval conditions, greatly reducing repetitive workload, lowering the development cost of interface-based data retrieval, improving data retrieval efficiency, and enhancing the user experience.

[0094] In some alternative implementations, step S204 includes the following steps:

[0095] The data retrieval SQL statement is parsed to obtain all the first data retrieval conditions contained in the data retrieval SQL statement. The number of first data retrieval conditions includes multiple conditions.

[0096] In this embodiment, the data retrieval SQL statement includes at least a first data retrieval condition and a data source. The data retrieval SQL statement may also include a return result field; if no return result field is specified, all fields corresponding to the first data retrieval condition are returned by default.

[0097] Select the second data retrieval condition that matches the data retrieval parameter from all the first data retrieval conditions, and mark the data retrieval conditions other than the second data retrieval condition from all the first data retrieval conditions as the third data retrieval condition.

[0098] In this embodiment, the data retrieval parameters mentioned above include at least data retrieval condition data, and may also include parameters corresponding to the data retrieval condition data. For example, the above data retrieval SQL statement may be:

[0099] SELECT

[0100] FROM emp f

[0101] WHERE sal>8800

[0102] AND deptno=30

[0103] AND job = 'MANAGER';

[0104] In this SQL statement, `empf` represents the data source, and `sal>8800`, `deptno=30`, and `job='MANAGER'` represent the first data retrieval conditions. For example, if the data retrieval parameters include `sal>8000` and `deptno=60`, then the corresponding data retrieval parameters include data condition 1: `sal>8000`, where the parameter corresponding to data condition 1 is 8000, and data condition 2: `deptno=60`, where the parameter corresponding to data condition 2 is 60. Therefore, the second data retrieval conditions that match the data retrieval parameters in the first data retrieval conditions include `sal>8800` and `deptno=30`.

[0105] Based on the third data retrieval condition, the first data retrieval condition in the first data retrieval SQL statement is removed to obtain the processed first data retrieval SQL statement.

[0106] In this embodiment, all the aforementioned third data retrieval conditions can be extracted from the first data retrieval condition in the first data retrieval SQL statement to obtain the first data retrieval SQL statement.

[0107] Based on the data retrieval parameters, the second data retrieval condition in the first data retrieval SQL statement is conditionally assigned to obtain the processed second data retrieval SQL statement.

[0108] In this embodiment, the parameters corresponding to the data retrieval conditions contained in the data retrieval parameters can be used to perform conditional assignment processing on the second data retrieval condition in the first data retrieval SQL statement, i.e., conditional parameter substitution processing, to obtain the second data retrieval SQL statement. Referring to the above example, the resulting processed second data retrieval SQL statement is:

[0109] SELECT

[0110] FROM emp f

[0111] WHERE sal>8800

[0112] AND deptno = 60;

[0113] Use the second data retrieval SQL statement as the target data retrieval SQL statement.

[0114] This application parses the data retrieval SQL statement to obtain all first data retrieval conditions contained in the SQL statement; then, it filters out second data retrieval conditions that match the data retrieval parameters from all the first data retrieval conditions, and marks the data retrieval conditions other than the second data retrieval conditions as third data retrieval conditions; subsequently, it performs condition elimination processing on the first data retrieval conditions in the first data retrieval SQL statement based on the third data retrieval conditions to obtain a processed first data retrieval SQL statement; subsequently, it performs condition assignment processing on the second data retrieval conditions in the first data retrieval SQL statement based on the data retrieval parameters to obtain a processed second data retrieval SQL statement, and uses the second data retrieval SQL statement as the target data retrieval SQL statement. This application can intelligently reorganize the data retrieval SQL statement according to the data retrieval parameters input by the user to quickly and accurately obtain the target data retrieval SQL statement corresponding to the user's individual needs, thereby enabling the implementation of multiple data retrieval logics in the same interface. The system allows users to input dynamic data retrieval parameters, which intelligently reassemble the SQL statement for the interface. By running the reassembled SQL statement, the system can retrieve the data the user needs. This eliminates the need for users to write a corresponding interface for each set of data retrieval conditions, greatly reducing repetitive workload, lowering the development cost of interface-based data retrieval, improving data retrieval efficiency, and enhancing the user experience.

[0115] In some optional implementations of this embodiment, step S205 includes the following steps:

[0116] Run the target data retrieval SQL statement and parse out the fourth data retrieval condition and data source contained within the target data retrieval SQL.

[0117] In this embodiment, the target data retrieval SQL statement includes at least a fourth data retrieval condition and a data source, and may also include return result fields. If no return result fields are specified, all fields corresponding to the fourth data retrieval condition are returned by default. For example, the target data retrieval SQL statement may be:

[0118]

[0119] Here, f.name, f.sal, and f.deptno are the returned result fields. f.name represents the employee's name extracted from the employee table f, f.sal represents the employee's salary extracted from the employee table f, and f.deptno represents the employee's department number extracted from the employee table f. emp f is the data source, referring to the employee table f. sal>8000 is the fourth data retrieval condition, representing the query for employees with a salary greater than 8000.

[0120] Based on the fourth data retrieval condition, the data retrieval data source is queried, and the query data corresponding to the fourth data retrieval condition is retrieved from the data retrieval data source.

[0121] The query data is used as the target data.

[0122] This application executes the target data retrieval SQL statement to parse out the fourth data retrieval condition and the data source contained within the target data retrieval SQL; then, based on the fourth data retrieval condition, it performs query processing on the data source to retrieve the query data corresponding to the fourth data retrieval condition, and uses the query data as the target data. By executing the target data retrieval SQL statement, this application can automatically and quickly retrieve the target data corresponding to the fourth data retrieval condition from the data source, improving the efficiency and intelligence of target data acquisition.

[0123] In some alternative implementations, prior to step S203, the electronic device may also perform the following steps:

[0124] Receive an interface construction request from the target user that corresponds to the target interface.

[0125] In this embodiment, the aforementioned interface construction request is a request used to construct the aforementioned target interface.

[0126] Displays the preset interface configuration page.

[0127] In this embodiment, the interface configuration page is an editable and visual page.

[0128] The system receives the interface parameters, the target space code, and the data retrieval logic rules corresponding to the data retrieval SQL statement input by the target user on the interface configuration page.

[0129] In this embodiment, the interface parameters mentioned above may include at least the following parameters: timeout (how many seconds a request takes to disconnect, to ensure the cluster does not become congested), number of data entries, request path (the path at the beginning of the generated API is fixed, followed by a spatial code + user definition), and cache time (the cache time for the data). The target spatial code has a one-to-one correspondence with the target interface, and this target spatial code can be considered as the unique identifier of the target interface. The data retrieval logic rules mentioned above can be program code customized by the user according to actual business needs. This program code can be in the form of SQL statements, that is, the SQL statements input by the user are used as the required data retrieval logic rules.

[0130] The target interface is constructed based on the interface parameters, the target space encoding, and the data retrieval logic rules.

[0131] In this embodiment, the target interface is generated by publishing the interface parameters, the target space encoding, and the data retrieval logic rules to a preset API gateway, thereby registering the target interface on the API gateway.

[0132] When this application receives an interface construction request corresponding to the target interface from a target user, it displays a preset interface configuration page; then, it receives the interface parameters, the target space code, and the data retrieval logic rules corresponding to the data retrieval SQL statement input by the target user on the interface configuration page; and then constructs the target interface based on the interface parameters, the target space code, and the data retrieval logic rules. This application can automatically and quickly generate target interfaces that meet user needs based on the interface configuration information input by the user, achieving flexible and intelligent generation of target interfaces and improving the user experience.

[0133] In another embodiment, the created interface also supports dynamic aggregation, implemented based on custom parameters. When users need to perform groupBY aggregation in SQL, they can either define parameters and pass them through the interface to achieve dynamic dimensional aggregation. The backend service will reassemble the data retrieval SQL based on the aggregation field parameters. Furthermore, the created interface supports various custom function algorithms for accumulation, such as year-on-year, month-on-month, percentage, and group percentage, similar to SQL engine functions. Developers only need to use the accumulation function to implement the accumulation of a column; the backend service will then parse the function and automatically accumulate the column, eliminating the need for developers to write complex SQL. Similarly, for year-on-year and month-on-month comparisons, if the SQL uses a year-on-year function, the backend will split the SQL into multiple SQL statements based on the date field offset, execute the results, and calculate the year-on-year comparison for the same dimension. This eliminates the need for developers to worry about database engine syntax differences. In addition, the created interface supports data caching. The backend service monitors table data updates; if table data is updated, the backend will automatically clear the API cache, ensuring the data is always up-to-date.

[0134] In some alternative implementations, after step S205, the electronic device may further perform the following steps:

[0135] Determine whether a data query request corresponding to the user input has been received.

[0136] In this embodiment, when an interface calculates many, such as hundreds, of metrics, if the user only needs to extract a few metrics, querying all the metrics would waste performance and memory. Furthermore, the data acquisition personnel would need to manually extract the required metrics from a large amount of data, which would also consume a lot of human resources.

[0137] If so, obtain the indicator identifiers of each indicator data contained in the target data, and display a selection page containing the indicator identifiers.

[0138] In this embodiment, the aforementioned indicator identifier may refer to the indicator name of the indicator data.

[0139] Receive the specified check mark selected by the user on the check mark page.

[0140] In this embodiment, users can select all the check marks according to their actual needs in the check interface.

[0141] Select the specified data corresponding to the check mark from the target data.

[0142] Display the specified data.

[0143] In this embodiment, there is no specific limitation on the way the specified data is displayed. For example, the specified data can be displayed on the current interface of the client.

[0144] When this application receives a data query request from a user corresponding to the target data, it acquires the indicator identifiers of each indicator data contained in the target data and displays a checkbox page containing the indicator identifiers; then, it receives the specified checkbox identifier selected by the user on the checkbox page; subsequently, it filters out the specified data corresponding to the checkbox identifier from the target data; and finally, it displays the specified data. This application can intelligently filter out and display the specified data corresponding to the checkbox identifier selected by the user from the target data, effectively improving the efficiency and intelligence of obtaining the specified data and enhancing the user experience.

[0145] In some optional implementations of this embodiment, after step S206, the electronic device may further perform the following steps:

[0146] Retrieve the preset interface level table.

[0147] In this embodiment, the aforementioned interface level table can be a pre-built space number storing multiple interfaces according to actual business needs, and a storage of the interface level corresponding to each interface's space number. The interface levels include important level, medium level, and normal level.

[0148] Based on the target space number, the target level corresponding to the target interface is obtained from the interface level table.

[0149] In this embodiment, the target level corresponding to the target interface is retrieved by querying the interface level table using the target space number.

[0150] Determine the target storage method corresponding to the target level.

[0151] In this embodiment, for different interface levels, data storage methods corresponding to each interface level are pre-configured according to actual business needs. For example, if the interface level is normal, the corresponding data storage method is local storage; if the interface level is medium, the corresponding data storage method is cloud storage; and if the interface level is important, the corresponding data storage method is blockchain storage.

[0152] The target data is stored based on the target storage method.

[0153] This application obtains a preset interface level table; then, based on the target space number, retrieves the target level corresponding to the target interface from the interface level table; subsequently, it determines the target storage method corresponding to the target level; and finally, it stores the target data based on the target storage method. This application uses the interface level table to obtain the target level corresponding to the target interface, and then uses the target storage method corresponding to that target level to store the target data, effectively improving the intelligence and standardization of target data storage. Furthermore, by storing the target data, when relevant users subsequently have a need to retrieve the target data, they do not need to re-run the relevant data storage and calculation operations, but can directly obtain the pre-stored target data, thereby improving the system's operating speed.

[0154] In some optional implementations of this embodiment, the electronic device may further perform the following steps:

[0155] Determine whether a data adjustment request for the target interface triggered by the user has been received.

[0156] If so, display the preset adjustment page.

[0157] In this embodiment, the aforementioned adjustment page is an editable page containing information such as interface parameters corresponding to the target interface, target space encoding, and data retrieval SQL statements.

[0158] Receive adjustment information entered by the user on the adjustment page.

[0159] In this embodiment, the aforementioned adjustment information may include processing information such as adding, deleting, or replacing user-inputted interface parameters, target space encoding, and data retrieval SQL statements corresponding to the target interface.

[0160] Based on the adjustment information, the target interface is adjusted accordingly.

[0161] When this application receives a data adjustment request for the target interface triggered by a user, it displays a preset adjustment page; then it receives the adjustment information entered by the user on the adjustment page; and then performs corresponding adjustment processing on the target interface based on the adjustment information. This application provides an online modification function for the target interface, allowing users to extend the target interface according to their personalized needs, thus improving the user experience. Furthermore, the adjustment information entered by the user takes effect immediately, eliminating the need for a new release to address changes in the target interface's logic, thereby improving the processing efficiency of interface adjustments.

[0162] It should be emphasized that, to further ensure the privacy and security of the aforementioned target data, the target data can also be stored in a node of a blockchain.

[0163] The blockchain referred to in this application is a novel application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanisms, and encryption algorithms. Essentially, a blockchain is a decentralized database, a chain of data blocks linked together using cryptographic methods. Each data block contains information about a batch of network transactions, used to verify the validity of the information (anti-counterfeiting) and generate the next block. A blockchain can include an underlying blockchain platform, a platform product service layer, and an application service layer.

[0164] The embodiments of this application can acquire and process relevant data based on artificial intelligence technology. Artificial intelligence (AI) refers to the theories, methods, technologies, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results.

[0165] Foundational technologies for artificial intelligence generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies mainly encompass computer vision, robotics, biometrics, speech processing, natural language processing, and machine learning / deep learning.

[0166] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing related hardware with computer-readable instructions. These computer-readable instructions can be stored in a computer-readable storage medium. When executed, the program can include the processes of the embodiments of the above methods. The aforementioned storage medium can be a non-volatile storage medium such as a magnetic disk, optical disk, or read-only memory (ROM), or random access memory (RAM).

[0167] It should be understood that although the steps in the flowcharts of the accompanying figures are shown sequentially as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the accompanying figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0168] Further reference Figure 3 As a response to the above Figure 2 To implement the method shown, this application provides an embodiment of a data extraction device, which is similar to... Figure 2 Corresponding to the method embodiments shown, this device can be specifically applied to various electronic devices.

[0169] like Figure 3 As shown, the data extraction device 300 described in this embodiment includes: a first judgment module 301, a parsing module 302, a first acquisition module 303, a first processing module 304, a running module 305, and a second processing module 306. Wherein:

[0170] The first judgment module 301 is used to determine whether a data extraction request input by the user through the client has been received; wherein the data extraction request carries the target space encoding and data retrieval parameters;

[0171] Parsing module 302 is used to parse the target space code and the data retrieval parameters from the data extraction request if the condition is met.

[0172] The first acquisition module 303 is used to acquire the target interface corresponding to the target space code and to acquire the data retrieval SQL statement corresponding to the target interface;

[0173] The first processing module 304 is used to reorganize the data retrieval SQL statement based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement.

[0174] The execution module 305 is used to execute the target data retrieval SQL statement to obtain the corresponding target data;

[0175] The second processing module 306 is used to return the target data to the client through the target interface.

[0176] In this embodiment, the operations performed by the above modules or units correspond one-to-one with the steps of the data extraction method in the aforementioned embodiments, and will not be repeated here.

[0177] In some optional implementations of this embodiment, the first processing module 304 includes:

[0178] The first parsing submodule is used to parse the data retrieval SQL statement and obtain all the first data retrieval conditions contained in the data retrieval SQL statement; wherein, the number of the first data retrieval conditions includes multiple conditions.

[0179] The filtering submodule is used to filter out the second data retrieval conditions that match the data retrieval parameters from all the first data retrieval conditions, and mark the data retrieval conditions other than the second data retrieval conditions from all the first data retrieval conditions as the third data retrieval conditions;

[0180] The first processing submodule is used to perform condition removal processing on the first data retrieval condition in the first data retrieval SQL statement based on the third data retrieval condition, so as to obtain the processed first data retrieval SQL statement.

[0181] The second processing submodule is used to perform conditional assignment processing on the second data retrieval condition in the first data retrieval SQL statement based on the data retrieval parameters, so as to obtain the processed second data retrieval SQL statement.

[0182] The first determining submodule is used to use the second data retrieval SQL statement as the target data retrieval SQL statement.

[0183] In this embodiment, the operations performed by the above modules or units correspond one-to-one with the steps of the data extraction method in the aforementioned embodiments, and will not be repeated here.

[0184] In some optional implementations of this embodiment, the running module 305 includes:

[0185] The second parsing submodule is used to run the target data retrieval SQL statement and parse out the fourth data retrieval condition and data source contained in the target data retrieval SQL statement;

[0186] The query submodule is used to perform query processing on the data source based on the fourth data retrieval condition, and retrieve query data corresponding to the fourth data retrieval condition from the data source;

[0187] The second determining submodule is used to use the query data as the target data.

[0188] In this embodiment, the operations performed by the above modules or units correspond one-to-one with the steps of the data extraction method in the aforementioned embodiments, and will not be repeated here.

[0189] In some optional implementations of this embodiment, the data extraction device further includes:

[0190] The first receiving module is used to receive an interface construction request input by the target user that corresponds to the target interface;

[0191] The first display module is used to display the preset interface configuration page;

[0192] The second receiving module is used to receive the interface parameters, the target space code, and the data retrieval logic rules corresponding to the data retrieval SQL statement input by the target user on the interface configuration page.

[0193] A construction module is used to construct the target interface based on the interface parameters, the target space encoding, and the data retrieval logic rules.

[0194] In this embodiment, the operations performed by the above modules or units correspond one-to-one with the steps of the data extraction method in the aforementioned embodiments, and will not be repeated here.

[0195] In some optional implementations of this embodiment, the data extraction device further includes:

[0196] The second judgment module is used to determine whether a data query request corresponding to the target data input by the user has been received.

[0197] The second acquisition module is used to acquire the indicator identifiers of each indicator data contained in the target data if the condition is met, and to display a selection page containing the indicator identifiers.

[0198] The third receiving module is used to receive the specified check mark selected by the user on the check page;

[0199] The filtering module is used to filter out the specified data corresponding to the check mark from the target data;

[0200] The second display module is used to display the specified data.

[0201] In this embodiment, the operations performed by the above modules or units correspond one-to-one with the steps of the data extraction method in the aforementioned implementation method, and will not be repeated here.

[0202] In some optional implementations of this embodiment, the data extraction device further includes:

[0203] The third acquisition module is used to acquire the preset interface level table;

[0204] The fourth acquisition module is used to obtain the target level corresponding to the target interface from the interface level table based on the target space number;

[0205] The determination module is used to determine the target storage method corresponding to the target level;

[0206] A storage module is used to store the target data based on the target storage method.

[0207] In this embodiment, the operations performed by the above modules or units correspond one-to-one with the steps of the data extraction method in the aforementioned embodiments, and will not be repeated here.

[0208] In some optional implementations of this embodiment, the data extraction device further includes:

[0209] The third judgment module is used to determine whether a data adjustment request for the target interface triggered by the user has been received;

[0210] The third display module, if applicable, displays the preset adjustment page;

[0211] The fourth receiving module is used to receive the adjustment information entered by the user on the adjustment page;

[0212] The adjustment module is used to perform corresponding adjustment processing on the target interface based on the adjustment information.

[0213] In this embodiment, the operations performed by the above modules or units correspond one-to-one with the steps of the data extraction method in the aforementioned embodiments, and will not be repeated here.

[0214] To address the aforementioned technical problems, embodiments of this application also provide a computer device. Please refer to [link / reference needed]. Figure 4 , Figure 4 This is a basic structural block diagram of the computer device in this embodiment.

[0215] The computer device 4 includes a memory 41, a processor 42, and a network interface 43 that are interconnected via a system bus. It should be noted that only the computer device 4 with components 41-43 is shown in the figure; however, it should be understood that it is not required to implement all the shown components, and more or fewer components can be implemented alternatively. Those skilled in the art will understand that the computer device described here is a device capable of automatically performing numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes, but is not limited to, microprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), embedded devices, etc.

[0216] The computer device can be a desktop computer, laptop, handheld computer, or cloud server, etc. The computer device can interact with the user via a keyboard, mouse, remote control, touchpad, or voice control.

[0217] The memory 41 includes at least one type of readable storage medium, including flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 41 may be an internal storage unit of the computer device 4, such as the hard disk or memory of the computer device 4. In other embodiments, the memory 41 may also be an external storage device of the computer device 4, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the computer device 4. Of course, the memory 41 may also include both the internal storage unit and its external storage device of the computer device 4. In this embodiment, the memory 41 is typically used to store the operating system and various application software installed on the computer device 4, such as computer-readable instructions for data extraction methods. In addition, the memory 41 can also be used to temporarily store various types of data that have been output or will be output.

[0218] In some embodiments, the processor 42 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip. The processor 42 is typically used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is used to execute computer-readable instructions stored in the memory 41 or to process data, for example, to execute computer-readable instructions for the data extraction method.

[0219] The network interface 43 may include a wireless network interface or a wired network interface, which is typically used to establish communication connections between the computer device 4 and other electronic devices.

[0220] Compared with the prior art, the embodiments of this application have the following main advantages:

[0221] In this embodiment, it is first determined whether a data extraction request input by the user through the client has been received; if so, the target space code and the data retrieval parameters are parsed from the data extraction request; then, the target interface corresponding to the target space code is obtained, and the data retrieval SQL statement corresponding to the target interface is obtained; then, the data retrieval SQL statement is reorganized based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement; subsequently, the target data retrieval SQL statement is run to obtain the corresponding target data; finally, the target data is returned to the client through the target interface. This embodiment can determine the corresponding target interface based on the target space code input by the user, and can intelligently reorganize the data retrieval SQL statement of the target interface based on the data retrieval parameters input by the user, so as to quickly and accurately obtain the target data retrieval SQL statement corresponding to the user's personal needs, thereby enabling multiple data retrieval logics to be implemented in the same interface. By simply having the user input dynamic data retrieval parameters, the system can intelligently reassemble the data retrieval SQL statement of the target interface based on these parameters. The system can then retrieve the target data that the user needs by running the reassembled data retrieval SQL statement. This eliminates the need for users to write a corresponding interface for each set of data retrieval conditions, greatly reducing repetitive workload, lowering the development cost of interface-based data retrieval, improving data retrieval efficiency, and enhancing the user experience.

[0222] This application also provides another embodiment, namely, a computer-readable storage medium storing computer-readable instructions that can be executed by at least one processor to cause the at least one processor to perform the steps of the data extraction method described above.

[0223] Compared with the prior art, the embodiments of this application have the following main advantages:

[0224] In this embodiment, it is first determined whether a data extraction request input by the user through the client has been received; if so, the target space code and the data retrieval parameters are parsed from the data extraction request; then, the target interface corresponding to the target space code is obtained, and the data retrieval SQL statement corresponding to the target interface is obtained; then, the data retrieval SQL statement is reorganized based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement; subsequently, the target data retrieval SQL statement is run to obtain the corresponding target data; finally, the target data is returned to the client through the target interface. This embodiment can determine the corresponding target interface based on the target space code input by the user, and can intelligently reorganize the data retrieval SQL statement of the target interface based on the data retrieval parameters input by the user, so as to quickly and accurately obtain the target data retrieval SQL statement corresponding to the user's personal needs, thereby enabling multiple data retrieval logics to be implemented in the same interface. By simply having the user input dynamic data retrieval parameters, the system can intelligently reassemble the data retrieval SQL statement of the target interface based on these parameters. The system can then retrieve the target data that the user needs by running the reassembled data retrieval SQL statement. This eliminates the need for users to write a corresponding interface for each set of data retrieval conditions, greatly reducing repetitive workload, lowering the development cost of interface-based data retrieval, improving data retrieval efficiency, and enhancing the user experience.

[0225] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0226] Obviously, the embodiments described above are only some embodiments of this application, not all embodiments. The accompanying drawings show preferred embodiments of this application, but do not limit the patent scope of this application. This application can be implemented in many different forms; rather, the purpose of providing these embodiments is to provide a more thorough and comprehensive understanding of the disclosure of this application. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing specific embodiments, or make equivalent substitutions for some of the technical features. Any equivalent structures made using the content of this application's specification and drawings, directly or indirectly applied to other related technical fields, are similarly within the scope of patent protection of this application.

Claims

1. A data extraction method, characterized in that, Includes the following steps: Determine whether a data extraction request has been received from the user via the client; wherein the data extraction request carries the target space encoding and data retrieval parameters; If so, parse the target space code and the data retrieval parameters from the data extraction request; Obtain the target interface corresponding to the target space code, and obtain the data retrieval SQL statement corresponding to the target interface; Based on the data retrieval parameters, the data retrieval SQL statement is reorganized to obtain the corresponding target data retrieval SQL statement; Run the target data retrieval SQL statement to obtain the corresponding target data; The target data is returned to the client through the target interface; The step of reorganizing the data retrieval SQL statement based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement specifically includes: The data retrieval SQL statement is parsed to obtain all the first data retrieval conditions contained in the data retrieval SQL statement; wherein, the number of the first data retrieval conditions includes multiple conditions. Filter out the second data retrieval conditions that match the data retrieval parameters from all the first data retrieval conditions, and mark the data retrieval conditions other than the second data retrieval conditions from all the first data retrieval conditions as the third data retrieval conditions; Based on the third data retrieval condition, the first data retrieval condition in the data retrieval SQL statement is removed to obtain the processed first data retrieval SQL statement. Based on the data retrieval parameters, the second data retrieval condition in the first data retrieval SQL statement is conditionally assigned to obtain the processed second data retrieval SQL statement; Use the second data retrieval SQL statement as the target data retrieval SQL statement.

2. The data extraction method according to claim 1, characterized in that, The step of running the target data retrieval SQL statement to obtain the corresponding target data specifically includes: Run the target data retrieval SQL statement and parse out the fourth data retrieval condition and data source contained within the target data retrieval SQL statement; Based on the fourth data retrieval condition, the data retrieval data source is queried, and the query data corresponding to the fourth data retrieval condition is retrieved from the data retrieval data source; The query data is used as the target data.

3. The data extraction method according to claim 1, characterized in that, Before the steps of obtaining the target interface corresponding to the target space code and obtaining the data retrieval SQL statement corresponding to the target interface, the method further includes: Receive an interface construction request corresponding to the target interface input by the target user; Displays the preset interface configuration page; Receive the interface parameters, the target space code, and the data retrieval logic rules corresponding to the data retrieval SQL statement input by the target user on the interface configuration page; The target interface is constructed based on the interface parameters, the target space encoding, and the data retrieval logic rules.

4. The data extraction method according to claim 1, characterized in that, After the step of running the target data retrieval SQL statement to obtain the corresponding target data, the method further includes: Determine whether a data query request corresponding to the target data has been received from the user input; If so, obtain the indicator identifiers of each indicator data contained in the target data, and display the check page containing the indicator identifiers; Receive the specified check mark selected by the user on the check mark page; Filter the target data to select the specified data corresponding to the check mark; Display the specified data.

5. The data extraction method according to claim 1, characterized in that, After the step of returning the target data to the client through the target interface, the method further includes: Retrieve the preset interface level table; Based on the target space encoding, the target level corresponding to the target interface is obtained from the interface level table; Determine the target storage method corresponding to the target level; The target data is stored based on the target storage method.

6. The data extraction method according to claim 1, characterized in that, The data extraction method further includes: Determine whether a data adjustment request for the target interface triggered by the user has been received; If so, display the preset adjustment page; Receive adjustment information input by the user on the adjustment page; Based on the adjustment information, the target interface is adjusted accordingly.

7. A data extraction device, characterized in that, include: The first judgment module is used to determine whether a data extraction request input by the user through the client has been received; wherein the data extraction request carries the target space encoding and data retrieval parameters; The parsing module is used to parse the target space code and the data retrieval parameters from the data extraction request if the condition is met. The first acquisition module is used to acquire the target interface corresponding to the target space code and to acquire the data retrieval SQL statement corresponding to the target interface; The first processing module is used to reorganize the data retrieval SQL statement based on the data retrieval parameters to obtain the corresponding target data retrieval SQL statement. The execution module is used to run the target data retrieval SQL statement to obtain the corresponding target data; The second processing module is used to return the target data to the client through the target interface; The first processing module includes: The first parsing submodule is used to parse the data retrieval SQL statement and obtain all the first data retrieval conditions contained in the data retrieval SQL statement; wherein, the number of the first data retrieval conditions includes multiple conditions. The filtering submodule is used to filter out the second data retrieval conditions that match the data retrieval parameters from all the first data retrieval conditions, and mark the data retrieval conditions other than the second data retrieval conditions from all the first data retrieval conditions as the third data retrieval conditions; The first processing submodule is used to perform condition removal processing on the first data retrieval condition in the data retrieval SQL statement based on the third data retrieval condition, so as to obtain the processed first data retrieval SQL statement. The second processing submodule is used to perform conditional assignment processing on the second data retrieval condition in the first data retrieval SQL statement based on the data retrieval parameters, so as to obtain the processed second data retrieval SQL statement. The first determining submodule is used to use the second data retrieval SQL statement as the target data retrieval SQL statement.

8. A computer device comprising a memory and a processor, the memory storing computer-readable instructions, wherein the processor, when executing the computer-readable instructions, implements the steps of the data extraction method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-readable instructions, which, when executed by a processor, implement the steps of the data extraction method as described in any one of claims 1 to 6.

Images