Data processing method and device, equipment, readable storage medium and program product

Abstract

The invention relates to a data processing method and device, equipment, a readable storage medium and a program product. The method comprises the steps that according to first display data of a current display page, first source data corresponding to the first display data can be obtained, and by obtaining export configuration data, paging export processing can be conducted on the first source data according to data content indicated by a plurality of export items included in the export configuration data. By adopting the method, the data exporting efficiency can be improved.

Description

Technical Field

[0001] The present application relates to the field of database technology, and in particular to a data processing method, apparatus, device, readable storage medium and program product. Background Art

[0002] Vue is a popular front-end JavaScript framework. Its componentized architecture and data binding features enable developers to quickly build front-end interfaces based on Vue and implement data processing, such as data export, on the front-end interfaces.

[0003] The traditional data export method based on the Vue front-end interface usually obtains query data according to the query conditions, displays the query data on the display page, and then exports the query data.

[0004] However, traditional data processing methods suffer from low export efficiency. Summary of the invention

[0005] Based on this, it is necessary to provide a data processing method, device, equipment, readable storage medium and program product that can improve export efficiency in response to the above technical problems.

[0006] In a first aspect, the present application provides a data processing method, comprising:

[0007] According to the first display data of the current display page, obtaining the first source data corresponding to the first display data;

[0008] Obtain export configuration data, the export configuration data includes multiple export items;

[0009] The first source data is exported in pages according to the data content indicated by each export item.

[0010] In one embodiment, performing data export processing on the first source data according to the data content indicated by each export item includes:

[0011] Determining candidate derived data from the first source data according to the data content indicated by each derived item;

[0012] When the data volume of the candidate export data is greater than the first data volume threshold, the candidate export data is subjected to page-by-page export processing according to the first data volume threshold.

[0013] In one embodiment, performing paging export processing on candidate export data according to a first data volume threshold includes:

[0014] Performing data segmentation on the candidate derived data according to a first data volume threshold to obtain at least one segmented derived data, wherein the data volume of the segmented derived data is less than or equal to the first data volume threshold;

[0015] Export each cutting export data to obtain a data export file corresponding to each cutting export data.

[0016] In one embodiment, the plurality of export items include export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data, and determining candidate export data from the first source data according to data content indicated by each export item includes:

[0017] The first source data is screened according to each exported header data and a mapping relationship corresponding to each header data, and the to-be-exported data corresponding to each exported header data is screened out;

[0018] Formatting each to-be-exported data according to the data processing mode indicated by the data processing mode field to obtain formatted to-be-exported data;

[0019] The formatted data to be exported is determined as candidate export data.

[0020] In one embodiment, the method further comprises:

[0021] Determine whether the data amount of the candidate export data is greater than zero;

[0022] If the data volume of the candidate export data is greater than zero and an export instruction is received, it is determined whether the data volume of the candidate export data is greater than a first data volume threshold.

[0023] In one embodiment, the method further comprises:

[0024] Determine whether all source data corresponding to each display page are exported;

[0025] If not all are exported, the second source data corresponding to the second display data is determined according to the second display data of the next display page, and data export processing is performed on the second source data according to the data content indicated by each export item.

[0026] In one embodiment, the method further comprises:

[0027] Acquire a data query condition, where the data query condition includes query data and a second data volume threshold;

[0028] Filter the source data according to the query data to determine the initial display data;

[0029] If the data volume of the initial display data is greater than the second data volume threshold, paging the initial display data according to the second data volume threshold to obtain initial display data corresponding to the current display page;

[0030] The initial display data corresponding to the current display page is processed according to the display configuration data to obtain first display data.

[0031] In a second aspect, the present application further provides a data processing device, comprising:

[0032] A data acquisition module, used to acquire first source data corresponding to the first display data according to the first display data of the current display page;

[0033] A configuration acquisition module is used to acquire export configuration data, where the export configuration data includes multiple export items;

[0034] The export module is used to perform page-by-page export processing on the first source data according to the data content indicated by each export item.

[0035] In a third aspect, an embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method of the first aspect when executing the computer program.

[0036] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the method of the first aspect described above.

[0037] In a fifth aspect, the present application further provides a computer program product, wherein the computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the method in the first aspect are implemented.

[0038] The above-mentioned data processing method, device, equipment, readable storage medium and program product can obtain the first source data corresponding to the first display data according to the first display data of the current display page, and by obtaining the export configuration data, the first source data can be subjected to paged export processing according to the data content indicated by the multiple export items included in the export configuration data. In this way, the first source data corresponding to the first display data displayed on the current display page is obtained, and the first source data is part of the data to be exported. The first source data is first exported, which reduces the amount of data exported at one time, and the first source data is subjected to paged export processing according to the export configuration data, which further reduces the amount of data exported at one time, avoids the export jamming problem caused by directly exporting all the queried query data in the traditional technology, and improves the efficiency of data export. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0040] FIG1 is an application environment diagram of a data processing method in one embodiment;

[0041] Figure 2 is a flow chart of a data processing method in one embodiment;

[0042] Figure 3 is a schematic flow chart of step 203 in another embodiment;

[0043] Figure 4 is a flowchart of an exemplary data processing method in one embodiment;

[0044] Figure 5 is a structural block diagram of a data processing device in one embodiment;

[0045] Figure 6 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0047] Vue is a popular front-end JavaScript framework. Its componentized architecture and data binding features enable developers to quickly build front-end interfaces based on Vue and implement data processing, such as data export, on the front-end interfaces.

[0048] The traditional data export method based on the Vue front-end interface usually obtains query data according to the query conditions, displays the query data on the display page, and then exports the query data.

[0049] However, directly displaying all the queried query data on the display page may cause the display page to freeze due to the large amount of query data, and directly exporting all the query data may also cause the export to freeze, resulting in low export efficiency.

[0050] In view of this, the present application provides a data processing method, apparatus, device, readable storage medium and program product. According to the first display data of the current display page, the first source data corresponding to the first display data can be obtained. By obtaining the export configuration data, the first source data can be exported in pages according to the data content indicated by the multiple export items included in the export configuration data. In this way, the first source data corresponding to the first display data displayed on the current display page is obtained. The first source data is part of the data to be exported. The first source data is first exported, which reduces the amount of data exported at one time. The first source data is exported in pages according to the export configuration data, which further reduces the amount of data exported at one time, avoids the export jamming problem caused by directly exporting all the queried query data in the traditional technology, and improves the efficiency of data export.

[0051] The data processing method provided in the embodiment of the present application can be applied to the application environment shown in FIG1. ​​Among them, the data storage system can store the data that the server 101 needs to process. The data storage system can be integrated on the server 101, or it can be placed on the cloud or other network servers. The server 101 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services.

[0052] In an exemplary embodiment, Figure 2 As shown, a data processing method is provided, and the method is applied to the server 101 in FIG. 1 as an example for explanation. It can be understood that the method can also be applied to a terminal, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. The method includes the following steps 201 to 203. Among them:

[0053] Step 201: Acquire first source data corresponding to the first display data according to the first display data of the current display page.

[0054] The display page can be a vue front-end page for displaying data. In the embodiment of the present application, the server can display data through multiple display pages, and the first display data is the data displayed on the current display page.

[0055] For the first display data of the current display page, the server may obtain the first source data according to the first display data. Optionally, the first display data may be the first source data queried by the server from a database; alternatively, the first display data may be data obtained by formatting the first source data queried by the server from the database.

[0056] Regarding the method for the server to obtain the first source data, optionally, if the first display data is the first source data queried by the server from a database, the server can directly use the first display data as the first source data; optionally, the first display data also includes a data identifier, and the server can filter the data in the database according to the data identifier, thereby obtaining the first source data corresponding to the first display data.

[0057] Regarding the method for the server to obtain the first display data on the current page, in a possible implementation, the server may obtain a data query condition.

[0058] In an embodiment of the present application, the data query conditions include query data and a second data volume threshold, which can be used to filter and display data. Optionally, the server can obtain a query instruction input by a user through an external device, and the query instruction includes the data query conditions; optionally, the server can detect whether there is a query instruction in the system, and if so, obtain the data query conditions according to the query instruction.

[0059] After obtaining the data query conditions, the server can filter the source data according to the query data to determine the initial display data.

[0060] The source data may be data archived in a database, and the server may filter the source data according to the query data to obtain initial display data matching the query data.

[0061] Optionally, the query data may be an identification range, for example, the query data is 100-600, meaning the 100th to 600th data items, and the server may obtain the initial display data corresponding to the query data from the database according to the representation range; optionally, the query data may be a value corresponding to a certain data item, for example, the data items included in the data include name and address, then the query data may be Zhang San, Province A, or Zhang San and Province A.

[0062] After obtaining the initial display data, in order to avoid display jams caused by excessive data volume, the server can display the display data in pages. In an embodiment of the present application, if the data volume of the initial display data is greater than the second data volume threshold, the server can page the initial display data according to the second data volume threshold to obtain the initial display data corresponding to the current display page.

[0063] For example, the second data volume threshold is 10, that is, only 10 data can be displayed on each display page. The server can detect whether the data volume of the initial display data is greater than 10. Optionally, if the data volume is less than or equal to 10, the server can directly use the initial display data as the initial display data corresponding to the current display page; optionally, if the data volume is greater than 10, the server first extracts the first 10 initial display data in the order of the initial display data as the initial display data corresponding to the current page, or the server can randomly select 10 from the initial display data as the initial display data corresponding to the current page.

[0064] After determining the initial display data corresponding to the current display page, the server may process the initial display data corresponding to the current display page according to the display configuration data to obtain the first display data.

[0065] The display configuration data may be data used to format the initial display data. In an embodiment of the present application, the display configuration data may include a column name, a mapping attribute, and a formatting method, wherein the column name is the name of the data item to be displayed in the current display page. For example, the data to be displayed is a personnel list, and the name of the data item to be displayed may be name, age, ID number, etc. The mapping attribute corresponds to the column name, and the source data is stored in the database according to each mapping attribute. Accordingly, the initial display data is stored in the database according to each mapping attribute. For example, the mapping attribute corresponding to the column name "name" is username. In the initial display data, the data corresponding to the mapping attribute username includes "Zhang San, Li Si, Wang Wu, etc." The server can obtain the data corresponding to the column name from the initial display data through the mapping attribute. For example, the server can obtain the data corresponding to the column name "name" "Zhang San, Li Si, Wang Wu, etc." from the first source data according to the mapping attribute "username."

[0066] Different column names correspond to different formatting methods, and the server can format the data corresponding to each column name according to each formatting method. For example, the formatting method of the date is "year-month-day".

[0067] Optionally, the formatting method can be configured using the eval keyword function. Optionally, the formatting method can be configured using a custom function.

[0068] For detailed description of display configuration data, please refer to Table 1:

[0069]

[0070] Table 1

[0071] Regarding the method for obtaining display configuration data, optionally, the server can obtain the display configuration data input by the user through an external input device. Optionally, the server can obtain a display configuration file from a storage space corresponding to a preset configuration address according to the preset configuration address, and the display configuration file includes the display configuration data.

[0072] In an embodiment of the present application, the server processes the initial display data corresponding to the current display page according to the display configuration data. After obtaining the first display data, the first display data can be displayed on the current display page. For other display pages, the server can obtain the display data corresponding to the other display pages according to the method for obtaining the first display data, and display the display data corresponding to each display page on the other display pages, thereby realizing the paginated display of the source data.

[0073] In a possible implementation, an export control is also deployed on the current display page, and the server can obtain the export instruction input by the user through the export control. When the server detects the export instruction, it can obtain the first source data according to the first display data and execute subsequent export steps.

[0074] Step 202: Obtain export configuration data.

[0075] In an embodiment of the present application, the export configuration data can be used to format the first source data. The export configuration data includes multiple export items, each of which can include header data and a mapping relationship corresponding to each header data.

[0076] Among them, the header data can be the name corresponding to the data item to be exported. For example, if the exported data is a personnel list, the header data corresponding to the data item to be exported can be name, age, ID number, etc.; the mapping relationship corresponds to the header data, and the first source data is stored in the database according to each mapping relationship. For example, the mapping relationship corresponding to the header data "name" is username, and the data corresponding to username in the first source data includes "Zhang San, Li Si, Wang Wu, etc.". The server can obtain the data corresponding to the header data from the first source data through the mapping relationship. For example, the server can obtain the data corresponding to the header data "name" "Zhang San, Li Si, Wang Wu, etc." from the first source data according to the mapping relationship "username".

[0077] Through the header data and the mapping relationship, the server can filter out the data to be exported from the first source data. In a possible implementation, when exporting the data to be exported, the server exports the data corresponding to each header data according to a preset format. For example, the date is stored as "year-month-day". Therefore, each export item can also include a data processing method corresponding to each header data.

[0078] Optionally, the server can obtain the export configuration data input by the user through an external device; optionally, the server can obtain the export configuration data from a storage location corresponding to a preset address; optionally, the server can generate the export configuration data based on the content indicated by the display configuration data, for example, using the column names included in the display configuration data as header data, using the attributes corresponding to each column name as the mapping relationship corresponding to each header data, and using the formatting method corresponding to each column name as the data processing method corresponding to each header data.

[0079] Step 203: perform page-by-page export processing on the first source data according to the data content indicated by each export item.

[0080] In an embodiment of the present application, in order to avoid export jams caused by an excessive amount of exported data, the server may perform paged export processing on the first source data according to the data content indicated by each export item. Exemplarily, the server may perform data processing on the first source data according to the data content indicated by each export item to obtain processed data, and then, according to a preset export data amount threshold, perform page cutting on the processed data to obtain at least one page of export data. The server may export each page of export data in batches.

[0081] In a possible implementation, after the server performs paginated export processing on the first source data corresponding to the first display data of the current display page, since the number of display pages can be multiple, the server can determine whether the source data corresponding to each display page is all exported. Optionally, the server can determine the total number of display pages based on the data volume of the queried source data and the second data volume threshold. The server can also calculate the number of display pages that have been exported based on a preset counter. Through the total number of display pages and the number of display pages that have been exported, the server can determine whether all the source data are exported.

[0082] Optionally, if not all are exported, the server may determine the second source data corresponding to the second display data according to the second display data of the next display page, and perform data export processing on the second source data according to the data content indicated by each export item.

[0083] Optionally, if all data have been exported, the server may generate export completion information, and the export completion information is used to prompt the user that the data export is completed.

[0084] In the above embodiment, the first source data corresponding to the first display data displayed on the current display page is obtained. The first source data is part of the data to be exported. The first source data is first exported, which reduces the amount of data exported at one time. The first source data is exported in pages according to the export configuration data, which further reduces the amount of data exported at one time. This avoids the export jamming problem caused by directly exporting all the queried data in the traditional technology, thereby improving the efficiency of data export.

[0085] In one embodiment, based on the above Figure 2 The embodiment shown, see Figure 3 This embodiment relates to a process of performing page-by-page export processing on the first source data according to the data content indicated by each export item. Figure 3 As shown, step 203 may include step 301 and step 302 .

[0086] Step 301: Determine candidate export data from the first source data according to the data content indicated by each export item.

[0087] In an embodiment of the present application, the server may perform data processing on the first source data according to the data content indicated by each export item in the export configuration data, thereby determining candidate export data.

[0088] Optionally, multiple export items may include export header data and a mapping relationship corresponding to the header data. The server may determine the data to be exported based on the export header data and the mapping relationship corresponding to the header data, and directly use the data to be exported as candidate export data; Optionally, multiple export directions may include export header data, a mapping relationship corresponding to the header data, and a data processing method field corresponding to the header data. The server may determine the data to be exported based on the export header data and the mapping relationship corresponding to the header data, and then use the data processing method fields corresponding to each header data to format the data to be exported, and use the formatted data to be exported as candidate export data.

[0089] Exemplarily, multiple export items include export header data, a mapping relationship corresponding to the header data, and a data processing method field corresponding to the header data. Then, according to the data content indicated by each export item, determining the candidate export data from the first source data can include: the server filters the first source data according to each export header data and the mapping relationship corresponding to each header data, and filters out the data to be exported corresponding to each export header data. Then, the server can format each data to be exported according to the data processing method indicated by the data processing method field to obtain the formatted data to be exported, and determine the formatted data to be exported as the candidate export data.

[0090] After the server determines the candidate export data, it may determine whether the data volume of the candidate export data is greater than zero.

[0091] In a possible implementation, if the data volume of the candidate export data is not greater than zero, the server may determine that there is no data to be exported, and the server may generate export failure information.

[0092] In another possible implementation, if the data volume of the candidate export data is greater than zero and the server receives the export instruction, it is determined whether the data volume of the candidate export data is greater than a first data volume threshold.

[0093] The export instruction is an instruction for instructing to export data. Optionally, the server can obtain the export instruction input by the user through the input control deployed on the current display page. Optionally, the system can periodically generate the export instruction, and the server can obtain the export instruction generated by the system through periodic detection.

[0094] In an embodiment of the present application, if the server determines that the data volume of the exported data is greater than zero and obtains the export instruction at the same time, the server can perform data export on the source data. When exporting data, in order to avoid export jams caused by excessive exported data volume, the server can first determine whether the data volume of the candidate exported data is greater than the first data volume threshold. If the data volume of the candidate exported data is less than or equal to the first data volume threshold, it means that the data volume of the candidate exported data is small, and the server can directly export the candidate export data; if the data volume of the candidate export data is greater than the first data volume threshold, it means that the data volume of the candidate export data is too large. At this time, the server needs to perform paging export processing on the candidate export data.

[0095] Step 302: When the data volume of the candidate export data is greater than the first data volume threshold, the candidate export data is subjected to paging export processing according to the first data volume threshold.

[0096] When the data volume of the candidate export data is greater than the first data volume threshold, the server can determine that the data volume of the candidate export data is too large. If the candidate export data is directly exported, export jams may occur, thereby reducing the export efficiency. In a possible implementation, the server can perform paging export processing on the candidate export data according to the first data volume threshold.

[0097] In an embodiment of the present application, the server may perform data segmentation on candidate export data according to a first data volume threshold to obtain at least one segmented export data, and the server may perform data export on each segmented export data to obtain a data export file corresponding to each segmented export data, wherein the data volume of the segmented export data is less than or equal to the first data volume threshold.

[0098] In the above embodiment, candidate export data is determined based on the export items. When the data volume of the candidate export data is greater than the first data volume threshold, it is determined that the data volume of the candidate export data is too large, and the candidate export data is processed in pages, thereby avoiding the export jamming problem that may be caused by the excessive amount of export data and improving the export efficiency.

[0099] In one embodiment, referring to Figure 4 , provides an exemplary data processing method, which can be applied in the implementation environment shown in Figure 1.

[0100] Step 401, obtaining data query conditions.

[0101] The data query condition includes query data and a second data volume threshold.

[0102] Step 402, filter the source data according to the query data to determine the initial display data.

[0103] Step 403: If the data volume of the initial display data is greater than the second data volume threshold, paging the initial display data is performed according to the second data volume threshold to obtain initial display data corresponding to the current display page.

[0104] Step 404: Process the initial display data corresponding to the current display page according to the display configuration data to obtain first display data.

[0105] Step 405: Acquire first source data corresponding to the first display data according to the first display data of the current display page.

[0106] Step 406, obtaining export configuration data.

[0107] The export configuration data includes multiple export items.

[0108] The multiple export items include export header data, a mapping relationship corresponding to the header data, and a data processing method field corresponding to the header data.

[0109] Step 407 , filtering the first source data according to each exported header data and the mapping relationship corresponding to each header data, and filtering out the to-be-exported data corresponding to each exported header data.

[0110] Step 408: format each to-be-exported data according to the data processing mode indicated by the data processing mode field to obtain formatted to-be-exported data.

[0111] Step 409: determine the formatted data to be exported as candidate export data.

[0112] Step 410, determining whether the data volume of the candidate derived data is greater than zero.

[0113] Step 411: If the data volume of the candidate export data is greater than zero and an export instruction is received, determine whether the data volume of the candidate export data is greater than a first data volume threshold.

[0114] Step 412: When the data volume of the candidate derived data is greater than the first data volume threshold, data segmentation is performed on the candidate derived data according to the first data volume threshold to obtain at least one segmented derived data.

[0115] The amount of the cut and exported data is less than or equal to a first data amount threshold.

[0116] Step 413, exporting each cutting export data to obtain a data export file corresponding to each cutting export data.

[0117] Step 414, determining whether all source data corresponding to each display page has been exported.

[0118] Step 415: if not all data are exported, the second source data corresponding to the second display data is determined according to the second display data of the next display page, and data export processing is performed on the second source data according to the data content indicated by each export item.

[0119] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0120] Based on the same inventive concept, the embodiment of the present application also provides a data processing device for implementing the data processing method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the one or more data processing device embodiments provided below can refer to the limitations on the data processing method above, and will not be repeated here.

[0121] In an exemplary embodiment, Figure 5 As shown, a data processing device is provided, including: a data acquisition module 501, a configuration acquisition module 502 and an export module 503, wherein:

[0122] The data acquisition module 501 is used to acquire first source data corresponding to the first display data according to the first display data of the current display page;

[0123] The configuration acquisition module 502 is used to acquire export configuration data, where the export configuration data includes multiple export items;

[0124] The export module 503 is used to perform page-by-page export processing on the first source data according to the data content indicated by each export item.

[0125] In one embodiment, the export module 503 includes:

[0126] a determining unit, configured to determine candidate derived data from the first source data according to data content indicated by each derived item;

[0127] The paging export unit is used to perform paging export processing on the candidate export data according to the first data volume threshold when the data volume of the candidate export data is greater than the first data volume threshold.

[0128] In one embodiment, the paging export unit is specifically configured to perform the following steps:

[0129] Performing data segmentation on the candidate derived data according to a first data volume threshold to obtain at least one segmented derived data, wherein the data volume of the segmented derived data is less than or equal to the first data volume threshold;

[0130] Export each cutting export data to obtain a data export file corresponding to each cutting export data.

[0131] In one embodiment, the multiple export items include export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data, and the determination unit is specifically used to perform the following steps:

[0132] The first source data is screened according to each exported header data and a mapping relationship corresponding to each header data, and the to-be-exported data corresponding to each exported header data is screened out;

[0133] Formatting each to-be-exported data according to the data processing mode indicated by the data processing mode field to obtain formatted to-be-exported data;

[0134] The formatted data to be exported is determined as candidate export data.

[0135] In one embodiment, the export module 503 further includes:

[0136] A first judgment unit, used to determine whether the data volume of the candidate derived data is greater than zero;

[0137] The second judgment unit is used to determine whether the data volume of the candidate export data is greater than a first data volume threshold if the data volume of the candidate export data is greater than zero and an export instruction is received.

[0138] In one embodiment, the data processing device further comprises:

[0139] A judgment module is used to judge whether all source data corresponding to each display page are exported;

[0140] The subsequent export module is used to determine the second source data corresponding to the second display data according to the second display data of the next display page if not all of the data have been exported, and to perform data export processing on the second source data according to the data content indicated by each export item.

[0141] In one embodiment, the data processing device further comprises:

[0142] A query module, used to obtain a data query condition, where the data query condition includes query data and a second data volume threshold;

[0143] A screening module is used to screen the source data according to the query data and determine the initial display data;

[0144] A paging processing module, configured to, if the data volume of the initial display data is greater than a second data volume threshold, perform paging processing on the initial display data according to the second data volume threshold to obtain initial display data corresponding to the current display page;

[0145] The display configuration module is used to process the initial display data corresponding to the current display page according to the display configuration data to obtain the first display data.

[0146] Each module in the above data processing device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0147] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 6As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data processing data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a data processing method is implemented.

[0148] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0149] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0150] According to first display data of the current display page, obtaining first source data corresponding to the first display data;

[0151] Acquire export configuration data, wherein the export configuration data includes a plurality of export items;

[0152] The first source data is exported in pages according to the data content indicated by each of the export items.

[0153] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0154] Determining candidate derived data from the first source data according to the data content indicated by each of the derived items;

[0155] When the data volume of the candidate export data is greater than a first data volume threshold, the candidate export data is subjected to page-by-page export processing according to the first data volume threshold.

[0156] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0157] Performing data segmentation on the candidate derived data according to the first data volume threshold to obtain at least one segmented derived data, wherein the data volume of the segmented derived data is less than or equal to the first data volume threshold;

[0158] Export each of the cutting export data to obtain a data export file corresponding to each of the cutting export data.

[0159] In one embodiment, the multiple export items include export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data, and the processor further implements the following steps when executing the computer program:

[0160] The first source data is screened according to each of the export header data and the mapping relationship corresponding to each of the header data, so as to screen out the data to be exported corresponding to each of the export header data;

[0161] Formatting the data to be exported according to the data processing mode indicated by the data processing mode field to obtain formatted data to be exported;

[0162] The formatted data to be exported is determined as the candidate export data.

[0163] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0164] Determining whether the data amount of the candidate derived data is greater than zero;

[0165] If the data volume of the candidate exported data is greater than zero and an export instruction is received, it is determined whether the data volume of the candidate exported data is greater than the first data volume threshold.

[0166] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0167] Determine whether all source data corresponding to each of the display pages are exported;

[0168] If not all of them are exported, the second source data corresponding to the second display data is determined according to the second display data of the next display page, and the second source data is exported according to the data content indicated by each of the export items.

[0169] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0170] Acquire a data query condition, wherein the data query condition includes query data and a second data volume threshold;

[0171] Filtering source data according to the query data to determine initial display data;

[0172] If the data volume of the initial display data is greater than the second data volume threshold, paging the initial display data according to the second data volume threshold to obtain initial display data corresponding to the current display page;

[0173] The initial display data corresponding to the current display page is processed according to the display configuration data to obtain the first display data.

[0174] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0175] According to first display data of the current display page, obtaining first source data corresponding to the first display data;

[0176] Acquire export configuration data, wherein the export configuration data includes a plurality of export items;

[0177] The first source data is exported in pages according to the data content indicated by each of the export items.

[0178] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0179] Determining candidate derived data from the first source data according to the data content indicated by each of the derived items;

[0180] When the data volume of the candidate export data is greater than a first data volume threshold, the candidate export data is subjected to page-by-page export processing according to the first data volume threshold.

[0181] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0182] Performing data segmentation on the candidate derived data according to the first data volume threshold to obtain at least one segmented derived data, wherein the data volume of the segmented derived data is less than or equal to the first data volume threshold;

[0183] Export each of the cutting export data to obtain a data export file corresponding to each of the cutting export data.

[0184] In one embodiment, the multiple export items include export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data, and when the computer program is executed by the processor, the following steps are further implemented:

[0185] The first source data is screened according to each of the export header data and the mapping relationship corresponding to each of the header data, so as to screen out the data to be exported corresponding to each of the export header data;

[0186] Formatting the data to be exported according to the data processing mode indicated by the data processing mode field to obtain formatted data to be exported;

[0187] The formatted data to be exported is determined as the candidate export data.

[0188] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0189] Determining whether the data amount of the candidate derived data is greater than zero;

[0190] If the data volume of the candidate exported data is greater than zero and an export instruction is received, it is determined whether the data volume of the candidate exported data is greater than the first data volume threshold.

[0191] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0192] Determine whether all source data corresponding to each of the display pages are exported;

[0193] If not all of them are exported, the second source data corresponding to the second display data is determined according to the second display data of the next display page, and the second source data is exported according to the data content indicated by each of the export items.

[0194] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0195] Acquire a data query condition, wherein the data query condition includes query data and a second data volume threshold;

[0196] Filtering source data according to the query data to determine initial display data;

[0197] If the data volume of the initial display data is greater than the second data volume threshold, paging the initial display data according to the second data volume threshold to obtain initial display data corresponding to the current display page;

[0198] The initial display data corresponding to the current display page is processed according to the display configuration data to obtain the first display data.

[0199] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0200] According to first display data of the current display page, obtaining first source data corresponding to the first display data;

[0201] Acquire export configuration data, wherein the export configuration data includes a plurality of export items;

[0202] The first source data is exported in pages according to the data content indicated by each of the export items.

[0203] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0204] Determining candidate derived data from the first source data according to the data content indicated by each of the derived items;

[0205] When the data volume of the candidate export data is greater than a first data volume threshold, the candidate export data is subjected to page-by-page export processing according to the first data volume threshold.

[0206] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0207] Performing data segmentation on the candidate derived data according to the first data volume threshold to obtain at least one segmented derived data, wherein the data volume of the segmented derived data is less than or equal to the first data volume threshold;

[0208] Export each of the cutting export data to obtain a data export file corresponding to each of the cutting export data.

[0209] In one embodiment, the multiple export items include export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data, and when the computer program is executed by the processor, the following steps are further implemented:

[0210] The first source data is screened according to each of the export header data and the mapping relationship corresponding to each of the header data, so as to screen out the data to be exported corresponding to each of the export header data;

[0211] Formatting the data to be exported according to the data processing mode indicated by the data processing mode field to obtain formatted data to be exported;

[0212] The formatted data to be exported is determined as the candidate export data.

[0213] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0214] Determining whether the data amount of the candidate derived data is greater than zero;

[0215] If the data volume of the candidate exported data is greater than zero and an export instruction is received, it is determined whether the data volume of the candidate exported data is greater than the first data volume threshold.

[0216] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0217] Determine whether all source data corresponding to each of the display pages are exported;

[0218] If not all of them are exported, the second source data corresponding to the second display data is determined according to the second display data of the next display page, and the second source data is exported according to the data content indicated by each of the export items.

[0219] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0220] Acquire a data query condition, wherein the data query condition includes query data and a second data volume threshold;

[0221] Filtering source data according to the query data to determine initial display data;

[0222] If the data volume of the initial display data is greater than the second data volume threshold, paging the initial display data according to the second data volume threshold to obtain initial display data corresponding to the current display page;

[0223] The initial display data corresponding to the current display page is processed according to the display configuration data to obtain the first display data.

[0224] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0225] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0226] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0227] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A data processing method, characterized in that: The method comprises: According to first display data of the current display page, obtaining first source data corresponding to the first display data; Acquire export configuration data, wherein the export configuration data includes a plurality of export items; The first source data is exported in pages according to the data content indicated by each of the export items.

2. The method according to claim 1, characterized in that The step of performing page-by-page export processing on the first source data according to the data content indicated by each of the export items includes: Determining candidate derived data from the first source data according to the data content indicated by each of the derived items; When the data volume of the candidate export data is greater than a first data volume threshold, the candidate export data is subjected to page-by-page export processing according to the first data volume threshold.

3. The method according to claim 2, characterized in that The step of performing paging export processing on the candidate export data according to the first data volume threshold comprises: Performing data segmentation on the candidate derived data according to the first data volume threshold to obtain at least one segmented derived data, wherein the data volume of the segmented derived data is less than or equal to the first data volume threshold; Export each of the cutting export data to obtain a data export file corresponding to each of the cutting export data.

4. The method according to claim 2, characterized in that: The multiple export items include export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data, and determining candidate export data from the first source data according to data content indicated by each of the export items includes: The first source data is screened according to each of the export header data and the mapping relationship corresponding to each of the header data, so as to screen out the data to be exported corresponding to each of the export header data; Formatting the data to be exported according to the data processing mode indicated by the data processing mode field to obtain formatted data to be exported; The formatted data to be exported is determined as the candidate export data.

5. The method according to claim 2, characterized in that: The method further comprises: Determining whether the data amount of the candidate derived data is greater than zero; If the data volume of the candidate exported data is greater than zero and an export instruction is received, it is determined whether the data volume of the candidate exported data is greater than the first data volume threshold.

6. The method according to claim 1, characterized in that The method further comprises: Determine whether all source data corresponding to each of the display pages are exported; If not all of them are exported, the second source data corresponding to the second display data is determined according to the second display data of the next display page, and the second source data is exported according to the data content indicated by each of the export items.

7. The method according to claim 1, characterized in that The method further comprises: Acquire a data query condition, wherein the data query condition includes query data and a second data volume threshold; Filtering source data according to the query data to determine initial display data; If the data volume of the initial display data is greater than the second data volume threshold, paging the initial display data according to the second data volume threshold to obtain initial display data corresponding to the current display page; The initial display data corresponding to the current display page is processed according to the display configuration data to obtain the first display data.

8. A data processing device, characterized in that: The device comprises: A data acquisition module, configured to acquire first source data corresponding to first display data according to first display data of a current display page; A configuration acquisition module, used to acquire export configuration data, wherein the export configuration data includes a plurality of export items; The export module is used to perform page-by-page export processing on the first source data according to the data content indicated by each of the export items.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

11. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images