Data processing method, apparatus, device, readable storage medium and program product

Abstract

The application relates to a data processing method, device, equipment, readable storage medium and program product. The method comprises the following steps: according to first display data of a current display page, first source data corresponding to the first display data can be acquired; by acquiring export configuration data, the first source data can be subjected to paging export processing according to data content indicated by a plurality of export items included in the export configuration data. The method can improve the efficiency of data export.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of database, and in particular, relates to a data processing method and device, equipment, readable storage medium and program product. BACKGROUND

[0002] Vue is a popular front-end JavaScript framework, and its component-based architecture and data binding features enable developers to quickly build front-end interfaces based on Vue and implement data processing, such as data export, in the front-end interface.

[0003] The traditional data export method based on the Vue front-end interface usually obtains query data according to the query conditions, and displays the query data on the display page, and then exports the query data.

[0004] However, the traditional data processing method has the problem of low export efficiency. SUMMARY

[0005] Therefore, it is necessary to provide a data processing method, device, equipment, readable storage medium and program product capable of improving the export efficiency to solve the above technical problems.

[0006] In a first aspect, the present application provides a data processing method, comprising:

[0007] According to the first display data of the current display page, the first source data corresponding to the first display data is obtained;

[0008] Obtain export configuration data, and the export configuration data includes a plurality of export items;

[0009] According to the data content indicated by each export item, the first source data is subjected to page export processing.

[0010] In one of the embodiments, according to the data content indicated by each export item, the first source data is subjected to data export processing, comprising:

[0011] According to the data content indicated by each export item, the candidate export data is determined from the first source data;

[0012] In the case where the data amount of the candidate export data is greater than the first data amount threshold, the candidate export data is subjected to page export processing according to the first data amount threshold.

[0013] In one of the embodiments, the candidate export data is subjected to page export processing according to the first data amount threshold, comprising:

[0014] According to the first data amount threshold, the candidate export data is subjected to data cutting to obtain at least one cutting export data, and the data amount of the cutting export data is less than or equal to the first data amount threshold.

[0015] Data export is performed on each cut export data to obtain a data export file corresponding to each cut export data.

[0016] In one of the embodiments, the plurality of export items include export table header data, mapping relationships corresponding to the table header data, and data processing mode fields corresponding to the table header data, candidate export data is determined from the first source data according to the data content indicated by each export item, including:

[0017] The first source data is filtered according to each export table header data and the mapping relationship corresponding to each table header data, and the to-be-exported data corresponding to each export table header data is filtered out;

[0018] The to-be-exported data is formatted according to the data processing mode indicated by the data processing mode field, and the formatted to-be-exported data is obtained;

[0019] The formatted to-be-exported data is determined as the candidate export data.

[0020] In one of the embodiments, the method further includes:

[0021] It is determined whether the data amount of the candidate export data is greater than zero;

[0022] If the data amount of the candidate export data is greater than zero and the export instruction is received, it is determined whether the data amount of the candidate export data is greater than a first data amount threshold.

[0023] In one of the embodiments, the method further includes:

[0024] It is determined whether the source data corresponding to each display page is all exported;

[0025] If not all are exported, the second source data corresponding to the second display data is determined according to the second display data of the next display page, and the second source data is subjected to data export processing according to the data content indicated by each export item.

[0026] In one of the embodiments, the method further includes:

[0027] A data query condition is obtained, the data query condition including query data and a second data amount threshold;

[0028] The source data is filtered according to the query data to determine initial display data;

[0029] If the data amount of the initial display data is greater than the second data amount threshold, the initial display data is subjected to paging processing according to the second data amount threshold to obtain initial display data corresponding to the current display page;

[0030] According to the display configuration data, the initial display data corresponding to the current display page is processed to obtain first display data.

[0031] In a second aspect, the present application further provides a data processing apparatus, comprising:

[0032] The data acquisition module is configured to acquire first source data corresponding to the first display data according to the first display data of the current display page.

[0033] The configuration acquisition module is configured to acquire export configuration data, wherein the export configuration data comprises a plurality of export items.

[0034] The export module is configured to perform page export processing on the first source data according to data content indicated by each export item.

[0035] In a third aspect, the present application provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to realize the steps of the method of the first aspect.

[0036] In a fourth aspect, the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to realize the steps of the method of the first aspect.

[0037] In a fifth aspect, the present application further provides a computer program product. The computer program product comprises a computer program, and the computer program is executed by a processor to realize the steps of the method of the first aspect.

[0038] The above data processing method, apparatus, device, readable storage medium and program product can acquire first source data corresponding to the first display data according to the first display data of the current display page, and can perform page export processing on the first source data according to data content indicated by a plurality of export items included in the export configuration data by acquiring the export configuration data. In this way, the first source data corresponding to the first display data displayed by the current display page is acquired, the first source data is part of the data to be exported, and the data export is performed on the first source data first, thereby reducing the data amount of one-time data export. According to the page export processing on the first source data according to the export configuration data, the data amount of one-time data export is further reduced, the export lag problem caused by directly exporting all the query data in the traditional technology is avoided, and the efficiency of data export is improved. BRIEF DESCRIPTION OF DRAWINGS

[0039] In order to make the technical solutions in the embodiments of the present application or the related art clearer, the accompanying drawings needed in the description of the embodiments of the present application or the related art will be briefly introduced. Obviously, the accompanying drawings in the following description only need to be some embodiments of the present application, and other related drawings can be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0040] Figure 1 An application environment diagram of the data processing method in one embodiment;

[0041] Figure 2 A flowchart of the data processing method in one embodiment;

[0042] Figure 3 A flowchart of the step 203 in another embodiment;

[0043] Figure 4 A flowchart of an exemplary data processing method in one embodiment;

[0044] Figure 5 A structural block diagram of the data processing device in one embodiment;

[0045] Figure 6 An internal structure diagram of the computer device in one embodiment. DETAILED DESCRIPTION

[0046] In order to make the technical solutions in the embodiments of the present application or the related art clearer, the accompanying drawings needed in the description of the embodiments of the present application or the related art will be briefly introduced. Obviously, the accompanying drawings in the following description only need to be some embodiments of the present application, and other related drawings can be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0047] Vue is a popular front-end JavaScript framework, and its component architecture and data binding features enable developers to quickly build front-end interfaces based on Vue and implement data processing in the front-end interface, such as data export.

[0048] The traditional data export method based on the Vue front-end interface usually obtains query data according to the query conditions, and displays the query data on the display page, and then exports the query data.

[0049] However, directly displaying all the query data on the display page may cause the display page to freeze due to the large amount of query data, and directly exporting all the query data may also cause the export to freeze, resulting in low export efficiency.

[0050] In view of this, the present application provides a data processing method, device, equipment, readable storage medium and program product. According to the first display data of the current display page, the first source data corresponding to the first display data can be obtained, and by obtaining the export configuration data, the first source data can be processed by paging export according to the data content indicated by the plurality of export items included in the export configuration data. In this way, the first source data corresponding to the first display data displayed by the current display page is obtained, and the first source data is part of the data to be exported. The first source data is exported first, reducing the amount of data exported at one time. According to the paging export processing of the first source data according to the export configuration data, the amount of data exported at one time is further reduced, avoiding the export lag problem caused by directly exporting all the query data in the traditional technology, and improving the efficiency of data export.

[0051] The data processing method provided by the embodiments of the present application can be applied to an application environment as shown in Figure 1 . The data storage system can store the data to be processed by the server 101. The data storage system can be integrated on the server 101, or placed on the cloud or other network servers. The server 101 can be a standalone physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.

[0052] In an exemplary embodiment, as shown in Figure 2 , a data processing method is provided. Taking the server 101 in Figure 1 as an example, it can be understood that the method can also be applied to a terminal, and can also be applied to a system including a terminal and a server, and can be realized through the interaction of the terminal and the server. The method includes the following steps 201 to 203. Wherein:

[0053] Step 201, according to the first display data of the current display page, obtaining the first source data corresponding to the first display data.

[0054] The display page can be a vue front-end page for displaying data. In the embodiments of the present application, the server can display data through a plurality of display pages, and the first display data is the data displayed on the current display page.

[0055] For the first display data of the current display page, the server can obtain the first source data according to the first display data. Optionally, the first display data can be the first source data queried by the server from the database; optionally, the first display data can be the data obtained by formatting the first source data queried by the server from the database.

[0056] Regarding the method for the server to obtain the first source data, if the first display data is the first source data obtained by the server from the database, the server can directly take the first display data as the first source data. Optionally, the first display data further includes a data identifier, and the server can filter the data in the database according to the data identifier, thereby obtaining the first source data corresponding to the first display data.

[0057] Regarding the method for the server to obtain the first display data on the current page, in a possible implementation, the server can obtain a data query condition.

[0058] In the embodiment of the application, the data query condition includes query data and a second data quantity threshold, and can be used to filter display data. Optionally, the server can obtain a query instruction input by a user through an external device, and the query instruction includes the data query condition. Optionally, the server can detect whether the system includes a query instruction, and if so, obtain the data query condition according to the query instruction.

[0059] After obtaining the data query condition, the server can filter source data according to the query data, and determine initial display data.

[0060] The source data can be data archived in the database, and the server can filter the source data according to the query data, and obtain initial display data matching the query data.

[0061] Optionally, the query data can be an identifier range, for example, the query data is 100-600, meaning the 100th data to the 600th data, and the server can obtain initial display data corresponding to the query data from the database according to the identifier range. Optionally, the query data can be a value corresponding to a data item, for example, the data includes data items such as a name and an address, and the query data can be Zhang San, can be A province, or can be Zhang San and A province.

[0062] After obtaining the initial display data, in order to avoid display lag caused by a large data quantity of display data, the server can perform page display on the display data. In the embodiment of the application, if the data quantity of the initial display data is greater than the second data quantity threshold, the server can perform page processing on the initial display data according to the second data quantity threshold, and obtain initial display data corresponding to the current display page.

[0063] For example, the second data amount threshold is 10, that is, only 10 data can be displayed on each display page, the server can detect whether the data amount of the initial display data is greater than 10, optionally, if the data amount is less than or equal to 10, the server can directly take the initial display data as the initial display data corresponding to the current display page; optionally, if the data amount is greater than 10, the server can first take the first 10 initial display data in the order of the initial display data as the initial display data corresponding to the current page, or the server can randomly select 10 initial display data from the initial display data as the initial display data corresponding to the current page.

[0064] After determining the initial display data corresponding to the current display page, the server can process the initial display data corresponding to the current display page according to the display configuration data to obtain the first display data.

[0065] The display configuration data can be data used for formatting processing of the initial display data, in the embodiment of the application, the display configuration data can include column name, mapping attribute and formatting method, wherein the column name is the name of the data item to be displayed in the current display page, for example, the data to be displayed is a personnel list, the name of the data item to be displayed can be name, age, ID number, etc., the mapping attribute corresponds to the column name, the source data is stored in the database according to each mapping attribute, correspondingly, the initial display data is stored in the database according to each mapping attribute, for example, the mapping attribute corresponding to the column name "name" is username, and the data corresponding to the mapping attribute username in the initial display data includes "Zhang San, Li Si, Wang Wu, etc.", the server can obtain the data corresponding to the column name from the initial display data through the mapping attribute, for example, the server can obtain the data "Zhang San, Li Si, Wang Wu, etc." corresponding to the column name "name" from the first source data according to the mapping attribute "username".

[0066] Different column names correspond to different formatting methods, the server can format process the data corresponding to each column name according to each formatting method, for example, the formatting method of the date is "year-month-day".

[0067] Optionally, the formatting method can be configured by using the eval keyword function, and optionally, the formatting method can be configured by using a custom function.

[0068] The specific description of the display configuration data can refer to Table 1:

[0069]

[0070] Table 1

[0071] In the method for obtaining the display configuration data, the server can obtain the display configuration data input by the user through an external input device, or the server can obtain a display configuration file from a storage space corresponding to a preset configuration address according to the preset configuration address, and the display configuration file includes the display configuration data.

[0072] In the embodiments of the present application, after the server processes the initial display data corresponding to the current display page according to the display configuration data to obtain the first display data, the server displays the first display data on the current display page. For other display pages, the server can obtain the display data corresponding to the other display pages according to the method for obtaining the first display data, and display the display data corresponding to each display page on the other display pages, thereby realizing the paging display of the source data.

[0073] In a possible implementation, the current display page is also deployed with an export control, and the server can obtain an export instruction input by the user through the export control. When the server detects the export instruction, the server can obtain the first source data according to the first display data, and perform subsequent export steps.

[0074] In step 202, export configuration data is obtained.

[0075] In the embodiments of the present application, the export configuration data can be data used for formatting processing of the first source data, and the export configuration data includes a plurality of export items. Each export item can include table header data and a mapping relationship corresponding to each table header data.

[0076] The table header data can be the name corresponding to the data item to be exported. For example, if the data to be exported is a personnel list, the table header data corresponding to the data item to be exported can be name, age, ID number, etc. The mapping relationship corresponds to the table header data, and the first source data is stored in the database according to each mapping relationship. For example, the mapping relationship corresponding to the table header data "name" is username, and the data corresponding to username in the first source data includes "Zhang San, Li Si, Wang Wu, etc." The server can obtain the data corresponding to the table header data from the first source data through the mapping relationship. For example, the server can obtain the data "Zhang San, Li Si, Wang Wu, etc." corresponding to the table header data "name" from the first source data according to the mapping relationship "username".

[0077] Through the table header data and the mapping relationship, the server can filter the data to be exported from the first source data. In a possible implementation, when the data to be exported is exported, the server exports the data corresponding to each table header data according to a preset format. For example, the date is stored as "year-month-day", and therefore each export item can also include a data processing method corresponding to each table header data.

[0078] Optionally, the server can obtain the exported configuration data input by the user through an external device; optionally, the server can obtain the exported configuration data from a storage location corresponding to a preset address; optionally, the server can generate the exported configuration data according to the content indicated by the display configuration data, for example, taking the column names included in the display configuration data as table header data, taking the attributes corresponding to the column names as the mapping relationships corresponding to the table header data, and taking the formatting methods corresponding to the column names as the data processing methods corresponding to the table header data.

[0079] In step 203, the first source data is subjected to page-based export processing according to the data content indicated by each export item.

[0080] In the embodiments of the present application, in order to avoid export lag caused by too large amount of exported data, the server can perform page-based export processing on the first source data according to the data content indicated by each export item. For example, the server can perform data processing on the first source data according to the data content indicated by each export item to obtain processed data, then perform page-based cutting on the processed data according to a preset export data amount threshold to obtain at least one page of exported data, and the server can export each page of exported data in batches.

[0081] In a possible implementation, after the server performs page-based export processing on the first source data corresponding to the first display data of the current display page, since the number of display pages can be multiple, the server can determine whether the source data corresponding to each display page has been exported. Optionally, the server can determine the total number of display pages according to the data amount of the source data and a second data amount threshold, and the server can also calculate the number of display pages that have been exported according to a preset counter. By the total number of display pages and the number of display pages that have been exported, the server can determine whether the source data has been exported.

[0082] Optionally, if not all the source data has been exported, the server can determine the second source data corresponding to the second display data according to the second display data of the next display page, and perform data export processing on the second source data according to the data content indicated by each export item.

[0083] Optionally, if all the source data has been exported, the server can generate export completion information, which is used to prompt the user that the data export is completed.

[0084] In the above embodiment, the first source data corresponding to the first display data displayed by the current display page is obtained, the first source data is part of the data to be exported, and the data export is performed on the first source data, thereby reducing the data amount of one-time data export. According to the paging export processing of the first source data according to the export configuration data, the data amount of one-time data export is further reduced, the export lag problem caused by directly exporting all the query data in the traditional technology is avoided, and the efficiency of data export is improved.

[0085] In one embodiment, based on the above Figure 2 In the above embodiment, the first source data corresponding to the first display data displayed by the current display page is obtained, the first source data is part of the data to be exported, and the data export is performed on the first source data, thereby reducing the data amount of one-time data export. According to the paging export processing of the first source data according to the export configuration data, the data amount of one-time data export is further reduced, the export lag problem caused by directly exporting all the query data in the traditional technology is avoided, and the efficiency of data export is improved. Figure 3 The embodiment relates to the paging export processing of the first source data according to the data content indicated by each export item. Figure 3 As shown in the figure, step 203 can include step 301 and step 302.

[0086] Step 301: determining candidate export data from the first source data according to the data content indicated by each export item.

[0087] In the embodiment of the present application, the server can perform data processing on the first source data according to the data content indicated by each export item in the export configuration data, so as to determine the candidate export data.

[0088] Optionally, the plurality of export items can include export header data and a mapping relationship corresponding to the header data, the server can determine the data to be exported according to the export header data and the mapping relationship corresponding to the header data, and directly take the data to be exported as the candidate export data. Optionally, the plurality of export items can include export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data, the server can determine the data to be exported according to the export header data and the mapping relationship corresponding to the header data, then perform format processing on the data to be exported by using the data processing mode field corresponding to each header data, and take the format-processed data to be exported as the candidate export data.

[0089] For example, the plurality of export items include export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data, and determining candidate export data from the first source data according to the data content indicated by each export item can include: the server filters the first source data according to each export header data and the mapping relationship corresponding to each header data, and filters out the data to be exported corresponding to each export header data, then the server can perform format processing on each data to be exported according to the data processing mode indicated by the data processing mode field, obtain the format-processed data to be exported, and determine the format-processed data to be exported as the candidate export data.

[0090] When the server determines the candidate export data, the server can determine whether the data amount of the candidate export data is greater than zero.

[0091] In a possible implementation, if the data amount of the candidate export data is not greater than zero, the server can determine that there is no data to be exported, and the server can generate export failure information.

[0092] In another possible implementation, if the data amount of the candidate export data is greater than zero and the server receives the export instruction, the server can determine whether the data amount of the candidate export data is greater than a first data amount threshold.

[0093] The export instruction is an instruction for instructing to export data. Optionally, the server can obtain the export instruction input by a user through an input control deployed on a current display page. Optionally, the system can periodically generate the export instruction, and the server can obtain the export instruction generated by the system by periodically detecting.

[0094] In the embodiment of the present application, if the server determines that the data amount of the export data is greater than zero and simultaneously obtains the export instruction, the server can perform data export on the source data. In order to avoid the export lag phenomenon caused by the large data amount of the export data, the server can first determine whether the data amount of the candidate export data is greater than the first data amount threshold. If the data amount of the candidate export data is less than or equal to the first data amount threshold, it indicates that the data amount of the candidate export data is small, and the server can directly perform data export on the candidate export data. If the data amount of the candidate export data is greater than the first data amount threshold, it indicates that the data amount of the candidate export data is too large, and the server needs to perform the paging export processing on the candidate export data.

[0095] In the embodiment of the present application, the server can perform the paging export processing on the candidate export data according to the first data amount threshold.

[0096] When the data amount of the candidate export data is greater than the first data amount threshold, the server can determine that the data amount of the candidate export data is too large, and if the data export is directly performed on the candidate export data, the export lag may occur, thereby reducing the efficiency of the export. In a possible implementation, the server can perform the paging export processing on the candidate export data according to the first data amount threshold.

[0097] In the embodiment of the present application, the server can perform data cutting on the candidate export data according to the first data amount threshold to obtain at least one cutting export data. The server performs data export on each cutting export data to obtain a data export file corresponding to each cutting export data, wherein the data amount of the cutting export data is less than or equal to the first data amount threshold.

[0098] In the above embodiments, the candidate export data is determined according to the export item, and when the data quantity of the candidate export data is greater than the first data quantity threshold, it is determined that the data quantity of the candidate export data is too large, and the candidate export data is subjected to the paging export processing, thereby avoiding the export jam problem caused by too large export data quantity and improving the export efficiency.

[0099] In one embodiment, referring to Figure 4 , an example data processing method is provided, which can be applied in the implementation environment shown in Figure 1 .

[0100] Step 401, obtain a data query condition.

[0101] The data query condition includes query data and a second data quantity threshold.

[0102] Step 402, filter the source data according to the query data to determine initial display data.

[0103] Step 403, if the data quantity of the initial display data is greater than the second data quantity threshold, perform paging processing on the initial display data according to the second data quantity threshold to obtain initial display data corresponding to a current display page.

[0104] Step 404, process the initial display data corresponding to the current display page according to display configuration data to obtain first display data.

[0105] Step 405, obtain first source data corresponding to the first display data according to the first display data of the current display page.

[0106] Step 406, obtain export configuration data.

[0107] The export configuration data includes a plurality of export items.

[0108] The plurality of export items include export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data.

[0109] Step 407, filter the first source data according to each export header data and the mapping relationship corresponding to each header data to filter out to-be-exported data corresponding to each export header data.

[0110] Step 408, perform format processing on each to-be-exported data according to the data processing mode indicated by the data processing mode field to obtain formatted to-be-exported data.

[0111] Step 409, determine that the formatted to-be-exported data is candidate export data.

[0112] Step 410, determining whether the data amount of the candidate export data is greater than zero.

[0113] Step 411, if the data amount of the candidate export data is greater than zero and the export instruction is received, determining whether the data amount of the candidate export data is greater than a first data amount threshold.

[0114] Step 412, in the case that the data amount of the candidate export data is greater than the first data amount threshold, performing data cutting on the candidate export data according to the first data amount threshold to obtain at least one cut export data.

[0115] Wherein, the data amount of the cut export data is less than or equal to the first data amount threshold.

[0116] Step 413, performing data export on each cut export data to obtain a data export file corresponding to each cut export data.

[0117] Step 414, determining whether the source data corresponding to each display page is all exported.

[0118] Step 415, if not all exported, determining the second source data corresponding to the second display data according to the second display data of the next display page, and performing data export processing on the second source data according to the data content indicated by each export item.

[0119] It should be understood that, although each step in the flowchart involved in each embodiment as described above is displayed in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least part of the steps in the flowchart involved in each embodiment as described above can include multiple steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be executed in rotation or alternation with at least part of other steps or steps or stages in other steps.

[0120] Based on the same inventive concept, the embodiments of the present application also provide a data processing apparatus for implementing the above-mentioned data processing method. The implementation scheme of the problem solving provided by the apparatus is similar to the implementation scheme described in the above method, so the specific limitations in one or more data processing apparatus embodiments provided below can refer to the limitations of the data processing method described above, which will not be repeated here.

[0121] In one exemplary embodiment, as Figure 5As shown, a data processing apparatus is provided, comprising: a data acquisition module 501, a configuration acquisition module 502, and an export module 503, wherein:

[0122] The data acquisition module 501 is configured to acquire first source data corresponding to first display data of a current display page according to the first display data.

[0123] The configuration acquisition module 502 is configured to acquire export configuration data, wherein the export configuration data comprises a plurality of export items.

[0124] The export module 503 is configured to perform page export processing on the first source data according to data content indicated by each export item.

[0125] In one embodiment, the export module 503 comprises:

[0126] A determination unit is configured to determine candidate export data from the first source data according to data content indicated by each export item.

[0127] A page export unit is configured to perform page export processing on the candidate export data according to a first data amount threshold in a case where a data amount of the candidate export data is greater than the first data amount threshold.

[0128] In one embodiment, the page export unit is specifically configured to perform the following steps:

[0129] Perform data cutting on the candidate export data according to the first data amount threshold to obtain at least one cut export data, wherein a data amount of the cut export data is less than or equal to the first data amount threshold.

[0130] Perform data export on each cut export data to obtain a data export file corresponding to each cut export data.

[0131] In one embodiment, the plurality of export items comprises export header data, a mapping relationship corresponding to the header data, and a data processing mode field corresponding to the header data, and the determination unit is specifically configured to perform the following steps:

[0132] Filter the first source data according to each export header data and the mapping relationship corresponding to each header data to filter out to-be-exported data corresponding to each export header data.

[0133] Format each to-be-exported data according to a data processing mode indicated by the data processing mode field to obtain formatted to-be-exported data.

[0134] Determine that the formatted to-be-exported data is the candidate export data.

[0135] In one embodiment, the export module 503 further comprises:

[0136] The first judging unit is configured to determine whether the data amount of the candidate exported data is greater than zero.

[0137] The second judging unit is configured to determine whether the data amount of the candidate exported data is greater than a first data amount threshold if the data amount of the candidate exported data is greater than zero and the export instruction is received.

[0138] In an embodiment, the data processing apparatus further comprises:

[0139] The judging module is configured to judge whether the source data corresponding to each display page is all exported.

[0140] The subsequent exporting module is configured to determine the second source data corresponding to the second display data according to the second display data of the next display page if the source data is not all exported, and perform data exporting processing on the second source data according to the data content indicated by each exporting item.

[0141] In an embodiment, the data processing apparatus further comprises:

[0142] The querying module is configured to obtain a data query condition, the data query condition comprising query data and a second data amount threshold.

[0143] The screening module is configured to screen the source data according to the query data to determine initial display data.

[0144] The paging processing module is configured to perform paging processing on the initial display data according to the second data amount threshold to obtain the initial display data corresponding to the current display page if the data amount of the initial display data is greater than the second data amount threshold.

[0145] The display configuration module is configured to process the initial display data corresponding to the current display page according to the display configuration data to obtain the first display data.

[0146] Each module in the above data processing apparatus can be realized by software, hardware and combinations thereof in whole or in part. Each module can be embedded in or independent of the processor in the computer device in hardware form, or stored in the memory in the computer device in software form, so as to be called and executed by the processor to perform the operations corresponding to each module.

[0147] In an exemplary embodiment, a computer device is provided, which can be a server, and the internal structure diagram thereof can be as shown in Figure 6The computer device shown in the figure includes a processor, a memory, an input / output interface (I / O for short), and a communication interface. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The database of the computer device is used to store data processing data. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals through network connection. The computer program is executed by the processor to implement a data processing method.

[0148] Those skilled in the art can understand that, Figure 6 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0149] In one exemplary embodiment, a computer device is provided, including a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the following steps:

[0150] According to the first display data of the current display page, the first source data corresponding to the first display data is obtained;

[0151] Obtain export configuration data, the export configuration data includes a plurality of export items;

[0152] According to the data content indicated by each of the export items, the first source data is subjected to a paging export processing.

[0153] In one embodiment, the processor executing the computer program further implements the following steps:

[0154] According to the data content indicated by each of the export items, the candidate export data is determined from the first source data;

[0155] In the case where the data amount of the candidate export data is greater than a first data amount threshold, the candidate export data is subjected to a paging export processing according to the first data amount threshold.

[0156] In one embodiment, the processor executing the computer program further implements the following steps:

[0157] data cut the candidate export data according to the first data amount threshold, to obtain at least one cut export data, the data amount of the cut export data is less than or equal to the first data amount threshold;

[0158] data export each of the cut export data, to obtain the data export file corresponding to each of the cut export data.

[0159] In one embodiment, the plurality of export items include export table header data, mapping relationship corresponding to the table header data, and data processing mode field corresponding to the table header data, and the processor executes the computer program to further implement the following steps:

[0160] According to each of the export table header data and the mapping relationship corresponding to each of the table header data, the first source data is filtered, and the data to be exported corresponding to each of the export table header data is filtered out;

[0161] According to the data processing mode indicated by the data processing mode field, each of the data to be exported is formatted to obtain the formatted data to be exported;

[0162] Determine that the formatted data to be exported is the candidate export data.

[0163] In one embodiment, the processor executes the computer program to further implement the following steps:

[0164] Determine whether the data amount of the candidate export data is greater than zero;

[0165] If the data amount of the candidate export data is greater than zero, and the export instruction is received, determine whether the data amount of the candidate export data is greater than the first data amount threshold.

[0166] In one embodiment, the processor executes the computer program to further implement the following steps:

[0167] Determine whether the source data corresponding to each of the display pages is all exported;

[0168] If not all are exported, determine the second source data corresponding to the second display data according to the second display data of the next display page, and perform data export processing on the second source data according to the data content indicated by each of the export items.

[0169] In one embodiment, the processor executes the computer program to further implement the following steps:

[0170] Obtain a data query condition, the data query condition includes query data and a second data amount threshold;

[0171] Filtering source data according to the query data to determine initial display data;

[0172] If a data amount of the initial display data is greater than the second data amount threshold, performing a paging processing on the initial display data according to the second data amount threshold to obtain initial display data corresponding to a current display page;

[0173] Processing the initial display data corresponding to the current display page according to display configuration data to obtain the first display data.

[0174] In one embodiment, a computer readable storage medium is provided, and the computer readable storage medium stores a computer program. When the computer program is executed by a processor, the following steps are implemented:

[0175] According to the first display data of the current display page, obtaining first source data corresponding to the first display data;

[0176] Obtaining export configuration data, the export configuration data including a plurality of export items;

[0177] Performing a paging export processing on the first source data according to data contents indicated by the export items.

[0178] In one embodiment, the computer program is further executed by the processor to implement the following steps:

[0179] Determining candidate export data from the first source data according to data contents indicated by the export items;

[0180] In a case where a data amount of the candidate export data is greater than a first data amount threshold, performing a paging export processing on the candidate export data according to the first data amount threshold.

[0181] In one embodiment, the computer program is further executed by the processor to implement the following steps:

[0182] Performing a data cutting on the candidate export data according to the first data amount threshold to obtain at least one cut export data, a data amount of the cut export data being less than or equal to the first data amount threshold;

[0183] Performing a data export on each of the cut export data to obtain a data export file corresponding to each of the cut export data.

[0184] In one embodiment, the plurality of export items include export table header data, a mapping relationship corresponding to the table header data, and a data processing mode field corresponding to the table header data. The computer program is further executed by the processor to implement the following steps:

[0185] According to the derived table header data and the mapping relationship corresponding to each table header data, the first source data is filtered to obtain to-be-exported data corresponding to each derived table header data.

[0186] According to the data processing mode indicated by the data processing mode field, the to-be-exported data is formatted to obtain formatted to-be-exported data.

[0187] It is determined that the formatted to-be-exported data is the candidate export data.

[0188] In one embodiment, the computer program is executed by the processor to further implement the following steps:

[0189] It is determined whether the data amount of the candidate export data is greater than zero.

[0190] If the data amount of the candidate export data is greater than zero and the export instruction is received, it is determined whether the data amount of the candidate export data is greater than the first data amount threshold.

[0191] In one embodiment, the computer program is executed by the processor to further implement the following steps:

[0192] It is determined whether the source data corresponding to each display page is all exported.

[0193] If not all are exported, the second source data corresponding to the second display data is determined according to the second display data of the next display page, and the second source data is subjected to data export processing according to the data content indicated by each export item.

[0194] In one embodiment, the computer program is executed by the processor to further implement the following steps:

[0195] The data query condition is obtained, and the data query condition includes query data and a second data amount threshold.

[0196] According to the query data, the source data is filtered to determine initial display data.

[0197] If the data amount of the initial display data is greater than the second data amount threshold, the initial display data is subjected to paging processing according to the second data amount threshold to obtain initial display data corresponding to a current display page.

[0198] According to the display configuration data, the initial display data corresponding to the current display page is processed to obtain the first display data.

[0199] In one embodiment, a computer program product is provided, including a computer program, which is executed by the processor to implement the following steps:

[0200] According to the first display data of the current display page, obtain first source data corresponding to the first display data;

[0201] Obtain export configuration data, the export configuration data including a plurality of export items;

[0202] According to the data content indicated by each of the export items, perform a paging export processing on the first source data.

[0203] In one embodiment, the computer program, when executed by the processor, further implements the following steps:

[0204] According to the data content indicated by each of the export items, determine candidate export data from the first source data;

[0205] In a case where the data amount of the candidate export data is greater than a first data amount threshold, perform a paging export processing on the candidate export data according to the first data amount threshold.

[0206] In one embodiment, the computer program, when executed by the processor, further implements the following steps:

[0207] According to the first data amount threshold, perform data cutting on the candidate export data to obtain at least one cut export data, the data amount of the cut export data being less than or equal to the first data amount threshold;

[0208] Perform data export on each of the cut export data to obtain a data export file corresponding to each of the cut export data.

[0209] In one embodiment, the plurality of export items include export table header data, a mapping relationship corresponding to the table header data, and a data processing mode field corresponding to the table header data, and the computer program, when executed by the processor, further implements the following steps:

[0210] According to each of the export table header data and the mapping relationship corresponding to each of the table header data, filter the first source data to obtain to-be-exported data corresponding to each of the export table header data;

[0211] According to the data processing mode indicated by the data processing mode field, perform format processing on each of the to-be-exported data to obtain formatted to-be-exported data;

[0212] Determine that the formatted to-be-exported data is the candidate export data.

[0213] In one embodiment, the computer program, when executed by the processor, further implements the following steps:

[0214] Determine whether the data amount of the candidate export data is greater than zero;

[0215] If the data amount of the candidate export data is greater than zero and the export instruction is received, it is determined whether the data amount of the candidate export data is greater than the first data amount threshold.

[0216] In one embodiment, the computer program, when executed by the processor, further implements the following steps:

[0217] It is determined whether the source data corresponding to each of the display pages is all exported.

[0218] If not all of the source data is exported, the second source data corresponding to the second display data of the next display page is determined according to the second display data, and the second source data is subjected to data export processing according to the data content indicated by each of the export items.

[0219] In one embodiment, the computer program, when executed by the processor, further implements the following steps:

[0220] The data query condition is obtained, and the data query condition includes query data and a second data amount threshold.

[0221] The source data is filtered according to the query data, and initial display data is determined.

[0222] If the data amount of the initial display data is greater than the second data amount threshold, the initial display data is subjected to paging processing according to the second data amount threshold, and initial display data corresponding to a current display page is obtained.

[0223] The initial display data corresponding to the current display page is processed according to the display configuration data, and the first display data is obtained.

[0224] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant regulations.

[0225] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when executed, can include the processes of the above-mentioned embodiment methods. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. The non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. The volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration but not limitation, the RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., without being limited thereto.

[0226] The technical features of the above embodiments can be combined in any manner. To make the description concise, all possible combinations of the technical features in the above embodiments are not described, but as long as the combinations of the technical features do not exist, they should be considered as the scope of the present application.

[0227] The above-described embodiments are merely illustrative of several embodiments of the present application, and the description is relatively specific and detailed, but should not be understood as a limitation on the scope of the patent. It should be noted that for those skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the scope of the present application. Therefore, the scope of protection of the present application should be subject to the appended claims.

Claims

1. A data processing method, characterized by, The method comprises: obtaining a data query condition, screening source data according to query data included in the data query condition, determining initial display data, formatting the initial display data corresponding to the current display page according to display configuration data to obtain first display data; the source data includes archived data in a database; the display configuration data is input by a user through an external input device; screening data in the database according to a data identifier included in the first display data of the current display page to obtain first source data corresponding to the first display data; generating export configuration data according to content indicated by the display configuration data, the export configuration data including a plurality of export items; performing paging export processing on the first source data according to data content indicated by each of the export items.

2. The method of claim 1, wherein, The paging export processing on the first source data according to the data content indicated by each of the export items comprises: determining candidate export data from the first source data according to the data content indicated by each of the export items; in a case where the data amount of the candidate export data is greater than a first data amount threshold, performing paging export processing on the candidate export data according to the first data amount threshold.

3. The method of claim 2, wherein, The paging export processing on the candidate export data according to the first data amount threshold comprises: performing data cutting on the candidate export data according to the first data amount threshold to obtain at least one cutting export data, the data amount of the cutting export data being less than or equal to the first data amount threshold; performing data export on each of the cutting export data to obtain a data export file corresponding to each of the cutting export data.

4. The method of claim 2, wherein, The plurality of export items include export header data, mapping relationships corresponding to the header data, and data processing mode fields corresponding to the header data, and the determination of candidate export data from the first source data according to the data content indicated by each of the export items comprises: screening the first source data according to each of the export header data and the mapping relationships corresponding to the header data to screen out to-be-exported data corresponding to each of the export header data; performing formatting processing on each of the to-be-exported data according to the data processing mode indicated by the data processing mode field to obtain formatted to-be-exported data; determining the formatted to-be-exported data as the candidate export data.

5. The method of claim 2, wherein, The method further comprises: determining whether the data amount of the candidate export data is greater than zero; if the data amount of the candidate export data is greater than zero and an export instruction is received, determining whether the data amount of the candidate export data is greater than the first data amount threshold.

6. The method of claim 1, wherein, The method further comprises: judging whether source data corresponding to each of the display pages is all exported; if not all of the source data is exported, determining second source data corresponding to second display data of a next display page according to the second display data, and performing data export processing on the second source data according to the data content indicated by each of the export items.

7. The method of claim 1, wherein, The method further comprises: obtaining a data query condition, the data query condition including query data and a second data amount threshold; Filtering source data according to the query data to determine initial display data; If the data amount of the initial display data is greater than the second data amount threshold, performing page processing on the initial display data according to the second data amount threshold to obtain initial display data corresponding to a current display page; Processing the initial display data corresponding to the current display page according to display configuration data to obtain the first display data.

8. A data processing apparatus, characterized by, The apparatus comprises: A data acquisition module configured to acquire a data query condition, filter source data according to query data included in the data query condition to determine initial display data, and format process the initial display data corresponding to a current display page according to display configuration data to obtain first display data; the source data includes archived data in a database; the display configuration data is input by a user through an external input device; and data in the database is filtered according to a data identifier included in the first display data of the current display page to obtain first source data corresponding to the first display data; A configuration acquisition module configured to generate export configuration data according to content indicated by the display configuration data; the export configuration data includes a plurality of export items; An export module configured to perform page export processing on the first source data according to data content indicated by each of the export items. 9.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-8 when the computer program is executed by the processor. The processor executes the computer program to implement the steps of the method of any one of claims 1 to 7.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 7.

11. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 7.

Images