Data exporting method and device, computer equipment and storage medium

Abstract

The invention discloses a data exporting method and device, computer equipment and a storage medium. The method comprises the following steps: when a data export instruction of a user is received, determining whether a method parameter corresponding to the data export instruction contains an export mark or not; and when it is determined that the method parameter contains an export mark, querying and exporting corresponding export data in batches through a preset paging call list query method, and integrating the export data into target export data in a preset format. According to the technical scheme, when the data exporting instruction of the user is received, whether the exporting mark is contained or not is determined through the transmitted method parameters so as to achieve the data exporting function, other exporting interfaces do not need to be connected, the calling number of front-end interfaces is greatly reduced, the code development amount is small, a large amount of development manpower and time cost can be saved, and the development efficiency is improved. And rapid iterative development is realized, the data exporting effect can be preset, and the exporting effects such as visualization and the like are better.

Description

Technical Field

[0001] The present invention relates to the fields of data query technology and financial technology technology, and in particular to a data export method, device, computer equipment and storage medium. Background Art

[0002] The data export function is usually combined with the list function. The operation process is usually to query the list first, and then complete the data export by clicking the export button. For example, in financial scenarios, the corresponding work order data can be exported by querying the work orders of various insurance systems, banking systems, trading systems, or order systems. Traditional implementation methods tend to meet flexibility requirements by developing independent export interfaces to support various special export scenarios. However, the disadvantages of this approach are obvious: it not only greatly increases the amount of code development and consumes more manpower and time resources, but also leads to a high degree of code redundancy, thereby increasing maintenance costs; In addition, in most business scenarios, the requirements for data export and list query are highly consistent, that is, the exported data content should be consistent with the list query results. Faced with such highly overlapping demand scenarios, traditional data export functions cannot achieve fast iterative development and light code development. It is not only time-consuming and labor-intensive, but also often has poor data export results.

[0003] Therefore, those skilled in the art are in urgent need of finding a new technical solution to solve the above problems. Summary of the invention

[0004] Based on this, a data export method, apparatus, computer equipment and storage medium are provided to solve the technical problems of the data export function in the prior art, which are time-consuming and labor-intensive and have poor data export effect.

[0005] A data export method, comprising: Upon receiving a data export instruction from a user, determining whether a method parameter corresponding to the data export instruction includes an export tag; When it is determined that the method parameter includes the export mark, the corresponding export data is queried and exported in batches through a preset paging call list query method, and the export data is integrated into target export data in a preset format.

[0006] A data export device, comprising: A determination module, configured to, upon receiving a data export instruction from a user, determine whether a method parameter corresponding to the data export instruction includes an export tag; The integration module is used to query and export the corresponding export data in batches through a preset paging call list query method when it is determined that the method parameter contains an export mark, and integrate the export data into target export data in a preset format.

[0007] A computer device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned data export method when executing the computer program.

[0008] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the data export method is implemented.

[0009] The above-mentioned data export method, device, computer equipment and storage medium, upon receiving the user's data export instruction, determine whether the method parameter corresponding to the data export instruction contains an export mark; upon determining that the method parameter contains the export mark, query and export the corresponding export data in batches through the preset paging call list query method, and integrate the export data into the target export data in a preset format. After realizing the data export function, the business list query function and the export function are closely combined, and the final results of the two are completely consistent, one is reflected in the page query result, and the other is reflected in the data export result; upon receiving the user's data export instruction, determine whether the export mark is contained through the passed method parameter to realize the data export function, and there is no need to connect to other export interfaces, which greatly reduces the number of front-end interface calls, the amount of code development is small, and a large amount of development manpower and time costs can be saved, and rapid iterative development can be realized. The effect of exporting data is based on the pre-set, and the export effect such as visualization is better. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0011] Figure 1 is a schematic diagram of an application environment of a data export method in one embodiment of the present invention; Figure 2 is a process diagram of a data export method in one embodiment of the present invention; Figure 3 is a structural schematic diagram of a data export device in one embodiment of the present invention; Figure 4 is a schematic diagram of a computer device in one embodiment of the present invention. DETAILED DESCRIPTION

[0012] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0013] The data export method provided by the present invention can be applied in Figure 1 In an application environment, a client communicates with a server via a network. The client may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, and portable wearable devices. The server may be implemented as an independent server or a server cluster consisting of multiple servers.

[0014] In one embodiment, if Figure 2 As shown, a data export method is provided, which is applied in Figure 1 The server in the example is used as an example to illustrate the process, including the following steps: S10, upon receiving a data export instruction from a user, determining whether a method parameter corresponding to the data export instruction includes an export mark.

[0015] It can be understood that the data export instruction is an instruction generated after the virtual export button is triggered in the front-end page. After the instruction is generated, an input parameter - a method parameter will be passed to determine whether the export mark is included; the export mark is a pre-set mark, and the existence of this mark means that data can be further exported, and the mark can be exportFlag.

[0016] S20, when it is determined that the method parameter includes the export mark, query and export the corresponding export data in batches through a preset paging call list query method, and integrate the export data into target export data in a preset format.

[0017] Understandably, the preset paging call list query method can be used to divide a large amount of data into multiple smaller pages and then export them in a specified data format, such as exporting them in the form of a data list, including an Excel data table, etc., wherein the preset paging call list query method usually involves the following key parameters: page number, page size, and possible sorting and filtering conditions; after obtaining the target export data, the download address of the target export data on Excel can be returned, wherein the target export data in a specific scenario can be the business data of the work order, historical transaction data, configuration data, etc.; It should be noted that by adding specified annotations to the query of list data, one-click export can be achieved. Common usage scenarios include exporting after querying the work order list (such as exporting insurance, finance, etc. work orders that employees are responsible for), exporting after querying historical task records, and exporting after querying configuration information.

[0018] In the embodiment of step S10 to step S20, after the data export function is implemented, the business list query function and the data export function are closely combined, and the final results of the two are completely consistent, one is reflected in the page query result, and the other is reflected in the data export result; when the user's data export instruction is received, it is determined whether the export mark is included through the passed method parameter to realize the data export function, and there is no need to connect to other export interfaces, which greatly reduces the number of front-end interface calls, reduces the amount of code development, saves a lot of development manpower and time costs, and realizes rapid iterative development. The effect of exporting data is based on pre-settings, and the export effect such as visualization is better.

[0019] Further, the determining whether the method parameter corresponding to the data export instruction includes an export tag includes: When processing the slice, the method parameters are obtained through the slice; Determine whether the method parameter contains an export tag and whether the value of the exported export tag is a preset target export tag value.

[0020] Understandably, aspect processing, in software development, usually refers to an application of aspect-oriented programming (AOP), in which an aspect is a collection of notifications and pointcuts, which together define all the functions of the aspect. The aspect encapsulates those logics or responsibilities that are not related to the business but are commonly called by business modules, which is convenient for reducing the system's duplicate code, reducing the coupling between modules, and is conducive to future operability and maintainability; the type of method parameters can be customized according to requirements, and the export tag can be determined through this method parameter, in which the type of method parameters can be DTO (data transfer object) and Map; Specifically, in the process of aspect processing, the @Pointcut annotation is used to define the pointcut, specify which methods need to be intercepted, and define the pointcut based on conditions such as package path, class name, and method signature; the intercepted method parameters are obtained through the object in the surrounding notification @Around written in the aspect class; reflection or type checking is used to traverse the method parameters to find the parameters containing the export tag exportFlag; after finding the method parameter containing the export tag, check whether its exported value is the "Y" target export tag value. If so, execute the data export logic; The aspect processing in this embodiment makes the export logic more centralized and easier to manage. Developers can understand and maintain the export logic more easily because it is separated from the business logic. Through aspect processing, it is possible to avoid repeatedly writing the same export logic in each method that needs to be exported, reduce code redundancy, and improve code quality. The use of aspects can ensure that the export logic is executed in a consistent manner in all related methods, reducing errors and inconsistencies caused by manually implementing the export logic in different methods.

[0021] Furthermore, the querying and exporting of corresponding export data in batches by calling a list query method by a preset page, and integrating the export data into target export data in a preset format, include: After scanning the annotation, enter the aspect processing logic; When processing the slice, after determining that the current situation requires data export processing, set the paging parameters based on the total amount of data queried and the amount of data queried in a single query; Call the marked annotated calling method under the paging parameters and query the exported data consisting of data lists in batches; The export data are integrated into target export data consisting of a large data list.

[0022] Understandably, the existence of annotations is equivalent to the existence of business methods that need to be processed. In this way, after the annotation is recognized, the corresponding aspect processing logic must be entered; the paging parameter refers to the number of pages that need to be queried in batches; the calling method of the marked annotation is to use reflection or Spring's AopContext to call the marked annotation method, through which the paging data can be obtained under the passed-in paging parameters, wherein the export annotation is configured on the data list query method, and the export aspect service class intercepts and recognizes the export annotation, and can perform data export processing logic. Because the page only queries the data of the current page, and the data export function needs to be able to export the data of all pages under the current conditions, the data query needs to be processed in pages and batches in the data export processing logic; Specifically, after scanning the class method with the @Export annotation, enter the aspect processing logic, where the paging logic is implemented in the aspect notification, including calculating the total number of pages, current page number and other paging parameters; reset the export paging parameters, call the business method marked with the export annotation (@Export), and call the query data list multiple times. For example, if the total amount of data is 10,000 data records and the amount of data queried in a single time is 1,000, the paging parameter can be set to 10. At this time, the data list can be queried in 10 paging times; integrate the exported data in the data list results of the paging query into a large data list; according to the export list template (model in the annotation), export the target export data composed of the large data list to an Excel file or send it to a remote service; In addition, during the data export process, the returned data format is used to determine whether the data export requirements are met, the returned export data is used to determine whether the data is empty, and the filtered target data is used to determine whether there is exportable export data. This embodiment separates the data export processing logic from the business logic through annotations, making the code clearer and easier to maintain. The aspect class can be reused in multiple annotated methods, avoiding repeated writing of paging and data export processing logic; paging query reduces the amount of data in a single query, reduces memory consumption and database pressure, and at the same time, by calculating the number of paging queries, a large amount of data export can be efficiently processed.

[0023] Furthermore, before the method of querying and exporting the corresponding export data in batches by calling the preset paging list query method and integrating the export data into target export data in a preset format, the method further includes: An annotation corresponding to the data export processing is set; the annotation includes a file name prefix, a time suffix and an export data description of the target export data in a preset format; the annotation is used to perform the data export processing logic of the target export data.

[0024] Understandably, the data list query method mentioned above needs to be configured with annotations. The annotations set in advance can specify the exported data file and the exported data during the data export process, including fileNamePre: export file name prefix (suffixed with time yyMMddHHmmss), fileName: export file name (select one of the above), model: export data column description, such as column A, column B (defining the header of the exported Excel); in addition, the annotation is used to mark the class method, and after scanning the class method marked with the annotation through the section, the export logic processing after the data list query is performed; in addition, the process of exporting data can also determine the export format by setting exportType, such as setting it to H5 format, or by setting the mask of the exported data list of sqlID.

[0025] Furthermore, when it is determined that the method parameter includes the export mark, the corresponding export data is queried and exported in batches by calling the preset paging list query method, and before the export data is integrated into the target export data in a preset format, it also includes: When it is determined that the method parameter does not contain the export mark, the preset list query method is directly called to query the data and then return the query result.

[0026] Understandably, the presence of the export tag is the basis for determining the calling method of the marked annotation, and when the export tag is not included, the normal list query function can be used, without the need for paging query and then data export processing logic; This embodiment directly uses the preset list query method when no export mark is included, thereby saving query resources and optimizing data query performance.

[0027] Furthermore, the method further comprises: The front end where the user's data export instruction is located and the query are set to share a common interface; after the front end issues the export instruction, the export mark is transmitted on the interface; Call the marked annotated call method under the specified data description and query the exported data consisting of data lists in batches.

[0028] Understandably, in the front end: share the same interface with the data list query, and when issuing the export instruction after clicking the front end export button, pass an additional export tag parameter in the interface; in the back end: add annotations to the class method of the query list to specify the data column description parameters of the exported data and the prefix and suffix of the file name.

[0029] Furthermore, the querying and exporting corresponding export data in batches by calling a preset paging list query method includes: Get the filter criteria that the user selects in the data list on the front end; Under the input parameters corresponding to the screening conditions of the data list, the corresponding input parameters of the data export of the list query method are queried in batches through the preset paging call and the corresponding export data is exported.

[0030] Understandably, the filtering conditions can be set in the front-end page, such as setting the paging parameters of the data list, including page number, number of pages per page, and number of historical paging.

[0031] After the screening conditions are set at the front end, this embodiment realizes the export call and parameter input, and can also realize the list call and parameter input. In this way, not only can the data be exported, but also the corresponding data can be exported according to the specified export effect, thereby optimizing the export effect and improving the user experience.

[0032] To sum up, the above provides a data export method, which belongs to the field of data query technology. When receiving a user's data export instruction, it is determined whether the method parameter corresponding to the data export instruction contains an export mark; when it is determined that the method parameter contains the export mark, the corresponding export data is queried and exported in batches through a preset paging call list query method, and the export data is integrated into target export data in a preset format. After the data export function is realized, the business list query function and the data export function are closely combined, and the final results of the two are completely consistent, one is reflected in the page query result, and the other is reflected in the data export result; when receiving the user's data export instruction, the method parameter passed is used to determine whether the export tag is included to realize the data export function, and there is no need to connect to other export interfaces, which greatly reduces the number of front-end interface calls, the amount of code development is small, and a lot of development manpower and time costs can be saved, and rapid iterative development can be achieved. The effect of exporting data is based on the pre-set, and the visual export effect is better; data export can be realized by adding export annotations to the business method, which can save a lot of development manpower and time, and realize rapid iterative development; by using the same interface and not connecting to other export interfaces, the number of front-end interface calls can be reduced, saving the development time of front-end interface calls and improving the development timeliness; in the scenario where the needs of data export and list query are highly consistent, by exporting data in pages under the tag (equivalent to exporting data in batches), more than 98% of the problems of repeated development of data export functions can be solved; the data export function is highly extensible, including the naming of export files, number restrictions, and implementation methods through annotation customization.

[0033] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0034] In one embodiment, a data export device is provided, which corresponds one-to-one to the data export method in the above embodiment. Figure 3 As shown, the data export device includes a determination module 11 and an integration module 12. Each functional module is described in detail as follows: A determination module 11, configured to determine, upon receiving a data export instruction from a user, whether a method parameter corresponding to the data export instruction includes an export mark; The integration module 12 is used to query and export the corresponding export data in batches through a preset paging call list query method when it is determined that the method parameter contains an export mark, and integrate the export data into target export data in a preset format.

[0035] Furthermore, the determining module includes: A first acquisition submodule, used for acquiring the method parameters through the slice during slice processing; The determination submodule is used to determine whether the method parameter contains an export tag and whether the value of the exported export tag is a preset target export tag value.

[0036] Furthermore, the integration module includes: Enter the submodule, which is used to enter the aspect processing logic after scanning the annotation; Set up a submodule to set paging parameters based on the total amount of data queried and the amount of data queried in a single query after determining that the current situation requires data export processing during aspect processing; A query submodule, used to call the call method with the marked annotation under the paging parameters and query the exported data consisting of the data list in batches; The integration submodule is used to integrate the export data into target export data consisting of a large data list.

[0037] Furthermore, the data export device further includes: The first setting module is used to set annotations corresponding to the data export processing; the annotations include the file name prefix, time suffix and export data description of the target export data in a preset format; the annotations are used to perform the data export processing logic of the target export data.

[0038] Furthermore, the data export device further includes: The return module is used to directly call the preset list query method to query data and then return the query result when it is determined that the method parameter does not contain the export mark.

[0039] Furthermore, the data export device further includes: The second setting module is used to set the front end where the user's data export instruction is located to share an interface with the query; after the front end issues the export instruction, the export mark is transmitted on the interface; The query module is used to call the call method with marked annotations under the specified data description and query the exported data consisting of data lists in batches.

[0040] Furthermore, the integration module includes: The second acquisition submodule is used to obtain the screening conditions of the data list selected by the user on the front end; The export submodule is used to query and export the corresponding input parameters of the data export corresponding to the input parameters of the data list through the preset paging call list query method under the input parameters corresponding to the screening conditions of the data list.

[0041] For the specific definition of the data export device, please refer to the definition of the data export method above, which will not be repeated here. Each module in the above-mentioned data export device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0042] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 4 As shown. The computer device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data involved in the data export method. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a data export method is implemented.

[0043] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the data export method in the above embodiment are implemented, such as Figure 2 Steps S10 to S20 shown include the following steps: Upon receiving a data export instruction from a user, determining whether a method parameter corresponding to the data export instruction includes an export tag; When it is determined that the method parameter includes the export mark, the corresponding export data is queried and exported in batches through a preset paging call list query method, and the export data is integrated into target export data in a preset format.

[0044] Alternatively, when the processor executes the computer program, the functions of each module / unit of the data export device in the above embodiment are realized, for example Figure 3 The functions of modules 11 to 12 are shown in Figure 1. To avoid repetition, they will not be described here.

[0045] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the data export method in the above embodiment are implemented, such as Figure 2 Steps S10 to S20 shown include the following steps: Upon receiving a data export instruction from a user, determining whether a method parameter corresponding to the data export instruction includes an export tag; When it is determined that the method parameter includes the export mark, the corresponding export data is queried and exported in batches through a preset paging call list query method, and the export data is integrated into target export data in a preset format.

[0046] Alternatively, when the computer program is executed by the processor, the functions of each module / unit of the data export device in the above embodiment are realized, for example Figure 3 The functions of modules 11 to 12 are shown in Figure 1. To avoid repetition, they will not be described here.

[0047] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0048] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0049] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

Claims

1. A data export method, characterized in that: include: Upon receiving a data export instruction from a user, determining whether a method parameter corresponding to the data export instruction includes an export tag; When it is determined that the method parameter includes the export mark, the corresponding export data is queried and exported in batches through a preset paging call list query method, and the export data is integrated into target export data in a preset format.

2. The data export method according to claim 1, characterized in that: The determining whether the method parameter corresponding to the data export instruction includes an export tag comprises: When processing the slice, the method parameters are obtained through the slice; Determine whether the method parameter contains an export tag and whether the value of the exported export tag is a preset target export tag value.

3. The data export method according to claim 1, characterized in that: The querying and exporting corresponding export data in batches by calling a list query method by a preset page, and integrating the export data into target export data in a preset format, includes: After scanning the annotation, enter the aspect processing logic; When processing the slice, after determining that the current situation requires data export processing, set the paging parameters based on the total amount of data queried and the amount of data queried in a single query; Call the marked annotated calling method under the paging parameters and query the exported data consisting of data lists in batches; The export data are integrated into target export data consisting of a large data list.

4. The data export method according to claim 1 or 3, characterized in that: Before the method of querying and exporting the corresponding export data in batches by calling the preset paging list query method and integrating the export data into target export data in a preset format, the method further includes: An annotation corresponding to the data export processing is set; the annotation includes a file name prefix, a time suffix and an export data description of the target export data in a preset format; the annotation is used to perform the data export processing logic of the target export data.

5. The data export method according to any one of claims 1 to 3, characterized in that: When it is determined that the method parameter includes the export mark, querying and exporting the corresponding export data in batches by calling the preset paging list query method, and integrating the export data into the target export data in a preset format, it also includes: When it is determined that the method parameter does not contain the export mark, the preset list query method is directly called to query the data and then return the query result.

6. The data export method according to claim 1 or 3, characterized in that: The method further comprises: The front end where the user's data export instruction is located and the query are set to share a common interface; after the front end issues the export instruction, the export mark is transmitted on the interface; Call the marked annotated call method under the specified data description and query the exported data consisting of data lists in batches.

7. The data export method according to claim 1, characterized in that: The method of querying and exporting corresponding export data in batches by calling a preset paging list query method includes: Get the filter criteria that the user selects in the data list on the front end; Under the input parameters corresponding to the screening conditions of the data list, the data export corresponding to the input parameters of the list query method is called through the preset paging to query and export the corresponding export data in batches.

8. A data export device, characterized in that: include: A determination module, configured to, upon receiving a data export instruction from a user, determine whether a method parameter corresponding to the data export instruction includes an export tag; The integration module is used to query and export the corresponding export data in batches through a preset paging call list query method when it is determined that the method parameter contains an export mark, and integrate the export data into target export data in a preset format.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the data export method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the data export method according to any one of claims 1 to 7 is implemented.

Images