File exporting method, device and system, storage medium and program product
By setting up a file export device between the business server and the data server to generate and store data information tables, the problem of poor stability during GIS data export is solved, achieving more efficient and stable file export.
Patent Information
- Application Number
- CN202410511755.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-26
- Publication Date
- 2025-10-28
AI Technical Summary
In existing technologies, the export of GIS data is subject to poor stability due to the large amount of data processing and reliance on business servers, which makes it susceptible to server failures or restarts.
A file export device is set up between the business server and the data server. The business server generates a data information table and stores it on the data server. The file export device directly obtains relevant files from the data server, avoiding direct interaction with the business server.
It improves the stability and efficiency of file export, reduces dependence on business servers, reduces hardware resource redundancy requirements, and lowers hardware costs.
Smart Images

Figure CN120849433A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of information processing, and in particular to a file export method, apparatus and system, storage medium and program product. Background Technology
[0002] Map-based SaaS (Software as a Service) refers to providing map-related functions and services to users via a cloud platform in a SaaS model. This service model allows users to directly access online map services provided by the service provider, such as location data storage and management services, map data update and maintenance services, without having to build and maintain their own map service infrastructure.
[0003] SaaS services typically provide the ability to export GIS (Geographic Information System) data (usually referring to geographic information data such as location information data or map data) to meet customers' subsequent scenario or business needs.
[0004] For the traditional technical implementation of GIS data export, the business service usually provides the export interface, directly queries the database for GIS data that meets the conditions, then calls other services to obtain business data (such as order data, user information), assembles the data, generates a file in a predetermined format based on the assembled data, and returns it to the front-end device to complete the file download. Summary of the Invention
[0005] The inventors noted that in related technologies, GIS data that meets certain criteria is first queried from a database, and then other services are called to obtain business data before data assembly. Because this method involves a large amount of data processing and is time-consuming, it is easily affected by server failures or restarts, thus reducing the stability of file export.
[0006] Accordingly, this disclosure provides a file export scheme. By setting up a file export device between the business server and the data server, the file export device uses the business data in the business server to generate a data information table and sends it to the data server for storage. Thus, the file export device can directly obtain relevant files from the data server and will not be affected by the business server during the export process. This effectively reduces the file export time and improves the stability of file export.
[0007] According to a first aspect of the present disclosure, a file export method is provided, executed by a file export device, comprising: sending a second query request to a data server based on a first query request sent by a user equipment, wherein the second query request includes a service identifier and a region name information carried in the first query request; receiving a first file sent by the data server, wherein the first file includes a target record corresponding to the region name information, the target record originating from a target data information table corresponding to the service identifier, the target data information table being generated by the file export device using service data received from a service server and sent to the data server for storage; and sending the first file to the user equipment.
[0008] In some embodiments, the first file further includes field type information for each field in the target record, wherein sending the first file to the user equipment includes: converting the field type information of each field in the first file into the service type name of each field according to the mapping relationship corresponding to the service identifier, to obtain a second file; and sending the second file to the user equipment.
[0009] In some embodiments, the target record includes a region name field, an order identifier field, and an order business field, wherein the region name field includes the region name information, the order identifier field includes an order identifier, and the order business field includes order business information corresponding to the order identifier.
[0010] In some embodiments, when the business identifier is a first identifier, the order business information includes basic order information corresponding to the order identifier; the order business field includes at least one of a first order information subfield and a second order information subfield, wherein the first order information subfield includes product name information corresponding to the order identifier, and the second order information subfield includes purchaser information corresponding to the order identifier.
[0011] In some embodiments, when the business identifier is a second identifier, the order business information includes payment information corresponding to the order identifier; the order business field includes at least one of a first payment subfield and a second payment subfield, wherein the first payment subfield includes payment amount information corresponding to the order identifier, and the second payment subfield includes payment time information corresponding to the order identifier.
[0012] In some embodiments, the target record further includes a geolocation field, wherein the geolocation field includes geolocation information corresponding to the order identifier.
[0013] In some embodiments, multiple data information tables are generated using the business data in the business server; the multiple data information tables are stored in the data server.
[0014] In some embodiments, generating the plurality of data information tables includes: extracting a Geographic Information System (GIS) information table and an i-th order business table corresponding to the i-th business identifier from the business server, where 1 ≤ i ≤ K, and K is the total number of business identifiers; merging records with the same order identifier in the GIS information table and the i-th order business table to generate the i-th data information table.
[0015] In some embodiments, generating the plurality of data information tables includes: converting the business type name of each field in each record of the i-th data information table into field type information according to the mapping relationship corresponding to the i-th business identifier.
[0016] In some embodiments, merging records with the same order identifier in the GIS information table and the i-th order business table includes: when the m-th record in the GIS information table and the n-th record in the i-th order business table have the same order identifier, merging the m-th record and the n-th record to form a single record in the i-th data information table, where 1≤m,n≤N, and N is the total number of records.
[0017] In some embodiments, the GIS information table includes multiple records, each of which includes a first field and a second field, wherein the first field includes an order identifier, and the second field includes region name information corresponding to the order identifier included in the first sub-segment; each record also includes a third field, wherein the third field includes geographic location information corresponding to the order identifier included in the first sub-segment.
[0018] In some embodiments, the i-th order business table includes multiple records, each of the multiple records including a fourth field and a fifth field, wherein the fourth field includes an order identifier, and the fifth field includes order business information corresponding to the order identifier included in the fourth field.
[0019] In some embodiments, when the i-th business identifier is a first identifier, the order business information includes basic order information corresponding to the order identifier included in the fourth sub-segment; the fifth field includes at least one of a first sub-field and a second sub-field, wherein the first sub-field includes product name information corresponding to the order identifier, and the second sub-field includes purchaser information corresponding to the order identifier.
[0020] In some embodiments, when the i-th business identifier is a second identifier, the order business information includes payment information corresponding to the order identifier included in the fourth sub-field; the fifth field includes at least one of a third sub-field and a fourth sub-field, wherein the third sub-field includes payment amount information corresponding to the order identifier, and the fourth sub-field includes payment time information corresponding to the order identifier.
[0021] In some embodiments, the business data in the business server is used to update multiple data information tables in the data server; the updating of the multiple data information tables in the data server includes: when incremental data appears in the business server, merging the incremental GIS record in the incremental data and the incremental order business record corresponding to the i-th business identifier to obtain the incremental record of the i-th data information table, 1≤i≤K, where K is the total number of business identifiers; adding the incremental record to the i-th data information table to update the i-th data information table.
[0022] According to a second aspect of the present disclosure, a file export apparatus is provided, comprising: a memory configured to store instructions; and a processor coupled to the memory, the processor being configured to execute instructions stored in the memory to implement the method as described in any of the foregoing embodiments.
[0023] According to a third aspect of the present disclosure, a file export system is provided, comprising: a file export apparatus as described in any of the above embodiments; a data server configured to, according to a second query request sent by the file export apparatus, extract a target record corresponding to the region name information from a target data information table corresponding to the business identifier, generate a first file according to the target record, and send the first file to the file export apparatus; and a business server configured to provide business data to the file export apparatus.
[0024] In some embodiments, the data server is configured to create a pending information table, add the target record to the pending information table, and add field type information of each field in the target record to the pending information table to generate the first file.
[0025] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions that, when executed by a processor, implement the method as described in any of the above embodiments.
[0026] According to a fifth aspect of the present disclosure, a computer program product is provided, including computer instructions, wherein the computer instructions, when executed by a processor, implement the method as described in any of the above embodiments.
[0027] Other features and advantages of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description
[0028] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0029] Figure 1 This is a schematic diagram of a file export system according to an embodiment of the prior art;
[0030] Figure 2 This is a schematic flowchart of a file export method according to an embodiment of the present disclosure;
[0031] Figure 3 This is a schematic flowchart of a data information table processing method according to an embodiment of the present disclosure;
[0032] Figure 4 This is a schematic diagram of the structure of a file export device according to an embodiment of the present disclosure;
[0033] Figure 5 This is a schematic diagram of the structure of a file export system according to an embodiment of the present disclosure;
[0034] Figure 6 This is a schematic diagram of the structure of a file export system according to another embodiment of the present disclosure. Detailed Implementation
[0035] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit this disclosure or its application or use. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.
[0036] Unless otherwise specifically stated, the relative arrangement, numerical expressions, and values of the components and steps set forth in these embodiments do not limit the scope of this disclosure.
[0037] At the same time, it should be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not drawn according to actual scale.
[0038] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.
[0039] In all examples shown and discussed herein, any specific values should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.
[0040] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.
[0041] Figure 1 This is a schematic diagram of a file export system according to an embodiment of the prior art. Figure 1 As shown, a user sends a query request to the e-commerce business server 12 via user device 11 to retrieve order information for District X in City A. Business server 12 first retrieves the order identifier for District X in City A from database 13. Next, business server 12 retrieves the order information associated with the aforementioned order identifier from order server 14. Then, business server 12 assembles the retrieved order information and generates a file in a predetermined format (e.g., an Excel file) based on the assembled data. Business server 12 then sends the generated file to user device 14.
[0042] exist Figure 1 In the file export system shown, the business server 12 needs to interact with the database 13 and the order server 14 respectively, and also needs to assemble the acquired order information. Therefore, this method takes a long time, involves a large amount of data processing, and is easily affected by server failures or server restarts, thereby reducing the stability of file export.
[0043] Accordingly, this disclosure provides a file export scheme. By setting up a file export device between the business server and the data server, the file export device uses the business data in the business server to generate a data information table and sends it to the data server for storage. Thus, the file export device can directly obtain relevant files from the data server and will not be affected by the business server during the export process. This effectively reduces the file export time and improves the stability of file export.
[0044] Figure 2 This is a schematic flowchart of a file export method according to an embodiment of the present disclosure. In some embodiments, the following file export method is performed by a file export device, including steps 201-203.
[0045] In step 201, based on the first query request sent by the user equipment, a second query request is sent to the data server, wherein the second query request includes the service identifier and region name information carried in the first query request.
[0046] For example, if the business identifier included in the first query request is order_gis and the area name information is City A, District X, it indicates that the user wants to query the basic order information related to City A, District X, that is, the basic order information where the delivery address is located in City A, District X, such as the product name, the buyer's name, etc.
[0047] For example, if the business identifier included in the first query request is pay_gis and the area name information is City A, District Y, it indicates that the user wants to query order payment information related to City A, District Y, that is, order payment information with the delivery address located in City A, District X, such as payment amount, payment time, etc.
[0048] In step 202, the first file sent by the data server is received.
[0049] It should be noted that the first file includes target records corresponding to the region name information. These target records originate from the target data information table corresponding to the business identifier. The target data information table is generated by the file export device using business data received from the business server and then sent to the data server for storage.
[0050] For example, if the business identifier is order_gis, the target data information table corresponding to the business identifier order_gis in the data server is shown in Table 1.
[0051]
[0052] Table 1
[0053] Table 1 above is the target data information table corresponding to the business identifier order_gis. As shown in Table 1, each record in the target data information table includes region name information, latitude and longitude information, product name, and purchaser name. For example, the latitude and longitude information here can be the latitude and longitude information of the order delivery address.
[0054] For example, if the business identifier is pay_gis, the target data information table corresponding to the business identifier pay_gis in the data server is shown in Table 2.
[0055]
[0056] Table 2
[0057] Table 2 above is the target data information table corresponding to the business identifier pay_gis. As shown in Table 2, each record in the target data information table includes region name information, latitude and longitude information, payment amount, and payment time. For example, the latitude and longitude information here could be the latitude and longitude information of the order delivery address.
[0058] It's important to note that, to achieve logical isolation between different business data, each field in the data information table is defined using its corresponding data type, rather than by its business type name; a generalized data format is used. For example, in Table 1 and Table 2, fields are defined as int (integer), double (double-precision floating-point), and string (string), respectively. Of course, more data type information can be used to define fields as needed.
[0059] In some embodiments, the data server, based on a second query request sent by the file export device, extracts the target record corresponding to the region name information from the target data information table corresponding to the business identifier, and generates a first file based on the target record. The data server then sends the first file to the file export device.
[0060] For example, if the business identifier is order_gis and the area name information is City A, District Y, then the data server will extract two records including "City A, District Y" from the target data information table as shown in Table 1 to generate the first file, as shown in Table 3.
[0061]
[0062] Table 3
[0063] Table 3 above is the first file corresponding to the business identifier order_gis.
[0064] For example, if the business identifier is pay_gis and the area name information is City A, District Y, then the data server will extract two records containing "City A, District Y" from the target data information table shown in Table 2 to generate the first file, as shown in Table 4.
[0065]
[0066] Table 4
[0067] Table 4 above is the first file corresponding to the business identifier pay_gis.
[0068] In some embodiments, the target record includes a region name field, an order identifier field, and an order business field, wherein the region name field includes region name information, the order identifier field includes an order identifier, and the order business field includes order business information corresponding to the order identifier.
[0069] In some embodiments, when the business identifier is a first identifier, the order business field includes basic order information corresponding to the order identifier. For example, the basic order information includes product name information, purchaser information, etc.
[0070] For example, the order business field includes at least one of a first order information subfield and a second order information subfield, wherein the first order information subfield includes product name information corresponding to the order identifier, and the second order information subfield includes purchaser information corresponding to the order identifier.
[0071] For example, as shown in Table 3, in the first file corresponding to the business identifier order_gis, the first record includes multiple fields, including the area name field including the area name "City A, District Y", the order identifier field including the identifier information "2", the first order information subfield including the product name "biscuit", and the second order information subfield including the purchaser information "Li Si".
[0072] In some embodiments, when the business identifier is a second identifier, the order business field includes payment information corresponding to the order identifier. For example, the payment information includes payment amount information, payment time information, etc.
[0073] For example, the order business field includes at least one of a first payment subfield and a second payment subfield, wherein the first payment subfield includes payment amount information corresponding to the order identifier, and the second payment subfield includes payment time information corresponding to the order identifier.
[0074] For example, as shown in Table 4, in the first file corresponding to the business identifier pay_gis, the second record includes multiple fields, including the area name field including the area name "City A, District Y", the order identifier field including the identifier information "3", the first payment subfield including the payment amount "2000", and the second payment subfield including the payment time information "2021-01-01 11:10:01".
[0075] In some embodiments, the target record further includes a geolocation field, which includes geolocation information corresponding to the order identifier. For example, the address location information includes latitude and longitude information.
[0076] For example, as shown in Table 3, the first record includes two fields, which are used to include the dimension information "30.1919" and the longitude information "116.1919" of the order's delivery address.
[0077] For example, as shown in Table 4, the second record includes two fields, which are used to include the dimension information "30.1919" and the longitude information "116.1919" of the order's delivery address.
[0078] Figure 3 This is a schematic flowchart of a data information table processing method according to an embodiment of the present disclosure. In some embodiments, the following data information table processing method is executed by a file export device, including steps 301-302.
[0079] In step 301, multiple data information tables are generated using the business data in the business server.
[0080] In some embodiments, the step of generating multiple data information tables includes:
[0081] 1) Extract the Geographic Information System (GIS) information table and the i-th order business table corresponding to the i-th business identifier from the business server, where 1≤i≤K and K is the total number of business identifiers.
[0082] In some embodiments, the GIS information table includes multiple records, each of which includes a first field and a second field, wherein the first field includes an order identifier and the second field includes area name information corresponding to the order identifier included in the first subfield.
[0083] In some embodiments, each record in the GIS information table further includes a third field, wherein the third field includes geographic location information corresponding to the order identifier included in the first sub-segment.
[0084] For example, the GIS information table is shown in Table 5.
[0085] Data ID Order ID Region Name Dimension longitude 1 1 District X, City A 30.1818 116.1818 2 2 District Y, City A 30.1919 116.1919 3 3 District Y, City A 30.1919 116.1919
[0086] Table 5
[0087] Table 5 above is the GIS information table in the business server. From Table 5, we can see that the order with order ID 1 corresponds to the region name "City A, District X", and the latitude and longitude of the receiving address are "30.1818" and "116.1919". The order with order ID 2 corresponds to the region name "City A, District Y", and the latitude and longitude of the receiving address are "30.1919" and "116.1919". The order with order ID 3 corresponds to the region name "City A, District Y", and the latitude and longitude of the receiving address are "30.1919" and "116.1919".
[0088] In some embodiments, the order business table includes multiple records, each of which includes a fourth field and a fifth field, wherein the fourth field includes an order identifier and the fifth field includes order business information corresponding to the order identifier included in the fourth field.
[0089] In some embodiments, when the i-th business identifier is the first identifier, the fifth field includes basic order information corresponding to the order identifier included in the fourth sub-field. For example, the basic order information includes product name information, purchaser information, etc.
[0090] For example, the fifth field includes at least one of the first subfield and the second subfield, wherein the first subfield includes product name information corresponding to the order identifier, and the second subfield includes purchaser information corresponding to the order identifier.
[0091] For example, the order business table corresponding to the business identifier order_gis is shown in Table 6.
[0092] Order ID Product Name Buyer 1 bag Zhang San 2 biscuit Li Si 3 computer Li Si
[0093] Table 6
[0094] Table 6 above shows the order business table in the business server corresponding to the business identifier order_gis. From Table 6, we can see that the product name for order ID 1 is "backpack," and the buyer is "Zhang San." The product name for order ID 2 is "biscuits," and the buyer is "Li Si." The product name for order ID 3 is "computer," and the buyer is also "Li Si."
[0095] In some embodiments, when the i-th business identifier is the second identifier, the fifth field includes payment information corresponding to the order identifier included in the fourth sub-field. For example, the payment information includes payment amount information, payment time information, etc.
[0096] For example, the fifth field includes at least one of the third and fourth subfields, wherein the third subfield includes payment amount information corresponding to the order identifier, and the fourth subfield includes payment time information corresponding to the order identifier.
[0097] For example, the order business table corresponding to the business identifier pay_gis is shown in Table 7.
[0098] Data ID Order ID Payment amount Payment Time 1 1 10 2021-01-02 11:10:01 2 2 5 2021-01-03 11:10:01 3 3 2000 2021-01-01 11:10:01
[0099] Table 7
[0100] Table 7 above shows the order business table in the business server corresponding to the business identifier pay_gis. For example, from Table 7, we can see that the order with order ID 1 has a payment amount of "10" and a payment time of "2021-01-02 11:10:01". The order with order ID 2 has a payment amount of "5" and a payment time of "2021-01-03 11:10:01". The order with order ID 3 has a payment amount of "2000" and a payment time of "2021-01-01 11:10:01".
[0101] It should be noted that Tables 5 and 6 are used for subsequent processing of the business identifier `order_gis`, and Tables 5 and 7 are used for subsequent processing of the business identifier `pay_gis`.
[0102] 2) Merge the records with the same order identifier in the GIS information table and the i-th order business table to generate the i-th data information table.
[0103] In some embodiments, if the m-th record in the GIS information table and the n-th record in the i-th order business table have the same order identifier, the m-th record and the n-th record are merged to form a single record in the i-th data information table, where 1 ≤ m, n ≤ N, and N is the total number of records.
[0104] For example, for the business identifier order_gis, Tables 5 and 6 are used for subsequent processing. Since the order identifier of the first record in Table 5 and the first record in Table 6 are both 1, the first record in Table 5 and the first record in Table 6 are merged, and the merged result is shown in the first record of Table 8.
[0105]
[0106] Table 8
[0107] Table 8 above is the data information table corresponding to the business identifier order_gis. The first record in Table 8 includes the region name, shipping address (latitude and longitude), product name, and purchaser information for the order with order identifier 1. That is, the first record in Table 8 includes the information from the first record in Table 5 and the first record in Table 6.
[0108] The other records in Tables 5 and 6 are processed in the same way as described above to generate other records in the data information table corresponding to the business identifier order_gis, as shown in Table 8.
[0109] For example, for the business identifier pay_gis, Tables 5 and 7 are used for subsequent processing. Since the order identifier of the first record in Table 5 and the first record in Table 7 are both 1, the first record in Table 5 and the first record in Table 7 are merged, and the merged result is shown in the first record of Table 9.
[0110]
[0111] Table 9
[0112] Table 9 above is the data information table corresponding to the business identifier pay_gis. The first record in Table 9 includes the region name, shipping address latitude and longitude, payment amount, and payment time information for the order with order identifier 1. That is, the first record in Table 9 includes the information from the first record in Table 5 and the first record in Table 7.
[0113] The other records in Tables 5 and 7 are processed in the same way as described above to generate other records in the data information table corresponding to the business identifier pay_gis, as shown in Table 9.
[0114] In some embodiments, the business type name of each field in each record of the i-th data information table is converted into field type information according to the mapping relationship corresponding to the i-th business identifier.
[0115] It should be noted that, in order to achieve logical isolation of different business data, a generalized data format is adopted here. That is, in the data information table, each field is defined using the corresponding field type, rather than using the business type name.
[0116] For example, the mapping relationship corresponding to the business identifier order_gis is shown in Table 10.
[0117]
[0118] Table 10
[0119] Table 10 above is a mapping table corresponding to the business identifier order_gis. By using Table 10, the business type name of each field in Table 8 corresponding to the business identifier order_gis is converted into field type information, as shown in Table 11.
[0120]
[0121] Table 11
[0122] Table 11 above is a data information table corresponding to the business identifier order_gis, which is stored in the data server.
[0123] For example, the mapping relationship corresponding to the business identifier pay_gis is shown in Table 12.
[0124]
[0125] Table 12
[0126] Table 12 above is a mapping table corresponding to the business identifier pay_gis. Using Table 12, the business type name of each field in Table 13 corresponding to the business identifier pay_gis is converted into field type information, as shown in Table 13.
[0127]
[0128] Table 13
[0129] Table 13 above is a data information table corresponding to the business identifier pay_gis, which is stored in the data server.
[0130] It should be noted that the data information tables shown in Tables 11 and 13 are generated using all data from the historical database. Furthermore, updating multiple data information tables on the data server using business data from the business server can effectively reduce data processing overhead.
[0131] In some embodiments, when incremental data appears in the business server, the incremental GIS records and the incremental order business records corresponding to the i-th business identifier in the incremental data are merged to obtain the incremental records of the i-th data information table, where 1≤i≤K, and K is the total number of business identifiers. Next, the incremental records are added to the i-th data information table to update it.
[0132] For example, Table 11 is the data information table corresponding to the business identifier order_gis, and Table 13 is the data information table corresponding to the business identifier pay_gis. In the incremental data, the incremental GIS records are shown in Table 14, the incremental order business records corresponding to the business identifier order_gis are shown in Table 15, and the incremental order business records corresponding to the business identifier pay_gis are shown in Table 16.
[0133] Order ID Region Name Dimension longitude 4 District Z, City A 30.1819 116.1819
[0134] Table 14
[0135] Order ID Product Name Buyer 4 mouse Wang Wu
[0136] Table 15
[0137] Order ID Payment amount Payment Time 4 60 2021-01-04 10:10:01
[0138] Table 16
[0139] Table 14 above shows the incremental GIS records in the business server, Table 15 above shows the incremental order business records corresponding to the business identifier order_gis, and Table 16 above shows the incremental order business records corresponding to the business identifier pay_gis. By merging the contents of Tables 14 and 15 and adding the merged result to Table 11, the data information table corresponding to the business identifier order_gis is updated, as shown in Table 17.
[0140]
[0141] Table 17
[0142] Table 17 above is the updated data information table corresponding to the business identifier order_gis.
[0143] Furthermore, by merging the contents of Tables 14 and 16 and adding the merged result to Table 13, the data information table corresponding to the business identifier pay_gis is updated, such as...
[0144] As shown in Table 18.
[0145]
[0146] Table 18
[0147] Table 18 above is the updated data information table corresponding to the business identifier pay_gis.
[0148] In step 302, multiple data information tables are stored in the data server.
[0149] It should be noted that by storing multiple data information tables on the data server, the file export device can directly obtain the corresponding files from the data server. In this process, there is no need to interact with the business server, meaning that the file export process is not affected by the business server.
[0150] return Figure 2 In step 203, the first file is sent to the user equipment.
[0151] In some embodiments, the first file also includes field type information for each field in the target record.
[0152] For example, as shown in Table 3, the field type information for the field containing the region name information is string_1, the field type information for the field containing the product name information is string_2, the field type information for the field containing the purchaser information is string_3, the field type information for the field containing the latitude information is double_1, the field type information for the field containing the longitude information is double_2, and the field type information for the field containing the order ID is int_2.
[0153] For example, as shown in Table 4, the field type information for the field containing the region name information is string_1, the field type information for the field containing the payment amount information is double_3, the field type information for the field containing the payment time information is string_3, the field type information for the field containing the latitude information is double_1, the field type information for the field containing the longitude information is double_2, and the field type information for the field containing the order ID is int_2.
[0154] In some embodiments, based on the mapping relationship corresponding to the service identifier, the field type information of each field in the first file is converted into the service type name of each field to obtain the second file, and then the second file is sent to the user equipment.
[0155] For example, using the mapping relationship table corresponding to the business identifier order_gis shown in Table 10 above, the field type information of each field in Table 3 corresponding to the business identifier order_gis above is converted into the corresponding business type name, as shown in Table 19.
[0156] Business type Data ID Order ID latitude longitude Region Name Product Name Buyer order_gis 2 2 30.1919 116.1919 District Y, City A biscuit Li Si order_gis 3 3 30.1919 116.1919 District Y, City A computer Li Si
[0157] Table 19
[0158] Table 19 above is the second file corresponding to the business identifier order_gis.
[0159] For example, using the mapping relationship table corresponding to the business identifier pay_gis shown in Table 12 above, the field type information of each field in Table 4 corresponding to the business identifier pay_gis above can be converted into the corresponding business type name, as shown in Table 20.
[0160]
[0161] Table 20
[0162] Table 20 above is the second file corresponding to the business identifier pay_gis.
[0163] For example, the second file shown in Table 19 above is sent to the user's device so that the user can understand the basic order information in District Y of City A, including the product name, the buyer's name, and the latitude and longitude information of the delivery address.
[0164] For example, the second document shown in Table 20 above is sent to the user's device so that the user can understand the order payment information in District Y of City A, including the payment amount, payment time, and latitude and longitude information of the delivery address.
[0165] In the file export method provided in the above embodiments of this disclosure, a file export device is set up between the business server and the data server. The file export device uses the business data in the business server to generate a data information table and sends it to the data server for storage. Thus, the file export device can directly obtain relevant files from the data server and will not be affected by the business server during the export process. This effectively reduces the file export time and improves the stability of file export.
[0166] It should also be noted that in the file export method provided in the above embodiments, the file export behavior is isolated from ordinary business behavior, meaning that the file export behavior does not affect ordinary business behavior. In this case, only the hardware resources of the business service need to be configured according to the traffic of the business behavior, thereby avoiding redundant configuration of a large amount of hardware resources to support the file export behavior and effectively reducing hardware costs.
[0167] In some embodiments, the file export device is monitored in real time to ensure it is functioning properly. If the file export device malfunctions, such as a spike in CPU usage or a near 100% memory usage rate, an alarm is triggered, and relevant personnel are notified to promptly resolve the issue.
[0168] Figure 4 This is a schematic diagram of the structure of a file export device according to an embodiment of the present disclosure.
[0169] like Figure 4 As shown, the file export device 40 can be represented in the form of a general computing device. The file export device 40 includes a memory 41, a processor 42, and a bus 43 connecting different system components.
[0170] The memory 41 may include, for example, system memory, non-volatile storage media, etc. The system memory may store, for example, an operating system, application programs, a boot loader, and other programs. The system memory may include volatile storage media, such as random access memory (RAM) and / or cache memory. The non-volatile storage media may store, for example, instructions for a corresponding embodiment of at least one control method for an electric air pump being executed. Non-volatile storage media include, but are not limited to, disk storage, optical storage, flash memory, etc.
[0171] Processor 42 can be implemented using a general-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA) or other programmable logic devices, discrete hardware components such as discrete gates or transistors. Accordingly, each module, such as the acquisition module, calculation module, and adjustment module, can be implemented by executing instructions in the central processing unit (CPU) memory to perform the corresponding steps, or by implementing dedicated circuitry to perform the corresponding steps.
[0172] Bus 43 can use any of the various bus architectures. For example, bus architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MCA) bus, and the Peripheral Component Interconnect (PCI) bus.
[0173] The interfaces 44, 45, and 46 of the file export device 40, as well as the memory 41 and processor 42, can be connected via bus 43. Input / output interface 44 provides a connection interface for input / output devices such as monitors, mice, and keyboards. Network interface 45 provides a connection interface for various networked devices. Storage interface 46 provides a connection interface for external storage devices such as floppy disks, USB flash drives, and SD cards.
[0174] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus, and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations thereof, can be implemented by computer-readable program instructions.
[0175] These computer-readable program instructions are provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable device to produce a machine, such that execution of the instructions by the processor produces means for implementing the functions specified in one or more boxes of the flowchart and / or block diagram.
[0176] These computer-readable program instructions may also be stored in a computer-readable storage medium. These instructions cause a computer to work in a particular manner to produce an article of manufacture, including instructions that implement the functions specified in one or more boxes in a flowchart and / or block diagram.
[0177] This disclosure may take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects.
[0178] Figure 5 This is a schematic diagram of the structure of a file export system according to an embodiment of this disclosure. Figure 5 As shown, the file export system includes a file export device 51, a data server 52, and a business server 53. The file export device 51 is... Figure 4 The file export device involved in any of the embodiments.
[0179] Based on the first query request sent by the user equipment, the file export device 51 sends a second query request to the data server 52, wherein the second query request includes the service identifier and region name information carried in the first query request. The file export device 51 receives the first file sent by the data server 52 and sends the first file to the user equipment.
[0180] The data server 52 is configured to extract the target record corresponding to the area name information from the target data information table corresponding to the business identifier according to the second query request sent by the file export device 51, generate a first file according to the target record, and send the first file to the file export device 51.
[0181] In some embodiments, the data server 52 is configured to create a pending information table, add target records to the pending information table, and add field type information of each field in the target records to the pending information table to generate a first file.
[0182] The business server 53 is configured to provide business data to the file export device 51.
[0183] Figure 6 This is a schematic diagram of the structure of a file export system according to an embodiment of the present disclosure.
[0184] like Figure 6 As shown, the file export device includes a file export module and a data processing module. The file export module is used to export the corresponding files from the data server, and the data processing module is used to generate a data information table based on the business data from the business server and send the data information table to the data processing module for storage.
[0185] The business server provides corresponding business services, such as business service A, business service B, and business service C. The business server can provide all business data to the data processing module, or it can provide incremental data from the business data. For example, the business server stores incremental data in a Message Queue (MQ), and the data processing module retrieves the incremental data from the business server by listening for MQ messages.
[0186] The file export module, based on the first query request sent by the user equipment, sends a second query request to the data server. The second query request includes the service identifier and region name information carried in the first query request. Based on the second query request, the data server extracts the target record corresponding to the region name information from the target data information table corresponding to the service identifier, generates a relevant file based on the target record, and sends this file to the file export module. The file export module then sends this file to the user equipment.
[0187] For example, a user sends a first query request to the file export module through the user's device, where the query request includes: biz_type: order_gis, area_name: City A, District X, and filter method: equal to.
[0188] The field information included in the first query request is shown in Table 21.
[0189] Field value Field Description order_gis Business identifier (biz_type) area_name Filter fields District X, City A Filter value equal Filter
[0190] Table 21
[0191] Table 21 above shows the field information in the first query request. The file export module sends a second query request to the data server, which includes the business identifier order_gis and the area name information "City A, District X".
[0192] For example, the data information table stored in the data server at this time, corresponding to the business identifier order_gis, is shown in Table 1 above.
[0193] The data server adds one record containing "City A, District X" to the pending information table from the target data information table shown in Table 1, and also adds the field type information of each field in Table 1 to the pending information table. The first file generated is shown in Table 22.
[0194]
[0195] Table 22
[0196] Table 22 above shows the first file sent by the data server to the file export module. Using the mapping relationship shown in Table 10 above, the file export module converts the field type information of each field in Table 22 into the corresponding business type name, generating the second file as shown in Table 23.
[0197] Business type Data ID Order ID latitude longitude Region Name Product Name Buyer order_gis 1 1 30.1818 116.1818 District X, City A bag Zhang San
[0198] Table 23
[0199] Table 23 above shows the second file generated by the file export module. Next, the file export module sends the second file, as shown in Table 23, to the user device. The user device displays this second file so that the user can understand the order information corresponding to the business identifier order_gis.
[0200] For example, a user sends a first query request to the file export module through the user's device. The query request includes: biz_type: pay_gis, area_name: City A, District X, and filter method: equal to.
[0201] The field information included in the first query request is shown in Table 24.
[0202] Field value Field Description pay_gis Business identifier (biz_type) area_name Filter fields District X, City A Filter value equal Filter
[0203] Table 24
[0204] Table 24 above shows the field information in the first query request. The file export module sends a second query request to the data server, which includes the business identifier pay_gis and the area name information "City A, District X".
[0205] For example, the data information table stored in the data server at this time, corresponding to the business identifier pay_gis, is shown in Table 2 above.
[0206] The data server adds one record containing "City A, District X" to the pending information table from the target data information table shown in Table 2, and also adds the field type information of each field in Table 2 to the pending information table. The first file generated is shown in Table 25.
[0207]
[0208] Table 25
[0209] Table 25 above shows the first file sent by the data server to the file export module. Using the mapping relationship shown in Table 12 above, the file export module converts the field type information of each field in Table 25 into the corresponding business type name, generating the second file as shown in Table 26.
[0210]
[0211] Table 26
[0212] Table 26 above shows the second file generated by the file export module. Next, the file export module sends the second file, as shown in Table 26, to the user device. The user device displays this second file so that the user can understand the order information corresponding to the business identifier pay_gis.
[0213] In some embodiments, the functional modules described above may be implemented as general-purpose processors, programmable logic controllers (PLCs), digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or any suitable combination thereof for performing the functions described herein.
[0214] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.
[0215] The description in this disclosure is provided for illustrative and descriptive purposes only and is not intended to be exhaustive or to limit the disclosure to its forms. Many modifications and variations will be apparent to those skilled in the art. The embodiments were chosen and described in order to better illustrate the principles and practical application of this disclosure and to enable those skilled in the art to understand this disclosure and to design various embodiments with various modifications suitable for a particular purpose.
Claims
1. A file export method, executed by a file export device, comprising: Based on the first query request sent by the user equipment, a second query request is sent to the data server, wherein the second query request includes the service identifier and region name information carried in the first query request; The system receives a first file sent by the data server, wherein the first file includes a target record corresponding to the region name information, the target record originating from a target data information table corresponding to the business identifier, and the target data information table being generated by the file export device using business data received from the business server and sent to the data server for storage. The first file is sent to the user equipment.
2. The file export method according to claim 1, wherein, The first file also includes field type information for each field in the target record, wherein sending the first file to the user device includes: Based on the mapping relationship corresponding to the business identifier, the field type information of each field in the first file is converted into the business type name of each field to obtain the second file; The second file is sent to the user equipment.
3. The file export method according to claim 1, wherein, The target record includes a region name field, an order identifier field, and an order business field, wherein the region name field includes the region name information, the order identifier field includes the order identifier, and the order business field includes the order business information corresponding to the order identifier.
4. The file export method according to claim 3, wherein, When the business identifier is a first identifier, the order business information includes the basic order information corresponding to the order identifier; The order business field includes at least one of a first order information subfield and a second order information subfield, wherein the first order information subfield includes product name information corresponding to the order identifier, and the second order information subfield includes purchaser information corresponding to the order identifier.
5. The file export method according to claim 3, wherein, When the business identifier is the second identifier, the order business information includes payment information corresponding to the order identifier; The order business field includes at least one of a first payment subfield and a second payment subfield, wherein the first payment subfield includes payment amount information corresponding to the order identifier, and the second payment subfield includes payment time information corresponding to the order identifier.
6. The file export method according to claim 3, wherein, The target record also includes a geolocation field, wherein the geolocation field includes geolocation information corresponding to the order identifier.
7. The file export method according to any one of claims 1-6 further includes: Multiple data information tables are generated using the business data in the business server; The multiple data information tables are stored in the data server.
8. The file export method according to claim 7, wherein, The generation of the plurality of data information tables includes: Extract the Geographic Information System (GIS) information table and the i-th order business table corresponding to the i-th business identifier from the business server, where 1≤i≤K and K is the total number of business identifiers; The records with the same order identifier in the GIS information table and the i-th order business table are merged to generate the i-th data information table.
9. The file export method according to claim 8, wherein, The generation of the plurality of data information tables includes: Based on the mapping relationship corresponding to the i-th business identifier, the business type name of each field in each record of the i-th data information table is converted into field type information.
10. The file export method according to claim 8, wherein, Merging records with the same order identifier in the GIS information table and the i-th order business table includes: If the m-th record in the GIS information table and the n-th record in the i-th order business table have the same order identifier, the m-th record and the n-th record are merged to form a single record in the i-th data information table, where 1 ≤ m, n ≤ N, and N is the total number of records.
11. The file export method according to claim 8, wherein, The GIS information table includes multiple records, each of which includes a first field and a second field. The first field includes an order identifier, and the second field includes the region name information corresponding to the order identifier included in the first sub-field. Each record also includes a third field, wherein the third field includes geographic location information corresponding to the order identifier included in the first sub-segment.
12. The file export method according to claim 8, wherein, The i-th order business table includes multiple records. Each of the multiple records includes a fourth field and a fifth field, wherein the fourth field includes an order identifier, and the fifth field includes order business information corresponding to the order identifier included in the fourth field.
13. The file export method according to claim 12, wherein, When the i-th business identifier is the first identifier, the order business information includes basic order information corresponding to the order identifier included in the fourth sub-segment; The fifth field includes at least one of a first subfield and a second subfield, wherein the first subfield includes product name information corresponding to the order identifier, and the second subfield includes purchaser information corresponding to the order identifier.
14. The file export method according to claim 12, wherein, When the i-th business identifier is the second identifier, the order business information includes payment information corresponding to the order identifier included in the fourth sub-segment; The fifth field includes at least one of a third subfield and a fourth subfield, wherein the third subfield includes payment amount information corresponding to the order identifier, and the fourth subfield includes payment time information corresponding to the order identifier.
15. The file export method according to claim 7, further comprising: Update multiple data information tables in the data server using the business data in the business server; In the case of incremental data appearing in the business server, the incremental GIS record in the incremental data and the incremental order business record corresponding to the i-th business identifier are merged to obtain the incremental record of the i-th data information table, 1≤i≤K, where K is the total number of business identifiers; The incremental record is added to the i-th data information table to update the i-th data information table.
16. A file export device, comprising: The memory is configured to store instructions; A processor, coupled to a memory, configured to implement the method as described in any one of claims 1-15 based on memory-stored instruction execution.
17. A file export system, comprising: The file export device as described in claim 16; The data server is configured to extract the target record corresponding to the region name information from the target data information table corresponding to the business identifier according to the second query request sent by the file export device, generate a first file according to the target record, and send the first file to the file export device. A business server is configured to provide business data to the file export device.
18. The file export system according to claim 17, wherein, The data server is configured to create a pending information table, add the target record to the pending information table, and add the field type information of each field in the target record to the pending information table to generate the first file.
19. A computer-readable storage medium, wherein, A computer-readable storage medium stores computer instructions that, when executed by a processor, implement the method as described in any one of claims 1-15.
20. A computer program product comprising computer instructions, wherein the computer instructions, when executed by a processor, implement the method as described in any one of claims 1-15.
Citation Information
Patent Citations
Data exporting method, device and equipment and computer readable storage medium
CN112948474A
Order data indexing method and system, computer equipment and storage medium
CN113934713A
Data exporting method and device, computer equipment and readable storage medium
CN115203306A
Method, device and equipment for constructing online car-hailing real-time order wide table and storage medium thereof
CN117151059A
Modular feature extraction from parsed log data
US20200364585A1