A method, apparatus, and medium for data aggregation for a region

By constructing regional zoning tables and standard data table templates, the problem of low efficiency in grassroots data collection was solved, and unified standard collection of grassroots data was achieved, which improved data collection efficiency and reduced manual intervention.

CN117033476BActive Publication Date: 2026-03-17INSPUR ZHUOSHU BIG DATA IND DEV CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-08-02
Publication Date
2026-03-17

AI Technical Summary

Technical Problem

When higher-level units collect data from lower-level units, the inconsistency in their data standards leads to low data collection efficiency, requiring manual merging of each data point.

Method used

Construct regional division tables and standard data table templates. After identity verification, use the division codes to populate the basic data into the standard data table, generate the standard data table, and report it to the data collection party through the temporary data collection database. Provide add, modify, and query interfaces to avoid primary key conflicts.

Benefits of technology

It has achieved a unified standard for collecting grassroots data, which has improved data collection efficiency and reduced the workload of developers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117033476B_ABST
    Figure CN117033476B_ABST
Patent Text Reader

Abstract

The application discloses a data collection method and device for a region and a medium. The method comprises the following steps: obtaining an uploading request of a reporting party for basic data, calling a standard data table template and a regional division table associated with the reporting party according to the uploading request, searching a division code corresponding to the reporting party from the regional division table, and displaying the division code. The basic data uploaded by the reporting party is obtained, the basic data and the division code are filled into the standard data table template, and a standard data table of the reporting party is generated. The standard data table is output to a data collection temporary database of the reporting party, and the standard data table is reported to a collector through the data collection temporary database. By constructing the regional division table and the standard data table template, the basic data standard and the basic data attribution division unit are standardized, the basic data is collected according to the unified standard of the collector, and the data collection efficiency of the regional basic data is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to a method, device and medium for data collection in a region. Background Technology

[0002] Grassroots data governance is a complex and tedious task. Different units within a given governance area (the area to be collected) often have their own data governance systems, and their data governance practices vary, as do their respective business operations. When higher-level units conduct data statistical governance, they often need to collect grassroots data from lower-level units, such as population, housing, and vehicle data.

[0003] Currently, because each subordinate unit has its own data standards, the superior unit needs to manually merge the uploaded data one by one to obtain the aggregated data for the area to be aggregated that meets the requirements of the superior unit, resulting in low data aggregation efficiency for the area to be aggregated. Summary of the Invention

[0004] This application provides a method, device, and medium for data collection in a region, which addresses the problem of low data collection efficiency in the region to be collected.

[0005] The embodiments of this application adopt the following technical solutions:

[0006] On one hand, this application provides a data aggregation method for a region. The method includes: obtaining an upload request from a reporting party for grassroots data; calling a standard data table template and a regional division table associated with the reporting party based on the upload request; retrieving the division code corresponding to the reporting party from the regional division table and displaying the division code; obtaining the grassroots data uploaded by the reporting party; filling the grassroots data and the division code into the standard data table template to generate the standard data table of the reporting party; outputting the standard data table to the reporting party's temporary data aggregation database; and reporting the standard data table to the aggregator through the temporary data aggregation database.

[0007] In one example, after filling the basic data and the zoning code into the standard data table template to generate the standard data table of the reporting party, the method further includes: determining the primary key of the standard data table; retrieving the unique reporting code of the reporting party from the reporting code mapping table; concatenating the primary key value with the reporting code to obtain a concatenated string; and associating the concatenated string with the standard data table.

[0008] In one example, before invoking the standard data table template and regional division table associated with the reporting party according to the upload request, the method further includes: determining the unique identifier of the reporting party according to the upload request; verifying the identity of the reporting party according to the unique identifier; if the verification is successful, allowing the invocation of the standard data table template and regional division table associated with the reporting party; if the verification fails, sending a verification failure notification to the reporting party.

[0009] In one example, before obtaining the upload request for grassroots data from the reporting party, the method further includes: receiving the aggregation request from the aggregator; parsing the aggregation request to obtain the standard data table template and the regional division table for the area to be aggregated; generating a unique reporting code for each reporting party in the regional division table; and generating a mapping relationship table for the area to be aggregated based on the unique reporting code.

[0010] In one example, after reporting the standard data table to the aggregator through the temporary data aggregation database, the method further includes: receiving a aggregation request from the aggregator; aggregating the standard data tables of multiple reporting parties in the aggregator's database to obtain a summary standard data table for the region to be aggregated; generating a new / modify / query interface for the summary standard data table; and granting access permissions for the new / modify / query interface to the reporting party.

[0011] In one example, generating the add / modify / query interface for the summary standard data table specifically includes: generating interface parameters for the add / modify / query interface based on the primary key value of the standard data table of each reporting party; and associating the reporting code of each reporting party with the interface parameters to generate the add / modify / query interface for the summary standard table.

[0012] In one example, after generating the add / modify / query interface for the summary standard data table, the method further includes: receiving an incremental data synchronization request from the reporting party; verifying the primary key value of the add / modify / query interface according to the reporting code of the reporting party; if the verification is successful, allowing the reporting party to call the add / modify / query interface; if the verification fails, sending a primary key value verification failure notification message to the reporting party.

[0013] In one example, the step of reporting the standard data table to the aggregator through the temporary data aggregation database specifically includes: determining whether each reporting party in the region to be aggregated outputs its own standard data table to its own temporary data aggregation database; if so, triggering the reporting command for the region to be aggregated to report the standard data table in the temporary data aggregation database to the aggregator's database; if not, confirming that the reporting command for the region to be aggregated is not triggered.

[0014] On the other hand, embodiments of this application provide a data collection device for a region, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to: obtain an upload request from a reporting party for grassroots data; according to the upload request, call a standard data table template and a regional division table associated with the reporting party; retrieve the division code corresponding to the reporting party from the regional division table, and display the division code; obtain the grassroots data uploaded by the reporting party, fill the grassroots data and the division code into the standard data table template, and generate a standard data table for the reporting party; output the standard data table to the reporting party's temporary data collection database, and report the standard data table to the collector through the temporary data collection database.

[0015] On the other hand, embodiments of this application provide a non-volatile computer storage medium for regional data aggregation, storing computer-executable instructions. These computer-executable instructions are configured to: obtain an upload request from a reporting party for grassroots data; based on the upload request, invoke a standard data table template and a regional zoning table associated with the reporting party; retrieve the zoning code corresponding to the reporting party from the regional zoning table and display the zoning code; obtain the grassroots data uploaded by the reporting party; fill the grassroots data and the zoning code into the standard data table template to generate the reporting party's standard data table; output the standard data table to the reporting party's temporary data aggregation database; and report the standard data table to the aggregation party through the temporary data aggregation database.

[0016] The above-described technical solutions adopted in the embodiments of this application can achieve the following beneficial effects:

[0017] By constructing regional zoning tables and standard data table templates, the standards for grassroots data and the zoning units to which grassroots data belongs are standardized. This enables the collection of grassroots data according to a unified standard by the data collector, improving the efficiency of regional grassroots data collection and reducing the workload of developers. Attached Figure Description

[0018] To more clearly illustrate the technical solution of this application, some embodiments of this application will be described in detail below with reference to the accompanying drawings, in which:

[0019] Figure 1 A flowchart illustrating a method for data aggregation targeting a region, provided in an embodiment of this application;

[0020] Figure 2This is a schematic diagram of the structure of a data collection device for a region provided in an embodiment of this application. Detailed Implementation

[0021] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0022] Some embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0023] Figure 1 This is a flowchart illustrating a method for data aggregation targeting a region, provided as an embodiment of this application. Certain input parameters or intermediate results in this process can be manually adjusted to help improve accuracy.

[0024] The analysis method involved in the embodiments of this application can be implemented by a terminal device or a server, and this application does not impose any special limitations on it. For ease of understanding and description, the following embodiments are all described in detail using a server as an example.

[0025] It should be noted that the server can be a single device or a system composed of multiple devices, i.e., a distributed server. This application does not make any specific limitations on this.

[0026] Figure 1 The process may include the following steps:

[0027] S101: Obtain the upload request from the reporting party for grassroots data, and call the standard data table template and regional division table associated with the reporting party according to the upload request.

[0028] In some embodiments of this application, verification of the reporting party is required. First, a unique identifier for the reporting party is determined based on the upload request. Then, the reporting party is authenticated based on the unique identifier. If verification passes, the standard data table template and regional division table associated with the reporting party are allowed to be accessed. If verification fails, a verification failure notification is sent to the reporting party.

[0029] It should be noted that the unique identifier can be set according to actual needs. For example, the unique identifier can be the area code of the reporting party in the area division table. During identity verification, the verification is carried out based on the upload account and upload password pre-registered by the reporting party.

[0030] In some embodiments of this application, a data collection request from the aggregator must first be received before the data collection work of the reporting party can be initiated.

[0031] Based on this, firstly, the aggregation request is parsed. Then, the standard data table template and regional division table for the areas to be aggregated are obtained. Next, a unique reporting code is generated for each reporting party in the regional division table. Finally, based on the unique reporting codes, a mapping table for the areas to be aggregated is generated.

[0032] It should be noted that the standard data table template includes multiple fields of the standard data table.

[0033] The regional zoning table specifies the affiliation of basic-level data. It requires identifying the smallest administrative unit to which the basic-level data belongs; that is, in the regional zoning table, the smallest administrative unit to which the basic-level data belongs is the community. Furthermore, the regional zoning table is used to represent multiple regions that need to be aggregated within the area to be aggregated. Specifically, the regional zoning table includes the name of each sub-region that needs to perform the current aggregation task, as well as the zoning code for each sub-region.

[0034] The format of the reporting code can be set according to actual needs. For example, the reporting code can be three uppercase letters.

[0035] S102: Retrieve the zoning code corresponding to the reporting party from the zoning table, and display the zoning code.

[0036] S103: Obtain the grassroots data uploaded by the reporting party, fill the grassroots data and the zoning code into the standard data table template, and generate the standard data table of the reporting party.

[0037] The reporting party inputs the corresponding grassroots data according to the fields of the standard data table template.

[0038] In some embodiments of this application, after generating the standard data table, in order to avoid primary key conflicts between the standard data tables of multiple reporting parties when the primary key values ​​of the standard data tables are the same, the primary key and the reporting code are associated.

[0039] Specifically, first, the primary key of the standard data table is determined. Then, the unique reporting code of the reporting party is retrieved from the reporting code mapping table. Next, the primary key value and the reporting code are concatenated to obtain a concatenated string. Finally, the concatenated string is associated with the standard data table, so that the reporting party can subsequently look up its own standard data table in the aggregator's database and maintain the standard data table.

[0040] S104: Output the standard data table to the reporting party's temporary data collection database, and report the standard data table to the collecting party through the temporary data collection database.

[0041] Understandably, after the aggregator collects the basic data from each reporting party, since the primary key remains unchanged, the primary key value of each standard data table should be concatenated with the reporting code of each reporting party to avoid primary key conflicts.

[0042] In some embodiments of this application, the aggregator provides each reporting party with a corresponding temporary data aggregator database. The reporting party submits the organized data tables to its respective temporary data aggregator database. The aggregator checks the data and stores all the data in the aggregator's database.

[0043] Based on this, it is determined whether each reporting party in the area to be aggregated outputs its own standard data table to its own temporary data aggregation database.

[0044] If yes, then the reporting command for the area to be aggregated is triggered, and the standard data table of the temporary data aggregation database is reported to the aggregation party's database. If no, then it is confirmed that the reporting command for the area to be aggregated will not be triggered.

[0045] In some embodiments of this application, the incremental data synchronization phase adopts a real-time data interface, where the aggregator provides corresponding add, modify, and delete interfaces for each type of data, and the aggregator requests interface permissions from the reporting party.

[0046] Specifically, upon receiving a aggregation request from the aggregator, the aggregator's database aggregates the standard data tables from multiple reporting parties to obtain a summary standard data table for the region to be aggregated. Then, an add / modify / query interface is generated for the summary standard data table, and access permissions for this interface are granted to the reporting parties.

[0047] Furthermore, all types of data have interfaces for adding, modifying, and deleting data. The interface parameters should include the primary key value of the data, and the interface verifies the primary key value based on the reporting code of the reporting unit.

[0048] Based on this, when generating add / modify / query interfaces for the summary standard data table, interface parameters for the add / modify / query interfaces are generated according to the primary key value of the standard data table of each reporting party. Based on the interface parameters, the reporting code of each reporting party is associated with the interface parameters to generate the add / modify / query interfaces for the summary standard table.

[0049] Therefore, during the incremental data synchronization phase, the system first receives the incremental data synchronization request from the reporting party. Then, it verifies the primary key value of the add / modify / query interface based on the reporting code from the reporting party. If the verification is successful, the reporting party is allowed to call the add / modify / query interface. If the verification fails, a primary key value verification failure notification is sent to the reporting party.

[0050] Therefore, the data aggregator provides corresponding interfaces for adding, modifying, and deleting various types of data, and the reporting party can maintain the data through these interfaces. By providing data maintenance interfaces, it is convenient for each reporting party to maintain its own basic data in the future.

[0051] It should be noted that, although the embodiments in this application are based on... Figure 1 Steps S101 to S104 will be described sequentially, but this does not mean that steps S101 to S104 must be performed in a strict order. The reason this embodiment follows this order is... Figure 1 The order in which steps S101 to S104 are described is provided to facilitate understanding of the technical solutions of the embodiments of this application by those skilled in the art. In other words, in the embodiments of this application, the order of steps S101 to S104 can be appropriately adjusted according to actual needs.

[0052] pass Figure 1 The method, by constructing regional division tables and standard data table templates, standardizes the data standards at the grassroots level and the regional division units to which the grassroots data belongs. It enables the collection of grassroots data with a unified standard by the data collector, thereby improving the data collection efficiency of regional grassroots data and reducing the workload of developers.

[0053] Based on the same idea, some embodiments of this application also provide devices and non-volatile computer storage media corresponding to the above methods.

[0054] Figure 2 A schematic diagram of a data collection device for a region provided in this application embodiment includes:

[0055] At least one processor; and,

[0056] A memory communicatively connected to the at least one processor; wherein,

[0057] The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to:

[0058] Obtain the upload request from the reporting party for grassroots data, and based on the upload request, call the standard data table template and regional division table associated with the reporting party;

[0059] From the regional division table, retrieve the division code corresponding to the reporting party and display the division code;

[0060] Obtain the grassroots data uploaded by the reporting party, fill the grassroots data and the zoning code into the standard data table template, and generate the standard data table of the reporting party;

[0061] The standard data table is output to the temporary data collection database of the reporting party, and the standard data table is reported to the collection party.

[0062] Some embodiments of this application provide a non-volatile computer storage medium for regional data aggregation, storing computer-executable instructions configured as follows:

[0063] Obtain the upload request from the reporting party for grassroots data, and based on the upload request, call the standard data table template and regional division table associated with the reporting party;

[0064] From the regional division table, retrieve the division code corresponding to the reporting party and display the division code;

[0065] Obtain the grassroots data uploaded by the reporting party, fill the grassroots data and the zoning code into the standard data table template, and generate the standard data table of the reporting party;

[0066] The standard data table is output to the temporary data collection database of the reporting party, and the standard data table is reported to the collection party.

[0067] The various embodiments in this application are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device and medium embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the description of the method embodiments.

[0068] The devices and media provided in this application are one-to-one with the methods. Therefore, the devices and media also have similar beneficial technical effects as their corresponding methods. Since the beneficial technical effects of the methods have been described in detail above, the beneficial technical effects of the devices and media will not be repeated here.

[0069] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0070] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0071] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0072] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0073] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0074] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0075] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0076] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0077] The above description is merely an embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the technical principles of this application should fall within the protection scope of this application.

Claims

1. A method of data aggregation for a region, characterized by, The method comprises: Obtaining an uploading request of a reporting party for basic data, calling a standard data table template and a regional division table associated with the reporting party according to the uploading request; Retrieving a division code corresponding to the reporting party from the regional division table, and displaying the division code; Obtaining basic data uploaded by the reporting party, filling the basic data and the division code into the standard data table template, and generating a standard data table of the reporting party; Outputting the standard data table to a data collection temporary database of the reporting party, and reporting the standard data table to a collecting party through the data collection temporary database; After the basic data and the division code are filled into the standard data table template to generate the standard data table of the reporting party, the method further comprises: Determining the primary key of the standard data table; Retrieving the unique reporting code of the reporting party in the reporting code mapping relationship table; Splicing the primary key value and the reporting code to obtain a spliced string; Associating the spliced string with the standard data table; Reporting the standard data table in the data collection temporary database to the database of the collecting party by triggering the reporting command of the to-be-collected region; If not, it is confirmed that the reporting command of the to-be-collected region is not triggered; After the standard data table is reported to the collecting party through the data collection temporary database, the method further comprises: Receiving a summary request of the collecting party, summarizing the standard data tables of multiple reporting parties in the database of the collecting party to obtain a summary standard data table of the to-be-collected region; Generating a new change and query interface for the summary standard data table, and issuing access permission of the new change and query interface to the reporting party; Generating a new change and query interface for the summary standard data table, specifically comprising: Generating an interface parameter of the new change and query interface according to the primary key value of the standard data table of each reporting party; According to the interface parameter, the reporting code of each reporting party is associated with the interface parameter to generate the new change and query interface of the summary standard table; After the new change and query interface is generated for the summary standard data table, the method further comprises: Receiving an incremental data synchronization request of the reporting party; According to the reporting code of the reporting party, the primary key value of the new change and query interface is verified; If the verification is successful, the reporting party is allowed to call the new change and query interface; If the verification fails, the reporting party is sent a primary key value verification failure notification information. Before the standard data table template and the regional division table associated with the reporting party are called according to the uploading request, the method further comprises: According to the uploading request, determining the unique identifier of the reporting party; 2. The method of claim 1, wherein, According to the unique identifier, the identity of the reporting party is verified; If the verification is passed, the standard data table template and the regional division table associated with the reporting party are allowed to be called; ​ ​ If the verification fails, a verification failure notification is sent to the reporting party.

3. The method of claim 1, wherein, Before the reporting party uploads the basic data, the method further comprises: receiving a collection request from the collection party; parsing the collection request to obtain a standard data table template and a region table for the region to be collected; generating a unique reporting code for each reporting party in the region table; generating a mapping relationship table for the region to be collected according to the unique reporting code.

4. A data aggregation device for a region, characterized by, comprises: at least one processor; and a memory connected in communication with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the data collection method for the region according to any one of claims 1-3.

5. A non-transitory computer storage medium storing computer-executable instructions directed to data aggregation for a region, the computer-executable instructions comprising: The computer executable instructions are configured to execute the data collection method for the region according to any one of claims 1-3.

Citation Information

Patent Citations

  • Data collection management system, method and device, equipment and storage medium

    CN111538754A

  • Data acquisition method and device

    CN116009768A