Data collection system and method for government affair data sharing platform

Abstract

The invention discloses a data collection system and method for a government affair data sharing platform, belongs to the technical field of data sharing, and aims to solve the technical problem of how to efficiently, safely and reliably realize government affair data collection so as to improve government affair data sharing service. Comprising a user interaction module, a collection work order management module, a collection task management module, a collection task scheduling module, a collection task monitoring module, a data collection statistics module and a data collection report module. Data cleaning, data verification and format conversion operation are carried out through preprocessing, data conforming to a preset form is obtained, and it is ensured that the collected data has high consistency and accuracy.

Description

Technical Field

[0001] The present invention relates to the technical field of data sharing, and specifically to a data collection system and method for a government data sharing platform. Background Art

[0002] The existing government data sharing and open platform has problems in data collection and management, such as low efficiency, poor data consistency, difficulty in ensuring data security, and insufficient data utilization, which seriously restricts the effective use of government data resources and affects the quality and efficiency of government services.

[0003] How to efficiently, securely and reliably collect government data to improve government data sharing services is a technical problem that needs to be solved. Summary of the invention

[0004] The technical task of the present invention is to address the above shortcomings and provide a data collection system and method for a government data sharing platform to solve the technical problem of how to efficiently, safely and reliably realize government data collection to improve government data sharing services.

[0005] In a first aspect, the present invention provides a data collection system for a government data sharing platform, including a user interaction module, a collection work order management module, a collection task management module, a collection task scheduling module, a collection task monitoring module, a data collection statistics module, and a data collection report module;

[0006] The collection work order management module cooperates with the interactive interface to support authorized users to create collection work orders and edit work order information, and display the created collection work orders through the interactive interface, wherein the work order information includes basic information, data source and target source, and the basic information includes work order name, contact person and status;

[0007] The task management module cooperates with the interactive interface to support authorized users to select associated collection work orders to create collection tasks and configure data processing rules and task execution parameters. The data processing rules are used to perform data detection and preprocessing operations on the collected data to obtain data that conforms to a predetermined format. The preprocessing operations include data cleaning, data verification, and format conversion. The task execution parameters include task execution frequency, task triggering conditions, and task priority.

[0008] The collection task scheduling module is used to start and schedule the execution of the created task based on the task execution parameters, and update the status of the corresponding collection work order in real time, wherein, when executing the collection task, the data to be collected is obtained from the data source based on the collection work order, the collected data is processed according to the data processing rules to form data in a predetermined form, and the collected data is sent to the target source;

[0009] The collection task monitoring module is used to monitor the execution status and performance of the collection task, form task monitoring results, present the task monitoring results through an interactive interface, generate warning information based on the task monitoring results, and push the warning information to relevant contacts, wherein the task monitoring results include the running status, performance indicators and error bottlenecks of the collection task;

[0010] The data collection statistics module is used to statistically analyze the execution of the collection task and form data collection statistics results, which include the amount of successfully collected data, the amount of failed and abnormal data, and the success rate and efficiency of the collection task;

[0011] The data collection report module is used to form a collection task report based on the task monitoring results and the data collection statistical results, and to display the collection task report through an interactive interface, wherein the collection task report includes the progress, results and abnormal conditions of the collection task;

[0012] The user interaction module is used to provide a user-oriented interactive interface, support registration and login of users with different permissions through the interactive interface, support users with different permissions to query collection work orders, collection tasks, task monitoring results, data collection statistical results and data collection reports based on their permissions, and is used to exchange data with data sources and target sources through a unified interface.

[0013] Preferably, the collection work order management module cooperates with the interactive interface to support authorized users to batch create or import collection work orders and edit the work order information of the collection work orders;

[0014] The interactive interface displays the created collection work orders in the form of a list, and displays the created collection tasks in the form of a list.

[0015] Preferably, the data source in the work order information includes the IP address and port number of the source database, and correspondingly, the target source includes the IP address and port number of the target database, wherein the source database includes the database of the business system within the government data sharing platform and the database of the third-party business system.

[0016] Preferably, the collection task scheduling module cooperates with the interactive interface to support authorized users to customize scheduling rules. For each collection task, the scheduling rules support scheduled execution according to the task execution frequency or automatic start of the task execution according to the task triggering condition, and support the start of high-priority collection tasks;

[0017] For the created collection tasks, the collection task scheduling module is used to start the collection tasks based on the scheduling rules and according to the task execution parameters and schedule the execution order of the collection tasks.

[0018] Preferably, the data collection report module is used to analyze the amount of collected data, the processing time of the collection task, the success and failure records of the collection task, and the abnormal conditions during the execution of the collection task as the data collection log based on the task monitoring results and the data collection statistical results, and to perform quality assessment on the collected data, to build a data collection report based on the data collection log and the data quality assessment, and to provide solutions to the abnormal conditions during the execution of the task based on the predefined knowledge base;

[0019] There are multiple pieces of knowledge configured in the knowledge base, and each piece of knowledge includes abnormal situations in task execution and corresponding solutions.

[0020] In a second aspect, the present invention provides a data collection method for a government data sharing platform, which is used to implement data collection through a data collection system for a government data sharing platform as described in any one of the first aspects, and the method comprises the following steps:

[0021] Aggregation work order management: Users with permissions can create aggregation work orders and edit work order information. The created aggregation work orders are displayed through the interactive interface. The work order information includes basic information, data source and target source. The basic information includes work order name, contact person and status.

[0022] Collection task management: Authorized users select the associated collection work order to create a collection task and configure data processing rules and task execution parameters. The data processing rules are used to perform data detection and preprocessing operations on the collected data to obtain data that conforms to the predetermined format. The preprocessing operations include data cleaning, data verification, and format conversion. The task execution parameters include task execution frequency, task triggering conditions, and task priority.

[0023] Aggregation task scheduling: Start and schedule the execution of the created tasks based on the task execution parameters, and update the status of the corresponding aggregation work order in real time. When executing the aggregation task, the data to be aggregated is obtained from the data source based on the aggregation work order, and the aggregated data is processed according to the data processing rules to form data in a predetermined format, and the aggregated data is sent to the target source;

[0024] Collection task monitoring: monitor the execution status and performance of the collection task, form task monitoring results, present the task monitoring results through the interactive interface, generate warning information based on the task monitoring results, and push the warning information to relevant contacts. The task monitoring results include the running status, performance indicators and error bottlenecks of the collection task;

[0025] Data collection statistics: Statistical analysis of the execution of collection tasks to form data collection statistics. The data collection statistics include the amount of successfully collected data, the amount of failed and abnormal data, and the success rate and efficiency of the collection tasks.

[0026] Data collection report: A collection task report is generated based on the task monitoring results and data collection statistics, and is displayed through an interactive interface. The collection task report includes the progress, results, and abnormal conditions of the collection task.

[0027] User interaction: Users with different permissions can query permission-based work orders, tasks, task monitoring results, data collection statistics, and data collection reports, and exchange data with data sources and target sources through a unified interface.

[0028] Preferably, when executing the collection work order management, the authorized user batch creates or imports the collection work orders and edits the work order information of the collection work orders;

[0029] The interactive interface displays the created collection work orders in the form of a list, and displays the created collection tasks in the form of a list.

[0030] Preferably, the data source in the work order information includes the IP address and port number of the source database, and correspondingly, the target source includes the IP address and port number of the target database, wherein the source database includes the database of the business system within the government data sharing platform and the database of the third-party business system.

[0031] Preferably, when executing the collection task scheduling, the authorized user customizes the scheduling rules. For each collection task, the scheduling rules support the scheduled execution according to the task execution frequency or the automatic start of the task execution according to the task triggering condition, and support the start of high-priority collection tasks;

[0032] For the created collection tasks, the collection tasks are started based on the scheduling rules and according to the task execution parameters, and the execution order of the collection tasks is scheduled.

[0033] Preferably, when executing the data collection report, the amount of collected data, the processing time of the collection task, the success and failure records of the collection task, and the abnormal conditions during the execution of the collection task are analyzed based on the task monitoring results and the data collection statistical results as the data collection log, and the quality of the collected data is evaluated. A data collection report is constructed based on the data collection log and the data quality evaluation, and solutions are provided for abnormal conditions during the task execution based on the predefined knowledge base;

[0034] There are multiple pieces of knowledge configured in the knowledge base, and each piece of knowledge includes abnormal situations in task execution and corresponding solutions.

[0035] The data collection system and method for the government data sharing platform of the present invention have the following advantages:

[0036] 1. Improve data collection efficiency through collection task scheduling and collection task monitoring;

[0037] 2. Preprocess the collected data, perform data cleaning, data verification and format conversion through preprocessing to obtain data that conforms to the predetermined format, ensuring that the collected data has a high degree of consistency and accuracy;

[0038] 3. Collection work order management, collection task management, collection task scheduling, collection task monitoring, data collection statistics and data collection reports are all for users with relevant permissions, ensuring data security and effectively preventing data leakage and unauthorized access;

[0039] 4. The system interacts with users through an interactive interface and can exchange data internally and externally through a unified interface, improving data availability and sharing. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0041] The present invention is further described below in conjunction with the accompanying drawings.

[0042] Figure 1 This is a schematic diagram of a collection work order management interface in a data collection system for a government data sharing platform in Example 1;

[0043] Figure 2 This is a schematic diagram of a collection task scheduling interface in a data collection system for a government data sharing platform in Example 1;

[0044] Figure 3 This is a schematic diagram of a collection task monitoring interface in a data collection system for a government data sharing platform in Example 1;

[0045] Figure 4 This is a schematic diagram of a data collection and statistics interface in a data collection system for a government data sharing platform in Example 1;

[0046] Figure 5 This is a flowchart of a data collection method for a government data sharing platform in Example 2. DETAILED DESCRIPTION

[0047] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments so that those skilled in the art can better understand the present invention and implement it. However, the embodiments are not intended to limit the present invention. In the absence of conflict, the embodiments of the present invention and the technical features in the embodiments may be combined with each other.

[0048] The embodiments of the present invention provide a data collection system and method for a government data sharing platform, which are used to solve the technical problem of how to efficiently, safely and reliably realize government data collection to improve government data sharing services.

[0049] Embodiment 1:

[0050] The present invention provides a data collection system for a government data sharing platform, comprising a user interaction module, a collection work order management module, a collection task management module, a collection task scheduling module, a collection task monitoring module, a data collection statistics module and a data collection report module.

[0051] like Figure 1 As shown, the collection work order management module cooperates with the interactive interface to support authorized users to create collection work orders and edit work order information, and display the created collection work orders through the interactive interface, where the work order information includes basic information, data source and target source, and the basic information includes work order name, contact person and status.

[0052] In this embodiment, the collection work order management module cooperates with the interactive interface to support authorized users to batch create or import collection work orders and edit the work order information of the collection work orders. The interactive interface displays the created collection work orders in the form of a list. The data source in the work order information includes the IP address and port number of the source database, and correspondingly, the target source includes the IP address and port number of the target database, wherein the source database includes the database of the business system in the government data sharing platform and the database of the third-party business system.

[0053] The collection work order management module provides the creation of collection work orders and supports users to create collection work orders through the interface. Each work order can correspond to a specific data source or data type; it supports the priority setting of work orders to ensure the priority collection of key data; it provides user authority control to ensure the security of data collection; it supports the batch creation and import of work orders to improve work efficiency.

[0054] The task management module cooperates with the interactive interface to support authorized users to select associated collection work orders to create collection tasks and configure data processing rules and task execution parameters. The data processing rules are used to perform data detection and preprocessing operations on the collected data to obtain data that conforms to a predetermined format. Preprocessing operations include data cleaning, data verification, and format conversion. Task execution parameters include task execution frequency, task trigger conditions, and task priority.

[0055] In this embodiment, the interactive interface displays the created collection tasks in the form of a list. The collection task management module allows the user to configure the parameters of the data collection task, such as the source data location, target storage location, data format conversion rules, etc., to achieve the unification of the collected data.

[0056] like Figure 2 As shown, the collection task scheduling module is used to start and schedule the execution of the created tasks based on the task execution parameters, and update the status of the corresponding collection work order in real time. When executing the collection task, the data to be collected is obtained from the data source based on the collection work order, the collected data is processed according to the data processing rules to form data in a predetermined format, and the collected data is sent to the target source.

[0057] In this embodiment, the collection task scheduling module cooperates with the interactive interface to support authorized users to customize scheduling rules. For each collection task, the scheduling rules support scheduled execution according to the task execution frequency or automatic start of the task execution according to the task trigger conditions, and supports the start of high-priority collection tasks; for the created collection tasks, the collection task scheduling module is used to start the collection task based on the scheduling rules and according to the task execution parameters and schedule the execution order of the collection tasks.

[0058] The collection task scheduling module automatically schedules collection tasks according to preset rules, supports scheduled or event-triggered collection task scheduling, ensures timely update and collection of data, can handle data traffic during peak hours, and ensures system stability and response speed.

[0059] like Figure 3 As shown, the collection task monitoring module is used to monitor the execution status and performance of the collection task, form task monitoring results, present the task monitoring results through an interactive interface, generate warning information based on the task monitoring results, and push the warning information to relevant contacts, wherein the task monitoring results include the running status, performance indicators and error bottlenecks of the collection task.

[0060] The collection task monitoring module monitors the execution status and performance of the collection task in real time. It provides a real-time monitoring interface through an interactive interface to display the task's running status, performance indicators (such as processing speed, resource usage) and potential errors or bottlenecks. The monitoring system can automatically alarm so that timely intervention and problem solving can be carried out.

[0061] like Figure 4 As shown, the data collection statistics module is used to statistically analyze the execution of the collection task and form data collection statistics results. The data collection statistics results include the amount of successfully collected data, the amount of failed and abnormal data, and the success rate and efficiency of the collection task.

[0062] In this embodiment, the data collection statistics module counts the execution status of the collection task, including success, failure and exception statistics; provides statistical analysis functions for data collection, including the amount of successfully collected data, the number of failed and abnormal data records, and the success rate and efficiency of the collection task. The statistical results can be used to optimize the collection strategy and improve system performance.

[0063] The data collection report module is used to form a collection task report based on the task monitoring results and data collection statistical results, and to display the collection task report through an interactive interface, where the collection task report includes the progress, results and abnormal conditions of the collection task.

[0064] In this embodiment, the data collection report module is used to analyze the data volume of the collected data, the processing time of the collection task, the success and failure records of the collection task, and the abnormal situations during the execution of the collection task as the data collection log based on the task monitoring results and the data collection statistical results, and to perform quality assessment on the collected data, build a data collection report based on the data collection log and data quality assessment, and provide solutions to abnormal situations during the task execution based on a predefined knowledge base; wherein, the knowledge base is configured with multiple knowledge, each knowledge including abnormal situations in task execution and corresponding solutions.

[0065] The user interaction module is used to provide a user-oriented interactive interface. It supports registration and login of users with different permissions through the interactive interface. It supports users with different permissions to query collection work orders, collection tasks, task monitoring results, data collection statistical results and data collection reports based on their permissions. It is used to exchange data with data sources and target sources through a unified interface.

[0066] The user interaction module supports user login. It supports operations by users with relevant permissions for the services provided by the collection work order management module, collection task management module, collection task scheduling module, collection task monitoring module, data collection statistics module and data collection report module, thus ensuring data security.

[0067] The system of this embodiment realizes the efficient collection, accurate processing, secure storage and effective management of government data.

[0068] Embodiment 2:

[0069] The present invention provides a data collection method for a government data sharing platform, which realizes data collection through the system disclosed in Example 1, such as Figure 5 The seven steps shown include collection work order management, collection task management, collection task scheduling, collection task monitoring, data collection statistics, data collection report and user interaction.

[0070] Step S100: Collection work order management: authorized users create collection work orders and edit work order information, and display the created collection work orders through an interactive interface, where the work order information includes basic information, data source and target source, and the basic information includes work order name, contact person and status.

[0071] Step S100 of this embodiment supports authorized users to batch create or import collection work orders and edit the work order information of the collection work orders. The interactive interface displays the created collection work orders in the form of a list. The data source in the work order information includes the IP address and port number of the source database, and correspondingly, the target source includes the IP address and port number of the target database, wherein the source database includes the database of the business system in the government data sharing platform and the database of the third-party business system.

[0072] This step provides the creation of collection work orders, supports users to create collection work orders through the interface, and each work order can correspond to a specific data source or data type; supports the priority setting of work orders to ensure the priority collection of key data; provides user authority control to ensure the security of data collection; supports batch creation and import of work orders to improve work efficiency.

[0073] Step S200 Task Management: The authorized user selects the associated collection work order to create a collection task, and configures the data processing rules and task execution parameters. The data processing rules are used to perform data detection and preprocessing operations on the collected data to obtain data that conforms to a predetermined format. The preprocessing operations include data cleaning, data verification, and format conversion. The task execution parameters include task execution frequency, task trigger conditions, and task priority.

[0074] In this embodiment, the interactive interface displays the created collection tasks in the form of a list. The collection task management allows the user to configure the parameters of the data collection task, such as the source data location, target storage location, data format conversion rules, etc., to achieve the unification of the collected data.

[0075] Step S300: Scheduling the collection task: starting and scheduling the execution of the created task based on the task execution parameters, and updating the status of the corresponding collection work order in real time. When executing the collection task, the data to be collected is obtained from the data source based on the collection work order, and the collected data is processed according to the data processing rules to form data in a predetermined format, and the collected data is sent to the target source.

[0076] In this embodiment, step S300 supports customized scheduling rules for authorized users. For each collection task, the scheduling rules support scheduled execution according to the task execution frequency or automatic start of the execution task according to the task trigger conditions, and support the start of high-priority collection tasks; for the created collection tasks, the collection task scheduling module is used to start the collection tasks based on the scheduling rules and according to the task execution parameters and schedule the execution order of the collection tasks.

[0077] Step S400: Collection task monitoring: monitor the execution status and performance of the collection task, form task monitoring results, present the task monitoring results through an interactive interface, and generate warning information based on the task monitoring results, and push the warning information to relevant contacts, wherein the task monitoring results include the running status, performance indicators and error bottlenecks of the collection task.

[0078] Step S400 monitors the execution status and performance of the collection task, forms a task monitoring result, presents the task monitoring result through an interactive interface, generates warning information based on the task monitoring result, and pushes the warning information to relevant contacts, wherein the task monitoring result includes the running status, performance indicators and error bottlenecks of the collection task.

[0079] Step S500: Data collection statistics: Statistically analyze the execution of the collection task to form data collection statistics results, which include the amount of successfully collected data, the amount of failed and abnormal data, and the success rate and efficiency of the collection task.

[0080] This embodiment monitors the execution status and performance of the collection task in real time through step S500, and provides a real-time monitoring interface through an interactive interface to display the running status of the task, performance indicators (such as processing speed, resource usage) and potential errors or bottlenecks. The monitoring system can automatically alarm so as to intervene and solve the problem in time.

[0081] Step S600: Data collection report: A collection task report is formed based on the task monitoring results and the data collection statistical results, and the collection task report is displayed through an interactive interface, wherein the collection task report includes the progress, results and abnormal conditions of the collection task.

[0082] In this embodiment, step S600 counts the execution status of the collection task, including success, failure and exception statistics; provides statistical analysis of data collection, including the amount of successfully collected data, the number of failed and abnormal data records, and the success rate and efficiency of the collection task. The statistical results can be used to optimize the collection strategy and improve system performance.

[0083] Step S700: User interaction: Users with different permissions query work orders, tasks, task monitoring results, data collection statistics, and data collection reports based on permissions, and exchange data with data sources and target sources through a unified interface.

[0084] The method of this embodiment achieves efficient collection, accurate processing, secure storage and effective management of government data.

[0085] The present invention has been shown and described in detail above through the accompanying drawings and preferred embodiments. However, the present invention is not limited to these disclosed embodiments. Based on the above multiple embodiments, those skilled in the art can know that the means in the above different embodiments can be combined to obtain more embodiments of the present invention, and these embodiments are also within the protection scope of the present invention.

Claims

1. A data collection system for a government data sharing platform, characterized in that: It includes user interaction module, collection work order management module, collection task management module, collection task scheduling module, collection task monitoring module, data collection statistics module and data collection report module; The collection work order management module cooperates with the interactive interface to support authorized users to create collection work orders and edit work order information, and display the created collection work orders through the interactive interface, wherein the work order information includes basic information, data source and target source, and the basic information includes work order name, contact person and status; The task management module cooperates with the interactive interface to support authorized users to select associated collection work orders to create collection tasks and configure data processing rules and task execution parameters. The data processing rules are used to perform data detection and preprocessing operations on the collected data to obtain data that conforms to a predetermined format. The preprocessing operations include data cleaning, data verification, and format conversion. The task execution parameters include task execution frequency, task triggering conditions, and task priority. The collection task scheduling module is used to start and schedule the execution of the created task based on the task execution parameters, and update the status of the corresponding collection work order in real time, wherein, when executing the collection task, the data to be collected is obtained from the data source based on the collection work order, the collected data is processed according to the data processing rules to form data in a predetermined form, and the collected data is sent to the target source; The collection task monitoring module is used to monitor the execution status and performance of the collection task, form task monitoring results, present the task monitoring results through an interactive interface, generate warning information based on the task monitoring results, and push the warning information to relevant contacts, wherein the task monitoring results include the running status, performance indicators and error bottlenecks of the collection task; The data collection statistics module is used to statistically analyze the execution of the collection task and form data collection statistics results, which include the amount of successfully collected data, the amount of failed and abnormal data, and the success rate and efficiency of the collection task; The data collection report module is used to form a collection task report based on the task monitoring results and the data collection statistical results, and to display the collection task report through an interactive interface, wherein the collection task report includes the progress, results and abnormal conditions of the collection task; The user interaction module is used to provide a user-oriented interactive interface, support registration and login of users with different permissions through the interactive interface, support users with different permissions to query collection work orders, collection tasks, task monitoring results, data collection statistical results and data collection reports based on their permissions, and is used to exchange data with data sources and target sources through a unified interface.

2. The data collection system for the government data sharing platform according to claim 1 is characterized in that: The collection work order management module cooperates with the interactive interface to support authorized users to batch create or import collection work orders and edit the work order information of the collection work orders; The interactive interface displays the created collection work orders in the form of a list, and displays the created collection tasks in the form of a list.

3. The data collection system for the government data sharing platform according to claim 1 is characterized in that: The data source in the work order information includes the IP address and port number of the source database. Correspondingly, the target source includes the IP address and port number of the target database. The source database includes the database of the business system within the government data sharing platform and the database of the third-party business system.

4. The data collection system for the government data sharing platform according to claim 1 is characterized in that: The collection task scheduling module cooperates with the interactive interface to support authorized users to customize scheduling rules. For each collection task, the scheduling rules support scheduled execution according to the task execution frequency or automatic start of the task execution according to the task trigger condition, and support the start of high-priority collection tasks; For the created collection tasks, the collection task scheduling module is used to start the collection tasks based on the scheduling rules and according to the task execution parameters and schedule the execution order of the collection tasks.

5. The data collection system for the government data sharing platform according to claim 1 is characterized in that: The data collection report module is used to analyze the data volume of the collected data, the processing time of the collection task, the success and failure records of the collection task, and the abnormal conditions during the execution of the collection task as the data collection log based on the task monitoring results and the data collection statistical results, and to perform quality assessment on the collected data, build a data collection report based on the data collection log and data quality assessment, and provide solutions to abnormal conditions during the task execution based on the predefined knowledge base; There are multiple pieces of knowledge configured in the knowledge base, and each piece of knowledge includes abnormal situations in task execution and corresponding solutions.

6. A data collection method for a government data sharing platform, characterized in that: The method is used to realize data collection by a data collection system for a government data sharing platform according to any one of claims 1 to 5, and the method comprises the following steps: Aggregation work order management: Users with permissions can create aggregation work orders and edit work order information. The created aggregation work orders are displayed through the interactive interface. The work order information includes basic information, data source and target source. The basic information includes work order name, contact person and status. Collection task management: Authorized users select the associated collection work order to create a collection task and configure data processing rules and task execution parameters. The data processing rules are used to perform data detection and preprocessing operations on the collected data to obtain data that conforms to the predetermined format. The preprocessing operations include data cleaning, data verification, and format conversion. The task execution parameters include task execution frequency, task triggering conditions, and task priority. Aggregation task scheduling: Start and schedule the execution of the created tasks based on the task execution parameters, and update the status of the corresponding aggregation work order in real time. When executing the aggregation task, the data to be aggregated is obtained from the data source based on the aggregation work order, and the aggregated data is processed according to the data processing rules to form data in a predetermined format, and the aggregated data is sent to the target source; Collection task monitoring: monitor the execution status and performance of the collection task, form task monitoring results, present the task monitoring results through the interactive interface, generate warning information based on the task monitoring results, and push the warning information to relevant contacts. The task monitoring results include the running status, performance indicators and error bottlenecks of the collection task; Data collection statistics: Statistical analysis of the execution of collection tasks to form data collection statistics. The data collection statistics include the amount of successfully collected data, the amount of failed and abnormal data, and the success rate and efficiency of the collection tasks. Data collection report: A collection task report is generated based on the task monitoring results and data collection statistics, and is displayed through an interactive interface. The collection task report includes the progress, results, and abnormal conditions of the collection task. User interaction: Users with different permissions can query permission-based work orders, tasks, task monitoring results, data collection statistics, and data collection reports, and exchange data with data sources and target sources through a unified interface.

7. The data collection method for the government data sharing platform according to claim 7 is characterized in that: When performing the collection work order management, the authorized users can batch create or import the collection work orders and edit the work order information of the collection work orders; The interactive interface displays the created collection work orders in the form of a list, and displays the created collection tasks in the form of a list.

8. The data collection method for the government data sharing platform according to claim 7 is characterized in that: The data source in the work order information includes the IP address and port number of the source database. Correspondingly, the target source includes the IP address and port number of the target database. The source database includes the database of the business system within the government data sharing platform and the database of the third-party business system.

9. The data collection method for the government data sharing platform according to claim 6 is characterized in that: When executing the collection task scheduling, the authorized user customizes the scheduling rules. For each collection task, the scheduling rules support scheduled execution according to the task execution frequency or automatic start of the task execution according to the task trigger condition, and support the start of high-priority collection tasks; For the created collection tasks, the collection tasks are started based on the scheduling rules and according to the task execution parameters, and the execution order of the collection tasks is scheduled.

10. The data collection method for the government data sharing platform according to claim 6, characterized in that: When executing the data collection report, the data volume of the collected data, the processing time of the collection task, the success and failure records of the collection task, and the abnormal conditions during the execution of the collection task are analyzed based on the task monitoring results and data collection statistics as the data collection log, and the quality of the collected data is evaluated. The data collection report is constructed based on the data collection log and data quality evaluation, and solutions are provided for abnormal conditions during the task execution based on the predefined knowledge base; There are multiple pieces of knowledge configured in the knowledge base, and each piece of knowledge includes abnormal situations in task execution and corresponding solutions.

Images