A multitask automated processing and text structuring analysis system and method

Abstract

The application discloses a multitask automatic processing and text structural analysis system and method, and belongs to the technical field of data processing and automation execution. The system is optimized in view of the problems of low efficiency of existing unstructured text analysis, poor cross-platform automation universality, unstable multitask scheduling, and lack of unified standard for data flow. The system comprises four units of text structural analysis, task scheduling, cross-platform adaptive execution, and data standardization transfer. The unstructured text is analyzed into standard key-value pair data, and the data is checked and completed by the transfer unit. The multitask priority scheduling and abnormal control are completed by the task scheduling unit, the adaptive execution unit is connected to multiple platforms to realize automatic operation, and the units are cooperatively operated through standard interfaces. The application realizes automatic conversion of unstructured text to standardized execution process, improves multitask processing stability, universality and execution success rate, reduces manual dependence, and eliminates data error transmission.

Description

Technical Field

[0001] This invention relates to the field of data processing and automated execution technology, specifically to a multi-task automated processing and text structured parsing system and method. Background Technology

[0002] In real-world document processing scenarios involving multiple platforms and tasks, there is a large amount of unstructured text data. This type of data is characterized by inconsistent formats and scattered information. Manual parsing is not only extremely inefficient but also prone to high error rates due to human factors, failing to meet the needs of large-scale business processing.

[0003] Traditional automation tools are limited by differences in interface structure, field definitions, and interaction logic across different platforms, resulting in weak versatility and platform adaptability. They require customized development for a single platform, leading to high development costs and insufficient execution stability. Furthermore, the lack of a unified task scheduling mechanism during multi-task parallel processing easily leads to problems such as system resource contention, task execution timeouts, and process interruptions, further reducing the efficiency of automation.

[0004] Furthermore, there is a lack of standardized data interaction interfaces between text parsing results and automated execution processes. Parsed data cannot be directly used by automated execution processes, and there is no unified standard for data flow, making it difficult to form a stable closed loop of "text parsing-automated execution". The overall processing efficiency and reliability cannot meet the application needs of actual business. Summary of the Invention

[0005] To address the shortcomings of existing technologies, this invention provides a multi-task automated processing and text structured parsing system and method, which solves the technical problems of low efficiency in unstructured text parsing, poor cross-platform automated execution universality, unstable multi-task scheduling, and lack of standardization in data flow in existing technologies.

[0006] To achieve the above objectives, the present invention is implemented through the following technical solution: a multi-task automated processing and text structured parsing system, including a text structured parsing unit 1, a data standardization transfer unit 2, a task scheduling unit 3, and a cross-platform adapted execution unit 4. The units establish data connections through standardized data interfaces to realize sequential data interaction and collaborative work.

[0007] The text structuring parsing unit 1 has built-in preset field templates and feature matching rules, which are used to perform word segmentation, feature extraction, entity recognition and field mapping on unstructured text. Through template matching and feature recognition, unstructured documents are converted into standardized data with a unified key-value pair structure.

[0008] The task scheduling unit 3 adopts a queue layering mechanism and resource allocation mechanism to prioritize, control concurrency, monitor timeouts and retry exceptions for multiple types of tasks, allocate system resources to high-priority tasks first, and set a timeout rollback mechanism.

[0009] The cross-platform adaptation execution unit 4 is equipped with an interface element recognition module and a field mapping library, which are used to dynamically generate execution logic according to the interface structure and field rules of different platforms, and complete the automatic login, data filling and operation submission of the target platform without the need for customized development for a single platform.

[0010] The data standardization relay unit 2 is used to establish a unified data format, realize data exchange, verification and format conversion between text parsing results and automated execution process, verify, complete and encapsulate the parsed data, and directly output it as a data structure that can be called by automated execution.

[0011] Preferably, the core processing logic of the text structure parsing unit 1 is field template matching, keyword recognition and entity extraction, which can adapt to different types of unstructured document text parsing needs.

[0012] Preferably, the task scheduling unit 3 can flexibly configure task priority rules and concurrent processing quantity according to business needs to meet the task scheduling requirements of different scenarios.

[0013] Preferably, the field mapping library of the cross-platform adaptation execution unit 4 supports dynamic updates, and can add corresponding mapping rules in a timely manner according to the characteristics of the new platform, thereby improving the scalability of platform adaptation.

[0014] Preferably, the data standardization relay unit 2 is equipped with a data verification rule library, which can be configured with corresponding verification standards according to the needs of different business types to achieve accurate data verification and completion.

[0015] This invention also discloses a multi-task automated processing and text structured parsing method, applied to the aforementioned multi-task automated processing and text structured parsing system, comprising the following steps:

[0016] S1: Text structuring parsing unit 1 receives the input unstructured text, extracts text features and entity information through preset field template matching, keyword recognition and entity extraction, and converts the free text into standardized data with a unified key-value pair structure;

[0017] S2: Data standardization relay unit 2 receives standardized data output by text structure parsing unit 1, performs format verification, missing item completion and structure encapsulation according to preset verification rules, and outputs an execution data object that can be directly called by cross-platform adaptation execution unit 4;

[0018] S3: Task scheduling unit 3 receives external task requests, divides tasks according to task type and preset priority rules and allocates them to corresponding queues, controls the number of concurrent tasks according to resource allocation mechanism, monitors task execution status in real time, automatically retryes tasks with execution errors, and performs timeout rollback operations on tasks that have not been completed within the timeout period.

[0019] S4: Cross-platform adaptation execution unit 4 calls the corresponding platform mapping rules from the field mapping library according to the characteristics of the target platform, dynamically generates automated operation logic, and sequentially completes the automatic login of the target platform, the filling of execution data objects and the submission of business operation processes, and sends the execution results back to task scheduling unit 3, which updates the task execution status to realize the closed-loop flow of data.

[0020] Beneficial effects

[0021] 1. This invention achieves automatic structured parsing of unstructured text through a text structuring parsing unit, converting scattered, unformatted text into standardized key-value pairs, significantly reducing reliance on manual parsing, effectively improving parsing efficiency and reducing parsing error rate.

[0022] 2. The cross-platform adaptation execution unit of the present invention achieves dynamic adaptation to multiple platforms through interface element recognition and field mapping library, without the need for customized development for a single platform, which greatly improves the versatility and scalability of automated execution, while reducing the development and maintenance costs of automation tools.

[0023] 3. The task scheduling unit of this invention adopts a queue layering and resource allocation mechanism to realize unified scheduling and priority management of multiple tasks. Combined with timeout monitoring, abnormal retry and timeout rollback mechanisms, it effectively solves problems such as resource contention, execution timeout and process interruption, and improves the concurrent processing capability and execution success rate of multiple tasks.

[0024] 4. This invention establishes a unified data format and interaction standard through a data standardization transfer unit, realizes the verification, completion and encapsulation of parsed data, breaks down the data barrier between text parsing and automated execution, realizes closed-loop data flow, reduces duplicate entry and error propagation, and improves the stability and reliability of the overall processing flow.

[0025] 5. The various units of this invention work together through standardized data interfaces to achieve fully automated processing from unstructured text input to cross-platform automated execution, completing the automatic conversion of unstructured data into standardized execution processes, and significantly improving the overall work efficiency in multi-platform, multi-task document processing scenarios. Attached Figure Description

[0026] Figure 1This is a schematic diagram of the overall architecture of the system of the present invention, showing the composition of each unit and the data flow relationship;

[0027] Figure 2 This is a schematic diagram of the overall process of the method of the present invention, showing the steps of the method and the execution logic of each step;

[0028] Figure 3 This is a schematic diagram illustrating the specific process of cross-platform adaptation and execution of the present invention, showing the execution steps of cross-platform automated operation;

[0029] In the diagram, 1 is the text structure parsing unit; 2 is the data standardization transfer unit; 3 is the task scheduling unit; and 4 is the cross-platform adaptation execution unit. Detailed Implementation

[0030] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0031] Example:

[0032] Please see the appendix Figure 1 -Appendix Figure 3 This invention provides a multi-task automated processing and text structured parsing system and method. The system includes a text structured parsing unit 1, a data standardization transfer unit 2, a task scheduling unit 3, and a cross-platform adaptation execution unit 4. The units interact and collaborate with each other through standardized data interfaces, forming an automated processing closed loop of "text parsing - data processing - task scheduling - cross-platform execution".

[0033] In this embodiment, the text structuring parsing unit 1 has three types of preset field templates: government documents, business contracts, and general forms. It is also configured with a feature matching and entity recognition model based on natural language processing. After receiving unstructured government document text from external input, it first performs word segmentation on the text, extracts key feature information and entity information from the text, and then performs matching and field mapping through the government document field templates to convert the unstructured government document text into standardized data with a unified key-value pair structure. For example, information such as "applicant unit", "application item", and "application time" in the document are mapped to key-value pairs <applicant unit: XX company>, <application item: XX business processing>, and <application time: XXXX-XX-XX>.

[0034] After receiving the key-value pair standardized data output by the text structure parsing unit 1, the data standardization transfer unit 2 calls the verification rule library corresponding to the government business to perform format verification on the data. After detecting that the "application materials" field information is missing, it marks the missing items according to the preset rules and fills in the default prompt information. Then, it encapsulates the format of the verified complete data and generates an execution data object in JSON format. This data object can be directly called by the cross-platform adaptation execution unit 4.

[0035] After receiving external government affairs processing task requests, the task scheduling unit 3 classifies the tasks into three priorities: high, medium, and low, based on their urgency. In this embodiment, the task is a high-priority task, and the task scheduling unit 3 prioritizes allocating system resources to it. At the same time, it controls the number of concurrently executing tasks to 5 to avoid resource contention. The task scheduling unit 3 monitors the execution status of the task in real time. If an execution anomaly such as platform connection failure occurs, a retry mechanism is automatically triggered. If the retry fails after 3 attempts, execution is paused and an anomaly alert is issued. If the task execution time exceeds the preset 30-minute timeout threshold, a timeout rollback operation is performed to restore the system state before the task execution.

[0036] After receiving the execution instruction and JSON-formatted execution data object from the task scheduling unit 3, the cross-platform adaptation execution unit 4 identifies the target platform as the XX government service platform. It then calls the platform's interface elements and field mapping rules from the field mapping library to dynamically generate automated operation logic. First, it automatically logs into the XX government service platform using a preset account and password. Then, according to the mapping rules, it fills the information in the execution data object into the corresponding form fields of the platform. After filling, it automatically triggers the form submission operation to complete the automated processing of government affairs. After the processing is completed, it sends the platform's execution result (processing successful / processing failed + reason) back to the task scheduling unit 3. The task scheduling unit 3 updates the execution status of the task to "processing successful" and synchronizes the execution result to the external business system, realizing the closed-loop data flow of the entire process.

[0037] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A multi-task automated processing and text structure parsing system, characterized in that, It includes a text structured parsing unit, a data standardization transfer unit, a task scheduling unit, and a cross-platform adaptation execution unit that sequentially perform data interaction; The text structuring parsing unit is used to extract features from unstructured text, identify entities, and complete standardized data conversion. The task scheduling unit is used to prioritize tasks, control concurrency, monitor timeouts, and retry exceptions. The cross-platform adaptation execution unit is used to dynamically adapt to the interface structure and field rules of the target platform to complete automatic login, data filling and process submission operations. The data standardization relay unit is used to realize data conversion, interoperability and data processing in a unified format between various units.

2. The multi-task automated processing and text structure parsing system according to claim 1, characterized in that, The text structuring parsing unit has built-in preset field templates and feature matching rules. Through template matching and feature recognition, it converts unstructured documents into standardized data with a unified key-value pair structure.

3. The multi-task automated processing and text structured parsing system according to claim 1, characterized in that, The task scheduling unit adopts a queue hierarchical mechanism and a resource allocation mechanism, giving priority to allocating system resources to high-priority tasks, supporting multi-task parallel processing, and is equipped with a timeout rollback mechanism.

4. The multi-task automated processing and text structured parsing system according to claim 1, characterized in that, The cross-platform adaptation execution unit is equipped with an interface element recognition module and a field mapping library. It dynamically adapts the form structure of different platforms by calling the platform rules in the mapping library, without the need for customized development for a single platform.

5. The multi-task automated processing and text structure parsing system according to claim 1, characterized in that, The data standardization relay unit verifies, completes missing items, and encapsulates the format of the standardized data output by the text structure parsing unit, forming a standardized data structure that can be directly called by cross-platform adaptable execution units.

6. The multi-task automated processing and text structured parsing system according to any one of claims 1-5, characterized in that, Each unit establishes a data connection through a standardized data interface to achieve closed-loop data flow and collaborative work.

7. A multi-task automated processing and text structured parsing method, characterized in that, The system applied to the multi-task automated processing and text structure parsing system according to any one of claims 1-6 includes the following steps: S1: Perform structured parsing on the input unstructured text, extract text features and entity information, and generate standardized data in a unified format; S2: Perform format validation, missing item completion, and structural encapsulation on the standardized data generated in step S1 to form an executable data object that can be directly called; S3: Receive task requests, divide and queue tasks according to task type and priority, control the number of concurrent tasks, and monitor the task execution status in real time. S4: Based on the characteristics of the target platform, call the corresponding field mapping rules to dynamically generate automated operation logic, and sequentially complete the automatic login, data filling and operation process submission of the target platform, and return the execution results.

8. The multi-task automated processing and text structured parsing method according to claim 7, characterized in that, In step S1, a preset field template and feature matching method are used to convert unstructured text into standardized data with a unified key-value pair structure.

9. The multi-task automated processing and text structured parsing method according to claim 7, characterized in that, In step S3, tasks that fail to complete are automatically retried, and tasks that fail to complete within a timeout period are rolled back.

10. The multi-task automated processing and text structured parsing method according to claim 7, characterized in that, After submitting the operation process in step S4, the execution result is fed back to the task scheduling unit, which then updates the task execution status to achieve a closed-loop data flow.

Images