Impact Analysis for Big Data Task Redoing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In big data service processing, complex data dependencies lead to high maintenance difficulty and risk of data inconsistency when re-executing tasks due to extensive indirect dependencies, making manual reprocessing of affected procedures complex and prone to errors.
Innovation Solution
An impact analysis-based method that identifies all directly and indirectly affected procedures and tasks, allowing for one-click task redoing by analyzing dependencies and execution statuses, thereby simplifying the maintenance process and reducing manual steps and errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual reprocessing of affected procedures is performed to maintain data consistency, then data reliability is improved, but operational complexity and maintenance difficulty increase significantly
Solution Approach 1:
The system automatically identifies affected procedures and tasks through impact analysis, and executes reprocessing without manual intervention. The workflow system self-determines which tasks need reexecution based on dependency relationships and data changes, eliminating the need for manual operational complexity while maintaining data consistency.
Solution Approach 2:
The system implements a feedback mechanism where impact analysis continuously monitors data changes and triggers appropriate reprocessing actions. When data from procedure A changes, the system feedbacks to identify affected procedures (B, C, D, E) and automatically initiates reprocessing, creating a closed-loop system that maintains reliability without increasing operational complexity.
2Reliability
If comprehensive impact analysis is performed to identify all affected procedures, then data consistency is improved, but time consumption increases
Solution Approach 1:
The system performs preliminary impact analysis before reprocessing to pre-identify all affected procedures and tasks. By analyzing dependency relationships in advance and determining the complete scope of reprocessing needed, the system avoids time-consuming manual identification during actual reprocessing operations, thus reducing overall time loss while ensuring comprehensive data consistency.
3Ease of operation
If manual identification of affected procedures is performed, then operational control is improved, but error rate increases due to complexity
Solution Approach 1:
The patent replaces manual mechanical identification processes with automated computer-based impact analysis. The system uses algorithmic dependency tracking and automatic task identification to substitute human operational control, thereby maintaining operational oversight while eliminating errors caused by manual complexity in identifying affected procedures.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
The present invention discloses an impact analysis-based task redoing method, an impact analysis calculation apparatus, and a one-click resetting apparatus. The method includes: receiving an impact analysis request, where the impact analysis request includes a source procedure identifier, an impact start time, and an impact end time; obtaining a dependency list and a procedure information list of a source procedure according to the source procedure identifier; obtaining a period of the source procedure and a period of a target procedure according to the source procedure identifier and according to the target procedure identifier in the dependency list; obtaining, according to the period of the source procedure, the period of the target procedure, the impact start time, and the impact end time, a procedure instance list corresponding to each procedure identifier included in the procedure instance list; and sending the procedure instance list and the procedure information list. Optionally, one-click resetting is implemented.