Dynamic Workflow File Processing System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems for processing and analyzing large data sets in supply chain management require a two-tier approach, which is time-consuming due to the need for initial data cleansing and separate ETL operations for business analytics, hindering real-time processing.
Innovation Solution
A single-tier system that simultaneously processes data and applies business rules, using a dynamic workflow selection method to identify applicable rules from a pre-cached repository, enabling real-time processing and metric collection during file processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a two-tier approach is used for data processing (initial data loading and cleansing followed by separate ETL operations), then data processing completeness is improved, but processing time increases significantly
Solution Approach 1:
The patent merges the two-tier approach (data loading/cleansing and ETL operations) into a single-tier system where both data processing and business rule application occur simultaneously in one pass, eliminating the sequential execution delay between separate stages
Solution Approach 2:
The system performs preliminary action by pre-caching business rules and file-level rules in memory before processing begins, so that during the single-pass processing, rules can be applied immediately without additional lookup delays, thereby reducing overall processing time while maintaining completeness
2Measurement precision
If separate ETL operations are performed after data loading, then business metrics accuracy is improved, but real-time processing capability deteriorates
Solution Approach 1:
The system enables continuous useful action by applying business rules and calculating metrics continuously during the single-pass data processing operation, rather than performing separate batch ETL operations afterward, thus achieving both accuracy and real-time capability
Solution Approach 2:
The patent combines data processing and business rule application into a unified single-tier process, allowing metrics to be calculated in real-time during the same pass that data is being processed, eliminating the delay between data loading and analytics
3Adaptability or versatility
If dynamic workflow selection with rule fetching is implemented, then processing flexibility is improved, but system complexity increases
Solution Approach 1:
The system performs preliminary action by pre-caching all applicable business rules and file-level rules in memory before processing begins. This allows the dynamic workflow selection to operate with simplified in-memory lookups rather than complex real-time rule retrieval, reducing operational complexity while maintaining flexibility
Solution Approach 2:
The patent introduces an intermediary layer (the rule caching mechanism) that mediates between the complex rule repository and the processing engine. This intermediary pre-loads and stores rules in an accessible format, simplifying the interface between rule selection and rule application while maintaining full rule set flexibility
Data Source
AI summary
The technique relates to a system and method for selecting dynamic workflow to process file data. This technique facilitates to process file data and business rules simultaneously and thus saves a lot of time. The technique involves receiving a request from File Pattern Recognition Engine (FPRE) to select rules for processing file data by Data Rule Engine (DRE) and to select business rules to be applied on the data by the Business Metrics Engine (BME). After that, DRE and BME select the possible set of rules and send the acknowledgement to FPRE. Thereafter, FPRE sends the signal to proceed to DRE and BME, and after receiving the signal DRE and BME apply at least one of the possible set of rules selected earlier.