Parallel Data Record Consolidation via Sub-Flow Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The consolidation function in mediation systems is a bottleneck due to its sequential nature, limiting performance when multiple source nodes are connected to a single consolidation node, as it requires processing one source node at a time to prevent data loss or duplication, restricting the use of multiple processes and threads.
Innovation Solution
Data records from multiple network elements are distributed to different sub-flows based on a unique identifier like the last digit of the MSISDN, allowing parallel consolidation within each sub-flow, with one process and one thread allocated per sub-flow, enabling simultaneous processing across multiple threads.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If sequential consolidation processing is used to prevent data loss or duplication, then data reliability is improved, but system productivity deteriorates
Solution Approach 1:
The patent divides the consolidation processing into multiple independent sub-flows, where each sub-flow handles a specific portion of the data records. By segmenting the processing workload across multiple parallel sub-flows, the system achieves both high reliability through isolated processing and high productivity through concurrent execution, resolving the contradiction between sequential reliability and parallel performance.
2Productivity
If multiple processes and threads are allocated to consolidation node, then system resource utilization is improved, but data loss or duplication risk increases
Solution Approach 1:
The patent segments the consolidation task into multiple independent sub-flows, each processed by dedicated processes and threads. This segmentation isolates the data handling in each sub-flow, preventing data loss or duplication even when multiple processes run concurrently, thus allowing high resource utilization without compromising data integrity.
Solution Approach 2:
The patent introduces an intermediary mechanism (the structured sub-flow architecture with defined entry and exit points) that mediates between multiple parallel processes and the consolidation logic. This intermediary ensures that each process operates independently on its assigned sub-flow, preventing interference and data corruption while maximizing resource utilization.
3Reliability
If one process and one thread are allocated per sub-flow, then data integrity is maintained, but device complexity increases
Solution Approach 1:
The patent segments the consolidation system into standardized sub-flow units, where each sub-flow is a self-contained processing module with a single process and thread. This segmentation creates a modular architecture that maintains data integrity through isolation while managing complexity through repetition of identical, well-defined units rather than complex inter-process communication protocols.
Data Source
AI summary
A method for operating a computer system (100) to consolidate data records received from at least one network element (NE1, NE2) in consolidation node (200), wherein incoming data records are distributed to different links (L1, L2, L3) in the consolidation node (200) by routing the data to be processed in sub-flows (201,202,203), data to be consolidated is routed to the same sub-flow, and the data records of the respective sub-flows are consolidated in parallel.