Distributed Enterprise Collection Bus for Network Data Orchestration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current communications networks face inefficiencies in collecting and processing large volumes of raw data due to the need for each network node to sort and send data to multiple destinations, which is processor-intensive and burdensome, especially when dealing with increasing quantities of information.
Innovation Solution
The implementation of a Distributed Enterprise Collection Bus (DECB) that separates data collection, orchestration, and delivery, allowing raw data packets to be collected and filtered at a central point before being sent to appropriate destinations, thereby alleviating the burden on network nodes and optimizing data processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If each network node sorts and sends data to multiple destinations, then data can be delivered to all required warehouses, but the processing load on network nodes increases significantly
Solution Approach 1:
The patent introduces an Enterprise Collection Bus (ECB) as an intermediary component that centralizes the data collection and routing function. Instead of each network node independently sorting and sending data to multiple destinations, all nodes send their raw data to the ECB, which then orchestrates the distribution to appropriate data warehouses. This mediator approach transfers the processing burden from individual network nodes to a dedicated collection bus system, resolving the contradiction between complete data delivery and node processing efficiency.
Solution Approach 2:
The patent extracts the data sorting and routing function from network nodes and places it in the Enterprise Collection Bus. By separating the data collection function from the data routing function, the system allows network nodes to focus solely on generating and sending raw data, while the ECB handles the complex task of sorting, filtering, and distributing data to multiple destinations. This extraction resolves the technical contradiction by removing the harmful processing load from network nodes while maintaining complete data delivery through centralized orchestration.
2Reliability
If network nodes send data to multiple destinations directly, then all applications receive their required data, but duplicate and unnecessary data transmission occurs
Solution Approach 1:
The patent implements preliminary filtering and sorting actions in the Enterprise Collection Bus before data is distributed to destinations. The ECB performs preprocessing operations including removing duplicate packets, filtering unnecessary data, and organizing data by destination requirements. This preliminary action prevents duplicate and unnecessary data from being transmitted across the network, reducing bandwidth consumption while ensuring that each destination receives only the relevant data it needs, thus resolving the contradiction between complete data reception and energy-efficient transmission.
3Productivity
If a centralized data collection point is implemented, then data processing efficiency improves, but the system architecture becomes more complex
Solution Approach 1:
The Enterprise Collection Bus is designed as a universal, multi-functional platform that handles diverse data types from multiple network nodes and routes them to various data warehouses. The ECB provides standardized interfaces for data collection, filtering, sorting, and distribution, creating a unified architecture that simplifies the overall system despite the added complexity of the collection bus itself. This multi-functionality allows a single component to perform multiple tasks that would otherwise require separate mechanisms at each network node, resolving the contradiction by consolidating functions rather than distributing complexity.
Data Source
AI summary
Systems and methods are presented to collect raw data from a plurality of servers and nodes on a network. A Distributed Enterprise Collection Bus (DECB) architecture is employed at various points on a network. The DECB comprises a collector unit that is protocol agnostic, an orchestration unit, a rule database, a filtering unit, and a distribution unit. Packets of raw data such as Call Detail Records (CDRs) generated by switching centers are received, and distributed to relevant destinations. Relevant destinations include data warehouses, mediation, analytics, etc. The goal is to alleviate collection and filtration duties of the source and destination.