Predicate-Based Telemetry for Network Data Filtering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current telemetry systems face inefficiencies in scaling data streaming across large networks, often overwhelming management systems with excessive data, and struggle to reactively report bundled data elements based on related conditions, leading to wastage of resources.
Innovation Solution
Implementing a constraint-based, event-driven telemetry strategy that allows network devices to stream data only when specific predicates are met, using a 'push' model to efficiently transmit data related or unrelated to the event triggers, thereby optimizing resource usage and reducing unnecessary data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data elements are streamed from network elements to management systems all the time, then complete monitoring coverage is achieved, but the management system is overwhelmed when implemented on a large scale
Solution Approach 1:
The patent segments the continuous data stream into discrete data elements that are evaluated individually against predicates. Each data element is assessed independently to determine whether it meets the criteria for reporting, rather than transmitting all data continuously. This segmentation allows the system to filter data at the source before transmission, reducing the overall volume of data sent to management systems while maintaining monitoring coverage for relevant events.
Solution Approach 2:
The patent implements partial action by transmitting only the subset of data elements that satisfy predefined predicates rather than all available data. The system performs exactly the amount of data transmission necessary to meet monitoring requirements - no more, no less. This partial action approach optimizes resource utilization by sending data selectively based on operational needs and predicate satisfaction.
2Loss of energy
If data elements are reported only when they change, then data transmission is reduced, but the system cannot reactively report bundled data elements based on related conditions
Solution Approach 1:
The patent implements feedback mechanisms where management systems send predicate definitions and constraints back to network elements, which then autonomously evaluate their local data elements against these predicates. The network elements provide feedback by reporting only when predicate conditions are satisfied. This closed-loop feedback system enables reactive reporting of bundled data elements based on related conditions while maintaining transmission efficiency, as the system responds dynamically to actual operational states rather than transmitting continuously.
Solution Approach 2:
The patent applies preliminary action by pre-defining predicates and constraints at the management system level before data collection begins. These predicates establish the criteria for what constitutes reportable data in advance. Network elements use these pre-established predicates to filter and evaluate data elements locally before transmission, enabling the system to reactively report bundled data elements when related conditions are met without requiring continuous communication or complex real-time decision-making at the management system.
3Loss of information
If vast amounts of data are streamed by multiple network elements, then comprehensive monitoring is achieved, but edge bandwidth and processing cycles are wasted
Solution Approach 1:
The patent extracts the essential monitoring function from continuous data transmission by implementing predicate-based filtering at the network element level. Data elements are evaluated against predicates locally, and only those satisfying the predicates are extracted for transmission to the management system. This extraction approach maintains monitoring completeness for relevant events while eliminating the waste of bandwidth and processing cycles associated with transmitting unnecessary data volumes across the network.
Solution Approach 2:
The patent enables network elements to perform self-service data filtering and evaluation by autonomously assessing their own data elements against received predicates. Each network element independently determines which of its data elements warrant reporting based on local predicate satisfaction. This self-service capability eliminates the need for centralized filtering or continuous polling, reducing network bandwidth consumption and processing overhead while maintaining comprehensive monitoring of predicate-satisfied events across the distributed network.
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
Telemetry systems and methods are provided in which data is streamed from to a remote location based on predicate affirmation of pre-established conditions of a network (10). In one embodiment, a network device (14) comprises a processing device (52) and a memory device (54) configured to store logic instructions. When executed, the logic instructions are configured to cause the processing device (52) to obtain (122) a first set of one or more data elements indicative of one or more conditions of a network in which the network device operates. Also, the logic instructions are configured to cause the processing device (52) to monitor (124) the first set of one or more data elements to determine if a predefined predicate is affirmed and execute (128) a response action when the predefined predicate is affirmed (126).