Configurable Pipeline Agents for Network Message Reliability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing networked environments face challenges in ensuring reliable message transmission and processing due to network delays and outages, particularly in enterprise deployments where agent footprints are large and networks are erratic.
Innovation Solution
The implementation of autonomous or semi-autonomous agents with flow control mechanisms, on-demand agent plugins, and configurable pipeline processes that allow for spooling of data, re-transmission of lost messages, and efficient data formatting, along with a REST-based API for enhanced configurability and scalability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional message transmission methods are used in networked environments, then message delivery can occur, but reliability deteriorates due to network delays and outages
Solution Approach 1:
The patent implements flow control mechanisms that allow agents to pre-process and spool messages locally before transmission. This preliminary action ensures messages are ready for immediate sending when network conditions improve, maintaining reliability despite network delays and outages.
Solution Approach 2:
The patent introduces an intermediary spooling mechanism between the agent and the network. This intermediary buffers messages during network instability, mediating between the message source and the unreliable network transmission channel.
2Adaptability or versatility
If agents are deployed with full functionality, then data collection capabilities are comprehensive, but agent footprint increases
Solution Approach 1:
The patent segments agent functionality by separating core message transmission capabilities from data collection plugins. The core agent remains lightweight while plugins provide specialized data collection capabilities on-demand, reducing overall agent footprint while maintaining versatility.
Solution Approach 2:
The patent creates a universal agent platform that can perform multiple data collection functions through pluggable modules. The core agent provides universal message transmission and flow control, while specific data collection capabilities are added through interchangeable plugins.
3Manufacturing precision
If data is formatted and processed at the collector, then data processing accuracy is high, but processing time increases
Solution Approach 1:
The patent implements preliminary data formatting and configuration at the agent level before transmission. Configuration templates are applied in advance, and data is pre-formatted according to destination requirements, reducing the processing burden and time at the collector while maintaining high accuracy.
Data Source
AI summary
Apparatus and methods are disclosed for processing messages from agents of a network environment including the use of collectors. Collectors can use configurable pipelines to improve processing of messages received from the agents. In one example of the disclosed technology, a number of networked agents are configured to gather data describing operational aspects of an agent's computing host. A collector is configured to receive reports from the agent and send the gathered data to one or more destination agent data consumers designated by augmentation information in the reports. In some examples, the collector transforms data using one or more stage selector rules.