Agent-Based API Observability Signal Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge of integrating monitoring and logging data across disparate systems in network architectures is exacerbated by the complexity of web services, making it difficult to connect the chain of events and cause and effect, and existing observability solutions like Open Telemetry lack access to valuable information from existing APIs.
Innovation Solution
A general-purpose agent that utilizes configuration files to query and transform data from various application programming interfaces (APIs) into a common telemetry format, enabling the collection of Open Telemetry metrics without requiring custom code for each API.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If custom code is written for each API to collect observability data, then data collection capability is improved, but device complexity and maintenance burden increase
Solution Approach 1:
The patent implements a universal agent that can collect observability data from multiple different APIs using a single standardized interface. The agent reads configuration files to adapt to different API specifications without requiring custom code for each API, thereby achieving multi-functionality while reducing complexity and maintenance burden.
2Measurement precision
If manual custom coding is used for each API integration, then information extraction accuracy is improved, but loss of time and productivity decrease
Solution Approach 1:
The patent employs configuration files that are prepared in advance to define how data should be extracted and transformed from each API. This preliminary configuration allows the system to automatically extract information accurately without requiring manual coding at the time of integration, significantly reducing the time and effort required for API onboarding.
3Loss of information
If data is collected from disparate systems using different formats, then information completeness is improved, but device complexity increases due to format transformation requirements
Solution Approach 1:
The patent introduces a standardized telemetry format as an intermediary layer between diverse API data sources and the observability system. The agent transforms data from various API formats into this common intermediate format, enabling complete information collection from disparate systems while managing transformation complexity through a unified approach.
Data Source
AI summary
In one embodiment, a device executing an agent determines, based on a configuration file for the agent, a query for particular information from a particular application programming interface from amongst a plurality of application programming interfaces in communication with the agent. The device submits, via the agent, the query for the particular information to the particular application programming interface to receive a response to the query. The device extracts, using the agent, the particular information from the response to the query, based on the configuration file. The device transforms, via the agent, the particular information into a common telemetry format for combination with telemetry regarding one or more other application programming interfaces from among the plurality of application programming interfaces.