Correlating Server and Network Transaction Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current monitoring systems for distributed transactions lack the ability to combine server-side and network-side performance data effectively, leading to insufficient visibility and accuracy in performance degradation detection, especially in modern service-oriented applications.
Innovation Solution
A system that integrates server-side and network-side monitoring by correlating server-side tracing data with network measurements at the granularity level of individual network communication transactions, using existing message identification data or attributes of the underlying network transport protocol, such as TCP sequence numbers, to identify and combine corresponding data even when communication protocols do not allow out-of-band correlation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If manual or semi-automated timing based correlation of server side and network side tracing data is used, then integration of monitoring results is achieved, but the accuracy is insufficient and the process is time consuming
Solution Approach 1:
The patent applies preliminary action by embedding correlation identifiers (such as trace IDs, message IDs, or sequence numbers) into the monitoring data during the initial collection phase on both server-side and network-side. This pre-tagging approach enables automated correlation without requiring time-consuming manual matching processes, while maintaining high accuracy through consistent identifier pairing across different monitoring points.
2Loss of information
If server side monitoring is used, then server processing visibility is provided, but network communication visibility is missing
Solution Approach 1:
The patent merges server-side monitoring capabilities with network-side monitoring by integrating both data sources into a unified monitoring system. The correlation mechanism combines server processing traces with network communication traces using shared identifiers, providing comprehensive visibility across the entire distributed transaction lifecycle without requiring separate independent monitoring systems.
Solution Approach 2:
The monitoring system achieves multi-functionality by designing a universal correlation mechanism that can identify and link both server-side operations and network-side communications through common identifiers. This single system performs multiple functions: tracking server processing, monitoring network traffic, and correlating events across both domains, eliminating the need for separate specialized monitoring tools.
3Loss of information
If network monitoring systems are used, then network transaction visibility is provided, but server side processing visibility is missing
Solution Approach 1:
The patent merges network monitoring capabilities with server monitoring by integrating both data sources into a unified monitoring system. The correlation mechanism combines network communication traces with server processing traces using shared identifiers, providing comprehensive visibility across the entire distributed transaction lifecycle without requiring separate independent monitoring systems.
4Adaptability or versatility
If communication protocols do not allow out-of-band correlation, then protocol compatibility is maintained, but correlation capability is limited
Solution Approach 1:
The patent uses intermediary correlation identifiers (such as trace IDs, message IDs, or sequence numbers) that are embedded within the existing communication protocols without requiring protocol modifications. These identifiers act as mediators that enable correlation between server-side and network-side events while maintaining full compatibility with existing protocols like TCP/IP, HTTP, and other standard communication protocols.
Data Source
AI summary
A performance monitoring and management system is provided for monitoring both server side and network side performance parameters of individual distributed transactions. The system uses correlation data which is transferred over a computer network to identify corresponding sender/receiver parts of a distributed transaction. Both server side tracing data and correlation data is transferred to an external correlation and monitoring server that creates per transaction end-to-end tracing data. Network probes are installed in the network infrastructures which monitor network conditions, like e.g. data transferred. Those network probes are configured in a way to identify and extract the correlation data used by the monitoring system and to tag created network measurements with this correlation data. Those tagged network measurements are then used to augment the per transaction end-to-end tracing data with corresponding network measurements.