Server Transaction Lag Caching for Data Quality Routing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The discrepancy between client and server replication data quality information in continuous replication methods makes it difficult to measure and maintain data quality, as server data quality changes constantly, leading to a gap in understanding between clients and servers.

Innovation Solution

Recording and transmitting the number of transactions processed per second by the server, with dynamic recalculations and caching to ensure accurate and up-to-date replication data quality metrics, allowing clients to convert delay into transaction lag and route requests to suitable servers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If continuous replication is used to improve data quality and reduce delay, then replication data quality is improved, but it becomes difficult to measure and maintain data quality consistency between client and server

Engineering Contradiction:

Improvereplication data quality measurementVSAvoiddata quality measurement complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The server sends feedback information about its current transaction processing rate and lag status to the client. This feedback mechanism enables the client to dynamically adjust its data quality expectations and routing decisions based on real-time server conditions, resolving the measurement inconsistency problem between continuous replication systems.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent introduces an intermediary data structure that translates server-side transaction lag metrics into client-friendly time delay representations. This intermediary layer bridges the gap between server's continuous replication metrics and client's data quality requirements, enabling consistent measurement across the system.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If snapshot replication is used to simplify data quality measurement, then measurement is easier, but network and machine resources are inefficiently utilized with uneven server utilization

Engineering Contradiction:

Improvedata quality measurement easeVSAvoidnetwork and machine resource utilization

Core Design Contradiction:

Ease of operationVSProductivity

Solution Approach 1:

The patent implements continuous replication where transaction logs are continuously transferred and applied to replica servers rather than taking periodic snapshots. This continuous process fully utilizes network and machine capacity, eliminating the idle periods and resource waste associated with snapshot replication while maintaining ease of measurement through feedback mechanisms.

Inventive Principle:

Principle #20Continuity of useful action

3Measurement precision

If server recalculates transaction processing rate each request to ensure accuracy, then data quality information accuracy is improved, but processing time and computational resources increase

Engineering Contradiction:

Improvetransaction processing rate accuracyVSAvoidrecalculation time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The server performs preliminary calculations of transaction processing rate and maintains these values in a cached state. Between requests, the system uses these pre-calculated values, only performing recalculation when necessary (e.g., when thresholds are exceeded or errors occur). This preliminary action reduces the frequency of full recalculations while maintaining accuracy.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamic caching where the validity of cached transaction processing rate values is continuously monitored. The system dynamically adjusts between using cached values and performing new calculations based on changing server conditions, network latency, and data quality requirements, optimizing the balance between accuracy and processing time.

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS7523213B1Efficient approach with the toleration of stale data to dynamically transform and unify data quality in client and server with continuous transaction flows

Publication Date: 2009.04.21 SAP SE

AI summary

Discrepancies between client replication data quality information and server replication data quality information may be addressed by recording and transmitting the transaction processing rate for the server. The transaction processing rate may be used in conjunction with the number of transactions the server is behind to determine the transaction delay. The transaction delay may also be used in conjunction with the transaction processing rate to calculate the transaction lag. Using this information, the client and server may have a similar understanding of the replication data quality. This information may be cached and used to determine what servers requests should be routed to. Each time a client makes a request, the transaction processing rate and/or the transaction lag for the given server may be inserted into the replication data stream. The values inserted into the replication data stream may invalidate and replace the cached values.