Access Proxy Identifier Conversion for Duplicate Response Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In stream processing systems, inconsistencies may occur in responses from external systems due to repeated requests and responses being transmitted during recovery from failures like network disconnection, despite using distributed checkpoint methods for failure resistance.
Innovation Solution
The system employs an access proxy execution device that converts request identifiers into reversible conversion identifiers and reconverts response identifiers to distinguish between multiple transmissions, ensuring consistent response handling during recovery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If distributed checkpoint methods are used for failure resistance, then system reliability is improved, but response inconsistency occurs during recovery due to repeated requests and responses
Solution Approach 1:
The system performs preliminary actions by converting request identifiers to conversion identifiers before transmitting requests to external systems. This preliminary conversion allows the system to later identify and discard duplicate responses during recovery without affecting normal operation, thus preventing response inconsistency while maintaining failure resistance
Solution Approach 2:
The invention introduces conversion identifiers as an intermediary element between the stream processing system and external systems. These conversion identifiers act as mediators that enable the system to track and distinguish between different request-transmission instances, allowing duplicate responses to be identified and discarded during recovery while maintaining response consistency
2Productivity
If requests are retransmitted during recovery from network disconnection, then processing continuity is maintained, but duplicate responses cause inconsistency
Solution Approach 1:
The system implements feedback by comparing conversion identifiers in received responses against stored conversion identifiers from retransmitted requests. This feedback mechanism enables the system to identify duplicate responses and discard them appropriately, ensuring that processing continuity during recovery does not lead to response inconsistency
Data Source
AI summary
A data processing system comprising: a first information processing device and a second information processing device, the second information processing device including: a second memory; and a second processor coupled to the second memory and the second processor configured to: convert a first identifier included in a first processing request from the first information processing device into a reversibly convertible first conversion identifier in response to receiving the first processing request; transmit the first processing request including the converted first conversion identifier to another information processing system; reconvert, in response to receiving a first execution result of a process corresponding to the first processing request, the first conversion identifier included in the first execution result into the first identifier; and transmit the first execution result including the reconverted first identifier and the first conversion identifier to the first information processing device.