Publish-Subscribe Broker Retains Latest Document for Interval Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In publish/subscribe data processing systems, subscribers either receive all published documents or none, leading to inefficiencies in scenarios with long intervals between document publication or high document frequency, where regular updates are desired without overwhelming the subscriber with excessive information.
Innovation Solution
Implementing a mechanism to retain the latest published document and send it to the subscriber at predetermined intervals, along with sending new documents as they are published, using a publish interval and no-publish flag to control document delivery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the subscriber receives all published documents, then the subscriber gets complete information, but the subscriber is overwhelmed by excessive information when documents are published at high frequency
Solution Approach 1:
The patent extracts only the most recent document from the stream of published documents and sends it to the subscriber at predetermined intervals. This selective extraction approach filters out excessive intermediate documents while ensuring the subscriber receives updated information, resolving the contradiction between information completeness and document volume overload
Solution Approach 2:
The system implements periodic action by sending documents to the subscriber at predetermined time intervals rather than continuously forwarding all published documents. This periodic delivery mechanism controls the quantity of documents received while maintaining information freshness, addressing the high-frequency publication overload problem
2Quantity of substance
If the subscriber does not receive published documents, then the subscriber is not overwhelmed by excessive information, but the subscriber receives no updates even when new documents are published
Solution Approach 1:
The system performs preliminary action by retaining the most recent document in memory before it is published. This pre-retention ensures that when a subscriber connects or requests updates, the latest document is immediately available for transmission, preventing information loss while controlling document volume through selective delivery
Solution Approach 2:
The system uses feedback mechanisms where the broker monitors publication events and subscriber status, then dynamically controls document transmission. This feedback loop ensures documents are sent at appropriate intervals based on actual publication activity and subscriber needs, balancing information delivery with volume management
3Speed
If documents are sent immediately upon publication, then the subscriber receives real-time updates, but the subscriber experiences long waiting periods when documents are published infrequently
Solution Approach 1:
The system implements periodic checking and sending of retained documents at predetermined intervals. This periodic action ensures the subscriber receives updates regularly even when no new documents are published, eliminating long waiting periods while maintaining efficient document delivery speed through selective transmission
Solution Approach 2:
The system maintains continuous useful action by keeping the retained document ready for immediate transmission and periodically checking whether it should be sent. This continuous readiness state ensures minimal subscriber waiting time while maintaining appropriate document delivery speed, as the system is always prepared to send updates when needed
Data Source
AI summary
Documents are published in a publish subscribe data processing system. A first document to be published may have an associated topic. The first document is retained as a retained document. A second document to be published is retained as the retained document in response to receiving the second document before a predetermined time interval has passed. A copy of the second document is sent to a subscriber of the topic. A copy of the retained document is sent to the subscriber of the topic in response to a determination that the predetermined time interval has passed.