Message Broker Redelivery via Object Store Cache

Solution Overview

Problem

Current message broker systems face inefficiencies and delays when attempting to redeliver missing data, as they often need to request data from the source server, leading to network inefficiencies and client delays, especially after data loss events.

Innovation Solution

A system comprising a message broker with local memory storage, a backup control circuit that copies messages into an object store, and a reconciliation control circuit that downloads and provides missing data from the object store to the message broker, ensuring seamless redelivery to client computers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the message broker requests missing data from the source server, then the missing data can be retrieved, but network delays and inefficiencies occur

Engineering Contradiction:

Improvedata availabilityVSAvoidredelivery delay

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary action by maintaining a local cache of data at the message broker and pre-fetching data from source servers before it is actually needed. When data is cached locally, the broker can immediately redeliver missing data without contacting the source server, thereby eliminating network delays while ensuring data availability.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If the message broker requests missing data from the source server, then the missing data can be retrieved, but network inefficiencies occur

Engineering Contradiction:

Improvedata completenessVSAvoidnetwork overhead

Core Design Contradiction:

ReliabilityVSLoss of energy

Solution Approach 1:

The system performs preliminary action by maintaining a local cache of data at the message broker and pre-fetching data from source servers before it is actually needed. When data is cached locally, the broker can immediately redeliver missing data without contacting the source server, thereby eliminating network delays while ensuring data availability.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system creates a local copy of data at the message broker's cache. Instead of repeatedly accessing the source server over the network, the broker maintains redundant local copies of frequently accessed or potentially needed data. This copying approach eliminates network overhead for data retrieval while ensuring data completeness is maintained.

Inventive Principle:

Principle #26Copying

3Ease of operation

If the message broker maintains local memory storage, then data accessibility is improved, but device complexity increases

Engineering Contradiction:

Improvedata accessibilityVSAvoidbroker architecture

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary action by maintaining a local cache of data at the message broker and pre-fetching data from source servers before it is actually needed. When data is cached locally, the broker can immediately redeliver missing data without contacting the source server, thereby eliminating network delays while ensuring data availability.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11194665B2Systems and methods for seamless redelivery of missing data

Publication Date: 2021.12.07 WALMART APOLLO LLC

AI summary

In some embodiments, apparatuses and methods are provided herein useful to providing seamless redelivery of missing data from a message broker to a requesting client computer. In some embodiments, there is provided a system for providing seamless redelivery of missing data including a requesting client computer generating a first data request in response to a user's e-commerce activity over an internet; a message broker comprising one or more first control circuits; a backup control circuit configured to copy a plurality of messages as a plurality of object data into an object store; and a reconciliation control circuit configured to: receive a second data request in response to a determination by the requesting client computer that a data loss has occurred; download the missing data from the object store; and provide the missing data to the message broker.