Event Ordering Framework for Asynchronous Message Consistency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In distributed asynchronous systems, disparate computer systems generate messages asynchronously, leading to out-of-order transactions that cause data inconsistencies and inefficient resource allocation, as clients struggle to accurately process and order messages from independent producer servers.

Innovation Solution

An event ordering framework that creates a dependency model to process and order messages, converting them into common object models to ensure in-order data transactions by utilizing a storage layer and parsing unit to manage dependencies and reprocess messages as needed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If messages are processed asynchronously from disparate systems, then system independence and flexibility are improved, but message ordering and data consistency deteriorate

Engineering Contradiction:
Improvesystem independenceVSAvoiddata consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces an event ordering framework as an intermediary component between disparate asynchronous systems. This framework receives events from multiple independent sources, assigns sequence numbers, and reorders events before processing. The intermediary maintains system independence while ensuring data consistency through structured event ordering and dependency tracking mechanisms.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The framework performs preliminary actions by assigning sequence numbers and creating dependency models for events before they are processed. Events are pre-ordered and validated for their dependencies on other events, ensuring that when events are eventually processed, they maintain the correct chronological and logical order, thus preventing data inconsistency.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If messages are reordered to ensure data consistency, then data consistency is improved, but processing time and system complexity increase

Engineering Contradiction:
Improvedata consistencyVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

Sequence numbers and dependency relationships are assigned to events as they are received, before any reordering occurs. This preliminary structuring allows the framework to efficiently manage event ordering without requiring extensive back-and-forth communication or repeated validation, reducing overall processing time while maintaining data consistency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The event ordering framework operates autonomously to manage event sequencing and dependency resolution. It self-manages the ordering process using the pre-assigned sequence numbers and dependency models, without requiring external intervention or complex coordination with source systems, thereby minimizing additional processing overhead.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If dependency models are created for all events, then message ordering accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvemessage ordering accuracyVSAvoidframework complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The framework segments the event processing into distinct components: event reception, sequence number assignment, dependency model creation, event ordering, and event processing. Each component handles a specific aspect of the ordering process independently. This segmentation allows for precise message ordering while managing complexity through modular design, where each segment can be developed and maintained separately.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10644931B2Event ordering framework in distributed asynchronous systems
Publication Date: 2020.05.05 WALMART APOLLO LLC
  • US10644931B2 patent drawing
  • US10644931B2 patent drawing
  • US10644931B2 patent drawing

AI summary

An event ordering framework for the ordering of out of ordered messages generated by asynchronous events across disparate systems. The system receives a message, creates a common object model based on the message, and applies a dependency model to the message. Utilizing the dependency model, the framework determines if any subsequently expected messages have already arrived and reprocesses all the messages in the sequence in that event. When a dependent message arrives earlier in the sequence than expected the framework stores the messages corresponding object model for later processing.