Event Streaming Platform for Real-Time Balance Transfer Processing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional payment transfer networks require several days to settle and reflect balance transfers, which is not compatible with the near-instantaneous nature of real-time payment networks, necessitating enhancements in backend processing infrastructures to achieve concurrent and accurate electronic balance transfers.

Innovation Solution

The implementation of an event streaming platform and real-time, event-driven applications that process and transmit balance transfer data records in a sequential order to real-time payment networks, allowing for near-real-time updates and eliminating the need for soft posts by enabling hard posts directly to account ledgers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If conventional payment transfer networks are used, then balance transfers can be processed, but settlement takes several days which is not compatible with real-time payment networks

Engineering Contradiction:

Improvesettlement speedVSAvoidtime delay in balance transfer reflection

Core Design Contradiction:

SpeedVSLoss of time

Solution Approach 1:

The system segments the balance transfer process into distinct components: a producer application that captures balance transfer requests, an event streaming platform that streams events in real-time, and a consuming application that processes these events to update account ledgers. This segmentation allows each component to optimize for real-time processing independently, resolving the contradiction between processing capability and settlement speed.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The event streaming platform acts as an intermediary between the producer application and the consuming application, enabling real-time communication without requiring direct integration between all system components. This intermediary layer facilitates immediate event propagation and processing, eliminating the several-day delay inherent in conventional networks while maintaining system modularity.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If real-time payment networks are implemented, then immediate funds availability and real time settlement are achieved, but enhancements to internal technical infrastructures are required

Engineering Contradiction:

Improvereal-time payment processing capabilityVSAvoidinternal technical infrastructure complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The event streaming platform serves multiple functions within the system: it streams balance transfer events, maintains event order through partitioning, buffers events for reliable delivery, and enables real-time processing. By consolidating these multiple functions into a single platform, the system achieves real-time payment capability without proportionally increasing infrastructure complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system creates a copy of the balance transfer event data and transmits it to the consuming application for processing. This copying mechanism allows the producer application to immediately release the event for real-time processing while the consuming application independently processes the copy, enabling real-time settlement without requiring complex synchronized updates across all systems.

Inventive Principle:

Principle #26Copying

3Stability of the object's composition

If balance transfer data records are processed sequentially, then data order is maintained, but processing throughput may be limited

Engineering Contradiction:

Improvedata record orderVSAvoidprocessing throughput

Core Design Contradiction:

Stability of the object's compositionVSProductivity

Solution Approach 1:

The event streaming platform divides the data stream into multiple partitions, each maintaining sequential order for its specific subset of records. This segmentation allows multiple partitions to process records in parallel while each partition preserves sequential ordering, thereby maintaining data integrity without limiting overall throughput.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system transitions from single-threaded sequential processing to multi-threaded parallel processing by introducing partitions as a new dimension. Each partition handles a subset of records sequentially, but the partitions themselves operate in parallel, effectively increasing throughput while maintaining order within each partition's data stream.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20240232832A9Systems and methods for processing steams of balance transfer data records

Publication Date: 2024.07.11 JPMORGAN CHASE BANK NA

AI summary

A method may include a producer application receiving balance transfer request data, formatting the balance transfer request data into a plurality of balance transfer data records, and streaming the plurality of balance transfer data records to an event streaming platform. A method may include an event streaming platform formatting the plurality of balance transfer data records into a partition and sending the balance transfer data records in a sequential order to a consuming application. A method may include a consuming application sending a first part of the balance transfer data records to a real-time payment network for settlement of a payment indicated in the first part of the balance transfer data records and sending a second part of the balance transfer data records to a posting application for posting to an electronic account balance ledger.