Generalized Reversible Framework for Database Consensus

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern datacenters face inefficiencies in managing Common Knowledge (CK) due to complex and unreliable protocols between networks and applications, leading to slow transaction processing and unreliable consensus in distributed database systems.

Innovation Solution

The Generalized Reversible Framework (GRF) combines the Entangled Link protocol and Transaction—Earth Non-Time Transaction (ENTT) protocol within a Cellular Fabrix (CF) to create 'consensus tiles' that manage CK efficiently, enabling reversible transactions and reducing overhead through direct connections between cells, allowing for atomic information transfer and error recovery without overwriting data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If complex protocols and software system components are used between network and application to manage Common Knowledge, then reliability of consensus is improved, but system overhead and complexity increase

Engineering Contradiction:
Improveconsensus reliabilityVSAvoidprotocol complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the Common Knowledge management functionality from the application layer and relocates it to the network link layer. The link itself now maintains CK state and provides atomic information transfer primitives, removing the burden of complex consensus protocols from applications while preserving reliability through the link's inherent state machine guarantees.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The network link acts as an intermediary between applications, providing atomic information transfer (AIT) primitives. The link's state machine serves as a mediator that guarantees exactly-once delivery and maintains Common Knowledge, simplifying the interaction model for applications while ensuring consensus reliability through the intermediary's controlled state transitions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If complex protocols and software system components are used between network and application to manage Common Knowledge, then consensus reliability is improved, but transaction processing speed decreases

Engineering Contradiction:
Improveconsensus reliabilityVSAvoidtransaction processing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

By extracting CK management from applications to the link layer, the patent eliminates the overhead of application-level consensus protocols. The link's optimized state machine handles CK maintenance efficiently, allowing applications to focus on transaction processing without being burdened by complex consensus logic, thereby improving throughput.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The network link provides self-service by autonomously maintaining Common Knowledge state and guaranteeing atomic information transfer without requiring application intervention. The link's state machine automatically manages CK state transitions, reducing the computational overhead for applications and accelerating transaction processing while maintaining reliability.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If CK is managed in the application rather than the link, then application control is improved, but system robustness and resilience decrease

Engineering Contradiction:
Improveapplication controlVSAvoidsystem robustness
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The network link serves as a robust intermediary that manages Common Knowledge state with guaranteed atomicity and exactly-once delivery semantics. Applications retain control through standardized AIT primitives while the link's state machine provides robustness against failures, network partitions, and race conditions that would be difficult to manage at the application level.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces application-level software mechanisms for managing CK with a link-level state machine mechanism. The state machine's deterministic transitions and invariant maintenance provide superior robustness compared to software-based CK management, while applications retain operational control through well-defined AIT interface primitives.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Reliability

If reversible transactions are implemented with successive CK construction and teardown, then error recovery capability is improved, but protocol complexity increases

Engineering Contradiction:
Improveerror recovery capabilityVSAvoidprotocol complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent inverts the traditional approach by making the link reversible rather than the application. The link state machine supports reversible operations where CK can be successfully constructed and then torn down, allowing transactions to be undone if needed. This reversal capability is built into the link's state transitions, providing error recovery without requiring complex application-level rollback mechanisms.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The link maintains CK state in advance of application needs, preparing the groundwork for potential reversibility. By pre-establishing the state machine's ability to construct and teardown CK, the system enables error recovery before failures occur, with the reversibility mechanism already in place and tested through the link's state transitions.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11886428B2Generalized reversibility framework for common knowledge in scale-out database systems
Publication Date: 2024.01.30 LITAK ERIC
  • US11886428B2 patent drawing
  • US11886428B2 patent drawing
  • US11886428B2 patent drawing

AI summary

A computer-implemented system with a processor provides a reversible transfer of an atomic token from one side of an imperfect link to the other, such that if the protocol (or process) on either side fails at a critical moment, the atomic token will be found on both sides to be verifiably incomplete, unless the protocol has completed successfully past its ‘irreversible threshold’ on both sides.