Distributed System Instance Discovery via Gossip Protocol

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional computing systems face limitations in accessing and ensuring the reliability of application data, particularly in distributed environments, where data accessibility and redundancy are restricted by local storage models and incompatible operating systems, leading to challenges in cross-platform data access and security.

Innovation Solution

A distributed system employing discovery and failure detection daemons (DFDD) using a gossip-based synchronization protocol to manage application instances and storage nodes, enabling dynamic application instance discovery and state management, and a web services interface for platform-independent data storage and access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If application data is stored on local hard drive of a particular computer system, then data storage is simple and direct, but data accessibility to applications executing on other systems is limited

Engineering Contradiction:
Improvedata accessibilityVSAvoidstorage system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the storage system into distributed storage nodes that can be independently accessed. Each node maintains local storage capabilities while participating in a broader distributed network, allowing applications to access data from multiple locations without requiring a complex centralized storage architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a network dimension to traditional local storage by enabling data to be stored on remote nodes accessible through network protocols. This transforms the storage model from purely local (one-dimensional) to distributed across multiple systems (multi-dimensional), improving accessibility without requiring each system to have complex local storage infrastructure.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If conventional operating systems store one copy of application data on one storage device by default, then storage management is simple, but data redundancy and reliability are insufficient

Engineering Contradiction:
Improvedata redundancyVSAvoidstorage management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges storage capabilities across multiple distributed nodes to provide redundancy. Instead of relying on a single storage device, the system combines storage resources from multiple nodes, allowing data to be replicated and accessed from different locations, thereby improving reliability without requiring complex centralized management.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements self-service mechanisms where storage nodes automatically participate in data replication and recovery processes. Each node can independently contribute to redundancy and can autonomously recover data if failures occur, reducing the need for complex external management while maintaining high reliability.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If different operating systems store data for the same application in different, incompatible formats, then each operating system can optimize its own storage, but cross-platform data accessibility is difficult

Engineering Contradiction:
Improvecross-platform accessibilityVSAvoiddata format compatibility
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal data access layer that works across different operating systems and storage formats. This layer provides a common interface for data access, allowing applications to retrieve data from any node regardless of the underlying operating system or storage format, thereby achieving cross-platform accessibility without requiring all systems to use identical formats.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary data access layer that mediates between different operating systems and storage formats. This intermediary translates and coordinates data access requests across platforms, enabling seamless cross-system data retrieval without requiring direct compatibility between different storage formats.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Ease of operation

If enterprises restrict access to their local area networks for security reasons, then network security is improved, but applications on portable devices cannot access data on fixed systems

Engineering Contradiction:
Improvedata accessibilityVSAvoidsecurity risk
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent introduces a distributed network intermediary layer that enables secure data access between portable devices and fixed systems. This intermediary layer implements controlled access mechanisms that allow data retrieval without requiring direct network access, thereby maintaining security restrictions while enabling necessary data accessibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds a network access dimension that allows data to be retrieved from fixed systems through distributed network nodes. This enables portable devices to access data without requiring direct LAN access, bypassing security restrictions while maintaining the integrity of the fixed system's network perimeter.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10652076B2Dynamic application instance discovery and state management within a distributed system
Publication Date: 2020.05.12 AMAZON TECH INC
  • US10652076B2 patent drawing
  • US10652076B2 patent drawing
  • US10652076B2 patent drawing

AI summary

Dynamic application instance discovery and state management within a distributed system. A distributed system may implement application instances configured to perform one or more application functions within the distributed system, and discovery and failure detection daemon (DFDD) instances, each configured to store an indication of a respective operational state of each member of a respective group of the number of application instances. Each of the DFDD instances may repeatedly execute a gossip-based synchronization protocol with another one of the DFDD instances, where execution of the protocol between DFDD instances includes reconciling differences among membership of the respective groups of application instances. A new application instance may be configured to notify a particular DFDD instance of its availability to perform an application function. The particular DFDD instance may be configured to propagate the new instance's availability to other DFDD instances via execution of the synchronization protocol, without intervention on the part of the new application instance.