Decentralized Metadata Framework for Multi-Cloud Data Protection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data protection solutions in multi-cloud computing environments face challenges such as single point of failure, inability to scale out, vendor lock-in, and difficulty in protecting data across multiple clouds due to different APIs, leading to limitations in flexibility and cost-effectiveness.

Innovation Solution

A decentralized metadata database framework is implemented across multiple nodes in a multi-cloud environment, using a distributed hash table and peer-to-peer architecture to manage metadata and data replicas, eliminating the need for a single master node and enabling unified access and robust data protection across clouds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a centralized metadata database is used in a multi-cloud environment, then data protection can be managed centrally, but the system creates a single point of failure and cannot scale out effectively

Engineering Contradiction:
Improvedata protection reliabilityVSAvoidsystem architecture complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the centralized metadata database into multiple decentralized metadata database components distributed across different nodes in the multi-cloud environment. Each node maintains its own metadata database component, eliminating the single point of failure while distributing the data protection functionality across the network.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If a single master node architecture is used, then coordination is simplified, but the system cannot scale out and creates a bottleneck

Engineering Contradiction:
Improvecoordination simplicityVSAvoidsystem scalability
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent merges the master node functionality into each peer node, allowing every node to independently manage metadata and coordinate with others. This eliminates the single master node bottleneck while maintaining coordination through the decentralized metadata database framework where each node can act as both client and server.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If vendor-specific data protection solutions are used for each cloud platform, then optimization for each platform is achieved, but vendor lock-in occurs and flexibility is reduced

Engineering Contradiction:
Improvedata protection effectivenessVSAvoidcloud platform flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements a universal decentralized metadata database framework that can operate across multiple cloud platforms (AWS, Azure, GCP, etc.) through a common interface. The system translates platform-specific operations into standardized metadata operations, allowing data protection to function consistently across different vendors without requiring vendor-specific solutions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Reliability

If data is stored across multiple clouds for protection, then availability and resilience are improved, but managing access and tracking metadata becomes complex

Engineering Contradiction:
Improvedata availabilityVSAvoidmetadata management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements self-service functionality where each node autonomously manages its own metadata in the decentralized metadata database. Nodes can independently query, update, and track metadata for data replicas stored across the multi-cloud environment without requiring centralized coordination, simplifying the management of distributed data access.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11593496B2Decentralized data protection system for multi-cloud computing environment
Publication Date: 2023.02.28 EMC IP HLDG CO LLC
  • US11593496B2 patent drawing
  • US11593496B2 patent drawing
  • US11593496B2 patent drawing

AI summary

In a multi-cloud computing environment comprising a plurality of cloud platforms with each cloud platform comprising one or more nodes, a method maintains a decentralized metadata database framework, wherein each node comprises a decentralized metadata database component operatively coupled to each other decentralized metadata database component of the framework and wherein each of at least two of the decentralized metadata database components stores a set of metadata records corresponding to protected data stored across the plurality of cloud platforms. Further, the method manages one or more access requests directed to the protected data through one or more of the decentralized metadata database components of the framework.