Global Namespace Cloud Storage Parallel File Segmentation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Cloud storage systems lack standardized storage access and management functionality, leading to high latency, low individual object performance, and the need for proprietary APIs, which complicates data management and increases costs across multiple locations.

Innovation Solution

A global namespace system is implemented in a cloud-based storage system, using a virtual machine to facilitate communication between client machines and cloud storage providers, breaking files into segments for parallel upload and download, and employing encryption for security, thereby optimizing storage and network performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If proprietary APIs are used for cloud storage access, then individual application functionality is customized, but system complexity and costs increase across multiple locations

Engineering Contradiction:

Improveapplication customizationVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal namespace system that provides standardized storage access across multiple cloud providers and locations. Instead of customizing applications for each proprietary API, the system creates a unified namespace layer that works with multiple cloud storage providers simultaneously, reducing system complexity while maintaining adaptability through standardized interfaces

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Productivity

If data is stored across distributed cloud storage systems, then aggregate throughput is high, but individual object performance suffers due to latency

Engineering Contradiction:

Improveaggregate throughputVSAvoidindividual object access speed

Core Design Contradiction:

ProductivityVSSpeed

Solution Approach 1:

The patent segments individual files into multiple segments that are distributed across different cloud storage locations. When accessing a file, the system retrieves segments in parallel from multiple locations and reassembles them, maintaining high aggregate throughput while improving individual object access speed through parallel processing and reduced latency

Inventive Principle:

Principle #1Segmentation

3Reliability

If multiple cloud storage providers are used for data distribution, then data availability improves, but management functionality becomes non-standardized

Engineering Contradiction:

Improvedata availabilityVSAvoidstorage management

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces a namespace service as an intermediary layer between applications and multiple cloud storage providers. This mediator handles standardized storage management operations, translating them into provider-specific operations, thereby maintaining ease of operation through standardized interfaces while ensuring data availability across multiple distributed cloud storage systems

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10893106B1Global namespace in a cloud-based data storage system

Publication Date: 2021.01.12 DRUVA INC

AI summary

Techniques and mechanisms described herein provide for verifying data across cloud-based and on-premises data storage systems. According to various embodiments, data can be received by a gateway from a client machine and stored in a file data repository accessible via the internet. The stored data can have a common master namespace. Indications of updates to the master namespace can be received. Updated namespace data and metadata can be transmitted to the gateway.