Keymap Subsystem for Distributed Storage Routing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional storage models limit data accessibility and reliability, particularly for applications across different systems and platforms, due to restrictive network access and inconsistent data formats, making it difficult for portable devices to access persistent data stored on fixed systems or networks.

Innovation Solution

A distributed storage network with a keymap subsystem that uses consistent hashing to route keymap information requests to specific coordinators, incorporates cached information with generation identifiers, and applies cache optimization techniques to manage data across multiple components, enabling secure and redundant data storage accessible via a Web services interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If data is stored on a local hard drive or network device, then storage accessibility is limited to specific systems or networks, but implementing a distributed storage system increases system complexity

Engineering Contradiction:
Improvedata accessibilityVSAvoidstorage system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a keymap subsystem as an intermediary component that mediates between data storage operations and data access requests. This subsystem manages the mapping between keys and storage locations, enabling portable devices to access data across distributed systems without increasing the complexity at the application level. The keymap coordinator acts as a mediator that handles routing decisions and maintains consistency across the distributed storage network.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If conventional storage models are used, then data redundancy is not ensured by default, but implementing redundancy mechanisms increases storage overhead and system complexity

Engineering Contradiction:
Improvedata reliabilityVSAvoidstorage overhead
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent implements preliminary actions by automatically replicating data to multiple storage locations during the initial storage operation. The keymap subsystem pre-establishes redundancy mappings before data access is needed, ensuring that data is already available at multiple locations without requiring additional manual intervention or increasing storage overhead during normal operations.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If different operating systems store data in different formats, then cross-platform accessibility is limited, but implementing format conversion increases processing complexity

Engineering Contradiction:
Improvecross-platform accessibilityVSAvoiddata format management
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by using a unified keymap format that can be interpreted across different operating systems and platforms. The keymap subsystem manages the transformation and mapping parameters, allowing the same keymap structure to function consistently across Windows, macOS, Linux, and mobile platforms without requiring complex format conversion mechanisms at the application level.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8316213B1Management of object mapping information corresponding to a distributed storage system
Publication Date: 2012.11.20 AMAZON TECH INC
  • US8316213B1 patent drawing
  • US8316213B1 patent drawing
  • US8316213B1 patent drawing

AI summary

Systems and methods for managing mapping information for objects maintained in a distributed storage system are provided. The distributed storage system can include a keymap subsystem that manages the mapping information according to object keys. Requests for specific object mapping information are directed to specific keymap coordinators within the keymap subsystem based on a consistency based hashing schema. The hashing schema is updated and distributed to other components within the distributed storage system based on a defined distribution model.