Storage Controller Data Mapping Engine Scalability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional enterprise data storage solutions require substantial and expensive computing resources for tracking and mapping data locations, leading to increased complexity and disruption, and often fail to scale dynamically with demand.

Innovation Solution

A distributed data storage system utilizing a data mapping engine, placement engine, and map authority to provide scalable and flexible data access through a computing resource provider, implementing logical block addressing (LBA) maps and replication techniques to ensure data integrity and availability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If dedicated computing resources are invested for tracking and mapping data locations, then data storage performance and availability are improved, but system complexity and cost increase

Engineering Contradiction:
Improvedata availabilityVSAvoidcomputing resource complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the data mapping and location tracking functions from dedicated computing resources and relocates them to the storage devices themselves. Each storage device maintains its own mapping structure that associates logical block addresses with physical locations, eliminating the need for separate centralized computing resources while maintaining reliable data location tracking.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Storage devices perform self-mapping and self-tracking of data locations without requiring external dedicated computing resources. The mapping information is stored within the storage devices themselves, allowing them to autonomously manage their own data location information and reduce overall system complexity.

Inventive Principle:
Principle #25Self-service

2Productivity

If additional computing resources are added for data tracking, then data access performance improves, but disruption and productivity decrease

Engineering Contradiction:
Improvedata access performanceVSAvoidsystem disruption
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent removes the need for additional dedicated computing resources by embedding mapping functionality within storage devices. This extraction eliminates the disruption and operational complexity associated with adding separate computing infrastructure while preserving data access performance through efficient local mapping.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If static storage configurations are used, then system stability is maintained, but adaptability to changing demand is reduced

Engineering Contradiction:
Improvescaling capabilityVSAvoidconfiguration stability
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The patent implements dynamic mapping structures within storage devices that can adapt to changing data access patterns and storage demands. The mapping information is continuously updated based on actual data placement and access requirements, enabling the system to scale and reconfigure without sacrificing stability, as the dynamics occur at the storage device level rather than requiring system-wide reconfiguration.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8930364B1Intelligent data integration
Publication Date: 2015.01.06 AMAZON TECH INC
  • US8930364B1 patent drawing
  • US8930364B1 patent drawing
  • US8930364B1 patent drawing

AI summary

A storage controller is implemented for controlling a storage system. The storage controller may be implemented using a distributed computer system and may include components for servicing client data requests based on the characteristics of the distributed computer system, the client, or the data requests. The storage controller is scalable independently of the storage system it controls. All components of the storage controller, as well as the client, may be virtual or hardware-based instances of a distributed computer system.