Content Addressed Storage Translation to Hierarchical Directory

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Content-addressed storage (CAS) systems face challenges in adopting new storage technology advancements due to their specialized nature, leading to a lack of integration with general-purpose storage systems and hindering compatibility with contemporary technology developments.

Innovation Solution

A method is introduced to translate legacy CAS applications into a file-oriented interface using general-purpose NAS systems, employing a two-step mapping process to convert content addresses into multi-level directory names, allowing CAS-dependent applications to utilize contemporary storage technologies while maintaining backward compatibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If CAS systems use specialized hardware and software platforms optimized for CAS storage, then CAS functionality is provided effectively, but the systems cannot benefit from economies of scale and cannot incorporate new storage technology advancements

Engineering Contradiction:
Improveability to incorporate new storage technologyVSAvoidspecialized hardware and software platform
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a translation layer that acts as an intermediary between CAS applications and NAS file systems. This translation layer converts CAS operations (content-addressable storage/retrieval) into NAS file system operations, allowing CAS functionality to run on general-purpose NAS infrastructure without requiring specialized hardware or software platforms.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent enables general-purpose NAS systems to perform CAS functions through the translation layer. By making the NAS file system capable of emulating CAS behavior, the system achieves multi-functionality where a single platform can serve both traditional file storage and content-addressed storage needs, eliminating the need for specialized CAS hardware.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If all data objects are stored in one single directory using content address as file name, then CAS data model is implemented, but practical limits of NAS file systems are violated

Engineering Contradiction:
ImproveCAS data model implementationVSAvoidNAS file system stability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent segments the flat CAS namespace into a hierarchical directory structure by applying a hash function to the content address and using the hash output to determine directory paths. This segmentation distributes files across multiple directories rather than placing them all in a single directory, respecting NAS file system limitations while preserving CAS functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the content address parameter from being used directly as a filename into being processed through a hash function to generate directory path components. This parameter transformation allows the system to maintain the content-addressable nature of CAS while adapting to the hierarchical structure requirements of NAS file systems.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If specialized CAS platforms are used, then best CAS performance is achieved, but ongoing development costs cannot be amortized across large number of sold products

Engineering Contradiction:
ImproveCAS storage performanceVSAvoiddevelopment cost amortization
Core Design Contradiction:
ProductivityVSEase of manufacture

Solution Approach 1:

The patent merges CAS functionality with general-purpose NAS systems by introducing a translation layer. This combination allows the benefits of specialized CAS performance to be achieved through software translation rather than dedicated hardware, enabling the same NAS infrastructure to serve both file storage and CAS workloads, thereby amortizing development costs across a larger product base.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS8977662B1Storing data objects from a flat namespace in a hierarchical directory structured file system
Publication Date: 2015.03.10 EMC IP HLDG CO LLC
  • US8977662B1 patent drawing
  • US8977662B1 patent drawing
  • US8977662B1 patent drawing

AI summary

Storing and retrieving user data files includes, in a file storing operation, applying a first mapping (e.g. hash function) to a file identifier to originate a content address in a flat content address space; applying a second mapping (e.g., grouping of digits/characters) to the content address to originate a multi-level directory name usable in a file system; invoking the file system to store the user data file in the named directory. A file retrieving operation includes applying the first mapping to the file identifier to regenerate the content address; applying the second mapping to the regenerated content address to regenerate the directory name; invoking the file system using the regenerated directory name to retrieve the user data file. The method enables a general-purpose network attached storage (NAS) system to store files organized according to a legacy content-addressed storage (CAS) model of existing applications.