Transparent Data Movement Between Private Cloud and Storage Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Storing enterprise data on high-speed storage devices like solid state drive arrays is costly per byte and resource-intensive, while slower storage devices like hard disk drives are more economical but less suitable for frequently accessed data, necessitating a solution for efficient data movement between different storage systems.
Innovation Solution
The solution involves separating metadata from data contents in a private cloud storage ecosystem, allowing for independent operation, and enabling transparent data movement between the private cloud and other storage systems, including local and external storage, without altering the client's workflow or mount points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data is stored on high-speed storage devices like solid state drive arrays, then data access speed is improved, but storage cost per byte increases
Solution Approach 1:
The patent segments data into metadata and data contents, storing metadata on high-speed storage devices while data contents are stored on lower-cost storage devices. This allows the system to maintain fast access for metadata operations while reducing overall storage costs for large data volumes.
Solution Approach 2:
The patent introduces a storage management system that acts as an intermediary between clients and storage devices. This mediator transparently manages data movement between different storage types based on access patterns, allowing high-speed access when needed while optimizing for cost when access frequency is low.
2Quantity of substance
If data is stored on slower storage devices like hard disk drives, then storage cost per byte is reduced, but data access speed deteriorates
Solution Approach 1:
The patent segments data into metadata and data contents, storing metadata on high-speed storage devices while data contents are stored on lower-cost storage devices. This allows the system to maintain fast access for metadata operations while reducing overall storage costs for large data volumes.
Solution Approach 2:
The patent implements dynamic data movement between different storage devices based on access patterns. Data that is accessed frequently is automatically moved to high-speed storage, while data that is accessed less frequently remains on lower-cost storage, optimizing both performance and cost continuously.
3Device complexity
If metadata and data contents are stored together, then system complexity is reduced, but data movement flexibility is limited
Solution Approach 1:
The patent segments the file system into separate metadata and data contents components. This segmentation allows independent management of each component, enabling flexible data movement strategies where metadata remains on high-speed storage while data contents can be moved to various storage locations based on cost and access requirements.
Solution Approach 2:
The patent extracts data contents from the traditional file structure and stores them separately from metadata. This extraction enables the metadata to remain on high-speed storage devices for fast access, while data contents can be stored on lower-cost devices, providing flexibility in data movement and storage optimization.
4Quantity of substance
If data is moved between storage systems, then storage cost is optimized, but transparency of access is compromised
Solution Approach 1:
The patent introduces a storage management system that acts as an intermediary between clients and storage devices. This mediator transparently manages data movement between different storage types based on access patterns, allowing high-speed access when needed while optimizing for cost when access frequency is low.
Solution Approach 2:
The patent maintains metadata copies that reference data contents locations. When data is moved between storage systems, the metadata is updated to reflect the new location, while clients continue to access data through the same interface, maintaining transparency without requiring data duplication.
Data Source
AI summary
The disclosure provides methods and systems for transparent data movement between a private cloud storage ecosystem and another storage system. The other storage system may be local storage or external storage separate and apart from the private cloud storage ecosystem. Originally, metadata and the data contents of a file are both stored on local storage in the private cloud storage ecosystem. The method separates the metadata from the data contents of a file such that the metadata and data contents are independently operable. After separation and based on policy, the data content is transparently moved between the private cloud storage system and the other storage system. The data is managed and tracked such that a user, e.g., a client or external program/entity, may access the data content using the original metadata stored on the private cloud storage ecosystem, despite the movement of the data contents to the other storage system.


