Storage-Layer Name Space Propagation for Edge Node Caching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face inefficiencies due to the use of application-layer protocols for managing data changes across networks, leading to increased latency and complexity in accessing data, especially when dealing with large volumes of digital data and geo-scale content distribution.
Innovation Solution
Implementing storage-layer replication protocols and object-level caching mechanisms to efficiently distribute and manage name and object space information, allowing edge nodes to access data by monitoring inode changes and caching content for reduced latency and improved scalability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If application layer protocols are used to manage data changes across networks, then content management functionality is provided, but latency increases and system complexity increases
Solution Approach 1:
The patent introduces a name space propagation mechanism that acts as an intermediary between the storage system and edge nodes. This intermediary propagates name space information (inode metadata) to edge nodes using storage-layer protocols, enabling them to cache and serve content locally without requiring continuous application-layer polling or complex protocol overhead, thus reducing latency while maintaining content management functionality
Solution Approach 2:
The patent replaces the application-layer protocol mechanism with a storage-layer protocol mechanism for name space propagation. By substituting the higher-level application-layer communication with lower-level storage-layer communication, the system achieves more efficient data distribution with reduced latency and simpler operation
2Ease of operation
If application layer protocols are used to manage data changes, then content management is enabled, but device complexity increases
Solution Approach 1:
The name space propagation mechanism serves as an intermediary that simplifies the interaction between storage systems and edge nodes. By propagating name space information (inode metadata) to edge nodes, the system eliminates the need for complex application-layer protocols and continuous polling mechanisms, reducing overall system complexity while maintaining content management capabilities
Solution Approach 2:
The patent substitutes complex application-layer protocol mechanisms with simpler storage-layer protocol mechanisms. This substitution reduces the complexity of data change management by operating at a lower protocol layer that inherently provides more efficient and simpler communication primitives
3Reliability
If storage system continuously polls for changes, then name space updates are captured, but productivity decreases
Solution Approach 1:
The storage system uses self-service mechanisms to track and propagate name space changes. Instead of continuously polling for changes, the system leverages the existing change tracking capabilities within the storage system itself to identify and propagate only the necessary name space information to edge nodes, improving efficiency while maintaining update accuracy
Solution Approach 2:
The system implements periodic name space propagation rather than continuous polling. By propagating name space information at appropriate intervals or when changes are detected, the system achieves reliable name space updates without the overhead of continuous polling, thus improving productivity
4Device complexity
If data is stored at central repository only, then storage management is simplified, but access latency increases for geo-scale distribution
Solution Approach 1:
The patent segments the centralized storage model into a distributed architecture where edge nodes cache and serve content locally. By segmenting the storage function across multiple nodes (central repository plus edge nodes), the system reduces access latency for geo-scale distribution while maintaining manageable complexity through automated name space propagation mechanisms
Solution Approach 2:
The system performs preliminary action by propagating name space information to edge nodes in advance, enabling them to cache content before it is requested. This preliminary preparation of name space data and content caching at edge nodes significantly reduces access latency when users request data, while the automated propagation keeps management complexity low
Data Source
AI summary
Systems and methods efficiently distribute information, such as path name, attributes and object information, corresponding to changes in a content repository to remote nodes in a network using storage-layer/object-based protocols. A difference monitoring client monitors name space and object space changes by identifying inodes which have been modified on storage volumes between two or more snapshots. The monitoring client builds a list which may include name information, object space information and attributes such as file size and permissions for each of the changed inodes that is utilized to update the edge nodes. Systems and methods also provide for geo-scale content distribution from a central repository to edge nodes using a storage-layer/object protocol. A caching mechanism is utilized to cache requested content at an edge node. Cached content may be maintained at the edge node during use and/or for an additional predetermined period. Difference monitoring client may track such cached content.