Single Instance Storage via Multicast Check Exist
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current storage networks lack efficient mechanisms for managing data storage and retrieval across multiple storage targets in a multicast environment, leading to redundancy and inefficient resource utilization.
Innovation Solution
The implementation of a multicast group within a local area network, where a storage initiator device sends 'check exist' messages to storage targets to determine data segment availability, and based on responses regarding capacity, load, health, and proximity, selects optimal targets for storage or retrieval.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored on multiple storage targets without coordination, then data redundancy increases, but storage efficiency deteriorates
Solution Approach 1:
The system performs a 'check exist' operation before storing data by multicasting a query message to all storage targets in the group. This preliminary action determines whether the data segment already exists on any storage target, preventing redundant storage operations and improving storage efficiency while maintaining data redundancy through coordinated multi-target storage
2Reliability
If storage requests are sent to all storage targets, then data retrieval completeness improves, but network traffic increases
Solution Approach 1:
Before retrieving data, the system multicasts a 'check exist' message to all storage targets to determine which targets have the required data segment. This preliminary action enables the system to send retrieval requests only to storage targets that actually have the data, ensuring retrieval completeness while minimizing unnecessary network traffic
Solution Approach 2:
Storage targets respond to 'check exist' messages with presence/absence information about the requested data segment. This feedback mechanism allows the storage initiator to identify which storage targets have the required data and direct retrieval requests accordingly, reducing network traffic while maintaining retrieval completeness
3Quantity of substance
If data segments are distributed across multiple storage targets, then storage capacity utilization improves, but data management complexity increases
Solution Approach 1:
The system combines multiple storage targets into a unified multicast group, managing them as a single logical unit. Data segments are distributed across multiple storage targets to improve capacity utilization, while the multicast group abstraction simplifies management by allowing single operations to interact with all members simultaneously, reducing the perceived complexity for the storage initiator
Data Source
AI summary
A method and computer program product for defining a multicast group within a local area network. The multicast group includes a storage initiator device and a plurality of storage targets. Each of the plurality of storage targets includes a storage index that identifies one or more data segments stored on the storage target. A write request for storing a data segment within the multicast group is received on the storage initiator device. A “check exist” message is generated that defines the data segment to be stored within the multicast group. The “check exist” message is multicast to the plurality of storage targets included within the multicast group.