SDN Network Path Module for Distributed File System Block Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current distributed file systems, such as Hadoop, do not consider real-time network conditions and service level agreements (SLA) when placing file block replicas, leading to inefficient network usage and potential congestion, which can fail to meet clients' timing and service level requirements.
Innovation Solution
A network path determination module that utilizes Software Defined Networking (SDN) to assess real-time cluster topology and network status, evaluate the impact of block placement options on SLA and QoS requirements, and select an optimal block placement path, allocating resources to support data transfers efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If block placement is done without considering real-time network conditions, then placement simplicity is maintained, but network congestion occurs and SLA/QoS requirements are not met
Solution Approach 1:
The patent introduces a block placement module as an intermediary component that sits between the file manager node and storage nodes. This module receives block placement requests, evaluates multiple candidate placement options by simulating different scenarios, and selects the optimal placement that satisfies SLA and QoS requirements. The intermediary handles the complexity of network condition assessment and placement optimization, shielding the rest of the system while ensuring reliable block placement decisions.
2Productivity
If traditional block placement is used without network status consideration, then placement speed is fast, but network resource allocation is inefficient
Solution Approach 1:
The block placement module performs preliminary actions by proactively assessing network conditions and evaluating multiple candidate block placement options before actual placement occurs. It simulates different placement scenarios and predicts their impact on network resources and SLA compliance. This preliminary evaluation ensures that when placement decisions are made, they are optimized for network resource allocation efficiency while maintaining acceptable placement speeds through parallel evaluation of candidates.
3Reliability
If multiple candidate block placement options are evaluated, then placement optimization improves, but computational overhead increases
Solution Approach 1:
The block placement module applies partial action by evaluating multiple candidate placement options but not necessarily all possible combinations. It generates a set of candidate placements and evaluates them based on network conditions and SLA requirements, selecting the optimal one without exhaustively searching every possibility. This approach achieves sufficient placement optimization while limiting computational overhead by focusing on the most promising candidates rather than all possible scenarios.
Data Source
AI summary
The disclosure provides a network path determination module, a method of determining a network path, and a non-transitory storage medium which stores computer readable instruction to execute functions related to the method of determining a network path. In an aspect, the network path determination module includes not limited to: a first port; a non-transitory storage medium; and a processor coupled to the non-transitory storage medium, configured at least to: receive, through the first port, a requested generated by a detected data flow to create a forwarding entry in a network node for the data flow; retrieve a current network topology and a network status; select a network path based on the current network topology and the network status; generate a network control instruction based on the network path which has been selected; and execute the network control instruction to forward the data flow on the network path.