Distributed File System Node Data Accumulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In relay multiplexing of distributed file systems, data often accumulates on intermediate nodes due to communication delays, leading to inefficiencies and increased storage needs.
Innovation Solution
A distributed file system architecture where incremental data is generated, stored, and transmitted among nodes, with a mechanism to merge and delete accumulated data on intermediate nodes, reducing the need to send it further downstream.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If relay multiplexing is used to update replication data, then load concentration on specific computer nodes is prevented, but data accumulation on intermediate nodes occurs when communication delays happen
Solution Approach 1:
The patent extracts the problem of data accumulation by introducing a deletion mechanism that removes unnecessary incremental data from intermediate nodes. The controlling unit identifies and deletes incremental data that has been successfully transmitted to downstream nodes, thereby removing the harmful accumulation effect while preserving the relay multiplexing structure for reliability.
Solution Approach 2:
The patent implements feedback by having the controlling unit track transmission status of incremental data. When the controlling unit receives confirmation that incremental data has been successfully transmitted to downstream nodes, it uses this feedback information to delete the transmitted data from its local storage, preventing accumulation.
2Reliability
If incremental data is continuously transmitted downstream, then file system multiplexing is maintained, but communication and storage resources are wasted on data that has already been delivered
Solution Approach 1:
The patent extracts unnecessary data transmission by implementing a deletion mechanism. The controlling unit identifies incremental data that has already been successfully transmitted to downstream nodes and deletes it from local storage, thereby extracting the redundant data that would otherwise continue to be stored and potentially re-transmitted.
Solution Approach 2:
The patent uses feedback from transmission status tracking to optimize resource usage. The controlling unit monitors whether incremental data has been successfully transmitted downstream and uses this feedback to delete the data from local storage, preventing wasted storage resources and avoiding redundant transmission attempts.
Data Source
AI summary
A computer node connected with an upstream computer node and a downstream computer node so as to be capable of communicating therewith has a replication file system of a master file system, a storing unit, and a controlling unit. The controlling unit receives incremental data showing a changed part of the master file system from the upstream computer node, stores the incremental data into the storing unit, reflects the incremental data on the file system, and transfers the incremental data to the downstream computer node. Moreover, in a case that incremental data for plural times having received from the upstream computer node and having not transferred to the downstream computer node yet are accumulated in the storing unit, the controlling unit merges, with last received incremental data among the incremental data for plural times, the rest of the incremental data for plural times.