Profile Engine for Distributed File System Change Notification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Distributed file systems face challenges in reliably distributing change information across nodes due to their distributed nature, leading to inconsistencies and potential disruptions in service availability.

Innovation Solution

A system with a master node and client nodes, utilizing a profile catalog and profile registers to manage configuration information, where change actions are executed based on parameter identifiers, and recovery actions are taken to restore quorum and consistency across the file system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If change information is distributed across nodes in a distributed file system, then configuration flexibility and scalability are improved, but consistency and reliability of change distribution deteriorate

Engineering Contradiction:
Improveconfiguration flexibilityVSAvoidconsistency of change distribution
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces a profile engine as an intermediary component that mediates between configuration changes and node distribution. The profile engine receives change information, validates it against the profile catalog, and coordinates distribution across nodes, ensuring consistency while maintaining the distributed architecture's flexibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback mechanisms where nodes report status back to the profile engine after receiving change information. The profile engine tracks distribution status and can trigger recovery actions if inconsistencies are detected, ensuring reliable propagation of configuration changes across the distributed system.

Inventive Principle:
Principle #23Feedback

2Reliability

If distributed file system nodes operate independently, then system availability and fault tolerance are improved, but coordination of configuration changes and quorum restoration becomes more difficult

Engineering Contradiction:
Improvesystem availabilityVSAvoidcoordination complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The profile engine serves as a coordinating intermediary that manages quorum status and configuration distribution without centralizing control. It enables independent node operation while providing the necessary coordination for configuration changes and quorum restoration, reducing coordination complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary validation of configuration changes against the profile catalog before distribution. This preliminary action ensures that only valid changes are propagated, simplifying subsequent coordination and quorum restoration processes by preventing invalid states from occurring in the first place.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If configuration changes are propagated across all nodes, then system consistency is improved, but service disruption and latency increase

Engineering Contradiction:
Improveconfiguration consistencyVSAvoidservice disruption time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The profile engine implements partial propagation by distributing configuration changes only to nodes that need them, based on the profile catalog. This selective approach maintains consistency where required while minimizing unnecessary propagation to nodes where changes are not applicable, reducing service disruption time.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary validation and preparation of configuration changes before distribution. By pre-validating changes against the profile catalog and preparing distribution plans, the system minimizes the actual propagation time and reduces service disruption while ensuring consistency.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10860414B1Change notification in distributed file systems
Publication Date: 2020.12.08 QUMULO INC
  • US10860414B1 patent drawing
  • US10860414B1 patent drawing
  • US10860414B1 patent drawing

AI summary

Embodiments are directed to managing data in a file system over a network. A file system that includes a master node and client nodes may be provided. A master quorum value and a client quorum value having the same value may be provided. A profile catalog associated with the master node that includes parameters may be provided. Profile registers associated with the client nodes may be provided. Change actions may be executed on each client node based on change information provided by the master node. In response to errors, access to the file system may be suspended; the master quorum value may be modified to indicate that the file system is out of quorum; recovery actions may be executed; the client quorum value at each client node may be modified to correspond with the master quorum value; and access to the file system may be restored.