Split File System Compliance Architecture with Adaptive Throttling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing file system scanning methods use a monolithic architecture that intermixes scanning and checking, leading to performance perturbations and only partial scanning, resulting in undetected compliance violations due to lock occupation on file inodes, which hinders timely compliance checks.
Innovation Solution
A split detector architecture with functionally distinct collector and analyzer components, utilizing feedforward profiling and scheduling with feedback for individual and adaptive throttling to independently manage performance and resource consumption, allowing for full or partial file system scans while minimizing perturbation to the production system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a monolithic architecture is used where scanning and checking are intermixed, then the system structure is simple, but performance perturbation occurs and only partial scanning is possible due to lock occupation on file inodes
Solution Approach 1:
The patent divides the monolithic scanning system into two independent components: a collector that gathers file system metadata and an analyzer that checks compliance rules. This segmentation allows the collector to acquire file inodes without being blocked by lock contention, enabling complete scanning while the analyzer processes compliance checks separately, thus resolving the contradiction between structural simplicity and scanning completeness.
2Reliability
If scanning operations occupy locks on file inodes, then compliance checking can be performed, but other software including client business applications cannot access the same files
Solution Approach 1:
The patent extracts the compliance checking function from the file access operation. The collector gathers file metadata and file inodes without requiring exclusive locks, then passes this data to the analyzer which performs compliance checking separately. This extraction allows file accessibility to be maintained during collection while compliance checking proceeds independently, resolving the contradiction between reliability and ease of operation.
3Measurement precision
If a full file system scan is conducted to ensure compliance, then compliance violations can be detected, but resource consumption and performance perturbation increase
Solution Approach 1:
The patent implements dynamic throttling mechanisms that adjust the scanning and analysis rates based on system conditions and Service Level Objectives. The collector and analyzer can be independently throttled to optimize resource consumption while maintaining compliance detection accuracy. This dynamic adjustment allows full scanning capability to be preserved when needed while reducing resource consumption during normal operations, resolving the contradiction between measurement precision and energy use.
Data Source
AI summary
A method of checking file system compliance including receiving a plurality of compliance rules corresponding to a file system of a production system, collecting, by a collector, file system meta data from the file system, analyzing, by an analyzer, the file system meta data using the plurality of compliance rules to determine at least one compliance deviation of the file system, and throttling the collector and the analyzer independently of one-another, wherein the collector and the analyzer are configured according to a model of performance for the production system and a schedule for the collection and analyzing.