Dynamic Data Slice Grouping for NAS Backup Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional systems for managing network-attached storage (NAS) file systems lack the ability to prioritize data slice distribution during backups, leading to inefficient backup operations and inflexible subsequent backups due to static slice configurations that do not adapt to changes in the file system over time.

Innovation Solution

A system that performs pre-backup tasks by generating snapshots of file systems, sorting and grouping slices based on average file sizes, and dynamically adjusting slice groups to prioritize backup jobs, allowing for efficient distribution and customization of backup operations across available proxy hosts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If file systems are split into slices for backup, then backup performance is improved, but backup operations become inflexible and inefficient when file system conditions change over time

Engineering Contradiction:
Improvebackup performanceVSAvoidadaptability to file system changes
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic slice group management where slice groups are not fixed but are continuously adjusted based on current file system conditions. The system periodically re-evaluates file system characteristics and redistributes slices into new groups accordingly, making the backup system adaptable to changes in file system state while maintaining the performance benefits of sliced backups.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameters of slice group configuration based on file system conditions. By monitoring file system characteristics and adjusting slice group assignments dynamically, the system optimizes backup performance for varying conditions without requiring manual reconfiguration, thus resolving the contradiction between fixed performance optimization and adaptability.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If slice groups are dynamically adjusted based on file system conditions, then backup efficiency is improved, but system complexity increases

Engineering Contradiction:
Improvebackup efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements self-service through automated monitoring and dynamic reconfiguration of slice groups. The backup system autonomously evaluates file system conditions, determines optimal slice group assignments, and executes reconfiguration without external intervention. This automation improves backup efficiency while managing complexity by eliminating the need for manual management of dynamic adjustments.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system employs feedback mechanisms where backup performance metrics and file system condition data are continuously collected and used to adjust slice group configurations. This closed-loop control enables the system to automatically optimize backup efficiency based on actual performance feedback, managing complexity through systematic decision-making rather than ad-hoc adjustments.

Inventive Principle:
Principle #23Feedback

3Productivity

If slices are sorted and grouped based on average file sizes, then backup operations become more customizable and efficient, but the pre-backup processing time increases

Engineering Contradiction:
Improvebackup operation efficiencyVSAvoidpre-backup processing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-calculating and storing file size information and slice group assignments before backup operations commence. This advance preparation enables efficient backup execution without requiring complex real-time calculations during the backup process itself, thus reducing the impact on overall backup time while maintaining the benefits of organized slice groups.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12141034B2Method and system for grouping data slices based on average data file size for data slice backup generation
Publication Date: 2024.11.12 DELL PROD LP
  • US12141034B2 patent drawing
  • US12141034B2 patent drawing
  • US12141034B2 patent drawing

AI summary

Techniques described herein relate to a method for performing pre-backup tasks. The method includes obtaining, by a proxy host, a snapshot request associated with a full backup of a file system stored in a network attached storage (NAS) from a backup manager; in response to obtaining the snapshot request: instantiating a NAS container to obtain a snapshot of the file system; providing the snapshot to the NAS container; after providing the snapshot to the NAS container: generating, using the snapshot, slices associated with the file system; sorting the slices based on average file sizes associated with each slice; grouping the slices based on the average file sizes and group criteria to generate slice groups; generating a slice list specifying the slices and the slice groups; and providing the slice list to the backup manager.