Universal Connector for NAS Incremental Backup via Block Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current systems for managing backups in network attached storage (NAS) face inefficiencies in handling large numbers of files, incremental backups, and resource management, leading to suboptimal performance and bandwidth utilization.

Innovation Solution

The implementation of a universal connector that provides multi-threaded, protocol-agnostic data storage management services, enabling batching of small files, incremental metadata processing, feedback-based batching based on resource availability, parallel processing of large folders, intelligent caching, and block-based incremental backups to optimize backup operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If file-based incremental backups are performed in NAS systems, then backup functionality is provided, but the number of roundtrips increases and backup efficiency decreases

Engineering Contradiction:

Improvebackup efficiencyVSAvoidnumber of roundtrips

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent combines multiple metadata requests into a single batched request, merging multiple separate roundtrips into one consolidated communication between the client device and NAS server. This reduces the total number of roundtrips required for incremental backups while maintaining the ability to track individual file changes.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent segments the backup process into distinct phases: metadata collection, change detection, and data transfer. By separating metadata processing from actual backup data transfer, the system can efficiently identify only changed files without transferring entire datasets, reducing unnecessary roundtrips and improving backup efficiency.

Inventive Principle:

Principle #1Segmentation

2Reliability

If all files are processed for backup, then complete backup coverage is achieved, but resource utilization becomes suboptimal

Engineering Contradiction:

Improvebackup coverageVSAvoidresource utilization

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent extracts only the metadata necessary for change detection from the full file set, separating this lightweight operation from the actual backup data transfer. By processing only metadata initially and then identifying only changed files, the system achieves complete backup coverage while optimizing resource utilization by avoiding unnecessary processing of unchanged files.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs partial processing by collecting metadata for all files but only transferring data for changed files. This partial action approach ensures complete coverage (all files are monitored) while optimizing resources (only necessary data is transferred), resolving the contradiction between reliability and productivity.

Inventive Principle:

Principle #16Partial or excessive action

3Measurement precision

If metadata is processed for every file, then accurate change detection is achieved, but data generation and processing overhead increase

Engineering Contradiction:

Improvechange detection accuracyVSAvoiddata generation

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent merges multiple individual metadata requests into a single batched request, reducing the total volume of data transmitted while maintaining the ability to detect changes in individual files. This consolidation preserves measurement precision for change detection while significantly reducing data generation and processing overhead.

Inventive Principle:

Principle #5Merging (Combining)

4Reliability

If incremental backups are performed frequently, then data protection is improved, but bandwidth utilization becomes suboptimal

Engineering Contradiction:

Improvedata protectionVSAvoidbandwidth utilization

Core Design Contradiction:

ReliabilityVSLoss of energy

Solution Approach 1:

The patent extracts only the essential metadata needed for change detection, separating this lightweight operation from full data transfers. This allows frequent incremental backups to be performed with minimal bandwidth consumption, as only metadata and subsequently only changed file data are transmitted, not entire datasets.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs partial data transfers by sending only changed files rather than complete datasets. This partial action enables frequent backups that maintain strong data protection while optimizing bandwidth utilization by transmitting only the necessary portions of data.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS12153498B2System and method for generating incremental backups for file based backups stored in a network attached storage

Publication Date: 2024.11.26 DELL PROD LP

AI summary

A method for managing data includes obtaining, by a universal connector, a backup request for an incremental backup of a set of files, in response to the backup request: sending a file extent request to a network attached storage (NAS) server, obtaining, from the NAS server, a set of file extents associated with data of the set of files, performing a block-based analysis on the set of file extents using a stored data block table to determine a subset of data blocks, sending a data access request based on the subset of data blocks, obtaining a response from the NAS server, wherein the response comprises the subset of data blocks, and initiating a backup of the set of files using the subset of data blocks.