Backup Data Transfer Using Offset Table Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing backup generation methods in computing devices inefficiently utilize computing resources, leading to increased time and resource consumption when handling large backups, as they typically rely on serial data transfer and storage processes.

Innovation Solution

A method and system that divide backups into sub-portions using an offset table, allowing for parallel or partially overlapping data stream transfers to backup storage, thereby reducing the time and resource requirements for backup generation and storage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If serial data transfer and storage processes are used for backup generation, then the backup process is simple to implement, but the time and resource consumption increases significantly

Engineering Contradiction:
Improvebackup generation speedVSAvoidbackup transfer time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The backup data is divided into multiple sub-portions using an offset table that maps data blocks to their locations. This segmentation enables parallel transfer of multiple sub-portions through different data streams simultaneously, dramatically improving backup generation speed and reducing total transfer time compared to serial processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from one-dimensional serial data transfer to multi-dimensional parallel data streams. By utilizing multiple data streams operating simultaneously, the system adds temporal and spatial dimensions to the transfer process, enabling concurrent transmission of multiple sub-portions and significantly reducing overall backup time.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If multiple data streams are used for parallel backup transfer, then backup time is reduced, but system complexity increases

Engineering Contradiction:
Improvebackup transfer efficiencyVSAvoiddata stream management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The offset table is generated in advance during the data allocation analysis phase, before the actual backup transfer begins. This preliminary action organizes all data blocks and determines their locations and mappings to sub-portions beforehand, simplifying the complexity of managing multiple data streams during the transfer phase by having all routing decisions pre-computed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The offset table serves as an intermediary data structure that mediates between the source data and the multiple data streams. It provides a clear mapping relationship that simplifies the management of parallel data streams by translating data block locations into transfer instructions, reducing the complexity of coordinating multiple simultaneous transfers.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11093350B2Method and system for an optimized backup data transfer mechanism
Publication Date: 2021.08.17 EMC IP HLDG CO LLC
  • US11093350B2 patent drawing
  • US11093350B2 patent drawing
  • US11093350B2 patent drawing

AI summary

A method for processing backup generation requests includes receiving a backup generation request; in response to receiving the backup generation request: identifying a backup to transfer to a backup storage, the backup includes data blocks; performing a data allocation analysis on the backup to generate an offset table; dividing, based on at least the offset table, the backup into sub-portions, each of the sub-portions includes at least one of the data blocks; and transferring, using at least two data streams, at least two of the sub-portions to a backup storage.