Zero Bitmap Cache for Data Copy Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional data copy methods in storage systems require unnecessary IO operations when copying zero data, leading to performance inefficiencies, especially in complex systems with multiple storage processors.

Innovation Solution

Employing a zero bitmap in the cache to determine if a storage region is filled with zero, allowing for the omission of IO operations and direct bitmap updates, thereby reducing the number of IO operations and enhancing system performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional read-write operations are performed for data copy, then data can be copied from source to destination, but unnecessary IO operations occur when copying zero data, reducing system performance

Engineering Contradiction:
Improvedata copy speedVSAvoidtime for unnecessary IO operations
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary action by checking the zero bitmap before executing read-write operations. The cache controller checks whether the source storage region is filled with zero data by querying the zero bitmap in advance. If the source region is all zeros, the system skips the actual read operation and directly performs a write-zero operation to the destination, eliminating unnecessary data transfer and improving copy efficiency

Inventive Principle:
Principle #10Preliminary action

2Productivity

If data migration between cache and buffer is performed, then data can be copied, but the complexity of data management increases and performance decreases

Engineering Contradiction:
Improvedata copy efficiencyVSAvoidbuffer management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The invention extracts the zero-data detection functionality from the traditional read operation. Instead of performing full read operations and checking data content, the system separates the zero-checking step by querying the zero bitmap independently. This extraction allows the system to identify zero data regions and handle them differently, eliminating unnecessary data migration and simplifying buffer management

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The zero bitmap serves as an intermediary data structure that mediates between the storage system and the data copy operation. Rather than directly reading and analyzing data content, the system uses the zero bitmap as an intermediate indicator to determine whether source data is all zeros. This intermediary mechanism simplifies the complexity of data management by providing a quick reference without requiring actual data transfer

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11126353B2Method and apparatus for data copy
Publication Date: 2021.09.21 EMC IP HLDG CO LLC
  • US11126353B2 patent drawing
  • US11126353B2 patent drawing
  • US11126353B2 patent drawing

AI summary

Embodiments of the present disclosure relate to methods and apparatuses for data copy. A method comprises receiving, from a client module in a first processing unit, a read request for reading data from a first storage region. The method further comprises, in response to determining from the read request that the data is to be copied, obtaining, from a cache, a first bitmap associated with the first storage region, the first bitmap indicating if the first storage region is filled with zero. The method further comprises, in response to determining from the first bitmap that the first storage region is filled with zero, sending, to the client module, an indication that the data is zero.