Storage System Deduplication Area Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In storage systems with deduplication functions, it is challenging to quickly recover and copy data sets between storage areas due to the need to determine duplicate and individual data sets, which complicates the process of updating reference destinations and managing free space effectively.

Innovation Solution

The system introduces a common area and individual area within logical storage layers, where duplicate data sets are stored in a common area and individual data sets are stored in an individual area, enabling efficient duplication determination and rapid recovery and copying of data sets by associating data sets with appropriate storage areas based on their duplication status.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If deduplication function is implemented to reduce data amount, then storage efficiency is improved, but the complexity of determining duplicate and individual data sets increases

Engineering Contradiction:
Improvedata amountVSAvoidcomplexity of determining duplicate data sets
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The storage area is segmented into a first area for storing duplicate data sets and a second area for storing individual data sets. This segmentation allows the system to efficiently manage and identify duplicate versus individual data sets by their physical location, reducing the complexity of determination while maintaining deduplication effectiveness.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If mixed storage of duplicate and individual data sets is used, then storage space utilization is improved, but the speed of recovering and copying data sets decreases

Engineering Contradiction:
Improvestorage space utilizationVSAvoidspeed of recovering data sets
Core Design Contradiction:
Quantity of substanceVSSpeed

Solution Approach 1:

The storage area is divided into distinct first and second areas for duplicate and individual data sets respectively. This spatial separation enables rapid identification and retrieval of data sets based on their location, significantly improving recovery and copying speed while maintaining effective storage space utilization through dedicated regions.

Inventive Principle:
Principle #1Segmentation

3Reliability

If reference destinations are updated for all logical addresses when copying duplicate data sets, then data consistency is improved, but the time required for copying increases

Engineering Contradiction:
Improvedata consistencyVSAvoidtime required for copying
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

By segmenting the storage area into distinct regions for duplicate and individual data sets, the system can efficiently manage reference destinations. When copying, the system leverages the structured layout to update references more effectively, maintaining data consistency across logical addresses while reducing overall copying time through organized data placement.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10739999B2Computer system having data amount reduction function and storage control method
Publication Date: 2020.08.11 HITACHI VANTARA LTD
  • US10739999B2 patent drawing
  • US10739999B2 patent drawing
  • US10739999B2 patent drawing

AI summary

A computer system connected to an external computer issuing a data input/output request and a storage device, includes a logical storage area of a first layer of the storage device and a logical storage area of a second layer of the external computer. The logical storage area of the first layer includes a common area and an individual area. A storage area of the common area is associated with one or more of the second layer's logical storage areas. A storage area of the individual area is associated with one storage area of the second layer's logical storage area. The computer system performs duplication determination on a plurality of data sets and associates a plurality of data sets determined as being duplicated with the common area to associate the storage area of the common area with a plurality of storage areas of the logical storage area of the second layer.