Dynamic Over-Provisioning for SSD Write Amplification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional storage management systems for solid state disks in network services face issues with fixed storage capacities, leading to frequent data cleaning and reduced service life, especially for services with high traffic, as they cannot dynamically adjust over-provisioning storage to manage write amplification effectively.

Innovation Solution

A storage management method and apparatus that dynamically adjust the over-provisioning storage capacity based on real-time writing amounts, using pre-stored correspondences to determine and configure the appropriate over-provisioning storage and data cleaning thresholds, thereby reducing the frequency of data cleaning and extending the service life of solid state disks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If fixed capacity storage is allocated to each network service, then storage management is simple, but storage is easily filled for high-traffic services, resulting in frequent data cleaning and reduced service life

Engineering Contradiction:
Improvestorage management complexityVSAvoidservice life of solid state disk
Core Design Contradiction:
Device complexityVSDuration of action of stationary object

Solution Approach 1:

The patent implements dynamic adjustment of over-provisioning storage capacity based on real-time writing amounts. The system monitors the writing amount of service data and automatically adjusts the over-provisioning storage capacity according to pre-stored correspondences, transforming the static fixed-capacity allocation into a dynamic adaptive system that responds to actual traffic conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of over-provisioning storage capacity from a fixed value to a variable that adjusts according to writing amount. By establishing correspondences between different writing amount ranges and corresponding over-provisioning storage capacities, the system dynamically optimizes storage parameters to reduce write amplification and extend service life.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If fixed over-provisioning storage is allocated, then configuration is simple, but data cleaning frequency increases for high-traffic services, causing write amplification and storage block damage

Engineering Contradiction:
Improvestorage configuration simplicityVSAvoiddata cleaning frequency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously monitors the writing amount of service data and uses this information to adjust the over-provisioning storage capacity. The storage management device receives feedback about actual usage patterns and automatically adjusts storage allocation, creating a closed-loop system that optimizes performance based on real conditions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The storage management system automatically adjusts over-provisioning storage capacity without requiring manual intervention. The system serves itself by monitoring its own usage patterns and making autonomous decisions about storage allocation based on pre-configured correspondences between writing amounts and optimal over-provisioning levels.

Inventive Principle:
Principle #25Self-service

3Quantity of substance

If over-provisioning storage is increased, then storage capacity is sufficient, but storage management complexity increases

Engineering Contradiction:
Improvestorage capacityVSAvoidstorage management complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-storing correspondences between different writing amount ranges and their corresponding optimal over-provisioning storage capacities. This advance preparation allows the system to quickly determine appropriate storage allocation without complex real-time calculations, reducing management complexity while ensuring sufficient storage capacity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3392754B1Method and apparatus for managing storage device
Publication Date: 2022.10.19 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • EP3392754B1 patent drawingFigure 1~2
  • EP3392754B1 patent drawingFigure 3
  • EP3392754B1 patent drawingFigure 4~5

AI summary

Disclosed are a method and apparatus for managing a storage device, falling within the technical field of computers. The method comprises: detecting, within a pre-set duration, a first unit duration writing capacity of service data of a target network service in a target storage device; according to a correlation between a pre-stored unit duration writing capacity and a redundant space capacity, determining a first redundant space capacity corresponding to the first unit duration writing capacity, wherein in the correlation, the redundant space capacity is increased with the increase of the unit duration writing capacity; and setting a redundant space of the target network service in the target storage device according to the first redundant space capacity. By means of the present invention, the service life of the target storage device can be prolonged.