Hybrid Storage Data Block Migration for Performance Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing hybrid storage technologies lack flexibility and scalability, particularly at the cluster level, and fail to optimize storage capacity and data operation speed due to fixed ratios of SSD to HDD and complex configurations based on single device mechanisms.

Innovation Solution

A dynamic method that configures storage locations of data blocks based on access frequency, migrating frequently accessed data blocks from HDD to SSD and infrequently accessed data blocks from SSD to HDD, optimizing storage performance by leveraging the strengths of both devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a fixed ratio of SSD to HDD is used in hybrid hard disk technology, then the storage system can be simplified to configure, but the system cannot be effectively adapted to different scenarios to achieve optimal cost performance ratio

Engineering Contradiction:
Improveadaptability to different scenariosVSAvoidconfiguration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic storage location adjustment where data blocks are periodically migrated between SSD and HDD based on access frequency. Frequently accessed data blocks are moved to SSD, while infrequently accessed blocks are moved to HDD. This dynamic mechanism allows the system to adapt to different access patterns and scenarios without requiring complex manual configuration, resolving the contradiction between adaptability and complexity.

Inventive Principle:
Principle #15Dynamics

2Speed

If flashcache technology adds a new cache layer between VFS and device driver, then reading performance can be accelerated, but the system configuration becomes more complex and flexibility is reduced

Engineering Contradiction:
Improvedata access speedVSAvoidsystem configuration complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent implements self-service through automatic data block migration based on access frequency statistics. The system automatically identifies frequently accessed data blocks and migrates them to SSD without requiring manual intervention or complex configuration. The migration decision is made autonomously based on predefined access frequency thresholds, simplifying the configuration while maintaining performance acceleration benefits.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If existing hybrid storage technology is applied at cluster level, then scalability can be improved, but the existing technology fails to be implemented at the cluster level due to single device mechanisms

Engineering Contradiction:
Improvescalability at cluster levelVSAvoidmechanism complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the storage system into independent data blocks that can be individually managed and migrated. Each data block is treated as an independent unit with its own access frequency statistics, allowing the mechanism to scale from single device to cluster level. The segmentation enables distributed implementation where each node can independently manage its data blocks while participating in the overall hybrid storage strategy.

Inventive Principle:
Principle #1Segmentation

4Quantity of substance

If HDD is used for large capacity storage, then storage capacity is improved, but data access speed decreases

Engineering Contradiction:
Improvestorage capacityVSAvoiddata access speed
Core Design Contradiction:
Quantity of substanceVSSpeed

Solution Approach 1:

The patent applies local quality by differentiating storage locations based on data access characteristics. Frequently accessed data blocks are stored on SSD with fast access speed, while infrequently accessed data blocks are stored on HDD with large capacity. This local differentiation allows the system to simultaneously achieve both high storage capacity and fast data access speed for critical data, resolving the contradiction between capacity and speed.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3869316B1Hybrid storage
Publication Date: 2024.01.03 BEIJING OCEANBASE TECHNOLOGY CO LTD
  • EP3869316B1 patent drawingFigure 1
  • EP3869316B1 patent drawingFigure 2
  • EP3869316B1 patent drawingFigure 3A

AI summary

Example control methods of hybrid storage are provided, which are applied to each HDD-type storage device and each SSD-type storage device in a storage system having one or more HDD-type storage devices and one or more SSD-type storage devices. Each HDD-type storage device in the storage system is connected to the SSD-type storage device. Each HDD-type storage device and each SSD-type storage device stores one or more data blocks respectively. Access information of each data block stored in a storage device is periodically acquired. A storage location of each data block in the storage system is adjusted according to the acquired access information of each data block. By using the technical solution of the present disclosure, the storage location of the data block is dynamically configured according to an access frequency so that advantages of different storage devices are fully utilized.