Data processing method, system and device, storage system and medium

Abstract

The embodiment of the invention provides a data processing method, system and device, a storage system and a medium. The method comprises the steps of receiving a logic address corresponding to to-be-processed data; storing the logic address into a first storage pool as a first access unit; when the number of the first access units stored in the first storage pool meets the requirement, the multiple first access units are combined into a logic address group, the logic address group serves as a second access unit to be stored in the second storage pool, and data are processed based on the second access unit. Since the first access unit in the first storage pool is provided with the small access unit and the mapping table, data writing or reading can be realized based on the first storage pool, and the second storage block in the second storage pool supports the large access unit and the large mapping table, so that partial data writing or reading based on the second storage pool is avoided, and the data writing or reading efficiency is improved. Therefore, the problems of write amplification, poor service quality and the like can be effectively relieved. And the hardware cost of the storage system can be reduced while the data storage requirement is met.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a data processing method, system, device, storage system and medium. Background technique [0002] With the development of cloud storage technology and requirements, the capacity of solid-state drives (such as SSDs) is getting larger and larger, correspondingly, it is necessary to equip solid-state drives with larger caches to store address mapping tables. The more caches used, the higher the cost. Therefore, it is necessary to find a way to reduce the cache cost. [0003] In the prior art, a large access unit (Large Access Unit, Large AU) can be introduced into the solid-state hard disk, thereby reducing the secondary mapping table (Logical Address to Physical address) managed by the flash translation layer (flash translation layer, FTL). , the number of L2P). However, when a large access unit is read, modified and written, the entire large access unit (Large AU) m...

AI Technical Summary

Problems solved by technology

Generally, an application may open hundreds of logical blocks in parallel, which needs to occupy a lot of cache space to store the corresponding sequence stream; although a large space is used, when writing data directly, it still uses a small access unit size data writing method , which in turn causes a larger write amplification

Images