A log writing and synchronization method, device, system, and computer storage medium

Abstract

The invention discloses a log writing method and device, a system and a computer storage medium. The method comprises the steps that an end point page number which is written into a log is read from avariable area of a log disk; the log is written into a data area page corresponding to the end point page number to form a log page; the writing position corresponding to the log page and a data section number which the log page belongs to are acquired and stored into a bitmap area of the log disk; in the variable area of the log disk, one is added to the end point page number which is written into a log, and whether or not the log is written to a tail disk of the log disk is judged; if yes, an end point which is written into the log is set to a disk head.

Description

technical field [0001] The invention relates to the field of computer storage, in particular to a method, device, system, and computer storage medium for log writing and synchronization based on solid-state hard disks. Background technique [0002] In storage systems, high reliability, high performance, and low cost are the most important and contradictory three major indicators. Journal technology is an effective means to ensure high reliability and high performance of the system. Many storage systems have introduced log technology, such as EXT3, EXT4, XFS, JFS, F2FS, NTFS, Btrfs, CEPH, etc. [0003] In the log technology, the operation of the storage system on data (including creation, addition, modification, deletion, etc.) is first encapsulated into a log and recorded in the log disk. At regular intervals (or when the log disk is about to be filled), the storage system will actually write the data content to the data disk according to the log. This process is called lo...

AI Technical Summary

Problems solved by technology

[0006] Problem 1: Poor system scalability

The log disk partition leads to poor system scalability, and the number of partitions is difficult to increase or decrease at will, so the system scale cannot be expanded

[0007] Problem 2: Unbalanced storage space

The busyness of each data disk is different, which makes it impossible to balance the storage space of each log disk partition, resulting in waste of individual log disk partition space and saturation of individual log disk partitions

[0008] Problem 3: Damage to SSD lifespan

The old log technology uses an in-place update method when writing. This method does not take into account the erase-before-write characteristics of solid-state drives, so it has a relatively large negative impact on the life of solid-state drives, which also causes the cost of the storage system. high

[0009] Problem 4: Log writing is inefficient

[0011] Problem 5: Log synchronization is inefficient

During log synchronization, due to scattered logs, a large number of random reads are caused, which makes log synchronization inefficient

[0012] Problem 6: Log deletion is inefficient

The validity status of the log needs to be additionally recorded, and the log must be deleted immediately after the log is synchronized. However, the erase operation of the solid-state drive is performed in units of blocks rather than pages, resulting in a large amount of effective data relocation, which affects the performance and performance of the solid-state drive. negative impact on longevity

Images