Value log-based checkpoint implementation method and system, storage medium and equipment

An implementation method and system implementation technology, applied in the database field, can solve problems affecting system operation and occupying a large memory space, and achieve the effect of shortening recovery time and small completion time

Pending Publication Date: 2022-01-28
JIANGSU DAMENG DATABASE CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, because traditional checkpoints have to wait for all "dirty" data pages to be flushed, on the one hand, "dirty" data pages need to occupy a large amount of memory space until the corresponding pages are flushed (corresponding to random write operations); These "dirty" pages maintain a locked state to prevent data from being modified by subsequent update transactions, affecting system operation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Value log-based checkpoint implementation method and system, storage medium and equipment
  • Value log-based checkpoint implementation method and system, storage medium and equipment
  • Value log-based checkpoint implementation method and system, storage medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The present invention will be further explained below in conjunction with the accompanying drawings and specific embodiments.

[0034] The Chinese invention patent application with the application number of 2021107280253 discloses a value log implementation method for the integration of data and logs, in which the value log realizes only sequential writing and avoids writing multiple copies of data in the persistence process of the database and data processing system advantage. Based on the aforementioned invention patent application, the present invention proposes a checkpoint implementation method, such as figure 1 As shown, it specifically includes the following steps:

[0035] S1. During the implementation of the value log, the insertion operation is stored in the memory;

[0036] In the Chinese invention patent application with application number 2021107280253, the implementation process of the value log is: (1) the working thread or process in the data processin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a value log-based checkpoint implementation method and system, a storage medium and equipment, and the method comprises the steps: S1, storing an insertion operation in a memory in a value log implementation process; S2, acquiring a log serial number corresponding to a current check point of a value log system; S3, freezing and storing the memory area of the insertion operation, and changing the attribute of the memory area into read-only; adding the frozen memory area into a to-be-written disk queue, and setting a new writable area for storing insertion operation in the memory; S4, writing to-be-written content into the disk queue into a disk; and S5, writing the log serial number corresponding to the current check point into a check point control file in the disk. According to the method, the check point operation time and the recovery time during downtime can be shortened.

Description

technical field [0001] The invention belongs to the technical field of databases, and in particular relates to a value log-based checkpoint realization method, system, storage medium and equipment. Background technique [0002] Due to the large gap between the speed of the CPU and the speed of the disk, various databases and key-value and other data processing systems are introduced into the data buffer pool, and the data pages of the database are loaded into the buffer pool of the memory. The data update is done in the buffer pool, which means that the data pages are "dirty", that is, the data pages in the buffer pool are newer than the pages in the data files on the disk, and some mechanisms need to be used to refresh the data pages in the buffer plate. [0003] If you start flushing every time a data page is changed, the performance of the database will become very poor. At the same time, if a downtime occurs at this time, the data cannot be recovered. In order to ensu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/07G06F9/50G06F16/18
CPCG06F11/0787G06F9/5016G06F16/1815
Inventor 王学海付新张静修许雄凌
Owner JIANGSU DAMENG DATABASE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products