Unlock instant, AI-driven research and patent intelligence for your innovation.

Data page processing method, device and system

A processing method and data page technology, applied in the database field, can solve the problems of inability to persist data pages, serious memory consumption, abnormal progress of checkpoint events, etc.

Pending Publication Date: 2020-12-18
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the synchronization delay between the master and slave nodes, when the modification is frequent, the persistence condition cannot be satisfied, and the master node cannot persist the updated data page. In this way, the checkpoint CheckPoint event of the master node advances abnormally
Moreover, due to the continuous application of redo logs to synchronize data page updates on the slave node, the Force_Cache_List linked list of the forced cache queue continues to increase, and the page elimination mechanism fails, which seriously consumes a large amount of memory on the slave node

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data page processing method, device and system
  • Data page processing method, device and system
  • Data page processing method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, but not all of them. Based on the embodiments in the present application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present application.

[0063] The technical terms involved in the embodiments of the present application will first be described below.

[0064] The log sequence number (LSN) is mainly used to recover data when a downtime occurs. LSN is an increasing integer number, indicating the total number of bytes written by the transaction to the log. LSN not only exi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data page processing method, device and system. According to the technical scheme, when hotspot data occurs and a master node frequently updates the data page, the master node can persist the currently changed data page as long as all the slave nodes at least cache the last persistent data page without waiting for all the slave nodes to complete the current change of thedata page. Thus, the persistence of the master node to the currently changed data page is decoupled from the current change of all the slave nodes, so that even if the hotspot data is updated, the check point event of the master node can be continuously propelled to execute the persistence operation of the data page, and the subsequent updating of the data page can also be normally executed; andtherefore, database anomalies are avoided.

Description

technical field [0001] The present application relates to the technical field of databases, in particular to a data page processing method, device and system. Background technique [0002] In database applications, a computing-storage separation architecture is adopted, and multiple computing nodes share data in the storage layer. In order to cope with the problem of huge data access, computing nodes usually adopt a primary-replica (Primary-Replica) architecture. The master node is responsible for writing data, and the slave node synchronizes the data update of the master node by obtaining the redo log RedoLog from the storage layer. At present, for the updated data page Page, the master node needs to perform the persistence operation after all the slave nodes complete the update of the data page. [0003] However, when there are frequent modifications to the same data page, the corresponding redo logs are modified synchronously between the group slave nodes multiple times...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/172G06F16/18G06F16/23G06F16/27
CPCG06F16/172G06F16/1815G06F16/2379G06F16/27
Inventor 王天宇
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD