Data processing method and device for shared storage database, equipment and medium

A data processing device and shared storage technology, applied in the field of data processing, can solve problems such as data loss, and achieve the effect of reliability and effectiveness

Active Publication Date: 2020-04-21
SHANGHAI DAMENG DATABASE
View PDF8 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Then the data of node 1 on the data page will be lost
[0008] The above two data brushing methods may lead to data loss in the shared storage database cluster environment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device for shared storage database, equipment and medium
  • Data processing method and device for shared storage database, equipment and medium
  • Data processing method and device for shared storage database, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] figure 1It is a flow chart of the data processing method of the shared storage database provided by Embodiment 1 of the present invention. This embodiment is applicable to data processing in a shared storage database cluster environment, and the method can be executed by a data processing device of the shared storage database. The device can be realized by software and / or hardware.

[0042] Such as figure 1 As shown, the method specifically includes the following steps:

[0043] Step 110, acquiring the serial number value of the checkpoint to be adjusted in the database.

[0044] Optionally, the database includes at least two nodes.

[0045] Among them, the database is a shared storage database, which can correspond to multiple database nodes. A node can be understood as a server with database software installed, and multiple nodes are database software installed on multiple servers, thus forming a larger cluster; each Each node corresponds to a database instance. A...

Embodiment 2

[0055] figure 2 It is a flow chart of the data processing method of the shared storage database provided by Embodiment 2 of the present invention. On the basis of the foregoing embodiments, this embodiment further optimizes the above-mentioned data processing method of the shared storage database.

[0056] Such as figure 2 As shown, the method specifically includes:

[0057] Step 210, acquire the sequence number value of the checkpoint to be adjusted of the node to be adjusted in the database.

[0058] Specifically, when there is a node in the database to adjust the checkpoint, the sequence number value of the checkpoint to be adjusted is obtained.

[0059] Exemplarily, the value of the sequence number of the checkpoint to be adjusted is recorded as T_CKPT_LSN.

[0060] Step 220, broadcasting the sequence number value of the checkpoint to be adjusted to other nodes.

[0061] Specifically, the sequence number value of the checkpoint to be adjusted obtained in step 210 is...

Embodiment 3

[0074] The data processing device for a shared storage database provided by an embodiment of the present invention can execute the data processing method for a shared storage database provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method. image 3 It is a structural block diagram of a data processing device for sharing a storage database provided in Embodiment 3 of the present invention, as shown in image 3 As shown, the device includes: a first acquiring module 310 , a broadcasting module 320 and a disk brushing module 330 .

[0075] The first acquiring module 310 is configured to acquire the serial number value of the checkpoint to be adjusted in the database. The database includes at least two nodes, and the serial number value of the checkpoint to be adjusted is the adjusted checkpoint serial number value of the checkpoint to be adjusted.

[0076] The broadcast module 320 is configured...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and device for a shared storage database, equipment and a medium. The method comprises the steps: acquiring a to-be-adjusted check point serial numbervalue of a to-be-adjusted check point in a database, wherein the database at least comprises two nodes, and the to-be-adjusted check point serial number value is the adjusted check point serial numbervalue of the to-be-adjusted check point; broadcasting the serial number value of the check point to be adjusted to other nodes; writing all data pages of which the page log serial number values are smaller than or equal to the to-be-adjusted check point serial number value in a database into a disk; and notifying the to-be-adjusted node of adjusting the to-be-adjusted check point, the page log serial number value being a record serial number value generated when each node modifies the data page, and the redo log being used for recording an operation of modifying the data page by the corresponding node. According to the method, the data can be effectively stored, the problem of page breakage in the existing shared storage database cluster environment is solved, and the reliability and effectiveness of data storage are realized.

Description

technical field [0001] Embodiments of the present invention relate to data processing technologies, and in particular, to a data processing method, device, device, and medium for a shared storage database. Background technique [0002] When the database is writing data pages from the memory to the disk, in extreme cases (for example, the operating system is restarted, or the host is powered off and restarted), only part of the data page is written, and the other part of the data that is not written to the disk is lost. This phenomenon is called page break (partial write). [0003] Redo logs are an important basis for dealing with system failure recovery in database management systems. When a database node instance modifies a data page, a corresponding redo log is generated at the same time. If the database instance fails, after the instance is restarted, redoing the redo log sequentially from the checkpoint offset can restore all data pages to the latest state. Checkpoint ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/21G06F16/23
CPCG06F16/219G06F16/2358Y02D10/00
Inventor 韩朱忠王巍王海龙
Owner SHANGHAI DAMENG DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products