A migration method based on postgresql block storage device

A block storage device, block device technology, applied in database design/maintenance, input/output to record carriers, special data processing applications, etc. , to achieve the effect of improving the reading and writing speed

Active Publication Date: 2019-06-28
深圳市华讯方舟光电技术有限公司 +1
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0023] First, the migration of databases between different systems is extremely complicated and requires high professional knowledge of operators
[0024] Second, the use of the disk must go through the file system layer
[0028] Third, the expansion of the file system is also very troublesome
[0029] Fourth, the database data files are directly exposed to the operating system, and there are potential security risks in the data, so data security cannot be guaranteed. This is a huge security hole for some use environments that require a high level of security.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A migration method based on postgresql block storage device
  • A migration method based on postgresql block storage device
  • A migration method based on postgresql block storage device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0074] Such as Figure 4 As shown, the PostgreSQL block of the present invention is the smallest unit allocated to a data table in the PostgreSQL database system, and the storage capacity of the PostgreSQL block is equal to 4MB.

[0075] Of course, it may also be that the storage capacity of the PostgreSQL block is greater than 4KB.

[0076] It may also be that the storage capacity of the PostgreSQL block is a positive integer multiple of 8KB.

[0077] It may also be that the storage capacity of the PostgreSQL block is a natural number power of 2 of 8KB.

[0078] Furthermore, the storage capacity of the PostgreSQL block is 1MB, 2MB, 8MB, 16MB, 32MB, 64MB, 128MB, 256MB, 512MB or 1024MB.

Embodiment 2

[0080] Such as Figure 4 As shown, the PostgreSQL block storage device read-write module of the present invention is a PostgreSQL block storage device read-write module that manages the aforementioned PostgreSQL blocks in the PostgreSQL block storage device.

[0081] The read-write module of the PostgreSQL block storage device can be built on the PostgreSQL database system.

[0082] The read-write module of the PostgreSQL block storage device manages the PostgreSQL blocks in the PostgreSQL block storage device through the mapping relationship table between the PostgreSQL block and the data table and the free PostgreSQL block table.

[0083] The PostgreSQL block-data table mapping relationship table includes fields Relfilenode, Reltablespace, Forknum, Blockid, and Blockno, and the free PostgreSQL block table includes fields Blockid, Isfree, and Dev.

[0084] The PostgreSQL block storage device read-write module has the following submodules:

[0085] submodules that allocate P...

Embodiment 3

[0102] Such as Figure 4 As shown, the present invention is based on the migration method of the PostgreSQL block storage device, and uses the aforementioned PostgreSQL block storage device read-write module to read and write the aforementioned PostgreSQL block.

[0103] A. In the database background driver layer, the driver of the PostgreSQL block storage device read-write module completes the operation of the block file, and its main tasks are:

[0104] a. Manage the read-write interface of the upper-layer business to the underlying device through the file handle manager, so as to provide a high-concurrency read-write interface;

[0105] b. Realize the overwriting of the PostgreSQL block storage device, directly locate the specified location of the PostgreSQL block storage device, and write the data of the specified length;

[0106] B. Locate to a specified location of a specified block device according to the mapping relationship table oid and table space between the Postg...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A migration method based on a PostgreSQL block storage device, using a PostgreSQL block storage device read-write module to perform read and write operations to PostgreSQL blocks, the PostgreSQL block storage device read-write module managing, by means of an idle PostgreSQL block table and a table of mapping relationship between the PostgreSQL blocks and data tables, the PostgreSQL blocks in the PostgreSQL block storage device, copying the idle PostgreSQL block table and the table of mapping relationships between the PostgreSQL blocks and the data tables from an original database to a new database, and migrating the PostgreSQL block storage device from the computer in which the original database is located to the computer in which the new database is located. Migrating database between different systems by means of the migration method based on the PostgreSQL block storage device is easy, without a high requirement for the professional knowledge to operators. The query speed and the read-write speed can be improved, the speeds being improved by 10%-20% under the same condition of backend storage.

Description

technical field [0001] The invention relates to a migration method of a PostgreSQL database storage device, in particular to a migration method based on a PostgreSQL block storage device. Background technique [0002] With the development of the Internet, mobile Internet and the Internet of Things, we have ushered in an era of massive data, and more and more data are stored in the database, but the query time we need is getting smaller and smaller. Many application scenarios today require background storage with high concurrency, high capacity, and high response. The high-speed storage requirements force us to give up real-time indexing, and the data scanning of large data volumes is limited by the I / O on the storage side. In the current PostgreSQL database system, high-concurrency multi-database scans are basically random reads. At the same time, the throughput of ordinary disks can no longer meet the demand. [0003] In order to adapt to the application scenarios with a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/21G06F3/06
CPCG06F3/06G06F16/00
Inventor 朱晓伟
Owner 深圳市华讯方舟光电技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products