Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

High-speed data import and export method based on openGauss platform

A high-speed data, import and export technology, applied in the direction of database indexing, database update, digital data protection, etc., can solve the problems of low processing efficiency, low export efficiency, high maintenance cost, etc., to reduce maintenance costs, reduce time consumption, and improve efficiency Effect

Pending Publication Date: 2022-01-04
MASSIVE CLOUD BEIJING DATA TECH
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to overcome the defects of low table data import and export efficiency, high maintenance cost and low processing efficiency under the openGauss platform, the present invention provides a set of solutions: we propose a high-speed data import and export method based on the openGauss database, To replace the traditional logical import and export method, the method of the present invention is exported by copying the table data file, and the table data file is copied to the table space of the new database system when importing, and then according to its MVCC (Mutil-Version Concurrency Control) characteristics , to modify the tuple information in the data file. In this way, the performance of data import and export can be effectively improved. At the same time, the efficiency of the system in data processing has been significantly improved, and the maintenance cost of data has also been reduced.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-speed data import and export method based on openGauss platform
  • High-speed data import and export method based on openGauss platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] Embodiment 1: a kind of high-speed data import and export method based on openGauss platform, specifically comprises the following steps:

[0039] High-speed data export methods include (see figure 1 ):

[0040] Step 1: Enter the export command and control parameters, analyze the command and parameters; connect to the database through the connection parameters, and set other parameters as the attributes of this export;

[0041] Step 2: Determine the export attribute and select the corresponding export strategy. There are two export strategies. One is to export only metadata, that is, object definition; the other is to export all metadata and table data. The export strategy is passed in. Parameter items to determine;

[0042]Step 3: If you choose the first strategy, first query the metadata of the object to be exported from the system table through the SQL command, convert the metadata into DDL language, and then store it in the specified format. The same object type i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of database management systems and computer software, and particularly relates to a high-speed data import and export method based on an openGauss platform. Different from a traditional logic import and export method, export is carried out in a mode of copying the table data file, the table data file is copied into a table space of a new database system during import, tuple information in the data file is modified according to the MVCC characteristic of the table data file, as analysis of SQL commands and scanning and filtering of tuples in data files do not need to be carried out, the data import and export performance is remarkably improved, particularly, time consumed for export and import of large table object data is greatly shortened, the efficiency of object migration between databases is improved, meanwhile, the maintenance cost of the data is reduced accordingly, therefore, the defects of low import and export efficiency, high maintenance cost and low processing efficiency of the table data with large data volume under the openGauss platform are well overcome.

Description

technical field [0001] The invention belongs to the technical field of database management systems and computer software, in particular to a high-speed data import and export method based on an openGauss platform. Background technique [0002] In the information age, massive amounts of data are being generated all the time. As time goes by, the amount of data stored in the database will become larger and larger, and its maintenance cost will become higher and higher. When database administrators perform daily database maintenance, as well as data backup or migration, data import and export become the primary task they have to face. [0003] Data import and export is one of the essential functions of the database. At present, most databases are realized through the principle of logical import and export. For example, the openGauss platform (openGauss is an open source relational database management system whose core is derived from PostgreSQL) uses SQL commands to export met...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/242G06F16/23G06F21/60
CPCG06F16/2282G06F16/2433G06F16/2365G06F21/602Y02D10/00
Inventor 张文龙何小栋
Owner MASSIVE CLOUD BEIJING DATA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products