Data exporting method, node, server, system, equipment and storage medium

A data export and server technology, applied in the field of data processing, can solve the problems of long time consumption, poor user experience, affecting the performance of distributed database data export, etc., to achieve the effect of improving user experience and data export efficiency.

Pending Publication Date: 2022-07-05
金篆信科有限责任公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, single-threaded data export often takes too long, which seriously affects the data export performance of distributed databases, and the user experience is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data exporting method, node, server, system, equipment and storage medium
  • Data exporting method, node, server, system, equipment and storage medium
  • Data exporting method, node, server, system, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] It can be known from the background art that the single-threaded export method currently used to export data from multiple storage nodes of a distributed database takes too long, seriously affects the data export performance of the distributed database, and causes poor user experience.

[0025] To solve the above problem, an embodiment of the present application provides a data export method, which is applied to a storage node, including: receiving a first export request from a management node, where the first export request carries primary key information of the data to be exported; The primary key information divides the data to be exported to obtain a number of data blocks; at least two threads for data export and upload are created; according to the created at least two threads, data in different data blocks are exported in parallel and uploaded to the user-side server, for the user-side server to combine the received data and send it to the user.

[0026] In the da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention relates to the technical field of data processing, and discloses a data exporting method, a node, a server, a database, equipment and a storage medium. The data exporting method applied to a storage node comprises the steps that a first exporting request of a management node is received, and the first exporting request carries primary key information of data to be exported; dividing the to-be-exported data according to the primary key information to obtain a plurality of data blocks; creating at least two threads for exporting and uploading data; and exporting data in different data blocks in parallel according to the created at least two threads, and uploading the data to a user side server, so that the user side server merges the received data and sends the data to a user. According to the method, the to-be-exported data can be quickly divided, and the divided data can be quickly uploaded concurrently by utilizing the created threads, so that the data export efficiency is improved, and the user experience is improved.

Description

technical field [0001] The embodiments of the present application relate to the technical field of data processing, and in particular, to a data export method, node, server, system, device, and storage medium. Background technique [0002] A distributed database is a logically unified database based on a computer network that connects multiple physically dispersed storage nodes (DataBase, DB) that store data. Because of its large storage capacity, high business concurrency, and scalability Because of its good advantages, distributed databases are increasingly widely used. Among them, in order to ensure the safety and convenience of distributed databases, operations such as backup, recovery and migration of data in distributed databases are usually performed, whether it is backup, recovery or migration, Usually rely on data export. At present, the data export function of distributed databases is basically exported by each DB in a single thread. It is not until all DBs export...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27G06F16/22G06F16/21
CPCG06F16/27G06F16/2282G06F16/214
Inventor 沈文宽黄健付裕马玉伟
Owner 金篆信科有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products