Distributed parallel processing database system and a data processing method thereof

A parallel processing and database technology, applied in digital data processing, database design/maintenance, database distribution/replication, etc., can solve problems such as failure to achieve automatic data recovery, inflexible scale and configuration, and poor system scalability. Achieve the effect of realizing automatic data recovery, breaking through storage space and computing limitations, and high availability

Active Publication Date: 2019-04-19
CHINA REALTIME DATABASE +2
View PDF5 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At this time, the centralized database system shows its shortcomings: the data has been distributed and stored on the network according to the actual needs, and then the centralized processing will inevitably cause a large communication overhead; If there is a fault, the entire system will be affected, and the reliability is not high; the scale and configuration of the system caused by centralized processing are not flexible enough, and the scalability of the system is poor
When the node is abnormal, troubleshoot the node, and after repairing, manually select the appropriate backup data for data recovery according to the needs, and the data recovery is not automated.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed parallel processing database system and a data processing method thereof
  • Distributed parallel processing database system and a data processing method thereof
  • Distributed parallel processing database system and a data processing method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be further described below in conjunction with the accompanying drawings.

[0053] The technical solution adopted by the present invention mainly includes four parts: 1. Overall functional architecture design. Second, data distributed storage design. Three, data redundancy backup and high availability design. Fourth, redo log recovery and inter-node consistency recovery design.

[0054] Overall functional architecture design:

[0055] Distributed parallel processing database deployment architecture such as figure 1 As shown, the distributed parallel processing database of the present invention adopts a federated architecture.

[0056] The database system of the present invention is distributed, and two or more servers are required for installation and deployment. The servers are referred to as nodes below, and the series of N nodes with the same function or characteristics are usually called a cluster. Clusters are divided into scheduling...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed parallel processing database system and a data processing method thereof. Reliable data support is provided for data recovery by formulating a data fragment distribution rule, a redundant backup rule and a redo log mechanism. And according to the data operation type, log recovery or inter-node consistency recovery is redone to perform data automatic recovery.Distributed deployment is supported, automatic data recovery is achieved, and a stable storage computing service is provided.

Description

technical field [0001] The invention belongs to the application field of a distributed parallel database in an information system, and in particular relates to a distributed parallel processing database system and a data processing method thereof. Background technique [0002] Database technology came into being in the late 20th century, its theory and technology developed extremely rapidly, and its application became more and more extensive. With the wide application of microcomputers, in order to strengthen and expand the functions of microcomputers to process data, it is required to interconnect many microcomputers distributed in different places to participate in common work. In this way, the database has entered the era of distributed databases. Since the 1990s, distributed database systems have entered the stage of commercial application, and traditional relational database products have developed into distributed database products centered on computer networks and mu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/27G06F11/14
CPCG06F11/1464Y02D10/00
Inventor 乔斌粟勇
Owner CHINA REALTIME DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products