Database cluster for mixing various heterogeneous data sources and implementation method

A technology of heterogeneous data sources and databases, applied in the field of distributed databases, can solve problems such as inability to optimize data processing and management

Active Publication Date: 2015-04-01
TIANJIN NANKAI UNIV GENERAL DATA TECH
View PDF8 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can only add, delete, modify and query "heterogeneous data sources", but it cannot optimize data processi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database cluster for mixing various heterogeneous data sources and implementation method
  • Database cluster for mixing various heterogeneous data sources and implementation method
  • Database cluster for mixing various heterogeneous data sources and implementation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] Specific embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0027] A database cluster that mixes multiple heterogeneous data sources, such as figure 1 As shown, including processing layer and storage layer,

[0028] The storage layer includes multiple heterogeneous data sources, and each heterogeneous data source serves as a virtual node, and each virtual node can be a single database instance or a database cluster, or a single virtual node or multiple virtual nodes;

[0029] The processing layer includes a command parsing module, a query optimization module, a metadata management module, an execution plan module, an executor module and a transaction management module; after receiving a command, the command parsing module first parses out the relevant information of the data table and generates a syntax tree , then the query optimization module generates a query plan according to the syntax tree query...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a database cluster for mixing various heterogeneous data sources. The database cluster comprises a processing layer and a storage layer, wherein the storage layer comprises the various heterogeneous data sources, each heterogeneous data source serves as a virtual node, and each virtual node can be a single database example or database cluster, or a single virtual node or a plurality of virtual nodes; the processing layer comprises a command parsing module, a query optimization module, a metadata management module, an execution planning module, an executer module and an office management module. The database cluster has the advantages and positive effects that the ''heterogeneous data sources'' (such as database products or database clusters purchased by a user) can be accessed by the user through a unified interface, the ''heterogeneous data sources'' are brought into a unified cluster in a virtual node mode for resource management, and thus the operations of data migration, copying, stretching and the like can be flexibly carried out in the ''cluster'' consisting of the ''heterogeneous data sources''.

Description

technical field [0001] The invention belongs to the technical field of distributed databases, and in particular relates to a database cluster and an implementation method for mixing multiple heterogeneous data sources. Background technique [0002] Big data technology (big data), or huge amount of data, refers to the amount of data involved is so large that it cannot be captured, managed, processed, and organized within a reasonable time through current mainstream software tools to help enterprises operate Information for more active purposes in decision-making. In "The Age of Big Data" written by Victor Meyer-Schönberger and Kenneth Kukeye, big data refers to the use of all data for analysis and processing without shortcuts such as random analysis (sampling survey). [0003] Database cluster, as the name implies, is to use at least two or more database servers to form a virtual single database logical image, and provide transparent data services to clients like a single da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/27
Inventor 张灵王傲雷武新崔维力
Owner TIANJIN NANKAI UNIV GENERAL DATA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products