Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed relational database based on HDFS metadata server and construction method

A metadata server and metadata technology, applied in the field of distributed databases, can solve the problem that HDFS cannot directly apply platform architecture with a unique structure, and achieve high-speed data operations and access interfaces, ensuring reliability, and excellent scalability.

Active Publication Date: 2021-02-23
SHENZHEN CHINA BLOG IMFORMATION TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When HDFS is applied to the basic layer of a specific information platform, each platform architecture has its own unique structure, and HDFS cannot be directly applied to a platform architecture with a unique structure

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed relational database based on HDFS metadata server and construction method
  • Distributed relational database based on HDFS metadata server and construction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, not to limit the invention. It should also be noted that, for ease of description, only parts related to the invention are shown in the drawings.

[0028] It should be noted that, in the case of no conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and examples.

[0029] The embodiment of the present invention provides a distributed relational database based on HDFS metadata server and its construction method. The HDFS metadata server constructs the relationship between the root node and the child nodes, and stores some metadata in the child nodes, thereby reducing t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distributed relational database based on an HDFS metadata server and a construction method, and belongs to the field of distributed databases. The construction method comprises the following steps: partitioning data according to the coverage range of an HDFS system, and storing the data in a regional HDFS according to partitions; adopting the regional HDFS to generate metadata according to the stored resource data and send the metadata to the corresponding child nodes; adopting the sub-nodes corresponding to the regional HDFS to store the metadata, generate unique identifiers according to the metadata, and send the metadata and the unique identifiers to an HDFS metadata server; and adopting the metadata server to store the unique identifier, send the metadata and the unique identifier to the root node, sets a user interface, and feed back a user request layer by layer in a database through the user interface. According to the invention, the relationship betweenthe father node and the child node is established through the metadata server, so that cross-region and multi-branch data source distributed relationship data storage is realized.

Description

technical field [0001] The invention belongs to the field of distributed databases, and in particular relates to a distributed relational database based on an HDFS metadata server and a construction method. Background technique [0002] In the Internet platform architecture, the data storage layer is the basis of the overall architecture. It not only needs to effectively organize massive data, but also provides an efficient interface to the upper database system to meet the needs of massive structured data analysis. For example, for a mature cloud storage system, its database system must have a stable architecture, good scalability, compatibility, and friendly query and indexing functions. Hadoop Distributed File System (Hadoop Distributed File System, HDFS) is a distributed file system that runs on general-purpose hardware and is highly fault-tolerant. It is suitable for deployment on cheap machines and has a high degree of compatibility. When HDFS is applied to the specif...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/27G06F16/28G06F16/22G06F16/182
CPCG06F16/278G06F16/284G06F16/22G06F16/182
Inventor 李发明
Owner SHENZHEN CHINA BLOG IMFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products