Data management method and device and related components

A data management and metadata technology, applied in the server field, can solve problems such as slow transmission speed and lower Druid performance, and achieve the effects of reducing transmission time consumption, improving user experience, and improving performance

Pending Publication Date: 2021-04-27
北京浪潮数据技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the usage scenario of a large amount of data, Druid faces a problem, that is, when Druid obtains the metadata of the data block segment from the target underlying database (such as MySql) after receiving the query command, the target underlying database is not necessarily the client The underlying database of the corresponding server, and the obtained segment metadata needs to be transmitted through the network, and the network transmission bandwidth is fixed. Therefore, the larger the amount of data obtained, the slower the transmission speed, and it will take a long time to transfer the data from The target underlying database is transferred to the client, reducing the performance of Druid

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data management method and device and related components
  • Data management method and device and related components

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The core of this application is to provide a data management method, device, electronic equipment and computer-readable storage medium, which can shorten the execution link of query instructions, reduce the time-consuming transmission of metadata of data blocks in the network, and facilitate the improvement of Druid. performance.

[0036] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0037] Plea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data management method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: obtaining metadata of data blocks of all underlying databases in a cluster, and storing the metadata of all data blocks to a cache device of a server node; determining a query target according to the state of the cache device; when a query instruction is received, obtaining metadata of a data block corresponding to the query instruction from a query target and feeding the metadata back to the client, wherein the query target is a cache device or a target underlying database. According to the method and device, the execution link of the query instruction can be shortened, the transmission time consumption of metadata of the data block in the network is reduced, and the performance of the Druid is improved.

Description

technical field [0001] The present application relates to the server field, in particular to a data management method, device and related components. Background technique [0002] Druid is a high-performance real-time analysis database that can provide sub-second query data storage for historical and real-time data. Druid supports low-latency data ingestion, flexible data exploration and analysis, high-performance data aggregation, and simple horizontal expansion. It is suitable for analytical query systems with large data volumes and high scalability requirements. It is used in digital advertising analysis and business intelligence. , OLAP (Online Analytical Processing, Online Analytical Processing) and other fields are widely used. [0003] However, in the usage scenario of a large amount of data, Druid faces a problem, that is, when Druid obtains the metadata of the data block segment from the target underlying database (such as MySql) after receiving the query command, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F16/27G06F16/28
CPCG06F16/24552G06F16/27G06F16/28
Inventor 宋文豪
Owner 北京浪潮数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap