A Result Cache Method of Distributed Database Based on Hierarchical Mapping

A result cache and database technology, applied in the direction of database distribution/replication, digital data processing, structured data retrieval, etc., can solve the problems that affect the performance of distributed databases, fail to solve the problems of large amounts of data and computing convergence, and reduce the internal Effects of network and memory load, reduction of network data transmission volume, improvement of reliability and data throughput performance

Active Publication Date: 2020-07-10
INST OF SOFTWARE - CHINESE ACAD OF SCI
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] The above problems greatly affect the performance of distributed databases
There are already some solutions to push data to the second master node other than the master node for calculation (such as ocean base, etc.), so that although the master node’s master control ability can be guaranteed when the data is congested, it is still not solved in essence. Problems caused when large amounts of data and computation converge to a single point

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Result Cache Method of Distributed Database Based on Hierarchical Mapping
  • A Result Cache Method of Distributed Database Based on Hierarchical Mapping
  • A Result Cache Method of Distributed Database Based on Hierarchical Mapping

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present invention will be further described below through specific embodiments and accompanying drawings.

[0032] The basic structure of the distributed database in this embodiment is as follows: figure 1 shown. It consists of a master node and multiple worker nodes. The module content in each node is as follows.

[0033] The Master node mainly includes data organization interface, metadata, task management, group management, sort management, cache management, extraction interface and virtual cache.

[0034] The data organization interface provides data services for external users, and the finally extracted data is organized by the data organization interface in the form of user requirements and returned to the user.

[0035] Metadata, which saves the relevant information of the worker node, the basic information of the database table, and the data distribution information.

[0036] In the task management section, query tasks are created for user requests. Que...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a layered mapping-based distributed database result caching method, belongs to the field of distributed database performance optimization research and application, and particularly relates to cache management, grouping, sorting and extraction of query operation result set data of a distributed database. According to the method, a distributed mapping cache framework is established based on a distributed framework; a bottom-layer local cache realizes local storage and grouping of the result set data; cache information is gathered in an upper-layer virtual cache; data extraction is realized through mapping of the virtual cache and the local cache; and the processing of grouping, sorting and the like of a result set is realized. Through the cache technology provided by the invention, while the result set of the distributed database is correctly extracted, the internal network and memory load of a system is reduced, and the reliability and data throughput performance of the distributed data system are improved. The technology has a positive application value in the fields of big data-based e-commerce, internet of things, wisdom cities and the like.

Description

technical field [0001] The invention provides a distributed database result set cache technology. The invention belongs to the field of distributed database performance optimization research and application, and in particular relates to a cache management, grouping, sorting and extraction method of query operation result set data of a distributed database. Background technique [0002] Data is the core resource of information system. How to correctly and reliably extract data satisfying constraints is one of the key issues of information systems. With the rapid development of technologies and applications such as the Internet of Things and social networks, the speed and scale of data generation have shown explosive growth. And whoever can hold these data and make good use of them can occupy a dominant position in the industry. As a core asset of an enterprise, business data has very high requirements for data storage, use, and management. In order to meet these requireme...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/27G06F16/2455
CPCG06F16/24552G06F16/27
Inventor 庞廓郭皓明王之欣魏闫艳田霂焉丽
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products