Distributed key-value query method and query engine system

A query engine and distributed technology, applied in the field of distributed key-value query methods and query engine systems, can solve problems such as machine resource exhaustion, high CPU resource overhead, manual shutdown and maintenance, etc., so as to improve processing capacity and improve query performance. Speed, strength-enhancing effects

Active Publication Date: 2012-07-18
BEIJING QIHOO TECH CO LTD
View PDF3 Cites 78 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

There are two problems here. One is that for each application, the application layer needs to split the data, and the splitting strategy of each application will be different, which is inefficient; the other problem is that the cost of data re-splitting after adding machines is very high High, requires manual downtime for maintenance operations, does not support automatic elasti...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed key-value query method and query engine system
  • Distributed key-value query method and query engine system
  • Distributed key-value query method and query engine system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] In order to make the above objects, features and advantages of the present application more obvious and comprehensible, the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0056] refer to figure 1 , which shows an embodiment of a distributed key-value query engine system of the present invention, which may specifically include:

[0057] The metadata server 101 is used to maintain the global routing table information pointing to the storage node; the maintenance may include storage and corresponding modification and update;

[0058] at least one proxy node 102, at figure 1 X proxy nodes are shown in , and each proxy node may include:

[0059] The query forwarding module is used to respond to the request sent by the client including the target KEY, and forward the client request to the corresponding storage node based on the global routing table information;

[0060] The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed key-value query engine system and a query method. The system comprises a metadata server, at least one proxy node and at least one storage node, wherein the metadata server is used for maintaining the information of a global routing table pointing at a storage node; the proxy node comprises a query forwarding module and a data forwarding module, wherein the query forwarding module is used for forwarding a client request to a corresponding storage node in response to a request including a target KEY sent from a client based on the information of the global routing table, and the data forwarding module is used for transmitting a response packet including a target Value, returned from the corresponding storage node, to the client; and the storage node is used for acquiring the needed data from a local storage based on the received client request and transmitting the response packet including the target Value to the proxy node. According to the distributed key-value query engine system and the query method, the key-value data can be stored and queried in a distributed manner, massive key-value data can be accommodated and the adaptability to highly concurrent access is better.

Description

technical field [0001] The present application relates to the technical field of distributed data storage and query, in particular to a distributed key-value query method and a query engine system. Background technique [0002] For the support of large-scale Internet applications and cloud computing, relational databases are generally used to store related data. [0003] Traditional relational databases usually store a certain type of information of an application (such as website user information) in a single database table of the database system, and provide a communication interface for reading and writing operations to the application. In terms of implementation, typical relational databases such as MySQL have a certain upper limit for single-table query and write operations. If the upper limit is exceeded, SQL query and write operations will become very slow, and the disk input / output (IO) module will also A bottleneck occurs. In today's massive data on the Internet, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30H04L29/08
Inventor 杨康谢冉
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap