System and method for distributed database query engines

A database and distributed storage technology, applied in the database field, can solve problems such as inconvenient and troublesome processing

Active Publication Date: 2015-09-09
META PLATFORMS INC
View PDF10 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, this workaround remains cumbersome and inconvenient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for distributed database query engines
  • System and method for distributed database query engines
  • System and method for distributed database query engines

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] References in this specification to "an embodiment," "one embodiment," etc., mean that a described particular feature, function, or characteristic is included in at least one embodiment of the present invention. The appearances of such phrases in this specification do not necessarily refer to the same embodiment, nor are they mutually exclusive.

[0070] Modern social network systems can accumulate large amounts of data every day, therefore, a highly scalable system for storing and analyzing data is required. In particular, efficient interactive analysis of large amounts of data requires a low-latency and fast-response way of processing data queries. The present invention discloses a distributed query engine enabled by combining an in-memory service tree based computing framework with approximate query processing. The distributed query engine divides query tasks into multiple partial tasks, and distributes the partial tasks to worker nodes for further in-memory process...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Techniques for a system capable of performing low-latency database query processing are disclosed herein. The system includes a gateway server and a plurality of worker nodes. The gateway server is configured to divide a database query, for a database containing data stored in a distributed storage cluster having a plurality of data nodes, into a plurality of partial queries and construct a query result based on a plurality of intermediate results. Each worker node of the plurality of worker nodes is configured to process a respective partial query of the plurality of partial queries by scanning data related to the respective partial query that stored on at least one data node of the distributed storage cluster and generate an intermediate result of the plurality of intermediate results that is stored in a memory of that worker node.

Description

[0001] Cross reference to related applications [0002] This application claims priority to US Patent Application No. 13 / 735,820, filed January 7, 2013, which is hereby incorporated by reference in its entirety. [0003] This application claims priority from European Patent Application No. 13198563.2 filed on December 19, 2013, which is hereby incorporated by reference in its entirety. technical field [0004] The present invention relates generally to databases, and more particularly to a distributed database query engine for low query latency database analysis. Background technique [0005] Advances in computer and network computing have given rise to applications that require large amounts of data storage. For example, tens of millions of users can create web pages and upload images and text to social media sites. Therefore, social media sites can accumulate large amounts of data every day, and thus, a highly scalable system for storing and processing data is required. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F17/30545G06F16/2471G06F16/951G06F16/24539G06F16/24552G06F16/27G06F16/2358G06F16/9535
Inventor 拉戈特姆·穆尔蒂拉贾特·格尔
Owner META PLATFORMS INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products