Multi-partition-table inquiring and processing method and device

A table query, multi-partition technology, applied in electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as the inability to exert the advantages of Presto query, and achieve the goal of improving operating efficiency, increasing input and output, and improving stability. Effect

Inactive Publication Date: 2016-09-28
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF3 Cites 37 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] Therefore, the existing technical solutions ca...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-partition-table inquiring and processing method and device
  • Multi-partition-table inquiring and processing method and device
  • Multi-partition-table inquiring and processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0036] figure 1 is a schematic diagram of main steps of a method for querying and processing a multi-partition table according to an embodiment of the present invention. Such as figure 1 As shown, the multi-partition table query processing method of the present invention mainly includes the following steps S11 to S14.

[0037] Step S11: receiving a database query statem...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-partition-table inquiring and processing method and device. Data of all partition tables can be executed and inquired in parallel, the input and output data amount is increased, and the execution efficiency of Presto is improved. The method includes the steps of receiving a database inquiring statement, analyzing the database inquiring statement to obtain a data source table, extracting data partitions from the data source table, if the number of data partitions is one, directly executing the database inquiring statement, otherwise, conducting parallel conversion on the database inquiring statement, decomposing the database inquiring statement into multiple sub inquiring statements corresponding to all the data partitions respectively, and then executing the sub inquiring statements in parallel.

Description

technical field [0001] The invention relates to the technical field of computers and computer software, in particular to a method and device for multi-partition table query processing. Background technique [0002] Data is stored in a relational database in the form of a table. [0003] When the amount of data in the table continues to increase, the speed of querying data will slow down, and the performance of the application will decrease. At this time, you should consider partitioning the table. After the table is partitioned, logically, the table is still a complete table, but the data in the table is physically stored in the table spaces (physical files) corresponding to multiple partitions. In this way, when querying data, the entire table is not scanned every time. Therefore, many databases (such as MySQL, Oracle, Hive, etc.) will perform data partitioning when modeling. [0004] Take the Hive database as an example. In the Hive Select data query, the contents of th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/24534G06F16/24532G06F16/2456
Inventor 白贤锋
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products