A method and device for distributed execution of relational computing instructions

A relational and distributed technology, applied in the computer field, can solve problems such as inability to deal with relational computing descriptions, relational operator definitions, etc.

Active Publication Date: 2019-06-18
ZHEJIANG TMALL TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, Hive (a data warehouse tool based on the Hadoop framework), Impala (a new query system developed by Cloudera), Presto (a data query engine developed by Facebook), tajo (a distributed data warehouse system based on Hadoop), Stinger ( A tool for improving the efficiency of Hive), Drill (a distributed system designed for interactive analysis of large data sets), etc., but these implementations are not based on a standard definition of relational operators, and cannot meet the requirements of increasingly complex data analysis requirements A more flexible relational computing description other than SQL

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for distributed execution of relational computing instructions
  • A method and device for distributed execution of relational computing instructions
  • A method and device for distributed execution of relational computing instructions

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The application will be further described in detail below in conjunction with the drawings.

[0024] In a typical configuration of this application, the terminal, the equipment of the service network, and the trusted party all include one or more processors (CPU), input / output interfaces, network interfaces, and memory. The memory may include non-permanent memory in computer readable media, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM). Memory is an example of computer readable media. Computer-readable media includes permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access mem...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Provided are a method and device for executing in a distributed manner relational calculation instruction. The device obtains a relational calculation instruction consisting of several distributed relational calculation operators (S1); according to the relational calculation instruction, generating a corresponding logical query tree comprising nodes corresponding to the distributed relational calculation operators (S2); conducting the logical query tree in a distributed way to obtain a query result corresponding to the relational calculation instruction (S3). Compared to the prior art, the method and device transfer a sentence which has not been defined with standard operators on a distributed formula into operators and the relational calculation instruction capable of being processed in a distributed way to enable a distributed system to conduct a conducting method like an SQL sentence, thus disenabling eliminable gap between a traditional database and a distributed processing.

Description

Technical field [0001] This application relates to the computer field, and in particular to a technology for distributed execution of relational computing instructions. Background technique [0002] With the advent of the big data era, in order to solve the needs of large-scale data parallel computing, Google first proposed the MapReduce programming model and implemented the corresponding distributed operating system. Because the MapReduce programming model is simple, does not involve parallelization details, and can complete most of the parallel computing requirements, it is widely accepted [0003] A large category of large-scale data computing scenarios comes from data warehouses. This type of demand was originally supported by traditional relational databases (such as Oracle). As the amount of data increases, data warehouses need to be migrated from traditional relational databases to distributed On the cluster system. While performing relational computing in a distributed cl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/25G06F16/28G06F9/44
CPCG06F16/00
Inventor 冯骁王鹏飞谢德军柴永锋徐常亮
Owner ZHEJIANG TMALL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products