Method and apparatus for executing relation type calculating instruction in distributed way

A relational and distributed technology, applied in the computer field, can solve problems such as inability to deal with relational computing descriptions, relational operator definitions, etc.

Active Publication Date: 2016-07-20
ZHEJIANG TMALL TECH CO LTD
View PDF4 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, Hive (a data warehouse tool based on the Hadoop framework), Impala (a new query system developed by Cloudera), Presto (a data query engine developed by Facebook), tajo (a distributed data warehouse system based on Hadoop), Stinger ( A tool for improving the efficiency of Hive), Drill (a distributed system designed for interactive analysis of large data sets), etc., but these implementations are not based on a standard definition of relational operators, and cannot meet the requirements of increasingly complex data analysis requirements A more flexible relational computing description other than SQL

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for executing relation type calculating instruction in distributed way
  • Method and apparatus for executing relation type calculating instruction in distributed way
  • Method and apparatus for executing relation type calculating instruction in distributed way

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The application will be described in further detail below in conjunction with the accompanying drawings.

[0024] In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input / output interfaces, network interfaces and memory. Memory may include non-permanent storage in computer-readable media, in the form of random access memory (RAM) and / or nonvolatile memory, such as read-only memory (ROM) or flash memory (flashRAM). Memory is an example of computer readable media. Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The objective of the invention is to provide a method and apparatus for executing relation type calculating instruction in distributed way. The method comprises the steps of obtaining a relation type calculating instruction that is formed by a plurality of distributed relation type calculating operators; generating a logic query tree corresponding to the relation type calculating instruction, wherein, the logic query tree comprises nodes corresponding to the distributed relation type calculating operators; and then, executing the logic query tree in a distributed way to obtain a query result corresponding to the relation type calculating instruction. Compared with prior art, the statements that haven't define standard operators in the distributed way into operators and relation type calculating instructions that can be processed in the distribution way to execute an execution method like an SQL statement in a distributed system, so that the gap between a traditional database and the distributed processing is avoided.

Description

technical field [0001] The present application relates to the field of computers, and in particular to a technology for distributed execution of relational computing instructions. Background technique [0002] With the advent of the big data era, in order to meet the needs of large-scale data parallel computing, Google first proposed the MapReduce programming model and implemented a corresponding distributed operating system. Because the MapReduce programming model is simple, basically does not involve parallelization details, and can complete most of the parallel computing requirements, it is widely accepted [0003] A large category of scenarios for large-scale data computing comes from data warehouses, which were originally supported by traditional relational databases (such as Oracle). As the amount of data increases, data warehouses need to be migrated from traditional relational databases to distributed on a cluster system. While the implementation of relational comp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F9/44
CPCG06F16/00
Inventor 冯骁王鹏飞谢德军柴永锋徐常亮
Owner ZHEJIANG TMALL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products