Method and system of SQL-like queries based on HBase coprocessor

A co-processor and query request technology, which is applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as poor real-time performance, long data query response time, and insufficient utilization of HBase resources to achieve the goal of improving efficiency Effect

Active Publication Date: 2017-11-21
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF12 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, in the above two methods, because Hive is based on the idea of ​​Map-Reduce, the data query response time is long, the real-time performance is poor, and the efficiency of data query and calculation on a smaller order of magnitude is low; while Phoenix has a strong HBase Intrusive, the table created by it can be recognized and used by HBase, but the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system of SQL-like queries based on HBase coprocessor
  • Method and system of SQL-like queries based on HBase coprocessor
  • Method and system of SQL-like queries based on HBase coprocessor

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0027] The specific embodiment of the present invention is based on a kind of SQL (SQL is the query language of a kind of relational database, and the class SQL grammar is similar to SQL but can not cover real SQL. The class SQL here is to unify the lower-level HBase data to the upper-level business Query description) to calculate and query the data stored in HBase, standa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a system of SQL-like queries based on an HBase coprocessor. The method and the system can standardize and unify query conditions and returned results, and can execute high-performance parallel computing of real-time data while intrusion into an upper-layer service is avoided. The method includes: preconfiguring the metadata of tables, which are stored by HBase, on an HBase client; establishing an upper-layer service access connection, parsing SQL query statements imported from the upper-layer service, and generating query requests; distributing the query requests to RegionServers by the HBase client; utilizing the HBase coprocessor by the RegionServers to carry out the parallel queries and processing on the data according to the query requests; and merging data, which is returned by the RegionServers, by the HBase client, and encapsulating a result set.

Description

technical field [0001] The invention relates to the field of computer technology and software, in particular to a method and system for SQL-like query based on an HBase coprocessor. Background technique [0002] In recent years, with the continuous development of the e-commerce industry, the storage, extraction, calculation, analysis, and display of big data have attracted more and more attention from major e-commerce companies. With the explosive growth of e-commerce data and the urgent need for big data processing and analysis, and due to the contradiction between data storage space and data access time, major e-commerce companies choose the distributed storage system HBase (HBase is a highly reliable , high-performance, column-oriented, and scalable distributed storage system) to store data to meet the high-efficiency insert and read operations on data. [0003] However, due to the diversification of business requirements, the native API query conditions for HBase and th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2457
Inventor 邵先凯李威张鹏
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap