Complex SQL query method and device through Elasticsearch database, processor and storage medium

A database and processor technology, applied in the direction of electronic digital data processing, special data processing applications, digital data information retrieval, etc., can solve the problems of not supporting complex SQL queries, low timeliness, large delay, etc., and achieve efficient real-time retrieval effect , to achieve real-time retrieval effects and wide range of application effects

Active Publication Date: 2021-04-20
上海梦鱼信息科技有限公司
View PDF10 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 1. The existing technology has low timeliness, large delay, and poor user feedback;
[0007] 2. Elasticsearch only supports single-document SQL queries, does not support complex SQL queries, and supports few keywords for SQL

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Complex SQL query method and device through Elasticsearch database, processor and storage medium
  • Complex SQL query method and device through Elasticsearch database, processor and storage medium
  • Complex SQL query method and device through Elasticsearch database, processor and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] In order to describe the technical content of the present invention more clearly, further description will be given below in conjunction with specific embodiments.

[0036] The method for realizing complex SQL query processing by the Elasticsearch database of the present invention comprises the following steps:

[0037] (1) Import each business data into the ElasticSearch cluster;

[0038] (1.1) Import each business data into the ElasticSearch cluster;

[0039] (1.2) Create the mapping relationship between the overall structure, schema, tables, fields, and types of the memory database;

[0040] (2) Initiate a complex SQL query request, and parse all the table names in SQL through the SQL parsing engine;

[0041] (3) Retrieve the ElasticSearch cluster;

[0042] (4) Map the data of each table to the table of the memory database;

[0043] (4.1) Correspond the ElasticsearchTable table object of the elasticsearch cluster service with the document mapping;

[0044] (4.2)...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a complex SQL query processing method through an Elasticsearch database. The method comprises the following steps: importing each piece of service data into an ElasticSearch cluster; initiating a complex SQL query request, and analyzing all table names existing in the SQL through an SQL analysis engine; searching ElasticSearch clusters; mapping the table data into a table of a memory database; and implementing an SQL execution engine in the memory, and executing the complex SQL in the memory to return a result set. The invention further relates to a corresponding device, a processor and a computer readable storage medium thereof. By the adoption of the complex SQL query processing method and device through the Elasticsearch database, the processor and the computer readable storage medium of the processor, the complex SQL effect is executed on the Elasticsearch, and the real-time retrieval effect is achieved efficiently. In the prior art, the data volume of a database table I is more than 40 millions, the data volume of a database table II is more than 40 millions, the time consumed for carrying out complex SQL query processing on a mysql table is more than 30 seconds, and the time consumed for carrying out logic processing after querying es data is more than 30 seconds. However, according to the invention, after improvement, when the memory database carries out complex SQL query on es, the consumed time is more than 2 seconds, the effect is improved by more than 15 times, and the invention has a wide application range.

Description

technical field [0001] The present invention relates to the field of big data processing, in particular to the field of SQL query, and specifically refers to a method, device, processor and computer-readable storage medium for realizing complex SQL query processing through an Elasticsearch database. Background technique [0002] The steps in the prior art that require real-time processing of large data complex queries are as follows: [0003] 1. When retrieving data and performing complex SQL processing, it is generally other databases; [0004] 2. Retrieve the elasticsearch database, and then edit the complex logic code for processing. [0005] The defective that existing technology exists is as follows: [0006] 1. The existing technology has low timeliness, large delay, and poor user feedback; [0007] 2. Elasticsearch only supports single-document SQL queries, does not support complex SQL queries, and supports few keywords for SQL. Contents of the invention [0008...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2453
CPCY02D10/00
Inventor 屈栋栋郭德宇吴鹏程
Owner 上海梦鱼信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products