Complex SQL query method and device through Elasticsearch database, processor and storage medium

Abstract

The invention relates to a complex SQL query processing method through an Elasticsearch database. The method comprises the following steps: importing each piece of service data into an ElasticSearch cluster; initiating a complex SQL query request, and analyzing all table names existing in the SQL through an SQL analysis engine; searching ElasticSearch clusters; mapping the table data into a table of a memory database; and implementing an SQL execution engine in the memory, and executing the complex SQL in the memory to return a result set. The invention further relates to a corresponding device, a processor and a computer readable storage medium thereof. By the adoption of the complex SQL query processing method and device through the Elasticsearch database, the processor and the computer readable storage medium of the processor, the complex SQL effect is executed on the Elasticsearch, and the real-time retrieval effect is achieved efficiently. In the prior art, the data volume of a database table I is more than 40 millions, the data volume of a database table II is more than 40 millions, the time consumed for carrying out complex SQL query processing on a mysql table is more than 30 seconds, and the time consumed for carrying out logic processing after querying es data is more than 30 seconds. However, according to the invention, after improvement, when the memory database carries out complex SQL query on es, the consumed time is more than 2 seconds, the effect is improved by more than 15 times, and the invention has a wide application range.

Description

technical field [0001] The present invention relates to the field of big data processing, in particular to the field of SQL query, and specifically refers to a method, device, processor and computer-readable storage medium for realizing complex SQL query processing through an Elasticsearch database. Background technique [0002] The steps in the prior art that require real-time processing of large data complex queries are as follows: [0003] 1. When retrieving data and performing complex SQL processing, it is generally other databases; [0004] 2. Retrieve the elasticsearch database, and then edit the complex logic code for processing. [0005] The defective that existing technology exists is as follows: [0006] 1. The existing technology has low timeliness, large delay, and poor user feedback; [0007] 2. Elasticsearch only supports single-document SQL queries, does not support complex SQL queries, and supports few keywords for SQL. Contents of the invention [0008...

AI Technical Summary

Problems solved by technology

[0006] 1. The existing technology has low timeliness, large delay, and poor user feedback;

[0007] 2. Elasticsearch only supports single-document SQL queries, does not support complex SQL queries, and supports few keywords for SQL

Images