Data query method and device based on big data query engine, equipment and medium

A query engine and data query technology, applied in the field of data query, can solve problems such as long query time and low data query efficiency

Pending Publication Date: 2021-05-28
PING AN TECH (SHENZHEN) CO LTD
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the large amount of data, a large amount of data needs ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data query method and device based on big data query engine, equipment and medium
  • Data query method and device based on big data query engine, equipment and medium
  • Data query method and device based on big data query engine, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of the application; the terms used herein in the description of the application are only to describe specific embodiments The purpose is not to limit the present application; the terms "comprising" and "having" and any variations thereof in the specification and claims of the present application and the description of the above drawings are intended to cover non-exclusive inclusion. The terms "first", "second" and the like in the description and claims of the present application or the above drawings are used to distinguish different objects, rather than to describe a specific order.

[0034] Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrenc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of data query, and discloses a data query method and device based on a big data query engine, equipment and a medium, the method comprises the following steps: analyzing an obtained SQL query statement to obtain a corresponding query table and filtering information in the SQL query statement, then obtaining associated file information corresponding to the query table, and storing the associated file information in the SQL query statement; the method comprises the following steps: filtering SQL query statements, generating a target query table in combination with filtering information, performing matching processing on the SQL query statements, then replacing corresponding query tables in the matched SQL query statements with the target query table to obtain target SQL query statements, performing data query on the target SQL query statements through a big data query engine, and sending an obtained query result to a user side. The invention further relates to a block chain technology, and the query result is stored in the block chain. According to the method, the associated file information and the filtering conditions are added into the query statement, so that the data query range is reduced, and the data query efficiency of big data is improved.

Description

technical field [0001] The present application relates to the technical field of data query, and in particular to a data query method, device, device and medium based on a big data query engine. Background technique [0002] Using big data technology to query and analyze a large amount of historical data is very mature. Its big data technology query has the following characteristics: large amount of data, which can reach several GB to TB of data, and even the data queried by some tasks may be close to or reach the PB level; a large number of tasks include SQL-like query tasks or themselves It is SQL query, which basically filters source data in a SQL-like manner; a large number of tasks filter data by date. [0003] Existing big data query uses data warehouse technology for data cleaning and processing, or submits timed tasks in the form of job for calculation in advance, and then performs data query through data scanning and data mapping. However, due to the large amount ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/242G06F16/335G06F40/211
CPCG06F16/2433G06F16/335G06F40/211
Inventor 包云飞
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap