Supercharge Your Innovation With Domain-Expert AI Agents!

Nested query method oriented to mass distributed-type database

A query method and database technology, which is applied in the field of massive data management, can solve problems such as limited SQL functions, performance problems, and difficulties in meeting financial needs, and achieve the effect of improving query performance and query speed

Active Publication Date: 2014-10-08
广东绵亘科技发展有限公司
View PDF3 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, although Oceanbase supports relational language operations, the supported SQL functions are very limited, especially for nested subqueries commonly used in financial applications, which have not yet been supported. There are also performance problems in the implemented query strategies, making it difficult to meet financial requirements. Requirements, cannot be imported into practical applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Nested query method oriented to mass distributed-type database
  • Nested query method oriented to mass distributed-type database
  • Nested query method oriented to mass distributed-type database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] refer to Figure 1-2 . The specific steps of the present invention's nested query method for massive distributed databases are as follows:

[0058] A. Build a query tree:

[0059] The strategy does not use the SQL rewriting technology of traditional relational databases, but adopts the scheme of "execute the inner query first, and execute the outer query after binding the result (set) of the inner query". This solution is easy to implement, and compared with the SQL rewriting technology, it reduces the amount of data transmitted to MergeServer, saves bandwidth, and reduces the impact of nested queries on concurrent queries.

[0060] For the following nested query SQL:

[0061] Select X.a from X WHERE X.b in (Select Y.b from Y)[AND / OR]

[0062] X.c in(select C.c from C WHERE C.d in(Select D.d from D)),

[0063] There is one main query (Select X.a from X WHERE X.b in...), represented by Q1, and three subqueries, (Select Y.b from Y) represented by Q2, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a nested query method oriented to a mass distributed-type database. The nested query method is used for solving the technical problem that an existing Oceanbase SQL query method does not support nested queries. According to the technical scheme, the nested subquery function is achieved by building a query tree and a query engine. During small data set queries, a subquery result set is directly bound to a physical plan. During large data volume queries, two-stage filtering strategies are started, first-time filtering is carried out on a ChunkServer through a BloomFilter, secondary accurate matching is carried out on filtered data on a MergeServer, and result sets needing comparison are stored through a HashMap. As a large number of unrelated data can be rapidly filtered out by the BloomFilter, and the result sets meeting conditions can be rapidly matched through the HashMap, the SQL query speed is greatly increased by the nested query method on the basis that the nested queries are achieved.

Description

technical field [0001] The invention belongs to the field of massive data management under the cloud computing environment, and in particular relates to a nested query method for massive distributed databases. Background technique [0002] With the further development of technologies such as cloud computing and web2.0, traditional relational databases are unable to cope with massive data processing. The NoSQL database has given up the strict transaction consistency and paradigm constraints of traditional relational databases, adopts a weak consistency model, supports distributed and horizontal expansion, and meets the needs of massive data management, so it has received widespread attention in the field of big data processing. and applications such as Google's BigTable and Amazon's Dynamo. Compared with traditional relational data, NoSQL database has the characteristics of high cost performance and scalability, which makes NoSQL database the first choice for domestic financ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/24553G06F16/27
Inventor 刘文洁裴欧亚李战怀田征
Owner 广东绵亘科技发展有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More