Sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation

A technology of sub-database sub-table and high-level language, applied in the field of information, can solve the problems of lack of talents, inability to make full use of SQL standards, immature distributed database management, etc., to achieve the effect of reducing technical requirements and ensuring security

Active Publication Date: 2015-12-09
WEIRONG TECH CO LTD
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 2. The management of distributed databases is immature, and there is a lack of management talents
[0016] From the above execution process, the MapReduce solution is a brand new data processing solution. In the process of processing, either the traditional relational database is not used at all, or the original data is simply extracted from the database when used, and

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation
  • Sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation
  • Sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0048] The following describes in detail the implementation steps and specific methods of the present invention.

[0049] The realization of the present invention is a set of MapReduce methods based on the sub-database sub-table of the traditional relational database and the high-level language stream aggregation technology. The traditional database is divided into tables to store big data, and the high-level language stream aggregation technology is used to solve the defect that the traditional database and tables cannot be MapReduce functions.

[0050] The following first gives an architecture diagram of the entire sub-database and sub-table merge query based on high-level language aggregation computing to illustrate the entire workflow and main module tasks, and finally the sub-table describes the specific implementation of each module.

[0051] The system architecture diagram of the present invention is as follows figure 2 with image 3 Shown. Since the ultimate goal of the pres...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation. The method comprises the steps that firstly, the relational database sub-library and sub-table problems are solved by extending a Spring template technology, and the safety of sub-library key values of concurrent access is guaranteed through ThreadLocal; secondly, sub-libraries and sub-tables are queried through a CompletableFuture technology in an asynchronous and unblocked mode; finally, query results are aggregated through a stream technology, and a final result is formed and returned back to a client side. The powerful data analysis capacity of traditional relational data is utilized, and the up-to-date stream technology is used for reducing intermediate results to the final result; the stability and powerful functions of the traditional relational database are reserved, and an up-to-date MapReduce technology is extended for the traditional database.

Description

technical field [0001] The invention relates to a method for performing SQLmerge query on the basis of sub-databases and tables of a traditional relational database, in particular to a method for querying merge of sub-databases and tables based on high-level language concurrent aggregation calculation, and belongs to the field of information technology. Background technique [0002] With the development of Internet technology and the Internet of Things, many traditional industries have invested in the Internet, resulting in a large number of "Internet +" demands, many of which are based on big data. The current popular Internet big data solutions are based on distributed databases and distributed MapReduce solutions. [0003] Distributed databases and distributed MapReduce solutions are very popular big data computing frameworks today, featuring strong computing power, strong fault tolerance, strong data availability, and strong scalability. [0004] However, distributed da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/27G06F16/284
Inventor 魏伟陈祥献冯国平商茎正虞华锋陈小勇
Owner WEIRONG TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap