Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation

A technology of sub-database sub-table and high-level language, applied in the field of information, can solve the problems of lack of talents, inability to make full use of SQL standards, immature distributed database management, etc., to achieve the effect of reducing technical requirements and ensuring security

Active Publication Date: 2015-12-09
WEIRONG TECH CO LTD
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 2. The management of distributed databases is immature, and there is a lack of management talents
[0016] From the above execution process, the MapReduce solution is a brand new data processing solution. In the process of processing, either the traditional relational database is not used at all, or the original data is simply extracted from the database when used, and it cannot be maximized. Second, whether it is the MapReduce tool Hadoop or the distributed database hbase, it is a brand-new technology for development and has a considerable learning curve; finally, the distributed database hbase is also a brand-new technology for users. technology, users do not have mature maintenance mechanisms and personnel like relational databases

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation
  • Sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation
  • Sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The implementation steps and specific methods of the present invention will be described in detail below.

[0049] The realization of the present invention is a set of MapReduce methods based on the sub-database and sub-table of the traditional relational database and high-level language stream aggregation technology. By storing big data through sub-databases and tables in traditional databases, and using high-level language stream aggregation technology to solve the defect that traditional sub-databases and sub-tables cannot do MapReduce functions.

[0050] The following first gives the architecture diagram of the entire sub-database and sub-table merge query based on high-level language aggregation calculations, illustrating the entire workflow and main module tasks, and finally sub-tables describe the specific implementation of each module.

[0051] The system architecture diagram of the present invention is as follows figure 2 with image 3 shown. Because the ult...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a sub-library and sub-table merge query method based on high-level language concurrent aggregation calculation. The method comprises the steps that firstly, the relational database sub-library and sub-table problems are solved by extending a Spring template technology, and the safety of sub-library key values of concurrent access is guaranteed through ThreadLocal; secondly, sub-libraries and sub-tables are queried through a CompletableFuture technology in an asynchronous and unblocked mode; finally, query results are aggregated through a stream technology, and a final result is formed and returned back to a client side. The powerful data analysis capacity of traditional relational data is utilized, and the up-to-date stream technology is used for reducing intermediate results to the final result; the stability and powerful functions of the traditional relational database are reserved, and an up-to-date MapReduce technology is extended for the traditional database.

Description

technical field [0001] The invention relates to a method for performing SQLmerge query on the basis of sub-databases and tables of a traditional relational database, in particular to a method for querying merge of sub-databases and tables based on high-level language concurrent aggregation calculation, and belongs to the field of information technology. Background technique [0002] With the development of Internet technology and the Internet of Things, many traditional industries have invested in the Internet, resulting in a large number of "Internet +" demands, many of which are based on big data. The current popular Internet big data solutions are based on distributed databases and distributed MapReduce solutions. [0003] Distributed databases and distributed MapReduce solutions are very popular big data computing frameworks today, featuring strong computing power, strong fault tolerance, strong data availability, and strong scalability. [0004] However, distributed da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/27G06F16/284
Inventor 魏伟陈祥献冯国平商茎正虞华锋陈小勇
Owner WEIRONG TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com