Unlock instant, AI-driven research and patent intelligence for your innovation.

Cross-data-source query method and system based on message queue and server node

A message queue and cross-data source technology, applied in database management systems, electronic digital data processing, structured data retrieval, etc., can solve the problem of low query throughput, non-expandable, high real-time requirements and high throughput. And other issues

Inactive Publication Date: 2020-10-30
合肥森亿智能科技有限公司 +1
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional blockchain adopts a chain structure and maintains the globally unified longest chain through the consensus mechanism of the whole network. The query throughput is low and cannot be expanded, so that it cannot be applied to scenarios that require high real-time performance and high throughput. such as banks and exchanges

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-data-source query method and system based on message queue and server node
  • Cross-data-source query method and system based on message queue and server node
  • Cross-data-source query method and system based on message queue and server node

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] Such as figure 1 As shown, this embodiment provides a message queue-based cross-data source query method, including:

[0041] Step S100, generating SOL statements based on the data input by the user;

[0042] Step S200, optimizing the SOL statement to obtain the SOL statement with the highest execution efficiency;

[0043] Step S300, obtaining search data according to the SOL statement with the highest execution efficiency, and updating the local node according to the search data;

[0044] Step S400, randomly mirror the update data to the message queues of each node in the pre-configured message queue cluster.

[0045] Steps S100 to S400 of the method for querying across data sources based on message queues in this embodiment will be described in detail below.

[0046] Step S100, generating SOL statements based on the data input by the user.

[0047] In this embodiment, if figure 2 As shown, a specific implementation of generating the SOL statement based on the qu...

Embodiment 2

[0068] Such as Figure 7 As shown, this embodiment provides a message queue-based cross-data source query system 100, the message queue-based cross-data source query system 100 includes: SOL preprocessing module 110, SOL optimization module 120 and metadata update module 130 .

[0069] In this embodiment, the SOL preprocessing module 110 is used to generate SOL sentences based on the data input by the user.

[0070] Wherein, the SOL pre-processing module 110 generates SOL statements according to variables to be queried, grouping and / or association of operation data, and metadata of local nodes.

[0071] In this embodiment, the message queue-based cross-data source query system 100 further includes: a visualization operation module 140, configured to declare variables to be queried, group and / or associate operation data.

[0072] Specifically, in this embodiment, the variables to be queried are declared through the RabbitMQ management page of the visual operation module 140, ...

Embodiment 3

[0085] Such as Figure 9 As shown, this embodiment also provides a server node 1100, such as Figure 8 As shown, the server node 1100 includes a processor 1101 , a memory 1102 and a display 1103 . In one embodiment, the display may be an OLED, LED or LCD display, etc., and the display 1103 may also include an interactive display device such as a touch screen, which is not specifically limited in this embodiment.

[0086] The memory 1102 is connected to the processor 1101 through the system bus to complete mutual communication, the memory 1102 is used to store computer programs, the processor 1101 is coupled to the display 1003 and the memory 1002, and the processor 1101 is used to run the computer programs, so that The server node 1100 executes the message queue-based cross-data source query method described in Embodiment 1. Embodiment 1 has described the message queue-based cross-data source query method in detail, so details will not be repeated here.

[0087]The message ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a cross-data-source query method and system based on a message queue and a server node. The cross-data-source query system based on the message queue comprises an SOL preprocessing module which is used for generating an SOL statement based on the data inputted by a user; an SOL optimization module which is used for optimizing the SOL statement to obtain the SOL statement with the highest execution efficiency; and a metadata updating module which is used for acquiring search data according to the SOL statement with the highest execution efficiency, updating a local node according to the search data, and randomly mirroring the updated data to a message queue of each node in a pre-configured message queue cluster. According to the method, the query throughput can be further improved, cross-data-source and cross-region distributed query is realized, and all queues in the cluster can be seen by a user side connected to any node even if the queues are not located on the connection node.

Description

technical field [0001] The invention belongs to the technical field of big data, in particular to the technical field of distributed query across data sources. Background technique [0002] Distributed query across data sources is one of the research hotspots in the industry in recent years. Traditional technical solutions cannot meet its requirements due to the limitations of scalability and processing performance. The emerging message queue-based technology has good scalability and needs to gather data from different data sources into the same database. Due to the characteristics of non-tamperable modification, anonymity and decentralization, blockchain technology has been widely used in industry and academia. The widespread attention has spawned a large number of blockchain applications, including Bitcoin, Ethereum, etc. The traditional blockchain adopts a chain structure and maintains the globally unified longest chain through the consensus mechanism of the whole netwo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2453G06F16/242G06F16/2458G06F16/25
CPCG06F16/2433G06F16/2453G06F16/2471G06F16/252
Inventor 杨文龙郭罗军刘永超
Owner 合肥森亿智能科技有限公司