Supercharge Your Innovation With Domain-Expert AI Agents!

Method and system for implementing cross-multi-relation database sorting based on distributed stream calculation

A stream computing and database technology, applied in the field of communications, can solve problems such as memory overflow, limited memory, and inability to sort, and achieve high scalability and easy integration.

Active Publication Date: 2015-10-07
中电福富信息科技有限公司
View PDF2 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the application system executes the sorting statement through the data routing module to perform sorting operations, the massive data of each node is collected on the data routing module node, because the memory of a single data routing module node is limited, there will be a situation where memory overflow cannot be sorted

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for implementing cross-multi-relation database sorting based on distributed stream calculation
  • Method and system for implementing cross-multi-relation database sorting based on distributed stream calculation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Such as figure 1 and figure 2 Shown, an embodiment of the present invention is:

[0029] A method for sorting across multiple relational databases based on distributed stream computing, comprising the following steps:

[0030] Step 1. Accept the original SQL statement requested by the application system, and judge whether the original SQL statement contains an Order by statement. If the original SQL statement contains an Order by statement, and the Order by statement is "Order by field limit starting point n, step long m", then transform the original SQL statement into "Order by field limit 0, n+m". According to the transformed SQL statement, the field to be sorted can be obtained: Order by field, and the required limit number is: n+ m. The number of truncated results is: n (representing that the records before the nth item will be truncated and discarded, that is, the n+1th to n+mth items are taken out, a total of m records), and the transformed SQL statement needs ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a method for implementing cross-multi-relation database sorting based on distributed stream calculation, comprising: step 1, determining whether an original SQL statement comprises an Order by statement, if yes, transforming the original SQL statement, and encapsulating and sending a transformed SQL statement, a to-be-sorted field, a required limit quantity, a result truncation quantity, and connection configuration information of a relation database case; and if no, finishing the process; and step 2, sorting the relation database according to a parameter. The present invention further provides a system for implementing cross-multi-relation database sorting based on distributed stream calculation. The present invention avoids a problem of memory overflow when a data routing module responds to a sorting request of an application system. A node quantity of a distributed stream calculation module may be adjusted according to variation of a quantity of relation database cases, and extensibility is high. The present invention further has an advantage of being easy in integration with an existing system.

Description

technical field [0001] The invention relates to the field of communication technology, in particular to a method and system for realizing sorting across multiple relational databases based on distributed stream computing. Background technique [0002] With the advent of the era of big data, multiple relational database instances and data routing modules are increasingly used in various projects and software systems. The data routing module acts as a bridge between each node of the relational database and the application system, dismantling the Sql request statement initiated by the application system to each relational database instance, and then summarizing the data of each node and returning it to the application system. When the application system executes the sorting statement through the data routing module for sorting operations, massive data from each node is collected on the data routing module node. Because the memory of a single data routing module node is limited,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/2453G06F16/2471G06F16/27G06F16/284
Inventor 连城齐权林杰东郭海涛
Owner 中电福富信息科技有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More