Data connection method and data connection system

Abstract

The invention brings forward a data connection method and data connection system. The data connection method comprises following steps: obtaining multiple available connections from a connection pool based on a received resources obtaining request; using multiple available connections to obtain target resources for the resources obtaining request; and recovering any available connection to the connection pool after using any available connection of the multiple available connections. By adoption of the technical scheme, multi-thread calculating tasks and balanced management of database resources are created such that relations between multi-thread calculating tasks and database connection resources can be reasonably managed in order to increase utilization rate of database connection resources; and the purposes of reducing system breakdown and improving system performance are fulfilled.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data connection method and a data connection system. Background technique [0002] At present, with the development of computer technology and information management technology, the application complexity and data volume of large-scale management systems are increasing, and it is often necessary to process large-scale data calculations, read huge amounts of data, and complicate the calculation process. Existing systems mostly use Single-threaded computing, read data first, and then perform calculations. [0003] Specifically, the existing system processes data slowly when querying data from the database, and the system resource consumption is mainly concentrated on input and output transmission and memory reading. When processing large amounts of data, memory overflow is prone to occur. In addition, due to the huge amount of data in the entire calculation query, a si...

AI Technical Summary

Problems solved by technology

[0002] At present, with the development of computer technology and information management technology, the application complexity and data volume of large-scale management systems are increasing, and it is often necessary to process large-scale data calculations, read huge amounts of data, and complicate the calculation process. Existing systems mostly use Single-threaded calculation, read data first, then calculate

[0003] Specifically, the existing system processes data slowly when querying data from the database, and the system resource consumption is mainly concentrated on input and output transmission and memory reading. When processing large amounts of data, memory overflow is prone to occur

In addition, due to the huge amount of data in the entire calculation query, a single query of large data increases the consumption of database resources, the entire calculation takes a long time, and the resources of the controller are insufficiently used during the calculation process.

[0004] In order to solve the above problems, in related technologies, although a multi-threaded batch computing scheme can be used for calculation processing, and a single large amount of data processing data is converted into multiple batch processing, this processing scheme is based on the task during calculation. How many threads are enabled, without considering the relationship between multithreading and data resources, just blindly requesting resources without managing resources, this method will easily lead to exhaustion of database resources and system crashes

In addition, frequently establishing and closing connections will greatly consume system performance, causing the use of database connections to become the bottleneck of system performance

Images