20 results about "Database connectivity" patented technology

The invention provides a method and system for accessing a database interface layer through an SAS language based on C + + middleware. The method comprises the following steps that the C + + middleware is called to obtain SAS statements of SAS language analysis software originating from the C + + middleware; performing word segmentation identification on database information in the SAS statement, and calling a database connection module of the C + + middleware based on the database information to establish a database connection pool; identifying the SAS statement by using the C + + middleware and converting the SAS statement into a database recognizable statement; the C + + middleware is used for transmitting the database recognizable statements to the corresponding database through the database connection pool, the problem that in the prior art, SAS language analysis software cannot be directly and efficiently connected with a universal database is solved, and high-performance, high-reliability and safe data access can be achieved.

This invention provides a method and system for accessing a database interface layer using SAS language based on C++ middleware. The method includes the following steps: calling C++ middleware to obtain SAS statements from SAS language analysis software; identifying database information in the SAS statements through word segmentation, and establishing a database connection pool based on the database information by calling the database connection module of the C++ middleware; using the C++ middleware to identify the SAS statements and convert them into database-recognizable statements; and using the C++ middleware to pass the database-recognizable statements to the corresponding database through the database connection pool. This solves the problem in the prior art that SAS language analysis software cannot directly and efficiently connect to general databases, and enables high-performance, high-reliability, and secure data access.

The application discloses a transaction processing method and device based on database connection, equipment and storage medium. The transaction processing method comprises the following steps: intercepting a database connection request; detecting whether the intercepted database connection request is from an open transaction; if yes, establishing the connection between the transaction and the database according to the database connection request; listening to the transaction and establishing a script record of the transaction; and determining an optimizable transaction record according to the script record. The transaction processing method based on database connection provided by the application embodiment realizes efficient listening to the transaction execution process, can automatically discover and determine the optimizable transaction record, realizes timely discovery and determination of the optimizable transaction record, facilitates staff to optimize the optimizable transaction record in time, reduces the error rate of the transaction execution process, improves the transaction execution efficiency, and reduces the artificial workload and the artificial cost.

Communication connections with databases, such as when deployed as a database layer of a system architecture, are resource intensive to establish, take down, and maintain. However, from the applications' perspective, deployed in a business logic layer, more database connections result in less delay interacting with the databases. In order to optimize system resources, systems and methods are disclosed that create an optimized number of database connections and / or application connections, that are then maintained and shared by the applications via a proxy intercepting the communications and forwarding the communications to the database via the optimized number of pooled database connections. The connections may be multiplex so that simultaneous communications may be hosted concurrently.

The invention discloses a structured query statement extraction method and device, equipment and a storage medium. The method comprises the steps that a module set, an environment variable set, a database connection tool set and an accessed database type set used by a Perl script to be processed are determined; constructing a virtual module set according to the module set, constructing a virtual database set according to the database type set, and constructing a virtual database connection tool set according to the database connection tool set; based on the module set, the environment variable set, the virtual module set, the virtual database connection tool set and the virtual database set, constructing a virtual environment for running the Perl script; and executing the Perl script in the virtual environment to obtain a structured query statement extraction result of the Perl script. In this way, generalization, safety and integrity of SQL statement extraction in the Perl script can be improved.

The invention discloses a data exporting method and device, a storage medium and electronic equipment. The method relates to the field of financial science and technology or other fields, and comprises the following steps: determining a first thread and a second thread from a plurality of threads under the condition that a data export request is received; reading a key and a data type corresponding to the key from the target database node through a first database connection instance in the first thread; obtaining a value corresponding to the key from the target database node through a second database connection instance in the first thread; and exporting the read key, the value corresponding to the key and the data type corresponding to the key as a target file through a second thread. Through the data exporting method and device, the problem that the exporting efficiency is low when the data in the database node is exported as the file in the prior art is solved.

Embodiments of the present application disclose a gRPC-based database service providing method and device, a server and a medium, the method comprising: starting a gRPC service by using a preset interface definition file, listening to a specified port of the gRPC service, and exposing a unified execution method for facilitating client calling; receiving input minimum connection number parameters and maximum connection number parameters, initializing a database connection pool according to the minimum connection number and the maximum connection number; obtaining an idle connection from the connection pool when the execution method is called to execute, creating a new connection if there is no idle connection and the maximum connection number has not been reached; determining a corresponding operation type parameter according to a parameter list, executing a corresponding logical branch in the execution method according to the operation type parameter; obtaining a calculation execution result of the corresponding logical branch and returning the execution result to the client; and returning the connection to the database connection pool when the execution method is executed. The database access performance and resource utilization are improved.

Communication connections with databases, such as when deployed as a database layer of a system architecture, are resource intensive to establish, take down, and maintain. However, from the applications' perspective, deployed in a business logic layer, more database connections result in less delay interacting with the databases. In order to optimize system resources, systems and methods are disclosed that create an optimized number of database connections and / or application connections, that are then maintained and shared by the applications via a proxy intercepting the communications and forwarding the communications to the database via the optimized number of pooled database connections. The connections may be multiplex so that simultaneous communications may be hosted concurrently.

Systems and methods are disclosed for optimizing database join operations in large-scale relational databases using an integrated framework of quantum annealing, swarm intelligence, and genetic algorithms. The system employs quantum annealing to learn data distribution patterns, normalizing and transforming data to identify optimal join strategies and correlations across tables. Swarm intelligence predicts access patterns by deploying artificial ants to navigate data blocks, converging on high-relevance areas for prefetching. Genetic algorithms estimate join selectivity, calculating expected record counts to allocate resources efficiently. Learned index structures, dynamically created and tuned based on identified patterns, enhance retrieval speed with minimal storage. Additional features include learned Bloom filters for accurate join candidate selection, predictive page loading to reduce I / O wait times, and join order optimization to minimize intermediate result sizes. This modular, adaptive approach ensures rapid, resource-efficient query responses across diverse applications, such as banking and e-commerce.

The invention relates to a database connection sequence optimization method and device based on a bloom filter. The method comprises the following steps: in response to multi-table connection query, constructing a weighted connection graph which takes data tables as nodes and connection conditions as edges, and calculating filtering potential weights of the edges based on cardinal numbers and selectivity of each table; generating a maximum spanning tree, determining a root node, forming a directed filtering scheduling tree, and further generating a multi-stage bloom filter scheduling plan; the execution engine constructs a Bloom filter stage by stage from bottom to top according to the plan and detects and filters a downstream table connection key to realize global data pruning; and finally, performing connection operation on the filtered data set according to an original connection sequence. According to the method, through a pre-filtering mechanism independent of a connection sequence, the performance cliff caused by a cardinal number estimation error is eliminated, the scale of intermediate results is greatly reduced, memory overflow and sudden performance drop are avoided, the robustness and resource efficiency of complex query are remarkably improved, and the execution stability is guaranteed.

The invention provides a dynamic grouping and connection scheduling method for a database connection pool. According to the method, through multi-dimensional feature extraction and quantification, queried resource consumption attributes are accurately identified; dynamically dividing connection sub-pools based on clustering analysis, and realizing self-adaptive matching of query features and connection resources; in combination with packet routing, sub-pool load balancing and idle connection optimization strategies, the resource utilization rate and the response speed are remarkably improved; and through a closed-loop monitoring and dynamic adjustment mechanism, the distribution change and the system load fluctuation are adaptively inquired in real time, and the manual maintenance cost is reduced. Finally, the problems of rigidity of a fixed grouping strategy and preemption of a single resource pool are solved, query delay is reduced in a high-concurrency scene, and stability and expansibility of a database system are improved.

The application relates to a database connection pool management and monitoring method and system, which is used for managing and monitoring database connection pools of multiple clients, and comprises the following steps: S1, collecting data of multiple database connection pools through a data probe JavaAgent; S2, forwarding the data of the database connection pools to a stream processing module after the data is summarized; S3, the stream processing module carries out cleaning and clustering processing on the data of the database connection pools, and stores the processed data into a storage module; S4, an alarm module is used for alarming and early warning the data in the storage module; and S5, a server is used for acquiring a configuration version of the database connection pool in the data of the storage module, and updating the database connection pool configuration to the latest configuration. Compared with the prior art, the application is accurate and efficient, can monitor multiple database connection pools, and can realize dynamic adjustment of the connection pool configuration.

The application relates to a database connection reconstruction method, device, equipment, readable storage medium and program product. The method comprises the following steps: sending a node metadata query request to a management platform of a database cluster; receiving node metadata of a current database cluster returned by the management platform, wherein the node metadata comprises network addresses of master library nodes and backup library nodes in the database cluster; obtaining network addresses corresponding to created connections in a current connection pool, wherein the created connections comprise master library connections and backup library connections; performing consistency comparison on the network addresses of the master library nodes in the node metadata and the network addresses corresponding to the master library connections, and performing consistency comparison on the network addresses of the backup library nodes in the node metadata and the network addresses corresponding to the backup library connections; and in the case that the comparison results are inconsistent, reconstructing the connections in the connection pool according to the network addresses of the master library nodes and the network addresses of the backup library nodes in the node metadata, so that the connections can be quickly reconstructed.

The embodiment includes: receiving a request for access to data from a data source at the Database Connectivity (DBC) layer, wherein the data source is registered to a data directory including a data governance artifact, and wherein the request is made via a connection bypassing the data directory. The embodiment also includes: a governance manager at the DBC layer comparing the access permission level of the credentials associated with the request with the access requirements of the requested data included in data protection rules of the governance artifact. The embodiment further includes: the governance manager masking a portion of the data provided in response to the request, wherein this portion of the data has an access requirement where the access permission level of the credentials associated with the request is not met.

Embodiments of the present application disclose a database connectivity detection method, device and equipment and a storage medium. The method comprises the following steps: a pre-configured script is executed to generate a corresponding configuration file; configuration information of a target database contained in the configuration file is extracted; connectivity of the target database is detected based on the configuration information of the target database to obtain a detection result corresponding to the target database; and if the detection result is consistent with an expected result, it is determined that connectivity of the target database is normal. Embodiments of the present application can automatically execute a pre-configured script, support quick access to a target database and perform detection of detection items in a configuration file, thereby avoiding errors, omissions or low efficiency caused by manual application and manual detection.

The invention relates to a distributed database connection management method and a database connection management method. The method comprises the following steps: receiving a database connection request which is sent by a client and carries a target user identifier, a target database identifier and a starting parameter, searching available connections of the client based on the target user identifier, the target database identifier and the starting parameter, and distributing the searched available connections to the client, a trained connection use prediction model is called, the life cycle of the connection maintained in the connection pool of each database is predicted, a prediction result is obtained, and the connection use prediction model is obtained through training based on historical connection behavior feature data and historical system state data of different databases; and adjusting the connection retention condition of the connection pool of each database based on the prediction result. By adopting the method, the occupation of invalid connections on system resources can be remarkably reduced, and the execution efficiency of the database is improved.

The invention relates to the technical field of database operation and maintenance, in particular to an intelligent SQL (Structured Query Language) script execution and management system, which comprises the following modules: a configuration management module receives and uniformly stores script files input by a user and database connection configuration; the session management module generates a session context with a unique identifier to associate the whole process of the single operation; the data source management module adopts a connection pool technology to establish and maintain database connection; the coding adaptation module can automatically identify and convert SQL scripts in different coding formats; the script execution engine obtains the matched script content in batches based on the session context, grammar verification is carried out before execution, and batch operation is completed through multiplexing connection; and the log recording and analyzing module captures and structurally stores the complete process and result information executed each time in real time, and supports multi-dimensional query and export. The problems that in a traditional mode, operation efficiency is low, error positioning is difficult, script management is disordered, and coding compatibility is poor are solved.

The invention provides an automatic detection method and device for database connection abnormal conditions, a medium and a product. The automatic detection method for the database connection abnormal condition comprises the steps of obtaining original data of database connection in a preset time period, wherein the original data comprises starting time and current connection states of all database connection in the preset time period; a preset performance index of the database is obtained through calculation according to the original data, the preset performance index comprises the average number of newly-built connections per second and the average proportion of newly-built short connections per second, and the short connections are database connections with the survival time smaller than a preset time threshold value; determining whether the database has an abnormal connection condition based on a preset performance index; if the connection abnormal condition exists, an alarm prompt and a preset optimization suggestion are output, the alarm prompt comprises the preset performance index obtained through calculation, and the preset optimization suggestion comprises establishment of the connection pool. And the continuous automatic detection of the database connection condition is realized.

The invention discloses a standardized low-code method and system adaptive to multiple data sources and multiple service functions. The standardized low-code method comprises the following steps: creating a corresponding Velocity template engine file according to service requirements; performing standardization processing on the template file during writing; a front-end page is added, a database driver is selected on the page, database configuration is filled in, and connection with a database is established; establishing a data source connection tool class; and during generating and previewing, firstly executing table information query by using the established database connection. The development efficiency is remarkably improved, repeated labor is reduced, and compared with the limitation of an existing universal code generation tool and the problem that an ORM framework is only limited to a persistent layer, the workload of manually compiling a modeling code by a developer is reduced.

The invention discloses a data synchronization system, device and method from a problem management tool to a flying book spreadsheet application, and relates to the technical field of data processing. A system master control module starts and manages a data synchronization work module, and triggers a synchronization task regularly; the data synchronization work module calls data synchronization objects to perform query and retrieval operation on a database of a problem management tool through a database connection pool, and each data synchronization object adopts a flying book spreadsheet communication object instance to perform data refreshing on different spreadsheets of flying book background services; and the database connection pool is used for creating and managing database connection object instances. The problem ticket data in each engineering project of the new energy electric vehicle OEM can be periodically and automatically synchronized to the flying book online spreadsheet from the problem management tool, and the problem data can be automatically displayed from multiple dimensions by configuring the multi-dimensional sheet and the real-time billboard of the flying book system.