35 results about "Database connectivity" patented technology

The invention relates to the technical field of data processing, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a database data verification method which comprises the following steps: configuring source database connection parameters and target database connection parameters, setting comparison task parameters, and associating the comparison task parameters with corresponding database connection parameters; determining a source table and a target table corresponding to the source table identifier and the target table identifier, executing table structure comparison to generate a structure difference record, determining a data range according to a comparison mode parameter, executing data volume comparison to generate a quantity difference value, determining a data sampling strategy, and performing content comparison to generate a feature identifier comparison result; and finally, integrating the structure difference record, the quantity difference value and the feature identification comparison result to generate a verification report. According to the method, the data range and the sampling strategy are driven by comparing the mode parameters, so that the integrated processing of structure comparison, quantity comparison and content comparison is realized, and the accuracy and efficiency of data synchronization verification are improved in a heterogeneous database environment.

The invention discloses a database connection pool management method and device, equipment and a storage medium, and relates to the technical field of database management, the method comprises the following steps: creating a corresponding cluster connection pool for each cluster according to cluster parameter information and cluster configuration information, the cluster connection pool comprising a plurality of connection clusters, the connection cluster comprises a plurality of target connections, and the target connections carry first tags and timers; creating a database cluster pool according to the corresponding relationship between the cluster identifier and the cluster connection pool; and managing the target connection based on the database cluster pool, the first tag and the timer. The database connection resources are managed in a unified manner through the two-stage pool, so that the overhead of connection establishment and disconnection is reduced, and the processing efficiency is improved. And assigning a label to each connection, and upgrading the database connection pool into unequal stateful connections. And the timer is used for marking and tracking the use condition of each connection, so that the life cycle of the connection can be managed, and the management efficiency of the connection pool is improved.

The invention relates to a data quality inspection method capable of dynamically expanding, which can dynamically add, modify and delete a data quality inspection rule, dynamically store database connection information and the quality inspection rule in a database, and obtain the database connection information and the quality inspection rule from the database in real time when the quality inspection is executed; the execution process of quality inspection is dynamically scheduled according to a frequency defined by a user, and comprises the following steps: realizing a quality inspection rule management system, performing the quality inspection execution process: performing timed task scheduling, acquiring a quality inspection rule, connecting a database, executing data query, executing quality inspection logic and storing a quality inspection result, and performing the quality inspection result processing process: performing anomaly detection, generating a quality inspection report and sending the report. The problem that a traditional data quality inspection system is insufficient in rule expansibility, complex rule support, database type adaptability and exception handling efficiency is solved, and quality monitoring and verification of large-scale and multi-source heterogeneous data are achieved by dynamically registering database links and quality inspection rules and combining complex expression analysis.

The invention relates to the technical field of power system automation, and provides a global database connection number control method and system based on an end side, and the method comprises the steps: calling a database connection assembly to achieve the access to a multi-type heterogeneous database service; the method comprises the following steps: transforming a heterogeneous database access component, adding a database connection handle state monitoring function module, and traversing heterogeneous database connection handles and releasing idle overtime database connection according to the current read-write state of the connection handles; when the non-idle database connection handle reaches the timeout time, the database connection is not forcibly released; after the database connection handle is automatically disconnected, the database connection is recovered when the current database connection handle generates the read-write request again; judging whether the current global connection number is out of limit or not, if yes, waiting until idle connection occurs, and then establishing new database connection; and setting the connection timeout time of the request database, and returning the timeout time. The method can be compatible with various types of heterogeneous databases.

The invention provides a method and system for accessing a database interface layer through an SAS language based on C + + middleware. The method comprises the following steps that the C + + middleware is called to obtain SAS statements of SAS language analysis software originating from the C + + middleware; performing word segmentation identification on database information in the SAS statement, and calling a database connection module of the C + + middleware based on the database information to establish a database connection pool; identifying the SAS statement by using the C + + middleware and converting the SAS statement into a database recognizable statement; the C + + middleware is used for transmitting the database recognizable statements to the corresponding database through the database connection pool, the problem that in the prior art, SAS language analysis software cannot be directly and efficiently connected with a universal database is solved, and high-performance, high-reliability and safe data access can be achieved.

This invention provides a method and system for accessing a database interface layer using SAS language based on C++ middleware. The method includes the following steps: calling C++ middleware to obtain SAS statements from SAS language analysis software; identifying database information in the SAS statements through word segmentation, and establishing a database connection pool based on the database information by calling the database connection module of the C++ middleware; using the C++ middleware to identify the SAS statements and convert them into database-recognizable statements; and using the C++ middleware to pass the database-recognizable statements to the corresponding database through the database connection pool. This solves the problem in the prior art that SAS language analysis software cannot directly and efficiently connect to general databases, and enables high-performance, high-reliability, and secure data access.

This invention discloses a data-based low-code development method, system, device, and medium, belonging to the field of database and low-code technology. The technical problem this invention aims to solve is how to build applications in low-code that are compatible with existing system data and enable rapid access to existing information system data. The technical solution adopted is as follows: Configuring database data to be retained: configuring the database connection URL, obtaining all tables in the corresponding database through the URL, creating a new database configuration table, and saving tables to be used later in the new system; Generating front-end pages based on database tables and SQL: embedding commonly used page templates in the low-code platform, selecting the database table to generate the front-end page, which has CRUD (Create, Read, Update, Delete) functions, and configuring the page's operation buttons and query conditions; configuring the front-end page style and reassembling the application menu information; configuring the application user center; generating the back-end framework and compilable front-end code; writing business code online and dynamically verifying it.

The application discloses a kind of flow TDengine database data self-defined synchronization method for power system, this method includes: database table and field synchronization method, data timing automatic synchronization method, database table is shown after synchronization.Database table and field synchronization method, by manual mode, add the database connection information of different levels, when manually triggering database or database table synchronization, connection path is automatically created in system, obtain database or table information and persist to local database, simultaneously it will be saved to Redis database.Data timing automatic synchronization method, in the scheduling task in system, create new scheduling task, and bind the data exchange connection line that has been created, that is, data can be extracted to receiver database at specified time point.Effectively improve data interaction efficiency, and power system data transmission efficiency, realize the purpose of data synchronization between different subject data in multi-layer architecture.

The application discloses a transaction processing method and device based on database connection, equipment and storage medium. The transaction processing method comprises the following steps: intercepting a database connection request; detecting whether the intercepted database connection request is from an open transaction; if yes, establishing the connection between the transaction and the database according to the database connection request; listening to the transaction and establishing a script record of the transaction; and determining an optimizable transaction record according to the script record. The transaction processing method based on database connection provided by the application embodiment realizes efficient listening to the transaction execution process, can automatically discover and determine the optimizable transaction record, realizes timely discovery and determination of the optimizable transaction record, facilitates staff to optimize the optimizable transaction record in time, reduces the error rate of the transaction execution process, improves the transaction execution efficiency, and reduces the artificial workload and the artificial cost.

Communication connections with databases, such as when deployed as a database layer of a system architecture, are resource intensive to establish, take down, and maintain. However, from the applications' perspective, deployed in a business logic layer, more database connections result in less delay interacting with the databases. In order to optimize system resources, systems and methods are disclosed that create an optimized number of database connections and / or application connections, that are then maintained and shared by the applications via a proxy intercepting the communications and forwarding the communications to the database via the optimized number of pooled database connections. The connections may be multiplex so that simultaneous communications may be hosted concurrently.

The invention discloses a structured query statement extraction method and device, equipment and a storage medium. The method comprises the steps that a module set, an environment variable set, a database connection tool set and an accessed database type set used by a Perl script to be processed are determined; constructing a virtual module set according to the module set, constructing a virtual database set according to the database type set, and constructing a virtual database connection tool set according to the database connection tool set; based on the module set, the environment variable set, the virtual module set, the virtual database connection tool set and the virtual database set, constructing a virtual environment for running the Perl script; and executing the Perl script in the virtual environment to obtain a structured query statement extraction result of the Perl script. In this way, generalization, safety and integrity of SQL statement extraction in the Perl script can be improved.

The invention provides a database access method and device. The method comprises the following steps: determining a pre-cured virtual IP address of a micro-service application; a connection request is sent to the virtual IP address, so that a database connection agent on one side of the database server returns database metadata according to the connection request; receiving database metadata; and determining a target drive type according to the database category, loading a database drive corresponding to the target drive type, and creating a database connection pool according to the database connection information by using the database drive. In the method, a micro-service application can receive database metadata which is returned by a database connection agent and comprises a database category and database connection information by sending a connection request to a virtual IP (Internet Protocol), and dynamically construct a database connection pool according to the database metadata, so that the application does not need to perceive information of a real database in the process; differences of heterogeneous databases are shielded, zero modification of configuration is realized, and the workload of application deployment operation and maintenance is remarkably reduced.

The invention relates to the technical field of data processing, and discloses a data dynamic verification method and device, computer equipment and a storage medium, the method comprises the following steps: configuring a connection pool corresponding to a multi-source database, and establishing a connection with the multi-source database based on the connection pool; setting a data verification rule, executing the data verification rule based on the specified object set and the corresponding database connection in the connection pool, and dynamically generating a structured query statement as an execution result; and outputting a verification conclusion based on the execution result and a preset expected value. According to the method, from database connection establishment, rule execution, query result comparison and conclusion output, full-process automation is achieved, connection with a multi-source database can be established, cross-database data verification is achieved, and the problems that in the prior art, multi-rule configuration is not supported, and cross-database query is difficult are solved.

The invention discloses a data exporting method and device, a storage medium and electronic equipment. The method relates to the field of financial science and technology or other fields, and comprises the following steps: determining a first thread and a second thread from a plurality of threads under the condition that a data export request is received; reading a key and a data type corresponding to the key from the target database node through a first database connection instance in the first thread; obtaining a value corresponding to the key from the target database node through a second database connection instance in the first thread; and exporting the read key, the value corresponding to the key and the data type corresponding to the key as a target file through a second thread. Through the data exporting method and device, the problem that the exporting efficiency is low when the data in the database node is exported as the file in the prior art is solved.

Embodiments of the present application disclose a gRPC-based database service providing method and device, a server and a medium, the method comprising: starting a gRPC service by using a preset interface definition file, listening to a specified port of the gRPC service, and exposing a unified execution method for facilitating client calling; receiving input minimum connection number parameters and maximum connection number parameters, initializing a database connection pool according to the minimum connection number and the maximum connection number; obtaining an idle connection from the connection pool when the execution method is called to execute, creating a new connection if there is no idle connection and the maximum connection number has not been reached; determining a corresponding operation type parameter according to a parameter list, executing a corresponding logical branch in the execution method according to the operation type parameter; obtaining a calculation execution result of the corresponding logical branch and returning the execution result to the client; and returning the connection to the database connection pool when the execution method is executed. The database access performance and resource utilization are improved.

Communication connections with databases, such as when deployed as a database layer of a system architecture, are resource intensive to establish, take down, and maintain. However, from the applications' perspective, deployed in a business logic layer, more database connections result in less delay interacting with the databases. In order to optimize system resources, systems and methods are disclosed that create an optimized number of database connections and / or application connections, that are then maintained and shared by the applications via a proxy intercepting the communications and forwarding the communications to the database via the optimized number of pooled database connections. The connections may be multiplex so that simultaneous communications may be hosted concurrently.

Systems and methods are disclosed for optimizing database join operations in large-scale relational databases using an integrated framework of quantum annealing, swarm intelligence, and genetic algorithms. The system employs quantum annealing to learn data distribution patterns, normalizing and transforming data to identify optimal join strategies and correlations across tables. Swarm intelligence predicts access patterns by deploying artificial ants to navigate data blocks, converging on high-relevance areas for prefetching. Genetic algorithms estimate join selectivity, calculating expected record counts to allocate resources efficiently. Learned index structures, dynamically created and tuned based on identified patterns, enhance retrieval speed with minimal storage. Additional features include learned Bloom filters for accurate join candidate selection, predictive page loading to reduce I / O wait times, and join order optimization to minimize intermediate result sizes. This modular, adaptive approach ensures rapid, resource-efficient query responses across diverse applications, such as banking and e-commerce.

Techniques for database connection management and governance in a multi-tenant provider network are described. One or more database broker instances connect to client applications and can obtain database connections for those client applications. The database connections can be pinned to particular client applications and / or multiplexed by and thus shared by multiple clients.

The embodiment of the application discloses a method for connecting GeoServer and a hive database, which comprises the following steps: obtaining connection parameters of a data source to be connected through a plug-in; sending the connection parameters to the GeoServer through the plug-in to determine a database corresponding to the connection parameters; establishing a data source object corresponding to the database through the plug-in; the data source object comprises a database identifier and a database driver class name; and establishing a connection between the GeoServer and the database based on the database identifier and the database driver class name through the plug-in. The method makes the GeoServer capable of publishing contents in the database, and has the characteristics of high cohesion and low coupling and good plug-and-play characteristics because the method is realized in the plug-in mode.

The application discloses a kind of database connection number anomaly detection, upper limit adjustment and quantity prediction system, including M1 data preprocessing module: for reading the connection number of corresponding database and writing M2 data storage module;M2 data storage module: for receiving data from other modules;M3 connection number threshold calculation module: for calculating observation connection number upper limit threshold, observation connection number lower limit threshold;M4 observation connection number upper limit threshold, observation connection number lower limit threshold, for sending alarm information;M5 design connection number threshold dynamic adjustment module: for adjusting connection number;M6 connection number capacity prediction module: prediction is carried out to future design connection number upper limit threshold.The application can realize the monitoring, deployment and prediction to database connection pool.

An apparatus provides an operating system service that receives, from an application in a batch environment, a plurality of database transactionality calls associated with a first program of the application, the first program having a first addressability mode. In response to at least one of the plurality of database transactionality calls, the operating system service provides a shared database connection to a database for the first program of the application and for a second program of the application that has a different and second addressability mode. In some implementations, the operating system service provides the shared database connection using one or more of a plurality of callable database transactionality classes, such as a plurality of callable Java classes in a Java archive (JAR) file.

The invention relates to a database connection sequence optimization method and device based on a bloom filter. The method comprises the following steps: in response to multi-table connection query, constructing a weighted connection graph which takes data tables as nodes and connection conditions as edges, and calculating filtering potential weights of the edges based on cardinal numbers and selectivity of each table; generating a maximum spanning tree, determining a root node, forming a directed filtering scheduling tree, and further generating a multi-stage bloom filter scheduling plan; the execution engine constructs a Bloom filter stage by stage from bottom to top according to the plan and detects and filters a downstream table connection key to realize global data pruning; and finally, performing connection operation on the filtered data set according to an original connection sequence. According to the method, through a pre-filtering mechanism independent of a connection sequence, the performance cliff caused by a cardinal number estimation error is eliminated, the scale of intermediate results is greatly reduced, memory overflow and sudden performance drop are avoided, the robustness and resource efficiency of complex query are remarkably improved, and the execution stability is guaranteed.

The invention provides a dynamic grouping and connection scheduling method for a database connection pool. According to the method, through multi-dimensional feature extraction and quantification, queried resource consumption attributes are accurately identified; dynamically dividing connection sub-pools based on clustering analysis, and realizing self-adaptive matching of query features and connection resources; in combination with packet routing, sub-pool load balancing and idle connection optimization strategies, the resource utilization rate and the response speed are remarkably improved; and through a closed-loop monitoring and dynamic adjustment mechanism, the distribution change and the system load fluctuation are adaptively inquired in real time, and the manual maintenance cost is reduced. Finally, the problems of rigidity of a fixed grouping strategy and preemption of a single resource pool are solved, query delay is reduced in a high-concurrency scene, and stability and expansibility of a database system are improved.

The application relates to a database connection pool management and monitoring method and system, which is used for managing and monitoring database connection pools of multiple clients, and comprises the following steps: S1, collecting data of multiple database connection pools through a data probe JavaAgent; S2, forwarding the data of the database connection pools to a stream processing module after the data is summarized; S3, the stream processing module carries out cleaning and clustering processing on the data of the database connection pools, and stores the processed data into a storage module; S4, an alarm module is used for alarming and early warning the data in the storage module; and S5, a server is used for acquiring a configuration version of the database connection pool in the data of the storage module, and updating the database connection pool configuration to the latest configuration. Compared with the prior art, the application is accurate and efficient, can monitor multiple database connection pools, and can realize dynamic adjustment of the connection pool configuration.

The application provides a data source connection pool control method and device and a server, relates to database technology, and the method comprises the following steps: obtaining data source configuration information of a server through middleware deployed in the server running an application; the configuration information comprises a database connection strategy of the server; in response to an editing operation on the database connection strategy, it is determined that the database connection strategy of the server is the middleware connection strategy; in response to a query instruction, target data sent by each target database in a plurality of target databases is received; based on the middleware connection strategy, if it is determined that the target data sent by any target database in the plurality of target databases has been obtained, the connection between any target database and the server is released according to the acquisition time of the target data. The application can dynamically analyze and release connection pool resources, improve the efficiency of data connection, and solve the problem of poor resource calling capability of database connection.

The application relates to a database connection reconstruction method, device, equipment, readable storage medium and program product. The method comprises the following steps: sending a node metadata query request to a management platform of a database cluster; receiving node metadata of a current database cluster returned by the management platform, wherein the node metadata comprises network addresses of master library nodes and backup library nodes in the database cluster; obtaining network addresses corresponding to created connections in a current connection pool, wherein the created connections comprise master library connections and backup library connections; performing consistency comparison on the network addresses of the master library nodes in the node metadata and the network addresses corresponding to the master library connections, and performing consistency comparison on the network addresses of the backup library nodes in the node metadata and the network addresses corresponding to the backup library connections; and in the case that the comparison results are inconsistent, reconstructing the connections in the connection pool according to the network addresses of the master library nodes and the network addresses of the backup library nodes in the node metadata, so that the connections can be quickly reconstructed.

The embodiment includes: receiving a request for access to data from a data source at the Database Connectivity (DBC) layer, wherein the data source is registered to a data directory including a data governance artifact, and wherein the request is made via a connection bypassing the data directory. The embodiment also includes: a governance manager at the DBC layer comparing the access permission level of the credentials associated with the request with the access requirements of the requested data included in data protection rules of the governance artifact. The embodiment further includes: the governance manager masking a portion of the data provided in response to the request, wherein this portion of the data has an access requirement where the access permission level of the credentials associated with the request is not met.

Embodiments of the present application disclose a database connectivity detection method, device and equipment and a storage medium. The method comprises the following steps: a pre-configured script is executed to generate a corresponding configuration file; configuration information of a target database contained in the configuration file is extracted; connectivity of the target database is detected based on the configuration information of the target database to obtain a detection result corresponding to the target database; and if the detection result is consistent with an expected result, it is determined that connectivity of the target database is normal. Embodiments of the present application can automatically execute a pre-configured script, support quick access to a target database and perform detection of detection items in a configuration file, thereby avoiding errors, omissions or low efficiency caused by manual application and manual detection.

The invention relates to a distributed database connection management method and a database connection management method. The method comprises the following steps: receiving a database connection request which is sent by a client and carries a target user identifier, a target database identifier and a starting parameter, searching available connections of the client based on the target user identifier, the target database identifier and the starting parameter, and distributing the searched available connections to the client, a trained connection use prediction model is called, the life cycle of the connection maintained in the connection pool of each database is predicted, a prediction result is obtained, and the connection use prediction model is obtained through training based on historical connection behavior feature data and historical system state data of different databases; and adjusting the connection retention condition of the connection pool of each database based on the prediction result. By adopting the method, the occupation of invalid connections on system resources can be remarkably reduced, and the execution efficiency of the database is improved.

The present application provides a multi-version dynamically extensible data source method, device, terminal and storage medium, which relates to the technical field of database data source loading. The method includes: creating a JAVA SDK package, the JAVA SDK package includes core dependencies, core entity classes, core interface classes, database connection pool management core classes, thread isolation, routing data source classes and basic properties of routing data source classes and target data source mapping, the target data source mapping is used to store the loaded database connection pool; based on the JAVA SDK package, initialize the system database connection pool in the application system; after initializing the system database connection pool in the application system, based on the JAVA SDK package, dynamically expand the new database connection pool in the application system. The present application has powerful dynamic expansion capabilities and loosely coupled design features, which can greatly improve the flexibility and extensibility of the system and reduce development and maintenance costs.