86 results about "Connection pool" patented technology

The invention belongs to the technical field of data processing, and discloses an active intelligent operation and maintenance monitoring method for a data center, which comprises the following steps: step 1, component modeling and topology configuration; 2, carrying out distributed health detection and data acquisition; 3, performing real-time health assessment and anomaly detection; 4, performing intelligent alarm and root cause analysis; 5, unified operation and maintenance and closed-loop control are carried out; and step 6, dynamically optimizing the intelligent operation and maintenance strategy. According to the method, a monitoring object and a dependency relationship are clarified through component modeling and topological configuration, and specific scenes, such as multi-mode acquisition, active detection, index pulling, log analysis, coverage message queue theme accumulation and database connection pool exhaustion, of distributed health detection are combined. The quantitative health score is calculated based on the preset scoring model, and by combining with the dynamic baseline learned by the ARIMA or LSTM algorithm, the module abnormity can be actively detected in different periods and weekly updating, and the problems of fault discovery lagging and incomplete monitoring coverage are solved.

The invention relates to the technical field of data processing, and discloses a log data batch updating method and device, equipment and a medium, and the method comprises the steps: obtaining a full-amount historical log in a preset database in real time, converting the full-amount historical log into an event stream, and writing the event stream into preset message middleware, obtaining a partition ID of the total historical log in the message middleware, generating a global unique identifier bound with a partition according to the partition ID to obtain a distributed ID, generating a consumer ID associated with the user identity information according to the distributed ID by calling a pre-designed distributed algorithm, and sending the consumer ID to the message middleware. And carrying out lock-free parallel updating on the database according to the consumer ID based on connection pool preheating and asynchronous submission to obtain an updating result, carrying out consistency verification on the updating result to obtain a verification result, and confirming the updating result according to the verification result. And the batch updating efficiency of the log data is improved.

The invention provides a heterogeneous database query method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out security verification processing on a plurality of SQL execution requests sent by a user side, and carrying out SPI mechanism scanning processing on a plurality of database plug-ins in a heterogeneous database plug-in directory based on a high-performance database connection pool after the security verification processing is passed, determining a target database plug-in package corresponding to each SQL execution request; and performing metadata query processing on the SQL execution request in the target data source based on a database operation client interface and a metadata service interface under the target database plug-in package, and determining a structured tree result. According to the method, an extensible and dynamically integrated heterogeneous database plug-in mechanism is realized, unified access of various databases is supported, the platform maintenance cost is remarkably reduced, hierarchical metadata of any type of databases is obtained through a consistent metadata service interface, and the user experience and the cross-database query efficiency are improved.

The invention relates to the technical field of unmanned aerial vehicle control and management systems, in particular to an unmanned aerial vehicle parameter management method based on template management, and the method comprises the steps: building multi-device concurrent connection with an unmanned aerial vehicle flight control system through a communication abstraction layer, integrating a protocol adaptation module, a port automatic detection engine and a multi-device connection pool, and achieving a unified device access interface; parameters are structured and managed through the core processing module, a dynamic parameter tree, a batch operation engine and a template management system are constructed, verification operation is monitored through the safety control module, and an auditing system, a version control engine and a parameter verification module are integrated. According to the invention, by constructing a modular architecture of a communication abstraction layer, a core processing layer and a security control layer, adopting a dynamic parameter tree, a difference comparison algorithm and a template management system, and combining an operation auditing and atomic transaction writing technology, low resource occupation and high-concurrency batch operation are realized, the production line efficiency is improved, and the production cost is reduced. And parameter consistency, safety and traceability are guaranteed.

The invention relates to the technical field of data testing and the field of smart medical treatment and financial science and technology, and provides a load balancing testing method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: generating a load balancing testing request based on a testing module of a client; forwarding the load balancing test request to a load balancing proxy node based on a switch; determining a target test script from the load balancing agent node according to the load balancing test request; performing data forwarding processing on the client and the communication test instrument based on the load balancing agent node according to the target test script, and detecting on the load balancing agent node to obtain a CPU utilization rate, a memory occupancy rate, connection pool state information and request processing delay information; and determining a load balancing test result according to the CPU utilization rate, the memory occupancy rate, the connection pool state information and the request processing delay information. Through the technical scheme, comprehensive and reliable test processing can be performed on the load balancing server simply, conveniently and quickly.

This invention relates to the field of experimental data storage technology for nuclear fusion devices, and discloses a method for large-scale EPICS data archiving based on a time-series database. The method involves acquiring process variables in an event-driven acquisition mode through an embedded channel access protocol data acquisition module and writing them into buffered memory channels. Through group aggregation and batch persistence, the process variables are grouped into fixed-size groups, each group corresponding to an aggregation coroutine. The latest event data is read non-blockingly from the buffered memory channels of each group at fixed intervals. Metadata mapping is used to convert the process variable names into device paths and measurement value names in the time-series database, assembling them into a sparse wide table. Null value columns in the sparse wide table are filtered, and the data is then batch-written into a distributed time-series database through a connection pool. This invention achieves stable high-throughput writing and low-latency retrieval of large-scale experimental data in the EPICS system, and provides an efficient data access interface for subsequent artificial intelligence training and inference platforms.

The application belongs to the technical field of computers and discloses a general metadata operation method and system based on a graph database, which comprises the following steps: S1, using a configuration file yml of SpringBoot to configure to create a connection pool SessionPool of a NebulaGraph Database graph database based on a NebulaPool custom implementation, containing definitions of maxCountSession, minCountSession, hostAndPort, userName and passWord parameters; S2, defining parameter models for accepting different interfaces, including a model for creating a graph space, a model for creating a point, a model for creating an edge, a model for creating an index and a general query model; S3, using an independently developed NebulaUtil tool to automatically arrange nGQL statements for the accepted parameter models according to the input models; S4, defining different Controller layers to provide an open and unified Api interface externally; S5, using an execution service of a GraphCommonService graph database to obtain an effective connection of the NebulaGraph Database graph database from the SessionPool; and S6, executing the nGQL statements automatically arranged by the NebulaUtil tool and analyzing and returning a result model, and uniformly returning the result.

The invention discloses a gateway-based script execution method, apparatus and device, and a readable storage medium, and relates to the technical field of network services. The gateway-based script execution method comprises the following steps: calling a preset script by a gateway, and performing access control on a received user request; obtaining an idle connection from a connection pool configured between the gateway process and the database server in response to access control passing of the user request; verifying the execution qualification of the user according to the user request; in response to the fact that the execution qualification of the user passes the verification, sending the preset script to a database server through the idle connection, and executing the service logic of the preset script to obtain an execution result; and storing the execution result in a non-volatile storage medium to realize persistence of the execution result. By implementing the technical scheme of the invention, the user request can be prevented from penetrating back-end service, and the request response speed is improved.

Embodiments of the present disclosure provide a method, an electronic device, and a computer program product for connection pool efficiency. The method may include determining a set of connections in a connection pool of a storage system, the set of connections corresponding to open connections established by the storage system to a set of end-points of an object storage service of a cloud provider, wherein an application of the storage system accesses the object storage service through one or more connections from the set of connections; monitoring data transfers over the set of connections; collecting performance metrics associated with the data transfers; identifying a first connection having performance metrics below a predetermined threshold; identifying a second connection being added to the set of connections in the connection pool, wherein the second connection is a new connection; and marking the first connection for removal from the connection pool.

The invention provides a method and system for improving system concurrency capability in a live broadcast scene, and the method comprises the steps: obtaining historical data corresponding to live broadcast according to the configuration information of the live broadcast, asynchronously generating a plurality of accounts in advance through intelligent prediction, converting the most time-consuming write operation in a real-time link into efficient memory allocation, and improving the system concurrency capability in a live broadcast scene. Therefore, write lock competition and connection pool exhaustion of the database are avoided. Meanwhile, through smooth supplement during real-time live broadcast and an automatic cleaning mechanism after the live broadcast is finished, on the premise of ensuring system elasticity, optimization of resource utilization is realized, the extreme experience and stability of the system under high concurrency are fundamentally ensured, and the user experience is improved. The problem that response delay soaring and even service avalanche are caused by dense database writing at the flow flood peak is well solved, meanwhile, user experience is greatly improved, and the registration and login time of a new user is greatly shortened.

The invention discloses a database connection pool management method and device based on DataX, and solves the problems of low resource utilization rate, concurrence disorder, thread safety and the like caused by lack of a built-in connection pool in the existing DataX. The method comprises the following steps: deploying an independent connection pool service (CPS), integrating a third-party connection pool and configuring a global maximum connection number; the DataX communicates with the CPS through a network, and each Channel independently applies for connection; the CPS dynamically adjusts the DataX parallelism degree (limitation or waiting when the DataX parallelism degree is insufficient) according to the available connection number, and allocates a unique connection identifier; the DataX sends an SQL request through the identifier, and the CPS calls the third-party connection pool for execution and returns a result; and after the task is completed, notifying the CPS to release the connection. Connection multiplexing is achieved through centralized management, the physical connection sharing risk is avoided, the parallelism degree is dynamically regulated and controlled to guarantee efficient utilization of resources, and DataX task stability and thread safety are improved.

The embodiment of the invention provides a dynamic connection pool management method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining the resource information of a connection pool in a current monitoring period, the resource information being information reflecting the performance index of the connection pool; when it is determined that a capacity adjustment condition is met according to the resource information, the capacity of the connection pool is adjusted, and the adjusted capacity is applied to operation of the connection pool in the next monitoring period. According to the embodiment of the invention, the dynamic adjustment speed of the connection pool can be improved, and resource waste caused by connection exhaustion or more idle connections is avoided.

The invention relates to a data query method and device, computer equipment and a storage medium. The method comprises the following steps: receiving a data query request sent by a client; analyzing the data query request to extract coding information corresponding to the target type from the data query request; carrying out validity verification on the coded information; if the coding information passes the validity verification, performing routing rule matching and data source selection processing on the coding information based on a preset rule engine to obtain a corresponding candidate data source; performing state evaluation on the candidate data sources to obtain a state evaluation result, and screening out a target data source from the candidate data sources according to the state evaluation result; obtaining a query statement corresponding to the data query request; sending the query statement into the target data source based on the connection pool so as to execute query processing on the query statement through the target data source to obtain a query result; and returning a query result to the client. The processing efficiency and the processing flexibility of the data query request are improved.

This invention provides a method and system for accessing a database interface layer using SAS language based on C++ middleware. The method includes the following steps: calling C++ middleware to obtain SAS statements from SAS language analysis software; identifying database information in the SAS statements through word segmentation, and establishing a database connection pool based on the database information by calling the database connection module of the C++ middleware; using the C++ middleware to identify the SAS statements and convert them into database-recognizable statements; and using the C++ middleware to pass the database-recognizable statements to the corresponding database through the database connection pool. This solves the problem in the prior art that SAS language analysis software cannot directly and efficiently connect to general databases, and enables high-performance, high-reliability, and secure data access.

The invention discloses a containerized system start-stop control method and device, electronic equipment and a storage medium, and relates to the technical field of data processing, and the method comprises the steps: configuring a process termination signal hierarchical response mechanism of a container platform, and controlling a process termination process through a preset maximum downtime parameter; triggering a service unavailable mark based on the process termination signal, closing a monitoring port according to the service unavailable mark to intercept a new request, and cancelling interface information of the service registration center; monitoring operation states of the application layer thread pool and the timed task cluster, and waiting for all active requests of the application layer thread pool and uncompleted tasks of the timed task cluster to be processed within a preset timeout period; and sequentially closing the log framework, the thread pool and the database connection pool according to a preset resource release sequence, completing safe release of resources, and recording a log state. The method has the technical effects of guaranteeing service continuity in a containerized deployment or updating process, ensuring data integrity and realizing safe and orderly release of resources.

The invention discloses an end-to-end connection system, which comprises a client, a cloud platform and an equipment end, and is characterized in that the cloud platform acquires an equipment serial number and a user identifier; the cloud platform obtains an external network address of the equipment end according to the equipment serial number; the cloud platform inquires whether unused connection resources exist in a connection pool or not according to the user identifier and the external network address of the equipment side; and under the condition that the connection resources exist, end-to-end connection between the client and the equipment end is established through the connection resources. Through the method and the device, the technical problem of resource waste caused by repeated NAT traversal in related technologies is solved.

Communication connections with databases, such as when deployed as a database layer of a system architecture, are resource intensive to establish, take down, and maintain. However, from the applications' perspective, deployed in a business logic layer, more database connections result in less delay interacting with the databases. In order to optimize system resources, systems and methods are disclosed that create an optimized number of database connections and / or application connections, that are then maintained and shared by the applications via a proxy intercepting the communications and forwarding the communications to the database via the optimized number of pooled database connections. The connections may be multiplex so that simultaneous communications may be hosted concurrently.

The invention discloses a regularized ID (Identity) generation method, system, equipment and medium in a high-concurrency scene, belongs to the technical field of Java back-end distributed system development, and aims to solve the technical problem of how to meet the requirements of custom regularized formats, have high-concurrency processing capability, avoid serial number repetition or fault and improve the efficiency of generating a regularized ID in a high-concurrency scene. According to the technical scheme, the method comprises the steps that monthly increasing serial numbers are generated based on the Redis atom self-increasing characteristic, a regular ID is formed by combining a service prefix and year-month splicing, monthly resetting of the serial numbers is achieved through a Redis key expiration strategy, and uniqueness under high concurrency is guaranteed in cooperation with a distributed lock; the method specifically comprises the following steps of: configuring regularized ID generation parameters in a Java back-end system, wherein the regularized ID generation parameters comprise a service prefix, a serial number digit and a year-month format; deploying a Redis cluster to ensure high availability, and configuring Redis connection pool parameters to ensure connection stability; the service system initiates an ID generation request carrying service prefix parameters; and obtaining a year-month character string corresponding to the current date.

The invention relates to a Saas system message pushing method and system based on a message queue, and belongs to the technical field of message pushing, and the method comprises the steps that each micro-service instance maintains a corresponding local long connection pool; when the business service generates a message needing to be pushed to a target user, the message is published to a message theme corresponding to identification information in a message queue according to the identification information of a tenant to which the target user belongs; the micro-service instance subscribing to the message theme corresponding to the target user receives the message, inquires a local long connection pool of the micro-service instance after receiving the message, and judges whether long connection exists between the micro-service instance and the target user or not; if the long connection exists, the corresponding micro-service instance pushes the message to the target user and confirms the consumption message; and if the long connection does not exist, the corresponding micro-service instance discards or ignores the message. The method has the advantages that on the premise of guaranteeing real-time and accurate delivery of the message, the system overhead is remarkably reduced, and the elastic expansion of the system scale can be supported.

This invention relates to the field of distributed data link monitoring technology, and discloses a method and system for monitoring and handling anomalies across the entire data link based on intelligent operation and maintenance. The method includes: acquiring multi-source operation and maintenance data and performing cross-link time normalization; identifying abnormal events based on a unified operation and maintenance feature sequence; constructing a delay causal graph carrying propagation delay based on the abnormal event sequence; performing counterfactual dynamic Bayesian inference based on the delay causal graph; and executing processing actions. Compared to existing technologies that rely on static thresholds for anomaly detection, especially under conditions of slow SQL, connection pool queuing, and mutual propagation of interface latency, this invention addresses the technical problem of failing to identify cross-component anomaly propagation relationships and achieve secure closed-loop processing. By identifying counterfactual root causes through anomaly event recognition and selecting security constraint processing actions, this application achieves accurate localization of the root causes of anomalies across the entire data link, improving the accuracy of anomaly response and operational stability of the distributed data link.

The invention provides a Netty adaptive connection method and system based on EventLoop affinity and PID (Proportion Integration Differentiation) control, and relates to the field of computer network communication. The method comprises the steps of obtaining a service thread request queue, determining an EventLoop thread of a current service, and determining available connection resources in a hierarchical architecture connection pool according to a local priority principle; the hierarchical architecture connection pool is a hierarchical architecture connection pool based on EventLoop affinity, and comprises a thread local pool and a global shared pool; periodically calculating a pressure value representing a system load state based on the multi-dimensional index of the service request queue; based on the pressure value, determining a resource capacity variation through a feedback control algorithm; and on the basis of the capacity variation, performing capacity expansion or capacity reduction operation of connection resources on the thread local pool according to a preset rule, and recovering redundant connections generated by capacity reduction or idle to the global shared pool. The method and the device are used in a Netty self-adaptive connection process based on EventLoop affinity and PID control, and the technical problem of multi-thread lock competition existing in existing Netty connection is solved.

The invention discloses a cross-database batch data synchronization method and system, electronic equipment and a storage medium, and the method comprises the steps: creating a database connection pool, and recognizing to-be-synchronized incremental data according to an update record of a source database; determining a data synchronization mode according to the synchronization configuration information in combination with the current system load and the data volume of the incremental data; distributing and initializing corresponding thread resources according to the data synchronization mode; based on the database connection pool and the thread resources, executing batch data synchronization operation from the source database to the target database; wherein the batch data synchronization operation comprises the following steps: writing incremental data into a target database in a batch operation mode according to a dynamically determined batch size; and after the batch data synchronization operation is completed, recycling the thread resources and the database connection pool. According to the invention, the problems of poor large-batch synchronization performance, high delay and easy inconsistency are solved, and the data synchronization real-time performance, stability and resource utilization efficiency are improved.

This invention discloses a cluster scheduling component and method suitable for isolation devices, including a configuration center, a third-party database, a monitoring service module, and a liveness detection service module. The second-party database includes a data source connection pool and an interceptor. Each data source connection in the data source connection pool connects the business system to the database via its corresponding isolation device. The interceptor is connected to the data source connection pool and the isolation device, sending data obtained from the database to the business system, or sending a failure heartbeat to the monitoring service module when the isolation device is determined to be in a faulty state. The liveness detection service module connects to the test database through data source connections marked as offline and their corresponding isolation devices. When it detects that the isolation device has recovered, it sends a success heartbeat to the monitoring service. The monitoring service module modifies the configuration file in the configuration center to mark the status of each data source connection. This invention enables dynamic scheduling and management of isolation devices, improving service reliability.

The invention discloses an intelligent scheduling method and system for linkage of multiple security and protection devices, and belongs to the technical field of security and protection scheduling. The system comprises a sensing layer, an access layer, a core scheduling layer and a display layer; the multiple security and protection devices upload state data to an access layer formed by a Tomcat cluster through a TCP / IP (Transmission Control Protocol / Internet Protocol); the access layer formats data through a SpringBoot interface in combination with a connection pool dynamic capacity expansion mechanism and outputs the data to the core scheduling layer; the core scheduling layer processes data through a SpringEvent event-driven mechanism, writes the data into a Memcached cache in real time, asynchronously synchronizes the data to an Oracle database, calls a dynamic weight matching algorithm to generate an optimal equipment combination, and issues a task instruction through a cluster load balancing algorithm; the display layer is used for realizing visual display through JQuery; according to the invention, the real-time performance, intelligence and visualization of multi-security equipment cooperative scheduling are realized, and the scheduling efficiency and the resource utilization rate are improved.

The invention relates to the technical field of communication, and discloses a client request scheduling and communication method and system based on a communication connection pool, and the method comprises the steps: building a plurality of initial communication connection channels in a pre-built communication connection pool through a communication scheduling system; receiving a service request sent by a client, and carrying out request legality verification on the service request; when the request validity verification is passed, according to the obtained connection pool information of the communication connection pool, executing a connection distribution operation on the service request to obtain a target communication connection channel matched with the service request; and sending the service request to the server through the target communication connection channel, and triggering the server to analyze the service request and execute the service processing logic corresponding to the service request so as to complete the service request. According to the invention, efficient, stable and controllable two-way communication between the client request and the back-end service can be realized by establishing the communication connection pool and combining distribution control.

The application discloses an automatic connection method and device between function blocks in an FBD program, comprising the following steps: in response to a first target event triggered in a connection pool of a visual window, obtaining a target function block to be connected according to the first target event; analyzing the target function block to obtain a function block ID number and pin information of the target function block; judging whether a network relationship file associated with the target function block is imported; if yes, adding a connection between a pin of the target function block and a pin of a determined associated function block according to a logical relationship determined in the network relationship file; if not, executing a preset connection rule configuration, and completing automatic connection between the target function block and pins of other function blocks in the connection pool according to the connection requirement configuration, the function block ID number and the pin information. The application saves the time for manually adding function block connections, improves the configuration operation efficiency, reduces the possibility of manual connection errors, and guarantees the correctness of control logic.

The invention discloses a plug-in type communication architecture supporting multiple industrial protocols. The plug-in type communication architecture comprises a protocol adapter dynamic loading module, a protocol adapter dynamic loading module and a protocol adapter dynamic loading module, wherein the protocol adapter dynamic loading module is used for dynamically loading and unloading adapters of the multiple industrial protocols during operation; the container arrangement module is used for realizing plug-in deployment and automatic discovery of services through a containerization technology; the asynchronous processing and connection pool collaborative optimization module is used for reducing communication time delay through asynchronous I / O processing and connection pool management; and the heartbeat detection and automatic fault recovery module is used for improving the reliability of the system through a heartbeat detection and automatic recovery mechanism. According to the architecture, industrial protocol plug and play and flexible service deployment are realized through protocol adapter dynamic loading and container arrangement, and the system expansibility is improved; through asynchronous processing and connection pool collaborative optimization, the communication time delay is reduced, and the throughput capacity is improved; the reliability and the self-healing capability of the system are enhanced through heartbeat detection and an automatic fault recovery mechanism, and finally collaborative optimization of time delay, multi-protocol compatibility and reliability is realized in a complex industrial environment.

Embodiments of the present application disclose a gRPC-based database service providing method and device, a server and a medium, the method comprising: starting a gRPC service by using a preset interface definition file, listening to a specified port of the gRPC service, and exposing a unified execution method for facilitating client calling; receiving input minimum connection number parameters and maximum connection number parameters, initializing a database connection pool according to the minimum connection number and the maximum connection number; obtaining an idle connection from the connection pool when the execution method is called to execute, creating a new connection if there is no idle connection and the maximum connection number has not been reached; determining a corresponding operation type parameter according to a parameter list, executing a corresponding logical branch in the execution method according to the operation type parameter; obtaining a calculation execution result of the corresponding logical branch and returning the execution result to the client; and returning the connection to the database connection pool when the execution method is executed. The database access performance and resource utilization are improved.

The application discloses a connection resource allocation method and device for a server connection pool. The method comprises the following steps: determining a target client; determining a target number of connections allocated to the target client; in the case that the number of idle connections in the server connection pool is less than the target number, performing connection allocation for the target client; the connection allocation comprises the following steps: allocating all idle connections to the target client; determining at least one to-be-disconnected client with a connection usage rate less than a first preset threshold from the connected clients; disconnecting a first number of connections from the connections currently used by the at least one to-be-disconnected client, and allocating the disconnected first number of connections to the target client. The application squeezes out a first number of connections from the connected clients with a small connection usage rate and allocates the first number of connections to the target client, which can provide connection resources for more clients without affecting the business rate requirement of the squeezed-out connected clients.

This application discloses a method, apparatus, device, system, and medium for accessing distributed data nodes, belonging to the field of data processing. The method includes: determining the target data node accessed by the database operation statement based on a database operation statement transmitted by a client through an established front-end connection; obtaining an idle back-end connection from a preset connection pool as the target connection, the connection pool including idle back-end connections, the target connection undergoing check and synchronization processing to ensure normal use; sending the database operation statement to the target data node using the target connection; and, if the database operation statement has not initiated a database transaction or has already closed a database transaction, adding the target connection as an idle back-end connection to the connection pool. Embodiments of this application can reduce network resource waste.