220 results about "Connection pool" patented technology

The embodiment of the invention provides a distributed server cluster log processing method and device, and the method comprises the steps: constructing a distributed server cluster log collection network, and dynamically distributing collection tasks through a load balancing scheduling center. An incremental data acquisition channel is designed, efficient transmission is realized by using a websocket long connection pool, and the transmission efficiency is optimized in combination with real-time compression coding and a repeated data detection mechanism. An intelligent log analysis model is constructed, the intelligent log analysis model comprises an anomaly detection sub-model, a mode recognition sub-model and an event association analysis sub-model, anomaly score calculation, log classification labeling and multi-dimensional association analysis are achieved based on a deep learning method, and visual display and data export functions are provided. According to the method, the defects of the traditional technology in the aspects of distributed acquisition, data transmission, intelligent analysis and the like are effectively overcome, and the performance and practicability of a log processing system are remarkably improved.

The invention provides a performance optimization method and system for cross-data-source paging query, and relates to the technical field of data processing, and the method comprises the steps: calculating a data distribution weight and a data source routing table, determining an optimal data access path, and splitting a paging query request into sub-query tasks; dynamically adjusting the number of parallel query threads based on the load state and distributing sub-query tasks; establishing a local index and adaptively adjusting an index structure; dynamically adjusting the connection number of the connection pool and acquiring data in batches; performing feature analysis according to a query result, determining the size of a data fragment, and selecting an optimal merging strategy to merge the data; constructing a cache access mode graph, and aggregating and storing related data based on the access association degree; and optimizing a performance strategy set through reinforcement learning, adjusting a cache updating interval, a data access path and a feature matrix, and finally obtaining a query result. According to the method, the cross-data-source paging query efficiency can be effectively improved, the query delay is reduced, and the overall performance of the system is improved.

The invention relates to the technical field of network security, and particularly discloses a front digital boundary security switching method and system based on an optical one-way transmission characteristic and a storage medium, and the method comprises the steps that a front digital boundary security gateway of a service extranet receives a request, analyzes a context parameter of the request, and stores the context parameter of the request; legality verification is carried out on the carried exchange account, the key and other request parameters, and request context parameters are signed and encrypted; after the legality verification is passed, the service extranet front digital boundary security gateway encapsulates the request context parameter into a request data packet, a unidirectional data transmission optical shutter connection pool from the extranet to the intranet is used, and the request data packet is sent to the intranet front digital boundary security gateway after the connection is obtained; and after receiving the request data packet, the intranet front digital boundary security gateway decrypts and verifies the signature of the request message in the request data packet, reconstructs the request message after the verification is successful, and sends the request message to a real target server to obtain a result.

The invention provides a multi-version dynamically expandable data source method and device, a terminal and a storage medium, and relates to the technical field of database data source loading. The method comprises the steps that a JAVA SDK package is created, the JAVA SDK package comprises core dependence, a core entity class, a core interface class, a database connection pool management core class, thread isolation, a routing data source class and basic attributes and target data source mapping of the routing data source class, and the target data source mapping is used for storing a loaded database connection pool; initializing a system database connection pool in the application system based on a JAVA SDK packet; after a system database connection pool in an application system is initialized, a new database connection pool is dynamically expanded in the application system based on a JAVA SDK package. The system has the design characteristics of strong dynamic expansion capability and loose coupling, the flexibility and expansibility of the system can be greatly improved, and the development and maintenance cost is reduced.

The invention discloses a database connection pool management method and device, equipment and a storage medium, and relates to the technical field of database management, the method comprises the following steps: creating a corresponding cluster connection pool for each cluster according to cluster parameter information and cluster configuration information, the cluster connection pool comprising a plurality of connection clusters, the connection cluster comprises a plurality of target connections, and the target connections carry first tags and timers; creating a database cluster pool according to the corresponding relationship between the cluster identifier and the cluster connection pool; and managing the target connection based on the database cluster pool, the first tag and the timer. The database connection resources are managed in a unified manner through the two-stage pool, so that the overhead of connection establishment and disconnection is reduced, and the processing efficiency is improved. And assigning a label to each connection, and upgrading the database connection pool into unequal stateful connections. And the timer is used for marking and tracking the use condition of each connection, so that the life cycle of the connection can be managed, and the management efficiency of the connection pool is improved.

The invention provides a multi-node dynamic switching method and a multi-node dynamic switching system for a MongoDB (MongoDB). The method comprises the following steps: acquiring configuration information of a plurality of MongoDB nodes, and establishing a data access layer based on the configuration information; through a data access layer, acquiring index data marks of the MongoDB nodes about a plurality of operation indexes according to a hierarchical frequency acquisition task configured by each MongoDB node; in combination with a node weight preset value of the MongoDB node, converting the node performance index into a weight value of the MongoDB node; based on a connection pool management mechanism and the node available state data, a request distribution strategy is determined according to the weight value, and the request distribution strategy is used for indicating the distribution proportion of the MongoDB requests distributed to the MongoDB nodes; and performing state detection on the MongoDB node through a data access layer, marking the detected MongoDB node as an unavailable state when detecting that the MongoDB node meets an abnormal state condition, and updating available state data of the node. The problems that in the prior art, manual intervention is needed, the real-time load condition of the node cannot be sensed, and the code coupling degree is high are solved.

The invention relates to the technical field of network communication, and discloses a multi-path routing proxy method, a storage medium and a system, and the method comprises the steps: identifying the session type, protocol type and session feature parameters of a data flow, querying corresponding performance index coefficients according to the session type of the data flow, and obtaining a multi-path routing proxy according to the corresponding performance index coefficients. And calculating the score of each potential path in the path connection pool according to the real-time performance indexes of the potential paths. And matching with a preset demand type according to the session type, the protocol type and the session feature parameter, and determining a data distribution strategy according to the matched demand type. And finally, according to the determined data distribution strategy, calculating the number of paths corresponding to the data flow, selecting the potential paths with the corresponding number with the top scores as the distribution paths of the data flow, and completing the distribution of the data flow along the corresponding distribution paths according to the corresponding data distribution strategy. According to the method, the transmission quality of the routing system for different types of application data can be improved.

The invention discloses an improved method for logging in a weak network by a mobile phone number through one key and electronic equipment, and belongs to the technical field of communication, and the method comprises the following steps: a main processor creates a pre-connection pool, records a pre-connection domain name and a port list, and executes pre-connection; meanwhile, various parameters required by number prefetching are prepared, and a number prefetching request is sent; the network processor creates a retry controller, and the retry controller intelligently determines a corresponding retry mode according to the failure reason and the network state; unnecessary repeated operation is avoided by means of implementing a breakpoint resume type retry mechanism, error type detection and classification processing, network availability judgment and automatic reconstruction, private network IP change detection and URL reconstruction, an exponential backoff algorithm to control a retry interval and the like, and a staged timeout mechanism is introduced, so that the retry efficiency is improved. The personalized reasonable timeout time of different stages is set, the problem that a certain stage consumes too long time is avoided, and the network request success rate of the SDK in the weak network environment is improved.

The invention belongs to the technical field of data processing, and discloses an active intelligent operation and maintenance monitoring method for a data center, which comprises the following steps: step 1, component modeling and topology configuration; 2, carrying out distributed health detection and data acquisition; 3, performing real-time health assessment and anomaly detection; 4, performing intelligent alarm and root cause analysis; 5, unified operation and maintenance and closed-loop control are carried out; and step 6, dynamically optimizing the intelligent operation and maintenance strategy. According to the method, a monitoring object and a dependency relationship are clarified through component modeling and topological configuration, and specific scenes, such as multi-mode acquisition, active detection, index pulling, log analysis, coverage message queue theme accumulation and database connection pool exhaustion, of distributed health detection are combined. The quantitative health score is calculated based on the preset scoring model, and by combining with the dynamic baseline learned by the ARIMA or LSTM algorithm, the module abnormity can be actively detected in different periods and weekly updating, and the problems of fault discovery lagging and incomplete monitoring coverage are solved.

The invention discloses a data transmission method, system and device and a storage medium, is applied to a host end in a non-uniform memory access architecture, and relates to the technical field of data transmission, and the method comprises the steps that a target path mapping table from a target end is received and analyzed, and a plurality of monitoring entrances are obtained; based on the target path mapping table, establishing a plurality of connection paths corresponding to the plurality of monitoring entrances in sequence, and generating a connection pool; in response to a data read-write request generated by the host end for a target end, determining a target processor domain corresponding to the target storage unit according to the target path mapping table, and selecting a connection path associated with the target processor domain from the connection pool as a current read-write path; and monitoring and judging whether the current read-write path is available or not, and if not, reselecting. The data transmission method can be combined with NUMA architecture perception, path state monitoring and a policy-driven selection mechanism to at least solve the problems that in the prior art, path selection lacks topology perception and multiple network cards are difficult to aggregate and use.

The invention discloses a microservice gateway performance optimization method and system based on real-time flow monitoring and analysis. The invention relates to the technical field of microservice gateways. The real-time flow monitoring module is deployed on a gateway service layer in a sidecar mounting mode to collect flow data of a gateway in real time, wherein the flow data comprise request response time, the number of requests, the number of error requests and system resource use conditions. By dynamically adjusting the key parameters of the gateway, such as the thread pool parameter, the connection pool parameter and the load balancing strategy, the resource allocation and request processing flow is optimized, so that the throughput of the gateway is remarkably improved, the request response time is shortened, and the error rate is reduced. The real-time monitoring and performance evaluation mechanism provided by the invention is helpful to timely discover and solve potential performance bottlenecks and security problems, thereby greatly enhancing the stability of the gateway. Meanwhile, configuration and strategies are dynamically adjusted, so that the gateway can better deal with sudden flow and abnormal conditions, and continuous and stable operation is ensured.

The invention relates to the technical field of data processing, and discloses a log data batch updating method and device, equipment and a medium, and the method comprises the steps: obtaining a full-amount historical log in a preset database in real time, converting the full-amount historical log into an event stream, and writing the event stream into preset message middleware, obtaining a partition ID of the total historical log in the message middleware, generating a global unique identifier bound with a partition according to the partition ID to obtain a distributed ID, generating a consumer ID associated with the user identity information according to the distributed ID by calling a pre-designed distributed algorithm, and sending the consumer ID to the message middleware. And carrying out lock-free parallel updating on the database according to the consumer ID based on connection pool preheating and asynchronous submission to obtain an updating result, carrying out consistency verification on the updating result to obtain a verification result, and confirming the updating result according to the verification result. And the batch updating efficiency of the log data is improved.

The invention provides a college entrance examination volunteer filling assisting method and system based on a large language model, and the method is characterized in that the method comprises the steps: presetting a question template and an SQL template according to the volunteer filling scene demands and a database schema; analyzing a natural language query Q by adopting a large language model and designing a cue word, and combining a question template sequence number and an analysis result to generate a structured query condition set CQ; generating a database SQL query statement according to the CQ in combination with a preset SQL template; and managing database connection by using a connection pool technology, executing SQL query, generating a result set RS, and outputting information to a user. Through the method, the query efficiency and the interaction friendliness of the volunteer filling auxiliary system are improved.

The invention provides a heterogeneous database query method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out security verification processing on a plurality of SQL execution requests sent by a user side, and carrying out SPI mechanism scanning processing on a plurality of database plug-ins in a heterogeneous database plug-in directory based on a high-performance database connection pool after the security verification processing is passed, determining a target database plug-in package corresponding to each SQL execution request; and performing metadata query processing on the SQL execution request in the target data source based on a database operation client interface and a metadata service interface under the target database plug-in package, and determining a structured tree result. According to the method, an extensible and dynamically integrated heterogeneous database plug-in mechanism is realized, unified access of various databases is supported, the platform maintenance cost is remarkably reduced, hierarchical metadata of any type of databases is obtained through a consistent metadata service interface, and the user experience and the cross-database query efficiency are improved.

The invention provides a data direct-connection writing method and system and electronic equipment, and belongs to the technical field of data processing, and the method comprises the following steps: writing to-be-written data into a buffer channel of a streaming acquisition framework; extracting the to-be-written data from the buffer channel according to a preset batch size to form a data batch, and determining a target database table according to information contained in the data batch; according to the target database table, constructing the data batch into a write-in request conforming to a target database batch write-in interface specification; and sending the write-in request to the target database table through the connection pool of the preset transmission protocol. Through data batch extraction based on the buffer channel and dynamic determination of the target database table, the batch writing requests are constructed and are directly connected and transmitted through the connection pool, so that the real-time performance and stability of data writing are improved in a large-scale real-time data writing scene.

The invention provides a method and system for accessing a database interface layer through an SAS language based on C + + middleware. The method comprises the following steps that the C + + middleware is called to obtain SAS statements of SAS language analysis software originating from the C + + middleware; performing word segmentation identification on database information in the SAS statement, and calling a database connection module of the C + + middleware based on the database information to establish a database connection pool; identifying the SAS statement by using the C + + middleware and converting the SAS statement into a database recognizable statement; the C + + middleware is used for transmitting the database recognizable statements to the corresponding database through the database connection pool, the problem that in the prior art, SAS language analysis software cannot be directly and efficiently connected with a universal database is solved, and high-performance, high-reliability and safe data access can be achieved.

Methods for managing a connection pool for cloud-based applications accessing databases are provided. Aspects include establishing a plurality of connections to one or more databases, receiving connection requests from a plurality of cloud-based applications to access the one or more databases, and allocating the connection requests to among the plurality of connections, where the allocation is determined based at least in part on one or more connection pool parameters. Aspects also include monitoring a usage of the plurality of connections by the plurality of applications and updating the one or more connection pool parameters based on an analysis of the usage of the plurality of connections by the plurality of applications.

The invention relates to the technical field of unmanned aerial vehicle control and management systems, in particular to an unmanned aerial vehicle parameter management method based on template management, and the method comprises the steps: building multi-device concurrent connection with an unmanned aerial vehicle flight control system through a communication abstraction layer, integrating a protocol adaptation module, a port automatic detection engine and a multi-device connection pool, and achieving a unified device access interface; parameters are structured and managed through the core processing module, a dynamic parameter tree, a batch operation engine and a template management system are constructed, verification operation is monitored through the safety control module, and an auditing system, a version control engine and a parameter verification module are integrated. According to the invention, by constructing a modular architecture of a communication abstraction layer, a core processing layer and a security control layer, adopting a dynamic parameter tree, a difference comparison algorithm and a template management system, and combining an operation auditing and atomic transaction writing technology, low resource occupation and high-concurrency batch operation are realized, the production line efficiency is improved, and the production cost is reduced. And parameter consistency, safety and traceability are guaranteed.

The invention discloses a data source connection management method and device and a computer program product. The method comprises the following steps: receiving a data source operation request of a user, analyzing the data source operation request to obtain a target data source to be accessed, and judging whether a target connection management object exists in a target connection pool or not; under the condition that the target connection management object exists in the target connection pool, judging whether an idle connection exists in a connection list managed by the target connection management object or not; and under the condition that the idle connection exists in the connection list managed by the target connection management object, establishing the data connection between the user and the target data source based on the idle connection. Through the data connection management method and device, the problem that resource consumption is large due to the fact that multiple connection pools are adopted to manage data connection of different data sources in the prior art is solved.

The invention relates to the technical field of Internet of Vehicles, and discloses an Internet of Vehicles communication stability optimization method and system based on multichannel connection multiplexing, and the system comprises a proxy service module, a terminal interaction module, a connection multiplexing module, a base station monitoring module, a load balancing decision module, and a strategy optimization module. The method comprises the following steps of: deploying a multi-thread proxy service at an edge node adjacent to a base station, constructing a surviving global shared connection pool, and realizing cross-thread security access by using a read-write lock; the terminal sends a request containing a target server IP and a TLS session identifier to the virtual IP entry through a TLS 3.1 + encryption protocol, so that the three-way handshake delay is avoided; a base station switching event is synchronously detected, a dynamic load balancing mechanism is triggered, health scores and weight factors are calculated in real time, and requests are distributed according to flow types. According to the method, handshake delay is shortened, communication continuity is improved, the problem of request packet loss is solved, and a high-reliability communication infrastructure is provided for an intelligent network connection vehicle.

The invention relates to the technical field of data testing and the field of smart medical treatment and financial science and technology, and provides a load balancing testing method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: generating a load balancing testing request based on a testing module of a client; forwarding the load balancing test request to a load balancing proxy node based on a switch; determining a target test script from the load balancing agent node according to the load balancing test request; performing data forwarding processing on the client and the communication test instrument based on the load balancing agent node according to the target test script, and detecting on the load balancing agent node to obtain a CPU utilization rate, a memory occupancy rate, connection pool state information and request processing delay information; and determining a load balancing test result according to the CPU utilization rate, the memory occupancy rate, the connection pool state information and the request processing delay information. Through the technical scheme, comprehensive and reliable test processing can be performed on the load balancing server simply, conveniently and quickly.

This invention relates to the field of experimental data storage technology for nuclear fusion devices, and discloses a method for large-scale EPICS data archiving based on a time-series database. The method involves acquiring process variables in an event-driven acquisition mode through an embedded channel access protocol data acquisition module and writing them into buffered memory channels. Through group aggregation and batch persistence, the process variables are grouped into fixed-size groups, each group corresponding to an aggregation coroutine. The latest event data is read non-blockingly from the buffered memory channels of each group at fixed intervals. Metadata mapping is used to convert the process variable names into device paths and measurement value names in the time-series database, assembling them into a sparse wide table. Null value columns in the sparse wide table are filtered, and the data is then batch-written into a distributed time-series database through a connection pool. This invention achieves stable high-throughput writing and low-latency retrieval of large-scale experimental data in the EPICS system, and provides an efficient data access interface for subsequent artificial intelligence training and inference platforms.

The invention discloses an efficient data transmission method and system based on Arrow Flight, and the method comprises the steps: achieving the direct interaction between Spark and an Arrow Flight Server based on a self-defined data source interface of a Spark DataSource API (Application Program Interface); the method comprises the following steps: defining a data reading process through a Scan interface of Spark, and acquiring distributed data in an Arrow Flight Server by adopting a parallel fragmentation mode; the method comprises the following steps of: customizing a batch processing reading process in Spark, and converting a data format obtained from an Arrow Flight Server into a column type storage format of the Spark; and designing a connection pool management and fault-tolerant mechanism. According to the method and the system, direct connection with an Arrow Flight Server is realized by creating a self-defined data source interface based on a Spark framework, and the performance and the stability of data interaction between systems in a big data environment are improved by utilizing efficient data fragmentation, batch transmission and column storage format conversion technologies, a connection pool and an automatic retry mechanism.

The present invention discloses a method, device, electronic device and storage medium for implementing a distributed lock. The method includes the steps of: obtaining the connection address and connection pool of a configured distributed data storage cluster and a cluster management mechanism, creating a keyword for the thread to be locked, and obtaining lock call information; obtaining an asynchronous listening task for lock release according to the lock call information; obtaining information that the business logic execution of the locked thread is completed and the lock is released according to the asynchronous listening task for lock release; deleting the asynchronous listening task for lock release, and obtaining other threads waiting to acquire the lock to acquire the lock. The present application can automatically renew the lock for the locked thread before the execution of the business logic is completed, ensuring that the lock will not be released in advance. After the execution of the locked thread is completed, other threads waiting to acquire the lock can obtain the message in time, avoiding the threads waiting to acquire the lock from continuously looping and waiting for the lock acquisition request, and reducing the consumption of the processor.

The application discloses a business information processing method and device, electronic equipment and a storage medium. The method comprises the following steps: a gateway module receives an HTTP request from a client, obtains a database name corresponding to an access object according to ID information of the access object in the HTTP request; the database identifier is put into the HTTP request, and the HTTP request is forwarded to a business module; the business module obtains the database identifier based on the HTTP request, and stores the database identifier into a thread local variable of a current thread; the database name is obtained from the thread local variable, and a corresponding database connection pool is selected according to a key-value pair; when other business modules are called, the corresponding database identifier is obtained from the thread local variable through an interceptor, and the database name is written into a new HTTP request header and transmitted to the called other business modules. The application ensures that the system can accurately match the corresponding data source when processing data, and meets the business secret protection requirement.

The application belongs to the technical field of computers and discloses a general metadata operation method and system based on a graph database, which comprises the following steps: S1, using a configuration file yml of SpringBoot to configure to create a connection pool SessionPool of a NebulaGraph Database graph database based on a NebulaPool custom implementation, containing definitions of maxCountSession, minCountSession, hostAndPort, userName and passWord parameters; S2, defining parameter models for accepting different interfaces, including a model for creating a graph space, a model for creating a point, a model for creating an edge, a model for creating an index and a general query model; S3, using an independently developed NebulaUtil tool to automatically arrange nGQL statements for the accepted parameter models according to the input models; S4, defining different Controller layers to provide an open and unified Api interface externally; S5, using an execution service of a GraphCommonService graph database to obtain an effective connection of the NebulaGraph Database graph database from the SessionPool; and S6, executing the nGQL statements automatically arranged by the NebulaUtil tool and analyzing and returning a result model, and uniformly returning the result.

The invention discloses a method for automatically pushing index data to an index platform and a related device. The method comprises the following steps: reading data from an index routing table through a timed task; constructing a query statement according to the read data; establishing a connection with a database where the index data is located by using a database connection pool technology; the query statement is executed, the index data is queried from the database where the index data is located, the method and the related device can improve the flexibility and the real-time performance of index data pushing, and the cost is low.

The invention discloses a gateway-based script execution method, apparatus and device, and a readable storage medium, and relates to the technical field of network services. The gateway-based script execution method comprises the following steps: calling a preset script by a gateway, and performing access control on a received user request; obtaining an idle connection from a connection pool configured between the gateway process and the database server in response to access control passing of the user request; verifying the execution qualification of the user according to the user request; in response to the fact that the execution qualification of the user passes the verification, sending the preset script to a database server through the idle connection, and executing the service logic of the preset script to obtain an execution result; and storing the execution result in a non-volatile storage medium to realize persistence of the execution result. By implementing the technical scheme of the invention, the user request can be prevented from penetrating back-end service, and the request response speed is improved.

The present invention relates to the technical field of computer data management, and specifically discloses a data governance method, device, equipment and storage medium. By deploying a monitoring agent at the database engine layer in the data management system, data phantom read information within a specific time period is collected in real time; the probability coefficient of data phantom read in the database within a specific time period is calculated, and based on a set judgment rule, combined with the data phantom read probability coefficient, a hierarchical early warning operation is performed on the data; finally, a comprehensive adjustment is made to the cache volume and connection pool adjustment volume of the database. The implementation of these steps not only enhances the stability and reliability of the database, but also significantly improves the resource utilization rate and response speed of the system. In modern data-intensive applications, the complexity and dynamics of data operations require the system to have a higher level of intelligence and automation. It not only meets the current requirements of data management systems for high performance and high reliability, but also provides a sustainable development path for future data governance.

The invention provides a connection pool communication processing method, equipment and a medium, which are applied to the field of data transmission. The method comprises the following steps: acquiring length information and service type fields of data to be transmitted in a current process; classifying each piece of data to be transmitted into a first priority connection pool and a second priority connection pool according to the service type field; in the first priority connection pool, when the priorities of the to-be-transmitted data corresponding to the service type field are different, the to-be-transmitted data with the high priority are transmitted firstly; when the priorities of the to-be-transmitted data corresponding to the service type field are the same, the to-be-transmitted data with the high priority corresponding to the data length represented by the length information is transmitted first; in the second priority connection pool, the to-be-transmitted data with the high priority corresponding to the data length represented by the length information is transmitted first; therefore, according to the invention, the connection pool is dynamically divided according to the service type field, the problem of tail time delay caused by the transmission of the mixed message in the network environment is effectively reduced, and meanwhile, the resource occupation is reduced.