168results about How to "Improve concurrency" patented technology

The invention relates to the technical field of big data, and particularly discloses a business data processing method and device, computer equipment and a readable storage medium. The method comprises the following steps: in response to a resource registration request for target service data, grouping the target service data to obtain a plurality of grouped data; the target business data comprises any business data in the business data uploaded by the plurality of resource transaction channel ends; storing the grouping information of the plurality of grouped data to a clearing task queue list corresponding to the target business data; issuing the task processing message to enable a plurality of servers subscribing the task processing message to obtain grouping information from the clearing task queue list in parallel, and executing a registration subtask on the grouping data according to the grouping information; and according to the sub-task execution states of the grouped data returned by the plurality of servers, determining resource registration operation results of the plurality of grouped data. By adopting the method, the accuracy of business data processing can be improved.

The invention discloses a multi-thread and LOD-based point cloud rendering method, and relates to the field of video rendering, and the method comprises the steps: dividing point cloud data into n data blocks; calculating an initial position of each data block in the point cloud file, and creating n threads; extracting m pieces of LOD point cloud data with different levels of detail from the octree of each data block; calculating the proportion # imgabs0 # of the size of the current point cloud in a rendering viewport and the distance # imgabs1 # from a viewpoint to a camera, and calculating the detail level # imgabs4 # of the current to-be-rendered LOD point cloud according to a preset viewport proportion threshold value # imgabs2 # and a preset sight distance threshold value # imgabs3 #; according to # imgabs5 #, selecting point cloud data of a corresponding detail level from the m pieces of LOD point cloud data; for each interactive operation event, parallel coordinate transformation and illumination calculation are carried out on the LOD point cloud data to be rendered currently in different threads; submitting a calculation result to a renderer for rendering; aiming at low rendering efficiency in the prior art, the method and the device can efficiently render large-scale point cloud data.

The invention provides a distributed transaction processing system and method. The system comprises a transaction coordinator, a transaction manager and a resource manager, the transaction manager is configured to: register a global transaction with the transaction coordinator; the transaction coordinator is used for creating a global transaction identifier for the global transaction; creating a branch transaction identifier for each branch transaction; the resource manager is configured to: register branch transactions with the transaction coordinator; the service processing statement is executed to obtain updated service data, a rollback log is generated, the updated service data and the rollback log are submitted to a database, and resources used for submitting operation are released; the transaction coordinator is further used for judging whether the submission operation of each branch transaction in the first stage is successful or not; if both are successful, the transaction manager is notified, so that the transaction manager initiates a global submission confirmation request of a second stage; and asynchronously notifying each resource manager to delete the rollback log. According to the invention, the concurrency performance can be improved and the complexity can be reduced.

A blockchain smart contract execution system supporting artificial intelligence model reasoning comprises a client used for deploying a contract or a smart contract supporting AI model reasoning, a blockchain node used for maintaining the security and consistency of blockchain data, and a trusted execution environment provider. According to the method, the function of realizing complex deep learning model reasoning in the existing block chain can be supported, and four design objectives of supporting non-deterministic AI reasoning, avoiding complex intelligent contract verification, being compatible with the existing block chain and protecting model privacy are realized.

The invention provides a multi-thread dynamic video transmission technology based on bird repelling application, which is characterized in that real-time transcoding and transmission of multiple paths of high-definition videos can be completed, multi-thread dynamic video transmission is completed in the same window in a man-machine interaction mode, and the video transmission technology adopts coding terminal cache optimization and congestion control algorithm optimization. According to the coding terminal cache optimization, a specific data structure is applied to cache design, the utilization rate of a cache region is increased, and the data circulation speed is increased; according to the congestion control algorithm optimization, by changing a slow start threshold value, the data volume is changed from exponential growth to linear growth, the data fluctuation in the network is reduced, and the probability of packet loss retransmission is reduced; the QT multi-thread technology is adopted, the data transmission efficiency among multiple threads is improved, the data circulation speed is increased, software flash quit caused by memory overflow is avoided, the system delay time is shortened, a client side can conduct multi-channel video transmission at the same time, and the function requirement for real-time multi-channel video transmission under the complex scene of bird repelling application is met.

For scenes of data distributed storage and cross-domain circulation use in each business domain of an industrial scene, the invention provides a cloud-edge collaborative data storage and retrieval architecture aiming at the problems that business systems are many and complex, the data volume is huge and part of data cannot be clouded, and aims to realize unified storage and cross-domain efficient circulation of large-scale data. According to the architecture, a data coding rule based on an RDF graph model and a data multi-level efficient storage strategy based on an S-tree are designed, it is guaranteed that cloud-unavailable data are stored in an edge side server, cloud-available data are stored in a cloud server, and an index tree efficient collaborative retrieval algorithm (CECI-tree) oriented to cloud edge collaborative storage is provided. The efficiency of data retrieval is effectively improved through a concurrent retrieval mechanism and a cloud edge collaborative indexing mechanism.

The invention discloses a block generation method, a block generation device and computer equipment, which are characterized in that a hash value of a leaf node is calculated by combining a preset hash algorithm and modulo operation, and a hash value of a father node is calculated based on a hash value of a child node of the father node by combining summation operation and modulo operation. Therefore, the leaf node can be updated based on the transaction data needing to be packaged for generating the target block, the difference value between the new hash value and the old hash value corresponding to the leaf node is used as the hash variable quantity, and then the position information of each path node on the target path leading to the root node of the Merkel tree from the leaf node is acquired; according to the method, the Hash variation generated by each tree node corresponding to the leaf node is determined based on the Hash variation of the leaf node and the position information of the path node, then the Merkel tree is updated based on each Hash variation, finally, transaction data is packaged, and the transaction data is stored in the Merkel tree based on the packaged data and the Hash value of the root node in the updated Merkel tree. And generating a target block.

The invention relates to an automatic marine data downloading method and system, and belongs to the technical field of data transmission, and the method comprises the steps that downloading parameters and task parallel requirements are acquired, and the downloading parameters comprise remote server information and the number of downloaded files; a downloading thread is created through a main thread according to the number of downloaded files and task parallel requirements, and the downloading thread independently sends a downloading request to a remote server; the remote server sends a downloading file to a downloading thread according to the downloading request, the downloading thread processes data of the downloading file in parallel according to a preset semaphore, the downloading file is stored in a database, and a downloading success notification is sent to the main thread; transmitting the successfully downloaded download file to a remote server through an asynchronous mechanism; wherein the asynchronous transmission step and the multi-thread downloading step are carried out in parallel; through multi-thread parallel downloading and asynchronous transmission, quick and reliable downloading and distribution of files are achieved, the number of downloading threads is controlled through semaphores, and stability and high efficiency of the downloading process are ensured.

The invention belongs to the technical field of integrated circuit design, and provides a user-defined attribute class access method and device, electronic equipment, a storage medium and a program product, and the access method comprises the steps: determining a to-be-accessed target user-defined attribute class; mapping a pointer address for storing the target circuit data to a target lock in the plurality of locks, so that the current thread holds the target lock; and under the condition that the target lock is utilized to lock the target circuit data, accessing the target custom attribute class in the target circuit data by calling the interface of the target custom attribute class in the management class of the target function module in the current thread. The problems that the data access speed is low and the data access efficiency is difficult to improve are solved, the pointer address can be mapped to the lock, local locking of the to-be-accessed target circuit data in the whole class inheritance relation is achieved, the situation that the data access speed and efficiency are affected by locking all data in the class inheritance relation is avoided, and the data access efficiency is improved. Concurrency and stability of the system can be improved.

The invention discloses a distributed file analysis method and system, and belongs to the technical field of file processing, distributed parallel processing is adopted, distributed file analysis is realized based on Flink + Kafka, and for a to-be-analyzed HDFS (Hadoop Distributed File System) file, the analysis efficiency is improved. And distributing file information needing to be analyzed to different hosts for executing analysis tasks in a balanced manner through a Kafka distributed message queue and an Flink distributed calculation engine, and executing file analysis operation in parallel. According to the invention, the distributed parallel analysis of the file can be realized, the high availability of the file analysis is ensured, the consistency of the file analysis is realized, and the file analysis is ensured not to be repeated or lost.

The invention provides a request processing method, a related device and a storage medium. The method comprises the steps that a plurality of read-write requests of a user mode program to a storage device are stored in a first annular buffer area, the storage device comprises a controller and a memory, and a circulation step is executed, specifically, a target read-write request pointed by a head pointer in the first annular buffer area is sent to the controller so as to achieve data read-write operation on the memory, and obtaining a target read-write response of the target read-write request, storing the target read-write response in a second annular buffer area, storing the target read-write request and context information of the target read-write response in a third annular buffer area, and reading the target read-write request on the basis of the target read-write request and the context information of the target read-write response. The target read-write response is sent to the corresponding user state program, the head pointer is moved down by one bit, the target read-write request stored in the third annular buffer area and the context information of the target read-write response are emptied, and the input / output operand per second of the storage device is increased.

The invention provides a database memory allocation method, device and equipment, and the method comprises the steps: obtaining a target sub-memory pool allocated by a target thread used for executing a target task under the condition that the memory demand of the target task is smaller than a preset allocation threshold value, the target sub-memory pool is composed of a plurality of linked lists, each linked list comprises a plurality of memory blocks with the same memory capacity, and the memory capacities of the memory blocks linked by the plurality of linked lists are different; under the condition that the memory demand is larger than the memory capacity of the maximum memory block in the multiple linked lists, a first target allocation memory block is obtained from the global memory pool, and the memory capacity of the first target allocation memory block is larger than or equal to the memory demand; extracting a task allocation memory block corresponding to the memory demand from the first target allocation memory block, and allocating the task allocation memory block to a target task; and adding the remaining memory blocks of the first target allocation memory block into the target sub-memory pool.

The invention relates to a method, a device and a system for setting transaction operation dependence based on a log sequence. The method mainly comprises the steps that after a target end data synchronization service receives a DML operation of a source end, an MD5 value calculated by the source end in the operation is extracted to serve as a KEY, and then a transaction ID in the operation is extracted to serve as a TRXID; constructing a detection record X by using the currently operated KEY, merging the detection record X into the hash table R, performing conflict detection judgment in the merging process, and returning a TRXID value corresponding to a conflicting KEY if the conflicting KEY exists; otherwise, 0 is returned to serve as the corresponding TRXID, and no conflict exists; and setting the TRXID obtained by conflict detection judgment as a conflict TRXID, writing the initial LSN of the first memory chip in the memory linked list corresponding to the current hash table R into the current operation, and setting the initial LSN as a conflict LSN. According to the method, the dependency relationship between transaction operations can be determined, which transactions need to wait can be determined during synchronous operation, and the synchronization parallelism can be improved to the maximum extent.

The present application belongs to the field of database technology, and specifically discloses a connection reuse method and device based on database distributed communication, the method comprising: receiving an SQL request from a business component, and starting a transaction based on the SQL request; if the current SQL statement is a start transaction statement, searching and determining the first connection slot that matches successfully from the connection pool cache, and taking the first connection slot from the connection pool cache, and executing the current SQL statement according to the first connection slot; looping and executing subsequent SQL statements in the transaction until the transaction ends when the current SQL statement is a commit statement or a rollback statement, updating the reference count of the connection slot, and returning the connection slot to the connection pool or continuing to retain it in the connection pool cache according to the reference count; when all SQL statements are executed, returning the connection slot to the connection pool. Through the present application, the connection utilization rate can be improved to improve the operating efficiency of the system.

This invention provides a method, apparatus, electronic device, and medium for monitoring terminal inspection, applied to an inspection system connected to multiple monitoring terminals to be inspected. The method includes: acquiring historical service traffic information and real-time network stability information of the inspection system; determining inspection configuration information for the multiple monitoring terminals based on the historical service traffic information and the real-time network stability information, the inspection configuration information including inspection concurrency and inspection time period; and performing inspection on the multiple monitoring terminals according to the inspection configuration information to generate monitoring data for the multiple monitoring terminals. This invention achieves automated generation of inspection configuration information during the inspection process, while improving the concurrency performance of the inspection system, increasing the number of concurrent inspections within a period, and improving inspection efficiency.

The application provides a mosaic video playing control system, method, electronic device and storage medium. The system comprises a device end, a server end and a browser end. The device end is used for collecting video data, encoding and processing video frames in the video data and detecting sensitive information in the video frames, obtaining encoded frames corresponding to the video frames and the sensitive information in the video frames, adding the sensitive information in a protocol header of the encoded frames, obtaining a first video file, and uploading the first video file to the server end. The server end is used for performing encapsulation processing on the first video file according to a video playing request of a user, obtaining a second video file, and transmitting the second video file to the browser end. The browser end is used for receiving the second video file, performing mosaic processing on video frames in the second video file, obtaining a mosaic video, and rendering and playing the mosaic video. The system can reduce storage cost, improve video concurrency, improve response speed and support plug-in-free dynamic playing.

The invention provides a data writing method, system and device and a medium, and the method comprises the steps: obtaining a local version number currently maintained by a local site in response to the detection of a data writing request initiated by the local site to a target data block; generating local metadata according to a local write operation range and a local version number corresponding to the data write request, and writing local to-be-written data in the data write request and the local metadata into a target data block; in response to detecting that the local site receives a synchronous write request initiated by the remote site to the target data block, triggering the local site to respond to the synchronous write request, comprising the following steps: acquiring remote to-be-written data and remote metadata contained in the synchronous write request; and according to the local metadata, the far-end metadata, the far-end to-be-written data and a preset rule, determining target to-be-written data corresponding to the synchronous write request and a target write operation range, and writing the target to-be-written data into the target write operation range. The write conflict problem is solved, and the concurrency performance is improved.

This application discloses a method and system for uploading monitoring data for internet hospitals. The method includes: a data management center monitoring the data to be monitored generated on the internet hospital platform, obtaining the index value of the data to be monitored, and sending the index value to a front-end application terminal; the front-end application terminal obtaining the corresponding data to be monitored based on the index value, adding the data to a message queue, and transmitting the data to be monitored to the monitoring platform based on the message queue. This application uses the data management center to send the index value of the data to be monitored to the front-end application terminal, allowing the front-end application terminal to directly obtain the data to be monitored, avoiding the backlog of data requests between the gateway and the front-end application terminal, ensuring the timeliness and completeness of the data acquisition, and improving the accessibility of the data to be monitored. Simultaneously, the front-end application terminal sends the data to be monitored to the monitoring platform via a message queue, improving the concurrency of the data to be monitored.

The embodiment of the invention provides a cross-forward isolation data comparison system, method and device, a medium and a product, and relates to the field of data synchronization and verification. The system comprises a first agent which is deployed in an intranet and accesses a source end database through a database connection protocol; the second agent is deployed in an external network and establishes one-way communication connection with the first agent; the first agent is also used for transmitting the source end data of the source end database to the second agent through the forward isolation device through the one-way communication connection; and the comparison service is deployed in an external network, pulls the source end data from the interface of the second agent, and performs comparison operation on the source end data and the target end data. According to the method provided by the invention, the technical problem of data comparison in a cross-forward isolation scene is solved through the design of a double-agent architecture and a user-defined protocol, the security and reliability of data comparison are realized, and efficient and secure data comparison in a strict network isolation environment is realized.

The invention relates to an information hooking method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: acquiring an initial session; the initial session comprises a dynamic service pointer; if the state of the first security service in the security services for the initial session is first hitching, determining a target memory of the initial session; the first security service is a service participating in initial session processing in a firewall; pointing a dynamic service pointer in the initial session to a target memory, and hooking service extension information of the first security service to the initial session; and for the next first security service in the security services, re-executing the step of determining the target memory of the initial session if the state of the first security service in the security services relative to the initial session is first hitching until the service extension information of the last first security service in the security services is hitching to the initial session, thereby obtaining the target session. By adopting the method, the concurrency performance of the firewall can be improved.

The invention discloses a method, a system and equipment for generating ECharts chart resources based on a server side. The method is executed in a Node.js environment and comprises the following steps: receiving and analyzing a chart generation request; loading an ECharts configuration template and obtaining original data, and generating a complete configuration item after standardization processing; creating a virtual DOM (Document Object Model) environment and container elements through the JSDOM; creating an off-screen canvas based on Canvas, initializing an ECharts instance and executing rendering; encoding the rendering result into an image data stream; and performing format adaptation and distribution according to the terminal type. The invention further provides a cross-end consistency guarantee mechanism, a block rendering optimization mechanism, an intelligent distribution mechanism and the like. Complete decoupling of the ECharts and the server environment is achieved, static chart resources can be efficiently generated, large data volume processing is supported, cross-terminal display consistency is ensured, the performance and safety of chart generation are remarkably improved, and the application range of chart generation is remarkably widened.

The invention provides a data batch migration method which can be applied to the technical field of big data. The method comprises the following steps: creating a thread pool for data batch migration by utilizing a dynamic multi-thread model; performing data slicing on the source data table based on the data volume of the source data table to obtain data batch information, and creating a batch manager with a synchronous lock mechanism; migrating the source data table into a temporary data table in batches by using threads in a thread pool based on the data batch information; the number of threads in the data batch migration process is dynamically adjusted through a dynamic multi-thread model, and the data batch migration process is synchronously controlled through a batch manager; under the condition that the batch manager detects that synchronization is completed, data consistency verification is conducted on the data in the temporary table, and then data batch migration of the source data table is completed. The invention further provides a data batch migration device and equipment, a medium and a program product.

The invention relates to an efficient sparse large object data migration method, and belongs to the field of large data. The method comprises the following steps of: calculating the size of a row of data according to a table structure, and setting a reasonable size of a data buffer area, a size threshold value of loading large object data into a memory and reasonable reading, caching and writing thread counts according to the size of the data buffer area; comparing the size of the read source data with a set data threshold value, and putting the source data into different task queues according to a result; and writing the data into a target database by adopting different writing modes aiming at the data of different task queues. Aiming at the characteristics of sparse large object data, the invention provides an efficient data migration method, and the available memory of the system is utilized to the greatest extent to improve the concurrency of data operation, so that the efficiency of data migration and storage is improved.

The present invention relates to the field of petrochemical exploration technology, and in particular to a real-time detection method and system for gas field business anomalies based on the Rete algorithm, including obtaining real-time data during the drilling process and inputting it into a pre-constructed Rete network. The steps of constructing the Rete network include: defining a rule set according to the rules in the drilling process; constructing an α network, the α network is used to quickly filter the input real-time data according to one or more α nodes; constructing a β network, the β network is used to judge the relationship between real-time data and multiple conditions according to one or more β nodes; and performing constraint judgment and execution according to the input real-time data. The present invention can quickly identify and match the massive real-time data obtained during the drilling process, and output the corresponding anomaly detection results, thereby improving the detection efficiency. At the same time, based on rule matching, it reduces the detection error and improves the real-time performance of the detection.

The invention discloses a multi-thread log lock-free output method and device and a storage medium, and the method comprises the steps that a hash table is created in a memory, and each slot position in the hash table comprises a plurality of nodes used for storing log output content; a plurality of service threads transmit log output contents generated by various services to a hash table, and ID values of the service threads and corresponding slot numbers in the hash table are obtained; storing the log output content transmitted by the service thread into a node under the slot number corresponding to the ID value of the service thread; and finally, regularly traversing log output contents in the nodes under all slot numbers, and transmitting the log output contents to a log file. According to the invention, in the process of searching the slot position, as the ID value of the service thread is unique, the selection of the slot position is unique, and the situation that a plurality of threads occupy one slot position is avoided, so that the conflict of the service threads is reduced, the concurrency efficiency of service logic is increased, and the concurrency and throughput of the service are improved.

The invention discloses a data processing method and device based on a distributed optimistic lock, equipment and a medium, and relates to the technical field of distributed systems.The method comprises the steps that when a data writing request is received, the distributed optimistic lock is obtained from a cache; matching a request version number carried in the data writing request with an optimistic lock version number recorded by the distributed optimistic lock; if the matching is successful, updating an optimistic lock version number recorded by the distributed optimistic lock, and releasing the distributed optimistic lock after the updating is completed; and obtaining target write-in data from the data write-in request, and updating database data in the structured database and cache data in the cache according to the target write-in data. According to the method, the consistency of the cache data and the database data can be maintained.

The invention discloses a message control method, a product, equipment and a medium, and relates to the technical field of information propagation control. According to the scheme, the concept of the gravitation value is defined for each node of the social network; the gravitation value represents an information propagation association degree between the two nodes; according to the method, the corresponding clustering label is updated according to the gravitation value of each node, each node in the social network can be divided into a plurality of sub-networks according to the clustering label, and finally message control is performed on each sub-network, so that the calculation complexity is greatly reduced. Meanwhile, due to the fact that the split sub-networks are mutually independent, the different sub-networks can concurrently and synchronously execute related operations such as negative message control, concurrency of the system is improved, the execution period of the algorithm is shortened, expandability of the algorithm is enhanced, and the method is suitable for a large-scale social network.

The embodiment of the invention discloses a distributed transaction processing system transaction processing method and a computer readable storage medium. According to the method, a lock-free conflict detection mechanism is introduced, on the premise that any read-write lock is not used, writing-writing conflicts, writing-reading conflicts or read-writing conflicts of data item granularity between concurrent transactions are detected, and the three data inconsistency problems of dirty reading, unrepeatable reading and magical reading are avoided. Meanwhile, transactions with reading conflicts are allowed to be executed concurrently, and the concurrency of transaction processing is improved. When a timeout problem occurs, the coordinator and the participants respectively execute different protocol termination processes, so that the coordinator and the participants can be timely and properly processed when faults occur, and the 2PC protocol is optimized. Besides, after the participants enter the submission stage of the transaction submission step, the multi-copy mechanism of the system ensures that the sub-transactions undertaken by the participants are not influenced to execute correct submission or rollback operation even if the participants fail, so that the fault tolerance of the system is ensured.

This application discloses a report calculation method, device, and medium. The method includes: obtaining a report calculation request from a client and calling a task scheduling operation log table; determining the running status of each application server based on the task scheduling operation log table; determining the idle status of each application server based on its running status using a preset idle status judgment algorithm; determining the calculation task for each application server in response to the report calculation request based on its idle status; and calculating the report based on the calculation task of each application server. After receiving the report calculation request, the server understands the running status of each application server based on the task scheduling operation log table and continues to determine the idle status of each application server using the preset idle status judgment algorithm. This automatically and reasonably allocates the report calculation workload to each application server, improving report calculation efficiency, especially under large-scale report calculations.