126 results about "Concurrency control" patented technology

The invention discloses a home page multi-component parallel prefetching and rendering first screen acceleration method and device and a storage medium, and the method comprises the following steps: constructing a global dependency relationship model based on the metadata and dependency relationship of each component of a home page, and calculating the priority for each component according to a predefined priority evaluation strategy, generating a component scheduling sequence constrained by the priority and the dependency relationship; controlling a concurrency control strategy of the component; preferentially rendering a visual placeholder structure, and smoothly replacing the real content to a user visible area through a progressive rendering replacement strategy; when the variable quantity of the component data exceeds a preset threshold value, triggering an increment updating strategy based on the difference content; generating a cache identifier according to component granularity, reading and writing data in a multi-level cache structure based on the cache identifier, and ensuring data consistency by adopting a background asynchronous verification strategy; and collecting performance indexes in a page rendering process, and adjusting the priority evaluation strategy, the concurrency control strategy and the increment updating strategy according to the performance indexes.

The invention relates to a visual component management method and system based on support of multi-user collaboration, and belongs to the technical field of computer software collaborative design. Wherein multi-party editing requests are received and verified through a cooperative access mechanism, structured component data are constructed by using a component modeling model, concurrent control and a difference buffer are adopted to coordinate parallel modification, write conflicts are identified and processed based on a conflict detection algorithm, and traceable management of component versions is realized through a snapshot generation model. According to the method, efficient, consistent and conflict-controllable unified management of the visual components in a multi-person online cooperation scene is realized, and the cooperation efficiency of component development and the system reliability are effectively improved.

The invention provides a communication optimization method for topological table persistent storage in efficient parallel computing, belongs to the technical field of storage communication, and aims to avoid pseudo sharing by aligning memory allocation through cache lines, expand local topological coverage through a topological entropy increment driven prefetching mechanism, and improve the reliability of the topological table persistent storage. Boundary processing is accelerated through a pre-calculation period mapping lookup table and a frequency domain transfer function vector, synchronization overhead is optimized through a concurrency control mechanism perceived by a read-write ratio, targeted cache preloading is achieved through stability and jitter degree two-dimensional evaluation, bandwidth consumption is reduced through an increment synchronization mechanism, and the stability of the cache is improved. The communication template is selected or the communication parameters are generated through adaptive conversion by matching the matching degree decision, and the technical problem that the parallel computing performance is reduced due to the fact that the communication overhead is too large in the topological table persistent storage process is solved.

The invention provides a storage device, a storage method and a storage access method based on lake and warehouse integration. The storage device comprises a storage management unit, a unified metadata management unit and a federal query engine unit, the storage management unit is used for realizing hybrid storage and dynamic hierarchical storage; the unified metadata management unit is used for metadata atlas construction, concurrency control and GDPR compliance support; the federal query engine is used for intelligent routing decision, SQL dialect unification and intelligent push-down optimization; based on a lake and warehouse integrated storage device and an access technology thereof, unified management of structured and unstructured data is supported, the problem of data islands is avoided, and cross-engine data visibility is realized through unified metadata management; according to the lake and warehouse integrated storage device and the access method, technologies such as a dynamic hierarchical storage strategy, intelligent routing decision, intelligent push-down optimization and the like are fused, and the storage and access efficiency and the robustness of the system are greatly improved.

The invention relates to the technical field of retail management, in particular to a retail end online management method and system based on concurrency control, and the method comprises the steps: constructing a retail knowledge graph based on historical transaction logs through employing a space-time interaction entropy weighting algorithm; calculating a local topology edge density increment by applying a streaming dense subgraph increment mining algorithm, and determining a topology aggregation state of a target node; if the state is the mixed concurrent state, constructing an inventory time slice mirror image containing a reference inventory domain and a dynamic increment domain; and writing the request into the lock-free annular buffer during checking, and merging data by adopting a time sequence alignment algorithm after checking to carry out atomized updating. According to the method, static inventory and dynamic sales are physically isolated by constructing the inventory time slice mirroring and lock-free buffer mechanism, the read-write conflict in the scene of inventory while sales is solved, and zero-blocking hybrid concurrence is realized while the final consistency of inventory data is guaranteed.

The invention discloses a report generation agent method, system and device driven by a large language model and a medium, and the method comprises the steps: constructing an agent execution framework independent of a native interface, outputting a decision through a cue word constraint model in a JSON structure, and scheduling a local tool function; analyzing the reference data and constructing a local vector knowledge base supporting semantic retrieval; the intelligent agent autonomously plans and generates a report directory structure based on a local vector knowledge base, stores the report directory structure as a structured intermediate file as a persistent intermediate representation, generates chapter content in parallel by utilizing a concurrent flow control and exponential backoff retry mechanism and combining a mixed retrieval strategy, and serializes and updates the chapter content to the intermediate file in real time; and finally, converting the intermediate file into a target format report according to a mapping rule. The system, the equipment and the medium are used for implementing the method. According to the method, the efficiency and the accuracy of complex report generation are remarkably improved through agent whole-process autonomous driving and combination of persistent intermediate representation, retrieval enhancement and concurrency control technologies.

The invention provides a database concurrency control and memory access optimization method which can be applied to the technical field of computer system software performance optimization. According to the method, multi-level instruction-level reconstruction is carried out on an execution path of a database kernel through the characteristics of an underlying hardware instruction set of a collaborative application processor platform, and the method comprises the following collaborative implementation optimization dimensions: based on a register file and a cache hierarchical structure of the processor platform, an access mode of a database core data structure is optimized; the number of memory access instructions is reduced; the data locality is improved; on the basis of atomic instruction set extension of a processor platform, instruction-level reconstruction is carried out on key primitives in a database multi-thread synchronization mechanism so as to reduce the overhead and contention of synchronization operation; on the basis of single-instruction multi-data-stream extension of a processor platform and a vector atomic operation instruction of the single-instruction multi-data-stream extension, parallel acceleration is carried out on batch life cycle management operation of objects in a database.

The invention discloses an AI policy consultation database and an AI consultation method, and belongs to the technical field of artificial intelligence and government affair information services. The invention aims to solve the problems of unreliable information source, large semantic understanding deviation and low policy matching accuracy of the existing general AI tool in the field of policy consultation. According to the technical scheme, the method comprises the steps that a multi-level, multi-dimension and versioning management policy database is constructed, and entity version snapshots and a multi-version concurrency control (MVCC) mechanism are adopted to process time sequence conflicts caused by policy revision; the retrieved trusted policy text and an original query request of a user are integrated into an enhanced Prompt (Augmented Prompt); and receiving and analyzing a preliminary conclusion returned by the LLM, and generating a standardized policy consultation report containing a structured table and attachments by using a natural language generation (NLG) and chapter structure analysis technology. And the accuracy, timeliness and reliability of policy consultation are remarkably improved.

The invention provides a transaction data processing method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring the market information of an electric power spot market in a current period, declaration strategies of a plurality of users and execution return in a previous period; performing priority ranking on the users based on the strategy and the market information to obtain a ranked user sequence; obtaining a target order of the user based on a standard price determined by the market information and the strategy, a price change step length and a transaction electric quantity in the strategy and the user sequence; carrying out comparison processing on the target order and the hung order executing the return to obtain a comparison result; and generating an order execution operation in the current period based on the comparison result, the target order and the hung order. According to the method, aggregation and account-level concurrency control in a period can be realized, so that stable throughput and low jitter can be kept under multiple parallel users, and high concurrency stability in a transaction data processing process is improved.

The invention provides an image tile service elastic concurrency control method and system under bandwidth constraint, and relates to the technical field of communication networks, and the method comprises the steps: inputting the collected actual bandwidth data of an image tile service into a preset time sequence prediction model, and outputting a future bandwidth use prediction value; determining a bandwidth utilization rate and a bandwidth early warning level in combination with a preset fixed exit bandwidth threshold value; when an access request is received and the bandwidth early warning level exceeds a preset early warning level, if the target image tile does not belong to the high-frequency tile set, returning the target image tile data with the original quality to the client; and otherwise, adjusting the image coding parameter of the target image tile, generating temporary tile data after quality reduction and compression, and returning the temporary tile data to the client. By implementing the method, the image browsing quality of the user can be maximized in the bandwidth unsaturated state while the high concurrency connectivity of the service is guaranteed.

The invention discloses an unstructured document multi-modal analysis and semantic metadata deep extraction method and system based on multi-agent collaboration. The method comprises the steps that multi-modal elements such as texts, images and tables are extracted in parallel through a multi-format unified analysis engine; a four-agent (table structure analysis, multi-modal image analysis, semantic text understanding and metadata extraction) collaborative architecture is adopted, and task decomposition, asynchronous scheduling and result fusion are realized based on a multi-agent collaborative scheduling algorithm; the performance is improved by combining dynamic concurrency control, memory optimization and an intelligent cache mechanism; and finally generating structured output. The system integrates the modules and supports micro-service architecture and stability guarantee. According to the method, multi-modal deep semantic understanding is achieved, the processing efficiency is improved by 3-5 times compared with that of a traditional method, the text / table analysis precision reaches 98% and 95% respectively, localized efficient processing and incremental updating are supported, and a high-quality data source is provided for enterprise knowledge management and content retrieval.

The invention provides an offshore wind power plant heterogeneous data lake snapshot integration method supporting dynamic backtracking, and aims to solve the problems of high operation and maintenance cost, inconsistent mass real-time data access and low historical backtracking efficiency caused by the fact that an existing Lambda architecture needs to maintain double computing engines. And constructing an incremental snapshot chain to support efficient data version backtracking. Specifically, the method comprises the following steps: designing a dynamic snapshot generation module based on time window division, and converting real-time streaming data into traceable continuous snapshot segments; a multi-version concurrency control engine is developed, and ACID transaction overhead is reduced through column type differential storage; meanwhile, a dynamic metadata sensing layer is established, a backward compatible mapping rule is automatically generated when a data mode is changed, and continuous and stable operation of a calculation engine is guaranteed; according to the method, the operation and maintenance complexity of the offshore wind power plant data lake is remarkably reduced, efficient integration of heterogeneous data and accurate backtracking of historical states are realized, and the data availability of fan fault diagnosis is effectively improved.

The invention discloses a shared resource access method and device, equipment, a medium and a product, and relates to the technical field of efficient concurrency control and resource management in a computer system.The shared resource access method and device adopt a mixed structure combining a lock-free annular queue and a double-end queue, queue data are analyzed through a load prediction unit, and the load trend is predicted; the queue capacity and the migration threshold value are dynamically adjusted; the lock-free annular queue is preferentially used in daily life to improve the access efficiency, and when the queue is close to the capacity upper limit or triggers the migration threshold, migration and capacity expansion of waiting coroutines are automatically realized through the double-end queue, so that the processing performance under high concurrency is ensured, and the dynamic capacity requirement is met; finally, the technical problems that the performance and the capacity of a single queue are difficult to consider in a high-concurrency scene and the single queue cannot adapt to a dynamic load are solved, and efficient scheduling of shared resources in a coroutine environment is realized.

The invention relates to the field of data access, and particularly provides an MPT-based block chain database system, a data access method, a terminal and a medium, the system comprises a native MPT storage engine used for realizing an MPT node structure in a disk and a memory, and the node structure comprises branch nodes, extension nodes and leaf nodes; the asynchronous I / O module is used for realizing non-blocking disk operation based on Linux iouring; the file system bypass module is used for supporting direct access to the block device; the versioning concurrency control module is used for realizing lock-free reading through an immutable Trie structure and atomic pointer updating; and the dynamic compression module is used for dynamically adjusting a historical data retention strategy according to the disk space utilization rate. The MPT structure storage engine is realized, basic data support is provided for a high-performance block chain system, serialization overhead is eliminated, and storage efficiency is improved.

The application relates to the technical field of flexible direct current power transmission, and particularly provides a lightweight real-time memory database transaction concurrent control method and device, which comprises the following steps: S101. Classifying to-be-processed transactions through cluster analysis to determine the cluster to which the to-be-processed transactions belong; S102. Obtaining a transaction lock corresponding to the to-be-processed transaction in the cluster to which the to-be-processed transaction belongs and a data lock called by the to-be-processed transaction, and executing S103 under the condition that the acquisition state is successful; S103. Conflict verification is performed on the to-be-processed transaction, if there is a conflict, the to-be-processed transaction is prevented, otherwise, the to-be-processed transaction is executed. The technical scheme provided by the application meets the demand of high-efficiency access of Internet of Things data and improves the transaction execution performance of the real-time memory database.

A database system implementing a concurrency control protocol is provided. The database system includes a node connected through a network to a client; the node comprises: a storage for storing a plurality of data cells; one or more processors; and a memory, the memory containing instructions that, when executed by the one or more processors, configure the node to: receive at least one non-commit statement that is part of a transaction; execute locally tasks included in each of the at least one received statement in an optimistic manner allowing statements of other transactions to independently access same data cells in the database system being modified by tasks of the at least one received statement; and return the client an acknowledgment that the transaction is committed, the acknowledgment is returned upon validation of the transaction, wherein the transaction is validated in a pessimistic manner.

The application provides a globally serializable multi-database transaction control method and system, comprising the following steps: an application service registers multi-database transaction processing logic to a shim layer; a multi-database transaction request initiated by a client is received, and the shim layer intercepts and starts a global transaction of the multi-database transaction; the shim layer executes a sub-transaction request of the multi-database transaction according to the multi-database transaction processing logic; the global transaction is submitted to a two-phase commit coordinator, and an execution result of the multi-database transaction request is returned to the client. The application provides atomicity, durability and global serializability guarantee for the multi-database transaction; based on the shim layer, the concurrent control of the existing database system is reused, and the application can be seamlessly integrated into the existing application; the transaction coordination overhead is low, and the application is suitable for a high concurrency environment; the distributed transaction control has good ACID characteristics; the application does not depend on a specific service implementation platform; the application has low invasiveness, and the transaction control does not affect the writing of normal business code.

The invention discloses a distributed block storage-oriented metadata request concurrency control method and system, and the method comprises the steps: firstly, carrying out the grouping of metadata according to the attribute information and business logic information of the metadata of a distributed block storage system; a metadata structure tree is established based on business logic information between root nodes of the sub-level tree structures obtained through grouping, then a tree-shaped lock mechanism is constructed based on the metadata structure tree, and fine-grained lock management is achieved; the method comprises the following steps: creating a transaction ID for a request for a time point and an RPC request type of each user RPC request, analyzing the user RPC request corresponding to each transaction ID, determining a specific node required to be processed by the request, then starting from a general control node of a tree lock, traversing all related root node paths downwards, and carrying out locking operation step by step. The availability of the metadata service is ensured, the requests on different sub-trees are allowed to be executed concurrently due to the fine-grained characteristic of the tree lock, and the concurrency and throughput of the metadata service are improved.

The embodiment of the invention relates to the field of medical treatment, and discloses a medical equipment system-oriented concurrency control method, system, equipment and product, and the method comprises the steps: receiving a control request from an external control end through a multi-thread concurrency channel, and analyzing the control request into a standardized intermediate format instruction; reading the standardized intermediate format instruction through a single serial channel, and performing logic interlocking arbitration on the instruction according to a preset global treatment state machine; when logic interlocking arbitration is passed, disassembling the standardized intermediate format instruction into a bottom atomic action sequence; distributing the atomic action sequence through a multi-thread parallel channel, and carrying out physical security verification on the atomic action sequence based on hardware physical constraint conditions before driving the medical equipment to execute actions; only when the physical safety verification is passed, the control signal is output to drive the medical equipment to execute the action, so that accurate transmission and execution of the control instruction in a complex clinical scene are ensured.

The application relates to the technical field of data processing, and discloses a hybrid breadth-first and depth-first traversal backup method and device, which comprises the following steps: acquiring a maximum depth value and a concurrency control threshold value, determining a first backup list and a directory to be backed up according to the maximum depth value, and determining a second backup list according to the concurrency control threshold value; and calling a file processing callback function to back up each file in the backup list. Through the above method, the maximum depth value and the concurrency control threshold value are pre-configured, and the directory structure characteristics of different business scenarios are adjusted. According to the configuration parameters, the breadth-first traversal and the depth-first traversal are switched, the breadth-first traversal is preferentially used when the directory structure is detected to be relatively flat, and the depth-first traversal is automatically switched when a nested structure is encountered to perform in-depth traversal. The application can be applied to the business fields of financial technology, medical health and old-age care, and the efficiency of data backup of a data management system is improved.

The invention relates to the technical field of data processing, in particular to a power grid multi-dimensional information base construction method and system based on data mapping. According to the method, data source change events are monitored in real time, and incremental data records are extracted; constructing a data association graph containing a dynamic association relationship, calculating the influence degree of incremental data records on other data items based on graph path propagation or space-time neighborhood analysis, and obtaining a quantized influence degree factor; updating tasks of other data items are generated according to the influence degree factors, priority ranking is carried out, and a multi-version concurrency control mechanism is adopted to carry out atomic updating on the data items according to the priority. The real-time accurate updating of the multi-source heterogeneous data of the power grid is realized by capturing the increment change in real time and quantifying the dynamic association influence, the problems of data lag and weak association caused by a traditional batch processing mode are solved, and the timeliness of power grid state sensing and scheduling is effectively improved.

The application discloses an LED lamp driving control method and controller based on wideband power carrier communication and relates to the technical field of intelligent lighting control; the application realizes channel sensing communication by dynamically selecting an anti-interference sub-carrier, combining adaptive modulation, CRC check and MMSE equalization algorithm, and reduces the error code rate; the application improves the light adjustment efficiency and accuracy by dynamically distributing PWM and analog light adjustment weight by using an LSTM network and a sparrow optimization algorithm; the application improves the fault prediction accuracy by combining multi-parameter fusion diagnosis and OTA remote repair and by real-time calibration of a driving signal through PID closed-loop control; the application supports multi-node high-concurrency control, improves signal injection efficiency, reduces comprehensive energy efficiency, is suitable for scenes such as smart home and industrial lighting, and significantly improves system reliability and user experience.

The invention relates to the technical field of distributed systems and micro-service architectures, and discloses an efficient concurrency control method based on a double-layer lock mechanism and related equipment.The method comprises the steps that a double-layer lock interface is defined, and the double-layer lock interface comprises an acquisition lock and a release lock; constructing a double-layer lock structure according to the double-layer lock interface, wherein the double-layer lock structure comprises a local lock layer and a distributed lock layer; and lock acquisition and lock release are respectively performed on the local lock layer and the distributed lock layer based on lock control logic, so that efficient concurrency control work of the double-layer lock mechanism is completed. Through the innovative design of a double-layer lock structure, global consistency and high concurrency performance are effectively considered in a micro-service architecture and a distributed system, the throughput capacity of the system is improved, and data consistency is guaranteed.

Systems and methods for editing a file-backed table in a database having a concurrency control mechanism, that include reading the content of the file-backed table, and modifying the content of the file-backed table.

This invention discloses a method for updating multi-source heterogeneous pipeline data, belonging to the field of data update technology. The method includes: creating a data download task, recording the download range and pipeline type information, and determining whether there is an associated data entry task; if so, waiting for the associated task to execute; creating a data entry task, determining whether there is an associated data download task, and waiting for the associated task to execute; reading multi-source pipeline data within a specified range through a download queue concurrency control mechanism, and assembling and downloading the data format; performing a quality check before data entry through an entry queue concurrency control mechanism, reading the data to be entered into the database and the data in the current database; performing repair and testing on the read data, and comparing the differences between additions, deletions, and modifications; updating the compared addition, deletion, and modification information to the current database, and synchronizing the deletion and modification information to the historical database.

The application discloses a transaction concurrent control method, first constructs a set of transaction system, each transaction index in the transaction system collects the transaction characteristic information of the data item of the partition in real time and dynamically adjusts the partition of the transaction, selects the appropriate concurrent control method for each partition, generates a concurrent control plan, and gives the partition manager, the partition manager adjusts the data partition in the transaction index according to the concurrent control plan, and distributes the concurrent control plan to the client, according to the partition range in the concurrent control plan and the concurrent control method of each partition, carries out the read-write operation, and completes the adaptive transaction concurrent control method. The method of the application adopts the adaptive concurrent control mechanism based on the transaction characteristics of the data item, dynamically selects the appropriate concurrent control method according to the transaction scale, the conflict rate and other characteristics, balances the load between the nodes, and effectively deals with the real-time variable transaction type and different workloads.

The invention discloses a high-scalability data processing system and method based on multi-strategy collaboration, a readable storage medium and electronic equipment. The system comprises a strategy abstraction and implementation module; a concurrency control and synchronization module; the strategy collaboration and factory scheduling module comprises a data flow reactor which is used for coordinating event driving and state management of the whole data processing flow and receiving original data; the transmission strategy factory module is used for receiving the original data sent by the data flow reactor and selecting a data format and a transmission protocol from the strategy abstraction and implementation module according to the configuration parameters so as to dynamically create a specific implementation instance based on the original data; and the data model packer and the concurrency control and synchronization module carry out parallel batch data processing on the specific implementation examples generated by the transmission strategy factory module, and output a final processing result to a target system. The system has the advantages that the system can overcome the defects of high coupling, poor expansibility, insufficient strategy collaboration, low concurrency efficiency and the like in the prior art.

The invention discloses an annotation-based transaction control and processing method, and relates to the technical field of data processing, and the method comprises the steps: adding a transaction control and processing annotation in a transaction processing code, and carrying out the aspect processing of the transaction control and processing annotation based on the aspect programming technology of the annotation; respectively weaving the transaction management and control logic and the transaction processing logic into business logic; executing transaction management and control logic, and executing a corresponding management and control strategy according to the online configured transaction state parameters; after the transaction management and control logic passes, executing the transaction processing logic, executing the business logic, and updating transaction flow information; a traffic control threshold, a concurrent number control threshold and transaction state parameters are checked and modified online through a monitoring page, so that a transaction volume control strategy can be flexibly adjusted for different scenes. According to the invention, the transaction flow control threshold value and the transaction concurrent number control threshold value can be updated online, and the transaction volume control strategy can be flexibly adjusted online for different scenes.

The invention discloses a WAL type KV storage engine system and an operation method thereof, and relates to the technical field of distributed storage systems.The system comprises a concurrent additional write-in module used for supporting Raft node level multi-file concurrent write-in, adopting a mechanical hard disk additional write-in mode and defining a clear RaftLog file format; the memory index module is used for realizing quick positioning and range reading and writing of RaftLog by adopting a two-stage memory index table structure of a hash table and an ordered single linked list, and comprises a cache mechanism; the cleaning module is used for recycling old RaftLog through a GC cleaning and file rewriting mechanism triggered by a threshold value, and new RaftLog writing is not blocked in the cleaning process; and the concurrency control and recovery module is used for guaranteeing the security of multi-thread operation through a lock strategy and reconstructing a secondary memory index table structure based on a RaftLog file format to realize fault recovery. According to the method, the read-write performance of RaftLog on the mechanical disk can be improved, and the problem of performance bottleneck of a traditional storage engine in a mechanical hard disk scene is solved.

The invention discloses a service request processing method and device, equipment, a medium and a product, and relates to the technical field of computers. The method comprises the following steps: determining a concurrency condition of a currently received service request based on a load condition of a server; when the concurrency condition is high concurrency, querying resource information of a plurality of Token interfaces in Redis based on a resource data table; allocating a target Token for the service request based on the resource information, and determining interface information of the target Token; setting an effective duration for the target Token; analyzing the service request to obtain a key identifier, and determining a processing strategy of the service request based on the key identifier; and within the effective duration, obtaining the target Token in the Redis based on the interface information, and responding to the service request based on the processing strategy to obtain a request processing result. According to the technical scheme, a global concurrency control strategy can be carried out on the service request, and concurrency resource control can be carried out on the whole system.