256 results about "Transaction log" patented technology

The invention discloses an electronic lead seal data management method based on a block chain, relates to the technical field of internet data services, and aims to solve the problems of node data asynchronization, state updating failure and potential safety hazards of an intelligent contract in the prior art. The data consistency is ensured through a distributed clock synchronization algorithm and a version number verification mechanism; the reliability and fault tolerance of state updating are improved by adopting an improved Byzantine fault-tolerant algorithm and an asynchronous two-stage transaction submission mechanism; data integrity and traceability are guaranteed through a state machine detection mechanism and transaction log records; the security and maintainability of the smart contract are improved based on an automatic code auditing algorithm and a proxy contract mode of a graph neural network; real-time data monitoring and exception repair are realized by using an under-chain auditing mechanism and a cross-chain data consistency verification protocol; according to the invention, the data consistency, the system safety and the reliability of electronic lead seal data management are obviously improved.

The invention relates to the technical field of distributed system transaction management, and discloses an inventory consistency management method and device based on distributed transactions, and the method comprises the following steps: pre-occupying an inventory, and recording the state information of the inventory to a Redis hash structure; after the inventory is pre-occupied successfully, generating a pre-deducted snapshot, generating a compensation identifier, and writing the pre-deducted snapshot and the compensation identifier into a MySQL transaction log together; verifying the uniqueness of the compensation identifier, and submitting the current database transaction after the uniqueness of the compensation identifier is confirmed; when the submission of the current database transaction fails, executing a compensation operation on the current database transaction; and after the compensation operation is executed, performing data consistency verification on the MySQL transaction log and the Redis hash structure. According to the method and the system, the consistency of inventory management during distributed transaction processing is highly guaranteed.

Systems and processes are disclosed for enhancing cybersecurity and optimizing software repositories through integration of web crawling, web scraping, feature engineering, and advanced machine learning algorithms to detect phishing attempts, prevent account takeover fraud, and identify unused code in repositories. The system collects and refines data from various sources, including transaction logs, customer databases, device details, external data sources, and historical fraud data, to build comprehensive datasets. Feature engineering creates new, meaningful features from the refined data, which are used to train and evaluate machine learning models. The best-performing models are deployed in production to monitor incoming communications and transactions in real-time, flagging suspicious activities and optimizing codebases. This processing ensures timely detection and prevention of security threats while maintaining efficient software development processes. Robust protection is provided against evolving cyber threats and enhances software performance and security through continuous learning and adaptation.

The invention provides a dynamic tool integration method and system for an intention-driven AI dialogue system, and the method comprises the steps: S5, extracting resource occupation information from a transaction log according to a state persistence record, carrying out the resource release and temporary context cleaning of each heterogeneous component, and obtaining a released resource list; s6, searching a breakpoint state snapshot and a transaction log from the distributed database according to the released resource list, and reconstructing a tool chain execution flow historical state to obtain a fault context analysis result; and S8, according to the context recovery state and the semantic feature vector, updating a tool chain execution stream, and reallocating computing resources through a heterogeneous component coordination mechanism to obtain a task continuity confirmation result. According to the method, the recovery efficiency and the resource utilization rate of the tool chain in an abnormal scene are remarkably improved, and the task continuity and the system robustness in a high-concurrency environment are guaranteed.

The invention relates to the technical field of embedded data storage, and discloses a method and a system for prolonging the service life of a FLASH simulation EEPROM (Electrically Erasable Programmable Read-Only Memory) in a single chip microcomputer, and the method comprises the following steps: firstly, initializing the FLASH, dividing the FLASH into a main data area, a mapping table area, a backup area and a transaction log area, selecting a physical block through a dynamic wear leveling algorithm when data is written, and writing the data into a database; the method comprises the following steps of: starting a backup area or a transaction log area, safely updating a mapping table by using a transaction mechanism, performing cyclic redundancy check when reading data, if the cyclic redundancy check fails, starting cascade recovery from the backup area or the transaction log area, and finally, updating a transaction log to record operation so as to form a closed-loop management process. According to the invention, through a set of dynamic wear leveling and data classification management mechanism, global and uniform distribution of the write load in the storage array is realized, the physical block with the least erasing times is selected during writing, the access frequency of the data can be identified, and cold data which is not changed frequently can be actively migrated.

The invention relates to a time series data acquisition method and device based on a dynamic time window and fingerprint deduplication. The method comprises the following steps: establishing a sliding time window with a variable length by taking the current system time as a reference, and only querying incremental time sequence data in the window; adaptively zooming the window by calculating the ratio of the collected data volume to the expected volume in real time; setting the trigger interval as half of the length of the sliding time window to form a time overlap, thereby capturing out-of-order data; key features of each piece of time series data are extracted, and data fingerprints are generated; a bloom filter is used for primary screening, and accurate duplicate removal is carried out in a key-value storage system; compared with an existing fixed polling scheme, the method has the advantages that resources can be dynamically adjusted along with data flow rate, system load is reduced, real-time performance is improved, data integrity is guaranteed by overlapped windows, zero repeated acquisition is guaranteed by fingerprint two-stage duplicate removal, and the method is applicable to efficient incremental synchronization scenes of transactional log-free time sequence databases such as InfluxDB and the like.

The invention relates to the technical field of computer data processing, and discloses an automatic format conversion and incremental synchronization method for cross-platform heterogeneous document data. The method comprises the following steps: capturing an atomic data change event from a source system transaction log; aggregating into logic transaction units according to the transaction identifiers; converting into a unified intermediate normal form; generating a target system operation instruction set based on the metadata mapping rule; the synchronization sites are executed and persisted in a transactional manner. According to the method, through log-level capture and transactional synchronization, data integrity, sequence and high consistency are ensured, and efficient and reliable data synchronization between heterogeneous systems is supported.

The invention relates to the technical field of distributed data storage, and discloses a database cluster partition operation method and device under a network partition scene and a medium, and the method comprises the steps that a multi-master distributed database cluster is constructed, and each node continuously captures a database native transaction log; obtaining change event data, and performing unified data storage; analyzing the original log into structured data, and executing uniform fragmentation and parallelization processing; processing the block log change record, and arranging change events of the primary key according to a rule; executing conflict processing and data synchronization, and synchronizing all nodes after the conflict is solved; through exception handling and fault tolerance, self-healing is realized and data consistency is maintained. According to the method, millisecond conflict identification and data consistency convergence after network disconnection can be realized, continuous and stable operation of a cluster in a partition state is ensured, and self-healing and continuous availability of a system are realized.

The invention provides a customer relationship information storage and retrieval method and system based on bidirectional graph cache, and the method comprises the steps: constructing a double-layer cache architecture based on graph structure perception, fusing the structural features of a bidirectional graph into a cache strategy, and replacing traditional key value pair cache with sub-graph level cache; constructing a self-adaptive bidirectional atlas index; constructing a distributed consistency collaborative maintenance mechanism based on the graph change transaction log; receiving an operation request of client instance information on the business capability layer, and judging an instance operation type; adding, deleting, modifying and checking the client instance information through the instance object management API in the process data management layer; client instance information changes are recorded through the cache transaction container; and the operation result is persisted to a database. According to the invention, the rapid response client query and order real-time calculation capabilities are greatly improved, the final user experience is greatly improved, the multi-stage service scenes are supported to operate the client relationship data at the same time, and the flexibility and efficiency of service processing are improved.

Network management systems and associated methods are described for providing intent-driven management of networks. A transaction journal of intents for a network may be maintained to define intended behavior of the network. A proposed intent may be received and verified, and the transaction journal may selectively be updated to include the proposed intent based on the verification. Changes for network devices and / or services may be propagated to control the network to adhere to the intents of the journal, including the proposed intent when verified. The network may be monitored to identify and mitigate violations of the intents of the journal or other issues.

The invention relates to a heterogeneous database synchronization method and device, electronic equipment and a storage medium, and the method comprises the steps: analyzing a transaction log of a source database, extracting and generating an abstract syntax tree of a DDL event, and carrying out the node-level syntax conversion of the abstract syntax tree according to the database type of a target database and a preset syntax mapping rule base, and obtaining an equivalent DDL operation sequence of the target database, blocking a data processing operation corresponding to the database object associated with the DDL event, and executing the equivalent DDL operation sequence on the target database. The whole-process intelligent processing of the isomerous database DDL is realized without depending on manpower, the equivalent DDL operation sequence of the target database having semantic consistency with the DDL event of the source database is obtained through dynamic replenishment and deep analysis of the DDL event and the context semantics of the DDL event in combination with the grammar mapping rule base, the processing efficiency of isomerous database DDL synchronization is improved, and the processing efficiency of isomerous database DDL synchronization is improved. And meanwhile, the safety and reliability of synchronous processing can be ensured.

The invention discloses a white list state synchronous processing method and system combined with database transaction control, and relates to the technical field of database transaction control and data synchronous processing. The method comprises the following steps: recording a white list state change event based on a pre-writing mechanism of a database transaction log; change events in a transaction log are classified and aggregated according to a white list and then are asynchronously written into a specified buffer area, when a transaction is submitted, the sequence of data in the buffer area is controlled through a lightweight lock mechanism to be refreshed to a physical disk, and the priority of a disk IO queue is dynamically adjusted according to the transaction isolation level to reduce concurrent conflicts; according to the white list state synchronization processing method and system combined with database transaction control, the transaction concurrent processing performance and the database response efficiency are remarkably improved, and the expansion capability and stability of the white list synchronization system in a complex business environment are also improved.

The invention provides a self-adaptive texture atlas compression system and method based on a Unity engine, and relates to the field of graphic processing. The method comprises the steps that a texture resource import module converts PNG into a DYN file and generates configuration data, a texture resource setting module adopts a double-buffer configuration management mechanism, Hash value differences are detected through an improved CityHash algorithm, fields are changed asynchronously and synchronously, an image set construction module executes edge detection, polygon generation and rasterization processing, and a texture resource setting module performs texture resource setting. Pixel data is output by adopting an active side table algorithm, the arrangement unit realizes pixel data mutual exclusion arrangement based on multi-thread parallel calculation and outputs a UV coordinate mapping table, and an image set setting module dynamically modifies configuration parameters and triggers pipeline updating; geometric accuracy is ensured through verification of the number of vertexes and the texture area, expansion offset and step length parameters are dynamically adjusted to adapt to different resolutions, and an integrated breakpoint resume mechanism guarantees integrity of transaction logs.

Embodiments of the present disclosure provide a log storage method, a database system, a server, and a storage medium. In the log storage method, any database node in a distributed database can use a storage engine component to acquire a transaction log of a target transaction, and write the transaction log into a target online log file. The database node can use the storage engine to persistently store the transaction log in the target online log file into a corresponding target block device, and perform a transaction-level persistent storage operation on metadata information of the target online log file. In the implementation, on the basis of the online log file supporting a write operation at any location, the database node can directly store the transaction log in a block storage mode on the basis of the storage engine assembly of the database node without depending on a file system, thereby reducing resource overhead caused by incorporating the file system and a file storage mode.

The invention discloses a big language model training system and method based on a knowledge graph, and relates to the cross field of artificial intelligence and database technology, and the method comprises the following steps: S1, monitoring a transaction log of a knowledge graph database to obtain a change event of knowledge data, and extracting a change data set; and S2, converting the changed data set into a vector form, and determining an affected corpus subset from all training corpora by calculating a semantic similarity with a training corpus vector library. According to the big language model training system and method based on the knowledge graph, the contradiction between dynamic updating of the knowledge graph and static training of the big language model is solved. The knowledge graph change is monitored in real time and the affected corpus is accurately positioned, so that the increment and intelligence of the training process are realized, the computing resource waste and time delay caused by the traditional full-amount training are avoided, and the model training efficiency is improved.

The application provides a data synchronization method, device and system, and relates to the technical field of data processing. For each application program supporting a personal cloud in a plurality of terminal devices, a cloud device maintains a plurality of sets of transaction logs, each set of transaction logs recording a set of transaction IDs in chronological order. When a certain terminal device initiates synchronization, the terminal device first reports change data and / or a previous transaction ID of the terminal device to the cloud device, and then, in the case that the previous transaction ID is different from the latest transaction ID of the transaction log, the cloud device or the terminal device solves the conflict. Subsequently, the cloud device issues change data between the latest transaction ID and the previous transaction ID of the terminal device. Through the improvement of the synchronization mechanism among the plurality of terminal devices, the consistency problem of the plurality of terminal devices existing in the parallel modification of data is solved, the amount and complexity of the synchronized data are reduced, the modification history of each data of each terminal device can be tracked and rolled back, and no circular data is generated.

The invention relates to the technical field of database operation and maintenance, in particular to an automatic database operation and maintenance method and system. The method comprises the following steps: acquiring a transaction log in a database; analyzing the transaction log, and determining an operation service; analyzing the operation business, and determining business semantics and transaction association between transactions corresponding to the operation business; analyzing business semantics and transaction association, and determining an abnormal business and an operation atomicity level; determining rollback logic of the abnormal business according to the transaction association and the operation atomicity level; and according to the rollback logic, generating a multi-stage rollback path to maintain the abnormal business. According to the method, the rollback logic of the abnormal business can be determined, and the rollback operation is ensured to be executed according to the preset rollback logic, so that further confusion is avoided. The multi-stage rollback path is generated, so that the rollback operation is more flexible and efficient, the intermediate state in the transaction is gradually revoked, and the influence on the performance is reduced.

The invention relates to an inventory data synchronization and consistency verification system supporting network disconnection fault tolerance, and discloses an inventory data synchronization and consistency verification system which realizes continuous recording of inventory operation during a network disconnection period through network state detection and local cache, performs batch transmission after network recovery through a synchronous uploading and verification mechanism, and ensures data integrity. According to the inventory data synchronization and consistency verification system supporting network disconnection fault tolerance, data conflicts are automatically solved through a conflict detection and strategy processing module, a difference report is generated through consistency verification, and secondary synchronization is executed, so that safe synchronization and final consistency guarantee of inventory data are achieved, and it is ensured that the service process is continuous and stable. The system is characterized by comprising a network state detection module, a local cache module, a transaction log management module, a synchronous uploading module, a conflict detection module, a conflict resolution strategy module, a consistency verification module and an abnormity alarm and manual intervention interface module.

The invention relates to an e-commerce search service recovery method and device, equipment and a medium, and the method comprises the steps: starting a local search service deployed by a current fault node, and sending a missing data request to a remote search service of any healthy node, the request comprising a latest timestamp of a latest log record in a local transaction log library, the healthy nodes and the fault nodes are disaster recovery nodes; receiving a complete transaction log file which is returned by the remote search service and is generated after the latest timestamp, grouping log records in the complete transaction log file according to the commodity identifier, and determining a target log record with the maximum global version number in each group; constructing the target log record into an incremental transaction log file, writing the incremental transaction log file into a local transaction log library, and replaying the incremental transaction log file into search engine index data; and after the playback is completed, the local search service is registered to the service registration center again. According to the method, the fault node can be quickly recovered, and high consistency of the commodity data among the search service nodes is ensured.

The invention relates to the technical field of retail management, in particular to a retail end online management method and system based on concurrency control, and the method comprises the steps: constructing a retail knowledge graph based on historical transaction logs through employing a space-time interaction entropy weighting algorithm; calculating a local topology edge density increment by applying a streaming dense subgraph increment mining algorithm, and determining a topology aggregation state of a target node; if the state is the mixed concurrent state, constructing an inventory time slice mirror image containing a reference inventory domain and a dynamic increment domain; and writing the request into the lock-free annular buffer during checking, and merging data by adopting a time sequence alignment algorithm after checking to carry out atomized updating. According to the method, static inventory and dynamic sales are physically isolated by constructing the inventory time slice mirroring and lock-free buffer mechanism, the read-write conflict in the scene of inventory while sales is solved, and zero-blocking hybrid concurrence is realized while the final consistency of inventory data is guaranteed.

The present invention provides an adaptive texture atlas compression system and method based on the Unity engine, which relates to the field of graphics processing. It includes a texture resource import module that converts PNG to DYN files and generates configuration data. The texture resource setting module adopts a double-buffer configuration management mechanism, detects hash value differences through an improved CityHash algorithm, and asynchronously synchronizes changed fields. The atlas construction module performs edge detection, polygon generation, and rasterization processing, and outputs pixel data using the active edge table algorithm. The layout unit realizes mutually exclusive layout of pixel data based on multi-threaded parallel computing and outputs a UV coordinate mapping table. The atlas setting module dynamically modifies configuration parameters and triggers pipeline updates. Geometric accuracy is ensured by verifying the number of vertices and texture area, and the expansion offset and step parameters are dynamically adjusted to adapt to different resolutions. An integrated breakpoint resumption mechanism is used to ensure the integrity of transaction logs.

The invention provides a distributed database system migration method and device supporting online migration of active transactions. The method and device are suitable for a distributed database to complete dynamic migration of fragmented or tenant-level data and transactions under the condition that services are not interrupted. The method comprises the following steps: generating a consistency snapshot of a source node and transmitting the consistency snapshot to a target node; capturing an incremental transaction log after snapshot in real time; a log is efficiently synchronized to a target node through a remote direct memory access (RDMA) mechanism; the logs are played back in parallel at the target node to construct a complete data state; identifying active transactions in the source node and migrating their context; the target node continues to execute the transaction until submission is completed; and finally updating system routing information to complete migration takeover. According to the method, migration delay is effectively reduced, online transaction migration is realized, and the method has the advantages of high availability, low overhead, high adaptability and the like, and is suitable for database scenes such as elastic capacity expansion and contraction, load balancing and the like.

An illustrative data storage management system comprises a management database that stores administrative preferences and system configurations, as well as results and / or statistics of completed secondary storage operations, i.e., information needed by the system to protect customers' data and to track and recover the protected data, including secondary copies such as backup copies, archive copies, etc. The disclosed data storage management system is configured to protect its own system data subject to a very aggressive (short) Recovery Point Objective (RPO), by using an innovative infrastructure that enables the system's storage manager to fail over to any number of other failover destination storage managers, each one comprising a destination management database. An illustrative database granularly tracks whether each and every transaction log file has been successfully applied to each and every destination management database to synchronize with the source management database.

The invention discloses a road berth charging and control system for realizing multi-level fault tolerance and a method thereof, and belongs to the technical field of intelligent traffic systems and Internet of Things. The system adopts an edge computing and distributed sensing collaborative architecture, and is composed of an edge controller (ECU) and a sensing and control unit (SCU) deployed in a berth. High availability of the system is ensured through fault-tolerant design of three core dimensions: firstly, perception layer fault tolerance dynamically adjusts data fusion weights of geomagnetism, millimeter wave radar and visual AI according to real-time environment data such as rainfall and electromagnetic interference by integrating an environment perception sub-module; secondly, network layer fault tolerance utilizes an immutable transaction log and a Saga distributed transaction compensation mechanism to realize local charging and digital RMB double offline payment when cloud connection is interrupted, and data consistency is ensured after network recovery; and finally, a hardware layer establishes a neighborhood cooperation protocol based on a signature agent command through fault tolerance, and a healthy node is allowed to act as an agent fault node through safety verification to execute an unlocking instruction. According to the invention, the problems of environmental interference, network interruption, single-point hardware failure and the like in unattended parking management are effectively solved, and the robustness and financial security of the system are remarkably improved.

The invention discloses a mobile information asset inventory management system based on a parallel chain, and relates to the technical field of information asset management, the mobile information asset inventory management system comprises a main chain, the parallel chain, a cross-chain interaction module, a management platform, a mobile terminal and an asset label, and the main chain stores asset metadata, core transaction records, a cross-chain protocol and an authority token. In the invention, the system records the core metadata, the state change and the core transaction log of the assets through the main chain, the whole process chain evidence storage of the assets from warehousing, checking and transfer to recovery is realized, all data are encrypted and written in in a block form, the integrity and the non-tampering property of the data are ensured, a credible basis is provided for asset supervision and audit analysis, and the asset management and audit efficiency is improved. The parallel chain adopts an authorized Byzantine fault-tolerant consensus mechanism, has the processing capability of more than 1500 transactions per second, and is matched with a reinforcement learning dynamic allocation module to generate an optimal inventory task allocation scheme according to seven dimensions such as asset state, personnel position and task load, so that the task execution efficiency is remarkably improved.

The invention discloses a distributed transaction coordination system for a high-concurrency scene, and particularly relates to the technical field of distributed computing and transaction management. The system comprises a transaction manager, a resource agent group and a log storage module, the transaction manager receives a transaction request, generates a global transaction identifier and maintains a state machine, and an internal fragment coordinator routes the transaction to different processing fragments according to a consistent Hash algorithm for parallel coordination; the resource agent group is connected with each resource node, executes local operation and reports a state through an asynchronous batch mechanism; and the log storage module adopts a multi-copy distributed structure to persist transaction logs. Through fragment parallel processing, asynchronous state reporting and multi-copy log cooperation, the system throughput is effectively improved, the transaction delay is reduced, and the final consistency and high availability of distributed transactions are guaranteed.

The embodiment of the invention provides a log storage method, a database system, a server and a storage medium. In the log storage method, any database node in a distributed database can obtain a transaction log of a target transaction by using a storage engine component, and write the transaction log into a target online log file. The database node can utilize the storage engine to persistently store the transaction log in the target online log file into the corresponding target block device, and execute transaction-level persistent storage operation on metadata information of the target online log file. In the implementation mode, based on the online log file supporting the write-in operation at any position, the database node can directly store the transaction log in a block storage mode based on the storage engine component of the database node under the condition of not depending on a file system, and resource overhead caused by introduction of the file system and the file storage mode is reduced.

The invention provides a database data backup method and device, equipment and a storage medium. The method can be applied to the cloud computing field. The method comprises the following steps: in response to a received data backup request, dynamically selecting a target node of each fragment cluster according to a performance index of a backup node in each fragment cluster in a server cluster; under the condition that it is determined that the target node in each fragment cluster completes basic data backup for the main node, creating a data consistency point which is used for marking the moment when data of each node in the server cluster reaches a consistent state; synchronously distributing the data consistency point to each fragment cluster, so that each fragment cluster records a transaction log from the backup end moment of the target node to the data consistency point; and carrying out persistent storage on the basic data and the transaction log.

The invention discloses a historical literature version knowledge ontology dynamic collaborative construction method and system, and relates to the technical field of humanity knowledge maps, and the method comprises the steps: inputting a version feature set into a multi-node cloud collaborative processing architecture, calculating a local similarity score between versions, and outputting a version similar matrix; performing consistency evaluation on the version similar matrix by utilizing a distributed conflict detection mechanism, marking entity mapping pairs with confidence lower than a confidence threshold, and generating a conflict transaction log; the conflict transaction log is input into a five-level conflict hierarchical processing protocol, an output arbitration result is converted into a corresponding OWL ontology update statement, a version traceability annotation is added, and a historical literature update instruction is output; and dynamically expanding the entity relationship network of the historical literature knowledge ontology according to the historical literature updating instruction, and outputting the historical literature version knowledge ontology through a three-layer intelligent analysis framework. According to the method, the automation and reliability of multi-version literature knowledge management are remarkably enhanced.

The invention discloses a transaction log abnormity monitoring processing method and device, a medium and a product, and the method comprises the steps: carrying out the global log collection of upstream and downstream nodes of a transaction system, adding a unique identifier for the log data collected in real time, and enabling the unique identifier to comprise a link tracking identifier, a node identifier and a timestamp hash value; sequentially inputting the log data added with the unique identifier into a pre-trained three-dimensional verification model; performing exception verification on a time dimension, a space dimension and an association dimension on a log data sequence formed by the sequentially input log data through the three-dimensional verification model, and outputting an exception detection result when it is determined that verification exception exists on any dimension; when it is verified that the transaction system has the abnormity of the target abnormity type according to the abnormity detection result output by the three-dimensional verification model, the abnormity processing strategy matched with the target abnormity type is executed, and intelligent monitoring and accurate processing of the whole process of the transaction calendar can be achieved.