190 results about "Transaction log" patented technology

The invention discloses an electronic lead seal data management method based on a block chain, relates to the technical field of internet data services, and aims to solve the problems of node data asynchronization, state updating failure and potential safety hazards of an intelligent contract in the prior art. The data consistency is ensured through a distributed clock synchronization algorithm and a version number verification mechanism; the reliability and fault tolerance of state updating are improved by adopting an improved Byzantine fault-tolerant algorithm and an asynchronous two-stage transaction submission mechanism; data integrity and traceability are guaranteed through a state machine detection mechanism and transaction log records; the security and maintainability of the smart contract are improved based on an automatic code auditing algorithm and a proxy contract mode of a graph neural network; real-time data monitoring and exception repair are realized by using an under-chain auditing mechanism and a cross-chain data consistency verification protocol; according to the invention, the data consistency, the system safety and the reliability of electronic lead seal data management are obviously improved.

The invention relates to the technical field of distributed system transaction management, and discloses an inventory consistency management method and device based on distributed transactions, and the method comprises the following steps: pre-occupying an inventory, and recording the state information of the inventory to a Redis hash structure; after the inventory is pre-occupied successfully, generating a pre-deducted snapshot, generating a compensation identifier, and writing the pre-deducted snapshot and the compensation identifier into a MySQL transaction log together; verifying the uniqueness of the compensation identifier, and submitting the current database transaction after the uniqueness of the compensation identifier is confirmed; when the submission of the current database transaction fails, executing a compensation operation on the current database transaction; and after the compensation operation is executed, performing data consistency verification on the MySQL transaction log and the Redis hash structure. According to the method and the system, the consistency of inventory management during distributed transaction processing is highly guaranteed.

Systems and processes are disclosed for enhancing cybersecurity and optimizing software repositories through integration of web crawling, web scraping, feature engineering, and advanced machine learning algorithms to detect phishing attempts, prevent account takeover fraud, and identify unused code in repositories. The system collects and refines data from various sources, including transaction logs, customer databases, device details, external data sources, and historical fraud data, to build comprehensive datasets. Feature engineering creates new, meaningful features from the refined data, which are used to train and evaluate machine learning models. The best-performing models are deployed in production to monitor incoming communications and transactions in real-time, flagging suspicious activities and optimizing codebases. This processing ensures timely detection and prevention of security threats while maintaining efficient software development processes. Robust protection is provided against evolving cyber threats and enhances software performance and security through continuous learning and adaptation.

The invention provides a dynamic tool integration method and system for an intention-driven AI dialogue system, and the method comprises the steps: S5, extracting resource occupation information from a transaction log according to a state persistence record, carrying out the resource release and temporary context cleaning of each heterogeneous component, and obtaining a released resource list; s6, searching a breakpoint state snapshot and a transaction log from the distributed database according to the released resource list, and reconstructing a tool chain execution flow historical state to obtain a fault context analysis result; and S8, according to the context recovery state and the semantic feature vector, updating a tool chain execution stream, and reallocating computing resources through a heterogeneous component coordination mechanism to obtain a task continuity confirmation result. According to the method, the recovery efficiency and the resource utilization rate of the tool chain in an abnormal scene are remarkably improved, and the task continuity and the system robustness in a high-concurrency environment are guaranteed.

The invention relates to the technical field of embedded data storage, and discloses a method and a system for prolonging the service life of a FLASH simulation EEPROM (Electrically Erasable Programmable Read-Only Memory) in a single chip microcomputer, and the method comprises the following steps: firstly, initializing the FLASH, dividing the FLASH into a main data area, a mapping table area, a backup area and a transaction log area, selecting a physical block through a dynamic wear leveling algorithm when data is written, and writing the data into a database; the method comprises the following steps of: starting a backup area or a transaction log area, safely updating a mapping table by using a transaction mechanism, performing cyclic redundancy check when reading data, if the cyclic redundancy check fails, starting cascade recovery from the backup area or the transaction log area, and finally, updating a transaction log to record operation so as to form a closed-loop management process. According to the invention, through a set of dynamic wear leveling and data classification management mechanism, global and uniform distribution of the write load in the storage array is realized, the physical block with the least erasing times is selected during writing, the access frequency of the data can be identified, and cold data which is not changed frequently can be actively migrated.

The invention relates to a time series data acquisition method and device based on a dynamic time window and fingerprint deduplication. The method comprises the following steps: establishing a sliding time window with a variable length by taking the current system time as a reference, and only querying incremental time sequence data in the window; adaptively zooming the window by calculating the ratio of the collected data volume to the expected volume in real time; setting the trigger interval as half of the length of the sliding time window to form a time overlap, thereby capturing out-of-order data; key features of each piece of time series data are extracted, and data fingerprints are generated; a bloom filter is used for primary screening, and accurate duplicate removal is carried out in a key-value storage system; compared with an existing fixed polling scheme, the method has the advantages that resources can be dynamically adjusted along with data flow rate, system load is reduced, real-time performance is improved, data integrity is guaranteed by overlapped windows, zero repeated acquisition is guaranteed by fingerprint two-stage duplicate removal, and the method is applicable to efficient incremental synchronization scenes of transactional log-free time sequence databases such as InfluxDB and the like.

The invention relates to the technical field of computer data processing, and discloses an automatic format conversion and incremental synchronization method for cross-platform heterogeneous document data. The method comprises the following steps: capturing an atomic data change event from a source system transaction log; aggregating into logic transaction units according to the transaction identifiers; converting into a unified intermediate normal form; generating a target system operation instruction set based on the metadata mapping rule; the synchronization sites are executed and persisted in a transactional manner. According to the method, through log-level capture and transactional synchronization, data integrity, sequence and high consistency are ensured, and efficient and reliable data synchronization between heterogeneous systems is supported.

The invention relates to the technical field of distributed data storage, and discloses a database cluster partition operation method and device under a network partition scene and a medium, and the method comprises the steps that a multi-master distributed database cluster is constructed, and each node continuously captures a database native transaction log; obtaining change event data, and performing unified data storage; analyzing the original log into structured data, and executing uniform fragmentation and parallelization processing; processing the block log change record, and arranging change events of the primary key according to a rule; executing conflict processing and data synchronization, and synchronizing all nodes after the conflict is solved; through exception handling and fault tolerance, self-healing is realized and data consistency is maintained. According to the method, millisecond conflict identification and data consistency convergence after network disconnection can be realized, continuous and stable operation of a cluster in a partition state is ensured, and self-healing and continuous availability of a system are realized.

The invention relates to a heterogeneous database synchronization method and device, electronic equipment and a storage medium, and the method comprises the steps: analyzing a transaction log of a source database, extracting and generating an abstract syntax tree of a DDL event, and carrying out the node-level syntax conversion of the abstract syntax tree according to the database type of a target database and a preset syntax mapping rule base, and obtaining an equivalent DDL operation sequence of the target database, blocking a data processing operation corresponding to the database object associated with the DDL event, and executing the equivalent DDL operation sequence on the target database. The whole-process intelligent processing of the isomerous database DDL is realized without depending on manpower, the equivalent DDL operation sequence of the target database having semantic consistency with the DDL event of the source database is obtained through dynamic replenishment and deep analysis of the DDL event and the context semantics of the DDL event in combination with the grammar mapping rule base, the processing efficiency of isomerous database DDL synchronization is improved, and the processing efficiency of isomerous database DDL synchronization is improved. And meanwhile, the safety and reliability of synchronous processing can be ensured.

The invention discloses a white list state synchronous processing method and system combined with database transaction control, and relates to the technical field of database transaction control and data synchronous processing. The method comprises the following steps: recording a white list state change event based on a pre-writing mechanism of a database transaction log; change events in a transaction log are classified and aggregated according to a white list and then are asynchronously written into a specified buffer area, when a transaction is submitted, the sequence of data in the buffer area is controlled through a lightweight lock mechanism to be refreshed to a physical disk, and the priority of a disk IO queue is dynamically adjusted according to the transaction isolation level to reduce concurrent conflicts; according to the white list state synchronization processing method and system combined with database transaction control, the transaction concurrent processing performance and the database response efficiency are remarkably improved, and the expansion capability and stability of the white list synchronization system in a complex business environment are also improved.

The invention discloses a big language model training system and method based on a knowledge graph, and relates to the cross field of artificial intelligence and database technology, and the method comprises the following steps: S1, monitoring a transaction log of a knowledge graph database to obtain a change event of knowledge data, and extracting a change data set; and S2, converting the changed data set into a vector form, and determining an affected corpus subset from all training corpora by calculating a semantic similarity with a training corpus vector library. According to the big language model training system and method based on the knowledge graph, the contradiction between dynamic updating of the knowledge graph and static training of the big language model is solved. The knowledge graph change is monitored in real time and the affected corpus is accurately positioned, so that the increment and intelligence of the training process are realized, the computing resource waste and time delay caused by the traditional full-amount training are avoided, and the model training efficiency is improved.

The application provides a data synchronization method, device and system, and relates to the technical field of data processing. For each application program supporting a personal cloud in a plurality of terminal devices, a cloud device maintains a plurality of sets of transaction logs, each set of transaction logs recording a set of transaction IDs in chronological order. When a certain terminal device initiates synchronization, the terminal device first reports change data and / or a previous transaction ID of the terminal device to the cloud device, and then, in the case that the previous transaction ID is different from the latest transaction ID of the transaction log, the cloud device or the terminal device solves the conflict. Subsequently, the cloud device issues change data between the latest transaction ID and the previous transaction ID of the terminal device. Through the improvement of the synchronization mechanism among the plurality of terminal devices, the consistency problem of the plurality of terminal devices existing in the parallel modification of data is solved, the amount and complexity of the synchronized data are reduced, the modification history of each data of each terminal device can be tracked and rolled back, and no circular data is generated.

The invention relates to the technical field of database operation and maintenance, in particular to an automatic database operation and maintenance method and system. The method comprises the following steps: acquiring a transaction log in a database; analyzing the transaction log, and determining an operation service; analyzing the operation business, and determining business semantics and transaction association between transactions corresponding to the operation business; analyzing business semantics and transaction association, and determining an abnormal business and an operation atomicity level; determining rollback logic of the abnormal business according to the transaction association and the operation atomicity level; and according to the rollback logic, generating a multi-stage rollback path to maintain the abnormal business. According to the method, the rollback logic of the abnormal business can be determined, and the rollback operation is ensured to be executed according to the preset rollback logic, so that further confusion is avoided. The multi-stage rollback path is generated, so that the rollback operation is more flexible and efficient, the intermediate state in the transaction is gradually revoked, and the influence on the performance is reduced.

The invention relates to an inventory data synchronization and consistency verification system supporting network disconnection fault tolerance, and discloses an inventory data synchronization and consistency verification system which realizes continuous recording of inventory operation during a network disconnection period through network state detection and local cache, performs batch transmission after network recovery through a synchronous uploading and verification mechanism, and ensures data integrity. According to the inventory data synchronization and consistency verification system supporting network disconnection fault tolerance, data conflicts are automatically solved through a conflict detection and strategy processing module, a difference report is generated through consistency verification, and secondary synchronization is executed, so that safe synchronization and final consistency guarantee of inventory data are achieved, and it is ensured that the service process is continuous and stable. The system is characterized by comprising a network state detection module, a local cache module, a transaction log management module, a synchronous uploading module, a conflict detection module, a conflict resolution strategy module, a consistency verification module and an abnormity alarm and manual intervention interface module.

The invention relates to an e-commerce search service recovery method and device, equipment and a medium, and the method comprises the steps: starting a local search service deployed by a current fault node, and sending a missing data request to a remote search service of any healthy node, the request comprising a latest timestamp of a latest log record in a local transaction log library, the healthy nodes and the fault nodes are disaster recovery nodes; receiving a complete transaction log file which is returned by the remote search service and is generated after the latest timestamp, grouping log records in the complete transaction log file according to the commodity identifier, and determining a target log record with the maximum global version number in each group; constructing the target log record into an incremental transaction log file, writing the incremental transaction log file into a local transaction log library, and replaying the incremental transaction log file into search engine index data; and after the playback is completed, the local search service is registered to the service registration center again. According to the method, the fault node can be quickly recovered, and high consistency of the commodity data among the search service nodes is ensured.

The invention relates to the technical field of retail management, in particular to a retail end online management method and system based on concurrency control, and the method comprises the steps: constructing a retail knowledge graph based on historical transaction logs through employing a space-time interaction entropy weighting algorithm; calculating a local topology edge density increment by applying a streaming dense subgraph increment mining algorithm, and determining a topology aggregation state of a target node; if the state is the mixed concurrent state, constructing an inventory time slice mirror image containing a reference inventory domain and a dynamic increment domain; and writing the request into the lock-free annular buffer during checking, and merging data by adopting a time sequence alignment algorithm after checking to carry out atomized updating. According to the method, static inventory and dynamic sales are physically isolated by constructing the inventory time slice mirroring and lock-free buffer mechanism, the read-write conflict in the scene of inventory while sales is solved, and zero-blocking hybrid concurrence is realized while the final consistency of inventory data is guaranteed.

The invention provides a distributed database system migration method and device supporting online migration of active transactions. The method and device are suitable for a distributed database to complete dynamic migration of fragmented or tenant-level data and transactions under the condition that services are not interrupted. The method comprises the following steps: generating a consistency snapshot of a source node and transmitting the consistency snapshot to a target node; capturing an incremental transaction log after snapshot in real time; a log is efficiently synchronized to a target node through a remote direct memory access (RDMA) mechanism; the logs are played back in parallel at the target node to construct a complete data state; identifying active transactions in the source node and migrating their context; the target node continues to execute the transaction until submission is completed; and finally updating system routing information to complete migration takeover. According to the method, migration delay is effectively reduced, online transaction migration is realized, and the method has the advantages of high availability, low overhead, high adaptability and the like, and is suitable for database scenes such as elastic capacity expansion and contraction, load balancing and the like.

An illustrative data storage management system comprises a management database that stores administrative preferences and system configurations, as well as results and / or statistics of completed secondary storage operations, i.e., information needed by the system to protect customers' data and to track and recover the protected data, including secondary copies such as backup copies, archive copies, etc. The disclosed data storage management system is configured to protect its own system data subject to a very aggressive (short) Recovery Point Objective (RPO), by using an innovative infrastructure that enables the system's storage manager to fail over to any number of other failover destination storage managers, each one comprising a destination management database. An illustrative database granularly tracks whether each and every transaction log file has been successfully applied to each and every destination management database to synchronize with the source management database.

The invention discloses a road berth charging and control system for realizing multi-level fault tolerance and a method thereof, and belongs to the technical field of intelligent traffic systems and Internet of Things. The system adopts an edge computing and distributed sensing collaborative architecture, and is composed of an edge controller (ECU) and a sensing and control unit (SCU) deployed in a berth. High availability of the system is ensured through fault-tolerant design of three core dimensions: firstly, perception layer fault tolerance dynamically adjusts data fusion weights of geomagnetism, millimeter wave radar and visual AI according to real-time environment data such as rainfall and electromagnetic interference by integrating an environment perception sub-module; secondly, network layer fault tolerance utilizes an immutable transaction log and a Saga distributed transaction compensation mechanism to realize local charging and digital RMB double offline payment when cloud connection is interrupted, and data consistency is ensured after network recovery; and finally, a hardware layer establishes a neighborhood cooperation protocol based on a signature agent command through fault tolerance, and a healthy node is allowed to act as an agent fault node through safety verification to execute an unlocking instruction. According to the invention, the problems of environmental interference, network interruption, single-point hardware failure and the like in unattended parking management are effectively solved, and the robustness and financial security of the system are remarkably improved.

The invention discloses a mobile information asset inventory management system based on a parallel chain, and relates to the technical field of information asset management, the mobile information asset inventory management system comprises a main chain, the parallel chain, a cross-chain interaction module, a management platform, a mobile terminal and an asset label, and the main chain stores asset metadata, core transaction records, a cross-chain protocol and an authority token. In the invention, the system records the core metadata, the state change and the core transaction log of the assets through the main chain, the whole process chain evidence storage of the assets from warehousing, checking and transfer to recovery is realized, all data are encrypted and written in in a block form, the integrity and the non-tampering property of the data are ensured, a credible basis is provided for asset supervision and audit analysis, and the asset management and audit efficiency is improved. The parallel chain adopts an authorized Byzantine fault-tolerant consensus mechanism, has the processing capability of more than 1500 transactions per second, and is matched with a reinforcement learning dynamic allocation module to generate an optimal inventory task allocation scheme according to seven dimensions such as asset state, personnel position and task load, so that the task execution efficiency is remarkably improved.

The invention discloses a distributed transaction coordination system for a high-concurrency scene, and particularly relates to the technical field of distributed computing and transaction management. The system comprises a transaction manager, a resource agent group and a log storage module, the transaction manager receives a transaction request, generates a global transaction identifier and maintains a state machine, and an internal fragment coordinator routes the transaction to different processing fragments according to a consistent Hash algorithm for parallel coordination; the resource agent group is connected with each resource node, executes local operation and reports a state through an asynchronous batch mechanism; and the log storage module adopts a multi-copy distributed structure to persist transaction logs. Through fragment parallel processing, asynchronous state reporting and multi-copy log cooperation, the system throughput is effectively improved, the transaction delay is reduced, and the final consistency and high availability of distributed transactions are guaranteed.

The invention discloses a historical literature version knowledge ontology dynamic collaborative construction method and system, and relates to the technical field of humanity knowledge maps, and the method comprises the steps: inputting a version feature set into a multi-node cloud collaborative processing architecture, calculating a local similarity score between versions, and outputting a version similar matrix; performing consistency evaluation on the version similar matrix by utilizing a distributed conflict detection mechanism, marking entity mapping pairs with confidence lower than a confidence threshold, and generating a conflict transaction log; the conflict transaction log is input into a five-level conflict hierarchical processing protocol, an output arbitration result is converted into a corresponding OWL ontology update statement, a version traceability annotation is added, and a historical literature update instruction is output; and dynamically expanding the entity relationship network of the historical literature knowledge ontology according to the historical literature updating instruction, and outputting the historical literature version knowledge ontology through a three-layer intelligent analysis framework. According to the method, the automation and reliability of multi-version literature knowledge management are remarkably enhanced.

The invention discloses a transaction log abnormity monitoring processing method and device, a medium and a product, and the method comprises the steps: carrying out the global log collection of upstream and downstream nodes of a transaction system, adding a unique identifier for the log data collected in real time, and enabling the unique identifier to comprise a link tracking identifier, a node identifier and a timestamp hash value; sequentially inputting the log data added with the unique identifier into a pre-trained three-dimensional verification model; performing exception verification on a time dimension, a space dimension and an association dimension on a log data sequence formed by the sequentially input log data through the three-dimensional verification model, and outputting an exception detection result when it is determined that verification exception exists on any dimension; when it is verified that the transaction system has the abnormity of the target abnormity type according to the abnormity detection result output by the three-dimensional verification model, the abnormity processing strategy matched with the target abnormity type is executed, and intelligent monitoring and accurate processing of the whole process of the transaction calendar can be achieved.

The invention discloses an RFID data reliable transmission method and system based on multi-level cache, and relates to the technical field of Internet of Things data communication, and the method comprises the steps: collecting label data through an RFID reader-writer, adding a collection timestamp and a business semantic label to the label data, and generating original data; before the original data is written into the memory cache pool, a corresponding transaction log is recorded in the nonvolatile storage medium, and then the writing operation is executed; according to the aging priority identifier and the residence duration corresponding to the original data, executing cache level migration on the data meeting the degradation condition, moving the data from the memory cache pool to a Flash backup cache region, and synchronously updating a transaction log; high-priority original data is selected from the memory cache pool to form an upload packet, whether the upload packet is subjected to fragmentation processing or not is determined according to a historical transmission state, if not, the upload packet serves as a single transmission unit, and an overall transmission state record is created for the upload packet in a Flash backup cache region.

The invention relates to the technical field of computer data processing, and discloses an intelligent exhibition hall multi-modal interaction digital human system and an implementation method, which are used for solving the problem that multi-source data of multi-modal interaction lacks a unified clock and verifiable timestamp alignment mechanism in a traditional method. According to the method, a unified time domain and a time version are established on an edge side, terminal access is restrained, and an acquisition time mark, an access time mark and a serial number are written in data or a state; performing gating shunting according to a time version, performing de-duplication and out-of-order rearrangement based on a serial number and double time marks, and generating and solidifying a session window evidence index; locking a transaction window boundary according to the evidence index, generating a participation source list and a transaction number, establishing a fragment reference relationship and generating an alignment voucher; in the linkage stage, phase division issuing is carried out according to a preparation phase, an execution phase and a confirmation phase, backward reading verification is carried out according to an action sequence number, a transaction log is archived, and alignment, rechecking and playback of an interaction link are achieved.

The invention relates to the technical field of precision marketing analysis based on big data, and discloses a precision marketing analysis method and system based on big data. Sequentially executing transaction log preprocessing, extracting a customer transaction sequence and constructing a commodity transfer frequency matrix; constructing a commodity transition probability matrix based on the matrix, and calculating a diffusion retention coefficient; the commodity popularity is initialized in combination with a time attenuation mechanism; constructing a directed purchase network and calculating the diameter of the directed purchase network as an upper limit of diffusion round times; executing heat diffusion iteration according to the transition probability and the retention coefficient, and judging whether convergence occurs or not; and finally normalizing the popularity vector and sorting, and outputting a precise putting target. According to the method, modeling behaviors are extracted from original data, a propagation network is constructed, and indirect propagation of user interests is simulated in combination with time sequence popularity, so that automatic modeling from behavior data to a delivery target is realized. According to the scheme, the accuracy and the service decision-making efficiency are improved.

The invention relates to the technical field of database management, in particular to an automatic database backup and recovery method and system based on artificial intelligence, and the method comprises the steps: collecting the operation data of a database in real time, and constructing a dynamic data feature model; dynamically generating a backup strategy through a backup strategy generation module based on the data feature model; executing backup operation according to the backup strategy, creating and updating a metadata index used for rapid recovery in the backup process, monitoring the backup state in real time, and automatically triggering a grading retry mechanism when backup abnormity is detected; automatically executing a recovery test, verifying the integrity and recoverability of the backup data, and if verification fails, triggering an alarm and performing backup again; and when a data recovery request is received, quickly positioning and recovering target data based on the metadata index and the transaction log, and monitoring a recovery state in real time in a recovery process. The rigidity of a traditional fixed strategy is overcome, and the backup efficiency is improved.

The application discloses a historical document version knowledge ontology dynamic collaborative construction method and system, relates to the technical field of humanistic knowledge graph, and comprises the following steps: inputting a version feature set into a multi-node cloud collaborative processing architecture, calculating local similarity scores between versions, and outputting a version similarity matrix; utilizing a distributed conflict detection mechanism to evaluate the consistency of the version similarity matrix, marking entity mapping pairs with a confidence level lower than a confidence threshold, generating a conflict transaction log; inputting the conflict transaction log into a five-level contradiction hierarchical processing protocol, outputting arbitration results, converting the arbitration results into corresponding OWL ontology update statements, adding version trace annotations, and outputting historical document update instructions; and according to the historical document update instructions, dynamically expanding an entity relationship network of a historical document knowledge ontology, and outputting a historical document version knowledge ontology through a three-layer intelligent analysis framework. The application significantly enhances the automation and reliability of multi-version document knowledge management.

A method may include, obtaining, by one or more processors, transaction logs of a database server captured in a predetermined time period, identifying, by the one or more processors, a rate of change of data within the transaction logs, classifying, by the one or more processors, portions of the time period according to the rate of change of data within the portions of the time period, and setting, by the one or more processors, a service level agreement (SLA) for each portion of the time period according to the classification of each portion.