10 results about "Snapshot (computer storage)" patented technology

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for analyzing computer software source code. One of the methods includes receiving an updated snapshot of a source code file that comprises a change to an existing snapshot of the source code file maintained at a code repository for a software project; obtaining feature data; processing the feature data using a machine learning model to generate a classification output that classifies the updated snapshot into one of a plurality of categories; and performing, based on the classification output, an action with respect to the updated snapshot.

The invention belongs to the technical field of computer storage, and particularly relates to a checkpoint storage method and system for a distributed training system, target gradient data is used as a snapshot target, and the transmission and storage overhead of each snapshot operation of a checkpoint process can be effectively reduced; according to the method, gradient synchronization and parallel snapshot are carried out on each piece of target gradient data, the computing power of each GPU and CPU in the training system can be effectively utilized, the execution efficiency of the check point process is improved, and meanwhile, the blocking of the training process can be effectively reduced. Besides, different data recovery strategies are set in the case of accidental interruption of different processes, so that the fault-tolerant capability of the training process can be effectively ensured while the data recovery efficiency is improved.

Embodiments of the present application provide a data processing method, a distributed database system, an electronic device and a computer storage medium, wherein a data processing method is applied to a shard node of a distributed database system. The method comprises: receiving a physical DDL instruction converted from a logic DDL instruction for change of data in the distributed database system; executing the physical DDL instruction and generating a shard node mode snapshot for the shard node after the physical DDL instruction has been successfully executed; and if it is determined that the shard node mode snapshot is inconsistent with a global logic mode snapshot of the distributed database system, adjusting log data of the shard node aggregated into a global log to be consistent with the global logic mode snapshot.

The invention discloses a reverse snapshot data storage method, device and equipment for a disaster recovery system and a computer storage medium. The method comprises the following steps: generating a full copy of a protected volume according to a first snapshot creation instruction, wherein the full copy is a reference version of a snapshot sequence; according to a write-in request for the protected volume, acquiring data of a target data block of the write-in request before writing, storing the data as a historical incremental data block in a historical storage area, and writing new data of the write-in request into a corresponding position in the full copy, so that the full copy is a complete mapping of latest data; updating a metadata index, and establishing a mapping relationship between the historical incremental data block and the corresponding snapshot version; wherein after the write-in request is processed and the metadata index is updated each time, a new snapshot version is generated.

The invention provides a data comparison method and device, electronic equipment and a computer storage medium, and the method comprises the steps: querying a database table associated with a transaction code in a configuration library after receiving the transaction code and a transaction message configured by a user; before the transaction is executed, performing snapshot on current data in a database table associated with the transaction code to obtain first snapshot data; sending a transaction request; wherein the transaction request comprises a transaction message; after the transaction is completed, carrying out snapshot on the changed data in the database table associated with the transaction code to obtain second snapshot data; and comparing the first snapshot data with the second snapshot data to generate a data comparison result. The data in the database table associated with the transaction codes before and after the transaction is compared, data changes caused by transaction transformation, data deviation and the like are effectively recognized, and the accuracy of data comparison is effectively improved.

The application discloses a data processing method applied to a database, comprising the following steps: a data storage engine switches a working database into a temporary database for undertaking data update operations during execution of a data compression transaction / snapshot transaction process of the database; and the working database is switched into a compressed database / origin database after the data compression transaction and / or snapshot transaction is executed, wherein the compressed database is created by the data compression transaction, and the origin database is a target database of the snapshot transaction. The application proposes a new temporary database to distinguish newly written data from existing data, so as to ensure that the operation process is safer and more reliable, and the application generates a snapshot more quickly, and lock conflict is less likely to occur, so as to ensure data consistency of multiple storage engines.

Embodiments of the present application provide a data processing method and device, electronic equipment and computer storage medium. Wherein, a mapping relationship queue is determined, the mapping relationship queue contains the mapping relationship between the log number submitted by the processing module and the sequence number submitted by the memory; the maximum sequence number submitted by the memory table is determined, and the log number corresponding to the maximum sequence number is queried from the mapping relationship queue; the combination of the log number and the maximum sequence number is stored in the data file corresponding to the memory table; in the case of fault restart, multiple data files contained in the memory are traversed, and the maximum log number is sent to the processing module; the maximum log number is used for the processing module to take the maximum log number as a snapshot point, and data playback is performed according to the snapshot point. In the embodiment, not only the accuracy of the snapshot point can be improved, but also the resource loss of the processing module is reduced.

This invention relates to the field of automotive electronic fault diagnosis technology, and in particular to a method, apparatus, device, and computer storage medium for recording high-speed fault snapshot data. The method involves creating a circular storage space containing multiple storage blocks and setting index values ​​during the initialization phase of a high-frequency task. In each cycle of the high-frequency task, if there is no fault, the index values ​​are updated and the currently observed variable data is stored; if a fault occurs, the data remains unchanged. In each cycle of the low-frequency diagnostic task, it is determined whether a system fault has occurred. If a fault occurs, the observed variable data stored before the fault occurred is retrieved from the circular storage space and written to non-volatile memory. This invention solves the problem of original data loss at the moment of fault due to frequency mismatch between high-frequency and low-frequency tasks. It can accurately record the state and trend of effective variables before the fault occurs, providing reliable data support for fault root cause analysis, without increasing the diagnostic task frequency, thus balancing real-time performance and efficiency.

Embodiments of the present application provide a kind of operation log processing method, device, electronic equipment and computer storage medium, the method comprises: determining target persistence layer interface, target persistence layer interface is called when editing target data Operation of persistence layer interface;Operation log annotation corresponding to target persistence layer interface is obtained;Operation log annotation is used to characterize the persistence layer query interface of target data;Before editing target data, the operation before data of target data is obtained according to operation log annotation;And / or, after editing target data, the operation after data of target data is obtained according to operation log annotation;The operation before data of target data and / or the operation after data of target data is saved to operation log.Based on the operation log processing method of the present application, the coupling of different functional modules in software system can be reduced, and the reliability of operation log record data snapshot can be improved.

The application discloses a block storage volume rollback method and device and a storage medium, and relates to the technical field of computer storage. The method comprises the following steps: after starting the instruction of rolling back the state of the current active volume to the target snapshot, a temporary snapshot corresponding to the state of the current active volume is created; a difference data block list is generated according to the target snapshot and the temporary snapshot, the data content corresponding to the difference data block is read from the target snapshot, and the current active volume is written back. While maintaining the functions of keeping the storage volume online and continuously processing business read-write requests, the application carries out targeted data writing back, avoids the influence of storage performance response caused by full data replication, can guarantee the continuity of business read-write, realizes the isolation of rollback read-write and business read-write by using the past timestamp, avoids the risk of data conflict and inconsistency, and does not need to delete any snapshot after the rollback target snapshot, thereby providing reliable support for the flexible switching of users between different historical states.