11 results about "Multiple copy" patented technology

The invention discloses an inventory real-time monitoring and abnormity repairing system based on multi-node redundancy check. According to the system, fragmentation and multi-replica redundancy guarantee of inventory data are achieved through a multi-node redundancy storage module, Hash fingerprints are generated through a real-time check monitoring module, and abnormity is found through quick comparison; the fault reason and the influence range are analyzed through the anomaly detection and positioning module, copy reconstruction and transaction rollback are completed through the automatic repair and rollback module, and the repair progress and the push alarm are displayed in real time through the visual monitoring and alarm module. According to the inventory real-time monitoring and abnormity repairing system based on the multi-node redundancy check, consistency maintenance and automatic repairing of inventory data are achieved, and continuous and stable operation of businesses is guaranteed. The system is characterized by comprising a multi-node redundancy storage module, a real-time verification monitoring module, an anomaly detection and positioning module, an automatic repair and rollback module and a visual monitoring and alarm module.

The present disclosure discloses the system and method for efficient file storage and management. The method includes collecting information on access of different files by different applications on a master storage. The collected information is then normalized within a predetermined range. Additionally, the method includes training a machine learning model with the normalized information to predict which of the files should be stored in a cache. The cache is ten implemented by storing predicted files in the cache. Consequently, the different applications then access one of the predicted files in the cache without making multiple copies of the predicted files.

This disclosure describes storage techniques for hybrid transactional and analytical processing. Data captured by a first processing engine can be received. The first processing engine can be configured to perform online transactional processing. Multiple copies of a logical log generated based on the data can be distributed to an incremental repository by applying a consensus protocol on the multiple copies. Data in the incremental repository is stored in a row format and is visible to queries of online analytical processing performed by a second processing engine. Data can be flushed from the incremental repository to a base repository based on one or more predetermined rules. Data in the base repository is stored in a columnar format and is accessible by the second processing engine.

The invention discloses a data redundancy protection method for adaptive switching of erasure codes and multiple copies. The method comprises the following steps: dividing a to-be-processed file into a plurality of to-be-processed data segments according to a preset length; determining a to-be-coded data segment based on the operation type of each to-be-processed data segment, judging whether the to-be-coded data segment is a standard data segment, if the to-be-coded data segment is the standard data segment, coding by using an erasure code mode, and if the to-be-coded data segment is a non-standard data segment, carrying out redundancy by using a multi-copy mode to obtain a data block list; and assembling the data in the data block list to obtain an assembly packet, sending the assembly packet to a storage pool based on the storage node list, and storing the data in the assembly packet in a storage node corresponding to the storage pool. According to the embodiment of the invention, the advantages of multiple copies and coding are fused through the self-adaptive switching of the erasure code mode and the multi-copy mode, the disadvantages of the modes are overcome, and efficient data updating is ensured on the premise of high storage efficiency.

Embodiments of the present application provide a kind of storage, reading and archiving method, equipment, storage medium and program product of multiple copy data.In the embodiments of the present application, more than the number of storage nodes of copy is provided by fast fault-tolerant mechanism to store fault-tolerant, first write data in copy node, when the node of failure and within the fault-tolerant range, data is written to candidate node, it is beneficial to improve the success probability of multiple copy storage, without triggering the slow fault-tolerant mechanism of the above-mentioned trigger archiving data unit within the fault-tolerant range, reduce the probability of triggering the fault-tolerant mechanism, reduce the access impact to management node (such as MS), to improve the efficiency of data writing, reduce write delay.

The application discloses a data synchronization method and device. The method comprises the following steps: receiving a data object update request, wherein the data object update request carries a target data object identifier and update information; determining a target data object in a database according to the target data object identifier, and updating content information and version information of the target data object based on the update information; generating a change operation message for indicating the target data object based on the update information and the updated version information; sending the change operation message to a corresponding service instance, so that the corresponding service instance stores the change operation message in a change operation queue, and synchronizes a local copy based on the change operation queue. Thus, more real-time and effective synchronization of multiple copies can be realized, and consistency between the local copy and data objects in the database can be better ensured.

The application provides a file management method based on a soft core on-board high-speed solid storage, which comprises the following steps: dividing a solid storage logical space into a metadata fixed block area and a data block area, dividing the data block area according to a fixed block size and managing the data block area according to a block number; establishing a super block, a directory table, a file table, a free block linked list and a file block number sequence of each file in a memory; serializing the above structure to generate a metadata mirror, writing the metadata mirror into the metadata fixed block area and saving multiple redundant copies; when power is restored, reading the multiple copies to make a consistency judgment, selecting an effective mirror to analyze and rebuilding a memory index structure. Through integrated storage of metadata and data, the application avoids the life and reliability risks caused by storing metadata in an independent and vulnerable medium in a traditional scheme; a multiple-copy redundancy and consistency judgment mechanism is adopted to realize quick recovery after power failure; through a rebuilding mechanism of the memory index, the consistency of a file system state and physical data is ensured, and the reliability of an on-board storage system is improved.

The application relates to the technical field of 3D printing data processing, and discloses a 3D printing factory data processing method and system based on a database, which comprises the following steps: S101, a 3D printing model is intelligently segmented into multiple model data blocks according to preset geometric characteristics, and a space index is constructed; S102, data blocks are stored in multiple nodes in a distributed manner through a distributed file system, and multiple copies are stored in a redundant manner; S103, printing parameters of a printing task are collected and written into a distributed database; S104, product detection data corresponding to the printing task are collected, and a mapping relationship is established with the printing parameters; S105, clustering analysis is carried out based on the mapping relationship between the printing parameters and the product detection data, a parameter configuration template corresponding to a printing scene is generated, and the parameter configuration template is stored in association with the model data blocks. The application realizes efficient data storage, intelligent resource management and accurate printing task configuration.

One or more embodiments of the specification provide a multi-copy data storage method, device, equipment and medium. The method comprises: obtaining a pre-set copy deployment mode in a target data table in a database; in the case where the copy deployment mode is not set, obtaining a copy deployment mode indicated by a configuration file of the database; setting storage formats of multiple nodes according to the copy deployment mode; and storing data in the target data table in the nodes according to the storage formats of the nodes. By setting the row storage and column storage nodes in the same set of database architectures, different requirements for the storage formats under different query load scenarios can be met, and compared with setting the row storage and column storage in different databases, the maintenance of the database can be realized by using a set of software systems, and the nodes with different storage formats do not need to rely on data synchronization tools outside the database, which is easy to monitor and maintain.

The invention provides a data management method, a server and a storage medium, and belongs to the technical field of data processing.The method comprises the steps that in response to an operation request for any target attachment, a unique identifier of the target attachment is determined; according to the unique identifier, querying attachment information corresponding to the target attachment from an attachment table; updating a reference count in the attachment information, wherein the reference count is used for representing the number of times that the target attachment is referenced by the business entity; according to the operation request, a reference relation table of the target attachment is updated, and the reference relation table is used for recording the incidence relation between the service entity and the attachment. In this way, for one attachment, the server only stores the data stream in the attachment once, redundant storage caused by repeated copying of the same attachment is avoided, the number of times that the attachment information is referenced by the service entity is recorded through the number of times of reference, so that when deletion operation is executed, the number of times of reference of the attachment is used as a reference, deletion of the currently referenced attachment is avoided, and user experience is improved. Accessories are prevented from being deleted by mistake, and a data management mode is optimized.

The present disclosure discloses the system and method for efficient file storage and management. The method includes collecting information on access of different files by different applications on a master storage. The collected information is then normalized within a predetermined range. Additionally, the method includes training a machine learning model with the normalized information to predict which of the files should be stored in a cache. The cache is ten implemented by storing predicted files in the cache. Consequently, the different applications then access one of the predicted files in the cache without making multiple copies of the predicted files.