20 results about "Multiple copy" patented technology

The invention discloses an inventory real-time monitoring and abnormity repairing system based on multi-node redundancy check. According to the system, fragmentation and multi-replica redundancy guarantee of inventory data are achieved through a multi-node redundancy storage module, Hash fingerprints are generated through a real-time check monitoring module, and abnormity is found through quick comparison; the fault reason and the influence range are analyzed through the anomaly detection and positioning module, copy reconstruction and transaction rollback are completed through the automatic repair and rollback module, and the repair progress and the push alarm are displayed in real time through the visual monitoring and alarm module. According to the inventory real-time monitoring and abnormity repairing system based on the multi-node redundancy check, consistency maintenance and automatic repairing of inventory data are achieved, and continuous and stable operation of businesses is guaranteed. The system is characterized by comprising a multi-node redundancy storage module, a real-time verification monitoring module, an anomaly detection and positioning module, an automatic repair and rollback module and a visual monitoring and alarm module.

The invention relates to a distributed system multi-copy distribution method based on RDMA (Remote Direct Memory Access), belongs to the technical field of distributed systems, and solves the problem of relatively high write-in time delay of distributed system multi-copy distribution in the prior art. The method comprises the following steps: a client writes data corresponding to a plurality of I / O requests into a predetermined memory slot position of a master node and predetermined memory slot positions of slave nodes; the client sends the global metadata to the main node; the master node sends the local metadata aiming at the master node to the master node, and sends the local metadata aiming at each slave node to each slave node; each slave node persists data stored in a predetermined memory slot of the slave node to a nonvolatile storage medium of the slave node; and the master node persists data stored in a predetermined memory slot of the master node to a non-volatile storage medium of the master node, and the data persisted to the non-volatile storage medium of the master node and the data persisted to the non-volatile storage medium of each slave node are copies of each other. And the write-in time delay is reduced.

Provided herein are systems and methods for detecting a phishing attack. The method comprises: processing an original message to determine whether the original message is suspicious or benign, upon determining the original message is suspicious, generating multiple copies of the original message for detecting a phishing attack, where the multiple copies are varied from the original message in least one of tones, formats, and writing styles, and the multiple copies are generated to be similar to a training dataset that is utilized to train a phishing attack detection engine; and processing the multiple copies and the original message by the phishing attack detection engine to determine whether the original message is malicious or benign. One or more copies from the multiple copies that are not identified as malicious are utilized to further train the phishing attack detection engine automatically.

The application provides a webpage diagnosis method, device and system. In an embodiment, the method is applied to a first device, and includes obtaining multiple copies of a target webpage and error information when an error occurs; wherein the multiple copies include a first copy before the error of the target webpage and a second copy when the error occurs; the multiple copies are used to record page content information, operation information and network requests of the target webpage; the operation information indicates the operation of the user on the target webpage, and the page content information is used to generate page content; the multiple copies and the error information are sent to a second device, so that the second device restores the page content of the target webpage, the operation of the user on the target webpage and the result of the network requests based on the multiple copies. Thus, the page content on the webpage, the error information and the user operation in a period of time before the error of the webpage occur are collected, and the error occurring in the webpage is quickly positioned more comprehensively.

The present disclosure discloses the system and method for efficient file storage and management. The method includes collecting information on access of different files by different applications on a master storage. The collected information is then normalized within a predetermined range. Additionally, the method includes training a machine learning model with the normalized information to predict which of the files should be stored in a cache. The cache is ten implemented by storing predicted files in the cache. Consequently, the different applications then access one of the predicted files in the cache without making multiple copies of the predicted files.

This disclosure describes storage techniques for hybrid transactional and analytical processing. Data captured by a first processing engine can be received. The first processing engine can be configured to perform online transactional processing. Multiple copies of a logical log generated based on the data can be distributed to an incremental repository by applying a consensus protocol on the multiple copies. Data in the incremental repository is stored in a row format and is visible to queries of online analytical processing performed by a second processing engine. Data can be flushed from the incremental repository to a base repository based on one or more predetermined rules. Data in the base repository is stored in a columnar format and is accessible by the second processing engine.

The invention discloses a data redundancy protection method for adaptive switching of erasure codes and multiple copies. The method comprises the following steps: dividing a to-be-processed file into a plurality of to-be-processed data segments according to a preset length; determining a to-be-coded data segment based on the operation type of each to-be-processed data segment, judging whether the to-be-coded data segment is a standard data segment, if the to-be-coded data segment is the standard data segment, coding by using an erasure code mode, and if the to-be-coded data segment is a non-standard data segment, carrying out redundancy by using a multi-copy mode to obtain a data block list; and assembling the data in the data block list to obtain an assembly packet, sending the assembly packet to a storage pool based on the storage node list, and storing the data in the assembly packet in a storage node corresponding to the storage pool. According to the embodiment of the invention, the advantages of multiple copies and coding are fused through the self-adaptive switching of the erasure code mode and the multi-copy mode, the disadvantages of the modes are overcome, and efficient data updating is ensured on the premise of high storage efficiency.

Embodiments of the present application provide a kind of storage, reading and archiving method, equipment, storage medium and program product of multiple copy data.In the embodiments of the present application, more than the number of storage nodes of copy is provided by fast fault-tolerant mechanism to store fault-tolerant, first write data in copy node, when the node of failure and within the fault-tolerant range, data is written to candidate node, it is beneficial to improve the success probability of multiple copy storage, without triggering the slow fault-tolerant mechanism of the above-mentioned trigger archiving data unit within the fault-tolerant range, reduce the probability of triggering the fault-tolerant mechanism, reduce the access impact to management node (such as MS), to improve the efficiency of data writing, reduce write delay.

The application discloses a data synchronization method and device. The method comprises the following steps: receiving a data object update request, wherein the data object update request carries a target data object identifier and update information; determining a target data object in a database according to the target data object identifier, and updating content information and version information of the target data object based on the update information; generating a change operation message for indicating the target data object based on the update information and the updated version information; sending the change operation message to a corresponding service instance, so that the corresponding service instance stores the change operation message in a change operation queue, and synchronizes a local copy based on the change operation queue. Thus, more real-time and effective synchronization of multiple copies can be realized, and consistency between the local copy and data objects in the database can be better ensured.

The present application relates to a kind of efficient safe personal information multiple copy deletion method and system, the method includes: personal information is signed with personal information subject identifier and is uploaded to information field, and is stored as personal information copy by information field;Personal information copy circulates between information field, and each personal information copy records its source and destination;When information field receives delete command, delete command is communicated to each information field based on personal information subject identifier and the destination information in personal information copy, and delete operation is executed;Information field completes deletion and stores the log of self domain identifier and the feedback information received, and the log is fed back to the upper level information field;Information field completes deletion and stores the log of self domain identifier and the feedback information received, and the log is fed back to the upper level information field;The system includes several information fields capable of executing the above-mentioned operation, to realize personal information multiple copy associated storage, associated deletion and associated deletion verification.

The application provides a file management method based on a soft core on-board high-speed solid storage, which comprises the following steps: dividing a solid storage logical space into a metadata fixed block area and a data block area, dividing the data block area according to a fixed block size and managing the data block area according to a block number; establishing a super block, a directory table, a file table, a free block linked list and a file block number sequence of each file in a memory; serializing the above structure to generate a metadata mirror, writing the metadata mirror into the metadata fixed block area and saving multiple redundant copies; when power is restored, reading the multiple copies to make a consistency judgment, selecting an effective mirror to analyze and rebuilding a memory index structure. Through integrated storage of metadata and data, the application avoids the life and reliability risks caused by storing metadata in an independent and vulnerable medium in a traditional scheme; a multiple-copy redundancy and consistency judgment mechanism is adopted to realize quick recovery after power failure; through a rebuilding mechanism of the memory index, the consistency of a file system state and physical data is ensured, and the reliability of an on-board storage system is improved.

The application relates to the technical field of 3D printing data processing, and discloses a 3D printing factory data processing method and system based on a database, which comprises the following steps: S101, a 3D printing model is intelligently segmented into multiple model data blocks according to preset geometric characteristics, and a space index is constructed; S102, data blocks are stored in multiple nodes in a distributed manner through a distributed file system, and multiple copies are stored in a redundant manner; S103, printing parameters of a printing task are collected and written into a distributed database; S104, product detection data corresponding to the printing task are collected, and a mapping relationship is established with the printing parameters; S105, clustering analysis is carried out based on the mapping relationship between the printing parameters and the product detection data, a parameter configuration template corresponding to a printing scene is generated, and the parameter configuration template is stored in association with the model data blocks. The application realizes efficient data storage, intelligent resource management and accurate printing task configuration.

One or more embodiments of the specification provide a multi-copy data storage method, device, equipment and medium. The method comprises: obtaining a pre-set copy deployment mode in a target data table in a database; in the case where the copy deployment mode is not set, obtaining a copy deployment mode indicated by a configuration file of the database; setting storage formats of multiple nodes according to the copy deployment mode; and storing data in the target data table in the nodes according to the storage formats of the nodes. By setting the row storage and column storage nodes in the same set of database architectures, different requirements for the storage formats under different query load scenarios can be met, and compared with setting the row storage and column storage in different databases, the maintenance of the database can be realized by using a set of software systems, and the nodes with different storage formats do not need to rely on data synchronization tools outside the database, which is easy to monitor and maintain.

The invention provides a data management method, a server and a storage medium, and belongs to the technical field of data processing.The method comprises the steps that in response to an operation request for any target attachment, a unique identifier of the target attachment is determined; according to the unique identifier, querying attachment information corresponding to the target attachment from an attachment table; updating a reference count in the attachment information, wherein the reference count is used for representing the number of times that the target attachment is referenced by the business entity; according to the operation request, a reference relation table of the target attachment is updated, and the reference relation table is used for recording the incidence relation between the service entity and the attachment. In this way, for one attachment, the server only stores the data stream in the attachment once, redundant storage caused by repeated copying of the same attachment is avoided, the number of times that the attachment information is referenced by the service entity is recorded through the number of times of reference, so that when deletion operation is executed, the number of times of reference of the attachment is used as a reference, deletion of the currently referenced attachment is avoided, and user experience is improved. Accessories are prevented from being deleted by mistake, and a data management mode is optimized.

The present disclosure discloses the system and method for efficient file storage and management. The method includes collecting information on access of different files by different applications on a master storage. The collected information is then normalized within a predetermined range. Additionally, the method includes training a machine learning model with the normalized information to predict which of the files should be stored in a cache. The cache is ten implemented by storing predicted files in the cache. Consequently, the different applications then access one of the predicted files in the cache without making multiple copies of the predicted files.

The application provides a storage device data protection method and device, an electronic device and a storage medium. Through the method provided by the application, the data of the source LUN at different historical time planes can be respectively copied using multiple copy LUNs, that is, the method provided by the application supports one-to-many replication, and can provide an effective data protection scheme for various scenes. Moreover, since the difference bitmap of the source LUN and the difference bitmap respectively saved by the associated LUN of the target LUN are merged, and the incremental data in the source LUN is synchronized to the target LUN based on the merged difference bitmap, the data between the source LUN and the target LUN is copied in an incremental manner, which can maximize the replication efficiency. Moreover, since the replication is completed by the storage device without the aid of the backup software of the server, the process of reading and writing data from the storage device by the backup software is omitted, and the backup efficiency can be improved.