39 results about "Multiple copy" patented technology

The invention discloses an inventory real-time monitoring and abnormity repairing system based on multi-node redundancy check. According to the system, fragmentation and multi-replica redundancy guarantee of inventory data are achieved through a multi-node redundancy storage module, Hash fingerprints are generated through a real-time check monitoring module, and abnormity is found through quick comparison; the fault reason and the influence range are analyzed through the anomaly detection and positioning module, copy reconstruction and transaction rollback are completed through the automatic repair and rollback module, and the repair progress and the push alarm are displayed in real time through the visual monitoring and alarm module. According to the inventory real-time monitoring and abnormity repairing system based on the multi-node redundancy check, consistency maintenance and automatic repairing of inventory data are achieved, and continuous and stable operation of businesses is guaranteed. The system is characterized by comprising a multi-node redundancy storage module, a real-time verification monitoring module, an anomaly detection and positioning module, an automatic repair and rollback module and a visual monitoring and alarm module.

The invention relates to a distributed system multi-copy distribution method based on RDMA (Remote Direct Memory Access), belongs to the technical field of distributed systems, and solves the problem of relatively high write-in time delay of distributed system multi-copy distribution in the prior art. The method comprises the following steps: a client writes data corresponding to a plurality of I / O requests into a predetermined memory slot position of a master node and predetermined memory slot positions of slave nodes; the client sends the global metadata to the main node; the master node sends the local metadata aiming at the master node to the master node, and sends the local metadata aiming at each slave node to each slave node; each slave node persists data stored in a predetermined memory slot of the slave node to a nonvolatile storage medium of the slave node; and the master node persists data stored in a predetermined memory slot of the master node to a non-volatile storage medium of the master node, and the data persisted to the non-volatile storage medium of the master node and the data persisted to the non-volatile storage medium of each slave node are copies of each other. And the write-in time delay is reduced.

A radiation tolerant data storage apparatus and method. The radiation tolerant data storage apparatus and method can direct and store redundant copies of data in different physical locations to reduce the likelihood that a single radiation particle damages corresponding portions of the multiple copies of data. The radiation tolerant data storage apparatus and method includes a controller that arranges for multiple copies of data to be stored in a manner that reduces collinearity and detect if one copy has been damaged. The copies are preferably stored at physical locations that minimize or otherwise completely avoid the ability for a single radiation particle to damage or flip the same bit in each of the multiple copies of data. Most preferably, numerous other radiation hardening techniques can also be used to provide further radiation tolerance to the system and method.

Embodiments of the present disclosure provide an address translation method, a computing system, and an electronic device. In the address translation method, all entries of a shared process are completely saved only in a target computing apparatus among a plurality of computing apparatuses running the shared process; entries recorded in a root page table are only saved in the remaining computing apparatuses; values of tag information of the shared process in the remaining computing apparatuses are set as a first tag value, and a value of tag information of the shared process in the root page table of the target computing apparatus is set as a second tag value, such that the computing system can reduce the number of complete table entries of the shared process that need to be saved from multiple copies to one copy while ensuring that address translation can be carried out normally, and the occupation requirement of the shared process on storage resources is reduced.

Provided herein are systems and methods for detecting a phishing attack. The method comprises: processing an original message to determine whether the original message is suspicious or benign, upon determining the original message is suspicious, generating multiple copies of the original message for detecting a phishing attack, where the multiple copies are varied from the original message in least one of tones, formats, and writing styles, and the multiple copies are generated to be similar to a training dataset that is utilized to train a phishing attack detection engine; and processing the multiple copies and the original message by the phishing attack detection engine to determine whether the original message is malicious or benign. One or more copies from the multiple copies that are not identified as malicious are utilized to further train the phishing attack detection engine automatically.

The application provides a webpage diagnosis method, device and system. In an embodiment, the method is applied to a first device, and includes obtaining multiple copies of a target webpage and error information when an error occurs; wherein the multiple copies include a first copy before the error of the target webpage and a second copy when the error occurs; the multiple copies are used to record page content information, operation information and network requests of the target webpage; the operation information indicates the operation of the user on the target webpage, and the page content information is used to generate page content; the multiple copies and the error information are sent to a second device, so that the second device restores the page content of the target webpage, the operation of the user on the target webpage and the result of the network requests based on the multiple copies. Thus, the page content on the webpage, the error information and the user operation in a period of time before the error of the webpage occur are collected, and the error occurring in the webpage is quickly positioned more comprehensively.

The embodiment of the invention provides a data replication method and device and electronic equipment. According to the embodiment, the multiple copy LUNs are correspondingly created for the source LUN to be used for copying the data in the storage space corresponding to the subsequent source LUN, it can be seen that the one-to-many copying scheme, namely the copying scheme that one source LUN corresponds to the multiple copy LUNs is adopted, and after one-time data copying is completed, the copy of the multiple copy LUNs is completed by modifying the information of the copy LUNs; according to the embodiment of the invention, the sequential cyclic use of each copy LUN corresponding to the source LUN is realized, so that the data of the source LUN at the plurality of historical moments are correspondingly stored on the plurality of copy LUNs, the data of the source LUN at the plurality of historical moments can be retrieved through the plurality of copy LUNs when the source LUN has a disaster, and the availability of the data is improved. And when one or more replica LUNs corresponding to the source LUN also have a disaster, the data in the replica LUNs without the disaster can be used for data recovery, so that the reliability of data recovery is improved.

The present disclosure discloses the system and method for efficient file storage and management. The method includes collecting information on access of different files by different applications on a master storage. The collected information is then normalized within a predetermined range. Additionally, the method includes training a machine learning model with the normalized information to predict which of the files should be stored in a cache. The cache is ten implemented by storing predicted files in the cache. Consequently, the different applications then access one of the predicted files in the cache without making multiple copies of the predicted files.

One example method includes refreshing secondary or repurposed copies. A copy data management system issues a single request that allows multiple secondary copies to be refreshed using an API server. The server allows a storage controller to read data from a single source and then write the data read from the source to multiple targets simultaneously, thereby refreshing multiple copies in parallel.

The invention provides a cloud version control-based system update publishing method, which comprises the following steps of: 1, acquiring a plurality of services of a platform, and carrying out multi-copy deployment on each service; step 2, performing version management on each service based on a version control mechanism, and when a target service is updated, updating and replacing a plurality of target copies of the target service in sequence based on the version control mechanism to obtain a new target service; and step 3, issuing an update notification to the new target service, and meanwhile, carrying out multi-copy load balancing management on the new target service. The multi-copy load balancing management is carried out on the new target service, so that the utilization rate of resources is effectively guaranteed to be improved, other copies can still bear extra loads even if a certain copy fails or the performance is reduced, and the overall stability and availability of the service are guaranteed.

This disclosure describes storage techniques for hybrid transactional and analytical processing. Data captured by a first processing engine can be received. The first processing engine can be configured to perform online transactional processing. Multiple copies of a logical log generated based on the data can be distributed to an incremental repository by applying a consensus protocol on the multiple copies. Data in the incremental repository is stored in a row format and is visible to queries of online analytical processing performed by a second processing engine. Data can be flushed from the incremental repository to a base repository based on one or more predetermined rules. Data in the base repository is stored in a columnar format and is accessible by the second processing engine.

An embodiment of the present invention provides a method, device, terminal device, and storage medium for obtaining a product model, which relates to the field of mechanical design. The method responds to a user's model download operation, sends a model download request to the server, and the model download request carries a target identifier, so that the server determines a target copy model with the target identifier from multiple copy models associated with the original models. The terminal device receives the target copy model returned by the server and obtains a target product model based on the obtained target copy model; wherein, the copy model is obtained by simplifying the original model, the file size of the copy model is smaller than that of the original model, and each original model is associated with a copy model. When it is necessary to design and obtain a target product model, only the target copy model needs to be downloaded, which reduces the requirements for the hardware and network speed of the terminal device, and thus improves the efficiency.

The present application relates to the field of electronic digital data processing technology, and in particular to a data redundancy processing method. The method comprises: if multiple copies of data to be written by a target I / O request are redundant, traversing the number of times H the target address is accessed in the most recent first time period, obtaining the average number of times PH the i-th target address is accessed in the most recent first time period i ; Traverse the number of times the target disk is accessed in the most recent first time period D, and obtain the average number of times the i-th target disk is accessed in the most recent first time period PD i If the replica number adjustment judgment value F of the data to be written by the target I / O request is less than the lower limit of the preset replica number adjustment judgment value interval, it is determined whether n is greater than the first preset replica number. If so, n-1 is determined as the target replica number corresponding to the data to be written by the target I / O request. The present invention can balance data storage access performance and storage cost.

The present invention discloses a distributed file-level backup method and system based on object storage, which belongs to the technical field of object storage and container mirroring. The technical problem to be solved by the present invention is that as the amount of data increases, the backup time will be long, the backup data will be repeated, the synchronization of multiple copies will be slow, and the backup storage cost will be high. The technical solution adopted is that the method cuts the data into blocks, saves the block information to the task queue for file-level backup, and provides all backup servers for consumption; before each backup, the data blocks will be compared, and when a database with the same MD5 has been backed up, the current database will not be backed up, ensuring that only one identical data will be saved; the details are as follows: generating a system image; system initialization; backup task initialization; data backup; monitoring system; backup and recovery.

The invention discloses a data redundancy protection method for adaptive switching of erasure codes and multiple copies. The method comprises the following steps: dividing a to-be-processed file into a plurality of to-be-processed data segments according to a preset length; determining a to-be-coded data segment based on the operation type of each to-be-processed data segment, judging whether the to-be-coded data segment is a standard data segment, if the to-be-coded data segment is the standard data segment, coding by using an erasure code mode, and if the to-be-coded data segment is a non-standard data segment, carrying out redundancy by using a multi-copy mode to obtain a data block list; and assembling the data in the data block list to obtain an assembly packet, sending the assembly packet to a storage pool based on the storage node list, and storing the data in the assembly packet in a storage node corresponding to the storage pool. According to the embodiment of the invention, the advantages of multiple copies and coding are fused through the self-adaptive switching of the erasure code mode and the multi-copy mode, the disadvantages of the modes are overcome, and efficient data updating is ensured on the premise of high storage efficiency.

Embodiments of the present application provide a kind of storage, reading and archiving method, equipment, storage medium and program product of multiple copy data.In the embodiments of the present application, more than the number of storage nodes of copy is provided by fast fault-tolerant mechanism to store fault-tolerant, first write data in copy node, when the node of failure and within the fault-tolerant range, data is written to candidate node, it is beneficial to improve the success probability of multiple copy storage, without triggering the slow fault-tolerant mechanism of the above-mentioned trigger archiving data unit within the fault-tolerant range, reduce the probability of triggering the fault-tolerant mechanism, reduce the access impact to management node (such as MS), to improve the efficiency of data writing, reduce write delay.

The application discloses a data synchronization method and device. The method comprises the following steps: receiving a data object update request, wherein the data object update request carries a target data object identifier and update information; determining a target data object in a database according to the target data object identifier, and updating content information and version information of the target data object based on the update information; generating a change operation message for indicating the target data object based on the update information and the updated version information; sending the change operation message to a corresponding service instance, so that the corresponding service instance stores the change operation message in a change operation queue, and synchronizes a local copy based on the change operation queue. Thus, more real-time and effective synchronization of multiple copies can be realized, and consistency between the local copy and data objects in the database can be better ensured.

The present invention provides a method and device for verifying the integrity of multiple copies of data, which can be used in the financial field or other technical fields. The method includes: receiving files uploaded by a user terminal and metadata corresponding to the files via a trusted channel; generating N copy files according to the files and metadata corresponding to the files; generating corresponding first hash values ​​according to the copy files; transmitting the first hash value to the user terminal via a trusted channel so that the user terminal generates challenge information; receiving the challenge information from the user terminal and verifying the data integrity of the N copy files according to the challenge information. The present application extends the specified number of copies in a trusted container and saves it to a cloud server, so that the user terminal only needs to upload one copy of the file to the cloud server to ensure that the cloud server actually stores the specified number of copy files, prevents the cloud server from storing only one copy of the file or less than the agreed number of copy files, and avoids serious communication overhead between the user terminal and the cloud server.

Provided herein are systems and methods for detecting a phishing attack. The method comprises: processing an original message to determine whether the original message is suspicious or benign, upon determining the original message is suspicious, generating multiple copies of the original message for detecting a phishing attack, where the multiple copies are varied from the original message in least one of tones, formats, and writing styles, and the multiple copies are generated to be similar to a training dataset that is utilized to train a phishing attack detection engine; and processing the multiple copies and the original message by the phishing attack detection engine to determine whether the original message is malicious or benign. One or more copies from the multiple copies that are not identified as malicious are utilized to further train the phishing attack detection engine automatically.

The present application relates to a kind of efficient safe personal information multiple copy deletion method and system, the method includes: personal information is signed with personal information subject identifier and is uploaded to information field, and is stored as personal information copy by information field;Personal information copy circulates between information field, and each personal information copy records its source and destination;When information field receives delete command, delete command is communicated to each information field based on personal information subject identifier and the destination information in personal information copy, and delete operation is executed;Information field completes deletion and stores the log of self domain identifier and the feedback information received, and the log is fed back to the upper level information field;Information field completes deletion and stores the log of self domain identifier and the feedback information received, and the log is fed back to the upper level information field;The system includes several information fields capable of executing the above-mentioned operation, to realize personal information multiple copy associated storage, associated deletion and associated deletion verification.

The present application provides a data synchronization method, device and server-side equipment for a distributed table system, which relates to the field of data processing technology and improves the data synchronization efficiency between multiple copies in a distributed table. The method includes: receiving a log synchronization request sent by a storage server where a master copy is located, the log synchronization request includes the first maximum number of the log to be synchronized and the log applied in the storage server where the master copy is located; synchronizing the log to be synchronized based on the log synchronization request; sending a synchronization success message to the storage server where the master copy is located, so that the storage server where the master copy is located applies the log according to the synchronization success message, and the synchronization success message includes the second maximum number of the locally synchronized log.

The invention belongs to the technical field of data cloud storage, and particularly relates to a group-oriented privacy protection block-level deduplication and multi-copy dynamic auditing method, which comprises the following steps of: S1, system initialization: generating system public parameters and a main private key; s2, generating a group key; s3, data processing: performing data processing on the group sharing document and then storing a data set; s4, auditing interaction: judging the integrity of the data stored on the cloud server by verifying the legality of the auditing evidence; s5, data dynamic operation: the cloud server performs dynamic operation on the specified multi-copy block after identity verification; s6, dynamic group members: the group users apply for joining or quitting the group; and S7, data de-duplication: performing data de-duplication based on the block-level de-duplication voucher and the file label. According to the method, multi-copy data integrity auditing protection is realized, a plurality of copies are flexibly stored, and the expenditure related to storage and updating is reduced.

The embodiment of the invention provides a multi-copy data processing method and device and electronic equipment. The method comprises the steps that in response to a processing instruction for multi-copy data, data nodes where multiple copies of the multi-copy data are located are determined, and all the copies in the multiple copies are located at different data nodes; determining the request probability of each copy based on the request processing capability corresponding to the unit data volume of the data node where each copy is located; and based on the request probability for each copy, selecting a target copy from the plurality of copies, and sending a processing request for the target copy to the data node where the target copy is located. It is guaranteed that the processing request received by the data node is matched with the processing capacity provided by the data node, and therefore the overall service capacity of the distributed system is improved.

The application provides a file management method based on a soft core on-board high-speed solid storage, which comprises the following steps: dividing a solid storage logical space into a metadata fixed block area and a data block area, dividing the data block area according to a fixed block size and managing the data block area according to a block number; establishing a super block, a directory table, a file table, a free block linked list and a file block number sequence of each file in a memory; serializing the above structure to generate a metadata mirror, writing the metadata mirror into the metadata fixed block area and saving multiple redundant copies; when power is restored, reading the multiple copies to make a consistency judgment, selecting an effective mirror to analyze and rebuilding a memory index structure. Through integrated storage of metadata and data, the application avoids the life and reliability risks caused by storing metadata in an independent and vulnerable medium in a traditional scheme; a multiple-copy redundancy and consistency judgment mechanism is adopted to realize quick recovery after power failure; through a rebuilding mechanism of the memory index, the consistency of a file system state and physical data is ensured, and the reliability of an on-board storage system is improved.

The application relates to the technical field of 3D printing data processing, and discloses a 3D printing factory data processing method and system based on a database, which comprises the following steps: S101, a 3D printing model is intelligently segmented into multiple model data blocks according to preset geometric characteristics, and a space index is constructed; S102, data blocks are stored in multiple nodes in a distributed manner through a distributed file system, and multiple copies are stored in a redundant manner; S103, printing parameters of a printing task are collected and written into a distributed database; S104, product detection data corresponding to the printing task are collected, and a mapping relationship is established with the printing parameters; S105, clustering analysis is carried out based on the mapping relationship between the printing parameters and the product detection data, a parameter configuration template corresponding to a printing scene is generated, and the parameter configuration template is stored in association with the model data blocks. The application realizes efficient data storage, intelligent resource management and accurate printing task configuration.

The embodiment of the invention provides a copy migration method and device, a storage medium and electronic equipment, and relates to the field of computers.The method comprises the steps that access popularity evaluation is conducted on multiple copies based on access data of the multiple copies, and access popularity scores of the multiple copies are obtained; a first copy with the access popularity score larger than a first score threshold value is determined from the multiple copies, a second copy with the access popularity score smaller than a second score threshold value is determined from the multiple copies, and the first score large threshold value is larger than the second score threshold value; a first replica migration operation is performed on the first replica and a second replica migration operation is performed on the second replica.