27 results about "Multiple copy" patented technology

The invention discloses an inventory real-time monitoring and abnormity repairing system based on multi-node redundancy check. According to the system, fragmentation and multi-replica redundancy guarantee of inventory data are achieved through a multi-node redundancy storage module, Hash fingerprints are generated through a real-time check monitoring module, and abnormity is found through quick comparison; the fault reason and the influence range are analyzed through the anomaly detection and positioning module, copy reconstruction and transaction rollback are completed through the automatic repair and rollback module, and the repair progress and the push alarm are displayed in real time through the visual monitoring and alarm module. According to the inventory real-time monitoring and abnormity repairing system based on the multi-node redundancy check, consistency maintenance and automatic repairing of inventory data are achieved, and continuous and stable operation of businesses is guaranteed. The system is characterized by comprising a multi-node redundancy storage module, a real-time verification monitoring module, an anomaly detection and positioning module, an automatic repair and rollback module and a visual monitoring and alarm module.

The invention relates to a distributed system multi-copy distribution method based on RDMA (Remote Direct Memory Access), belongs to the technical field of distributed systems, and solves the problem of relatively high write-in time delay of distributed system multi-copy distribution in the prior art. The method comprises the following steps: a client writes data corresponding to a plurality of I / O requests into a predetermined memory slot position of a master node and predetermined memory slot positions of slave nodes; the client sends the global metadata to the main node; the master node sends the local metadata aiming at the master node to the master node, and sends the local metadata aiming at each slave node to each slave node; each slave node persists data stored in a predetermined memory slot of the slave node to a nonvolatile storage medium of the slave node; and the master node persists data stored in a predetermined memory slot of the master node to a non-volatile storage medium of the master node, and the data persisted to the non-volatile storage medium of the master node and the data persisted to the non-volatile storage medium of each slave node are copies of each other. And the write-in time delay is reduced.

Provided herein are systems and methods for detecting a phishing attack. The method comprises: processing an original message to determine whether the original message is suspicious or benign, upon determining the original message is suspicious, generating multiple copies of the original message for detecting a phishing attack, where the multiple copies are varied from the original message in least one of tones, formats, and writing styles, and the multiple copies are generated to be similar to a training dataset that is utilized to train a phishing attack detection engine; and processing the multiple copies and the original message by the phishing attack detection engine to determine whether the original message is malicious or benign. One or more copies from the multiple copies that are not identified as malicious are utilized to further train the phishing attack detection engine automatically.

The application provides a webpage diagnosis method, device and system. In an embodiment, the method is applied to a first device, and includes obtaining multiple copies of a target webpage and error information when an error occurs; wherein the multiple copies include a first copy before the error of the target webpage and a second copy when the error occurs; the multiple copies are used to record page content information, operation information and network requests of the target webpage; the operation information indicates the operation of the user on the target webpage, and the page content information is used to generate page content; the multiple copies and the error information are sent to a second device, so that the second device restores the page content of the target webpage, the operation of the user on the target webpage and the result of the network requests based on the multiple copies. Thus, the page content on the webpage, the error information and the user operation in a period of time before the error of the webpage occur are collected, and the error occurring in the webpage is quickly positioned more comprehensively.

The present disclosure discloses the system and method for efficient file storage and management. The method includes collecting information on access of different files by different applications on a master storage. The collected information is then normalized within a predetermined range. Additionally, the method includes training a machine learning model with the normalized information to predict which of the files should be stored in a cache. The cache is ten implemented by storing predicted files in the cache. Consequently, the different applications then access one of the predicted files in the cache without making multiple copies of the predicted files.

This disclosure describes storage techniques for hybrid transactional and analytical processing. Data captured by a first processing engine can be received. The first processing engine can be configured to perform online transactional processing. Multiple copies of a logical log generated based on the data can be distributed to an incremental repository by applying a consensus protocol on the multiple copies. Data in the incremental repository is stored in a row format and is visible to queries of online analytical processing performed by a second processing engine. Data can be flushed from the incremental repository to a base repository based on one or more predetermined rules. Data in the base repository is stored in a columnar format and is accessible by the second processing engine.

The present application relates to the field of electronic digital data processing technology, and in particular to a data redundancy processing method. The method comprises: if multiple copies of data to be written by a target I / O request are redundant, traversing the number of times H the target address is accessed in the most recent first time period, obtaining the average number of times PH the i-th target address is accessed in the most recent first time period i ; Traverse the number of times the target disk is accessed in the most recent first time period D, and obtain the average number of times the i-th target disk is accessed in the most recent first time period PD i If the replica number adjustment judgment value F of the data to be written by the target I / O request is less than the lower limit of the preset replica number adjustment judgment value interval, it is determined whether n is greater than the first preset replica number. If so, n-1 is determined as the target replica number corresponding to the data to be written by the target I / O request. The present invention can balance data storage access performance and storage cost.

The present invention discloses a distributed file-level backup method and system based on object storage, which belongs to the technical field of object storage and container mirroring. The technical problem to be solved by the present invention is that as the amount of data increases, the backup time will be long, the backup data will be repeated, the synchronization of multiple copies will be slow, and the backup storage cost will be high. The technical solution adopted is that the method cuts the data into blocks, saves the block information to the task queue for file-level backup, and provides all backup servers for consumption; before each backup, the data blocks will be compared, and when a database with the same MD5 has been backed up, the current database will not be backed up, ensuring that only one identical data will be saved; the details are as follows: generating a system image; system initialization; backup task initialization; data backup; monitoring system; backup and recovery.

The invention discloses a data redundancy protection method for adaptive switching of erasure codes and multiple copies. The method comprises the following steps: dividing a to-be-processed file into a plurality of to-be-processed data segments according to a preset length; determining a to-be-coded data segment based on the operation type of each to-be-processed data segment, judging whether the to-be-coded data segment is a standard data segment, if the to-be-coded data segment is the standard data segment, coding by using an erasure code mode, and if the to-be-coded data segment is a non-standard data segment, carrying out redundancy by using a multi-copy mode to obtain a data block list; and assembling the data in the data block list to obtain an assembly packet, sending the assembly packet to a storage pool based on the storage node list, and storing the data in the assembly packet in a storage node corresponding to the storage pool. According to the embodiment of the invention, the advantages of multiple copies and coding are fused through the self-adaptive switching of the erasure code mode and the multi-copy mode, the disadvantages of the modes are overcome, and efficient data updating is ensured on the premise of high storage efficiency.

Embodiments of the present application provide a kind of storage, reading and archiving method, equipment, storage medium and program product of multiple copy data.In the embodiments of the present application, more than the number of storage nodes of copy is provided by fast fault-tolerant mechanism to store fault-tolerant, first write data in copy node, when the node of failure and within the fault-tolerant range, data is written to candidate node, it is beneficial to improve the success probability of multiple copy storage, without triggering the slow fault-tolerant mechanism of the above-mentioned trigger archiving data unit within the fault-tolerant range, reduce the probability of triggering the fault-tolerant mechanism, reduce the access impact to management node (such as MS), to improve the efficiency of data writing, reduce write delay.

The application discloses a data synchronization method and device. The method comprises the following steps: receiving a data object update request, wherein the data object update request carries a target data object identifier and update information; determining a target data object in a database according to the target data object identifier, and updating content information and version information of the target data object based on the update information; generating a change operation message for indicating the target data object based on the update information and the updated version information; sending the change operation message to a corresponding service instance, so that the corresponding service instance stores the change operation message in a change operation queue, and synchronizes a local copy based on the change operation queue. Thus, more real-time and effective synchronization of multiple copies can be realized, and consistency between the local copy and data objects in the database can be better ensured.

The present application relates to a kind of efficient safe personal information multiple copy deletion method and system, the method includes: personal information is signed with personal information subject identifier and is uploaded to information field, and is stored as personal information copy by information field;Personal information copy circulates between information field, and each personal information copy records its source and destination;When information field receives delete command, delete command is communicated to each information field based on personal information subject identifier and the destination information in personal information copy, and delete operation is executed;Information field completes deletion and stores the log of self domain identifier and the feedback information received, and the log is fed back to the upper level information field;Information field completes deletion and stores the log of self domain identifier and the feedback information received, and the log is fed back to the upper level information field;The system includes several information fields capable of executing the above-mentioned operation, to realize personal information multiple copy associated storage, associated deletion and associated deletion verification.

The invention belongs to the technical field of data cloud storage, and particularly relates to a group-oriented privacy protection block-level deduplication and multi-copy dynamic auditing method, which comprises the following steps of: S1, system initialization: generating system public parameters and a main private key; s2, generating a group key; s3, data processing: performing data processing on the group sharing document and then storing a data set; s4, auditing interaction: judging the integrity of the data stored on the cloud server by verifying the legality of the auditing evidence; s5, data dynamic operation: the cloud server performs dynamic operation on the specified multi-copy block after identity verification; s6, dynamic group members: the group users apply for joining or quitting the group; and S7, data de-duplication: performing data de-duplication based on the block-level de-duplication voucher and the file label. According to the method, multi-copy data integrity auditing protection is realized, a plurality of copies are flexibly stored, and the expenditure related to storage and updating is reduced.

The application provides a file management method based on a soft core on-board high-speed solid storage, which comprises the following steps: dividing a solid storage logical space into a metadata fixed block area and a data block area, dividing the data block area according to a fixed block size and managing the data block area according to a block number; establishing a super block, a directory table, a file table, a free block linked list and a file block number sequence of each file in a memory; serializing the above structure to generate a metadata mirror, writing the metadata mirror into the metadata fixed block area and saving multiple redundant copies; when power is restored, reading the multiple copies to make a consistency judgment, selecting an effective mirror to analyze and rebuilding a memory index structure. Through integrated storage of metadata and data, the application avoids the life and reliability risks caused by storing metadata in an independent and vulnerable medium in a traditional scheme; a multiple-copy redundancy and consistency judgment mechanism is adopted to realize quick recovery after power failure; through a rebuilding mechanism of the memory index, the consistency of a file system state and physical data is ensured, and the reliability of an on-board storage system is improved.

The application relates to the technical field of 3D printing data processing, and discloses a 3D printing factory data processing method and system based on a database, which comprises the following steps: S101, a 3D printing model is intelligently segmented into multiple model data blocks according to preset geometric characteristics, and a space index is constructed; S102, data blocks are stored in multiple nodes in a distributed manner through a distributed file system, and multiple copies are stored in a redundant manner; S103, printing parameters of a printing task are collected and written into a distributed database; S104, product detection data corresponding to the printing task are collected, and a mapping relationship is established with the printing parameters; S105, clustering analysis is carried out based on the mapping relationship between the printing parameters and the product detection data, a parameter configuration template corresponding to a printing scene is generated, and the parameter configuration template is stored in association with the model data blocks. The application realizes efficient data storage, intelligent resource management and accurate printing task configuration.

The embodiment of the invention provides a copy migration method and device, a storage medium and electronic equipment, and relates to the field of computers.The method comprises the steps that access popularity evaluation is conducted on multiple copies based on access data of the multiple copies, and access popularity scores of the multiple copies are obtained; a first copy with the access popularity score larger than a first score threshold value is determined from the multiple copies, a second copy with the access popularity score smaller than a second score threshold value is determined from the multiple copies, and the first score large threshold value is larger than the second score threshold value; a first replica migration operation is performed on the first replica and a second replica migration operation is performed on the second replica.

One or more embodiments of the specification provide a multi-copy data storage method, device, equipment and medium. The method comprises: obtaining a pre-set copy deployment mode in a target data table in a database; in the case where the copy deployment mode is not set, obtaining a copy deployment mode indicated by a configuration file of the database; setting storage formats of multiple nodes according to the copy deployment mode; and storing data in the target data table in the nodes according to the storage formats of the nodes. By setting the row storage and column storage nodes in the same set of database architectures, different requirements for the storage formats under different query load scenarios can be met, and compared with setting the row storage and column storage in different databases, the maintenance of the database can be realized by using a set of software systems, and the nodes with different storage formats do not need to rely on data synchronization tools outside the database, which is easy to monitor and maintain.

The invention provides a data management method, a server and a storage medium, and belongs to the technical field of data processing.The method comprises the steps that in response to an operation request for any target attachment, a unique identifier of the target attachment is determined; according to the unique identifier, querying attachment information corresponding to the target attachment from an attachment table; updating a reference count in the attachment information, wherein the reference count is used for representing the number of times that the target attachment is referenced by the business entity; according to the operation request, a reference relation table of the target attachment is updated, and the reference relation table is used for recording the incidence relation between the service entity and the attachment. In this way, for one attachment, the server only stores the data stream in the attachment once, redundant storage caused by repeated copying of the same attachment is avoided, the number of times that the attachment information is referenced by the service entity is recorded through the number of times of reference, so that when deletion operation is executed, the number of times of reference of the attachment is used as a reference, deletion of the currently referenced attachment is avoided, and user experience is improved. Accessories are prevented from being deleted by mistake, and a data management mode is optimized.

The invention relates to the technical field of spacecraft control, in particular to a satellite-borne computer on-orbit software multi-version management method which comprises the following steps: dividing a storage space in a multi-version management system into a physical area and a file system area; the method comprises the following steps: dividing a program of on-orbit software into a factory program and an updating program, and storing the factory program in a physical area and packaging the factory program into an ROMFS mirror image file; the updating program is generated through dynamic compiling, the updating program serves as a main program, and a redundant copy is copied to serve as a backup program to be stored in the file system area; and judging the starting type of the satellite-borne computer system based on the register information, and determining the program loading position of the on-orbit software according to the starting type. Through the dual storage structure of the physical area and the file system area, it is ensured that even if a certain software copy goes wrong, recovery can still be conducted through a redundant copy, and single-point faults are avoided. The fault tolerance of the system is enhanced by adopting CRC (Cyclic Redundancy Check) and two-out-of-three operation, so that the system can still be recovered and normally started even if a plurality of copies have errors.

The present application provides an address translation method, a computing system, and an electronic device. By completely saving all table entries of a shared process only in a target computing device among multiple computing devices running the shared process, while saving only the table entries recorded in the root page table in the remaining computing devices, and setting the value of the tag information of the shared process in the remaining computing devices to a first tag value, and setting the value of the tag information of the shared process in the root page table of the target computing device to a second tag value, the computing system can reduce the number of complete table entries required to be saved for the shared process from multiple copies to one copy while ensuring that address translation can proceed normally, thereby reducing the storage resource requirements of the shared process.

The present disclosure discloses the system and method for efficient file storage and management. The method includes collecting information on access of different files by different applications on a master storage. The collected information is then normalized within a predetermined range. Additionally, the method includes training a machine learning model with the normalized information to predict which of the files should be stored in a cache. The cache is ten implemented by storing predicted files in the cache. Consequently, the different applications then access one of the predicted files in the cache without making multiple copies of the predicted files.

The application provides a storage device data protection method and device, an electronic device and a storage medium. Through the method provided by the application, the data of the source LUN at different historical time planes can be respectively copied using multiple copy LUNs, that is, the method provided by the application supports one-to-many replication, and can provide an effective data protection scheme for various scenes. Moreover, since the difference bitmap of the source LUN and the difference bitmap respectively saved by the associated LUN of the target LUN are merged, and the incremental data in the source LUN is synchronized to the target LUN based on the merged difference bitmap, the data between the source LUN and the target LUN is copied in an incremental manner, which can maximize the replication efficiency. Moreover, since the replication is completed by the storage device without the aid of the backup software of the server, the process of reading and writing data from the storage device by the backup software is omitted, and the backup efficiency can be improved.

The present application discloses a sample screening method, apparatus, device, storage medium and program product, belonging to the field of neural network technology. The method obtains multiple first sample content items and multiple second sample content items, and performs different feature deletion processing on each first sample content item to obtain two copies of the first sample content item. Then, based on the multiple copies of the first sample content items, a feature vector of each first sample content item is determined, and based on the feature vectors of the multiple first sample content items and the feature vectors of the multiple second sample content items, negative sample content items are screened from the multiple first sample content items. Since the obtained feature vector can represent the content information of the sample content item, the negative sample content items screened based on the content information have high reliability, and the model trained based on the screened negative sample content items has high accuracy, thereby improving the content item recommendation effect.