164 results about "Data Corruption" patented technology

Systems and methods for a programming language-agnostic data modeling platform that is both less resource intensive and scalable. Additionally, the programming language-agnostic data modeling platform allows for advanced analytics to be run on descriptions of the known logical data models, to generate data offerings describing underlying data, and to easily format data for compatibility with artificial intelligence systems. The systems and methods use a supplemental data structure that comprises logical data modeling metadata, in which the logical data modeling metadata describes the logical data model in a common, standardized language. For example, the logical data modeling metadata may comprise a transformer lineage of the logical data model.

The invention discloses a data verification method and device for a redundant disk array, equipment and a medium, and relates to the technical field of data verification, when a data verification value of target data is generated, the target data is firstly divided into a plurality of data blocks, and correspondingly reference data is also divided into one-to-one corresponding reference blocks; then, the unit verification value of each data block is determined by taking the data block as a unit, and the data verification value of the target data is obtained through block-by-block calculation, so that the data verification of the target data is realized according to the data verification value, the memory occupation in the data verification value generation process is reduced, the storage requirement of temporary data is reduced, and the data verification efficiency is improved. The high memory overhead of processing the whole target data at a time is avoided, and the calculation efficiency of the data verification value is improved. The size of the data block can be flexibly adjusted according to requirements, the application range is wide, the flexibility is high, the check and problem positioning of the stored data are facilitated, and the troubleshooting of abnormal conditions such as data damage of the stored data is facilitated.

Techniques are described for maintaining data consistency when failure events occur during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, two generation numbers (or different identifications) are assigned to two groups of processed B-tree key-value pairs, one before and one after a failure event, within a key range. In some embodiments, the two generation numbers are assigned to a group of B-tree key-value pairs processed by a failed thread and another group of B-tree key-value pairs processed by a substitute thread taking over the failed thread to avoid potential data corruption.

Obtaining immutable snapshots in storage systems for recovery after corrupted data detection. The method includes triggering an immutable snapshot without forcing an active storage write cache to flush so that active write cache data is not contained in the snapshot. The method includes analyzing current active writes in the write cache to identify compromised writes. Triggering the immutable snapshot may be in response to detection of a corrupted data risk and may be in addition to scheduled immutable snapshots or at the time of scheduled immutable snapshots.

Disclosed herein are methods, systems, and apparatus for the detection of data integrity anomalies indicative of malware for a datastore of an organization. To identify an anomaly in a file, a portion of a file is identified to be used in a vector comparison. The portion can comprise sentences or paragraphs for text files, entries, rows, or columns for spreadsheet files, or some other divisible portion of a file. A vector having multiple dimensions is generated for the portion based on the content in the portion. Each dimension of the multiple dimensions corresponds to a feature of the portion. A variation is determined between the vector and one other vector associated with one other portion of the file. One or more actions to take with respect to the file is determined based on the variation, such as malware mitigation, and the action is performed with respect to the file

The invention discloses a deep-buried long-distance TBM tunnel fracture type rockburst micro-seismic monitoring method. A micro-seismic system is installed on a TBM; the micro-seismic system is in communication connection with a data memory and a monitoring control center through a local area network in the tunnel; the micro-seismic monitoring method comprises the following steps: uploading collected micro-seismic data to a data memory outside a tunnel through a local area network by virtue of a micro-seismic system, and synchronously downloading the data in the data memory by virtue of a monitoring control center, so as to obtain a specific intersection position of a fractured rock mass and an unexcavated rock mass by analyzing spatial distribution characteristics of the micro-seismic data. According to the micro-seismic monitoring method disclosed by the invention, the collected data in the tunnel is timely transmitted to the outside of the tunnel based on the local area network and the data memory, so that the timeliness of processing and analyzing the data by the monitoring center outside the tunnel is ensured, and the problem that the rockburst monitoring data of the deeply-buried long-distance TBM tunnel is difficult to timely acquire is solved; the original monitoring data is stored in the data memory, so that the problems of data damage, data loss and the like caused by power failure are avoided, and the continuity of rockburst micro-seismic monitoring is guaranteed.

The invention discloses an access request processing method under centralized storage and electronic equipment, and relates to the technical field of centralized storage, and the method comprises the following steps: setting a virtual file system in a node, and carrying out cache mirror image synchronization among the nodes by utilizing the virtual file system. After any node receives an access request, the node firstly determines whether the access request is a read request or a write-in request, and then processes the read request or the write-in request by using the cache mirror image. The problems that when multiple nodes of a local file system are used for providing read-write services to the outside, data are damaged easily due to the fact that a memory structure has no consistency protection, and protocol processing is conducted depending on one node can be solved. According to the method, the virtual file system is introduced into the nodes, so that the nodes are mounted on the same volume, cache synchronization between the nodes is performed by using the virtual file system, and unification of cache mirror images between the nodes is realized. Through the cache mirror image between the nodes, the capability of providing services to the outside by the multiple nodes is realized.

In one embodiment, a system for managing a virtualization environment comprises a plurality of host machines, one or more virtual disks comprising a plurality of storage devices, a virtualized file server (VFS) comprising a plurality of file server virtual machines (FSVMs), wherein each of the FSVMs is running on one of the host machines and conducts I / O transactions with the one or more virtual disks, and a virtualized file server self-healing system configured to identify one or more corrupt units of stored data at one or more levels of a storage hierarchy associated with the storage devices, wherein the levels comprise one or more of file level, filesystem level, and storage level, and when data corruption is detected, cause each FSVM on which at least a portion of the unit of stored data is located to recover the unit of stored data.

The present disclosure provides a system for managing users in a network. The system includes a processor configured to receive a request via one or more computing devices; establish a binding session with a primary control plane function based on the user session; receive an authentication authorization request (AAR) from an application function based on a session data corruption associated with the user session; transmit the AAR to the control plane function to determine a particular control plane function associated with the primary control plane function processing the user session based on the binding session; and transmit the AAR to a network function to process the user session via an secondary control plane function based on receiving an error message from the particular control plane function.

The invention discloses a data offline encryption storage method and system based on a mobile terminal, and the method is executed in a network connection-free environment, and comprises the following steps: dynamically dividing original data into N data blocks; performing double encryption on each data block to generate a composite ciphertext; splitting the master key into a plurality of fragments, and distributing the fragments to a local security module and a trusted execution environment for independent storage through a secret sharing algorithm; writing the composite ciphertext into an encrypted database in a tree index structure; during data reading, carrying out integrity verification on the data block based on the Hash tree structure; and when the data is detected to be damaged, performing data reconstruction by using redundant data and an erasure code algorithm. The method disclosed by the invention has the beneficial effects that the security, efficiency and reliability of offline data storage of the mobile terminal can be remarkably improved.

The invention discloses a method for processing abnormal power failure data damage and an NAND, and the method comprises the steps: writing user data into an MLC Block, firstly writing invalid data into the MLC Block, and then writing a logic mapping table and snapshot information into the MLC Block; obtaining snapshot information and information of a logic mapping table, and forming a temporary mapping table; and searching all the mapping items in the temporary mapping table in sequence, if the positions of the mapping items are invalid, invalidating all the mapping item information after the mapping items, and updating the logic mapping table according to the temporary mapping table. According to the method, the consistency of the file system data can be ensured, the write-in data volume of the NAND equipment is reduced, the performance is improved, and the service life of the NAND equipment is prolonged as much as possible.

An apparatus comprising a bus to communicate a plurality of signal sets in a plurality of transactions; first circuitry to generate a first signature based on the plurality of signal sets communicated by the bus, wherein the first circuitry is to update a signature based on a current value of the signature and a valid incoming signal set; and second circuitry to provide the first signature for comparison with a second signature.

A method for receiving and verifying data, comprising the steps implemented by a receiver unit: receiving (302) a data set having at least one data element; receiving (304) a first integrity feature characterizing the number of data elements thereof and a second integrity feature characterizing the size thereof of the transmitted data set; determining (306) a number of data elements; determining (308, 310) the number of reception parity and a transmission parity of the first integrity feature and comparing (312); if both correspond, comparing (314) the number of data elements of the received and transmitted data sets; if both correspond, comparing (316) the sizes of the received and transmitted data sets; if both correspond, confirming (318) data integrity of the received data set; if one of the comparisons is different, data corruption of the received data set is confirmed (320).

The present invention provides a memory drive device, an information processing device, and a control method that reduce data corruption due to retention characteristics and improve reliability. [Solution] The SSD (Solid State Drive) in the information processing device 100 comprises a data storage unit including a data storage area and a test storage area, and a control unit. The data storage area is composed of rewritable non-volatile memory and stores data used for information processing. The test storage area is composed of non-volatile memory and stores predetermined test data. The control unit determines that a predetermined data retention period has been reached if the date and time information obtained from the information processing device is accurate and the power outage period based on the date and time information exceeds a threshold period. If the date and time information is inaccurate, the control unit determines that a predetermined data retention period has been reached based on an index value related to storage failures in the test storage area and performs a rewrite of the already stored data to the data storage area.

The application discloses a fine-tuning fault-tolerant method, device, medium and product of an intelligent question and answer model, relates to the technical field of artificial intelligence, and comprises the following steps: dividing a preset low-rank matrix pre-injected in an intelligent question and answer model into at least two target sub-matrices according to the influence degree of the matrix parameters on the model performance, and matching corresponding target coding algorithms for different target sub-matrices, so that hierarchical and differentiated data protection is realized, and resource waste caused by uniform intensity protection on all parameters is avoided. Moreover, the target sub-matrices are respectively subjected to coding calculation at a first preset time point and a second preset time point of any two adjacent training steps, and the two coding results are compared, so that a data damage event occurring to the preset low-rank matrix in a training process can be effectively and quickly detected, thereby preventing error pollution from spreading to the whole model, and the reliability of the system is improved. The scheme disclosed by the application can significantly reduce fault-tolerant overhead and guarantee the stability in the fine-tuning process of the model.

To provide a system for tracking corrupted data and recording data errors regarding computer memory reliability.SOLUTION: A memory controller circuit communicates with a memory circuit via an interface that supports link error detection and transmits a combination of data and parity for a first data block that causes the memory circuit to detect an uncorrectable write interface error based on a corruption indicator. Therefore, subsequent reads of a location may cause an uncorrectable error display. In some embodiments, the memory controller circuit enables the corruption indicator to propagate as an uncorrectable error within the memory circuit without requiring additional tracking of the indicator by the memory circuit or memory controller.SELECTED DRAWING: Figure 2

To provide an apparatus, method, and a non-transitory computer readable medium for improving memory reliability in context of memory circuitry in which reliability features are limited.SOLUTION: Memory controller circuitry communicates with memory circuitry via an interface that supports link error detection to transmit, based on a corruption indicator, a data and parity combination for a first data block that causes the memory circuitry to detect an uncorrectable write interface error. Therefore, subsequent reading of a location might cause an uncorrectable error display. This enables the memory controller circuitry to propagate the corruption indicator as an uncorrectable error in the memory circuitry without requiring additional tracking of the indicator by the memory circuitry or a memory controller.SELECTED DRAWING: Figure 11

According to the invention, position information subject to data corruption is processed without the need for additional signals, for example by using an extended Kalman filter. This can be used in a motor vehicle (1).

A system may include a storage array comprised of one or more array member drives. The storage array may be partitioned into stripes of data across the one or more array member drives. In operation, a DMA controller may move source data from a processor memory and may write the data to an accelerator memory. The accelerator may perform a parity calculation and a DMA controller may write the parity result and the source data to at least one of the array member drives. The parity information may be used to reconstruct data in the one or more array member drives in the case of damage or loss of data.

The present invention discloses a method for secure storage of video surveillance data based on blockchain technology, which relates to the technical field of video surveillance data storage. From the careful design of the hybrid storage architecture to the application of storage virtualization technology and then to the selection of highly reliable storage media, this application comprehensively ensures the integrity of data in the storage link, effectively preventing data corruption caused by hardware failures, data loss and other problems, and providing a solid data foundation for security decision-making. Through the reasonable allocation of computing power and the optimization of the encryption scheme, it is ensured that the data can be quickly decrypted and efficiently processed when needed, and various queries, analyses and decision-making requirements of security services can be responded to in a timely manner. High-priority data blocks, with the computing power preferentially allocated and a simple and efficient encryption and decryption process, quickly provide key clues to ensure that security personnel can obtain effective information in the first time, strongly supporting emergency response operations and achieving a perfect balance between data availability and security.

This invention relates to the field of performance data management technology, specifically disclosing a performance data management method and system based on a mini-program. The method includes: when a high-concurrency scenario is identified, real-time monitoring and analysis of data interaction parameters between the mini-program and the server are performed to determine whether the high-frequency data interaction process is stable; the mini-program receives raw performance data returned by the server; if the interaction process is unstable, the raw data is preprocessed and the interaction process is adjusted synchronously; if the interaction process is stable, preliminary processing is performed directly to improve processing efficiency and obtain the final performance data; a performance data form is generated based on the final performance data, and the form generation process parameters are parsed and obtained to determine whether data corruption has occurred. This method enables dynamic adjustment of the interaction process in a high-concurrency environment, ensuring data processing stability, improving the generation efficiency and accuracy of performance data forms, and enhancing the performance and reliability of the mini-program in complex scenarios.

The invention belongs to the technical field of programmable gate arrays, and discloses an FPGA module upgrading method and device. According to the method, the upgrading instruction sent by the upper computer is verified, illegal instructions can be intercepted, and upgrading starting safety is guaranteed; the second storage area is firstly erased and then the upgrade data is stored, and subsequent upgrade data verification is matched, so that new and old data confusion and data damage can be avoided, and the storage accuracy of the upgrade data in the second storage area is ensured; after restarting, the FPGA module can be efficiently switched to the second storage area to load and execute upgrading data by means of a program jump instruction of the first storage area, upgrading of the FPGA module is achieved, upgrading stability is guaranteed by means of division of labor of the first storage area and the second storage area, the problems that an existing upgrading mode is poor in remote performance and low in reliability are effectively solved, and the upgrading efficiency is improved. And the requirement of a service system on reliable online upgrading of the FPGA module is met.

To provide an apparatus, a method and a program for realizing data corruption detection for an electronic device.SOLUTION: A method of detecting data corruption generates a first signature based on a first plurality of sets of signals communicated by a bus. Here, a first plurality of sets of signals are communicated by the bus in a first set of transactions. The method also generates a second signature based on a second plurality of sets of signals communicated by the bus. A second plurality of sets of signals are communicated by the bus in a second set of transactions. The method further compares the first signature and the second signature to determine whether a data corruption error has occurred.SELECTED DRAWING: Figure 6

The invention relates to a distributed upgrade package downloading method, terminal equipment and a storage medium. The method comprises the following steps: recording storage addresses and mark states of data blocks divided by an upgrade package through child nodes; obtaining the storage address of the data block from each child node, starting downloading, and marking the current state; when an exception is detected, immediately notifying the thread to stop the current operation, and checking the mark state of each data block at the latest moment; when downloading or solidifying is carried out, downloading or solidifying is recovered, data integrity check is carried out after downloading or solidifying is completed, and downloading is carried out again if data integrity check is not passed; after all the data blocks are solidified, data integrity check is carried out once, and if incomplete data blocks exist, the incomplete data blocks are downloaded and solidified again; and combining all the solidified data blocks into one data packet. According to the invention, traffic waste caused by full packet discarding due to local data damage easily caused by power failure is avoided.

A system can have a storage array consisting of one or more array member drives. The storage array can be partitioned into stripes of data across the one or more array member drives. During operation, a DMA controller can move source data from processor memory and write the data to accelerator memory. The accelerator can perform a parity calculation, and a DMA controller can write the parity result and the source data to at least one of the array member drives. The parity information can be used to reconstruct the data in one or more array member drives in the event of corruption or data loss.

The application discloses a management method of a storage system and an electronic device, and relates to the technical field of computers. The management method of the storage system comprises the following steps: when the running states of a cache mirror pair of memory controllers are both abnormal, that is, the cache processing procedure of one of the memory controllers is abnormal, the abnormality of the memory controller of the same mirror pair is superimposed, the inference business process is controlled to process without interrupting the current cache business that has been started, the risk that input and output are not processed for a long time and affect the storage system is reduced when the current cache business continuously stays in a silent stage, the cache processing procedure is dynamically promoted in the process, cache data redundancy is further ensured through mirror pair synchronization and re-mirroring, and therefore, the data damage risk is reduced. The technical problem that the business interruption and recovery in the cache re-mirroring process affect the stability of the storage system is solved, the technical effect that the business reliability and data effectiveness are considered is achieved, and the performance of the storage system is optimized.

Space efficient data integrity checks are disclosed herein. During a write operation of a first data to a location, a combined integrity value is calculated based on a first data integrity value of the first data and the location. The first data is stored at the location along with the combined integrity value. During a read operation of the first data, the first data is read from the location along with the combined integrity value, and a second data integrity value is calculated for the read first data. Data corruption and / or location errors can be determined based on the second data integrity value, the location, and the combined integrity value.

A method includes searching a group of PITs, identifying one of the PITs as having an indicator of an occurrence of an event involving data associated with the identified PIT, restoring the data, running a production system copy using the data, and while the production system copy is running, taking increasingly granular backups of the data until the event is located. The event may be a corruption of the data, or other problem.

One example method includes receiving a Quadratic Unconstrained Binary Optimization (QUBO) problem that comprises a matrix that includes various cells having data. It is then determined that one or more of cells is missing data or has corrupted data. A machine learning (ML) model performs a denoising process that removes random noise from the one or more cells having the missing data or corrupted data. This results in data being imputed to the one or more cells having the missing data or the corrupted data. The imputed data approximates the missing data or approximates an expected value of the corrupted data before the corrupted data was corrupted.

The invention discloses a memory, a memory system and an operation method of the memory, and belongs to the technical field of storage. The method comprises the following steps: receiving an erasure command which indicates to erase data stored in a storage block in a memory, reading a numerical value stored in a register, and if it is determined that configuration data of the memory is stored in the storage block based on the numerical value stored in the register, stopping executing the erasure command. According to the method and the device, whether the erasure command aims at the configuration data or not is judged according to the value stored in the determination, and the erasure command is stopped under the condition that the erasure command aims at the configuration data, so that the potential data loss risk caused by the erasure command is avoided, and the user experience is improved. And the system failure rate caused by data damage or loss can be reduced, so that the reliability and the stability of the memory can be remarkably improved.