202 results about "Data Corruption" patented technology

A method for mitigating the effects of malware is provided. The method includes determining a compressibility of a portion of data, determining a data corruption condition is satisfied based on the determined compressibility, and modifying a retention policy for retention of stored snapshots associated with the portion of data based on the satisfaction of the data corruption condition. The modifying of the retention policy includes generating a first snapshot associated with the portion of the data, prior to writing cached data associated with the portion of the data, writing the cached data associated with the portion of the data, and generating a second snapshot associated with the portion of the data, responsive to the deletion.

Systems and methods for a programming language-agnostic data modeling platform that is both less resource intensive and scalable. Additionally, the programming language-agnostic data modeling platform allows for advanced analytics to be run on descriptions of the known logical data models, to generate data offerings describing underlying data, and to easily format data for compatibility with artificial intelligence systems. The systems and methods use a supplemental data structure that comprises logical data modeling metadata, in which the logical data modeling metadata describes the logical data model in a common, standardized language. For example, the logical data modeling metadata may comprise a transformer lineage of the logical data model.

The invention discloses a data verification method and device for a redundant disk array, equipment and a medium, and relates to the technical field of data verification, when a data verification value of target data is generated, the target data is firstly divided into a plurality of data blocks, and correspondingly reference data is also divided into one-to-one corresponding reference blocks; then, the unit verification value of each data block is determined by taking the data block as a unit, and the data verification value of the target data is obtained through block-by-block calculation, so that the data verification of the target data is realized according to the data verification value, the memory occupation in the data verification value generation process is reduced, the storage requirement of temporary data is reduced, and the data verification efficiency is improved. The high memory overhead of processing the whole target data at a time is avoided, and the calculation efficiency of the data verification value is improved. The size of the data block can be flexibly adjusted according to requirements, the application range is wide, the flexibility is high, the check and problem positioning of the stored data are facilitated, and the troubleshooting of abnormal conditions such as data damage of the stored data is facilitated.

A system comprises at least one processor; and a memory coupled to the at least one processor, the memory storing processor-executable instructions that, when executed, configure the at least one processor to receive a request to create a data corruption detection test; generate a set of operations to create the data corruption detection test, at least one of the operations including a request to generate error-identification processor-executable instructions; conduct an automated review of the data corruption detection test to confirm that the set of operations to create the data corruption detection test are complete; and implement the data corruption detection test to determine whether one or more functions performed according to processor-executable instructions of a function-performing module were performed according to a defined rule.

Techniques are described for maintaining data consistency when failure events occur during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, two generation numbers (or different identifications) are assigned to two groups of processed B-tree key-value pairs, one before and one after a failure event, within a key range. In some embodiments, the two generation numbers are assigned to a group of B-tree key-value pairs processed by a failed thread and another group of B-tree key-value pairs processed by a substitute thread taking over the failed thread to avoid potential data corruption.

The invention provides a data processing method and related equipment, and relates to the field of database application, the method comprises the following steps: when a write request of target data is received, a storage space is applied for the target data, the storage space comprises at least one range, and the range comprises a data page and a verification page; the verification information of the first range is written into a verification page corresponding to the first range, the verification information of the first range is the verification information obtained through calculation when the target data is written into a data page corresponding to the first range, the verification information is used for conducting redundancy verification, and the first range is any range in the at least one range; and writing the first range into persistent storage. Whether the data is damaged or not can be detected by using the verification information, so that the reliability of data storage is improved, and the risk of data damage caused by a silent error and the like is reduced; and meanwhile, the problem of write amplification is reduced, the storage space occupied by configuration of additional copies is reduced, and the storage overhead and the data reliability can be effectively balanced.

Obtaining immutable snapshots in storage systems for recovery after corrupted data detection. The method includes triggering an immutable snapshot without forcing an active storage write cache to flush so that active write cache data is not contained in the snapshot. The method includes analyzing current active writes in the write cache to identify compromised writes. Triggering the immutable snapshot may be in response to detection of a corrupted data risk and may be in addition to scheduled immutable snapshots or at the time of scheduled immutable snapshots.

Disclosed herein are methods, systems, and apparatus for the detection of data integrity anomalies indicative of malware for a datastore of an organization. To identify an anomaly in a file, a portion of a file is identified to be used in a vector comparison. The portion can comprise sentences or paragraphs for text files, entries, rows, or columns for spreadsheet files, or some other divisible portion of a file. A vector having multiple dimensions is generated for the portion based on the content in the portion. Each dimension of the multiple dimensions corresponds to a feature of the portion. A variation is determined between the vector and one other vector associated with one other portion of the file. One or more actions to take with respect to the file is determined based on the variation, such as malware mitigation, and the action is performed with respect to the file

The invention discloses a deep-buried long-distance TBM tunnel fracture type rockburst micro-seismic monitoring method. A micro-seismic system is installed on a TBM; the micro-seismic system is in communication connection with a data memory and a monitoring control center through a local area network in the tunnel; the micro-seismic monitoring method comprises the following steps: uploading collected micro-seismic data to a data memory outside a tunnel through a local area network by virtue of a micro-seismic system, and synchronously downloading the data in the data memory by virtue of a monitoring control center, so as to obtain a specific intersection position of a fractured rock mass and an unexcavated rock mass by analyzing spatial distribution characteristics of the micro-seismic data. According to the micro-seismic monitoring method disclosed by the invention, the collected data in the tunnel is timely transmitted to the outside of the tunnel based on the local area network and the data memory, so that the timeliness of processing and analyzing the data by the monitoring center outside the tunnel is ensured, and the problem that the rockburst monitoring data of the deeply-buried long-distance TBM tunnel is difficult to timely acquire is solved; the original monitoring data is stored in the data memory, so that the problems of data damage, data loss and the like caused by power failure are avoided, and the continuity of rockburst micro-seismic monitoring is guaranteed.

The invention discloses an access request processing method under centralized storage and electronic equipment, and relates to the technical field of centralized storage, and the method comprises the following steps: setting a virtual file system in a node, and carrying out cache mirror image synchronization among the nodes by utilizing the virtual file system. After any node receives an access request, the node firstly determines whether the access request is a read request or a write-in request, and then processes the read request or the write-in request by using the cache mirror image. The problems that when multiple nodes of a local file system are used for providing read-write services to the outside, data are damaged easily due to the fact that a memory structure has no consistency protection, and protocol processing is conducted depending on one node can be solved. According to the method, the virtual file system is introduced into the nodes, so that the nodes are mounted on the same volume, cache synchronization between the nodes is performed by using the virtual file system, and unification of cache mirror images between the nodes is realized. Through the cache mirror image between the nodes, the capability of providing services to the outside by the multiple nodes is realized.

A data protection system may perform a process including accessing a first compressibility metric indicating an amount of storage space saved if write traffic processed by a storage system is compressed and a second compressibility metric indicating an amount of storage space saved if write traffic processed by an additional storage system is compressed, the additional storage system configured to replicate data stored by the storage system; determining, based on the first and second compressibility metrics, that the storage system is possibly being targeted by a security threat that causes a potential data corruption; and determining a corruption-free recovery point for potential use by the storage system to recover from the potential data corruption.

In one embodiment, a system for managing a virtualization environment comprises a plurality of host machines, one or more virtual disks comprising a plurality of storage devices, a virtualized file server (VFS) comprising a plurality of file server virtual machines (FSVMs), wherein each of the FSVMs is running on one of the host machines and conducts I / O transactions with the one or more virtual disks, and a virtualized file server self-healing system configured to identify one or more corrupt units of stored data at one or more levels of a storage hierarchy associated with the storage devices, wherein the levels comprise one or more of file level, filesystem level, and storage level, and when data corruption is detected, cause each FSVM on which at least a portion of the unit of stored data is located to recover the unit of stored data.

A basic input / output system (BIOS) determine whether an automated recovery mechanism is enabled in response to a detection of a data corruption. An embedded controller may extract recovery data from a storage device upon confirmation that the automated recovery mechanism is enabled. In response to verification that the recovery data is valid, the controller may decrypt a BIOS firmware data in the recovery data and push the BIOS firmware data into a non-volatile random access memory, and decrypt an embedded controller firmware data in the recovery data and push the embedded controller firmware data into the non-volatile random access memory.

The present disclosure provides a system for managing users in a network. The system includes a processor configured to receive a request via one or more computing devices; establish a binding session with a primary control plane function based on the user session; receive an authentication authorization request (AAR) from an application function based on a session data corruption associated with the user session; transmit the AAR to the control plane function to determine a particular control plane function associated with the primary control plane function processing the user session based on the binding session; and transmit the AAR to a network function to process the user session via an secondary control plane function based on receiving an error message from the particular control plane function.

The invention discloses a data offline encryption storage method and system based on a mobile terminal, and the method is executed in a network connection-free environment, and comprises the following steps: dynamically dividing original data into N data blocks; performing double encryption on each data block to generate a composite ciphertext; splitting the master key into a plurality of fragments, and distributing the fragments to a local security module and a trusted execution environment for independent storage through a secret sharing algorithm; writing the composite ciphertext into an encrypted database in a tree index structure; during data reading, carrying out integrity verification on the data block based on the Hash tree structure; and when the data is detected to be damaged, performing data reconstruction by using redundant data and an erasure code algorithm. The method disclosed by the invention has the beneficial effects that the security, efficiency and reliability of offline data storage of the mobile terminal can be remarkably improved.

The invention discloses a method for processing abnormal power failure data damage and an NAND, and the method comprises the steps: writing user data into an MLC Block, firstly writing invalid data into the MLC Block, and then writing a logic mapping table and snapshot information into the MLC Block; obtaining snapshot information and information of a logic mapping table, and forming a temporary mapping table; and searching all the mapping items in the temporary mapping table in sequence, if the positions of the mapping items are invalid, invalidating all the mapping item information after the mapping items, and updating the logic mapping table according to the temporary mapping table. According to the method, the consistency of the file system data can be ensured, the write-in data volume of the NAND equipment is reduced, the performance is improved, and the service life of the NAND equipment is prolonged as much as possible.

An apparatus comprising a bus to communicate a plurality of signal sets in a plurality of transactions; first circuitry to generate a first signature based on the plurality of signal sets communicated by the bus, wherein the first circuitry is to update a signature based on a current value of the signature and a valid incoming signal set; and second circuitry to provide the first signature for comparison with a second signature.

A method for receiving and verifying data, comprising the steps implemented by a receiver unit: receiving (302) a data set having at least one data element; receiving (304) a first integrity feature characterizing the number of data elements thereof and a second integrity feature characterizing the size thereof of the transmitted data set; determining (306) a number of data elements; determining (308, 310) the number of reception parity and a transmission parity of the first integrity feature and comparing (312); if both correspond, comparing (314) the number of data elements of the received and transmitted data sets; if both correspond, comparing (316) the sizes of the received and transmitted data sets; if both correspond, confirming (318) data integrity of the received data set; if one of the comparisons is different, data corruption of the received data set is confirmed (320).

The present invention provides a memory drive device, an information processing device, and a control method that reduce data corruption due to retention characteristics and improve reliability. [Solution] The SSD (Solid State Drive) in the information processing device 100 comprises a data storage unit including a data storage area and a test storage area, and a control unit. The data storage area is composed of rewritable non-volatile memory and stores data used for information processing. The test storage area is composed of non-volatile memory and stores predetermined test data. The control unit determines that a predetermined data retention period has been reached if the date and time information obtained from the information processing device is accurate and the power outage period based on the date and time information exceeds a threshold period. If the date and time information is inaccurate, the control unit determines that a predetermined data retention period has been reached based on an index value related to storage failures in the test storage area and performs a rewrite of the already stored data to the data storage area.

The application discloses a fine-tuning fault-tolerant method, device, medium and product of an intelligent question and answer model, relates to the technical field of artificial intelligence, and comprises the following steps: dividing a preset low-rank matrix pre-injected in an intelligent question and answer model into at least two target sub-matrices according to the influence degree of the matrix parameters on the model performance, and matching corresponding target coding algorithms for different target sub-matrices, so that hierarchical and differentiated data protection is realized, and resource waste caused by uniform intensity protection on all parameters is avoided. Moreover, the target sub-matrices are respectively subjected to coding calculation at a first preset time point and a second preset time point of any two adjacent training steps, and the two coding results are compared, so that a data damage event occurring to the preset low-rank matrix in a training process can be effectively and quickly detected, thereby preventing error pollution from spreading to the whole model, and the reliability of the system is improved. The scheme disclosed by the application can significantly reduce fault-tolerant overhead and guarantee the stability in the fine-tuning process of the model.

To provide a system for tracking corrupted data and recording data errors regarding computer memory reliability.SOLUTION: A memory controller circuit communicates with a memory circuit via an interface that supports link error detection and transmits a combination of data and parity for a first data block that causes the memory circuit to detect an uncorrectable write interface error based on a corruption indicator. Therefore, subsequent reads of a location may cause an uncorrectable error display. In some embodiments, the memory controller circuit enables the corruption indicator to propagate as an uncorrectable error within the memory circuit without requiring additional tracking of the indicator by the memory circuit or memory controller.SELECTED DRAWING: Figure 2

To provide an apparatus, method, and a non-transitory computer readable medium for improving memory reliability in context of memory circuitry in which reliability features are limited.SOLUTION: Memory controller circuitry communicates with memory circuitry via an interface that supports link error detection to transmit, based on a corruption indicator, a data and parity combination for a first data block that causes the memory circuitry to detect an uncorrectable write interface error. Therefore, subsequent reading of a location might cause an uncorrectable error display. This enables the memory controller circuitry to propagate the corruption indicator as an uncorrectable error in the memory circuitry without requiring additional tracking of the indicator by the memory circuitry or a memory controller.SELECTED DRAWING: Figure 11

According to the invention, position information subject to data corruption is processed without the need for additional signals, for example by using an extended Kalman filter. This can be used in a motor vehicle (1).

The invention relates to a security processing data solidification method and system based on mass data, and belongs to the technical field of data storage processing. The method comprises the following steps: acquiring to-be-stored data, and performing encryption according to the to-be-stored data through an improved AES-ECC hybrid encryption algorithm to obtain to-be-stored encrypted data; constructing a block chain network, and storing the data to block chain nodes through a PBFT consensus algorithm according to the to-be-stored encrypted data; the stored encrypted data is backed up to a plurality of block chain nodes, and curing processing is performed through the data snapshot, so that strong encryption protection in the data storage and transmission process is realized, data leakage and unauthorized access are effectively prevented, data integrity is ensured, and data traceability is realized; meanwhile, data loss prevention is achieved, recovery can be carried out when a system fault or data damage occurs, the block chain network can be expanded according to needs, and the storage and processing requirements of a large amount of data are met.

A system may include a storage array comprised of one or more array member drives. The storage array may be partitioned into stripes of data across the one or more array member drives. In operation, a DMA controller may move source data from a processor memory and may write the data to an accelerator memory. The accelerator may perform a parity calculation and a DMA controller may write the parity result and the source data to at least one of the array member drives. The parity information may be used to reconstruct data in the one or more array member drives in the case of damage or loss of data.

The present invention discloses a method for secure storage of video surveillance data based on blockchain technology, which relates to the technical field of video surveillance data storage. From the careful design of the hybrid storage architecture to the application of storage virtualization technology and then to the selection of highly reliable storage media, this application comprehensively ensures the integrity of data in the storage link, effectively preventing data corruption caused by hardware failures, data loss and other problems, and providing a solid data foundation for security decision-making. Through the reasonable allocation of computing power and the optimization of the encryption scheme, it is ensured that the data can be quickly decrypted and efficiently processed when needed, and various queries, analyses and decision-making requirements of security services can be responded to in a timely manner. High-priority data blocks, with the computing power preferentially allocated and a simple and efficient encryption and decryption process, quickly provide key clues to ensure that security personnel can obtain effective information in the first time, strongly supporting emergency response operations and achieving a perfect balance between data availability and security.

This invention relates to the field of performance data management technology, specifically disclosing a performance data management method and system based on a mini-program. The method includes: when a high-concurrency scenario is identified, real-time monitoring and analysis of data interaction parameters between the mini-program and the server are performed to determine whether the high-frequency data interaction process is stable; the mini-program receives raw performance data returned by the server; if the interaction process is unstable, the raw data is preprocessed and the interaction process is adjusted synchronously; if the interaction process is stable, preliminary processing is performed directly to improve processing efficiency and obtain the final performance data; a performance data form is generated based on the final performance data, and the form generation process parameters are parsed and obtained to determine whether data corruption has occurred. This method enables dynamic adjustment of the interaction process in a high-concurrency environment, ensuring data processing stability, improving the generation efficiency and accuracy of performance data forms, and enhancing the performance and reliability of the mini-program in complex scenarios.

The invention discloses a starting method and device of a vehicle-mounted terminal, the vehicle-mounted terminal and a storage medium, and the vehicle-mounted terminal comprises a system memory and a logic memory; the starting method comprises the steps that the vehicle-mounted terminal is powered on, and whether data of a system memory are damaged or not is judged; if the data of the system memory is damaged, starting an operating system of the vehicle-mounted terminal through the data backed up by the logic memory; mounting a logic memory into a read-only mode, and mounting a system memory into a read-write mode; and performing disk repair on the system memory, and recovering the data backed up by the logic memory to the system memory. The reliability and the stability of the vehicle-mounted terminal are effectively improved, the problem that an operating system of the vehicle-mounted terminal is abnormal and cannot be started or user data is lost due to abnormal power failure is avoided, and the safety of a driver and the user experience are guaranteed.

In one embodiment, a system for managing a virtualization environment comprises a plurality of host machines, one or more virtual disks comprising a plurality of storage devices, a virtualized file server (VFS) comprising a plurality of file server virtual machines (FSVMs), wherein each of the FSVMs is running on one of the host machines and conducts I / O transactions with the one or more virtual disks, and a virtualized file server self-healing system configured to identify one or more corrupt units of stored data at one or more levels of a storage hierarchy associated with the storage devices, wherein the levels comprise one or more of file level, filesystem level, and storage level, and when data corruption is detected, cause each FSVM on which at least a portion of the unit of stored data is located to recover the unit of stored data.

The invention belongs to the technical field of programmable gate arrays, and discloses an FPGA module upgrading method and device. According to the method, the upgrading instruction sent by the upper computer is verified, illegal instructions can be intercepted, and upgrading starting safety is guaranteed; the second storage area is firstly erased and then the upgrade data is stored, and subsequent upgrade data verification is matched, so that new and old data confusion and data damage can be avoided, and the storage accuracy of the upgrade data in the second storage area is ensured; after restarting, the FPGA module can be efficiently switched to the second storage area to load and execute upgrading data by means of a program jump instruction of the first storage area, upgrading of the FPGA module is achieved, upgrading stability is guaranteed by means of division of labor of the first storage area and the second storage area, the problems that an existing upgrading mode is poor in remote performance and low in reliability are effectively solved, and the upgrading efficiency is improved. And the requirement of a service system on reliable online upgrading of the FPGA module is met.