219 results about "RAID" patented technology

A data protection method and system are provided. At least one computing device provides information representing failure of a drive that is assigned to a RAID group. Available storage on each of a plurality of drives in use in the RAID group is identified and at least one virtual drive is built using at least the available storage. Data associated with the failed drive is provided to the virtual drive(s). The virtual drive(s) is / are assigned to the RAID group, and appears to be the failed drive in a non-failed state. Information representing the failed drive having been replaced is received and data from the at least one virtual drive is provided to the replacement drive. The replacement drive is assigned to the RAID group. The replacement drive appears to the RAID controller to be the failed drive. The virtual drive(s) are released.

The invention discloses an NVMe storage array virtualization device based on an FPGA (Field Programmable Gate Array), which is characterized in that single I / O (Input / Output) virtualization (SR-IOV) is realized in the FPGA, and a plurality of NVMe virtual functions which can be directly accessed by a virtual machine are externally provided; mapping from a virtual volume logic address to a physical storage address is completed in hardware, striping management and RAID verification calculation are carried out on a plurality of NVMe solid state disks at the rear end, and storage resource pooling is achieved; the partial reconfigurable characteristic of the FPGA is utilized, I / O scheduling, data compression and prefetching strategies are dynamically adjusted, and the adaptability and performance efficiency of the system are improved. Hardware unloading of the whole I / O path is completed in the FPGA, intervention of a host CPU is not needed, delay is remarkably reduced, the throughput capacity is improved, service quality isolation and elastic expansion in a multi-tenant environment are supported, and an effective technical path is provided for constructing a next-generation high-performance and low-delay storage infrastructure.

The invention discloses a disk capacity expansion method and device, equipment and a storage medium, and relates to the technical field of storage, in the disk capacity expansion method, under the condition that a bad disk is detected during disk array capacity expansion, at least one original stripe before capacity expansion is determined according to an abnormal stripe containing the bad disk after capacity expansion; restoring the bad disk data element according to the check code in the original stripe and the normal data element in the original stripe to obtain a restored target data element; then determining a target stripe according to the restored target data element and the normal data element in the abnormal stripe; writing the target strip into a reserved area of any normal disk; and finally, under the condition that a preset migration condition is met, migrating the target strip stored in the reserved area to the expanded target disk array. According to the method and the device, on the premise of ensuring the data consistency of the RAID system, the continuous capacity expansion under the condition that the disk breaks down during the online capacity expansion of the RAID can be realized.

The invention provides an RDMA-based big data transmission and storage system and method and a semiconductor detection device.The big data transmission and storage system comprises a hardware layer and a software layer, the hardware layer comprises an NVMe SSD storage array, an NVMe RAID acceleration card based on a GPU architecture and an RDMA network card, and the software layer comprises an NVMe SSD storage array, an NVMe RAID acceleration card based on the GPU architecture and an RDMA network card; the software layer comprises a multi-thread transmission module, a self-adaptive memory pool module, a transmission control module, a data verification and retransmission module, a scheduling and optimizing module and a disk falling and storage management module. According to the method, multi-channel transmission parallelization is achieved through data direct connection, zero copy transmission, RAID acceleration and multi-thread parallel RDMA transmission in a hardware link, data is directly connected and transmitted from a memory to the NVMe SSD storage array, data receiving and disk falling thread decoupling directly access the NVMe SSD storage array through asynchronous writing, network overload or storage blockage is avoided, and the data transmission efficiency is improved. The data transmission efficiency and reliability are high, and popularization and application in scenes needing large-scale image transmission processing such as semiconductor detection are facilitated.

A Redundant Array of Independent Disks (RAID) scheme can be used to allow recovery from a memory failure. RAID 6 can be used to recover data from up to two catastrophic failures. Typically, a hardware encoder is used to generate parities of the RAID 6 protection scheme, and a separate hardware decoder is used in the data recovery process. In an example data storage device described herein, some of the components of the hardware encoder are used to perform the data recovery process, thereby eliminating the need for a separate, additional hardware component.

The invention discloses an SSD (Solid State Disk) garbage collection method and device with RAID (Redundant Array of Independent Disk) redundancy and a medium, and relates to the technical field of garbage collection, and the method comprises the following steps: in a garbage collection process, selecting a target NAND flash memory physical block of which the effective data volume meets a collection condition, copying the effective data to a new position, and updating address mapping; querying a first RAID block to which the target block belongs and all member block identifiers thereof according to a first mapping table and a second mapping table which record a mapping relationship between the NAND flash memory physical block and the RAID blocks; and recombining other blocks except the target block in the first RAID block into a second RAID block, recalculating and storing verification data for the second RAID block, synchronously updating the two mapping tables to reflect a new composition relationship, and finally erasing the target block. The physical block of the NAND flash memory is used as the minimum recovery unit to replace the traditional recovery mode taking the whole RAID block as the unit, and the block with the minimum effective data can be preferentially recovered, so that the effective data migration amount is remarkably reduced, the write amplification coefficient is reduced, the abrasion is reduced, and the service life of a hard disk is prolonged.

The invention relates to the technical field of solid-state storage, in particular to a dynamic fault tolerance and replacement system and method for bad blocks of a flash memory. Compared with the prior art, through dynamic migration and global scheduling, prediction maintenance, cross-Die cooperation and a system-level fault-tolerant mechanism, the reliability of the Ink Die storage system is remarkably improved, the bad block replacement efficiency is improved by 40%, the burst failure rate is reduced by 60%, and the data loss risk is reduced; passive replacement operation is reduced by 50% for predictive maintenance, the service life of equipment is prolonged by a cross-Die spare block sharing mechanism, storage resource allocation is optimized, and storage capacity loss is reduced by 25%; according to the collaborative design of RAID and bad block management, the system complexity is reduced, a lightweight end-to-end fault-tolerant scheme is formed, and a better solution is provided for high-reliability storage requirements.

The invention relates to an RAID stripe repairing method and device, equipment, a storage medium and a program product. Pre-embedded information is recorded in data blocks of stripes of the RAID, and the pre-embedded information recorded in each data block at least comprises a block identifier of the data block, a stripe identifier of the stripe to which the data block belongs and a data disk falling timestamp of the data block; the stripe repairing method of the RAID comprises the following steps: performing duplicate removal processing on each data block according to pre-embedded information of each data block of the RAID to obtain a target data block; comparing the actual mapping relationship corresponding to the target data block with a preset mapping relationship between a block identifier and a stripe identifier stored in the metadata of the RAID; wherein the actual mapping relationship is a mapping relationship between a block identifier and a stripe identifier in the pre-embedded information of the target data block; and according to a comparison result, performing stripe repair on the RAID. By adopting the method, the application scene of RAID repair can be expanded, and the efficiency and accuracy of RADI strip repair are improved.

Systems and methods for selectively bypassing an external cache (EC) of a storage system are provided. In one example, when the EC backing storage device is saturated, reads bypass the EC and are completed via a redundant array of independent disks (RAID) subsystem of the storage system. One or more performance metrics for the EC backing storage device may be monitored to predict one or more saturation thresholds (e.g., in terms of latency and / or throughput). Based on this monitoring, tuning may be performed to drive utilization of the EC into a “knee region” of a performance (or response) curve of the EC backing storage device. For example, the depth of one or more request queues at the front-end of an EC lookup may be manipulated based on a current measure of saturation relating to the EC backing storage device to limit the number of in-flight reads pending for the EC.

Disclosed in the embodiments of the present application are a data storage method and apparatus, a device, and a non-transitory readable storage medium. According to the embodiments of the present application, F parity blocks occupying blank storage areas are added to a RAID system, which not only increases error tolerance but also eliminates the need for additional parity disks. During data storage, corresponding original check codes are solved according to an original encoding method, and additional check codes located on the parity blocks are solved simultaneously. Thus, it is possible to recover more erroneous data based on the original check codes and the additional check codes. When an error occurs in a disk in which any block in a stripe is located and data loss occurs in other blocks of the same stripe, the corresponding data can still be recovered.

Embodiments of the present application relate to a hard disk backboard control method and a computing device. The method comprises: in the case that a first device is an upper host device connected to a hard disk backboard, a CPLD on the hard disk backboard is switched to a pass-through backboard mode, the pass-through backboard mode is used to indicate that the hard disk backboard is used as a pass-through backboard to manage hard disks connected to the hard disk backboard by the first device, and the first device is a motherboard or a PCIe Switch interchanger connected to the motherboard; in the case that a second device is an upper host device connected to the hard disk backboard, the CPLD on the hard disk backboard is switched to a hard RAID backboard mode, the hard RAID backboard mode is used to indicate that the hard disk backboard is used as a hard RAID backboard to manage the hard disks connected to the hard disk backboard by the second device, and the second device is a redundant array of independent disks (RAID) card or a device with a RAID function. The same hard disk backboard can be adapted to two different modes without hardware modification, and the hard disk backboard can be compatible with the functions of the pass-through backboard and the hard RAID backboard.

The application provides a method, system, storage medium and equipment for physical disk management under a RAID controller, the method comprising: constructing a physical disk pass-through command SQE; sending the physical disk pass-through command SQE to the RAID controller; reading a pass-through command operation code in DW0 in the received physical disk pass-through command SQE to confirm that the physical disk pass-through command SQE is a physical disk pass-through command; reading DW2 in the physical disk pass-through command SQE to obtain a physical disk ID, so as to determine the type of a target physical disk; constructing a physical disk command SQE based on the type of the target physical disk; sending the physical disk command SQE to the target physical disk, and waiting for the target physical disk to return a physical disk CQE; and constructing a pass-through command CQE based on the physical disk CQE, and returning the pass-through command CQE. According to the application, the host can directly send a command to a physical disk under the RAID controller through the RAID controller, so that the complexity of the RAID management interface is reduced, and the flexibility of the interface is improved.

This invention relates to the field of storage and discloses a method, system, device, and medium for constructing hybrid RAID. The method includes: establishing a remapping space between a host and the storage disk based on the storage disk's information to achieve isolation between the storage disk and the host; establishing a host driver for the remapping space based on the remapping space, and using the host driver to implement RAID management of the storage disk by the remapping space. The method disclosed in this invention avoids the risk of directly exposing the storage disk's information to the host operating system during the construction process of hybrid RAID.

The invention relates to a storage data security technology, and provides an access control method and device, a server and a computer storage medium, which are applied to a storage server, the storage server is in communication connection with a key management server, a pre-initialized UKEY is inserted into the storage server, and the UKEY stores a preset key generated by the key management server. The storage server comprises an RAID card, and the method comprises the steps that an obtaining request is sent to a key management server, and the obtaining request is used for obtaining a PIN code for conducting access control on the RAID card; receiving a response request returned by the key management server, wherein the response request carries the target PIN code; verifying the response request according to a preset key; and if the response request passes the verification, performing access control on the RAID card by using the target PIN code carried in the response request. According to the RAID security access method and device, RAID security access is achieved through the preset key stored in the UKEY.

The application provides an implementation method of a virtual RAID card, comprising the following steps: generating a RAID card control module in a virtualization tool, and establishing a communication connection between the RAID card control module and a user operating system; the RAID card control module sends its own information and disk information mounted under the RAID card control module, generates a RAID group according to the user's selection; the RAID card control module creates a logical volume based on the RAID in the RAID group, dynamically creates a namespace according to the created logical volume, and binds the namespace and the logical volume; the RAID card control module reads and writes the disks in the RAID based on the RAID group information, the logical volume information and the disk information. The application further provides an implementation device and component of the virtual RAID card, which effectively reduces the implementation cost of the RAID card and perfects the function of the RAID card.

Redundant array of independent drives (RAID) sub-stripes are formed across one or more solid-state storage devices of storage nodes of a storage system. The RAID sub-stripes include corresponding shards of data to be stored at the solid-state storage devices, wherein at least one of the RAID sub-stripes has at least two of the corresponding shards of data on a same storage node. At least one global parity shard is generated for the RAID sub-stripes. The at least one global parity shard is to be stored on a first storage node that is different from each of the same storage nodes storing the at least two of the corresponding shards of data.

A system and related method, the system including control circuitry and memory with a first memory block of a first memory density and a second memory block of a second memory density which is greater than the first memory density. Control circuitry, which is communicatively coupled to the memory, is configured to determine to transfer data from the first memory block to the second memory block, generate parity data based on the data and cause to store the parity data at a parity address corresponding to an available portion of the first memory block. Control circuitry is further to cause to update a look-up table with the parity data address and cause to copy the data from the first memory block to the second memory block.

A data protection method and system are provided. At least one computing device provides information representing failure of a drive that is assigned to a RAID group. Available storage on each of a plurality of drives in use in the RAID group is identified and at least one virtual drive is built using at least the available storage. Data associated with the failed drive is provided to the virtual drive(s). The virtual drive(s) is / are assigned to the RAID group, and appears to be the failed drive in a non-failed state. Information representing the failed drive having been replaced is received and data from the at least one virtual drive is provided to the replacement drive. The replacement drive is assigned to the RAID group. The replacement drive appears to the RAID controller to be the failed drive. The virtual drive(s) are released.

The invention discloses a namespace management operation testing method and device, electronic equipment and a storage medium, and relates to the technical field of storage. The method comprises the steps of obtaining the number of processors of a target host corresponding to a target hardware simulation platform, the number of controllers of a target redundant array of independent disks, the number of redundant array of independent disks and the total capacity of each redundant array of independent disks; creating a plurality of threads consistent with the processors in number; determining configuration information corresponding to each thread according to the number of the controllers, the plurality of threads, the number of redundant array groups of independent disks and the total capacity; and based on the configuration information corresponding to each thread, calling the plurality of threads to send a management operation instruction to the target redundant array of independent disks in parallel, so that the target redundant array of independent disks executes a management operation test in parallel according to the received management operation instruction. The problem of low testing efficiency of management operation testing of the namespace is solved.

The application relates to the storage field and relates to an automatic configuration method of a RAID array card and a configuration system thereof. The application solves the problems that the RAID array card cannot be preconfigured in the prior art, and the manual configuration process is prone to misoperation and high in labor cost. The application comprises the following steps: saving the default automatic creation virtual disk and configuration data of the RAID array card in a serial peripheral interface flash memory; setting two M.2 SSD system disks of the same model and capacity and a microprocessor MCU in the RAID array card; setting a trigger automatic configuration under the condition that hardware requirements and trigger time are met through a configuration management module responsible for executing an automatic configuration process; realizing the automatic configuration of the RAID array card; greatly reducing the complex operation of manual creation of the user, reducing the consideration of human error, and putting forward the demand for automatic configuration of the RAID, which is realized through the automatic configuration, so as to achieve the purpose of being used as soon as powered on.

A data processing method dynamically determines a strip size for various data, and uses the dynamically determined strip size for the various data to store the various data into Redundant Arrays of Independent Disks (RAID) storage apparatuses.

Solutions for managing RAID logical devices. Some solutions provide enhanced online capacity expansion for virtual disks on RAID drives, for example by taking advantage of the hardware capabilities to expand a virtual disk stripe by stripe. Some solutions provide increase hardware automation, which can reduce firmware load and / or provide more efficient input-output operations (IO) for the online capacity expansion operation.

The present application relates to storing data by allocating redundant data blocks across multiple storage devices (e.g., solid state disks (SSDs)) and based on multiple RAID schemes. An electronic system mirrors user data on two distinct storage devices. Integrity data is generated based on the user data, and the integrity data is stored on an integrity storage device. In accordance with a determination that the integrity data of the user data is stored on the integrity storage device, the electronic system releases the user data mirrored on at least one of the two distinct storage devices. In some embodiments, a copy of the user data is also stored on one of a plurality of data storage devices. The integrity data is generated and stored on the integrity storage device based on the user data in accordance with a determination that the plurality of data storage devices are filled.

The invention relates to a system and apparatus for redundant array of independent disks striping against programming faults. Embodiments of the present disclosure provide a system including a memory device for storing memory data. The memory device includes a memory cell array and a plurality of word lines arranged in a plurality of rows and coupled to the memory cell array. The system also includes a memory controller having a processor and a memory, and operably coupled to the array of memory cells. The system also includes a host having another processor and another memory, and operably coupled to the memory controller. Another processor of the host is configured to perform a first RAID encoding operation on the memory data to form first parity data. A processor of the memory controller is configured to receive the first parity data and the memory data, and perform a second RAID encoding operation on the first parity data and the memory data to form second parity data.

The invention relates to a joint LDPC and RAID decoding scheme. An error correction code (ECC) system of a data storage device corrects errors in a codeword using a joint decoding scheme when the codeword fails to pass a decoding process using a first decoding scheme. The ECC system uses information derived from the second decoding scheme to generate soft bit information or reliability information associated with a portion of the unpassed codeword. When the first decoding scheme attempts to correct or decode unpassed codewords, the soft bit information derived from the second decoding scheme is provided to the first decoding scheme.

Systems, methods, and computer-readable storage devices can include fabric networks for isolating and correcting failures in the fabric network and device failures. The fabric network connects to a group of devices and a host. The group of devices includes at least a target data device, other data devices, and a parity device. A redundant array of independent devices (RAID) engine, which is coupled to the one group of devices, performs an access operation. The fault tolerant engine is provided in a leaf switch of the fabric network. A routing processor determines a path for a request received from the host to the target data device. The routing processor is coupled to the fault tolerant engine, and the routing processor is provided in the leaf switch.

Data protection super-slices with super-parity p are created from sets of two RAID slices a, b of width W that each include slice parity a, b. The tracks of each super-slice are distributed across the disks of a disk cluster of width 2W+1, and the same number of indexed sequences. Each of the indexed sequences contains one super-slice with the slice tracks a, b distributed according to a fixed sequence in order from a start pointer to a stop pointer. The start pointer and the stop pointer are shifted one place for each successive indexed sequence. The fixed sequence may be characterized by slice track adjacency or be interleaved, e.g., (a b b a a a a a b b b b a b b b a a b a b b a a bap) or (a a b a b b a b b b b a a a b a a a b a a a b b b bp).

The disclosure configures a memory sub-system controller to perform Redundant Array of Independent Disks (RAID) stripe deletion based on physical region size. The controller stores a set of data across a plurality of memory components, a first of the plurality of components being configured to store data in a first set of regions, a second of the plurality of components being configured to store data in a second set of regions. The controller generates a plurality of error correction parity information stripes for multiple collections of the set of data and computes a quantity of the plurality of error correction parity information stripes to delete based on sizes of each region in the first and second sets of regions. The controller deletes one or more of the plurality of error correction parity information stripes based on the computed quantity.

This invention relates to a distributed video file processing method and system based on RAID disks via FTP. The method includes: calculating the size, content hash value, and block content hash value of the video file to be uploaded via an FTP client and uploading it to an FTP scheduling module; the FTP scheduling module searches the FTP server for a file with the same size and hash value as the video file to be uploaded; if a file exists, the FTP file address of the same file is returned to the client; if no file exists, an optimal FTP server address is selected and returned to the client, and the client uploads the video file to the optimal FTP address. This invention utilizes the fast read / write characteristics of RAID 0 and also adds an idle backup and recovery file module to ensure data security. If a file is corrupted, a backup file is used for download, and the file can be recovered in the background.