360 results about "RAID" patented technology

The invention relates to the technical field of data compression, and particularly discloses a method for realizing data compression in an RAID card and an RAID control chip, and the method comprises the following steps: S1, receiving a plurality of IO writing commands issued by a host, and obtaining the logic block address and length of each IO; s2, executing a merging operation on the plurality of IOs to generate a merged IO block; s3, performing a data compression operation on the merged IO block through a data compression engine to obtain compressed data; s4, establishing a mapping relation from a logic block address to a physical block address of the compressed data, and storing the mapping relation in a logic-to-physical mapping table; s5, the compressed data are written into a solid state disk through an RAID engine, and meanwhile, logic-to-physical mapping table metadata are stored persistently; s6, sending a recovery command or a zero-writing command to the solid state disk recovery space for the address space which is not used after compression; the problem that an existing SSD compression scheme is high in power consumption is solved, reliability is better, original user data content is closer, and the obtained compression effect is better.

The present application provides a complex programmable logic device (CPLD)-based data processing method and system, and a computing device. The CPLD is arranged on a hard disk backplane of a server, and the hard disk backplane supports a universal backplane management (UBM) protocol; the hard disk backplane comprises an HFC connector for connecting to a RAID controller and a DFC connector for connecting to a hard disk slot, and the CPLD is connected to the HFC connector and the DFC connector, respectively. The method comprises: when a hard disk is inserted into the hard disk slot, determining an interface type of the hard disk according to a signal level transmitted by the DFC; processing interaction data between the RAID controller and the hard disk according to the hard disk interface type, wherein the interaction data comprises data indicating the hard disk interface type, data indicating a hard disk state and read / write operation command data; and transmitting the processed data to the RAID controller or the hard disk so as to achieve hard disk management, wherein the hard disk comprises a hard disk of an SAS / SATA / NVME interface type. In this way, new logic functionality is added to an existing logic chip of the hard disk backplane to achieve the functionality of the UBM protocol.

The invention provides an RAID (redundant array of independent disks) data processing method and device, a chip, electronic equipment, a storage medium and a computer program product, and is applied to RAID, the method comprises the following steps: detecting that at most three storage devices fail, determining at most three corresponding to-be-recovered areas in a stripe, and storing the to-be-recovered areas in the stripe; the to-be-recovered area is a data area, a verification area, a first hot standby area and / or a second hot standby area; determining a target area based on at most three areas to be recovered, wherein the target area is a data area, a verification area, a first hot standby area and / or a second hot standby area except the areas to be recovered; and target information in the target area is read, and the data information and / or the first verification information of the to-be-recovered area are / is recovered based on the target information.

The invention relates to a server disk RAID state monitoring method and device and a readable storage medium. The method comprises the steps that the health state of a battery backup unit is judged according to RAID hardware information; obtaining SMART attribute information to judge the health state of a server disk; obtaining the state of a server disk RAID array, reconstruction progress information and availability information of a hot spare disk so as to judge the performance of the server disk; when the RAID array has the degradation state, a fault disk corresponding to the degradation state in the RAID array is determined, reconstruction of the RAID array is automatically triggered, replacement operation of the fault disk is executed, and alarm information is sent to an upper computer; the RAID hardware information, the SMART attribute information, the state of the RAID array, the reconstruction progress information, the availability information of the hot spare disk and the position information of the fault disk are uploaded to a log file; and encrypting the log file by using an AES algorithm. The accuracy of the method for monitoring the RAID state of the server disk and the safety and reliability of the log file are improved.

The invention provides an RAID (Redundant Array of Independent Disk) implementation method based on FPGA (Field Programmable Gate Array) hardware acceleration, which comprises the following steps of: transferring a control authority of kernel storage equipment to a user mode based on a UIO (Universal Input / Output) technology, and constructing a disk management module in the user mode to reduce the switching frequency between the user mode and a kernel mode; a shared memory area is established between the kernel module and the disk management module, and efficient interaction between a kernel and a user mode is achieved; and an FPGA hardware card is introduced into the disk management module, and the FPGA hardware card verification calculation logic is configured according to the RAID mode and the data access type. Aiming at the problems of high user mode and kernel mode switching overhead, low transmission efficiency of data between a user mode and a kernel mode and the like caused by frequent user program memory access requests in an existing RAID system, the method comprises the following steps: firstly, optimizing equipment management by utilizing a UIO technology, extracting a disk management function from a kernel to an application layer, and establishing a disk management module; frequent context switching caused by a user program request is reduced, and time and resource expenses are reduced.

Techniques are directed to wear leveling. Such techniques involve: determining, at least based on the type information of each redundant array of independent disks (RAID) group in a plurality of RAID groups, the write loss of each of the RAID groups. Such techniques further involve: determining the wear status of each of the RAID groups according to the status information and write loss of each of the RAID groups. Such techniques further involve: transferring at least a portion of data and / or a write task of a first RAID group to a second RAID group based on the write loss and the wear status of each of the RAID groups. With such wear leveling techniques, wear caused by write tasks can be evenly distributed among the RAID groups, so that the degree of wear among the RAID groups is more leveled.

A data protection method and system are provided. At least one computing device provides information representing failure of a drive that is assigned to a RAID group. Available storage on each of a plurality of drives in use in the RAID group is identified and at least one virtual drive is built using at least the available storage. Data associated with the failed drive is provided to the virtual drive(s). The virtual drive(s) is / are assigned to the RAID group, and appears to be the failed drive in a non-failed state. Information representing the failed drive having been replaced is received and data from the at least one virtual drive is provided to the replacement drive. The replacement drive is assigned to the RAID group. The replacement drive appears to the RAID controller to be the failed drive. The virtual drive(s) are released.

The invention discloses an NVMe storage array virtualization device based on an FPGA (Field Programmable Gate Array), which is characterized in that single I / O (Input / Output) virtualization (SR-IOV) is realized in the FPGA, and a plurality of NVMe virtual functions which can be directly accessed by a virtual machine are externally provided; mapping from a virtual volume logic address to a physical storage address is completed in hardware, striping management and RAID verification calculation are carried out on a plurality of NVMe solid state disks at the rear end, and storage resource pooling is achieved; the partial reconfigurable characteristic of the FPGA is utilized, I / O scheduling, data compression and prefetching strategies are dynamically adjusted, and the adaptability and performance efficiency of the system are improved. Hardware unloading of the whole I / O path is completed in the FPGA, intervention of a host CPU is not needed, delay is remarkably reduced, the throughput capacity is improved, service quality isolation and elastic expansion in a multi-tenant environment are supported, and an effective technical path is provided for constructing a next-generation high-performance and low-delay storage infrastructure.

The invention relates to the field of storage, in particular to an automatic configuration method and system for RAID (redundant array of independent disks) cards. The problems that in the prior art, an RAID card cannot be pre-configured, misoperation is prone to occurring in the manual configuration process, and the labor cost is high are solved. The method comprises the following steps of: storing default automatic virtual disk creation and configuration data of an RAID (Redundant Array of Independent Disks) card in a serial peripheral interface flash memory; two M.2 SSD system disks with the same model and the same capacity and a microprocessor MCU are arranged in the RAID card; the configuration management module is responsible for executing an automatic configuration process, and automatic configuration is set and triggered under the condition that the hardware requirement and the triggering time are met; the automatic configuration of the RAID card is realized; the complex operation of manual creation of a user is greatly reduced, consideration of human-caused faults is reduced, the requirement for automatically configuring the RAID is provided, the process is achieved through automatic configuration, and the purpose of instant use after power-on is achieved.

The invention provides a storage server RAID card abnormity monitoring method and device, and belongs to the field of computer storage. The method comprises the following steps: acquiring storage service processes corresponding to all RAID cards; initializing a hardware watchdog; the storage service process sends a heartbeat signal to the hardware watchdog at the dog feeding time point, identifies the start exception state of the storage service process, and automatically triggers a start exception handling mechanism when the start exception state is identified; after the storage service process is normally started, the BMC receives state information of the storage service process and identifies an abnormal running state of the storage service process based on the state information; matching a repair scheme based on the abnormal operation state, and repairing the abnormal operation state; and if the running abnormal state is repaired unsuccessfully, triggering a configuration rollback operation to repair the running abnormal state. According to the storage server RAID card exception monitoring method and device provided by the invention, RAID service process monitoring and exception recovery and RAID configuration exception recovery can be realized.

The invention discloses a solid state disk data caching method and device of a redundant array of independent disks (RAID) system, which are applied to the technical field of RAID systems, and in order to solve the problems of large performance loss and influence on system performance, parameter information of each data block is acquired for each data block in a solid state disk reserved area; the parameter information comprises available invalid page proportions; the ratio of the available invalid pages is the ratio of the available invalid pages to the total page number, and the available invalid pages are pages with the same content as the data blocks in the redundant array of independent disks; determining the weight of the data block according to the parameter information of the data block; the weight is in negative correlation with the available invalid page proportion; determining the data block with the maximum weight in the data blocks as a to-be-erased data block, and erasing data in the to-be-erased data block; according to the method, disk access during updating of the array check value is reduced, performance loss caused by frequent erasing of the SSD data blocks is reduced, the read-write performance of the RAID system is improved, and the service life of the SSD is prolonged.

A method, comprising: identifying, by a processing circuitry of a storage device controller, a plurality of memory portions of a volatile memory of the storage device controller; generating one or more data structures that map each of the plurality of memory portions to a different one of a plurality of logical drives; using each of the plurality of memory portions to exclusively cache data for the one of the plurality of logical drives that is mapped to that memory portion, such that none of the memory portions is used to cache data for any of the plurality of logical drives other than the logical drive that is mapped to that memory portion; detecting a failure of a given one of the plurality of logical drives; identifying the one of the plurality of memory portions that is mapped to the given logical drive; and blocking the identified memory portion.

The invention provides a modular data center machine room system, and belongs to the technical field of intelligent machine rooms, the modular data center machine room system comprises a plurality of stackable functional unit modules, and each functional unit module comprises a composite load-bearing frame, an integrated standardized mechanical interface and an electrical fast-assembly interface; the computing unit supports plug and play of heterogeneous computing equipment; the storage unit supports RAID hot plug of the mixed medium; the network unit provides a programmable switching matrix; the power supply unit is internally provided with a multi-mode adapter and is compatible with AC / DC input and lithium battery / super capacitor hybrid energy storage; and the central intelligent management platform monitors the real-time load rate and the energy efficiency ratio of each module, coordinates the resources of each module, detects the interface attribute of a new module and configures a network address when judging that the new module needs to be accessed, executes a topology reconstruction instruction, carries out topology reconstruction and outputs a prompt. Compared with the prior art, the crossing from a fixed framework to elastic ecology is realized.

The invention discloses a disk capacity expansion method and device, equipment and a storage medium, and relates to the technical field of storage, in the disk capacity expansion method, under the condition that a bad disk is detected during disk array capacity expansion, at least one original stripe before capacity expansion is determined according to an abnormal stripe containing the bad disk after capacity expansion; restoring the bad disk data element according to the check code in the original stripe and the normal data element in the original stripe to obtain a restored target data element; then determining a target stripe according to the restored target data element and the normal data element in the abnormal stripe; writing the target strip into a reserved area of any normal disk; and finally, under the condition that a preset migration condition is met, migrating the target strip stored in the reserved area to the expanded target disk array. According to the method and the device, on the premise of ensuring the data consistency of the RAID system, the continuous capacity expansion under the condition that the disk breaks down during the online capacity expansion of the RAID can be realized.

The invention provides a hard disk state monitoring method and device, equipment, a storage medium and a product, and relates to the technical field of computers.The method comprises the steps that a BMC regularly sends a SMART query instruction to an RAID, and fault index data of a hard disk with out-of-band connection is obtained; based on the fault index data, adopting a weighted comprehensive calculation method to generate a health score value of the hard disk; judging the health state of the hard disk according to the health score value; if the score value is greater than a preset threshold value, marking as a sub-health state; and triggering an alarm for the hard disk in the sub-health state and setting the hard disk in a read-only access mode. The SMART fault index data of the out-of-band hard disk is regularly acquired through the BMC, and the health score is generated based on the weighted comprehensive calculation method, so that the real-time monitoring and accurate judgment of the sub-health state of the hard disk are realized, the problem that the sub-health state of the out-of-band hard disk is difficult to find in time in the prior art is effectively solved, the data loss risk is reduced, and the safety of the out-of-band hard disk is improved. And the reliability of the server system is improved.

The invention discloses a cache dynamic allocation method and device for a storage hardware device, and relates to the technical field of cache dynamic allocation, and the method comprises the steps: obtaining multi-dimensional perception data corresponding to an RAID card, matching a corresponding dynamic decision engine, and carrying out cache dynamic allocation in combination with a QoS virtual channel and resource isolation and a preemptive resource recovery mechanism, the problems that in the related technology, a single-index offline training model is excessively depended, multi-dimensional perception is lacked, and traffic processing has large delay are solved; besides, during resource allocation competition, service interference is easily caused, the hardware cost for deploying an intelligent algorithm is high, and the cache allocation efficiency is greatly influenced are solved, and the purposes of avoiding write cache full and forced degradation into a write-through mode, remarkably improving I / O response stability, eliminating high-temperature downtime and cache data loss risks and improving the cache allocation efficiency are achieved. And the delay fluctuation and the hardware deployment cost are reduced.

The invention provides an RDMA-based big data transmission and storage system and method and a semiconductor detection device.The big data transmission and storage system comprises a hardware layer and a software layer, the hardware layer comprises an NVMe SSD storage array, an NVMe RAID acceleration card based on a GPU architecture and an RDMA network card, and the software layer comprises an NVMe SSD storage array, an NVMe RAID acceleration card based on the GPU architecture and an RDMA network card; the software layer comprises a multi-thread transmission module, a self-adaptive memory pool module, a transmission control module, a data verification and retransmission module, a scheduling and optimizing module and a disk falling and storage management module. According to the method, multi-channel transmission parallelization is achieved through data direct connection, zero copy transmission, RAID acceleration and multi-thread parallel RDMA transmission in a hardware link, data is directly connected and transmitted from a memory to the NVMe SSD storage array, data receiving and disk falling thread decoupling directly access the NVMe SSD storage array through asynchronous writing, network overload or storage blockage is avoided, and the data transmission efficiency is improved. The data transmission efficiency and reliability are high, and popularization and application in scenes needing large-scale image transmission processing such as semiconductor detection are facilitated.

A Redundant Array of Independent Disks (RAID) scheme can be used to allow recovery from a memory failure. RAID 6 can be used to recover data from up to two catastrophic failures. Typically, a hardware encoder is used to generate parities of the RAID 6 protection scheme, and a separate hardware decoder is used in the data recovery process. In an example data storage device described herein, some of the components of the hardware encoder are used to perform the data recovery process, thereby eliminating the need for a separate, additional hardware component.

The invention relates to the technical field of storage equipment, and particularly discloses an RAID card high-availability device and method based on a multi-path cluster, and the device comprises at least two RAID cards; the RAID engine is used for processing RAID read-write data, configuring RAID levels and processing hard disk hot plug; the front-end multi-path module is used for establishing a plurality of data channels with a host and exposing a virtual disk with the same NGUID to the host, so that the host multi-path module can access the virtual disk in an aggregated manner; the rear-end multi-path module is used for establishing a multi-path data channel with the dual-port hard disk, transmitting read-write data and commands of the dual-port hard disk, and realizing disk access link redundancy and fault automatic switching; the system management module is used for processing internal and external management control events, state conversion and internal processes of the RAID card; the cluster management module is used for establishing communication channels among the RAID cards, maintaining heartbeat information among the RAID cards and managing cluster node states; the problem of single-point failure of a traditional RAID card is solved, and the reliability and performance of a system are improved.

In a locked RAID memory system, the present method generates variable-length compressed data in a RAID stripe, which is stored along with the inclusion of a single RAID parity segment (parity strip) for the entire stripe. If any one data segment (data strip) in the RAID stripe should fail, as determined by a CRC check, the data can be recovered by XORing the single RAID parity segment with all the non-errored data segments in the stripe. However, in order to determine which data segment has failed, successive data segments must be XORed, and the CRC check reperformed, until the CRC error stands corrected. In an embodiment, the successive data segments may be tested in parallel with suitable hardware. In an embodiment, the successive data segments may be tested sequentially, or semi-in-parallel and semi-sequentially.

The invention discloses an SSD (Solid State Disk) garbage collection method and device with RAID (Redundant Array of Independent Disk) redundancy and a medium, and relates to the technical field of garbage collection, and the method comprises the following steps: in a garbage collection process, selecting a target NAND flash memory physical block of which the effective data volume meets a collection condition, copying the effective data to a new position, and updating address mapping; querying a first RAID block to which the target block belongs and all member block identifiers thereof according to a first mapping table and a second mapping table which record a mapping relationship between the NAND flash memory physical block and the RAID blocks; and recombining other blocks except the target block in the first RAID block into a second RAID block, recalculating and storing verification data for the second RAID block, synchronously updating the two mapping tables to reflect a new composition relationship, and finally erasing the target block. The physical block of the NAND flash memory is used as the minimum recovery unit to replace the traditional recovery mode taking the whole RAID block as the unit, and the block with the minimum effective data can be preferentially recovered, so that the effective data migration amount is remarkably reduced, the write amplification coefficient is reduced, the abrasion is reduced, and the service life of a hard disk is prolonged.

The invention discloses a system and a method for performing flash disk redundant array computing management based on a GPU (Graphics Processing Unit). The system comprises an application layer, a host control layer, a GPU computing layer, a storage layer and a monitoring and optimizing layer. An application layer receives an external request through an API, and a task manager decomposes a file into an executable task corresponding to RAID fragmentation data; a host control layer coordinates task distribution of a GPU cluster and an NVMe solid state disk array through a task scheduler, an NVMe driver manages storage equipment, and a GPU direct connection port supports direct data transmission of a calculation layer and a storage layer; a GPU cluster of the GPU calculation layer comprises a hierarchical thread pool, a self-adaptive fragmentation module, a parallel verification assembly line and a video memory management module which are used for respectively realizing thread management, dynamic fragmentation adjustment, RAID verification calculation and video memory distribution; the storage layer stores fragments and redundant data by using an NVMe array; and the monitoring and optimization layer realizes system state monitoring and scheduling optimization through performance monitoring and AI prediction. According to the invention, the data fragmentation, verification and storage efficiency can be improved.

Systems and methods that make use of cluster-level redundancy within a distributed storage system to address various node-level error scenarios are provided. Rather than making use of a generalized one-size-fits-all approach in an effort to reduce complexity, an approach tailored to the node-level error scenario at issue may be performed to avoid doing more than necessary. According to one embodiment, responsive to identification of a failed RAID stripe by a node of a cluster of a distributed storage management system, for each block ID of multiple block IDs associated with the failed RAID stripe, a data block is restored corresponding to the block ID by reading the data block from another node of the cluster having a redundant copy of the data block; and writing the redundant copy of the data block to a storage area of the node that is unaffected by the failed RAID stripe.

The invention belongs to the technical field of computers, and discloses an RAID (redundant array of independent disks) parameter configuration method and system.The RAID parameter configuration method comprises the steps of obtaining a storage emphasized direction selected by a user, determining a utility function weight, determining an RAID parameter space according to the number of hard disks, searching an optimal RAID parameter combination, generating non-technical scheme interpretation and displaying the non-technical scheme interpretation to the user, and providing a slider to adjust the weight. According to the method, the problems that non-professional users are difficult to understand RAID technical parameters and lack in deep non-technical interpretation and convenient adjustment modes in the prior art are solved, the configuration difficulty is reduced, the users can autonomously complete storage configuration, and the user experience is improved. The method has the advantages that the difficulty of configuring the multi-hard-disk network storage device by a non-professional user is reduced, and the user can autonomously and confidently complete the storage configuration meeting the requirement of the user.

A geometry-aware method of writing parity, performed by a storage system is provided. The method includes writing data, using error correction coding, to a RAID stripe comprising a plurality of allocation units of storage memory of the storage system, and writing one or more parity pages comprising parity data for a block having a portion of the data of the RAID stripe in one of the plurality of allocation units of the RAID stripe to a targeted differing word line of the block or a differing block, the parity data for the block distinct from the error correction coding of the RAID stripe.

The invention relates to the technical field of solid-state storage, in particular to a dynamic fault tolerance and replacement system and method for bad blocks of a flash memory. Compared with the prior art, through dynamic migration and global scheduling, prediction maintenance, cross-Die cooperation and a system-level fault-tolerant mechanism, the reliability of the Ink Die storage system is remarkably improved, the bad block replacement efficiency is improved by 40%, the burst failure rate is reduced by 60%, and the data loss risk is reduced; passive replacement operation is reduced by 50% for predictive maintenance, the service life of equipment is prolonged by a cross-Die spare block sharing mechanism, storage resource allocation is optimized, and storage capacity loss is reduced by 25%; according to the collaborative design of RAID and bad block management, the system complexity is reduced, a lightweight end-to-end fault-tolerant scheme is formed, and a better solution is provided for high-reliability storage requirements.

The invention relates to an RAID stripe repairing method and device, equipment, a storage medium and a program product. Pre-embedded information is recorded in data blocks of stripes of the RAID, and the pre-embedded information recorded in each data block at least comprises a block identifier of the data block, a stripe identifier of the stripe to which the data block belongs and a data disk falling timestamp of the data block; the stripe repairing method of the RAID comprises the following steps: performing duplicate removal processing on each data block according to pre-embedded information of each data block of the RAID to obtain a target data block; comparing the actual mapping relationship corresponding to the target data block with a preset mapping relationship between a block identifier and a stripe identifier stored in the metadata of the RAID; wherein the actual mapping relationship is a mapping relationship between a block identifier and a stripe identifier in the pre-embedded information of the target data block; and according to a comparison result, performing stripe repair on the RAID. By adopting the method, the application scene of RAID repair can be expanded, and the efficiency and accuracy of RADI strip repair are improved.

Systems and methods for selectively bypassing an external cache (EC) of a storage system are provided. In one example, when the EC backing storage device is saturated, reads bypass the EC and are completed via a redundant array of independent disks (RAID) subsystem of the storage system. One or more performance metrics for the EC backing storage device may be monitored to predict one or more saturation thresholds (e.g., in terms of latency and / or throughput). Based on this monitoring, tuning may be performed to drive utilization of the EC into a “knee region” of a performance (or response) curve of the EC backing storage device. For example, the depth of one or more request queues at the front-end of an EC lookup may be manipulated based on a current measure of saturation relating to the EC backing storage device to limit the number of in-flight reads pending for the EC.

The invention discloses a method for determining an optimal read-write strategy of an RAID card and a related product. The method comprises the following steps: acquiring an iostat echo field of the RAID card; performing feature extraction on the iostat echo field to obtain feature data; and performing feature matching on the feature data and an IO model library, and determining an optimal read-write strategy of the RAID card. According to the method, the extracted feature data and the IO model library which is pre-constructed and continuously optimized are subjected to matching analysis. And automatically recommending the most matched read-write strategy combination. According to the method, subjective errors caused by manual intervention are reduced, and the configuration accuracy and the adaptive capacity of the RAID card in a complex and changeable service environment are remarkably improved, so that the performance and the stability of a whole storage system are effectively improved.

Disclosed in the embodiments of the present application are a data storage method and apparatus, a device, and a non-transitory readable storage medium. According to the embodiments of the present application, F parity blocks occupying blank storage areas are added to a RAID system, which not only increases error tolerance but also eliminates the need for additional parity disks. During data storage, corresponding original check codes are solved according to an original encoding method, and additional check codes located on the parity blocks are solved simultaneously. Thus, it is possible to recover more erroneous data based on the original check codes and the additional check codes. When an error occurs in a disk in which any block in a stripe is located and data loss occurs in other blocks of the same stripe, the corresponding data can still be recovered.