529 results about "RAID" patented technology

The invention relates to the technical field of data storage and processing, in particular to an RAID card static cache management method and device based on data popularity, and the method comprises the steps that the physical position of a data block needing to be accessed in an SSD array is acquired according to a read-write request; historical data access information of the RAID card is collected, a historical data set is generated, and a neural network model is trained by using the historical data set to obtain a cache management model; predicting and outputting data blocks which are possibly accessed in the future and the access probability of the data blocks through the cache management model; the RAID controller dynamically adjusts a cache strategy in combination with an LRU strategy according to a prediction result output by the cache management model and a read-write request of a file system, and optimizes a storage position and an updating mechanism of a data block in a cache space; and when the hit rate or the data access efficiency does not reach the preset value, adjusting the parameters of the cache strategy and updating the cache strategy. According to the method, cache resources can be more effectively distributed, the cache hit rate is improved, the cache replacement overhead is reduced, and therefore the performance of a storage system is optimized.

The invention relates to the technical field of data compression, and particularly discloses a method for realizing data compression in an RAID card and an RAID control chip, and the method comprises the following steps: S1, receiving a plurality of IO writing commands issued by a host, and obtaining the logic block address and length of each IO; s2, executing a merging operation on the plurality of IOs to generate a merged IO block; s3, performing a data compression operation on the merged IO block through a data compression engine to obtain compressed data; s4, establishing a mapping relation from a logic block address to a physical block address of the compressed data, and storing the mapping relation in a logic-to-physical mapping table; s5, the compressed data are written into a solid state disk through an RAID engine, and meanwhile, logic-to-physical mapping table metadata are stored persistently; s6, sending a recovery command or a zero-writing command to the solid state disk recovery space for the address space which is not used after compression; the problem that an existing SSD compression scheme is high in power consumption is solved, reliability is better, original user data content is closer, and the obtained compression effect is better.

In various examples, data storage is managed using a distributed storage management system that is resilient. Data blocks of a logical block device may be distributed across multiple nodes in a cluster. The logical block device may correspond to a file system volume associated with a file system instance deployed on a selected node within a distributed block layer of a distributed file system. Each data block may have a location in the cluster identified by a block identifier associated with each data block. Each data block may be replicated on at least one other node in the cluster. A metadata object corresponding to a logical block device that maps to the file system volume may be replicated on at least another node in the cluster. Each data block and the metadata object may be hosted on virtualized storage that is protected using redundant array independent disks (RAID).

A storage device may carve out redundant array of independent disks (RAID) and reduce write amplification when writing data to the RAID. The storage device includes multiple flexible data placement drives that are configured to execute RAID techniques. A controller on the storage device may receive data from a host. The controller obtains reclaim unit handles from the data to determine locations where the data is to be stored on the flexible data placement drives. During storage, the controller stripes the data in parallel across reclaim units within different reclaim groups and endurance groups across a single flexible data placement drive or multiple flexible data placement drives. The storage device leverages the write amplification of the flexible data placement drives to reduce a write amplification factor on the RAID.

The present application provides a complex programmable logic device (CPLD)-based data processing method and system, and a computing device. The CPLD is arranged on a hard disk backplane of a server, and the hard disk backplane supports a universal backplane management (UBM) protocol; the hard disk backplane comprises an HFC connector for connecting to a RAID controller and a DFC connector for connecting to a hard disk slot, and the CPLD is connected to the HFC connector and the DFC connector, respectively. The method comprises: when a hard disk is inserted into the hard disk slot, determining an interface type of the hard disk according to a signal level transmitted by the DFC; processing interaction data between the RAID controller and the hard disk according to the hard disk interface type, wherein the interaction data comprises data indicating the hard disk interface type, data indicating a hard disk state and read / write operation command data; and transmitting the processed data to the RAID controller or the hard disk so as to achieve hard disk management, wherein the hard disk comprises a hard disk of an SAS / SATA / NVME interface type. In this way, new logic functionality is added to an existing logic chip of the hard disk backplane to achieve the functionality of the UBM protocol.

The invention provides an RAID (redundant array of independent disks) data processing method and device, a chip, electronic equipment, a storage medium and a computer program product, and is applied to RAID, the method comprises the following steps: detecting that at most three storage devices fail, determining at most three corresponding to-be-recovered areas in a stripe, and storing the to-be-recovered areas in the stripe; the to-be-recovered area is a data area, a verification area, a first hot standby area and / or a second hot standby area; determining a target area based on at most three areas to be recovered, wherein the target area is a data area, a verification area, a first hot standby area and / or a second hot standby area except the areas to be recovered; and target information in the target area is read, and the data information and / or the first verification information of the to-be-recovered area are / is recovered based on the target information.

The invention relates to a server disk RAID state monitoring method and device and a readable storage medium. The method comprises the steps that the health state of a battery backup unit is judged according to RAID hardware information; obtaining SMART attribute information to judge the health state of a server disk; obtaining the state of a server disk RAID array, reconstruction progress information and availability information of a hot spare disk so as to judge the performance of the server disk; when the RAID array has the degradation state, a fault disk corresponding to the degradation state in the RAID array is determined, reconstruction of the RAID array is automatically triggered, replacement operation of the fault disk is executed, and alarm information is sent to an upper computer; the RAID hardware information, the SMART attribute information, the state of the RAID array, the reconstruction progress information, the availability information of the hot spare disk and the position information of the fault disk are uploaded to a log file; and encrypting the log file by using an AES algorithm. The accuracy of the method for monitoring the RAID state of the server disk and the safety and reliability of the log file are improved.

The invention discloses an encryption and decryption method, system, device and equipment and a storage medium, and relates to the technical field of data security of a storage system.The encryption and decryption method comprises the steps that a system password is received through an RAID controller, a derived password is generated in combination with a pre-stored random number salt value and an encryption key, and the derived password is sent to the RAID controller; and converting the password into a readable password conforming to the password rule of the self-encryption disk, and encrypting and storing the readable password so as to control the locking or unlocking of the self-encryption disk. According to the method, the salt value and the encryption key are stored in advance, so that the exposure of a plaintext password is avoided, the problems of performance bottleneck and key storage security risk caused by centralized encryption of a traditional RAID controller are solved, meanwhile, the encryption characteristic of the self-encryption disk is utilized, automatic encryption during data storage and automatic locking after power failure are realized, and the security of data storage is improved. The technical effects of reducing the calculation load, improving the key security and guaranteeing the end-to-end encryption of the data storage are achieved, so that RAID redundancy and the security mechanism of the self-encryption disk are deeply combined, and the data protection capability of the whole system is enhanced.

The invention discloses a fault reconstruction method, device and equipment for a mechanical hard disk and a storage medium, and relates to the technical field of storage, and the method comprises the following steps: obtaining fault area information of a current fault hard disk in a disk array group; wherein the fault area information is information of a strip of a disk array group where a fault occurring in the current fault hard disk is located; the fault area information comprises a fault hard disk identifier and a fault strip identifier; determining a target reconstruction region corresponding to the fault region information; wherein the target reconstruction area is an area in the current mechanical hard disk; reconstructing data of a fault area in the current fault hard disk in the target reconstruction area, and recording a corresponding relation between the target reconstruction area and the fault area; reconstruction is still carried out on the faulty mechanical hard disk, a new disk does not need to be inserted, the reconstruction efficiency of the RAID group and the utilization rate of the faulty mechanical hard disk are improved, the cost is greatly reduced, and therefore the IO performance of a host is improved.

The invention discloses a hard disk operation method, system and device and a computer readable storage medium, and relates to the technical field of storage, and the method comprises the steps: obtaining a target request for carrying out target operation on a redundant array group of independent disks; determining a target hard disk needing to be operated according to the target request; splitting the target request into target sub-requests for operating a target hard disk; generating correlation information between the target sub-request and the target operation; adding the target sub-request to a first processing queue corresponding to the target hard disk in response to the fact that the correlation information meets a set strong correlation condition; adding the target sub-request to a second processing queue corresponding to the target hard disk in response to the fact that the correlation information does not meet the strong correlation condition; and if the first processing queue is empty, operating the target hard disk according to the first processing queue, and if the first processing queue is empty, operating the target hard disk according to the second processing queue. And the target sub-request strongly related to the target operation is preferentially processed in the target hard disk, so that the data processing efficiency is ensured.

The invention provides an RAID (Redundant Array of Independent Disk) implementation method based on FPGA (Field Programmable Gate Array) hardware acceleration, which comprises the following steps of: transferring a control authority of kernel storage equipment to a user mode based on a UIO (Universal Input / Output) technology, and constructing a disk management module in the user mode to reduce the switching frequency between the user mode and a kernel mode; a shared memory area is established between the kernel module and the disk management module, and efficient interaction between a kernel and a user mode is achieved; and an FPGA hardware card is introduced into the disk management module, and the FPGA hardware card verification calculation logic is configured according to the RAID mode and the data access type. Aiming at the problems of high user mode and kernel mode switching overhead, low transmission efficiency of data between a user mode and a kernel mode and the like caused by frequent user program memory access requests in an existing RAID system, the method comprises the following steps: firstly, optimizing equipment management by utilizing a UIO technology, extracting a disk management function from a kernel to an application layer, and establishing a disk management module; frequent context switching caused by a user program request is reduced, and time and resource expenses are reduced.

A system and related method, the system including control circuitry and memory with a first memory block of a first memory density and a second memory block of a second memory density which is greater than the first memory density. Control circuitry, which is communicatively coupled to the memory, is configured to determine to transfer data from the first memory block to the second memory block, generate parity data based on the data and cause to store the parity data at a parity address corresponding to an available portion of the first memory block. Control circuitry is further to cause to update a look-up table with the parity data address and cause to copy the data from the first memory block to the second memory block.

Techniques are directed to wear leveling. Such techniques involve: determining, at least based on the type information of each redundant array of independent disks (RAID) group in a plurality of RAID groups, the write loss of each of the RAID groups. Such techniques further involve: determining the wear status of each of the RAID groups according to the status information and write loss of each of the RAID groups. Such techniques further involve: transferring at least a portion of data and / or a write task of a first RAID group to a second RAID group based on the write loss and the wear status of each of the RAID groups. With such wear leveling techniques, wear caused by write tasks can be evenly distributed among the RAID groups, so that the degree of wear among the RAID groups is more leveled.

A data protection method and system are provided. At least one computing device provides information representing failure of a drive that is assigned to a RAID group. Available storage on each of a plurality of drives in use in the RAID group is identified and at least one virtual drive is built using at least the available storage. Data associated with the failed drive is provided to the virtual drive(s). The virtual drive(s) is / are assigned to the RAID group, and appears to be the failed drive in a non-failed state. Information representing the failed drive having been replaced is received and data from the at least one virtual drive is provided to the replacement drive. The replacement drive is assigned to the RAID group. The replacement drive appears to the RAID controller to be the failed drive. The virtual drive(s) are released.

The invention discloses a disk parameter configuration method and device. The method comprises the steps of obtaining an initial demand text input by a user; performing semantic analysis on the initial demand text, and determining at least one piece of demand information and a priority among the at least one piece of demand information; determining a target dimension corresponding to the at least one piece of demand information; determining a demand degree corresponding to the target dimension according to the priority; determining a demand weight value corresponding to the target dimension according to the demand degree; according to the demand weight value corresponding to the target dimension, respectively calculating a target score of at least one pre-stored disk parameter configuration scheme; determining a target disk parameter configuration scheme according to the target score of the at least one disk parameter configuration scheme; and performing configuration according to the target disk parameter configuration scheme. A user does not need to understand technical details of the RAID in advance, dynamic balance among multiple dimensions such as safety, performance and cost is achieved based on weights, analysis and accurate quantification of RAID configuration requirements are achieved, and dynamic balance among multiple targets can be met.

The invention discloses an NVMe storage array virtualization device based on an FPGA (Field Programmable Gate Array), which is characterized in that single I / O (Input / Output) virtualization (SR-IOV) is realized in the FPGA, and a plurality of NVMe virtual functions which can be directly accessed by a virtual machine are externally provided; mapping from a virtual volume logic address to a physical storage address is completed in hardware, striping management and RAID verification calculation are carried out on a plurality of NVMe solid state disks at the rear end, and storage resource pooling is achieved; the partial reconfigurable characteristic of the FPGA is utilized, I / O scheduling, data compression and prefetching strategies are dynamically adjusted, and the adaptability and performance efficiency of the system are improved. Hardware unloading of the whole I / O path is completed in the FPGA, intervention of a host CPU is not needed, delay is remarkably reduced, the throughput capacity is improved, service quality isolation and elastic expansion in a multi-tenant environment are supported, and an effective technical path is provided for constructing a next-generation high-performance and low-delay storage infrastructure.

The invention discloses a redundant array of independent disks (RAID) card, a test method, device and system thereof and a host, and relates to the technical field of storage, the method is applied to an RAID card, and the method comprises the following steps: acquiring an integrated test command of a target firmware system sent by a test host; determining a target test case in a target subsystem in the test framework according to the integrated test command; executing the target test case by using the test framework to obtain an integration test result of the integration test command, and sending the integration test result to the test host; according to the invention, through the arrangement of the test framework in the RAID card, redundant codes during writing of the test case can be reduced, and the workload and resource waste of testers are reduced; according to the method, the test frame uniformly performs distribution execution of the test cases and judgment and statistics of the test results, so that the number of times of interaction with the test host can be reduced, the test efficiency is improved, and an automatic integrated test for docking the RAID card with the test host is conveniently realized.

The invention relates to the field of storage, in particular to an automatic configuration method and system for RAID (redundant array of independent disks) cards. The problems that in the prior art, an RAID card cannot be pre-configured, misoperation is prone to occurring in the manual configuration process, and the labor cost is high are solved. The method comprises the following steps of: storing default automatic virtual disk creation and configuration data of an RAID (Redundant Array of Independent Disks) card in a serial peripheral interface flash memory; two M.2 SSD system disks with the same model and the same capacity and a microprocessor MCU are arranged in the RAID card; the configuration management module is responsible for executing an automatic configuration process, and automatic configuration is set and triggered under the condition that the hardware requirement and the triggering time are met; the automatic configuration of the RAID card is realized; the complex operation of manual creation of a user is greatly reduced, consideration of human-caused faults is reduced, the requirement for automatically configuring the RAID is provided, the process is achieved through automatic configuration, and the purpose of instant use after power-on is achieved.

The invention provides a storage server RAID card abnormity monitoring method and device, and belongs to the field of computer storage. The method comprises the following steps: acquiring storage service processes corresponding to all RAID cards; initializing a hardware watchdog; the storage service process sends a heartbeat signal to the hardware watchdog at the dog feeding time point, identifies the start exception state of the storage service process, and automatically triggers a start exception handling mechanism when the start exception state is identified; after the storage service process is normally started, the BMC receives state information of the storage service process and identifies an abnormal running state of the storage service process based on the state information; matching a repair scheme based on the abnormal operation state, and repairing the abnormal operation state; and if the running abnormal state is repaired unsuccessfully, triggering a configuration rollback operation to repair the running abnormal state. According to the storage server RAID card exception monitoring method and device provided by the invention, RAID service process monitoring and exception recovery and RAID configuration exception recovery can be realized.

The invention discloses a solid state disk data caching method and device of a redundant array of independent disks (RAID) system, which are applied to the technical field of RAID systems, and in order to solve the problems of large performance loss and influence on system performance, parameter information of each data block is acquired for each data block in a solid state disk reserved area; the parameter information comprises available invalid page proportions; the ratio of the available invalid pages is the ratio of the available invalid pages to the total page number, and the available invalid pages are pages with the same content as the data blocks in the redundant array of independent disks; determining the weight of the data block according to the parameter information of the data block; the weight is in negative correlation with the available invalid page proportion; determining the data block with the maximum weight in the data blocks as a to-be-erased data block, and erasing data in the to-be-erased data block; according to the method, disk access during updating of the array check value is reduced, performance loss caused by frequent erasing of the SSD data blocks is reduced, the read-write performance of the RAID system is improved, and the service life of the SSD is prolonged.

A container system facilitates selective migrations of data from high-wear inducing data devices to spare data devices to promote SSD wear levelling. Storage capacity is configured into same-size cells with each container having the same number of cells as RAID width W. The cells are distributed over W SSDs. The containers are subdivided into equal-size data devices, each distributed over the same set of W SSDs as its associated container. Candidate migration source-target pairs are selected using heuristics guided by a prediction model that correlates disk wear rate with total writes of existing workloads. Wear rate predictions are computed using a weighted sum of write rates of all data devices on a disk. Wear rate predictions for candidate migration pairs are computed inclusive of additional wear caused by data migration to select a migration plan.

A method, comprising: identifying, by a processing circuitry of a storage device controller, a plurality of memory portions of a volatile memory of the storage device controller; generating one or more data structures that map each of the plurality of memory portions to a different one of a plurality of logical drives; using each of the plurality of memory portions to exclusively cache data for the one of the plurality of logical drives that is mapped to that memory portion, such that none of the memory portions is used to cache data for any of the plurality of logical drives other than the logical drive that is mapped to that memory portion; detecting a failure of a given one of the plurality of logical drives; identifying the one of the plurality of memory portions that is mapped to the given logical drive; and blocking the identified memory portion.

The invention provides a modular data center machine room system, and belongs to the technical field of intelligent machine rooms, the modular data center machine room system comprises a plurality of stackable functional unit modules, and each functional unit module comprises a composite load-bearing frame, an integrated standardized mechanical interface and an electrical fast-assembly interface; the computing unit supports plug and play of heterogeneous computing equipment; the storage unit supports RAID hot plug of the mixed medium; the network unit provides a programmable switching matrix; the power supply unit is internally provided with a multi-mode adapter and is compatible with AC / DC input and lithium battery / super capacitor hybrid energy storage; and the central intelligent management platform monitors the real-time load rate and the energy efficiency ratio of each module, coordinates the resources of each module, detects the interface attribute of a new module and configures a network address when judging that the new module needs to be accessed, executes a topology reconstruction instruction, carries out topology reconstruction and outputs a prompt. Compared with the prior art, the crossing from a fixed framework to elastic ecology is realized.

The invention discloses a disk capacity expansion method and device, equipment and a storage medium, and relates to the technical field of storage, in the disk capacity expansion method, under the condition that a bad disk is detected during disk array capacity expansion, at least one original stripe before capacity expansion is determined according to an abnormal stripe containing the bad disk after capacity expansion; restoring the bad disk data element according to the check code in the original stripe and the normal data element in the original stripe to obtain a restored target data element; then determining a target stripe according to the restored target data element and the normal data element in the abnormal stripe; writing the target strip into a reserved area of any normal disk; and finally, under the condition that a preset migration condition is met, migrating the target strip stored in the reserved area to the expanded target disk array. According to the method and the device, on the premise of ensuring the data consistency of the RAID system, the continuous capacity expansion under the condition that the disk breaks down during the online capacity expansion of the RAID can be realized.

The invention provides a hard disk state monitoring method and device, equipment, a storage medium and a product, and relates to the technical field of computers.The method comprises the steps that a BMC regularly sends a SMART query instruction to an RAID, and fault index data of a hard disk with out-of-band connection is obtained; based on the fault index data, adopting a weighted comprehensive calculation method to generate a health score value of the hard disk; judging the health state of the hard disk according to the health score value; if the score value is greater than a preset threshold value, marking as a sub-health state; and triggering an alarm for the hard disk in the sub-health state and setting the hard disk in a read-only access mode. The SMART fault index data of the out-of-band hard disk is regularly acquired through the BMC, and the health score is generated based on the weighted comprehensive calculation method, so that the real-time monitoring and accurate judgment of the sub-health state of the hard disk are realized, the problem that the sub-health state of the out-of-band hard disk is difficult to find in time in the prior art is effectively solved, the data loss risk is reduced, and the safety of the out-of-band hard disk is improved. And the reliability of the server system is improved.

The invention discloses a cache dynamic allocation method and device for a storage hardware device, and relates to the technical field of cache dynamic allocation, and the method comprises the steps: obtaining multi-dimensional perception data corresponding to an RAID card, matching a corresponding dynamic decision engine, and carrying out cache dynamic allocation in combination with a QoS virtual channel and resource isolation and a preemptive resource recovery mechanism, the problems that in the related technology, a single-index offline training model is excessively depended, multi-dimensional perception is lacked, and traffic processing has large delay are solved; besides, during resource allocation competition, service interference is easily caused, the hardware cost for deploying an intelligent algorithm is high, and the cache allocation efficiency is greatly influenced are solved, and the purposes of avoiding write cache full and forced degradation into a write-through mode, remarkably improving I / O response stability, eliminating high-temperature downtime and cache data loss risks and improving the cache allocation efficiency are achieved. And the delay fluctuation and the hardware deployment cost are reduced.

The invention provides an RDMA-based big data transmission and storage system and method and a semiconductor detection device.The big data transmission and storage system comprises a hardware layer and a software layer, the hardware layer comprises an NVMe SSD storage array, an NVMe RAID acceleration card based on a GPU architecture and an RDMA network card, and the software layer comprises an NVMe SSD storage array, an NVMe RAID acceleration card based on the GPU architecture and an RDMA network card; the software layer comprises a multi-thread transmission module, a self-adaptive memory pool module, a transmission control module, a data verification and retransmission module, a scheduling and optimizing module and a disk falling and storage management module. According to the method, multi-channel transmission parallelization is achieved through data direct connection, zero copy transmission, RAID acceleration and multi-thread parallel RDMA transmission in a hardware link, data is directly connected and transmitted from a memory to the NVMe SSD storage array, data receiving and disk falling thread decoupling directly access the NVMe SSD storage array through asynchronous writing, network overload or storage blockage is avoided, and the data transmission efficiency is improved. The data transmission efficiency and reliability are high, and popularization and application in scenes needing large-scale image transmission processing such as semiconductor detection are facilitated.

A Redundant Array of Independent Disks (RAID) scheme can be used to allow recovery from a memory failure. RAID 6 can be used to recover data from up to two catastrophic failures. Typically, a hardware encoder is used to generate parities of the RAID 6 protection scheme, and a separate hardware decoder is used in the data recovery process. In an example data storage device described herein, some of the components of the hardware encoder are used to perform the data recovery process, thereby eliminating the need for a separate, additional hardware component.

The invention relates to the technical field of storage equipment, and particularly discloses an RAID card high-availability device and method based on a multi-path cluster, and the device comprises at least two RAID cards; the RAID engine is used for processing RAID read-write data, configuring RAID levels and processing hard disk hot plug; the front-end multi-path module is used for establishing a plurality of data channels with a host and exposing a virtual disk with the same NGUID to the host, so that the host multi-path module can access the virtual disk in an aggregated manner; the rear-end multi-path module is used for establishing a multi-path data channel with the dual-port hard disk, transmitting read-write data and commands of the dual-port hard disk, and realizing disk access link redundancy and fault automatic switching; the system management module is used for processing internal and external management control events, state conversion and internal processes of the RAID card; the cluster management module is used for establishing communication channels among the RAID cards, maintaining heartbeat information among the RAID cards and managing cluster node states; the problem of single-point failure of a traditional RAID card is solved, and the reliability and performance of a system are improved.

In a locked RAID memory system, the present method generates variable-length compressed data in a RAID stripe, which is stored along with the inclusion of a single RAID parity segment (parity strip) for the entire stripe. If any one data segment (data strip) in the RAID stripe should fail, as determined by a CRC check, the data can be recovered by XORing the single RAID parity segment with all the non-errored data segments in the stripe. However, in order to determine which data segment has failed, successive data segments must be XORed, and the CRC check reperformed, until the CRC error stands corrected. In an embodiment, the successive data segments may be tested in parallel with suitable hardware. In an embodiment, the successive data segments may be tested sequentially, or semi-in-parallel and semi-sequentially.