729 results about "RAID" patented technology

The invention relates to the technical field of data storage and processing, in particular to an RAID card static cache management method and device based on data popularity, and the method comprises the steps that the physical position of a data block needing to be accessed in an SSD array is acquired according to a read-write request; historical data access information of the RAID card is collected, a historical data set is generated, and a neural network model is trained by using the historical data set to obtain a cache management model; predicting and outputting data blocks which are possibly accessed in the future and the access probability of the data blocks through the cache management model; the RAID controller dynamically adjusts a cache strategy in combination with an LRU strategy according to a prediction result output by the cache management model and a read-write request of a file system, and optimizes a storage position and an updating mechanism of a data block in a cache space; and when the hit rate or the data access efficiency does not reach the preset value, adjusting the parameters of the cache strategy and updating the cache strategy. According to the method, cache resources can be more effectively distributed, the cache hit rate is improved, the cache replacement overhead is reduced, and therefore the performance of a storage system is optimized.

The invention relates to the technical field of data storage, in particular to a dynamic data distribution storage method and system for an RAID (redundant array of independent disks), and the method comprises the following steps: based on the access frequency of data blocks in a disk, recording the access frequency and timestamp of each data block, carrying out heat rating on the data blocks, and determining thresholds of hot data and cold data. According to the method, the dynamic distribution of data storage is effectively optimized by analyzing the access frequency of the data blocks, and the performance and the economic efficiency of a storage system are remarkably improved by migrating the frequently accessed data to the cache disk and migrating the less accessed data to the low-cost storage; according to the method, unnecessary occupation of high-performance storage resources is reduced, the operation cost is also reduced, heat rating is performed on the data blocks, and the storage positions of the data blocks are correspondingly adjusted, so that the data processing speed is higher, meanwhile, the data security is improved, when a hard disk fails, data recovery is faster, and the service continuity is ensured.

The invention discloses a solid state disk controller, a solid state disk and a storage system, and relates to the technical field of storage, and the solid state disk controller comprises a communication endpoint unit which is used for determining a target working mode according to a control instruction sent by host equipment; if the target working mode is an exclusive-or accelerator mode, calling an exclusive-or computing engine, and processing a direct-connection disk management operation task issued by the host equipment; wherein the direct connection disk management operation task comprises a parity check operation task corresponding to disk equipment connected with the host equipment; the XOR calculation engine is used for carrying out operation processing on the direct connection disk management operation task according to the control of the communication endpoint unit; hardware acceleration of the RAID function of the host equipment is achieved through the solid state disk controller in the solid state disk connected with the host equipment, the burden of a host CPU is relieved, special hardware equipment does not need to be additionally arranged, and balance of high performance and low cost is achieved.

The invention relates to the technical field of data compression, and particularly discloses a method for realizing data compression in an RAID card and an RAID control chip, and the method comprises the following steps: S1, receiving a plurality of IO writing commands issued by a host, and obtaining the logic block address and length of each IO; s2, executing a merging operation on the plurality of IOs to generate a merged IO block; s3, performing a data compression operation on the merged IO block through a data compression engine to obtain compressed data; s4, establishing a mapping relation from a logic block address to a physical block address of the compressed data, and storing the mapping relation in a logic-to-physical mapping table; s5, the compressed data are written into a solid state disk through an RAID engine, and meanwhile, logic-to-physical mapping table metadata are stored persistently; s6, sending a recovery command or a zero-writing command to the solid state disk recovery space for the address space which is not used after compression; the problem that an existing SSD compression scheme is high in power consumption is solved, reliability is better, original user data content is closer, and the obtained compression effect is better.

The invention relates to the technical field of computers, and discloses a data management method and device, computer equipment and a storage medium, and the method comprises the following steps: obtaining target data of a disk array; grouping the target data to obtain corresponding grouped data under each preset category; writing the grouped data into the corresponding storage positions; after the storage fault corresponding to the disk array is recovered, data to be recovered are obtained in the storage position according to the preset reading sequence, the data to be recovered are utilized to recover the data of the disk array, and the data to be recovered are contained in the target data. The problems that when RAID data are stored, write-in operation needs to be repeatedly carried out, so that storage space loss is caused, and the storage process is very time-consuming due to log introduction are solved.

The invention provides a data transmission efficiency improving method and device, equipment and a storage medium, and the method comprises the steps: carrying out the equipment recognition and address space mapping of expansion card equipment connected with a PCIe interface on a GPU, and obtaining GPU data transmission configuration information; according to the configuration information, carrying out storage space division and transmission channel establishment on the expansion card equipment to obtain a GPU data transmission channel configuration result; scheduling and distributing the GPU data to be transmitted based on the configuration result and a preset CUDA (Compute Unified Device Architecture) shared storage mechanism to obtain a data transmission execution scheme; and starting, controlling, monitoring in real time and dynamically adjusting the transmission process of the data to be transmitted according to the execution scheme and a preset RAID (Redundant Array of Independent Disks) disk array. According to the method, the expansion card equipment and the RAID disk array are introduced, and a CUDA shared storage mechanism is combined, so that the available storage space of the GPU is effectively expanded, the data transmission process is optimized, the data transmission efficiency when the GPU processes a large-scale data set is remarkably improved, and meanwhile, relatively low hardware cost is kept.

A method of data storage based on a redundant array of independent disks (RAID), where the RAID includes a plurality of solid state drives (SSD), each SSD including a persistent memory region (PMR) and a NAND, includes writing first data into the NAND, and writing first check data into the PMR. The first check data is check data related to the first data.

In various examples, data storage is managed using a distributed storage management system that is resilient. Data blocks of a logical block device may be distributed across multiple nodes in a cluster. The logical block device may correspond to a file system volume associated with a file system instance deployed on a selected node within a distributed block layer of a distributed file system. Each data block may have a location in the cluster identified by a block identifier associated with each data block. Each data block may be replicated on at least one other node in the cluster. A metadata object corresponding to a logical block device that maps to the file system volume may be replicated on at least another node in the cluster. Each data block and the metadata object may be hosted on virtualized storage that is protected using redundant array independent disks (RAID).

The disclosure configures a memory sub-system controller to perform Redundant Array of Independent Disks (RAID) stripe deletion based on physical region size. The controller stores a set of data across a plurality of memory components, a first of the plurality of components being configured to store data in a first set of regions, a second of the plurality of components being configured to store data in a second set of regions. The controller generates a plurality of error correction parity information stripes for multiple collections of the set of data and computes a quantity of the plurality of error correction parity information stripes to delete based on sizes of each region in the first and second sets of regions. The controller deletes one or more of the plurality of error correction parity information stripes based on the computed quantity.

The invention relates to a method, and an apparatus for programming data into flash memory. The method includes: reading operating settings of a virtual carrier; setting a redundant array of independent disks (RAID) engine for driving the RAID engine to complete a designated encryption or encoding operation on first data associated with the virtual carrier when the operation settings indicate that the first data associated with the virtual carrier need to go through a mid-end processing stage; and sending a programming index to a data access engine for driving the data access engine to read a programming table from the SRAM, and program the second data associated with the virtual carrier into a designated address in a flash module when the operation settings indicate that the second data associated with the virtual carrier need to go through the back-end processing stage.

The embodiment of the invention provides a hard disk state indicator lamp control method and device, equipment and a storage medium. The method comprises the following steps: after a CPLD (Complex Programmable Logic Device) receives data through an SGPIO (Serial General Purpose Input / Output) interface, determining a hard disk state indication signal according to an effective flag bit and an overtime detection flag bit generated in a receiving process; wherein the effective flag bit is generated on the basis that the number of falling edges of a clock signal obtained in the data receiving process meets the number of clocks generated when the SGPIO interface sends a frame of data, and the overtime detection flag bit is used for indicating whether the SGPIO interface is suspended or not. The method is used for achieving the effect that when the Raid card is restarted to cause the SGPIO interface to be suspended, the CPLD is prevented from mistakenly reporting that a certain hard disk breaks down, so that the hard disk state indicator lamp is correct in indication.

A storage device may carve out redundant array of independent disks (RAID) and reduce write amplification when writing data to the RAID. The storage device includes multiple flexible data placement drives that are configured to execute RAID techniques. A controller on the storage device may receive data from a host. The controller obtains reclaim unit handles from the data to determine locations where the data is to be stored on the flexible data placement drives. During storage, the controller stripes the data in parallel across reclaim units within different reclaim groups and endurance groups across a single flexible data placement drive or multiple flexible data placement drives. The storage device leverages the write amplification of the flexible data placement drives to reduce a write amplification factor on the RAID.

Systems, methods, and computer-readable storage devices can include fabric networks for isolating and correcting failures in the fabric network and device failures. The fabric network connects to a group of devices and a host. The group of devices includes at least a target data device, other data devices, and a parity device. A redundant array of independent devices (RAID) engine, which is coupled to the one group of devices, performs an access operation. The fault tolerant engine is provided in a leaf switch of the fabric network. A routing processor determines a path for a request received from the host to the target data device. The routing processor is coupled to the fault tolerant engine, and the routing processor is provided in the leaf switch.

The present application provides a complex programmable logic device (CPLD)-based data processing method and system, and a computing device. The CPLD is arranged on a hard disk backplane of a server, and the hard disk backplane supports a universal backplane management (UBM) protocol; the hard disk backplane comprises an HFC connector for connecting to a RAID controller and a DFC connector for connecting to a hard disk slot, and the CPLD is connected to the HFC connector and the DFC connector, respectively. The method comprises: when a hard disk is inserted into the hard disk slot, determining an interface type of the hard disk according to a signal level transmitted by the DFC; processing interaction data between the RAID controller and the hard disk according to the hard disk interface type, wherein the interaction data comprises data indicating the hard disk interface type, data indicating a hard disk state and read / write operation command data; and transmitting the processed data to the RAID controller or the hard disk so as to achieve hard disk management, wherein the hard disk comprises a hard disk of an SAS / SATA / NVME interface type. In this way, new logic functionality is added to an existing logic chip of the hard disk backplane to achieve the functionality of the UBM protocol.

A RAID integrity verification system includes a chassis housing a software RAID subsystem that is coupled to storage devices and configured to provide a logical storage device using the storage devices. A management subsystem in the chassis is coupled to the storage devices and retrieves first RAID configuration information associated with the logical storage device from each of the storage devices and uses it to generate a first RAID logical storage device integrity verification measurement block. Subsequently, the management subsystem retrieves second RAID configuration information associated with the logical storage device from each of the storage devices and uses it to generate a second RAID logical storage device integrity verification measurement block. If the management subsystem determines that the second RAID logical storage device integrity verification measurement block does not match the first RAID logical storage device integrity verification measurement block, it performs RAID logical storage device integrity remediation operation(s).

The invention provides an RAID (redundant array of independent disks) data processing method and device, a chip, electronic equipment, a storage medium and a computer program product, and is applied to RAID, the method comprises the following steps: detecting that at most three storage devices fail, determining at most three corresponding to-be-recovered areas in a stripe, and storing the to-be-recovered areas in the stripe; the to-be-recovered area is a data area, a verification area, a first hot standby area and / or a second hot standby area; determining a target area based on at most three areas to be recovered, wherein the target area is a data area, a verification area, a first hot standby area and / or a second hot standby area except the areas to be recovered; and target information in the target area is read, and the data information and / or the first verification information of the to-be-recovered area are / is recovered based on the target information.

A direct-attached storage device software RAID control communication system includes a chassis housing a software RAID subsystem coupled to an operating system and a controller device. The software RAID subsystem provides a virtual adapter device and a virtual miniport driver for the operating system, provides a physical miniport driver for the controller device, and provides a helper driver between the virtual miniport driver and the physical miniport driver. The helper driver identifies, via the physical miniport driver, a communication entry point for the controller device and logical storage subsystem(s) provided by storage device(s) connected to the controller device, and identifies them to the virtual miniport driver. The virtual miniport driver then presents a logical storage device to the operating system that includes at least some of the logical storage subsystem(s), and uses the communication entry point to transmit communications between the operating system and the physical miniport driver.

A direct-attached storage device software RAID crash dump system includes a chassis housing a software RAID subsystem coupled to physical storage devices, controller devices, and a hypervisor subsystem. The software RAID subsystem presents a primary controller device to the hypervisor subsystem as being connected to a logical storage device provided by the physical storage devices. When the software RAID subsystem receives a first crash dump command from the hypervisor subsystem directed to the primary controller device and identifying a crash dump logical storage subsystem in the logical storage device, it transmits a respective second crash dump command to each of a subset of the physical storage devices that provide the crash dump logical storage subsystem via a respective controller device that couple the software RAID subsystem to that physical storage device, confirms completion of the respective second crash dump commands, and transmits a crash dump confirmation to the hypervisor subsystem.

A direct-attached storage device software RAID crash dump system includes a chassis housing a software RAID subsystem coupled to physical storage devices, controller devices, and a hypervisor subsystem. The software RAID subsystem presents a primary controller device to the hypervisor subsystem as being connected to a logical storage device provided by the physical storage devices. When the software RAID subsystem receives a first crash dump command from the hypervisor subsystem directed to the primary controller device and identifying a crash dump logical storage subsystem in the logical storage device, it transmits a respective second crash dump command to each of a subset of the physical storage devices that provide the crash dump logical storage subsystem via a respective controller device that couple the software RAID subsystem to that physical storage device, confirms completion of the respective second crash dump commands, and transmits a crash dump confirmation to the hypervisor subsystem.

The invention relates to a server disk RAID state monitoring method and device and a readable storage medium. The method comprises the steps that the health state of a battery backup unit is judged according to RAID hardware information; obtaining SMART attribute information to judge the health state of a server disk; obtaining the state of a server disk RAID array, reconstruction progress information and availability information of a hot spare disk so as to judge the performance of the server disk; when the RAID array has the degradation state, a fault disk corresponding to the degradation state in the RAID array is determined, reconstruction of the RAID array is automatically triggered, replacement operation of the fault disk is executed, and alarm information is sent to an upper computer; the RAID hardware information, the SMART attribute information, the state of the RAID array, the reconstruction progress information, the availability information of the hot spare disk and the position information of the fault disk are uploaded to a log file; and encrypting the log file by using an AES algorithm. The accuracy of the method for monitoring the RAID state of the server disk and the safety and reliability of the log file are improved.

The embodiment of the invention provides an RAID fault simulation method and device, relates to the technical field of computer system structure storage and can also be used for the financial field, and the method comprises the steps that an RAID array of a corresponding level is constructed based on the preset number of RAID array hard disks and a hard disk list forming an RAID; performing parameter control on the constructed RAID array to construct a corresponding fault model, wherein the fault type of the fault model comprises at least one of a hard disk type fault, a control and configuration type fault, a logic fault and a read-write slow fault; determining a corresponding fault injection instruction and a fault recovery instruction according to the fault model, and inputting the instructions to a tested system, so that the tested system performs fault simulation; the RAID fault simulation method and device can solve the problems that the current RAID fault simulation cost is high, and hardware dependence, professional software dependence and manual operation dependence exist.

The invention discloses an encryption and decryption method, system, device and equipment and a storage medium, and relates to the technical field of data security of a storage system.The encryption and decryption method comprises the steps that a system password is received through an RAID controller, a derived password is generated in combination with a pre-stored random number salt value and an encryption key, and the derived password is sent to the RAID controller; and converting the password into a readable password conforming to the password rule of the self-encryption disk, and encrypting and storing the readable password so as to control the locking or unlocking of the self-encryption disk. According to the method, the salt value and the encryption key are stored in advance, so that the exposure of a plaintext password is avoided, the problems of performance bottleneck and key storage security risk caused by centralized encryption of a traditional RAID controller are solved, meanwhile, the encryption characteristic of the self-encryption disk is utilized, automatic encryption during data storage and automatic locking after power failure are realized, and the security of data storage is improved. The technical effects of reducing the calculation load, improving the key security and guaranteeing the end-to-end encryption of the data storage are achieved, so that RAID redundancy and the security mechanism of the self-encryption disk are deeply combined, and the data protection capability of the whole system is enhanced.

The invention discloses a fault reconstruction method, device and equipment for a mechanical hard disk and a storage medium, and relates to the technical field of storage, and the method comprises the following steps: obtaining fault area information of a current fault hard disk in a disk array group; wherein the fault area information is information of a strip of a disk array group where a fault occurring in the current fault hard disk is located; the fault area information comprises a fault hard disk identifier and a fault strip identifier; determining a target reconstruction region corresponding to the fault region information; wherein the target reconstruction area is an area in the current mechanical hard disk; reconstructing data of a fault area in the current fault hard disk in the target reconstruction area, and recording a corresponding relation between the target reconstruction area and the fault area; reconstruction is still carried out on the faulty mechanical hard disk, a new disk does not need to be inserted, the reconstruction efficiency of the RAID group and the utilization rate of the faulty mechanical hard disk are improved, the cost is greatly reduced, and therefore the IO performance of a host is improved.

The invention discloses a hard disk operation method, system and device and a computer readable storage medium, and relates to the technical field of storage, and the method comprises the steps: obtaining a target request for carrying out target operation on a redundant array group of independent disks; determining a target hard disk needing to be operated according to the target request; splitting the target request into target sub-requests for operating a target hard disk; generating correlation information between the target sub-request and the target operation; adding the target sub-request to a first processing queue corresponding to the target hard disk in response to the fact that the correlation information meets a set strong correlation condition; adding the target sub-request to a second processing queue corresponding to the target hard disk in response to the fact that the correlation information does not meet the strong correlation condition; and if the first processing queue is empty, operating the target hard disk according to the first processing queue, and if the first processing queue is empty, operating the target hard disk according to the second processing queue. And the target sub-request strongly related to the target operation is preferentially processed in the target hard disk, so that the data processing efficiency is ensured.

The invention provides an RAID (Redundant Array of Independent Disk) implementation method based on FPGA (Field Programmable Gate Array) hardware acceleration, which comprises the following steps of: transferring a control authority of kernel storage equipment to a user mode based on a UIO (Universal Input / Output) technology, and constructing a disk management module in the user mode to reduce the switching frequency between the user mode and a kernel mode; a shared memory area is established between the kernel module and the disk management module, and efficient interaction between a kernel and a user mode is achieved; and an FPGA hardware card is introduced into the disk management module, and the FPGA hardware card verification calculation logic is configured according to the RAID mode and the data access type. Aiming at the problems of high user mode and kernel mode switching overhead, low transmission efficiency of data between a user mode and a kernel mode and the like caused by frequent user program memory access requests in an existing RAID system, the method comprises the following steps: firstly, optimizing equipment management by utilizing a UIO technology, extracting a disk management function from a kernel to an application layer, and establishing a disk management module; frequent context switching caused by a user program request is reduced, and time and resource expenses are reduced.

A system for dynamic sequence alignment and causal analysis in business mining, consisting of a data acquisition unit configured to capture real-time event logs from multiple enterprise systems via communication interfaces, wherein the data acquisition unit includes a variety of communication interfaces, including Ethernet ports, fiber optic interfaces, and wireless transceivers, enabling data acquisition from both local and remote enterprise systems, and wherein the unit is capable of processing multiple data streams simultaneously via parallel data acquisition channels; a preprocessing unit configured to normalize and transform the captured event logs using signal processors and real-time data converters; a sequence alignment processing unit configured with a central processing unit (CPU), a graphics processing unit (GPU) and a field-programmable gate array (FPGA) to dynamically align sequences of business events using machine learning; a causal inference processing unit configured with multiple central processing units (CPUs) and neural network accelerators to analyze the aligned sequences and infer causal relationships between business events; a visualization unit configured to display the aligned sequences and results of the causal analysis on user interface devices; and a data storage unit configured with solid-state drives (SSDs) and a redundant array of independent disks (RAID) to store event logs, aligned sequences, and causal analysis data.

A system and related method, the system including control circuitry and memory with a first memory block of a first memory density and a second memory block of a second memory density which is greater than the first memory density. Control circuitry, which is communicatively coupled to the memory, is configured to determine to transfer data from the first memory block to the second memory block, generate parity data based on the data and cause to store the parity data at a parity address corresponding to an available portion of the first memory block. Control circuitry is further to cause to update a look-up table with the parity data address and cause to copy the data from the first memory block to the second memory block.

The disclosure configures a memory sub-system controller to perform Redundant Array of Independent Disks (RAID) stripe deletion based on physical region size. The controller stores a set of data across a plurality of memory components, a first of the plurality of components being configured to store data in a first set of regions, a second of the plurality of components being configured to store data in a second set of regions. The controller generates a plurality of error correction parity information stripes for multiple collections of the set of data and computes a quantity of the plurality of error correction parity information stripes to delete based on sizes of each region in the first and second sets of regions. The controller deletes one or more of the plurality of error correction parity information stripes based on the computed quantity.

A method for performing data access management of a memory device in predetermined communications architecture to enhance sudden power off recovery (SPOR) of page-group-based redundant array of independent disks (RAID) protection with aid of suspendible serial number and associated apparatus are provided. The method may include: utilizing the memory controller to write preceding data and metadata thereof into at least one set of preceding pages in a first active block to make the metadata carry at least one preceding serial number; writing dummy data and other metadata into at least one set of dummy pages in the first active block to make the other metadata carry at least one suspended serial number which is equal to a last serial number among the at least one preceding serial number; and utilizing the memory controller to write subsequent data and metadata thereof to make it carry at least one subsequent serial number.

The embodiment of the invention relates to the field of computers, in particular to a construction method and system of an annular cache region, a storage medium and electronic device.The construction method of the annular cache region comprises the steps that whether an RAID card supports the host memory buffering characteristic or not is determined; under the condition of determining that the RAID card supports the host memory buffer characteristic, allocating a memory space for the RAID card; and sending an enabling instruction to the RAID card, so that the RAID card constructs an annular cache region in the memory space according to the enabling instruction and the host memory buffer characteristic, and the annular cache region is used for storing data written into the host by the RAID card. Through the embodiment of the invention, the problem of insufficient data storage capacity caused by limited hardware resources for running of RAID card firmware in related technologies can be solved.