Compatible processing method and system, electronic equipment and computer readable medium

Through virtualization technology, CXL and PCIe hard disks are integrated into a unified virtual resource pool, which solves the compatibility problem in the storage environment, realizes efficient resource management and performance optimization, and improves system compatibility and scalability.

CN118916315APending Publication Date: 2024-11-08INSPUR SUZHOU INTELLIGENT TECH CO LTD

Patent Information

Application Number
CN202410954043.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-16
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Compatibility issues of PCIe and CXL hard drives in virtualized storage environments lead to management complexity and high cost, limiting their wide application.

Method used

By virtualizing CXL and PCIe hard disks into virtual storage units and integrating them into a unified virtual resource pool, virtualization management modules are used for resource allocation and performance optimization, seamless docking and dynamic resource adjustment are achieved.

Benefits of technology

It improves system compatibility and scalability, enhances the overall efficiency and user experience of the storage system, and can dynamically adjust resource allocation according to application needs, and adapt to different load conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118916315A_ABST
    Figure CN118916315A_ABST
Patent Text Reader

Abstract

The invention provides a compatible processing method and system, electronic equipment and a computer readable medium, and relates to the technical field of storage, and the method comprises the following steps: accessing at least one CXL hard disk and at least one PCIe hard disk into a storage system; analyzing communication protocols of the CXL hard disk and the PCIe hard disk, and converting the communication protocols into communication protocols compatible with the virtual resource pool; under the condition that the communication protocols of the CXL hard disk and the PCIe hard disk are analyzed and converted successfully, virtualizing the CXL hard disk and the PCIe hard disk into virtual storage units, and integrating the virtual storage units into a virtual resource pool; and in response to a resource request of the target application, allocating storage resources of the virtual storage unit in the virtual resource pool to the target application through the virtualization management module. According to the method, seamless connection between the CXL hard disk technology and the PCIe hard disk technology is achieved, the compatibility of the system is improved, the expansibility of the system is enhanced, and the storage system can dynamically adjust resource allocation according to needs.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of storage technology, and in particular to a compatible processing method, system, electronic device and computer-readable medium. Background Art

[0002] PCI Express (PCIe) and Compute Express Link (CXL) are two advanced storage interface technologies that have demonstrated unique advantages in their respective application fields. As a relatively new technology, CXL's ecosystem and application scenarios are still evolving, and its compatibility issues with traditional PCIe systems are particularly prominent, limiting its potential for widespread application.

[0003] Although related technologies attempt to solve the compatibility issues between PCIe and CXL through interface conversion and bridging technology, they often involve complex signal conversion and protocol adaptation, which may introduce additional delays and costs. In addition, the high cost and technical complexity make it difficult for this solution to be popularized in practical applications. Therefore, a new solution is urgently needed to achieve effective compatibility between CXL hard drives and PCIe hard drives and optimize their integration and management in virtualized storage environments. Summary of the invention

[0004] The embodiments of the present disclosure provide a compatible processing method, system, electronic device and computer-readable medium, aiming to solve the problems existing in the above-mentioned background technology.

[0005] In order to solve the above technical problems, the present disclosure is implemented as follows:

[0006] In a first aspect, an embodiment of the present disclosure provides a compatibility processing method, the method comprising:

[0007] Connect at least one CXL hard disk and at least one PCIe hard disk to the storage system;

[0008] Parsing the communication protocol of the CXL hard disk and the PCIe hard disk and converting them into a communication protocol compatible with a virtual resource pool, wherein the virtual resource pool is a collection of at least one virtual storage unit;

[0009] When the communication protocols of the CXL hard disk and the PCIe hard disk are parsed and converted successfully, the CXL hard disk and the PCIe hard disk are virtualized into virtual storage units and integrated into the virtual resource pool;

[0010] In response to a resource request of a target application, a storage resource of a virtual storage unit in the virtual resource pool is allocated to the target application through a virtualization management module.

[0011] Optionally, the responding to the resource request of the target application includes:

[0012] The resource request of the target application is received through a standardized storage access interface, and the storage access interface provides a consistent access method for the target application.

[0013] Optionally, in response to the resource request of the target application, allocating storage resources of the virtual storage unit in the virtual resource pool to the target application through the virtualization management module includes:

[0014] In response to the resource request of the target application, the virtualization management module allocates storage resources of the virtual storage unit in the virtual resource pool to the target application according to the resource request of the target application and resource usage evaluation.

[0015] Optionally, the virtualization management module is configured with a monitoring tool and a performance optimization tool; the method further comprises:

[0016] By means of the monitoring tool, the performance indicators of the virtual resource pool are continuously detected, wherein the performance indicators include: input / output throughput and input / output delay;

[0017] When it is detected that the performance indicator of the virtual resource pool is abnormal, the abnormal performance indicator is optimized accordingly by using the performance optimization tool.

[0018] Optionally, the virtualization management module is configured with a fault detection tool; the method further includes:

[0019] By means of the fault detection tool, the state and performance of the virtual storage unit in the virtual resource pool are regularly checked, and according to the state and performance of the virtual storage unit, whether the virtual storage unit is faulty is determined;

[0020] When a virtual storage unit failure is detected, the failed virtual storage unit is located and repaired accordingly.

[0021] Optionally, the method further comprises:

[0022] Encrypting data of storage resources written into the virtual storage unit and decrypting data of storage resources read out of the virtual storage unit;

[0023] Setting different levels of access permissions for different virtual storage units in the virtual resource pool and monitoring abnormal access behaviors, wherein the access permissions are used to verify the identity of users accessing the virtual storage units;

[0024] Regularly backing up the storage resources of the virtual storage units in the virtual resource pool, and storing the backup data in a remote server;

[0025] When it is detected that the storage resources of the virtual storage unit in the virtual resource pool are lost or fail, the corresponding storage resources are obtained from the backup data stored in the remote server to perform data recovery.

[0026] In a second aspect, an embodiment of the present disclosure provides a storage system applied to a compatible processing method, the system comprising:

[0027] At least one CXL hard disk and at least one PCIe hard disk;

[0028] A virtual resource pool is a collection of at least one virtual storage unit, where the virtual storage unit is obtained by virtualizing the CXL hard disk and the PCIe hard disk;

[0029] The virtualization management module is used to manage the virtual storage units in the virtual resource pool.

[0030] In a third aspect, an embodiment of the present disclosure provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the steps of a compatible processing method when executed by the processor.

[0031] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored, and the computer program implements the steps of the compatible processing method when executed by a processor.

[0032] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects:

[0033] The present disclosure virtualizes CXL hard disks and PCIe hard disks into virtual storage units and integrates them into a unified virtual resource pool to achieve seamless connection between CXL hard disks and PCIe hard disk technologies, which not only improves the compatibility of the system, but also enhances its scalability, so that the storage system can dynamically adjust resource allocation as needed. At the same time, the present disclosure better adapts to the changing application requirements and load conditions of different upper-layer applications through a dynamic resource allocation mechanism, thereby improving the overall performance of the system and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0035] Figure 1It is a schematic diagram of the steps of a compatibility processing method provided by an embodiment of the present disclosure;

[0036] Figure 2 It is a flowchart of a complete compatibility processing method provided by an embodiment of the present disclosure;

[0037] Figure 3 It is a structural block diagram of a compatible processing system provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0038] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0039] In large data centers, multiple servers need to efficiently manage and utilize storage resources. Traditional storage systems often face problems such as a wide variety of hardware, complex management, and low resource utilization. In particular, when a data center uses CXL hard drives and PCIe hard drives at the same time, the compatibility issues caused by different interface standards further increase the difficulty of management. The present disclosure proposes to abstractly integrate all CXL hard drives and PCIe hard drives into a unified virtual resource pool based on virtualization technology. In this way, administrators do not need to worry about the specific hard drive type and can access and manage them through a unified interface.

[0040] Figure 1 is a schematic diagram of the steps of a compatibility processing method provided by an embodiment of the present disclosure, such as Figure 1 As shown, the method includes:

[0041] Step S101, connecting at least one CXL hard disk and at least one PCIe hard disk to a storage system;

[0042] Step S102, parsing the communication protocol of the CXL hard disk and the PCIe hard disk, and converting them into a communication protocol compatible with a virtual resource pool, where the virtual resource pool is a collection of at least one virtual storage unit;

[0043] Step S103, when the communication protocols of the CXL hard disk and the PCIe hard disk are parsed and converted successfully, the CXL hard disk and the PCIe hard disk are virtualized into virtual storage units and integrated into the virtual resource pool;

[0044] Step S104: In response to a resource request of a target application, a storage resource of a virtual storage unit in the virtual resource pool is allocated to the target application through a virtualization management module.

[0045] Involving step S101, CXL (Compute Express Link) is an open high-bandwidth, low-latency interconnection standard designed for connecting high-performance computing devices such as processors, accelerators, and memory expansion. CXL hard drives use this standard to provide fast data transmission and access capabilities. CXL hard drives are usually directly connected to the CXL slot on the motherboard through the CXL interface, supporting high-bandwidth, low-latency data transmission. PCIe (Peripheral Component Interconnect Express) is a high-speed serial computer expansion bus standard widely used in computer expansion cards and storage devices. PCIe hard drives provide high-performance data transmission based on this standard. PCIe hard drives are connected to the motherboard through PCIe slots, and common ones include M.2 interfaces, U.2 interfaces, etc., support NVMe protocols, and provide high throughput and low-latency storage performance. CXL hard drives and PCIe hard drives are connected to the storage system of the server through corresponding interfaces, that is, the CXL hard drive is connected to the CXL slot on the motherboard of the storage system through the CXL interface, and the PCIe hard drive is connected to the PCIe slot on the motherboard of the storage system through the PCIe interface.

[0046] Involving step S102, since the CXL hard disk and the PCIe hard disk use different communication protocols, it is necessary to parse their communication protocols separately. The CXL hard disk uses the CXL protocol, and the PCIe hard disk usually uses the NVMe protocol to communicate through the PCIe bus. In a specific implementation, the storage system reads the data transmission protocol of the CXL hard disk, and parses its commands, data structure, and communication mode. Similarly, the storage system reads the data transmission protocol of the PCIe hard disk, and parses its command set, data transmission mode, and interface specification. After parsing the communication protocols of the CXL and PCIe hard disks, it is necessary to convert these protocols into a unified protocol compatible with the virtual resource pool. In order to be compatible with different types of hard disks, it is necessary to design a unified virtual storage protocol so as to serve as a reference for subsequent protocol conversion. Optionally, the unified virtual storage protocol is abstracted and unified for the communication modes and data structures of different hard disks. For example, a unified virtual storage protocol can define standardized read and write commands, data formats, error handling mechanisms, etc., so that different types of hard disks can be accessed and managed through the same interface. The storage system is also configured with a protocol conversion module for converting the parsed CXL and PCIe protocols into a unified virtual storage protocol. The protocol conversion module can be implemented in the storage controller or as an independent software layer to perform protocol conversion in the form of middleware or driver.

[0047] In step S103, the physical storage resources of the CXL hard disk and the PCIe hard disk are abstracted into logical virtual storage units by using virtualization technology, and the virtual storage units represent specific storage capacity and performance characteristics. Each hard disk can be divided into one-to-one corresponding virtual storage units to allocate and manage storage resources more flexibly. All virtualized storage units are integrated into a unified virtual resource pool, which includes the virtual storage units of all CXL hard disks and PCIe hard disks in the system.

[0048] Involving step S104, the target application (such as a database, file system or other storage-intensive application) initiates a resource request for resource allocation to the virtualization management module. The resource request includes specific storage requirements, such as capacity, performance (I / O throughput and latency), redundancy requirements, etc. After receiving the request from the target application, the virtualization management module responds to the resource request of the target application, parses the request, and extracts the required storage resource parameters. The above parsing process ensures that the system understands the specific requirements and priorities of the resource request and determines the resource requirements of the target application. According to the resource requirements of the target application, the most suitable virtual storage unit is matched in the virtual resource pool. Once a suitable virtual storage unit is matched, the virtualization management module allocates the resources of these virtual storage units to the target application.

[0049] The present disclosure virtualizes CXL hard disks and PCIe hard disks into virtual storage units and integrates them into a unified virtual resource pool to achieve seamless connection between CXL hard disks and PCIe hard disk technologies, which not only improves the compatibility of the system, but also enhances its scalability, so that the storage system can dynamically adjust resource allocation as needed. At the same time, the present disclosure better adapts to the changing application requirements and load conditions of different upper-layer applications through a dynamic resource allocation mechanism, thereby improving the overall performance of the system and user experience.

[0050] Exemplarily, before responding to the resource request of the target application, the method further includes: receiving the resource request of the target application through a standardized storage access interface, wherein the storage access interface provides a consistent access method for the target application.

[0051] The present disclosure provides a standardized storage access interface, which is designed to shield the differences in the underlying hardware so that upper-layer applications can access and manage storage resources through a unified interface. The storage access interface needs to be compatible with multiple storage protocols, including CXL and PCIe, to ensure that the access method of upper-layer applications remains consistent regardless of how the underlying hardware changes. The storage access interface uses virtualization technology to encapsulate the underlying CXL hard disk and PCIe hard disk into a unified virtual storage unit. Through a standardized API, the target application can perform read and write operations through a unified interface without having to understand the specific implementation details of the underlying storage device. When the target application needs storage resources, it will initiate a resource request through a standardized storage access interface.

[0052] Exemplarily, in response to a resource request of the target application, allocating storage resources of the virtual storage unit in the virtual resource pool to the target application through the virtualization management module includes: in response to the resource request of the target application, allocating storage resources of the virtual storage unit in the virtual resource pool to the target application according to the resource request of the target application and resource usage evaluation through the virtualization management module.

[0053] As mentioned above, the virtualization management module is the core of the entire virtual storage system, responsible for monitoring, managing and allocating virtual storage resources. After receiving the resource request of the target application, the virtualization management module will evaluate the request to confirm the rationality and necessity of the request. Optionally, the evaluation criteria include the resource usage of the current system, the remaining resource amount, the current load, etc. The virtualization management module will monitor the usage of each virtual storage unit in the virtual resource pool in real time, consider which virtual storage units have sufficient idle resources and which units are running at high load, so as to make the best resource allocation decision. The virtualization management module selects a suitable virtual storage unit for resource allocation based on the resource request of the target application and the current resource usage. Optionally, resource allocation is performed based on the allocation strategy of load balancing and maximizing resource utilization. Once the resource allocation scheme is determined, that is, the appropriate virtual storage unit is matched, the virtualization management module will perform the allocation operation to allocate the resources of these virtual storage units to the target application. Specifically, the storage resources required by the target application are allocated from the corresponding virtual storage unit in the virtual resource pool and bound to the target application. It should be noted that since the plugging and unplugging of the hard disk is involved, the allocation process should be dynamic.

[0054] For example, an application of an e-commerce platform sends a resource request at a certain moment, hoping to allocate additional storage resources to handle the upcoming shopping festival traffic peak. The e-commerce platform application sends a resource request to the virtualization management module through the standardized storage access interface, requesting to increase the storage capacity by 1TB, and requiring the I / O throughput to reach 500MB / s to cope with high concurrent read and write operations. After receiving the request, the virtualization management module begins to evaluate the resource usage of the current virtual resource pool and finds that several virtual storage units in the virtual resource pool are in a low load state. Two of them have 2TB and 1.5TB of free capacity respectively, and the current I / O performance indicators can meet the 500MB / s requirement. The virtualization management module decides to allocate 1TB of storage capacity from the free virtual storage units to the e-commerce platform application. At the same time, in order to ensure high-performance I / O, the virtualization management module will also perform intelligent scheduling to ensure that the application can obtain the required I / O bandwidth first. After this allocation operation is completed, the e-commerce platform application can seamlessly use the newly added storage resources to handle the upcoming shopping festival peak traffic.

[0055] Exemplarily, the virtualization management module is configured with a monitoring tool and a performance optimization tool; the method also includes: continuously detecting the performance indicators of the virtual resource pool through the monitoring tool, and the performance indicators include: input / output throughput and input / output delay; when it is detected that the performance indicators of the virtual resource pool are abnormal, optimizing the abnormal performance indicators accordingly through the performance optimization tool.

[0056] The present disclosure provides a monitoring tool configured in a virtualization management module, which is a set of software and hardware tools for real-time monitoring of the performance of a virtual resource pool, and can continuously collect and record key performance indicators of a storage system. Performance indicators include, but are not limited to, input / output (I / O) throughput, I / O latency, storage unit utilization, etc. A performance optimization tool is a set of tools for detecting and optimizing storage system performance. It can automatically or manually adjust the system configuration to improve performance when performance problems are found. Optionally, adjusting the system configuration includes resource reallocation, I / O scheduling optimization, cache management, etc. Through the monitoring tool, the system can continuously detect the performance indicators of the virtual resource pool. The detection of these indicators is real-time to ensure that potential performance problems can be discovered in a timely manner. The following is a simple definition of the performance indicators monitored by the monitoring tool: I / O throughput, which indicates the number of I / O operations processed by the system per unit time. High throughput means that the system can quickly process a large number of read and write requests; I / O latency, which indicates the time required for an I / O operation from the issuance of a request to completion. Low latency means that the system can quickly respond to resource requests from applications. When the monitoring tool detects abnormal performance indicators, such as a significant drop in I / O throughput or a significant increase in I / O latency, it can be marked as a performance bottleneck or abnormal situation, the reasons for which include hardware failure, high load or resource competition. In specific implementations, the performance optimization tool performs the following optimization operations: reallocate the resources of the virtual storage unit according to the current load situation. For example, allocate part of the load in the high-load virtual storage unit to the low-load unit to balance the load; adjust the I / O scheduling strategy, such as increasing the cache size, changing the scheduling algorithm, etc., to improve I / O performance.

[0057] For example, when the monitoring tool detects that during the execution of a data analysis task, the I / O throughput drops significantly and the I / O latency increases significantly, the analysis task begins to slow down. The monitoring tool records that the current I / O throughput is only half of the normal level, while the I / O latency has tripled, and the system issues an alarm, indicating that there is a performance bottleneck. The performance optimization tool analyzes the load situation and finds that some virtual storage units are in a high-load state, while others are relatively idle. The optimization tool decides to migrate tasks from some high-load storage units to idle units to balance the load and improve overall I / O performance. The performance optimization tool further adjusts the I / O scheduling strategy, increases the cache size, and adopts a more efficient I / O scheduling algorithm to reduce I / O latency. At the same time, the optimization tool enables data prefetching to speed up data access.

[0058] Exemplarily, the virtualization management module is configured with a fault detection tool; the method also includes: regularly checking the status and performance of the virtual storage unit in the virtual resource pool through the fault detection tool, and judging whether the virtual storage unit is faulty according to the status and performance of the virtual storage unit; in the event that a virtual storage unit fault is detected, locating the faulty virtual storage unit and performing corresponding repairs.

[0059] The fault detection tool configured in the virtualization management module provided by the present disclosure is a set of software and hardware integrated tools for regularly checking the status and performance of the virtual storage unit to detect hardware faults, performance bottlenecks and other abnormal conditions. The fault detection tool can automatically collect and analyze various performance indicators of the virtual storage unit, such as I / O throughput, I / O latency, storage utilization, etc. The fault detection tool checks the virtual storage unit at a predetermined time interval, and the inspection frequency can be configured according to the needs, usually in real time or by hour, by day, etc. The frequency is defined. During the inspection process, the tool collects the performance data of all virtual storage units and compares it with the baseline performance data to identify abnormal conditions. The fault detection tool compares the collected performance data with the baseline data under normal operating conditions. If an abnormal condition such as obvious performance degradation, increased I / O latency or inaccessible storage unit is detected, the fault detection tool marks it as a fault. Specific judgment criteria include but are not limited to: I / O throughput is lower than the normal level, I / O latency is significantly higher than the baseline value, data read / write errors occur frequently, etc. When a fault is detected, the fault detection tool will record the specific information of the fault in detail, including the time when the fault occurred, the virtual storage unit involved, and the specific performance indicator abnormality. The fault detection tool can quickly locate the specific virtual storage unit where the fault occurred by using methods such as log analysis and fault tree analysis. For some faults that can be automatically repaired, such as restarting the faulty storage unit and reallocating resources, the system will automatically perform the repair operation.

[0060] Exemplarily, the method also includes: encrypting data of storage resources written to the virtual storage unit, and decrypting data of storage resources read from the virtual storage unit; setting different levels of access rights for different virtual storage units in the virtual resource pool, and monitoring abnormal access behavior, the access rights being used to verify the identity of users accessing the virtual storage units; regularly backing up data of storage resources of virtual storage units in the virtual resource pool, and storing the backup data in an off-site server; and upon detecting that storage resources of virtual storage units in the virtual resource pool are lost or fail, obtaining corresponding storage resources from the backup data stored in the off-site server for data recovery.

[0061] When data is written into the virtual storage unit, in order to ensure that the data is not leaked or tampered with during the storage process, the data is first encrypted, and the encryption algorithm can use a strong cryptographic algorithm. When the data stored in the virtual storage unit needs to be read, the data is decrypted to restore the original content of the data. The decryption process uses the key and algorithm that match the encryption process to ensure the confidentiality and integrity of the data.

[0062] Different virtual storage units can have different levels of access permissions. For example, some storage units can only be accessed by administrators, while other storage units may be open to specific user groups. When a user or application attempts to access a virtual storage unit, the system will authenticate the user to ensure that the accessor has the appropriate permissions. Authentication can be achieved through username and password, two-factor authentication, etc. During access, access behavior is monitored in real time to identify and record abnormal access situations, such as frequent failed login attempts, abnormal data access patterns, etc.

[0063] In order to ensure that data can still be recovered from a remote location even if a local failure occurs (such as hardware damage, natural disasters, etc.), the present disclosure regularly backs up the data in the virtual resource pool. The backup frequency can be set according to the importance and change frequency of the data, usually daily, weekly or monthly. The backup data will be stored in a remote server. The system will continuously monitor the operating status of the virtual resource pool to detect data loss or hardware failure. When a failure is detected, the corresponding data is automatically obtained from the remote backup server for recovery to ensure business continuity and data integrity.

[0064] Figure 2 is a flow chart of a complete compatible processing method provided by an embodiment of the present disclosure, such as Figure 2As shown, the compatible processing method disclosed in the present invention starts with the application of virtualization technology. By connecting CXL and PCIe hard disks to the storage system, firstly parse their communication protocols and convert them into protocols compatible with the virtual resource pool. If the protocol parsing and conversion are successful, these hard disks are virtualized into virtual storage units and integrated into the virtual resource pool; if the protocol parsing and conversion fail, fault handling and recovery are performed to ensure the normal access of the hard disks; next, the performance in the virtual resource pool is analyzed, and necessary optimization adjustments are made by monitoring indicators such as input / output throughput and latency to ensure system performance; at the same time, data encryption protection is performed on the storage resources, and decryption is performed when reading, and different levels of access rights are set to perform access control and authority management to prevent abnormal access behavior; performance monitoring and optimization are continuously performed to ensure the efficient operation of the virtual resource pool, and the status and performance of the virtual storage unit are regularly checked through the fault detection tool, and the fault is judged and processed according to the detection results. If a virtual storage unit fault is found, the faulty unit is located and repaired; to ensure data security, storage resources are regularly backed up and the backup data is stored in an off-site server. If data loss or failure occurs, the data is restored from the off-site backup, and the process ends.

[0065] Exemplarily, the method further includes: dynamically adjusting resource allocation of the virtual storage unit in real time through the virtualization management module to cope with load changes of the target application.

[0066] As mentioned above, the virtualization management module continuously monitors the frequency, data throughput, latency and other performance indicators of the target application's I / O requests. Based on the monitored load changes, the virtualization management module evaluates whether the current resource allocation meets the needs of the target application. If the load increase leads to insufficient existing resources, or the load reduction leads to resource waste, the system will make corresponding adjustments. Based on the monitored load changes, the virtualization management module evaluates whether the current resource allocation meets the needs of the target application. If the load increase leads to insufficient existing resources, or the load reduction leads to resource waste, corresponding and dynamic adjustments will be made. When the load increases, more virtual storage units are dynamically allocated to the target application to improve storage capacity and performance. In the specific implementation, by reallocating the available resources in the virtual resource pool, it is ensured that the target application can still maintain stable performance under high load. When the load decreases, the excess virtual storage unit resources are recycled to the virtual resource pool for use by other applications, thereby improving resource utilization and avoiding resource waste. During the resource adjustment process, the virtualization management module also optimizes performance according to load characteristics. For example, for high-concurrency I / O requests, the data path and cache strategy can be adjusted to reduce latency and improve response speed. By dynamically adjusting the resource allocation of virtual storage units in real time, the storage system can more flexibly respond to changes in the load of the target application, ensuring stable and efficient performance under various load conditions. This not only improves resource utilization efficiency, but also enhances the adaptability and flexibility of the system, enabling it to better meet the needs of various application scenarios.

[0067] Figure 3 is a structural block diagram of a compatible processing system provided by an embodiment of the present disclosure, such as Figure 3 As shown, an embodiment of the present disclosure provides a compatibility processing system, which is applied to the compatibility processing method as described above, and the system includes:

[0068] at least one CXL hard disk 301 and at least one PCIe hard disk 302;

[0069] A virtual resource pool 303 is a collection of at least one virtual storage unit, where the virtual storage unit is obtained by virtualizing the CXL hard disk and the PCIe hard disk;

[0070] The virtualization management module 304 is used to manage the virtual storage units in the virtual resource pool.

[0071] A compatible processing system provided by an embodiment of the present disclosure is intended to integrate and manage hard disks based on the CXL and PCIe standards so as to provide unified storage resources for target applications. Through virtualization technology and protocol conversion, the compatible processing system can efficiently and securely manage storage resources. It includes at least one CXL hard disk and at least one PCIe hard disk, which are connected to the mainboard of the compatible processing system of the present disclosure through corresponding connection methods. The virtual resource pool is a collection of at least one virtual storage unit, and the virtual storage unit is obtained by virtualizing the CXL hard disk and the PCIe hard disk. The virtual storage units of all CXL and PCIe hard disks in the system are uniformly managed to provide standardized and abstract storage resources for the target application. The virtualization management module is responsible for managing the virtual storage units in the virtual resource pool, including resource allocation, authority management, performance monitoring, etc.

[0072] Exemplarily, the system further includes a storage access interface for providing a unified access interface for the CXL hard disk and the PCIe hard disk, and providing a consistent access method for the target application.

[0073] The present disclosure provides a standardized storage access interface, which is designed to shield the differences in the underlying hardware so that upper-layer applications can access and manage storage resources through a unified interface. The storage access interface needs to be compatible with multiple storage protocols, including CXL and PCIe, to ensure that the access method of upper-layer applications remains consistent regardless of how the underlying hardware changes. The storage access interface uses virtualization technology to encapsulate the underlying CXL hard disk and PCIe hard disk into a unified virtual storage unit. Through a standardized API interface, applications can perform read and write operations through a unified interface without having to understand the specific implementation details of the underlying storage device. When the target application needs storage resources, it will initiate a resource request through a standardized storage access interface.

[0074] The embodiments of the present disclosure also provide an electronic device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the various processes in the above-mentioned compatible processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0075] The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, each process in the above-mentioned compatible processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. Each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the embodiments can be referred to each other.

[0076] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, electronic devices, and computer-readable media. Therefore, the embodiments of the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present disclosure may take the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0077] The embodiments of the present disclosure are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present disclosure. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing terminal device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded into a computer or other programmable data processing terminal device, so that a series of operation steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable terminal device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0078] Although the preferred embodiments of the present disclosure have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present disclosure.

[0079] Finally, it should be noted that, in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "include" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "include..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements. The above describes in detail a compatible processing method, system, electronic device and computer-readable medium provided by the present disclosure. Specific examples are used in this article to illustrate the principles and implementation methods of the present disclosure. The description of the above embodiments is only used to help understand the method and its core idea of ​​the present disclosure; at the same time, for those of ordinary skill in the art, according to the idea of ​​the present disclosure, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present disclosure.

Claims

1. A compatibility processing method, characterized in that: The method comprises: Connect at least one CXL hard disk and at least one PCIe hard disk to the storage system; Parsing the communication protocol of the CXL hard disk and the PCIe hard disk and converting them into a communication protocol compatible with a virtual resource pool, wherein the virtual resource pool is a collection of at least one virtual storage unit; When the communication protocols of the CXL hard disk and the PCIe hard disk are parsed and converted successfully, the CXL hard disk and the PCIe hard disk are virtualized into virtual storage units and integrated into the virtual resource pool; In response to a resource request of a target application, a storage resource of a virtual storage unit in the virtual resource pool is allocated to the target application through a virtualization management module.

2. The method according to claim 1, characterized in that Before responding to the resource request of the target application, the method further includes: The resource request of the target application is received through a standardized storage access interface, and the storage access interface provides a consistent access method for the target application.

3. The method according to claim 2, characterized in that The step of allocating storage resources of a virtual storage unit in the virtual resource pool to the target application through a virtualization management module in response to a resource request of the target application includes: In response to the resource request of the target application, the virtualization management module allocates storage resources of the virtual storage unit in the virtual resource pool to the target application according to the resource request of the target application and resource usage evaluation.

4. The method according to claim 1, characterized in that: The virtualization management module is configured with monitoring tools and performance optimization tools; The method further comprises: By means of the monitoring tool, the performance indicators of the virtual resource pool are continuously detected, wherein the performance indicators include: input / output throughput and input / output delay; When it is detected that the performance indicator of the virtual resource pool is abnormal, the abnormal performance indicator is optimized accordingly by using the performance optimization tool.

5. The method according to claim 1, characterized in that The virtualization management module is configured with a fault detection tool; the method further comprises: By means of the fault detection tool, the state and performance of the virtual storage unit in the virtual resource pool are regularly checked, and according to the state and performance of the virtual storage unit, whether the virtual storage unit is faulty is determined; When a virtual storage unit failure is detected, the failed virtual storage unit is located and repaired accordingly.

6. The method according to claim 1, characterized in that The method further comprises: Encrypting data of storage resources written into the virtual storage unit and decrypting data of storage resources read out of the virtual storage unit; Setting different levels of access permissions for different virtual storage units in the virtual resource pool and monitoring abnormal access behaviors, wherein the access permissions are used to verify the identity of users accessing the virtual storage units; Regularly backing up the storage resources of the virtual storage units in the virtual resource pool, and storing the backup data in a remote server; When it is detected that the storage resources of the virtual storage unit in the virtual resource pool are lost or fail, the corresponding storage resources are obtained from the backup data stored in the remote server to perform data recovery.

7. A storage system, characterized in that: The method according to any one of claims 1 to 6 is applied; the system comprising: At least one CXL hard disk and at least one PCIe hard disk; A virtual resource pool is a collection of at least one virtual storage unit, where the virtual storage unit is obtained by virtualizing the CXL hard disk and the PCIe hard disk; The virtualization management module is used to manage the virtual storage units in the virtual resource pool.

8. The system according to claim 7, characterized in that The system further comprises a storage access interface for providing a unified access interface for the CXL hard disk and the PCIe hard disk, and providing a consistent access method for the target application.

9. An electronic device, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory, wherein the processor executes the computer program to implement the compatible processing method according to any one of claims 1 to 6.

10. A computer-readable medium, characterized in that A computer program is stored thereon, wherein when the computer program is executed by a processor, the compatible processing method according to any one of claims 1 to 6 is implemented.

Citation Information

Patent Citations

  • Distributed network storage architecture

    CN101887349A

  • Convergence method of iSCSI (Internet Small Computer System Interface) and FCP (Fiber Channel Protocol) and application thereof to disaster recovery

    CN101938523A

  • Method for optimal distribution of cloud storage resources

    CN103023963A

  • Network virtualization storage method, equipment and system

    CN106686140A

Cited By

  • Computing power arrangement method and device, equipment and storage medium

    CN119356828A

  • Storage method and device compatible with multiple protocols and electronic equipment

    CN120469948A

  • Data storage method and device, electronic equipment and storage medium

    CN120994141A

  • Data storage methods, devices, electronic equipment and storage media

    CN120994141B

  • Mixing method for dynamic task allocation of unified mounting of multiple types of storage disks of monitoring platform

    CN121210142A