Disk management system and method based on DPU and storage medium
By assembling DPUs and prom on physical machines and using DPUs to process disk information, the problems of complexity and high operation and maintenance costs in the existing technology are solved, and flexible and efficient disk management is achieved.
Patent Information
- Application Number
- CN202310843977.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-10
- Publication Date
- 2025-01-10
AI Technical Summary
The existing disk management methods are greatly affected by the database system, resulting in complex operation and processing processes and high operation and maintenance costs, making it difficult to effectively manage a large number of disks.
Adopt a DPU-based disk management system to detect virtualized PCIe devices through a physical machine, read and run the prom, generate disk information reading requests, DPU receives and processes disk information, and feeds it back to the prom for management processing, reducing the difficulty of disk management and control , improve management flexibility and reduce operation and maintenance costs.
It has achieved simplified disk management process, reduced operation and maintenance costs, improved disk management flexibility and reliability, reduced manual operations, and improved disk information management efficiency.
Smart Images
Figure CN119292513A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a disk management system, method and storage medium based on DPU. Background Art
[0002] UUID (Universally Unique Identifier) is a globally unique identifier that ensures that all machines in the same space and time are unique. Its components usually include the current date and time, clock sequence, and the globally unique IEEE machine identification code. The UUID of the user disk is often very important in the system and is generally used to distinguish different disk partitions.
[0003] In recent years, the number of disks has become huge, and disk management and operation and maintenance have become extremely important. In related technologies, it is usually necessary to mount the UUID of the user's disk on the database to manage the disks in a unified manner based on the database. This disk management method is often greatly affected by the database system itself, making the operation and processing flow of disk management more complicated and the operation and maintenance cost higher. Summary of the invention
[0004] The present application provides a DPU-based disk management system, method and storage medium to achieve DPU-based disk management, thereby reducing the difficulty of disk management, improving the flexibility of disk management, and reducing the operation and maintenance costs of disk management.
[0005] According to one aspect of the present application, a disk management system based on a DPU is provided, the system comprising a physical machine, a DPU mounted on the physical machine, and an oprom; wherein,
[0006] The physical machine is used to read and run the oprom mounted on the target PCIe device when detecting the target PCIe device in the virtualized PCIe device;
[0007] The oprom is used to generate a disk information read request when detecting the target PCIe device, and send the disk information read request to the DPU;
[0008] The DPU is used to receive the disk information reading request, read the disk information in the target PCIe device based on the disk information reading request, and feed the disk information back to the oprom so that the oprom manages and processes the disk based on the disk information.
[0009] According to another aspect of the present application, a DPU-based disk management method is provided. The method comprises:
[0010] When a target PCIe device in a virtualized PCIe device is detected by a physical machine, the oprom mounted on the target PCIe device is read and executed;
[0011] When the oprom detects the target PCIe device, a disk information read request is generated and sent to the DPU;
[0012] The DPU receives the disk information reading request, reads the disk information in the target PCIe device based on the disk information reading request, and feeds the disk information back to the oprom, so that the oprom manages the disk based on the disk information. When the physical machine detects the target PCIe device in the virtualized PCIe device, the physical machine reads and runs the oprom mounted on the target PCIe device;
[0013] When the oprom detects the target PCIe device, a disk information read request is generated by the oprom, and the disk information read request is sent to the DPU;
[0014] The disk information reading request is received through the DPU, and based on the disk information reading request, the disk information is read in the target PCIe device, and the disk information is fed back to the oprom, so that the oprom manages and processes the disk based on the disk information.
[0015] According to another aspect of the present application, an electronic device is provided, the electronic device comprising:
[0016] at least one processor; and
[0017] a memory communicatively connected to the at least one processor; wherein,
[0018] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the DPU-based disk management method described in any embodiment of the present application.
[0019] According to another aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the DPU-based disk management method described in any embodiment of the present application when executed.
[0020] The technical solution of the embodiment of the present application provides a disk management system based on DPU, which includes: a physical machine and a DPU and oprom mounted on the physical machine. Among them, the physical machine is used to read and run the oprom mounted on the target PCIe device when the target PCIe device in the virtualized PCIe device is detected; the oprom is used to generate a disk information read request when the target PCIe device is detected, and send the disk information read request to the DPU; the DPU is used to receive the disk information read request, read the disk information in the target PCIe device based on the disk information read request, and feed the disk information back to the oprom, so that the oprom manages and processes the disk based on the disk information. The technical solution of the embodiment of the present application manages the disk based on the DPU, reduces the difficulty of disk control, improves the flexibility of disk management, and reduces the operation and maintenance cost of disk management.
[0021] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0023] Figure 1 A structural diagram of a disk management system based on a DPU provided in Example 1 of the present application;
[0024] Figure 2 A flowchart of a DPU-based disk management system method provided in Example 2 of the present application. DETAILED DESCRIPTION
[0025] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
[0026] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0027] Embodiment 1
[0028] Figure 1 A structural diagram of a DPU-based disk management system provided in Example 1 of the present application. The DPU-based disk management system provided in the embodiment of the present application may include: a physical machine (Host) 11, a DPU (Data Processing Unit) 12 mounted on the physical machine 11, and an oprom (Option ROM) 13.
[0029] In the embodiment of the present application, the physical machine 11 is used to read and run the oprom13 mounted on the target PCIe device when the target PCIe device in the virtualized PCIe (Peripheral Component Interconnect Express) device is detected. The oprom13 is used to generate a disk information read request when the target PCIe device is detected, and send the disk information read request to the DPU12. The DPU12 is used to receive the disk information read request, read the disk information in the target PCIe device based on the disk information read request, and feed the disk information back to the oprom13, so that the oprom13 manages and processes the disk based on the disk information.
[0030] Specifically, the physical machine 11 may be a server. DPU12 is a new type of programmable multi-core processor, which is installed on the physical machine and is used to unload part of the computing power of the CPU (Centrol Processing Unit) on the physical machine. DPU can simulate and implement virtualized PCIe devices, such as PCIe devices based on Virtio (which means virtualized IO and is used to implement device semi-virtualization). The target PCIe device may be a virtualized PCIe device for storing disk information simulated and implemented in DPU12. oprom13 is an executable program that can manage the disk based on disk information. In an embodiment of the present application, oprom is mounted in a virtualized PCIe device simulated and implemented by DPU. The virtualized PCIe device mounted with oprom is the target PCIe device. Optionally, the disk information may include the UUID (Universally Unique Identifier) of the disk. When the physical machine starts, it will scan and detect the virtualized PCIe device in the system (the operating system of the physical machine). When the physical machine detects the target PCIe device in the virtualized PCIe device, it reads oprom13 mounted on the target PCIe device to load oprom13 into the memory, and runs oprom13 after the loading is completed. After running, oprom detects the target PCIe device, reads the disk information stored in the target PCIe device, and modifies the user disk information of the physical machine according to the disk information. The embodiment of the present application adds a backdoor processing through oprom to modify the user disk information of the physical machine, avoid physical machine perception, reduce manual operation, reduce the difficulty of disk management, improve the flexibility of disk management, and reduce the operation and maintenance cost of disk management.
[0031] In a modified embodiment of the present application, the physical machine 11 is also used to determine whether the target PCIe device is mounted with oprom13 before reading the oprom13 mounted on the target PCIe device. If so, oprom13 is run to enable oprom13 to obtain disk information. If not, the target PCIe device is initialized according to the conventional procedure. Before the physical machine 11 reads the oprom13 mounted on the target PCIe device, the reliability of disk management can be guaranteed by determining whether the target PCIe device is mounted with oprom13 through the physical machine 11. It is understandable that when the physical machine 11 detects that the target PCIe device is not mounted with oprom13, it can be determined that the disk cannot be managed at this time.
[0032] Optionally, reading the disk information from the target PCIe device may include: determining a storage space in the target PCIe device for storing the disk information. Then, the disk information may be read from the storage space. Wherein, determining the storage space in the target PCIe device for storing the disk information may include: obtaining the first address and address offset of the disk information stored in the target PCIe device. Then, based on the first address and address offset, the storage space in the target PCIe device for storing the disk information may be determined.
[0033] In a modified embodiment of the present application, DPU 12 is specifically used to read disk information in a preset private storage space of a target PCIe device based on a disk information read request.
[0034] Among them, the preset private storage space can be understood as a private type of storage space for storing disk information pre-set in the target PCIe device. The space size of the preset private storage space can be set according to actual needs and is not specifically limited here. A private storage space for storing disk information is pre-set in the target PCIe device. After DPU12 receives a disk information read request, DPU12 can read the disk information from the private storage space. In an embodiment of the present application, setting the type of storage space for storing disk information to a private type can improve the security and reliability of the disk information.
[0035] In a modified embodiment of the present application, DPU12 may include a processing process. Among them, the processing process can be understood as a process in DPU12 for receiving a disk information read request and processing the disk information read request. In an embodiment of the present application, the processing process processes the disk information read request, which may specifically be reading disk information from the target PCIe device and feeding the disk information back to oprom13. There are many ways to obtain the processing process in DPU12. For example, after DPU12 receives a disk information read request, DPU12 may create a processing process inside it; or, a processing process may be pre-created in DPU12. On the basis of the above embodiment, oprom13 is also specifically used to send a disk information read request to the processing process; the processing process is specifically used to receive a disk information read request, read the disk information in the target PCIe device based on the disk information read request, and feed the disk information back to oprom13.
[0036] In a modified embodiment of the present application, the physical machine 11 is further used to generate a device configuration information acquisition request and send the device configuration information acquisition request to the DPU 12. The DPU 12 is further used to receive the device configuration information acquisition request, determine the device configuration information of the currently existing virtualized PCIe device based on the device configuration information acquisition request, and feed the device configuration information back to the physical machine 11.
[0037] The device configuration information acquisition request may be understood as a request for acquiring the device configuration information of the virtualized PCIe device. The device configuration information acquisition request may be a message request in TLP format. The device configuration information may include the device identification and device function information of the virtualized PCIe device. The device function information may be used to describe the functional details of the virtualized PCIe device configuration. Exemplarily, the device function information of the target PCIe device may be that the target PCIe device has the function of storing disk information.
[0038] On the basis of the above embodiment, the physical machine 11 is further used to determine the target PCIe device in the virtualized PCIe device according to the device configuration information after receiving the device configuration information sent by the DPU 12.
[0039] Specifically, after the physical machine 11 receives the device configuration information sent by the DPU 12, the physical machine 11 can analyze the device configuration information. In actual use, the device configuration information usually includes device function information of multiple virtualized PCIe devices. Then, the physical machine 11 can determine the target PCIe device in the virtualized PCIe device based on the device function information.
[0040] Optionally, based on each device function information, determining the target PCIe device in the virtualized PCIe device may include: searching each device function information for device function information having a function of storing disk information. Then, the virtualized PCIe device corresponding to the found device function information may be used as the target PCIe device.
[0041] In a modified embodiment of the present application, oprom13 is also used to modify disk information of the disk. Optionally, modifying disk information of the disk by oprom13 may include: modifying UUID of the disk by oprom13.
[0042] Specifically, after oprom13 receives the UUID modification instruction, oprom13 parses the UUID modification instruction, thereby obtaining the target UUID in the UUID modification instruction. After oprom13 obtains the target UUID, the current UUID of the disk can be modified to the target UUID.
[0043] Among them, the UUID modification instruction can be understood as an instruction for modifying the UUID of the disk. The UUID modification instruction includes a target UUID. The method for obtaining the UUID modification instruction can specifically be to generate a UUID modification instruction in response to a UUID modification operation based on the input of the physical machine 11. The current UUID can be understood as the UUID of the disk at the current moment. The target UUID can be the UUID of the disk set according to actual needs.
[0044] Based on the above embodiments, oprom13 can also be used to perform RTC (Real TimeClock) time modification processing on the physical machine 11, which may specifically include: after oprom13 receives the RTC time modification instruction for the physical machine 11, oprom13 parses the RTC time modification instruction, obtains the target RTC time in the RTC time modification instruction, and modifies the current RTC time of the physical machine 11 to the target RTC time.
[0045] Among them, the RTC time modification instruction can be understood as an instruction for modifying the RTC time of the physical machine 11. The RTC time modification instruction may include a target RTC time. The target RTC time can be configured according to actual needs, which is not specifically limited here. The current RTC time can be understood as the RTC time of the physical machine 11 at the current moment.
[0046] The technical solution of the embodiment of the present application provides a disk management system based on DPU, which includes: a physical machine and a DPU and oprom mounted on the physical machine. Among them, the physical machine is used to read and run the oprom mounted on the target PCIe device when the target PCIe device in the virtualized PCIe device is detected; the oprom is used to generate a disk information read request when the target PCIe device is detected, and send the disk information read request to the DPU; the DPU is used to receive the disk information read request, read the disk information in the target PCIe device based on the disk information read request, and feed the disk information back to the oprom, so that the oprom manages and processes the disk based on the disk information. The technical solution of the embodiment of the present application manages the disk based on the DPU, reduces the difficulty of disk control, improves the flexibility of disk management, and reduces the operation and maintenance cost of disk management.
[0047] Embodiment 2
[0048] Figure 2A flowchart of a DPU-based disk management method provided in Example 2 of the present application. This method and the DPU-based disk management system of the above-mentioned embodiments belong to the same inventive concept. For details not described in detail in the embodiment of the DPU-based disk management method, reference can be made to the above-mentioned DPU-based disk management system embodiment. This method is applied to a disk management system consisting of a physical machine, a DPU mounted on the physical machine, and an oprom, and the method specifically includes the following steps:
[0049] S110 . When a target PCIe device in the virtualized PCIe device is detected by the physical machine, the oprom mounted on the target PCIe device is read and executed.
[0050] S120. When the oprom detects the target PCIe device, a disk information read request is generated, and the disk information read request is sent to the DPU.
[0051] S130, receiving the disk information read request through the DPU, reading the disk information in the target PCIe device based on the disk information read request, and feeding back the disk information to the oprom, so that the oprom manages and processes the disk based on the disk information.
[0052] The technical solution of the embodiment of the present application is that when the physical machine detects the target PCIe device in the virtualized PCIe device, it reads and runs the oprom mounted on the target PCIe device; when the oprom detects the target PCIe device, it generates a disk information read request and sends the disk information read request to the DPU; the DPU receives the disk information read request, reads the disk information in the target PCIe device based on the disk information read request, and feeds the disk information back to the oprom, so that the oprom manages and processes the disk based on the disk information. The technical solution of the embodiment of the present application manages the disk based on the DPU, reduces the difficulty of disk management and control, improves the flexibility of disk management, and reduces the operation and maintenance cost of disk management.
[0053] Optionally, the method further includes: determining, by the physical machine, whether the target PCIe device has the oprom mounted on it before reading the oprom mounted on the target PCIe device; if so, running the oprom so that the oprom acquires the disk information.
[0054] Optionally, the DPU includes a processing process; sending the disk information read request to the processing process through the oprom; receiving the disk information read request through the processing process, reading the disk information in the target PCIe device based on the disk information read request, and feeding back the disk information to the oprom.
[0055] Optionally, the DPU reads disk information from a preset private storage space of the target PCIe device based on the disk information read request.
[0056] Optionally, the method further includes: generating a device configuration information acquisition request through the physical machine, and sending the device configuration information acquisition request to the DPU; receiving the device configuration information acquisition request through the DPU, determining the device configuration information of the currently existing virtualized PCIe device based on the device configuration information acquisition request, and feeding back the device configuration information to the physical machine.
[0057] Optionally, the method further includes: after receiving the device configuration information sent by the DPU, the physical machine determines the target PCIe device in the virtualized PCIe device according to the device configuration information.
[0058] Optionally, the method further includes: performing disk information modification processing on the disk through the oprom.
[0059] Optionally, the disk information includes a UUID of the disk.
[0060] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.
[0061] Embodiment 3
[0062] Embodiment 3 of the present application further provides a computer-readable storage medium on which a computer program is stored, characterized in that when the program is executed by a processor, a DPU-based disk management method provided in the above embodiment of the present application is implemented, for example, the method includes:
[0063] When the physical machine detects the target PCIe device in the virtualized PCIe device, the oprom mounted on the target PCIe device is read and run by the physical machine; when the oprom detects the target PCIe device, a disk information read request is generated by the oprom, and the disk information read request is sent to the DPU; the disk information read request is received by the DPU, and based on the disk information read request, the disk information is read in the target PCIe device, and the disk information is fed back to the oprom, so that the oprom manages and processes the disk based on the disk information.
[0064] The computer storage medium of the embodiment of the present application can adopt any combination of one or more computer-readable media. Computer-readable media can be computer-readable signal media or computer-readable storage media. Computer-readable storage media can be, for example, - but not limited to - electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any combination of the above. More specific examples (non-exhaustive lists) of computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this document, computer-readable storage media can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.
[0065] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0066] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
[0067] The computer program code for performing the operation of the embodiment of the present application can be written in one or more programming languages or a combination thereof, and the programming language includes an object-oriented programming language, such as Java, Smalltalk, C++, and also includes a conventional procedural programming language, such as "C" language or similar programming language. The program code can be executed completely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer, partially on the remote computer, or completely on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer by any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., using an Internet service provider to connect to the Internet).
[0068] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.
Claims
1. A disk management system based on DPU, characterized in that: The system includes a physical machine, a DPU mounted on the physical machine, and an oprom; wherein, The physical machine is used to read and run the oprom mounted on the target PCIe device when detecting the target PCIe device in the virtualized PCIe device; The oprom is used to generate a disk information read request when detecting the target PCIe device, and send the disk information read request to the DPU; The DPU is used to receive the disk information reading request, read the disk information in the target PCIe device based on the disk information reading request, and feed the disk information back to the oprom so that the oprom manages and processes the disk based on the disk information.
2. The system according to claim 1, characterized in that The physical machine is further used to determine whether the target PCIe device has the oprom mounted on it before reading the oprom mounted on the target PCIe device, and if so, run the oprom so that the oprom obtains the disk information.
3. The system according to claim 1, characterized in that The DPU includes a processing process; The oprom is specifically used to send the disk information read request to the processing process; The processing process is specifically used to receive the disk information reading request, read the disk information in the target PCIe device based on the disk information reading request, and feed back the disk information to the oprom.
4. The system according to claim 1, characterized in that The DPU is specifically configured to read disk information from a preset private storage space of the target PCIe device based on the disk information read request.
5. The system according to claim 1, characterized in that The physical machine is further configured to generate a device configuration information acquisition request and send the device configuration information acquisition request to the DPU; The DPU is further configured to receive the device configuration information acquisition request, determine the device configuration information of the currently existing virtualized PCIe device based on the device configuration information acquisition request, and feed back the device configuration information to the physical machine.
6. The system according to claim 5, characterized in that The physical machine is further configured to determine a target PCIe device in the virtualized PCIe device according to the device configuration information after receiving the device configuration information sent by the DPU.
7. The system according to claim 1, characterized in that The oprom is also used to modify the disk information of the disk.
8. The system according to claim 1, characterized in that The disk information includes the UUID of the disk.
9. A disk management method based on DPU, characterized in that: The method comprises: When a target PCIe device in a virtualized PCIe device is detected by a physical machine, the oprom mounted on the target PCIe device is read and executed; When the oprom detects the target PCIe device, a disk information read request is generated and sent to the DPU; The disk information reading request is received by the DPU, and based on the disk information reading request, the disk information is read in the target PCIe device, and the disk information is fed back to the oprom, so that the oprom manages and processes the disk based on the disk information.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is used to enable a processor to implement the DPU-based disk management method according to any one of claim 9 when executed.