Virtual peripheral device interconnection expansion equipment implementation system, equipment and cluster
Through the negotiation interaction between the data processor and the processor, the required number of virtual PCIE devices are dynamically allocated resources, solving the problem of resource waste and management complexity in the existing technology, and achieving efficient utilization and flexible management of resources.
Patent Information
- Application Number
- CN202411441330.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-16
- Publication Date
- 2024-11-15
AI Technical Summary
The prior art cannot flexibly virtualize the required number of virtual PCIE terminal devices, resulting in waste of resources and management complexity.
Through the negotiated interaction between the data processor and the processor, combined with hardware logic and software logic, resources are dynamically allocated to virtualize the required number of virtual PCIE devices, and the topological relationship is rescanned during cold startup to optimize resource allocation.
The number of flexible virtual PCIE devices is realized, avoiding the waste of ports and resources, and improving the system's resource utilization and management efficiency.
Smart Images

Figure CN118964272A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computers, and in particular to a virtual peripheral device interconnection expansion device implementation system, device and cluster. Background Art
[0002] A Peripheral Component Interconnect Express (PCIE) terminal device is a peripheral device connected to a computer motherboard via the PCIE bus standard. PCIE is a high-speed serial computer expansion bus standard that is widely used in modern computer architectures to connect various hardware components. The virtualization of a PCIE terminal device is directly implemented by hardware, and the virtual PCIE terminal devices that can be virtualized are fixed. Summary of the invention
[0003] The present application provides a virtual peripheral device interconnection expansion device implementation system, device and cluster, which can flexibly virtualize a required number of virtual PCIE terminal devices.
[0004] In a first aspect, a virtual peripheral device interconnection expansion device implementation system is provided, comprising: A data processor, used for providing a peripheral device interconnection expansion device and a hardware logic of a topological relationship of the peripheral device interconnection expansion device, the data processor is further provided with a simulator, the simulator is used for providing a peripheral device interconnection expansion device and a software logic of a topological relationship of the peripheral device interconnection expansion device, and negotiates and interacts with the hardware logic to realize simulation of the peripheral device interconnection expansion device, the peripheral device interconnection expansion device comprises a peripheral device interconnection expansion bridge device and a peripheral device interconnection expansion terminal device, wherein the peripheral device interconnection expansion bridge device comprises a first downstream port; the peripheral device interconnection expansion terminal device comprises a first peripheral device interconnection expansion terminal device, the first peripheral device interconnection expansion terminal device virtualizes one or more first virtual peripheral device interconnection expansion terminal devices, the first peripheral device interconnection expansion terminal device and the one or more first virtual peripheral device interconnection expansion terminal devices are all mounted on the first downstream port; A processor is used to drive the data processor through a driver program, scan the number of peripheral device interconnection expansion end devices and the number of virtual peripheral device interconnection expansion end devices mounted in the first downstream port after the system is cold started, and allocate resources to the first downstream port according to the number of peripheral device interconnection expansion end devices and the number of virtual peripheral device interconnection expansion end devices.
[0005] In the above solution, resources are allocated to the first downstream port according to the number of peripheral device interconnection expansion end devices and the number of virtual peripheral device interconnection expansion end devices, so as to flexibly virtualize the required number of virtual PCIE end devices.
[0006] In some possible designs, the peripheral device interconnect extension end device also includes a second peripheral device interconnect extension end device, the second peripheral device interconnect extension end device virtualizes one or more second virtual peripheral device interconnect extension end devices, and the second peripheral device interconnect extension end device and the one or more second virtual peripheral device interconnect extension end devices are all mounted on the first downstream port.
[0007] In the above solution, all the peripheral device interconnection extension end devices that are virtualized out of the virtual peripheral device interconnection extension end device are mounted on the same port, which can effectively avoid the waste of ports.
[0008] In some possible designs, the processor is further configured to allocate a basic address register space and a bus to the first downstream port according to the number of peripheral device interconnect expansion-end devices mounted on the first downstream port and the number of virtual peripheral device interconnect expansion-end devices.
[0009] The processor is further configured to allocate more than two buses to the first downstream port when the sum of the number of peripheral device interconnect expansion end devices mounted on the first downstream port and the number of virtual peripheral device interconnect expansion end devices is greater than the maximum number of peripheral device interconnect expansion end devices that can be mounted on one bus; A basic address register space is allocated to the first downstream port according to the basic address register space required by the peripheral device interconnect extension end device mounted on the first downstream port and the basic address register space required by the virtual peripheral device interconnect extension end device.
[0010] In some possible designs, the first downstream port is mounted in the order of a first peripheral device interconnect expansion end device, a second peripheral device interconnect expansion end device, a first virtual peripheral device interconnect expansion end device, and a second virtual peripheral device interconnect expansion end device.
[0011] In some possible designs, the peripheral device interconnect expansion bridge device includes a second downstream port, and the peripheral device interconnect expansion end device also includes a third peripheral device interconnect expansion end device, and the third peripheral device interconnect expansion end device is mounted on the second downstream port.
[0012] In some possible designs, the first downstream port is not used to mount a peripheral device interconnect expansion end device that does not virtualize a virtual peripheral device interconnect expansion end device.
[0013] In some possible designs, the attribute information of the first peripheral device interconnect expansion terminal device and the first virtual peripheral device interconnect expansion terminal device is recorded in a configuration file of the data processor. The data processor is further configured to delete the attribute information of the first peripheral device interconnect extension terminal device and the first virtual peripheral device interconnect extension terminal device from the configuration file when the first peripheral device interconnect extension terminal device is deleted.
[0014] In the above scheme, when deleting, only the attribute information of the first peripheral device interconnection expansion terminal device and the first virtual peripheral device interconnection expansion terminal device is deleted from the configuration file. Before cold start, the first peripheral device interconnection expansion terminal device and the first virtual peripheral device interconnection expansion terminal device can still be used normally.
[0015] In a second aspect, a computing device is provided, comprising a virtual peripheral device interconnection expansion device implementation system and a storage unit, wherein the virtual peripheral device interconnection expansion device implementation system and the storage unit can communicate with each other, and the virtual peripheral device interconnection expansion device implementation system is a system as described in any one of the first aspects.
[0016] In a third aspect, a computing device cluster is provided, comprising a plurality of computing devices, wherein at least one computing device comprises a virtual peripheral device interconnection expansion device implementation system and a storage unit, wherein the virtual peripheral device interconnection expansion device implementation system and the storage unit are capable of communicating with each other, and the virtual peripheral device interconnection expansion device implementation system is a system as described in any one of the first aspects. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the background technology, the drawings required for use in the embodiments of the present invention or the background technology will be described below.
[0018] Figure 1 It is a structural diagram of a virtual peripheral device interconnection expansion device implementation system provided by the present application; Figure 2 It is a structural diagram of a processor provided by the present application; Figure 3 It is a structural diagram of a data processor provided by the present application; Figure 4 It is a schematic diagram of a virtual peripheral device interconnection extension device provided by the present application to realize a system-mounted peripheral device interconnection extension end device and a virtual peripheral device interconnection extension end device; Figure 5 It is a structural schematic diagram of a computing device provided by this application. DETAILED DESCRIPTION
[0019] The embodiments of the present invention are described below in conjunction with the accompanying drawings in the embodiments of the present invention. The terms used in the implementation mode of the present invention are only used to explain the specific embodiments of the present invention, and are not intended to limit the present invention.
[0020] See also Figure 1 , Figure 1 This is a schematic diagram of the structure of a virtual peripheral device interconnection expansion device implementation system provided by the present application. Figure 1 As shown, the peripheral device interconnection expansion device implementation system provided by the present application includes: a processor (central processing unit, CPU) 11 and a data processor (Data Processing Unit, DPU) 12.
[0021] CPU11 is a computing core and a control core, and can handle complex situations. CPU11 can be a very large-scale integrated circuit. The main operating system and other software programs are installed in CPU11, so that CPU11 can access the memory and various PCIE devices. CPU11 can quickly access the local memory through the on-chip bus. CPU11 may include one or more processor cores. In one implementation, CPU11 may be a multi-core chip, that is, a chip containing multiple processing cores. In another implementation, CPU11 may include one or more processor cores. It can be a chip with one processing core.
[0022] See also Figure 2 , Figure 2 is a schematic diagram of the structure of a processor provided by this application. Figure 2 As shown, the CPU may include a memory address register 101, a memory data register 102, a program counter 103, an instruction register 104, an instruction decoder 105, a microcode read-only memory 106, an operation controller 107, a calculation unit 108, a general register group 109, an accumulator 110, a program status word register 111, a timing circuit 112, and a processor bus 120. The processor bus 120 may also be a data bus, a power bus, a control bus, or a status signal bus.
[0023] The CPU is used to process instructions and data stored in the memory 113. In some embodiments, the instructions may include one or more instruction formats. The instruction format may indicate various fields (number of bits, position of bits, etc.) to specify the operation of the data processing to be performed and the operand on which the operation will be performed. Some instruction formats may be further defined by instruction templates (or sub-formats).
[0024] In the CPU, the memory address register 101 is used to store the address of the memory that the CPU is currently accessing, and the memory data register 102 is used to store the data and instructions read or written by the CPU from the address, so as to make up for the difference in operating speed between the processor and the memory.
[0025] The timing circuit 112 provides a time reference for each component through a fixed clock. The time for the processor to execute an instruction is an instruction cycle. The program counter 103 is used to store the address of the next instruction. When the instructions are executed sequentially, the program counter 103 automatically adds the number of bytes of an instruction after each instruction is taken. When a transfer instruction is encountered, the program counter 103 specifies the address of the next instruction through the address code field in the transfer instruction. The instruction register 104 is used to save the instruction currently being executed. The instruction includes two fields, an operation code and an address code. The operation code part is decoded by the instruction decoder 105 to generate the control potential required by the instruction. The operation controller 107 can generate various operation control signals based on the control potential signal output by the instruction decoder and the timing signal generated by the timing circuit 112, and control the remaining components of the CPU to complete the operation of fetching and executing instructions.
[0026] A microinstruction is the smallest unit of instructions executed by a processor. An instruction can be a single microinstruction or composed of several microinstructions. An instruction composed of multiple microinstructions is called a complex instruction. Various mechanisms can be used to implement the decoding of complex instructions by the instruction decoder 105. Specific decoding mechanisms include, but are not limited to, lookup tables, hardware implementations, programmable logic arrays (PLA), microcode read-only memories (ROMs), and the like. In one embodiment, the steps of the microinstructions corresponding to the complex instructions can be stored in the microcode read-only memory 106. During the decoding process, the instruction decoder 105 can query and obtain the operation code and address code of the microinstructions constituting the complex instructions from the microcode read-only memory 106, and decode the operation code part of the microinstructions in turn to generate the control potential required by the microinstructions.
[0027] The operation controller 107 has multiple buffers, and can send the decoded instructions to their respective reservation stations for storage according to the types of instructions. After analyzing the status of the hardware circuit of the computing unit and the specific situation of whether each instruction can be executed in advance, the instructions that can be executed in advance are scheduled to the corresponding computing unit 108 for execution. During this period, the instruction stream is reordered so that the instruction pipeline can proceed and be smoothly scheduled. Exemplarily, for instructions of integer calculation, the operation controller 107 can use the integer reservation station to save instructions and assign them to the integer computing unit for calculation; for instructions of floating-point calculation, the operation controller 107 can use the floating-point reservation station to save instructions and assign them to the floating-point computing unit for calculation.
[0028] The general register group 109 is used to store the data corresponding to the address code according to the address code of the instruction. The calculation unit 108 is used to receive the operation control signal of the operation controller 107 and perform calculations on the data stored in the general register group 109, including arithmetic operations (including basic operations such as addition, subtraction, multiplication and additional operations) and logical operations (including shifting, logical testing or comparison of two values). The temporary variables generated in the calculation are stored in the accumulator 110, and the information of the generated status is stored in the program status word register 111, such as the operation result carry / borrow flag (C), the operation result overflow flag (O), the operation result zero flag (Z), the operation result negative flag (N), the operation result sign flag (S), etc. The program status word register is also used to save information such as interrupts and the working status of the computing device, so that the CPU can timely understand the machine operation status and program operation status.
[0029] The calculation unit 108 includes a variety of different circuit modules, which can be used to execute different instructions. For example, the integer calculation unit 1081 and the floating point calculation unit 1082 are used to perform arithmetic operations and logical operations on integers and floating point numbers, respectively.
[0030] It can be understood that the above-mentioned CPU is only a specific embodiment. In actual applications, it may have more or fewer components, which will not be described in detail here.
[0031] The DPU 12 includes multiple processing cores, which can process data in parallel. Therefore, the DPU 12 often has powerful computing capabilities. Figure 3, the DPU includes: multiple memories 121, multiple processing cores 122, and communication interfaces 123 and other hardware resources. For example, the processing core 122 may include a first processing core, a second processing core, ..., an Nth processing core, and the memory 121 includes a first memory, a second memory, ..., an Nth memory. In a possible embodiment, the computing power of the processing core 122 in the DPU12 is weaker than the computing power of the CPU11, and the storage capacity of the memory 121 in the DPU12 is weaker than the storage capacity of the memory in the CPU11. Therefore, the CPU11 is suitable for processing a small number of complex instructions, while the DPU12 is suitable for processing batches of simple instructions. The memory 121 may be a non-volatile solid-state memory. In a possible embodiment, the memory 121 includes a read-only memory ROM (Read-Only Memory). In appropriate cases, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically alterable ROM (EAROM) or a flash memory, or a combination of two or more of these. A slave operating system may be installed on the DPU, and the slave operating system is used to manage the hardware resources on the DPU. In a possible embodiment, the function of the slave operating system in the DPU12 is weaker than the main operating system in the CPU11. The DPU12 may be used to simulate the topological relationship between at least one peripheral device interconnection expansion device and at least one PCIE device. The hardware resources of the DPU are used to provide the hardware logic of the topological relationship of the PCIE device and the PCIE device. A simulator may be installed in the DPU12, and the simulator is used to provide the software logic of the topological relationship of the PCIE device and the PCIE device. The DPU12 implements the simulation of the PCIE device through negotiation and interaction between the software logic and the hardware logic.
[0032] The PCIE devices simulated in the DPU may include PCIE end devices and PCIE bridge devices. PCIE end devices can provide various functions. For example, the PCIE end device may be a network card for providing network data transmission functions, may be a remote direct memory access (RDMA) for providing remote direct memory access services, or may be a storage device for providing data storage services. The PCIE bridge device is used to connect multiple PCIE end devices to form different topological relationships. Specifically, the PCIE bridge device includes multiple end device slots, and each end device slot is used to mount a peripheral device interconnection expansion end device. The topological relationship of the PCIE device may include one or more of a star relationship, a tree relationship, a ring relationship, a bus relationship, etc. Figure 1 Taking the topological relationship of the PCIE devices as an example, the PCIE bridge device serves as the root node of the tree, and multiple PCIE end devices are respectively connected to the root node PCIE bridge device.
[0033] PCIE end devices can virtualize multiple virtual PCIE end devices from a single physical PCIE end device through Single Root I / O Virtualization (SR-IOV), and then pass the virtual PCIE end devices directly to each virtual machine to achieve the application scenario of a single physical PCIE end device supporting multiple virtual machines. SR-IOV is implemented on the basis of the PCIE specification. The SR-IOV protocol introduces the concept of two types of functions: physical function (PF) and virtual function (VF). PF is used to support PCI functions with SR-IOV functions, as defined in the SR-IOV specification. PF contains the SR-IOV function configuration structure for managing SR-IOV functions. PF is a full-featured PCIE function that can be discovered, managed, and processed like any other PCIE end device. PF has full configuration resources and can be used to configure or control PCIE end devices; VF is a function associated with PF, which is a lightweight PCIE function that can share one or more physical resources with physical functions and other VFs associated with the same physical function. VF is only allowed to have configuration resources for its own behavior.
[0034] The data processor is used to provide the hardware logic of the peripheral device interconnection expansion device and the topological relationship of the peripheral device interconnection expansion device. The data processor is also provided with a simulator. The simulator is used to provide the software logic of the peripheral device interconnection expansion device and the topological relationship of the peripheral device interconnection expansion device, and negotiate and interact with the hardware logic to realize the simulation of the peripheral device interconnection expansion device.
[0035] like Figure 4 As shown, the peripheral device interconnection expansion device includes a peripheral device interconnection expansion bridge device and a peripheral device interconnection expansion terminal device, wherein the peripheral device interconnection expansion bridge device includes a first downstream port and a second downstream port. The peripheral device interconnection expansion terminal device includes a first peripheral device interconnection expansion terminal device, the first peripheral device interconnection expansion terminal device virtualizes one or more first virtual peripheral device interconnection expansion terminal devices, and the first peripheral device interconnection expansion terminal device and the one or more first virtual peripheral device interconnection expansion terminal devices are all mounted on the first downstream port.
[0036] After the system is cold started, the processor allocates resources to the first downstream port according to the number of peripheral device interconnection extension end devices mounted on the first downstream port and the number of virtual peripheral device interconnection extension end devices. More specifically, when the sum of the number of peripheral device interconnection extension end devices mounted on the first downstream port and the number of virtual peripheral device interconnection extension end devices is greater than the maximum number of peripheral device interconnection extension end devices that can be mounted on one bus, the processor allocates more than two buses to the first downstream port; and allocates basic address register space to the first downstream port according to the basic address register space required by the peripheral device interconnection extension end devices mounted on the first downstream port and the basic address register space required by the virtual peripheral device interconnection extension end devices. For example, since the first virtual peripheral device interconnect extension terminal device can virtualize multiple first virtual peripheral device interconnect extension terminal devices, and the processor only reserves one bus (BUS) and 2 megabytes of basic address register space for the first downstream port in advance, since a maximum of 256 peripheral device interconnect extension terminal devices can be mounted under one bus, for example, 1 peripheral device interconnect extension terminal device and 255 virtual peripheral device interconnect extension terminal devices virtualized based on the peripheral device interconnect extension terminal device can be mounted, and since each PCIE terminal device requires 8 kilobytes of basic address register space, 2 megabytes of basic address register space can be allocated to a maximum of 256 peripheral device interconnect extension terminal devices, for example, 1 peripheral device interconnect extension terminal device and 255 virtual peripheral device interconnect extension terminal devices virtualized based on the peripheral device interconnect extension terminal device can be mounted.
[0037] Therefore, when the first downstream port needs to mount more than 256 peripheral device interconnection expansion terminal devices, the first downstream port does not have sufficient resources. Therefore, it is necessary to cold-start the virtual peripheral device interconnection expansion device to implement the system. After the virtual peripheral device interconnection expansion device implements the system cold-start, scan the number of peripheral device interconnection expansion terminal devices mounted on the first downstream port and the number of virtual peripheral device interconnection expansion terminal devices, and allocate resources to the first downstream port according to the number of peripheral device interconnection expansion terminal devices mounted on the first downstream port and the number of virtual peripheral device interconnection expansion terminal devices. For example, the processor can allocate basic address register space and bus to the first downstream port according to the number of peripheral device interconnection expansion terminal devices mounted on the first downstream port and the number of virtual peripheral device interconnection expansion terminal devices. In a specific embodiment, when the sum of the number of peripheral device interconnection expansion terminal devices mounted on the first downstream port and the number of virtual peripheral device interconnection expansion terminal devices is greater than 256, the processor allocates more than two buses and more than 2 megabytes of basic address register space to the first downstream port. The attribute information of the first PCIE terminal device and the first virtual PCIE terminal device is recorded in the configuration file of the data processor. When the first PCIE terminal device is deleted, the data processor deletes the attribute information of the first PCIE terminal device and the first virtual PCIE terminal device from the configuration file (no interrupt will be sent to the processor here), and the user can continue to use the first PCIE terminal device and the first virtual PCIE terminal device until the virtual peripheral device interconnection expansion device realizes a system cold restart.
[0038] Therefore, the PCIE end device that virtualizes the virtual PCIE end device is designed as a static device, that is, it is not used by hot plugging, but is discovered and used by cold starting the virtual peripheral device interconnection extension device to realize the system. During the cold start process of the virtual peripheral device interconnection extension device to realize the system, the PCIE topology will be rescanned and enough basic address register space and bus will be reserved for the first downstream port to meet the PCIE end device that virtualizes the virtual PCIE end device.
[0039] Optionally, all PCIE end devices that virtualize virtual PCIE end devices and the virtual PCIE end devices virtualized by them can be mounted below the first downstream port. The first downstream port is not used to mount PCIE end devices that do not virtualize virtual PCIE end devices. For example, the peripheral device interconnection extension end device also includes a second peripheral device interconnection extension end device, and the second peripheral device interconnection extension end device virtualizes one or more second virtual peripheral device interconnection extension end devices, and the second peripheral device interconnection extension end device and one or more second virtual peripheral device interconnection extension end devices are all mounted on the first downstream port. In this way, the resources of the basic address register space and the resources of the bus can be saved, and the downstream port resources of the simulator are also saved. The first downstream port can be a fixedly allocated downstream port or a dynamically allocated downstream port. When the first downstream port is a fixedly allocated downstream port, a downstream port can be reserved, and even if the user does not create any PCIE end device that virtualizes the virtual PCIE end device, this downstream port is also empty, and other ordinary PCIE end devices are not mounted. Alternatively, a free downstream port may be dynamically allocated. For example, if the user has created many common PCIE end devices and mounted them under the first to tenth downstream ports, if the user wants to create the first PCIE end device that virtualizes the virtual PCIE end device, then it can be mounted under the eleventh downstream port, and the newly created PCIE end device that virtualizes the virtual PCIE end device and the virtual PCIE end device that virtualizes it must be mounted under the eleventh downstream port. When mounting, the first downstream port is mounted in the order of the first peripheral device interconnection extension end device, the second peripheral device interconnection extension end device, the first virtual peripheral device interconnection extension end device, and the second virtual peripheral device interconnection extension end device.
[0040] The peripheral device interconnection extension terminal device also includes a third PCIE terminal device, and the third PCIE terminal device is mounted on the second downstream port. The third PCIE terminal device can be an ordinary PCIE terminal device, that is, a PCIE terminal device that does not virtualize a virtual PCIE terminal device. The third PCIE terminal device is a PCIE terminal device inserted by hot plugging. When creating, the simulator will allocate resources for the third PCIE terminal device and mount it under a certain idle downstream port (for example, the second downstream port), and then send an interrupt to the second downstream port. When the processor receives this interrupt, it will call the corresponding driver to load the third PCIE terminal device. When deleting, the simulator will send an interrupt to the second downstream port. When the processor receives this interrupt, it will uninstall the corresponding driver, and then the simulator will delete it from the second downstream port and delete the corresponding resources. The third PCIE terminal device can be dynamically added and deleted by hot plugging, that is, the processor can load and unload the device by hot plugging, which takes effect in time without cold restarting the system. The processor reserves 2MB of basic address register space and 1 bus for the second downstream port. When there is a fourth PCIE terminal device, and the fourth PCIE terminal device is also a common PCIE terminal device, the fourth PCIE terminal device will be similar to the third PCIE terminal device, and will not be further described here.
[0041] See also Figure 5 , Figure 5 4 is a schematic diagram of a computing device provided by the present application. The computing device 400 includes: one or more processing units 410 , a communication interface 420 and a storage unit 430 .
[0042] The processing unit 410, the communication interface 420 and the storage unit 430 are interconnected via a bus 440. Optionally, the computing device 400 may also include an input / output interface 450, which is connected to an input / output device for receiving parameters set by a user, etc. The computing device 400 can be used to implement some or all of the functions of the device embodiment or system embodiment in the above-mentioned embodiment of the present application; the processing unit 410 can also be used to implement some or all of the operation steps of the method embodiment in the above-mentioned embodiment of the present application. For example, the specific implementation of the various operations performed by the computing device 400 can refer to the specific details in the above-mentioned embodiment, such as the processing unit 410 is used to perform some or all of the steps in the above-mentioned method embodiment or some or all of the operations in the above-mentioned method embodiment. For another example, in the embodiment of the present application, the computing device 400 can be used to implement some or all of the functions of one or more components in the above-mentioned device embodiment, and the communication interface 420 can be specifically used for the communication functions necessary to implement the functions of these devices and components, and the processing unit 410 can be specifically used for the processing functions necessary to implement the functions of these devices and components, etc.
[0043] Figure 5 The computing device 400 may include one or more processing units 410, and the multiple processing units 410 may provide processing capabilities in a coordinated manner in a parallel connection manner, a serial connection manner, a serial-parallel connection manner, or any connection manner, or the multiple processing units 410 may constitute a processor sequence or a processor array, or the multiple processing units 410 may be divided into a main processor and an auxiliary processor, or the multiple processing units 410 may have different architectures such as a heterogeneous computing architecture. In addition, Figure 5 The computing device 400 shown in the figure, and the related structural description and functional description are exemplary and non-limiting. In some exemplary embodiments, the computing device 400 may include Figure 5 More or fewer components may be shown, or some components may be combined or separated, or may have a different arrangement of components.
[0044] The processing unit 410 may have a variety of specific implementation forms. For example, the processing unit 410 may include a processor (central processing unit, CPU), a graphic processing unit (graphic processing unit, GPU), a neural-network processing unit (neural-network processing unit, NPU), a tensor processing unit (tensor processing unit, TPU) or a data processing unit (data processing unit, DPU) and other combinations thereof, which are not specifically limited in the embodiments of the present application. The processing unit 410 may also be a single-core processor or a multi-core processor. The processing unit 410 may be a combination of a CPU and a hardware chip. The above-mentioned hardware chip may be an application-specific integrated circuit (application-specific integrated circuit, ASIC), a programmable logic device (programmable logic device, PLD) or a combination thereof. The above-mentioned PLD may be a complex programmable logic device (complex programmable logic device, CPLD), a field-programmable gate array (field-programmable gate array, FPGA), a generic array logic (generic array logic, GAL) or any combination thereof. The processing unit 410 may also be implemented using a logic device with built-in processing logic alone, such as an FPGA or a digital signal processor (digital signal processor, DSP), etc. The communication interface 420 may be a wired interface or a wireless interface for communicating with other modules or devices. The wired interface may be an Ethernet interface, a local interconnect network (LIN), etc., and the wireless interface may be a cellular network interface or a wireless local area network interface, etc.
[0045] The storage unit 430 may be a non-volatile memory, such as a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The storage unit 430 may also be a volatile memory, which may be a random access memory (RAM) used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous connection dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM). The storage unit 430 may also be used to store program codes and data, so that the processing unit 410 can call the program codes stored in the storage unit 430 to execute some or all of the operation steps in the above method embodiment, or to execute the corresponding functions in the above device embodiment. Figure 5 Show more or fewer components, or have different component configurations.
[0046] The bus 440 may be a peripheral component interconnect express (PCIe) bus, an extended industry standard architecture (EISA) bus, a unified bus (Ubus or UB), a compute express link (CXL), a cache coherent interconnect for accelerators (CCIX), etc. The bus 440 may be divided into an address bus, a data bus, a control bus, etc. In addition to the data bus, the bus 440 may also include a power bus, a control bus, and a status signal bus, etc. However, for the sake of clarity, Figure 5 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0047] The present application also provides a system, which includes multiple computing devices, and the structure of each computing device can refer to the structure of the computing device described above. The functions or operations that can be implemented by the system can refer to the specific implementation steps in the above method embodiment and / or the specific functions described in the above device embodiment, which will not be repeated here.
[0048] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one network site, computer, server or data center to another network site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer, or it can be a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape, etc.), an optical medium (e.g., a DVD, etc.), or a semiconductor medium (e.g., a solid-state hard disk), etc. In the above embodiments, the description of each embodiment has different emphases. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
Claims
1. A virtual peripheral device interconnection expansion device implementation system, characterized in that: include: A data processor, used for providing a peripheral device interconnection expansion device and a hardware logic of a topological relationship of the peripheral device interconnection expansion device, the data processor is further provided with a simulator, the simulator is used for providing a peripheral device interconnection expansion device and a software logic of a topological relationship of the peripheral device interconnection expansion device, and negotiates and interacts with the hardware logic to realize simulation of the peripheral device interconnection expansion device, the peripheral device interconnection expansion device comprises a peripheral device interconnection expansion bridge device and a peripheral device interconnection expansion terminal device, wherein the peripheral device interconnection expansion bridge device comprises a first downstream port; the peripheral device interconnection expansion terminal device comprises a first peripheral device interconnection expansion terminal device, the first peripheral device interconnection expansion terminal device virtualizes one or more first virtual peripheral device interconnection expansion terminal devices, the first peripheral device interconnection expansion terminal device and the one or more first virtual peripheral device interconnection expansion terminal devices are all mounted on the first downstream port; A processor is used to drive the data processor through a driver program, and after the system is cold started, allocate resources to the first downstream port according to the number of peripheral device interconnect expansion end devices mounted on the first downstream port and the number of virtual peripheral device interconnect expansion end devices.
2. The system according to claim 1, characterized in that The peripheral device interconnection extension end device also includes a second peripheral device interconnection extension end device, the second peripheral device interconnection extension end device virtualizes one or more second virtual peripheral device interconnection extension end devices, and the second peripheral device interconnection extension end device and the one or more second virtual peripheral device interconnection extension end devices are all mounted on the first downstream port.
3. The system according to claim 2, characterized in that The processor is further configured to allocate a basic address register space and a bus to the first downstream port according to the number of peripheral device interconnect expansion end devices and the number of virtual peripheral device interconnect expansion end devices mounted on the first downstream port.
4. The system according to claim 3, characterized in that The processor is further configured to allocate more than two buses to the first downstream port when the sum of the number of peripheral device interconnect expansion end devices mounted on the first downstream port and the number of virtual peripheral device interconnect expansion end devices is greater than the maximum number of peripheral device interconnect expansion end devices that can be mounted on one bus; A basic address register space is allocated to the first downstream port according to the basic address register space required by the peripheral device interconnect extension end device mounted on the first downstream port and the basic address register space required by the virtual peripheral device interconnect extension end device.
5. The system according to claim 2, characterized in that The first downstream port is mounted in the order of a first peripheral device interconnection extension end device, a second peripheral device interconnection extension end device, a first virtual peripheral device interconnection extension end device, and a second virtual peripheral device interconnection extension end device.
6. The system according to any one of claims 1 to 5, characterized in that: The peripheral device interconnection expansion bridge device includes a second downstream port, and the peripheral device interconnection expansion terminal device also includes a third peripheral device interconnection expansion terminal device, and the third peripheral device interconnection expansion terminal device is mounted on the second downstream port.
7. The system according to any one of claims 1 to 5, characterized in that: The first downstream port is not used for mounting a peripheral device interconnection extension terminal device that does not virtualize a virtual peripheral device interconnection extension terminal device.
8. The system according to any one of claims 1 to 5, characterized in that: The attribute information of the first peripheral device interconnect expansion terminal device and the first virtual peripheral device interconnect expansion terminal device is recorded in a configuration file of the data processor. The data processor is further configured to delete the attribute information of the first peripheral device interconnect extension terminal device and the first virtual peripheral device interconnect extension terminal device from the configuration file when the first peripheral device interconnect extension terminal device is deleted.
9. A computing device, characterized in that It comprises a virtual peripheral device interconnection expansion device implementation system and a storage unit, the virtual peripheral device interconnection expansion device implementation system and the storage unit can communicate with each other, and the virtual peripheral device interconnection expansion device implementation system is a system as described in any one of claims 1-8.
10. A computing device cluster, characterized in that: The method comprises a plurality of computing devices, at least one of which comprises a virtual peripheral device interconnection expansion device implementation system and a storage unit, wherein the virtual peripheral device interconnection expansion device implementation system and the storage unit are capable of communicating with each other, and the virtual peripheral device interconnection expansion device implementation system is a system as described in any one of claims 1 to 8.
Citation Information
Patent Citations
System and method for transforming PCIE SR-IOV functions to appear as legacy functions
CN101981554A
Mounting system and method, cluster and storage medium
CN116909639A
Memory sub-system with multiple ports having single root virtualization
US20200192848A1
Cited By
Network port direct connection system, equipment and cluster
CN119254622A
