Display resource management system based on hyper-convergence

Abstract

A hyper-convergence-based display resource management system includes: a multi-node hyper-convergence cluster composed of multiple server nodes connected by switches; a hyper-convergence virtual display environment established on the multi-node hyper-convergence cluster and used to uniformly manage and schedule display resources of multiple server nodes; a hyper-convergence display node running on each server node, the hyper-convergence display node including a display virtualization layer, a display device driver, and a physical layer; the display virtualization layer manages and calls corresponding server node display device drivers and responds to calls and management by the hyper-convergence virtual display environment; the hyper-convergence virtual display environment utilizes hyper-convergence technology to uniformly call the hyper-convergence display nodes of multiple server nodes. The present invention provides a lightweight and efficient hyper-convergence cluster display resource management and usage method, which greatly reduces the difficulty, complexity, and workload of setting up a service node display environment and improves the utilization rate and flexibility of hyper-convergence cluster display resources.

Description

Technical Field

[0001] The present invention relates to the technical field of virtualization, and in particular to a display resource management system based on hyper-convergence. Background Art

[0002] Hyper-converged Infrastructure (HCI) is a modern data center architecture that integrates computing, storage, networking, and virtualization resources into a single device or modular suite. All resources are managed and allocated through a software-defined approach, creating a unified management platform. This architecture allows enterprises to easily increase resources by scaling out nodes without reconfiguring the system.

[0003] The Linux system uses Xorg and Wayland technologies to manage system display. Xorg can easily manage multiple display devices, support multiple graphics cards, and call multiple display resources.

[0004] Hyperconvergence technology provides only a simple control interface and lacks a rich display environment. Hyperconvergence management and the organization of display resources lack a unified and effective approach. Furthermore, there is no effective way to uniformly access corresponding display resources, making it difficult to achieve through a simple interface. Summary of the Invention

[0005] To address the deficiencies of the prior art, the present invention provides a hyper-convergence-based display resource management system, comprising:

[0006] A multi-node hyper-converged cluster consists of multiple server nodes connected by switches;

[0007] A hyper-converged virtual display environment is built on a multi-node hyper-converged cluster through virtualization technology, and is used to uniformly manage and schedule display resources of multiple server nodes within the multi-node hyper-converged cluster.

[0008] In a multi-node hyper-converged cluster, a hyper-converged display node runs on each server node. The hyper-converged display node includes a display virtualization layer, a display device driver, and a physical layer connected in sequence. When the hyper-converged virtual display environment needs to call the display resources on the corresponding server node, the display virtualization layer of the corresponding server node calls the display device driver, and the display device driver calls the display resources on the physical layer. Finally, the display virtualization layer returns a network data packet consisting of the execution result information of the display device driver to the hyper-converged virtual display environment, and the hyper-converged virtual display environment completes the call processing of the display resources of the corresponding server node through the returned execution result information, so as to realize the unified management and scheduling of the display resources of multiple server nodes by the hyper-converged virtual display environment.

[0009] The display device driver of the hyper-converged display node includes an application layer and a kernel layer;

[0010] The display device drivers provided by the application layer include display application layer drivers, virtualized display application layer drivers, and other display application layer drivers;

[0011] The display device drivers provided by the kernel layer include CPU kernel device drivers, DRM display kernel device drivers, and other display kernel device drivers.

[0012] The display virtualization layer of the hyper-converged display node includes a hyper-converged display virtualization service and a hyper-converged virtualized display device driver, wherein:

[0013] The hyper-converged virtualized display device driver is responsible for calling the display device driver. The hyper-converged virtualized display device driver is started and managed by the hyper-converged display virtualization service.

[0014] The hyper-converged display virtualization service and the hyper-converged virtual display device driver are both connected to the hyper-converged virtual display environment. When the hyper-converged virtual display environment needs to call the display resources on the corresponding server node, the hyper-converged virtual display device driver receives and parses the network data packet sent by the hyper-converged virtual display environment, which is composed of display device driver function call information, and calls the display device driver to call the relevant display resources. At the same time, the hyper-converged virtual display device driver returns a network data packet composed of display device driver execution result information to the hyper-converged virtual display environment.

[0015] The hyper-converged virtual display environment includes a hyper-converged display management service, which is connected to the hyper-converged display virtualization service and the hyper-converged virtualized display device driver, and is used to:

[0016] Load and run a hyper-converged virtual display environment;

[0017] Sending a network data packet consisting of a display server's function call information to a hyper-converged virtualized display device driver;

[0018] Receive and parse the network data packet returned by the hyper-converged virtualized display device driver, which contains the display device driver execution result information;

[0019] Collects display resource information managed by the hyper-converged display virtualization service on each server node, and centrally manages display resources of multiple server nodes.

[0020] Among them, the hyper-converged display virtualization service is used to collect the display resource information of the server node, manage the display resources of the server node, and provide the display resource information of the server node to the hyper-converged display management service through the network, so that the hyper-converged display management service can uniformly manage and schedule the display resources of each server node; at the same time, the hyper-converged display virtualization service receives the application for the display device driver from the hyper-converged display management service, and controls whether the hyper-converged display node is used by the hyper-converged virtual display environment.

[0021] Among them, the hyper-converged virtual display environment also includes libdrm, libx, a display server and an accelerated rendering module, and the libdrm, libx, the display server and the accelerated rendering module are all started by the hyper-converged display management service; after the hyper-converged display management service receives and parses the network data packet composed of the display device driver execution result information returned by the virtualized display device driver, the display server uniformly organizes and coordinates the control of libdrm, libx and the accelerated rendering module to complete the display function of the display resources of the corresponding server node.

[0022] The hyper-converged virtual display environment uses computing resources, storage resources, network resources and virtualization resources of a multi-node hyper-converged cluster.

[0023] The present invention provides a unified hyper-converged virtual display environment for use by hyper-converged business applications, reducing the work of setting up the display environment for each service node; the present invention provides a method for unified scheduling and use of display resources based on hyper-convergence, a unified virtualized display environment, and unified display control, eliminating the display environment deployment of each server node, greatly improving the simplicity of the server node system. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a logical architecture diagram of the hyper-convergence-based display resource management system of the present invention.

[0025] Figure 2 This is a logical architecture diagram of a single server node in the hyper-convergence-based display resource management system of the present invention.

[0026] Figure 3 The figure is a schematic diagram of data interaction in the resolution setting process in an embodiment of the hyper-convergence-based display resource management system of the present invention. DETAILED DESCRIPTION

[0027] In order to have a further understanding of the technical solution and beneficial effects of the present invention, the technical solution and beneficial effects of the present invention are described in detail below with reference to the accompanying drawings.

[0028] Figure 1This is a logical architecture diagram of the hyper-convergence-based display resource management system of the present invention, as shown in FIG. Figure 1 As shown, the hyper-convergence-based display resource management system of the present invention includes:

[0029] A multi-node hyper-converged cluster consists of multiple server nodes connected by switches (corresponding to Figure 1 "Server Node 1", "Server Node 2", "Server Node 3" and "Server Node N" in the Node.

[0030] Hyper-converged virtual display environment, through virtualization technology (including Figure 1 The "Compute Virtualization", "Storage Virtualization", "Display Virtualization" and "Other Virtualization" shown in the figure are built on a multi-node hyper-converged cluster and are used to uniformly manage and schedule the display resources of multiple server nodes in the multi-node hyper-converged cluster.

[0031] The hyper-converged virtual display environment is provided by the hyper-converged display management service through the display server. The hyper-converged display management service also manages display resources (hardware resources required for the display environment to operate, such as HDMI interfaces, graphics cards, hardware decoders, etc.) uniformly through the hyper-converged display management service's management of the display device drivers of all server nodes belonging to the hyper-converged virtual display environment (detailed below). Display resources from different server nodes exist in the hyper-converged virtual display environment as a display resource pool. The hyper-converged display management service can obtain information about the increase or decrease of server nodes from the hyper-converged display virtualization service (detailed below) of the display virtualization layer of each server node via the network and dynamically adjust the display resource pool. Specifically, the hyper-converged display management service can use the display resources of corresponding server nodes in a multi-node hyper-converged cluster in a targeted manner, or it can use the display resources of corresponding server nodes by applying for usage from the display resource pool.

[0032] When business applications need to use the display resources of related server nodes, the hyper-converged display management service uniformly allocates display resources for business applications.

[0033] For specific implementation mechanisms, please refer to Figure 2 As shown to understand, Figure 2 This is a logical architecture diagram of a single server node in the hyper-convergence-based display resource management system of the present invention: In a multi-node hyper-convergence cluster, each server node runs a hyper-convergence display node, which includes a display virtualization layer, a display device driver, and a physical layer connected in sequence. When the hyper-convergence display management service needs to call the display resources on the corresponding server node, the display virtualization layer of the corresponding server node calls the display device driver, and the display device driver calls the display resources on the physical layer (including Figure 2Finally, the display virtualization layer returns a network data packet consisting of the execution result information driven by the display device to the hyper-converged display management service, and the hyper-converged display management service parses the network data packet to obtain the execution result information, and completes the call processing of the display resources of the corresponding server node through the returned execution result information, so as to realize the unified management and scheduling of the display resources of multiple server nodes by the hyper-converged virtual display environment.

[0034] In the present invention, the display device driver of the hyper-converged display node is loaded from the server node, including the application layer and the kernel layer:

[0035] The display device drivers provided by the application layer include display application layer drivers, virtualized display application layer drivers (virtualized display device drivers provided through virtualization methods, including GPU virtualized display device drivers, VPU virtualized display device drivers, etc.), and other display application layer drivers, which are mainly used to implement advanced display device driver functions;

[0036] The display device drivers provided by the kernel layer include CPU kernel device drivers, DRM display kernel device drivers, and other display kernel device drivers.

[0037] In the present invention, the display virtualization layer of the hyper-converged display node includes a hyper-converged virtualized display device driver and a hyper-converged display virtualization service; wherein the hyper-converged virtualized display device driver is provided by the hyper-converged display virtualization service, and the hyper-converged display virtualization service is run by the server node;

[0038] The hyper-converged virtualized display device driver is used to implement the following functions described above:

[0039] 1. Receive and parse network data packets consisting of display device driver function call information sent by the hyper-converged display management service;

[0040] 2. The hyper-converged virtualized display device driver parses the received network data packets and calls the corresponding display device driver, which then calls the display resources on the physical layer.

[0041] 3. Obtain the execution result information of the display device driver, and send the execution result information into a network data packet to the hyper-converged display management service;

[0042] After the virtualized display device driver calls the display device driver, the corresponding display device driver will return relevant data, such as command execution results, display status query results, etc. These results need to be obtained and transmitted to the hyper-converged display management service through the network. The hyper-converged display management service will parse and forward them to display servers such as xserver for processing.

[0043] The hyper-converged display virtualization service connects to the hyper-converged display management service in the hyper-converged virtual display environment. The hyper-converged display virtualization service collects display resource information for its server nodes, manages the display resources of its server nodes, and provides this information to the hyper-converged display management service over the network, enabling the hyper-converged display management service to uniformly manage and schedule the display resources of each server node. The hyper-converged display virtualization service also receives requests from the hyper-converged display management service for the use of display device drivers and controls whether hyper-converged display nodes are used by the hyper-converged virtual display environment.

[0044] Please continue reading Figure 1 As shown, the hyper-converged virtual display environment of the present invention also includes a display server (Xserver or weston, etc.), libdrm, libX and an accelerated rendering module (including OpenCL, OpenGL, FFmpeg, etc.); wherein, the display server, libdrm, libX and the accelerated rendering module are all started by the hyper-converged display management service on a multi-node hyper-converged cluster environment. The hyper-converged display management service, the display server, the hyper-converged virtual display environment and the hyper-converged virtualized display device driver cooperate in a specific function implementation process as follows:

[0045] 1. The hyper-converged display management service starts the display server, and then calls libdrm, libX, and accelerated rendering modules through the display server to load and start the hyper-converged virtual display environment through the hyper-converged display nodes of each server node, and establish a display resource pool. The hyper-converged display management service receives display resource call requests from business applications;

[0046] 2. The hyper-converged display management service sends a network data packet consisting of display device driver function call information to the hyper-converged virtualized display device driver of the corresponding server node;

[0047] 3. The hyper-converged virtualized display device driver receives and parses the network data packet sent by the hyper-converged display management service, which contains the display device driver function call information, and calls the display device driver to call the relevant display resources;

[0048] 4. The hyper-converged virtualized display device driver obtains the display device driver execution result information and returns a network data packet containing the display device driver execution result information to the hyper-converged display management service of the hyper-converged virtual display environment;

[0049] 5. The hyper-converged display management service receives network data packets, parses them, and returns them to the display server and other modules. The display server and other modules then process them and return them to the business application.

[0050] The hyper-converged virtual display environment runs in a hyper-converged cluster consisting of multiple server nodes. The running tasks of the hyper-converged virtual display environment are distributed to different server nodes of the hyper-converged cluster by hyper-converged technology. The use of display resources by the hyper-converged virtual display environment is coordinated by hyper-converged technology and hyper-converged display management services to use the various display device drivers of the server nodes of the corresponding hyper-converged cluster to use the corresponding display resources. For example, if a business application needs to set the display resolution of a specific server node, the business application calls the hyper-converged virtual display environment. The hyper-converged virtual display environment determines and uses the display device driver of the corresponding display resource of the corresponding server node through hyper-converged technology and hyper-converged display management services, and sets the display resolution of the corresponding server node by calling the display device driver. For specific methods, please refer to Figure 3 understand.

[0051] A hyper-converged virtual display environment utilizes the computing, storage, network, and virtualization resources of a hyper-converged cluster. Furthermore, with the help of hyper-convergence technology, a hyper-converged virtual display environment can handle massive display tasks and utilize vast storage resources, allowing it to run display tasks that a single server node cannot.

[0052] For example, the display server needs to call the display device driver interface to complete related display functions. For example, resolution setting requires calling the corresponding driver interface. The display server needs to call the accelerated rendering module to call the rendering acceleration hardware and other devices of different server nodes to implement the rendering acceleration function.

[0053] Therefore, the display server can flexibly use and control the display resources of each server node, while avoiding the deployment of display environments on different hyper-converged cluster server nodes, greatly reducing the difficulty, complexity and workload of setting up the service node display environment, and improving the utilization rate and flexibility of hyper-converged cluster display resources.

[0054] In the process of realizing the above functions, by using storage virtualization technology, the display server can flexibly use the relevant files of different server nodes.

[0055] It should be noted that the present invention Figure 1 In the display, only one hyper-converged virtual display environment is displayed. In actual operation, the hyper-converged display management service can create multiple independently running hyper-converged virtual display environments through the display server. Different hyper-converged virtual display environments can flexibly allocate different server nodes to each hyper-converged virtual display environment, so that different hyper-converged virtual display environments can run the display resources provided by different server nodes, and display different display interfaces through the display devices of the corresponding server nodes. At the same time, the display server allocates hyper-converged computing resources through the hyper-converged display management service.

[0056] The hyper-converged display management service can manage and record the display device status of different server nodes to provide unified hyper-converged virtual display environment support for multiple hyper-converged virtual display environments.

[0057] The present invention provides a unified hyper-converged virtual display environment for use by hyper-converged business applications, reducing the work of setting up the display environment for each service node; the present invention provides a method for unified scheduling and use of display resources based on hyper-convergence, a unified virtualized display environment, and unified display control, eliminating the display environment deployment of each server node, greatly improving the simplicity of the server node system.

[0058] Please combine Figure 3 As shown, in a specific embodiment of the present invention, a hyper-converged display resource management system based on Feiteng server and Kylin system is provided, and a method for setting screen resolution of the system is as follows:

[0059] 1. Multiple Feiteng server nodes are interconnected through network switches and form a multi-node hyper-converged cluster through hyper-convergence. Correspondingly, each Feiteng server node has display resources such as HDMI display interface, hardware codec device, graphics card device, etc.

[0060] 2. Each hyper-converged Feiteng server node loads the corresponding HDMI display interface, hardware codec devices, graphics card devices and other display resources, and runs the hyper-converged display virtualization service; the hyper-converged display virtualization service collects display resource information, manages the display resources of the corresponding server node, and provides hyper-converged virtualized display device drivers through the network;

[0061] 3. The hyper-converged display management service reads the display resource data of each Feiteng server node through the network, establishes a connection with the hyper-converged display virtualization service of each server node, and maintains the display resource pool;

[0062] 4. The hyper-converged display management service uses the virtualized display device driver provided by the server node to load component modules such as libdrm and libX, and starts the Xserver display server, further loading the Kylin ukui display environment;

[0063] 5. The hyper-converged display management service uniformly manages and organizes the display resources of each server node. For example, when MPV needs to play a video, the hyper-converged display management service provides corresponding functions through the Xserver display server to uniformly organize and coordinate control and select the display device of the corresponding server node to support MPV video playback, such as providing an HDMI display interface.

[0064] Furthermore, the MPV video can be played to the HDMI display interfaces of multiple server nodes through the Xserver display server, and the video data can be decoded by the hardware codec devices of multiple server nodes.

[0065] Furthermore, the display server runs on the hyper-converged cluster, which can uniformly organize and manage display resources, facilitate the use of display resources and function realization of multiple server nodes, such as realizing multi-screen management of each server node in the hyper-converged cluster through the display server.

[0066] When using the accelerated rendering module function, it is implemented through display server management. For example, when video loading and rendering are required, the graphics card devices of multiple server nodes are called to provide accelerated video loading and rendering.

[0067] 6. The hyper-converged display management service sends a network data packet composed of the display device driver function call information of the corresponding Feiteng server node in the hyper-converged virtual display environment to the corresponding server node; at the same time, it receives and parses the network data packet composed of the display device driver execution result information obtained by the hyper-converged virtualized display device driver of the corresponding Feiteng server node to respond or call the corresponding display server function;

[0068] For example: when an application needs to set the screen resolution of the HDMI graphics card interface of a corresponding Feiteng server node, the application calls the display server to set the screen resolution. The hyper-converged display management service captures the screen resolution setting command and converts the screen resolution setting command into a resolution setting network data packet of the corresponding Feiteng server node and sends it to the corresponding Feiteng server node (corresponding Figure 3 In the "Convert the screen resolution setting command into a data packet corresponding to a server node and send it out"), the hyper-converged virtualization display device driver of the corresponding Feiteng server node receives the network data packet consisting of the resolution setting command, parses it and calls the display device driver (specifically, calls the screen resolution setting driver interface), and the display device driver calls the HDMI display device driver resolution setting interface of the corresponding node to write the resolution setting data to the HDMI hardware register (corresponding Figure 3 "Set Hardware") to complete the screen resolution setting ("Screen" corresponds to Figure 3 The display device driver reads the register information and returns the resolution setting result (corresponding to Figure 3 "Read hardware setting information"); at the same time, return the display device driver resolution setting execution result to the hyper-converged virtualization display device driver (corresponding to Figure 3 The hyper-converged virtualized display device driver sends the network data packet consisting of the resolution setting information to the hyper-converged display management service (corresponding to Figure 3The hyper-converged display management service parses the data packet and sends it to the display server. The display server calls related functions to process the resolution setting success information and returns it to the application.

[0069] Although the present invention has been described using the above preferred embodiments, they are not intended to limit the scope of protection of the present invention. Any person skilled in the art may make various changes and modifications to the above embodiments without departing from the spirit and scope of the present invention. These changes and modifications are still within the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be based on the definition of the claims.

Claims

1. A display resource management system based on hyper-convergence, characterized in that: include: A multi-node hyper-converged cluster consists of multiple server nodes connected by switches; A hyper-converged virtual display environment is built on a multi-node hyper-converged cluster through virtualization technology, and is used to uniformly manage and schedule display resources of multiple server nodes within the multi-node hyper-converged cluster. In a multi-node hyper-converged cluster, each server node runs a hyper-converged display node, which includes a display virtualization layer, display device driver, and physical layer connected in sequence; The display virtualization layer includes the hyper-converged display virtualization service and the hyper-converged virtualized display device driver. The hyper-converged virtualized display device driver is started and managed by the hyper-converged display virtualization service. The hyper-converged virtual display environment includes a hyper-converged display management service, which is connected to the hyper-converged display virtualization service and the hyper-converged virtual display device driver and is used to: load and run the hyper-converged virtual display environment; send network data packets consisting of display server's display device driver function call information to the hyper-converged virtual display device driver; receive and parse network data packets consisting of display device driver execution result information returned by the hyper-converged virtual display device driver; Collects display resource information managed by the hyper-converged display virtualization service on each server node, and uniformly manages the display resources of multiple server nodes; When the hyper-converged virtual display environment needs to call the display resources on the corresponding server node, the hyper-converged virtualized display device driver of the corresponding server node calls the display device driver, and the display device driver calls the display resources on the physical layer. Finally, the hyper-converged virtualized display device driver returns a network data packet consisting of the execution result information of the display device driver to the hyper-converged virtual display environment, and the hyper-converged display management service completes the call processing of the display resources of the corresponding server node through the returned execution result information, so as to realize the unified management and scheduling of the display resources of multiple server nodes by the hyper-converged virtual display environment; The hyper-converged display virtualization service is used to collect display resource information of the server node, manage the display resources of the server node, and provide the display resource information of the server node to the hyper-converged display management service through the network, so that the hyper-converged display management service can uniformly manage and schedule the display resources of each server node. At the same time, the hyper-converged display virtualization service receives the application of the hyper-converged display management service for the display device driver and controls whether the hyper-converged display node is used by the hyper-converged virtual display environment. The hyper-converged display management service creates multiple independently running hyper-converged virtual display environments through the display server. Different hyper-converged virtual display environments flexibly allocate different server nodes, so that each hyper-converged virtual display environment is assigned a different server node's virtualized display device driver for use, so that different hyper-converged virtual display environments run the display resources provided by different server nodes, and display different display interfaces through the display devices of the corresponding server nodes. At the same time, the display server allocates hyper-converged computing resources through the hyper-converged display management service.

2. The hyper-convergence-based display resource management system according to claim 1, wherein: The display device driver of the hyper-converged display node includes an application layer and a kernel layer; The display device drivers provided by the application layer include display application layer drivers, virtualized display application layer drivers, and other display application layer drivers; The display device drivers provided by the kernel layer include CPU kernel device drivers, DRM display kernel device drivers, and other display kernel device drivers.

3. The hyper-convergence-based display resource management system according to claim 1, wherein: The hyper-converged virtual display environment also includes libdrm, libx, a display server, and an accelerated rendering module, which are all started by a hyper-converged display management service. After the hyper-converged display management service receives and parses the network data packet composed of the display device driver execution result information returned by the virtualized display device driver, the display server uniformly organizes and coordinates the control of libdrm, libx, and the accelerated rendering module to complete the display function of the display resources of the corresponding server node.

4. The hyper-convergence-based display resource management system according to claim 1, wherein: The hyper-converged virtual display environment uses computing resources, storage resources, network resources and virtualization resources of a multi-node hyper-converged cluster.

Images