Display resource management system based on hyper-fusion

Abstract

The display resource management system based on hyper-convergence comprises a multi-node hyper-convergence cluster which is composed of a plurality of server nodes connected through a switch; the hyper-converged virtual display environment is established on the multi-node hyper-converged cluster and is used for uniformly managing and scheduling display resources of a plurality of server nodes; a hyper-converged display node runs on each server node, the hyper-converged display node comprises a display virtualization layer, a display device driver and a physical layer, and the display virtualization layer manages and calls the display device driver of the corresponding server node and responds to hyper-converged virtual display environment call and management; and the hyper-converged virtual display environment uniformly calls hyper-converged display nodes of a plurality of server nodes by means of a hyper-converged technology. According to the lightweight and efficient hyper-converged cluster display resource management and use method provided by the invention, the construction difficulty, complexity and workload of a service node display environment are greatly reduced, and the utilization rate and flexibility of hyper-converged cluster display resources are improved.

Description

Technical Field

[0001] The present invention relates to the field of virtualization technology, and particularly to a display resource management system based on hyper-convergence. Background Art

[0002] Hyper-Converged Infrastructure (HCI) is a modern data center architecture that integrates computing, storage, networking, and virtualization resources into a single device or modular suite. Through software-defined means, all resources are managed and allocated to form a unified management platform. This architecture enables enterprises to easily increase resources by horizontally scaling nodes without reconfiguring the system.

[0003] The linux system manages system display through xorg and wayland technologies. xorg can conveniently manage multiple display devices, support multiple graphics cards simultaneously, and can call multiple display resources.

[0004] The hyper-convergence technology only provides a simple control interface and lacks a rich display environment. There is a lack of a unified and effective way to manage and organize display resources in hyper-convergence. At the same time, there is a lack of an effective way to uniformly call corresponding display resources, and it is relatively difficult to achieve through a simple interface. Summary of the Invention

[0005] To solve the deficiencies of the existing technology, the present invention provides a display resource management system based on hyper-convergence, including: A multi-node hyper-converged cluster composed of multiple server nodes connected by switches; A hyper-converged virtual display environment established on the multi-node hyper-converged cluster through virtualization technology, used to uniformly manage and schedule the display resources of multiple server nodes within the multi-node hyper-converged cluster; In the multi-node hyper-converged cluster, a hyper-converged display node runs on each server node. The hyper-converged display node includes a display virtualization layer, a display device driver, and a physical layer connected in sequence. When the hyper-converged virtual display environment needs to call the display resources on the corresponding server node, the display virtualization layer of the corresponding server node calls the display device driver, and the display device driver calls the display resources on the physical layer. Finally, the display virtualization layer returns a network data packet composed of the execution result information of the display device driver to the hyper-converged virtual display environment, and the hyper-converged virtual display environment completes the call processing of the display resources of the corresponding server node through the returned execution result information, so as to achieve the unified management and scheduling of the display resources of multiple server nodes by the hyper-converged virtual display environment.

[0006] Among them, the display device driver of the hyper-converged display node includes an application layer and a kernel layer; The display device drivers provided by the application layer include display application layer drivers, virtualized display application layer drivers, and other display application layer drivers; The display device drivers provided by the kernel layer include CPU kernel device drivers, DRM display kernel device drivers, and other display kernel device drivers.

[0007] Among them, the display virtualization layer of the hyper-converged display node includes a hyper-converged display virtualization service and a hyper-converged virtualized display device driver. Among them, The hyper-converged virtualized display device driver is responsible for calling the display device driver, and the hyper-converged virtualized display device driver is started and managed by the hyper-converged display virtualization service; Both the hyper-converged display virtualization service and the hyper-converged virtualized display device driver are connected to the hyper-converged virtual display environment. When the hyper-converged virtual display environment needs to call the display resources on the corresponding server node, the hyper-converged virtualized display device driver receives and parses the network data packet composed of display device driver function call information sent by the hyper-converged virtual display environment, and calls the display device driver to call the relevant display resources. At the same time, the hyper-converged virtualized display device driver returns a network data packet composed of display device driver execution result information to the hyper-converged virtual display environment.

[0008] Among them, the hyper-converged virtual display environment includes a hyper-converged display management service. The hyper-converged display management service is connected to both the hyper-converged display virtualization service and the hyper-converged virtualized display device driver, and is used for: Loading and running the hyper-converged virtual display environment; Sending a network data packet composed of display server's display device driver function call information to the hyper-converged virtualized display device driver; Receiving and parsing the network data packet composed of display device driver execution result information returned by the hyper-converged virtualized display device driver; Collecting the display resource information managed by the hyper-converged display virtualization service on each server node, and uniformly managing the display resources of multiple server nodes.

[0009] Among them, the hyper-converged display virtualization service is used to collect the display resource information of the local server node, manage the display resources of the local server node, and provide the display resource information of the local server node to the hyper-converged display management service through the network for the hyper-converged display management service to uniformly manage and schedule the display resources of each server node; at the same time, the hyper-converged display virtualization service receives the application of the hyper-converged display management service for the display device driver, and controls whether the hyper-converged display node is used by the hyper-converged virtual display environment.

[0010] Among them, the hyper-converged virtual display environment further includes libdrm, libx, a display server, and an accelerated rendering module, all of which are started by the hyper-converged display management service; after the hyper-converged display management service receives and parses the network data packet composed of the execution result information of the display device driver returned by the virtualized display device driver, the display server uniformly organizes and coordinates the control of libdrm, libx, and the accelerated rendering module to complete the display function implementation of the display resources of the corresponding server node.

[0011] Among them, the hyper-converged virtual display environment uses the computing resources, storage resources, network resources, and virtualization resources of a multi-node hyper-converged cluster.

[0012] The present invention provides a unified hyper-converged virtual display environment for hyper-converged service applications, reducing the display environment construction work of each service node; the present invention provides a unified scheduling and usage method for display resources, a unified virtualized display environment, and unified display control based on hyper-convergence, eliminating the display environment deployment of each server node and greatly improving the simplicity of the server node system. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 It is a logical architecture diagram of the display resource management system based on hyper-convergence of the present invention.

[0014] Figure 2 It is a logical architecture diagram of a single server node in the display resource management system based on hyper-convergence of the present invention.

[0015] Figure 3 It is a schematic diagram of data interaction in the resolution setting process in an embodiment of the display resource management system based on hyper-convergence of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0016] In order to have a further understanding of the technical solutions and beneficial effects of the present invention, the technical solutions of the present invention and the beneficial effects produced thereby will be described in detail below with reference to the accompanying drawings.

[0017] Figure 1 It is a logical architecture diagram of the display resource management system based on hyper-convergence of the present invention. As Figure 1 shown, the display resource management system based on hyper-convergence of the present invention includes: A multi-node hyper-converged cluster, which is composed of multiple server nodes (corresponding to Figure 1 "server node 1", "server node 2", "server node 3", and "server node N" in the figure) connected by a switch; A hyper-converged virtual display environment, through virtualization technology (including Figure 1The "computing virtualization", "storage virtualization", "display virtualization" and "other virtualizations" shown are built on a multi-node hyper-converged cluster and are used to uniformly manage and schedule the display resources of multiple server nodes within the multi-node hyper-converged cluster.

[0018] The hyper-converged virtual display environment is provided by the hyper-converged display management service through display servers. The unified management of the display resources (which are the hardware resources required for the display environment to run, such as HDMI interfaces, graphics cards, hardware decoders, etc.) by the hyper-converged virtual display environment is also achieved through the management of the display device drivers of all server nodes belonging to the hyper-converged virtual display environment by the hyper-converged display management service (detailed below). The display resources of different server nodes exist in the form of a display resource pool in the hyper-converged virtual display environment. The hyper-converged display management service can obtain the addition and deletion of server nodes through the network from the hyper-converged display virtualization service (detailed below) in the display virtualization layer of each server node and dynamically adjust the display resource pool. Specifically, the hyper-converged display management service can directly use the display resources of the corresponding server nodes of the multi-node hyper-converged cluster, or use the display resources of the corresponding server nodes by applying to the display resource pool.

[0019] When a business application needs to use the display resources of relevant server nodes, the hyper-converged display management service uniformly allocates the display resources for the business application to use.

[0020] For the specific implementation mechanism, please refer to Figure 2 shown for understanding. Figure 2 This is the logical architecture diagram of a single server node in the display resource management system based on hyper-convergence of the present invention: In a multi-node hyper-converged cluster, a hyper-converged display node runs on each server node. The hyper-converged display node includes a display virtualization layer, a display device driver, and a physical layer connected in sequence. When the hyper-converged display management service needs to call the display resources on the corresponding server node, the display virtualization layer of the corresponding server node calls the display device driver, and the display device driver calls the display resources on the physical layer (including Figure 2 the SOC, rendering acceleration device, and display device shown), and finally the display virtualization layer returns a network data packet composed of the execution result information of the display device driver to the hyper-converged display management service. The hyper-converged display management service parses the network data packet to obtain the execution result information and completes the call processing of the display resources of the corresponding server node through the returned execution result information, so as to achieve the unified management and scheduling of the display resources of multiple server nodes by the hyper-converged virtual display environment.

[0021] In the present invention, the display device driver of the hyper-converged display node is loaded from the server node and includes an application layer and a kernel layer: The display device drivers provided by the application layer include display application layer drivers, virtualized display application layer drivers (virtualized display device drivers provided through virtualization methods, including GPU virtualized display device drivers, VPU virtualized display device drivers, etc.), and other display application layer drivers, which are mainly used to implement advanced display device driver functions; The display device drivers provided by the kernel layer include CPU kernel device drivers, DRM display kernel device drivers, and other display kernel device drivers.

[0022] In the present invention, the display virtualization layer of the hyper-converged display node includes a hyper-converged virtualized display device driver and a hyper-converged display virtualization service; among them, the hyper-converged virtualized display device driver is provided by the hyper-converged display virtualization service, and the hyper-converged display virtualization service runs on the server node; The hyper-converged virtualized display device driver is used to implement the following functions described above: 1. Receive and parse the network data packet composed of the display device driver function call information sent by the hyper-converged display management service; 2. The hyper-converged virtualized display device driver parses the received network data packet and calls the corresponding display device driver, and the display device driver calls the display resources on the physical layer; 3. Obtain the execution result information of the display device driver, and form a network data packet with the execution result information and send it to the hyper-converged display management service; After the virtualized display device driver calls the display device driver, the corresponding display device driver will return relevant data, such as command execution results, display status query results, etc. These results need to be obtained and transmitted through the network to the hyper-converged display management service, which is parsed and forwarded by the hyper-converged display management service to display servers such as xserver for processing.

[0023] The hyper-converged display virtualization service is connected to the hyper-converged display management service in the hyper-converged virtual display environment. The hyper-converged display virtualization service collects the display resource information of the local server node, manages the display resources of the local server node, and provides the display resource information of the local server node to the hyper-converged display management service through the network for the hyper-converged display management service to uniformly manage and schedule the display resources of each server node. At the same time, the hyper-converged display virtualization service receives the usage application of the display device driver from the hyper-converged display management service and controls whether the hyper-converged display node is used by the hyper-converged virtual display environment.

[0024] Please continue to refer to Figure 1As shown in the figure, the hyper-converged virtual display environment of the present invention further includes a display server (such as Xserver or weston), libdrm, libX, and an accelerated rendering module (including OpenCL, OpenGL, FFmpeg, etc.); among them, the display server, libdrm, libX, and the accelerated rendering module are all started by the hyper-converged display management service in a multi-node hyper-converged cluster environment. The cooperation mode of the hyper-converged display management service, the display server, the hyper-converged virtual display environment, and the hyper-converged virtualized display device driver in a specific functional implementation process is as follows: 1. The hyper-converged display management service starts the display server, and then calls libdrm, libX, and the accelerated rendering module through the display server to load and start the hyper-converged virtual display environment through the hyper-converged display nodes of each server node, and establishes a display resource pool. The hyper-converged display management service receives the display resource call request of the business application; 2. The hyper-converged display management service sends a network data packet composed of display device driver function call information to the hyper-converged virtualized display device driver of the corresponding server node; 3. The hyper-converged virtualized display device driver receives and parses the network data packet composed of display device driver function call information sent by the hyper-converged display management service, and calls the display device driver to call relevant display resources; 4. The hyper-converged virtualized display device driver obtains the display device driver execution result information and returns a network data packet composed of the display device driver execution result information to the hyper-converged display management service of the hyper-converged virtual display environment; 5. The hyper-converged display management service receives the network data packet, parses it and returns it to modules such as the display server, and then the display server and other modules process it and return it to the business application.

[0025] The hyper-converged virtual display environment runs in a hyper-converged cluster composed of multiple server nodes. The running tasks of the hyper-converged virtual display environment are allocated by the hyper-converged technology to different server nodes of the hyper-converged cluster for running. The use of display resources by the hyper-converged virtual display environment is coordinated by the hyper-converged technology and the hyper-converged display management service to use various display device drivers of the server nodes of the corresponding hyper-converged cluster to use the corresponding display resources. For example, if a business application needs to set the display screen resolution of a specific server node, the business application calls the hyper-converged virtual display environment. The hyper-converged virtual display environment determines and uses the display device driver of the display resources of the corresponding display screen of the corresponding server node through the hyper-converged technology and the hyper-converged display management service, and sets the display screen resolution of the corresponding server node by calling the display device driver. For the specific method, please refer to Figure 3 for understanding.

[0026] The hyper-converged virtual display environment uses the computing resources, storage resources, network resources, and virtualization resources of the hyper-converged cluster. Further, the hyper-converged virtual display environment can process a large number of display tasks and use a huge amount of storage resources with the help of hyper-converged technology, and can run display tasks that cannot be run by a single server node.

[0027] For example, the display server needs to call the display device driver interface to complete relevant display functions. For example, the resolution setting needs to call the corresponding driver interface; the display server needs to call the accelerated rendering module to call rendering acceleration hardware and other devices of different server nodes to achieve the rendering acceleration function.

[0028] Thus, through the display server, the display resources of each server node can be flexibly used and controlled, and at the same time, deploying the display environment on different hyper-converged cluster server nodes is avoided, greatly reducing the difficulty, complexity, and workload of building the display environment of the service node, and improving the utilization rate and flexibility of the display resources of the hyper-converged cluster.

[0029] In the process of implementing the above functions, with the help of storage virtualization technology, the display server can flexibly use relevant files of different server nodes.

[0030] It should be noted that in the present invention Figure 1 only one hyper-converged virtual display environment is shown. In actual operation, the hyper-converged display management service can create multiple independently running hyper-converged virtual display environments through the display server. Different hyper-converged virtual display environments can flexibly allocate different server nodes to allocate virtualized display device drivers of different server nodes for each hyper-converged virtual display environment to use, so that different hyper-converged virtual display environments run the display resources provided by different server nodes, and different display interfaces are displayed through the display devices of the corresponding server nodes. At the same time, the display server allocates hyper-converged computing resources through the hyper-converged display management service.

[0031] The hyper-converged display management service can manage and record the display device status of different server nodes to provide unified support for multiple hyper-converged virtual display environments.

[0032] The present invention provides a unified hyper-converged virtual display environment for hyper-converged service applications, reducing the display environment building work of each service node; the present invention provides a unified scheduling and use method of display resources, a unified virtualized display environment, and unified display control based on hyper-convergence, removing the display environment deployment of each server node, and greatly improving the simplicity of the server node system.

[0033] Please combine Figure 3As shown in the figure, in a specific embodiment of the present invention, a hyper-converged display resource management system based on Feiteng servers and Kylin systems is provided, as well as a method for setting the screen resolution of the system, as follows: 1. Multiple Feiteng server nodes are interconnected through a network switch and form a multi-node hyper-converged cluster through the hyper-converged method. Correspondingly, each Feiteng server node has display resources such as an HDMI display interface, a hardware codec device, and a graphics card device; 2. Each hyper-converged Feiteng server node loads the corresponding display resources such as an HDMI display interface, a hardware codec device, and a graphics card device, and runs the hyper-converged display virtualization service; the hyper-converged display virtualization service collects display resource information, manages the display resources of the corresponding server node, and provides a hyper-converged virtualized display device driver through the network; 3. The hyper-converged display management service reads the display resource data of each Feiteng server node through the network, establishes a connection with the hyper-converged display virtualization service of each server node, and maintains the display resource pool; 4. The hyper-converged display management service loads component modules such as libdrm and libX through the virtualized display device driver function provided by the server node, starts the Xserver display server, and further loads the Kylin ukui display environment; 5. The hyper-converged display management service uniformly manages and organizes the display resources of each server node. For example, when mpv needs to play a video, the hyper-converged display management service uniformly organizes, coordinates, and controls to provide the corresponding function through the Xserver display server, and selects the display device of the corresponding server node to support the mpv video playback, such as providing an HDMI display interface.

[0034] Furthermore, the mpv video playback can be played to the HDMI display interfaces of multiple server nodes through the Xserver display server. The video data can be decoded by the hardware codec devices of multiple server nodes.

[0035] Furthermore, the display server runs on the hyper-converged cluster, and can uniformly organize and manage the display resources, which is convenient to realize the use and function implementation of the display resources of multiple server nodes. For example, functions such as multi-screen management of each server node of the hyper-converged cluster can be realized through the display server.

[0036] When using the function of the acceleration rendering module, it is realized through the management of the display server. For example, when video loading and rendering are required, the graphics card devices of multiple server nodes are called to provide acceleration for video loading and rendering.

[0037] 6. The hyper-converged display management service forms network data packets from the display device driver function call information corresponding to the display devices of the Feiteng server nodes in the hyper-converged virtual display environment and sends them to the corresponding server nodes; at the same time, it receives and parses the network data packets composed of the display device driver execution result information obtained by the hyper-converged virtualization display device driver of the corresponding Feiteng server node to respond to or call the corresponding display server functions. For example: when an application needs to set the screen resolution of the HDMI graphics card interface of a certain Feiteng server node, the display server is called through the application to set the screen resolution. The hyper-converged display management service captures the screen resolution setting command and converts the screen resolution setting command into a corresponding network data packet for the resolution setting of the Feiteng server node and sends it to the corresponding Feiteng server node (corresponding to Figure 3 "converting the screen resolution setting command into a data packet for a certain server node and sending it out"), the hyper-converged virtualization display device driver of the corresponding Feiteng server node receives the network data packet composed of the resolution setting command, parses it and calls the display device driver (specifically, calls the screen resolution setting driver interface). The display device driver calls the resolution setting interface of the HDMI display device driver of the corresponding node to write the resolution setting data to the HDMI hardware register (corresponding to Figure 3 "setting the hardware") to complete the screen resolution setting ("screen" corresponds to Figure 3 "display device"), the display device driver reads the register information and returns the resolution setting result (corresponding to Figure 3 "reading the hardware setting information"); at the same time, it returns the execution result of the display device driver resolution setting to the hyper-converged virtualization display device driver (corresponding to Figure 3 "returning the driver setting information"), the hyper-converged virtualization display device driver sends the network data packet composed of the resolution setting information to the hyper-converged display management service (corresponding to Figure 3 "forming a data packet from the driver return information and sending it out"), the hyper-converged display management service parses the data packet and sends it to the display server, and the display server calls the relevant functions to process the successful resolution setting information and returns it to the application.

[0038] Although the present invention has been described using the above preferred embodiments, it is not intended to limit the protection scope of the present invention. Any person skilled in the art can make various changes and modifications to the above embodiments without departing from the spirit and scope of the present invention, and still fall within the protection scope of the present invention. Therefore, the protection scope of the present invention shall be defined by the claims.

Claims

1. A display resource management system based on hyper-convergence, characterized in that: include: A multi-node hyper-converged cluster consists of multiple server nodes connected by switches; The hyper-converged virtual display environment is built on a multi-node hyper-converged cluster through virtualization technology, and is used to uniformly manage and schedule the display resources of multiple server nodes in the multi-node hyper-converged cluster; In a multi-node hyper-converged cluster, a hyper-converged display node runs on each server node. The hyper-converged display node includes a display virtualization layer, a display device driver and a physical layer connected in sequence. When the hyper-converged virtual display environment needs to call the display resources on the corresponding server node, the display virtualization layer of the corresponding server node calls the display device driver, and the display device driver calls the display resources on the physical layer. Finally, the display virtualization layer returns a network data packet consisting of the execution result information of the display device driver to the hyper-converged virtual display environment, and the hyper-converged virtual display environment completes the call processing of the display resources of the corresponding server node through the returned execution result information, so as to realize the unified management and scheduling of the display resources of multiple server nodes by the hyper-converged virtual display environment.

2. The hyper-convergence-based display resource management system according to claim 1, characterized in that: The display device driver of the hyper-converged display node includes an application layer and a kernel layer; The display device drivers provided by the application layer include display application layer drivers, virtualized display application layer drivers, and other display application layer drivers; The display device drivers provided by the kernel layer include CPU kernel device drivers, DRM display kernel device drivers, and other display kernel device drivers.

3. The hyper-convergence-based display resource management system according to claim 1, characterized in that: The display virtualization layer of the hyper-converged display node includes a hyper-converged display virtualization service and a hyper-converged virtualized display device driver, wherein: The hyper-converged virtualized display device driver is responsible for calling the display device driver. The hyper-converged virtualized display device driver is started and managed by the hyper-converged display virtualization service. The hyper-converged display virtualization service and the hyper-converged virtual display device driver are both connected to the hyper-converged virtual display environment. When the hyper-converged virtual display environment needs to call the display resources on the corresponding server node, the hyper-converged virtual display device driver receives and parses the network data packet consisting of the display device driver function call information sent by the hyper-converged virtual display environment, and calls the display device driver to call the relevant display resources. At the same time, the hyper-converged virtual display device driver returns a network data packet consisting of the display device driver execution result information to the hyper-converged virtual display environment.

4. The hyper-convergence-based display resource management system according to claim 3, characterized in that: The hyper-converged virtual display environment includes a hyper-converged display management service, which is connected to a hyper-converged display virtualization service and a hyper-converged virtualized display device driver, and is used to: Load and run the hyper-converged virtual display environment; Sending a network data packet consisting of a display server's information on a display device driver function call to a hyper-converged virtualized display device driver; Receive and parse the network data packet composed of the display device driver execution result information returned by the hyper-converged virtualized display device driver; Collects display resource information managed by the hyper-converged display virtualization service on each server node, and uniformly manages display resources of multiple server nodes.

5. The hyper-convergence-based display resource management system according to claim 4, characterized in that: The hyper-converged display virtualization service is used to collect display resource information of the server node, manage the display resources of the server node, and provide the display resource information of the server node to the hyper-converged display management service through the network, so that the hyper-converged display management service can uniformly manage and schedule the display resources of each server node; at the same time, the hyper-converged display virtualization service receives the application for the display device driver from the hyper-converged display management service and controls whether the hyper-converged display node is used by the hyper-converged virtual display environment.

6. The hyper-convergence-based display resource management system according to claim 4, characterized in that: The hyper-converged virtual display environment also includes libdrm, libx, a display server and an accelerated rendering module, and the libdrm, libx, the display server and the accelerated rendering module are all started by a hyper-converged display management service; after the hyper-converged display management service receives and parses the network data packet composed of the display device driver execution result information returned by the virtualized display device driver, the display server uniformly organizes and coordinates the control of libdrm, libx and the accelerated rendering module to complete the display function of the display resources of the corresponding server node.

7. The hyper-convergence-based display resource management system according to claim 1, characterized in that: The hyper-converged virtual display environment uses computing resources, storage resources, network resources and virtualization resources of a multi-node hyper-converged cluster.

Images