Graphics remote display method, graphics display service container and service node

By deploying independent graphical display service containers on service nodes, using inter-process transmission and difference comparison processing technology, the remote display resource consumption and security of graphical application containers is solved, and the efficiency and security of remote display are improved.

CN118672539BActive Publication Date: 2024-11-19SICHUAN MEDITATION SOFTWARE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411045504.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2024-11-19
Estimated Expiration
2044-08-01

AI Technical Summary

Technical Problem

In the prior art, graphics application containers require additional graphics display service-related components when remotely display, resulting in increased resource consumption, unsafe transmission process, network delay and inefficient.

Method used

Deploy an independent graphical display service container on the service node, and image processing and transmission are performed by transferring data between processes, avoiding cross-node transmission, and using differential comparison to process images to ensure transmission security and efficiency.

Benefits of technology

Reduces resource consumption and storage space of graphics application containers, avoids software package dependency conflicts, ensures the security and efficiency of data transmission, and improves the efficiency of remote display.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118672539B_ABST
    Figure CN118672539B_ABST
Patent Text Reader

Abstract

The present application discloses a method for remote display of graphics, a graphics display service container and a service node. The method processes images to be remotely displayed independently through a graphics display service container, does not invade a graphics application container during the processing, can avoid software package dependency conflicts between a graphics display server container and a graphics application container, reduces resource consumption and storage space of the graphics application container, and further, because data is transmitted between the graphics display service container and each graphics application container through inter-process data transmission without passing through an external network, there is no need to open network access to other containers, can ensure the security of the transmission process, avoid data leakage, and can avoid cross-node transmission between the two, reduce network delay and resource occupation, so can improve the efficiency of image processing, and further improve the efficiency of remote display.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure generally relates to the field of remote display technology, and in particular to a method for remotely displaying graphics, a graphics display service container, and a service node. Background Art

[0002] Currently, container technology, as a lightweight virtualization method, has been widely used due to its significant advantages in rapid application startup, deployment and delivery. However, with the popularity of graphics application containers in various complex systems, how to efficiently and securely implement remote display of these applications has become an urgent problem to be solved.

[0003] When graphical applications based on the graphics display protocol service architecture run in a container, they currently often display images remotely by means of local drawing and remote display.

[0004] However, the above method needs to run additional graphics display service related components in the graphical application container, which increases the resource consumption of the graphical application container. Summary of the invention

[0005] In view of the above-mentioned defects or deficiencies in the prior art, it is desirable to provide a method for remotely displaying graphics and a graphics display service container.

[0006] A first aspect provides a method for remotely displaying graphics, which is applied to a container cluster network, wherein the container cluster network includes at least one container cluster, the container cluster includes at least one service node, and a graphics display service container and at least one graphics application container are deployed on the service node. The method includes:

[0007] The graphic display service container receives a display request sent by a remote display terminal, and establishes a target graphic processing thread based on the display request, wherein the display request is used to request the remote display target graphic application container to display a target image at the current moment;

[0008] The graphic display service container obtains a first image corresponding to the target graphic application container stored in the target storage space of the service node at the current moment;

[0009] The graphic display service container obtains a second image corresponding to the target graphic application container stored in the target storage space of the service node at a moment before the current moment, and performs a difference comparison process on the first image based on the second image through the target graphic processing thread to obtain the target image;

[0010] The graphic display service container sends the target image to the remote display terminal for remote display via the remote display terminal.

[0011] The method for remote display of graphics provided by the present application takes into account the problem that currently, the image to be displayed on the service node is generated by deploying graphic display service-related components in the container of the service node and is only displayed through the remote display terminal, resulting in resource consumption of the service node graphical application container. The present application provides a method for remote display of graphics, deploys a graphic display service container on the service node, establishes a target image processing thread according to a display request sent by the remote display terminal through an independently running graphic display service container, obtains a first image corresponding to the target graphic application container stored in the target storage space of the service node at the current moment, and obtains a second image sent by the target graphic application container from the memory of the target image processing thread, performs difference comparison processing on the first image based on the second image through the target graphic processing thread, obtains the target image, and finally sends the target image to the remote display terminal for remote display. The method for remote display of graphics provided by the present application independently processes the images that need to be remotely displayed through the graphics display service container, and will not cause intrusion to the graphics application container during the processing process, which can avoid software package dependency conflicts between the graphics display server container and the graphics application container, and reduce resource consumption and storage space of the graphics application container. In addition, since the graphics display service container and each graphics application container transmit data between processes without passing through an external network, there is no need to open network access to other containers, which can ensure the security of the transmission process and avoid data leakage. Finally, since the graphics display service container and each graphics application container run on the same service node, cross-node transmission between the two can be avoided, reducing network delays and resource usage, so that the efficiency of image processing can be improved, and the efficiency of remote display is further improved.

[0012] The second aspect provides a graphics display service container, including:

[0013] A display module, used to receive a display request sent by a remote display terminal, and to establish a target graphics processing thread based on the display request, wherein the display request is used to request a remote display target graphics application container to display a target image at the current moment;

[0014] The display module is further used to obtain a first image corresponding to the target graphic application container stored in the target storage space of the service node at the current moment;

[0015] The display module is also used to perform difference comparison processing on the first image based on the second image through the target graphics processing thread to obtain the target image, the second image is stored in the memory of the graphics processing thread, and the target graphics application container sends the historical image to the remote display end for remote display through the remote display end.

[0016] A third aspect provides a service node, including the graphic display service container provided by the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0018] Figure 1 An application scenario diagram of a method for remote display of graphics provided in this application;

[0019] Figure 2 A flowchart of the steps of a method for remote display of graphics provided by the present application;

[0020] Figure 3 A flowchart of the steps of a method for remote display of graphics provided by the present application;

[0021] Figure 4 A flowchart of the steps of a method for remote display of graphics provided by the present application;

[0022] Figure 5 A flowchart of the steps of a method for remote display of graphics provided by the present application;

[0023] Figure 6 A flowchart of the steps of a method for remote display of graphics provided by the present application;

[0024] Figure 7 A schematic diagram of a difference comparison provided in this application;

[0025] Figure 8 A structural block diagram of a graphical display service container provided for this application;

[0026] Fig. 9 A schematic diagram of the structure of a computer system of a service node provided in this application. DETAILED DESCRIPTION

[0027] The present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It is also necessary to explain that, for ease of description, only the parts related to the invention are shown in the accompanying drawings.

[0028] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0029] Please refer to Figure 1 , Figure 1An application scenario diagram of a method for remote display of graphics provided in the present application, the application scenario diagram includes a container cluster network, the container cluster network includes at least one container cluster, the container cluster includes at least one service node, a graphics display service container and at least one graphics application container are deployed on the service node, and at least one graphics application container transmits data to the graphics display service container by transmitting data between processes. The graphics display service container is capable of receiving an image sent by a graphics application container deployed on the service node, and further storing the image in the storage space of the service node. When the graphics display service container receives a display request sent by a remote display terminal, the corresponding image is obtained from the storage space of the service node according to the established graphics processing thread for processing to obtain the target image that the remote display terminal needs to display, and is sent to the remote display terminal for remote display.

[0030] Combine the following Figure 2 The method for remote display of graphics provided by the present application is exemplarily described. Figure 2 A flowchart of a method for remote display of graphics provided in this application, wherein the method is applied to Figure 1 The method is described by taking the graphic display service container in as an example. The method includes the following steps:

[0031] Step S20, the graphics display service container receives a display request sent by the remote display terminal, and establishes a target graphics processing thread based on the display request, wherein the display request is used to request the remote display target graphics application container to display a target image at the current moment;

[0032] There may be multiple remote display terminals, and the multiple remote display terminals may be connected to different display interfaces of the service node. After the graphic display service container processes the image, the image may be sent to the remote display terminal through the corresponding display interface on the service node.

[0033] Accordingly, when the remote display terminal has a need to display the graphics of the corresponding graphic application container, it will send a display request to the corresponding display interface to establish remote communication with the graphic display service container.

[0034] It is understandable that each remote display terminal may be used to display the image of the corresponding graphic application container. For example, remote display terminal 1 is used to display the image on the graphic application container A, remote display terminal 2 is used to display the image on the graphic application container B, and remote display terminal 3 is used to display the image on the graphic application container C.

[0035] In order to facilitate the graphics display service container to determine the target graphics application container, the display request may carry the unique identifier of the target graphics application container, so that after receiving the display request, the graphics display service container parses the display request to obtain the unique identifier of the graphics application container, and can determine the target graphics application container from multiple graphics application containers, so as to further obtain the image that needs to be displayed by the target graphics application container at the current moment from the corresponding storage space for processing.

[0036] The graphics display service container needs to rely on the graphics processing thread of the graphics display service container to process the image that the target graphics application container needs to display at the current moment. However, since the historical graphics processing threads of the graphics display service container will be destroyed when the graphics display service container does not need to process the image, when the graphics display service container receives the display request sent by the remote display terminal, it will re-establish the target graphics processing thread to use the target graphics processing thread to process the target image that the target graphics application container needs to display at the current moment.

[0037] Step S30, the graphic display service container obtains a first image corresponding to a target graphic application container stored in a target storage space of the service node at the current moment;

[0038] Among them, the graphic display service container determines that the target graphic application container needs to display the target image at the current moment, so the graphic display service container needs to obtain the target image corresponding to the target graphic application container. The target image needs to be obtained from the storage space used to store the target graphic application container in the service node, but because the storage space stores images for each graphic application container in an overall manner, that is, the images sent for the same graphic application container will be arranged together and stored in the order of sending time, so if you want to obtain the target image to be displayed at the current moment, you need to obtain it based on the first image corresponding to the target graphic application container stored in the target storage space of the service node at the current moment and the second image corresponding to the target graphic application container stored in the target storage space of the service node at the previous moment of the current moment through processing.

[0039] Then the graphic display service container needs to obtain the first image and the second image by, for example, directly reading from the target storage space of the service node storing the image sent by the target graphic application container.

[0040] In an optional embodiment, the present application provides an optional method embodiment for obtaining a first image. However, for better understanding, before describing the method, we describe the way in which the service node stores images sent by each graphic application container: Figure 3 shown.

[0041] Step S301, a graphic display service container receives an image transmitted by at least one graphic application container through an inter-process data transmission method;

[0042] Among them, the graphics display service container and at least one graphics application container are both deployed in the service node, but the difference from the prior art is that the graphics display service container of the present application is another container independent of the graphics application container. Such deployment realizes the decoupling of the graphics display service container and at least one graphics application container. Therefore, the graphics display service container can be independently maintained and upgraded without intrusion into the graphics application container. In addition, such a setting can avoid software package dependency conflicts between the graphics display service container and the graphics application container. At the same time, the graphics application container does not need to integrate graphics display service-related components, which reduces the image size and resource consumption of the graphics application container and avoids occupying a larger storage space.

[0043] From the above, it can be seen that the graphics display service container and at least one graphics application container are isolated, and images are transmitted between the graphics display service container and the graphics application container through the transmission method of data transmission between processes. It does not need to pass through the network set up on the service node, so there is no need to open network access to the outside world, which can ensure the security of image transmission and avoid data leakage. In addition, since the graphics display service container and the graphics application container are deployed on the same service node, there is no need for cross-node transmission between the two, which can reduce network delays and the occupation of network resources on the service node, thereby improving the efficiency of image transmission.

[0044] It is understandable that if multiple graphics application containers are deployed on the service node, the multiple graphics application containers can send images to the graphics display service container at the same time, or send images to the graphics display service container in sequence. Each graphics application container can carry a unique identifier of the corresponding graphics application container in the sent image, so that the graphics display service container stores the image accordingly after receiving it.

[0045] It should be noted here that a graphics display module is also deployed in the graphics display service container, and the graphics display service container receives images transmitted by at least one graphics application container through the graphics display module through the transmission method of inter-process data transmission. Each graphics application container transmits images to the graphics display module through the transmission method of inter-process data transmission, and does not need to pass through the network set on the service node, so there is no need to open network access to the outside world, which can ensure the security of image transmission and avoid data leakage. In addition, since the graphics display service container and the graphics application container are deployed on the same service node, there is no need for cross-node transmission between the two, which can reduce network delays and the occupation of network resources on the service node, thereby improving the efficiency of image transmission.

[0046] Step S302: the graphic display service container arranges the images sent by each graphic application container according to the time when each graphic application container sends the image, and creates a data header, the data header including a unique identifier of each graphic application container and a data storage start address and a data storage end address corresponding to the unique identifier of each graphic application container;

[0047] Among them, the graphics display service container is stored in the format of "data header + image". The application in the graphics display service container sets the window resolution and bitmap depth when it starts, and then updates the data header and allocates the image storage space in the kernel module. The allocation of image storage space adopts the following calculation formula:

[0048]

[0049] S represents the storage space that needs to be opened for image data; H represents the vertical resolution of the application window; W represents the horizontal resolution of the application window; b represents bpp, that is, bits per pixel (bitmap depth);

[0050] In addition, images sent by the same graphic application container at different times may be stored in the same storage space of the service node, and images sent by different graphic application containers may be stored in different storage spaces of the service node. Images sent by the same graphic application container at different times may be first arranged in chronological order and then stored uniformly. For example: the data sent by graphic application container A is stored in the form of image 1, image 2, and image 3 connected:

[0051] Among them, Image 1 may be sent by the graphics application container A at the first moment, Image 2 may be sent by the graphics application container A at the second moment, and Image 3 may be sent by the graphics application container A at the third moment. The second moment is later than the first moment, and the third moment is later than the second moment.

[0052] The data header is equivalent to establishing a directory for each graphic application container in the storage space of the service node, which is convenient for the graphic display service container to read. Therefore, the data header includes the unique identifier of each graphic application container and the data storage start address and data length corresponding to the unique identifier of each graphic application container.

[0053] For example: Graphics application container A0x80000002KB

[0054] Graphics application container B0x2000000010KB

[0055] Graphics application container C0x8000000020KB

[0056] Step S303: the graphic display service container stores the image and data header sent by each graphic application container into the corresponding storage space of the service node based on the mapping relationship between the interface of the virtual device and the storage space of the service node.

[0057] Among them, since the storage space of the graphics display service container is isolated from that of the service node, the graphics display service container cannot directly access the storage space of the service node, so the service node registers a virtual device by loading a kernel module to enable the graphics display service container to access the storage space of the service node. By setting up a virtual device, the physical memory limitation of the graphics card is bypassed, thereby providing a larger storage space, and being able to support the simultaneous storage and update of images corresponding to multiple graphics application containers, thereby improving the scalability and graphics processing capabilities of the system.

[0058] Then, when the service node creates an independent graphics display service container through shared directory mounting, file socket, etc., it will first initialize the graphics display service container. These initialization operations may include initializing some basic services, preloading data, etc. Initializing the graphics display service container can ensure that the graphics display service container has all the required dependencies and configurations when it starts, thereby improving the startup efficiency and operation stability of the application.

[0059] Then, during the process of initializing the graphics display service container, the virtual device is registered; in order to enable the graphics display service container to access the storage space of the service node, it is necessary to establish a mapping relationship between the interface of the virtual device and the storage space of the service device, so that the graphics display service container can access the storage space of the service node through the interface of the virtual device.

[0060] Therefore, after receiving the image sent by the graphic application container, the graphic display service container sends the image and the data header to the storage space of the service node through the interface of the virtual device for storage.

[0061] In addition, it should be noted that since the graphics processing thread of the graphics display service container also needs to read the image from the storage space of the service node when performing image processing, it is also necessary to establish a mapping relationship between the storage space of the service device and the graphics processing thread. Since the graphics processing thread cannot directly access the storage space of the service device when there is no mapping relationship between the graphics processing thread and the storage space of the service device, the mapping relationship between the storage space of the service device and the graphics processing thread can only be established by relying on the interface of the virtual device. When the mapping relationship between the storage space of the service device and the graphics processing thread is successfully established, the graphics processing thread can directly access the storage space of the service device without going through the interface of the virtual device.

[0062] Based on the above introduction, the present application also provides a method embodiment for acquiring a first image, which includes the following steps:

[0063] Step S401, the graphic display service container determines a target storage space from a service node according to a unique identifier of a target graphic application container;

[0064] The display request carries the unique identifier of the target graphic application container, and the unique identifier of the target graphic application container can be obtained by parsing the display request. Since the images sent by each graphic application container can be stored in different storage spaces of the service node, the graphic display service container can determine the target storage space from the service node according to the unique identifier of the target graphic application container.

[0065] Optionally, the data header may also record the storage space address of the image corresponding to each graphic application container on the service node. Then the graphic display service container accesses the data header through the target image processing thread and determines the target storage space by matching the data header according to the unique identifier of the target graphic application container.

[0066] Step S402, the graphic display service container obtains the target data storage start address and the data length of the target data corresponding to the unique identifier of the target graphic application container at the current moment from the data header of the target storage space;

[0067] Since the data header includes the unique identifier of each graphic application container and the data storage start address and data length corresponding to the unique identifier of each graphic application container, the target data storage start address and data length of the target data storing the data corresponding to the target graphic application container can be obtained according to the unique identifier of the target graphic application container.

[0068] Step S403, the graphic display service container reads from the target storage space of the service node through the interface of the virtual device starting from the target data storage start address until the read data length equals the data length of the target data, thereby obtaining a first image.

[0069] Among them, after the graphics display service container obtains the target data storage starting address and data length, it starts to perform data reading operations from the target data storage starting address in the target storage space of the service node through the target image processing thread until the read data length is equal to the data length of the target data. In this way, all images sent by the target graphics application container on the target storage space of the service node at the current moment can be obtained.

[0070] Step S40, performing a difference comparison process on the first image based on the second image by the target graphics processing thread to obtain a target image, where the second image is a historical image sent by the target graphics application container and stored in the memory of the graphics processing thread;

[0071] Among them, the second image is stored in the memory of the graphics processing thread, and is a historical image sent by the target graphics application container. Therefore, when the target graphics processing thread is established, the target graphics processing thread can obtain the second image from the memory of the graphics processing thread. Simply put, the data is obtained once. If there is no "last data", the full amount is displayed; if there is "last data", a diff is performed; regardless of whether there is or not, after each execution of the remote display process of the graphics, the first image obtained at the current moment will be set as the second image, so only one copy of the data is cached in the memory of the graphics processing thread, that is, the latest image data sent by the graphics application container.

[0072] Optionally, the data header will regenerate the data storage start address and data length corresponding to the unique identifier of each graphic application container according to each image update. That is to say, the data header will record the data storage start address and data length corresponding to the unique identifier of each graphic application container after each graphic application container sends an image. Therefore, the data header includes not only the target data storage start address and data length of the image stored in the target graphic application container at the current moment, but also the data storage start address and data length of the image stored in the target graphic application container at the previous moment of the current moment. Correspondingly, it can also promptly include the data storage start address and data length of the image stored in the target graphic application container at the previous moment of the previous moment.

[0073] After acquiring the first image and the second image, the graphic display service container performs a difference comparison process to obtain the target image.

[0074] In an optional embodiment, if Figure 5 As shown, Figure 5 An optional method embodiment of obtaining a target image provided by an exemplary embodiment of the present application includes the following steps:

[0075] Step S501, the target graphics processing thread of the graphics display service container performs a difference comparison process on the first image based on the second image by using a comparison algorithm;

[0076] Among them, due to the limitation of image storage method, the first image and the second image obtained by the graphic display service container are all full images (that is, all images sent historically stored in the target storage space by the target graphic application container at different times), so only by difference comparison can it be determined whether the target graphic application container has sent an image at the current moment and what image has been sent. Using the comparison algorithm, only obtaining the target image can significantly reduce the bandwidth consumption and data transmission volume when transmitting images, and improve the efficiency and response speed of remote display.

[0077] In an optional embodiment, if Figure 6 As shown, Figure 6 An optional method embodiment of performing difference comparison processing on a first image based on a second image is provided in an exemplary embodiment of the present application. The method embodiment includes the following steps:

[0078] Step S601: The graphic display service container divides the first image into a plurality of first pixel blocks and the second image into a plurality of second pixel blocks according to the corresponding region division method, wherein the first regions corresponding to the plurality of first pixel blocks and the second regions corresponding to the plurality of second pixel blocks are equal in length and width;

[0079] Step S602: the graphic display service container compares the plurality of first pixel blocks included in the first area with the plurality of second pixel blocks included in the second area one by one according to a preset comparison order.

[0080] Among them, Figure 7 As shown, the preset comparison order is, for example, from left to right and from top to bottom. Since the first area and the second area are areas of equal length and width, the pixel blocks in the first area and the second area are compared one by one according to the preset comparison order. If the graphic application container sends an image at the current moment, the comparison result will be that there are pixel blocks in the multiple first pixel blocks that do not match the position of the second pixel block.

[0081] Here, we determine the image formed by the first pixel blocks in the first area and the second area having positions mismatching as the difference image through comparison by the graphic display service container.

[0082] Step S502: If the comparison result shows that there is a difference image between the first image and the second image, a format conversion process is performed on the format of the difference image according to a preset image transmission protocol to obtain a target image.

[0083] Among them, after the above comparison, if the comparison result is that there is a difference image between the first image and the second image, the format of the image needs to be converted to process the format of the difference image into a format that meets the requirements of the preset image transmission protocol agreed upon between the graphic display service container and the remote display terminal, so as to facilitate transmission and obtain the target image.

[0084] Step S50: the graphic display service container sends the target image to the remote display terminal for remote display via the remote display terminal.

[0085] Among them, after the graphic display service container obtains the target image through processing, it can encrypt the target image using an encryption protocol and send the target image to the remote display terminal through the display interface of the service node that has a mapping relationship with the remote display terminal. This can enhance the security of the data transmission process, prevent data leakage and forgery of illegal peripheral events, and effectively ensure the security of the application container.

[0086] The method for remote display of graphics provided by the present application takes into account the problem that currently, the image to be displayed on the service node is generated by deploying graphic display service-related components in the container of the service node and is only displayed through the remote display terminal, resulting in resource consumption of the service node graphical application container. The present application provides a method for remote display of graphics, deploys a graphic display service container on the service node, establishes a target image processing thread according to a display request sent by the remote display terminal through an independently running graphic display service container, obtains a first image corresponding to the target graphic application container stored in the target storage space of the service node at the current moment, and obtains a second image sent by the target graphic application container from the memory of the target image processing thread, performs difference comparison processing on the first image based on the second image through the target graphic processing thread, obtains the target image, and finally sends the target image to the remote display terminal for remote display. The method for remote display of graphics provided by the present application independently processes the images that need to be remotely displayed through the graphics display service container, and will not cause intrusion to the graphics application container during the processing process, which can avoid software package dependency conflicts between the graphics display server container and the graphics application container, and reduce resource consumption and storage space of the graphics application container. In addition, since the graphics display service container and each graphics application container transmit data between processes without passing through an external network, there is no need to open network access to other containers, which can ensure the security of the transmission process and avoid data leakage. Finally, since the graphics display service container and each graphics application container run on the same service node, cross-node transmission between the two can be avoided, reducing network delays and resource usage, so that the efficiency of image processing can be improved, and the efficiency of remote display is further improved.

[0087] It should be noted that although the operations of the method of the present invention are described in a specific order in the accompanying drawings, this does not require or imply that these operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. On the contrary, the steps depicted in the flow chart can change the execution order.

[0088] Further references Figure 8 , which shows a schematic diagram of the structure of a graphic display service container according to an embodiment of the present application, wherein the graphic display service container includes a display module,

[0089] A display module, used to receive a display request sent by a remote display terminal, and to establish a target graphics processing thread based on the display request, wherein the display request is used to request a remote display target graphics application container to display a target image at the current moment;

[0090] The display module is further used to obtain a first image corresponding to the target graphic application container stored in the target storage space of the service node at the current moment;

[0091] The display module is also used to perform difference comparison processing on the first image based on the second image through the target graphics processing thread to obtain the target image, the second image is stored in the memory of the graphics processing thread, and the target graphics application container sends the historical image to the remote display end for remote display through the remote display end.

[0092] In an optional embodiment, the display module is specifically configured to perform a difference comparison process on the first image based on the second image by using a comparison algorithm according to the target graphics processing thread;

[0093] If the comparison result shows that there is a difference image between the first image and the second image, the format of the difference image is converted according to a preset image transmission protocol to obtain a target image.

[0094] In an optional embodiment, the display module is further configured to divide the first image into a plurality of first pixel blocks and the second image into a plurality of second pixel blocks in a manner of dividing the first image and the second image according to corresponding regions, wherein the first regions corresponding to the plurality of first pixel blocks and the second regions corresponding to the plurality of second pixel blocks are equal in length and width;

[0095] The plurality of first pixel blocks included in the first area are compared one by one with the plurality of second pixel blocks included in the second area according to a preset comparison order.

[0096] In an optional embodiment, the display module is further configured to determine, through comparison, an image formed by first pixel blocks in the first area and in the second area whose positions do not match each other as a difference image.

[0097] In an optional embodiment, the graphic display service container further includes a receiving module,

[0098] A receiving module, used for receiving an image transmitted by at least one graphic application container through a transmission method of transmitting data between processes;

[0099] Arrange the images sent by each graphic application container according to the time when each graphic application container sends the image, and create a data header, the data header including a unique identifier of each graphic application container and a data storage start address and data length corresponding to the unique identifier of each graphic application container;

[0100] Based on the mapping relationship between the interface of the virtual device and the storage space of the service node, the image and data header sent by each graphic application container are stored in the corresponding storage space of the service node.

[0101] In an optional embodiment, the display module is further configured to determine the target storage space from the service node according to the unique identifier of the target graphic application container;

[0102] Obtaining the target data storage start address and the data length of the target data corresponding to the unique identifier of the target graphic application container at the current moment from the data header of the target storage space;

[0103] The first image is obtained by reading from the target storage space of the service node from the target data storage start address through the target processing thread until the read data length is equal to the data length of the target data.

[0104] In an optional embodiment, the display module is further configured to encrypt the target image using an encryption protocol before the graphic display service container sends the target image to the remote display terminal.

[0105] In an optional embodiment, the graphic display service container further includes a window management module.

[0106] The window management module is used to generate an operation window for the application corresponding to the graphic display service container.

[0107] Reference below Fig. 9 , which shows a structural diagram of a computer system 900 suitable for implementing a service node of an embodiment of the present application.

[0108] like Fig. 9As shown, the computer system 900 includes a central processing unit (CPU) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage part 908 into a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the system 900 are also stored. The CPU 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0109] The following components are connected to the I / O interface 905: an input section 906 including a keyboard, a mouse, etc.; an output section 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a LAN card, a modem, etc. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed, so that a computer program read therefrom is installed into the storage section 908 as needed.

[0110] In particular, according to the embodiments of the present disclosure, the above reference Figure 2-7 The described processes may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program tangibly embodied on a machine-readable medium, the computer program comprising a computer program for executing Figure 2-6 In such an embodiment, the computer program may be downloaded and installed from a network via the communication section 909 and / or installed from the removable medium 911.

[0111] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, program segment or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a different order from the order marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0112] The units or modules involved in the embodiments described in the present application may be implemented by software or hardware. The units or modules described may also be arranged in a processor, for example, may be described as: a processor includes an XX unit, a YY unit, and a ZZ unit. The names of these units or modules do not, in some cases, constitute a limitation on the unit or module itself, for example, the XX unit may also be described as a "unit for XX".

[0113] As another aspect, the present application further provides a computer-readable storage medium, which may be a computer-readable storage medium included in the device described in the above embodiment; or a computer-readable storage medium that exists independently and is not assembled into the device. The computer-readable storage medium stores one or more programs, and the programs are used by one or more processors to execute the formula input method described in the present application.

[0114] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the present application.

Claims

1. A method for remotely displaying graphics, It is characterized in that Applied to a container cluster network, the container cluster network includes at least one container cluster, the container cluster includes at least one service node, a graphic display service container and at least one graphic application container are deployed on the service node, and the at least one graphic application container transmits data to the graphic display service container by transmitting data between processes. The method includes: The graphic display service container receives a display request sent by a remote display terminal, and establishes a target graphic processing thread based on the display request, wherein the display request is used to request the remote display target graphic application container to display a target image at the current moment; The graphic display service container obtains a first image corresponding to the target graphic application container stored in the target storage space of the service node at the current moment; The target graphics processing thread of the graphics display service container performs a difference comparison process on the first image based on the second image by using a comparison algorithm; if the comparison result is that there is a difference image between the first image and the second image, a format conversion process is performed on the format of the difference image according to a preset image transmission protocol to obtain the target image, wherein the second image is a historical image sent by the target graphics application container and stored in the memory of the graphics processing thread; The graphic display service container sends the target image to the remote display terminal for remote display via the remote display terminal.

2. The method according to claim 1, It is characterized in that The graphic display service container performs a difference comparison process on the first image based on the second image by using a comparison algorithm, including: The graphic display service container divides the first image and the second image into a plurality of first pixel blocks and the second image into a plurality of second pixel blocks according to the corresponding area division method, wherein the first area corresponding to the plurality of first pixel blocks and the second area corresponding to the plurality of second pixel blocks have the same length and width; The graphic display service container compares the multiple first pixel blocks included in the first area with the multiple second pixel blocks included in the second area one by one according to a preset comparison order.

3. The method according to claim 2, It is characterized in that The method further comprises: The graphic display service container determines, through comparison, an image formed by the first pixel blocks having positions that do not match those in the first area and the second area as the difference image.

4. The method according to claim 1, It is characterized in that The method further comprises: The graphic display service container receives an image transmitted by the at least one graphic application container through an inter-process data transmission method; The graphic display service container arranges the images sent by each graphic application container according to the time when each graphic application container sends the image, and creates a data header, wherein the data header includes a unique identifier of each graphic application container and a data storage start address and a data length corresponding to the unique identifier of each graphic application container; The graphic display service container stores the image and the data header sent by each graphic application container in the corresponding storage space of the service node based on the mapping relationship between the interface of the virtual device and the storage space of the service node.

5. The method according to claim 4, It is characterized in that The display request carries the unique identifier of the target graphic application container, and the graphic display service container obtains a first image corresponding to the target graphic application container stored in the target storage space of the service node at the current moment, including: The graphics display service container determines the target storage space from the service node according to the unique identifier of the target graphics application container through the target graphics processing thread; The graphic display service container obtains the target data storage start address and the data length of the target data corresponding to the unique identifier of the target graphic application container at the current moment from the data header of the target storage space; The graphic display service container obtains the first image by reading from the target storage space of the service node from the target data storage start address through the interface of the virtual device until the length of the read data equals the data length of the target data.

6. The method according to claim 1, It is characterized in that The method further comprises: Before the graphic display service container sends the target image to the remote display terminal, the target image is encrypted using an encryption protocol.

7. The method according to claim 4, It is characterized in that The method further comprises: Initializing the graphic display service container; In the process of initializing the graphic display service container, registering the virtual device; Establishing a mapping relationship between the interface of the virtual device and the storage space of the service node; A mapping relationship between the storage space of the service node and the graphics processing thread is established based on the interface of the virtual device.

8. A graphical display service container, It is characterized in that include: A display module, used to receive a display request sent by a remote display terminal, and to establish a target graphics processing thread based on the display request, wherein the display request is used to request a remote display target graphics application container to display a target image at the current moment; The display module is further used to obtain a first image corresponding to the target graphic application container stored in the target storage space of the service node at the current moment; The display module is also used to perform a difference comparison process on the first image based on the second image through a comparison algorithm through the target graphics processing thread of the graphics display service container; if the comparison result is that there is a difference image between the first image and the second image, the format of the difference image is converted according to a preset image transmission protocol to obtain the target image, the second image is stored in the memory of the graphics processing thread, and is a historical image sent by the target graphics application container; and the target image is sent to the remote display terminal for remote display through the remote display terminal.

9. A service node, It is characterized in that Comprising the graphic display service container of claim 8.