Picture display method and device based on cloud desktop, equipment and medium

Abstract

The invention discloses a picture display method and device based on a cloud desktop, equipment and a medium, and relates to the technical field of data transmission, and the method comprises the steps: obtaining a user operation corresponding to a first picture, and processing the user operation to generate a second picture; comparing the second picture with the first picture to judge whether a comparison result meets a preset transmission condition or not, and covering the first picture in the comparison buffer area by using the second picture; if yes, transmitting the second picture to the client, so that the client displays the second picture; and if not, generating a differentiated picture and a pixel position of the differentiated picture in the first picture based on the second picture and the first picture, and transmitting the differentiated picture and the pixel position to the client, so that the client displays a target display picture determined based on the differentiated picture, the pixel position and the first picture. Therefore, the traffic required for picture transmission can be reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of data transmission, and in particular to a screen display method, device, equipment and medium based on a cloud desktop. Background Art

[0002] At present, the hardware resources of DaaS (Desktop as a Service) cloud desktops are all deployed in the cloud, and in the process of interaction between the client and the cloud, only the transmission of the screen is involved. As a major category of cloud desktop products, the main feature of Desktop as a Service is that DaaS is hosted using a public cloud, and the hardware resources required for the PC are all located in the cloud. Users can use terminals and connect to the cloud from the public network through operators, and then transmit the screen. Among them, the user experience of DaaS type cloud desktops is affected to a certain extent by the quality of network transmission. That is, when the network transmission quality is poor, the user experience will be greatly reduced; when the network transmission quality is good, the user experience will be improved.

[0003] Therefore, the current method used to reduce network traffic is to compress the screen image. However, when the screen image is compressed lossily, the image quality will be reduced, thus affecting the user experience; when the screen image is compressed losslessly, when the lossless compressed image reaches the client, the client needs to restore the lossless compressed image, thus increasing the requirements for the client hardware performance.

[0004] As can be seen from the above, how to reduce the traffic required for image transmission while ensuring that the image is not affected during the image display process based on the cloud desktop is an urgent problem to be solved. Summary of the invention

[0005] In view of this, the purpose of the present invention is to provide a screen display method, device, equipment and medium based on a cloud desktop, which can compare a first screen with a second screen while ensuring that the screen is not affected, and determine the transmission method of the second screen based on the comparison result, thereby reducing the traffic required for screen transmission. The specific scheme is as follows:

[0006] In a first aspect, the present application provides a screen display method based on a cloud desktop, which is applied to a cloud corresponding to the cloud desktop, comprising:

[0007] Acquire a user operation corresponding to a first screen transmitted by a client, and process the user operation to generate a second screen; the first screen is a screen corresponding to a current user interface in the client;

[0008] Comparing the second picture with the first picture to determine whether the comparison result meets the preset transmission condition, and using the second picture to overwrite the first picture in the comparison buffer in the cloud;

[0009] If the comparison result indicates that the preset transmission condition is met, transmitting the second picture to the client so that the client can save and display the second picture;

[0010] If the comparison result indicates that the preset transmission condition is not satisfied, a differentiated picture and a pixel position of the differentiated picture in the first picture are generated based on the second picture and the first picture, and the differentiated picture and the pixel position are transmitted to the client so that the client saves and displays a target display picture determined based on the differentiated picture, the pixel position and the first picture.

[0011] Optionally, before acquiring the user operation corresponding to the first screen transmitted by the client and processing the user operation to generate the second screen, the method further includes:

[0012] Establishing a comparison buffer in a local memory and maintaining the comparison buffer;

[0013] Generate the first picture corresponding to the current user interface in the client, transmit the first picture to the client through a preset transmission network, and save the first picture to the comparison buffer so as to compare the first picture with the second picture.

[0014] Optionally, the acquiring a user operation corresponding to the first screen transmitted by the client, and processing the user operation to generate a second screen includes:

[0015] Acquire a user operation corresponding to a first picture transmitted by a client through a preset transmission network, and process the user operation and the first picture to generate a second picture;

[0016] The user operation includes a mouse cursor movement operation, a keyboard input operation, and a video playback operation.

[0017] Optionally, comparing the second picture with the first picture to determine whether a comparison result meets a preset transmission condition includes:

[0018] Determining first image pixel content corresponding to the first picture based on the first picture;

[0019] determining, based on the second picture, pixel content of a second image corresponding to the second picture;

[0020] Perform differential comparison on the first image pixel content and the second image pixel content to obtain a differential comparison result, and determine whether the differential comparison result meets a preset transmission condition.

[0021] Optionally, if the comparison result indicates that the preset transmission condition is not satisfied, generating a differential image and a pixel position of the differential image in the first image based on the second image and the first image, and transmitting the differential image and the pixel position to the client includes:

[0022] If the comparison result indicates that the pixel difference between the pixel content of the second image and the pixel content of the first image does not satisfy the preset transmission condition, determining a differentiated picture based on the second picture and the first picture;

[0023] A pixel position corresponding to the differentiated picture is determined based on the differentiated picture and the first picture, and the differentiated picture and the pixel position corresponding to the differentiated picture are transmitted to the client.

[0024] Optionally, using the second picture to cover the first picture in the comparison buffer in the cloud includes:

[0025] The first picture stored in the comparison buffer is deleted, and the second picture is stored in the comparison buffer, so that the second picture can be obtained from the comparison buffer later for comparison with the picture to be compared newly generated based on the user operation on the current user interface.

[0026] Optionally, transmitting the differentiated picture and the pixel position to the client so that the client saves and displays a target display picture determined based on the differentiated picture, the pixel position and the first picture includes:

[0027] The differentiated picture and the pixel position are transmitted to the client, so that the client determines the picture to be deleted from the first picture based on the pixel position, deletes the picture to be deleted to obtain the picture to be filled, and then fills the picture to be filled with the differentiated picture to obtain the target display picture.

[0028] In a second aspect, the present application provides a screen display device based on a cloud desktop, which is applied to a cloud corresponding to the cloud desktop, including:

[0029] An operation processing module, used for acquiring a user operation corresponding to a first screen transmitted by a client, and processing the user operation to generate a second screen; the first screen is a screen corresponding to a current user interface in the client;

[0030] a picture comparison module, configured to compare the second picture with the first picture to determine whether the comparison result meets a preset transmission condition, and to overwrite the first picture in the comparison buffer in the cloud with the second picture;

[0031] A picture transmission module, configured to transmit the second picture to the client if the comparison result indicates that the preset transmission condition is satisfied, so that the client can save and display the second picture;

[0032] A differentiated picture generation module is used to generate a differentiated picture and a pixel position of the differentiated picture in the first picture based on the second picture and the first picture if the comparison result representation does not meet the preset transmission condition, and transmit the differentiated picture and the pixel position to the client, so that the client saves and displays a target display picture determined based on the differentiated picture, the pixel position and the first picture.

[0033] In a third aspect, the present application provides an electronic device, including:

[0034] Memory, used to store computer programs;

[0035] The processor is used to execute the computer program to implement the aforementioned cloud desktop-based screen display method.

[0036] In a fourth aspect, the present application provides a computer-readable storage medium for storing a computer program, wherein the computer program, when executed by a processor, implements the aforementioned cloud desktop-based screen display method.

[0037] As can be seen from the above, before the present application performs a screen display based on the cloud desktop, it is necessary to obtain the user operation corresponding to the first screen transmitted by the client, and process the user operation to generate a second screen; the first screen is the screen corresponding to the current user interface in the client; the second screen is compared with the first screen to determine whether the comparison result obtained meets the preset transmission conditions, and the second screen is used to overwrite the first screen in the comparison buffer in the cloud; if the comparison result indicates that the preset transmission conditions are met, the second screen is transmitted to the client so that the client saves and displays the second screen; if the comparison result indicates that the preset transmission conditions are not met, a differentiated screen and the pixel position of the differentiated screen in the first screen are generated based on the second screen and the first screen, and the differentiated screen and the pixel position are transmitted to the client so that the client saves and displays the target display screen determined based on the differentiated screen, the pixel position and the first screen.

[0038] It can be seen that the present application processes the user operation in the first screen on the client to generate the second screen, compares the first screen with the second screen, and determines the transmission method of the second screen based on the comparison result. If the comparison result meets the preset transmission condition, the second screen is directly transmitted to the client; if the comparison result does not meet the preset transmission condition, the second screen and the first screen generate a differentiated screen and the pixel position of the differentiated screen in the first screen, and the differentiated screen and the pixel position are transmitted to the client, so that the client can save and display the target display screen determined based on the differentiated screen, pixel position and the first screen. In this way, the traffic required for screen transmission can be reduced while ensuring that the screen is not affected, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0040] Figure 1 This is a flow chart of a screen display method based on a cloud desktop disclosed in this application;

[0041] Figure 2 A schematic diagram of a specific cloud desktop-based screen transmission process disclosed in this application;

[0042] Figure 3This is a structural diagram of a screen display device based on a cloud desktop disclosed in this application;

[0043] Figure 4 This is a structural diagram of an electronic device disclosed in this application. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] Desktop as a Service is a large category of cloud desktop products. Its main feature is that DaaS is hosted using a public cloud, and the hardware resources required for the PC are all located in the cloud. Users can use terminals and connect to the cloud from the public network through operators, and then transmit the images. Among them, the user experience of DaaS-type cloud desktops is affected to a certain extent by the quality of network transmission. That is, when the network transmission quality is poor, the user experience will be greatly reduced; when the network transmission quality is good, the user experience will be improved. To this end, the present application provides a screen display method based on a cloud desktop, which can compare the first screen with the second screen while ensuring that the screen is not affected, and determine the transmission method of the second screen based on the comparison result, thereby reducing the traffic required for screen transmission.

[0046] See also Figure 1 As shown, an embodiment of the present invention discloses a screen display method based on a cloud desktop, which is applied to a cloud corresponding to the cloud desktop, including:

[0047] Step S11, obtaining a user operation corresponding to a first screen transmitted by the client, and processing the user operation to generate a second screen; the first screen is a screen corresponding to a current user interface in the client.

[0048] In this embodiment, the cloud creates and maintains a buffer in the local memory, and the buffer is a comparison buffer, which is used to store the screen that the cloud needs to transmit to the client. Each time a newly generated screen is to be transmitted, the newly generated screen needs to overwrite the previous screen stored in the comparison buffer, so that each time a new screen is generated in the cloud, it is compared with the previous screen in the comparison buffer. That is, before obtaining the user operation corresponding to the first screen transmitted via the client, the cloud corresponding to the cloud desktop should create a comparison buffer in the local memory so that the first screen is stored in the comparison buffer. Specifically, the acquisition of the user operation corresponding to the first screen transmitted by the client and the processing of the user operation to generate the second screen may also include: establishing a comparison buffer located in the local memory and maintaining the comparison buffer; generating the first screen corresponding to the current user interface in the client, so as to transmit the first screen to the client through a preset transmission network, and saving the first screen to the comparison buffer so as to compare the first screen with the second screen.

[0049] It is worth mentioning that when obtaining the user operation corresponding to the first screen transmitted by the client, the user operation is transmitted through a preset transmission network. Specifically, obtaining the user operation corresponding to the first screen transmitted by the client, and processing the user operation to generate the second screen, may include: obtaining the user operation corresponding to the first screen transmitted by the client through the preset transmission network, and processing the user operation and the first screen to generate the second screen; wherein the user operation includes a mouse cursor movement operation, a keyboard input operation, and a video playback operation.

[0050] Step S12: Compare the second picture with the first picture to determine whether the comparison result meets the preset transmission condition, and use the second picture to cover the first picture in the comparison buffer in the cloud.

[0051] In this embodiment, after comparing the second picture with the first picture and obtaining the comparison result, it is necessary to determine the difference in image pixel content between the second picture and the first picture based on the comparison result. Specifically, comparing the second picture with the first picture to determine whether the obtained comparison result meets the preset transmission condition may include: determining the first image pixel content corresponding to the first picture based on the first picture; determining the second image pixel content corresponding to the second picture based on the second picture; performing a differential comparison between the first image pixel content and the second image pixel content to obtain a differential comparison result, and determining whether the differential comparison result meets the preset transmission condition.

[0052] It is worth mentioning that after performing a dissimilar comparison between the first image pixel content corresponding to the first picture and the second image pixel content corresponding to the second picture to obtain a difference comparison result, the embodiment of the present application needs to overwrite the first picture stored in the comparison buffer. Specifically, the use of the second picture to overwrite the first picture in the comparison buffer located in the cloud may include: deleting the first picture stored in the comparison buffer, and storing the second picture in the comparison buffer, so that the second picture can be subsequently obtained from the comparison buffer for comparison with the newly generated picture to be compared based on the user operation on the current user interface.

[0053] Step S13: If the comparison result indicates that the preset transmission condition is met, the second picture is transmitted to the client so that the client can save and display the second picture.

[0054] In this embodiment, if the difference in the image pixel content between the second picture and the first picture meets the preset transmission condition, the newly generated second picture is directly transmitted to the client through the preset transmission network so that the client can save and display the second picture. At the same time, the embodiment of the present application needs to use the second picture to cover the first picture stored in the comparison buffer, so as to prepare for the next picture transmission.

[0055] Step S14: If the comparison result indicates that the preset transmission condition is not satisfied, a differentiated image and a pixel position of the differentiated image in the first image are generated based on the second image and the first image, and the differentiated image and the pixel position are transmitted to the client, so that the client saves and displays a target display image determined based on the differentiated image, the pixel position and the first image.

[0056] It is worth mentioning that if the difference in the image pixel content between the second picture and the first picture does not meet the preset transmission condition, a differentiated picture is generated based on the first picture and the second picture and the pixel position of the differentiated picture is located in the previous picture, so that the differentiated picture and the corresponding pixel position are transmitted to the client. At the same time, the second picture is used to cover the first picture in the comparison buffer, so as to prepare for the picture comparison before the next transmission. Specifically, if the comparison result indicates that the preset transmission condition is not met, a differentiated picture is generated based on the second picture and the first picture and the pixel position of the differentiated picture is located in the first picture, and the differentiated picture and the pixel position are transmitted to the client, which may include: if the comparison result indicates that the pixel difference between the second image pixel content and the first image pixel content does not meet the preset transmission condition, a differentiated picture is determined based on the second picture and the first picture; the pixel position corresponding to the differentiated picture is determined based on the differentiated picture and the first picture, and the differentiated picture and the pixel position corresponding to the differentiated picture are transmitted to the client.

[0057] In this embodiment, after the differentiated picture and the pixel position are transmitted to the client, the client needs to modify the first picture stored locally based on the differentiated picture and the pixel position to obtain the target display picture. Specifically, the differentiated picture and the pixel position are transmitted to the client so that the client saves and displays the target display picture determined based on the differentiated picture, the pixel position and the first picture, which may include:

[0058] The differentiated picture and the pixel position are transmitted to the client, so that the client determines the picture to be deleted from the first picture based on the pixel position, deletes the picture to be deleted to obtain the picture to be filled, and then fills the picture to be filled with the differentiated picture to obtain the target display picture.

[0059] As can be seen from the above, before the screen display based on the cloud desktop is performed, the embodiment of the present application needs to obtain the user operation corresponding to the first screen transmitted by the client, and process the user operation to generate a second screen; the first screen is the screen corresponding to the current user interface in the client; the second screen is compared with the first screen to determine whether the comparison result meets the preset transmission condition, and the second screen is used to cover the first screen in the comparison buffer in the cloud; if the comparison result indicates that the preset transmission condition is met, the second screen is transmitted to the client so that the client can save and display the second screen; if the comparison result indicates that the preset transmission condition is not met, a differential screen is generated based on the second screen and the first screen and the pixel position of the differential screen in the first screen, and the differential screen and the pixel position are transmitted to the client so that the client can save and display the target display screen determined based on the differential screen, the pixel position and the first screen. It can be seen that the present application generates a second screen by processing the user operation in the first screen on the client, and compares the first screen with the second screen, and determines the transmission method of the second screen based on the comparison result. If the comparison result meets the preset transmission condition, the second picture is directly transmitted to the client; if the comparison result does not meet the preset transmission condition, the second picture and the first picture generate a differential picture and the pixel position of the differential picture in the first picture, and the differential picture and the pixel position are transmitted to the client so that the client can save and display the target display picture determined based on the differential picture, the pixel position and the first picture. In this way, the traffic required for picture transmission can be reduced while ensuring that the picture is not affected, thereby improving the user experience.

[0060] For further information, see Figure 2 As shown, an embodiment of the present invention discloses a screen display method based on a cloud desktop, comprising:

[0061] In this embodiment, the initial state is to generate a first screen in the cloud based on the current user operation and the current user interface. Among them, the cloud maintains a buffer in the local memory, called a comparison buffer, which is used to store the screen to be transmitted from the cloud to the client. Each time a new screen is to be transmitted, the new screen will be used to overwrite the first screen in the comparison buffer. It is worth mentioning that when the cloud transmits the generated first screen to the client, the first screen needs to be saved in the comparison buffer for comparison of the next transmitted screen. Subsequently, the generated first screen is transmitted to the client through a preset transmission network so that the client can display and save the first screen.

[0062] It can be understood that after the first screen is transmitted, the screen generated by the cloud based on the current user interface and user operation is the second screen, and before the second screen is transmitted, the second screen is compared with the first screen to obtain a comparison result, and it is determined whether the comparison result meets the preset transmission conditions.

[0063] In a specific implementation, if the comparison result meets the preset transmission conditions, such as a video playback operation is performed in the second screen but no video playback operation is performed in the first screen, the second screen is directly transmitted to the client so that the client can save and display the second screen. At the same time, the second screen is saved in the comparison buffer for the next screen transmission comparison.

[0064] In another specific implementation, if the comparison result does not meet the preset transmission condition, such as the difference between the second picture and the first picture is only the movement of the mouse cursor, a differential picture and the pixel position of the differential picture in the first picture are generated based on the first picture and the second picture, and the differential picture and the pixel position are transmitted to the client through a preset transmission network, so that the client can modify the locally stored first picture based on the differential picture and the pixel position to save and display the determined target display picture. At the same time, the second picture is saved in the comparison buffer for the next picture comparison of picture transmission.

[0065] As can be seen from the above, the embodiment of the present application processes the user operation in the first screen on the client to generate the second screen, and compares the first screen with the second screen, and determines the transmission mode of the second screen based on the comparison result. If the comparison result meets the preset transmission condition, the second screen is directly transmitted to the client; if the comparison result does not meet the preset transmission condition, the second screen and the first screen generate a differential screen and the pixel position of the differential screen in the first screen, and the differential screen and the pixel position are transmitted to the client, so that the client can save and display the target display screen determined based on the differential screen, the pixel position and the first screen. It can be seen that the embodiment of the present application adjusts the screen based on the user's behavior. If the second screen to be transmitted is almost the same as the first screen, only the difference screen between the first screen and the second screen and the pixel coordinates of the difference screen in the first screen will be transmitted, thereby avoiding the full transmission of the entire screen without using the screen compression technology, reducing the number of pixels of the transmitted screen, thereby reducing the required flow rate for screen transmission. In this way, the flow rate required for screen transmission can be reduced while ensuring that the screen is not affected.

[0066] Accordingly, see Figure 3As shown, the present application also provides a screen display device based on a cloud desktop, which is applied to a cloud corresponding to the cloud desktop, including:

[0067] The operation processing module 11 is used to obtain the user operation corresponding to the first screen transmitted by the client, and process the user operation to generate a second screen; the first screen is a screen corresponding to the current user interface in the client;

[0068] A picture comparison module 12, configured to compare the second picture with the first picture to determine whether the comparison result meets a preset transmission condition, and to overwrite the first picture in the comparison buffer in the cloud with the second picture;

[0069] A picture transmission module 13, configured to transmit the second picture to the client if the comparison result indicates that the preset transmission condition is satisfied, so that the client can save and display the second picture;

[0070] The differentiated picture generation module 14 is used to generate a differentiated picture and a pixel position of the differentiated picture in the first picture based on the second picture and the first picture if the comparison result representation does not meet the preset transmission condition, and transmit the differentiated picture and the pixel position to the client, so that the client saves and displays a target display picture determined based on the differentiated picture, the pixel position and the first picture.

[0071] As can be seen from the above, before the screen display based on the cloud desktop is performed, the embodiment of the present application needs to obtain the user operation corresponding to the first screen transmitted by the client, and process the user operation to generate a second screen; the first screen is the screen corresponding to the current user interface in the client; the second screen is compared with the first screen to determine whether the comparison result meets the preset transmission condition, and the second screen is used to cover the first screen in the comparison buffer in the cloud; if the comparison result indicates that the preset transmission condition is met, the second screen is transmitted to the client so that the client can save and display the second screen; if the comparison result indicates that the preset transmission condition is not met, a differential screen is generated based on the second screen and the first screen and the pixel position of the differential screen in the first screen, and the differential screen and the pixel position are transmitted to the client so that the client can save and display the target display screen determined based on the differential screen, the pixel position and the first screen. It can be seen that the present application generates a second screen by processing the user operation in the first screen on the client, and compares the first screen with the second screen, and determines the transmission method of the second screen based on the comparison result. If the comparison result meets the preset transmission condition, the second picture is directly transmitted to the client; if the comparison result does not meet the preset transmission condition, the second picture and the first picture generate a differential picture and the pixel position of the differential picture in the first picture, and the differential picture and the pixel position are transmitted to the client so that the client can save and display the target display picture determined based on the differential picture, the pixel position and the first picture. In this way, the traffic required for picture transmission can be reduced while ensuring that the picture is not affected, thereby improving the user experience.

[0072] In some specific implementations, the cloud desktop-based screen display device may further include:

[0073] A buffer establishment unit, used to establish a comparison buffer in a local memory and maintain the comparison buffer;

[0074] The screen generation unit is used to generate the first screen corresponding to the current user interface in the client, transmit the first screen to the client through a preset transmission network, and save the first screen to the comparison buffer so as to compare the first screen with the second screen.

[0075] In some specific implementations, the operation processing module 11 may specifically include:

[0076] An operation acquisition unit is used to acquire a user operation corresponding to a first screen transmitted by a client through a preset transmission network, and process the user operation and the first screen to generate a second screen; wherein the user operation includes a mouse cursor movement operation, a keyboard input operation, and a video playback operation.

[0077] In some specific implementations, the picture comparison module 12 may specifically include:

[0078] A first pixel content determining unit, configured to determine a first image pixel content corresponding to the first picture based on the first picture;

[0079] A second pixel content determining unit, configured to determine a second image pixel content corresponding to the second picture based on the second picture;

[0080] The comparison result judgment unit is used to perform a differential comparison between the first image pixel content and the second image pixel content to obtain a difference comparison result, and to judge whether the difference comparison result meets a preset transmission condition.

[0081] In some specific implementations, the picture comparison module 12 may specifically include:

[0082] The picture storage unit is used to delete the first picture stored in the comparison buffer and store the second picture in the comparison buffer so that the second picture can be obtained from the comparison buffer and compared with the picture to be compared newly generated based on the user operation on the current user interface.

[0083] In some specific implementations, the differentiated screen generation module 14 may specifically include:

[0084] a differentiated picture determining unit, configured to determine a differentiated picture based on the second picture and the first picture if the comparison result indicates that a pixel difference between pixel contents of the second image and pixel contents of the first image does not satisfy the preset transmission condition;

[0085] The first picture transmission unit is configured to determine a pixel position corresponding to the differentiated picture based on the differentiated picture and the first picture, and transmit the differentiated picture and the pixel position corresponding to the differentiated picture to the client.

[0086] In some specific implementations, the differentiated screen generation module 14 may specifically include:

[0087] The second picture transmission unit is used to transmit the differentiated picture and the pixel position to the client, so that the client determines the picture to be deleted from the first picture based on the pixel position, and deletes the picture to be deleted to obtain the picture to be filled, and then fills the picture to be filled with the differentiated picture to obtain the target display picture.

[0088] Furthermore, the present application also discloses an electronic device. Figure 4 It is a structural diagram of an electronic device 20 shown according to an exemplary embodiment, and the content in the figure cannot be regarded as any limitation on the scope of use of this application. The electronic device 20 may specifically include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input and output interface 25 and a communication bus 26. Among them, the memory 22 is used to store a computer program, and the computer program is loaded and executed by the processor 21 to implement the relevant steps in the cloud desktop-based screen display method disclosed in any of the aforementioned embodiments. In addition, the electronic device 20 in this embodiment can specifically be an electronic computer.

[0089] In this embodiment, the power supply 23 is used to provide working voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and the external device, and the communication protocol it follows is any communication protocol that can be applied to the technical solution of the present application, and is not specifically limited here; the input and output interface 25 is used to obtain external input data or output data to the outside world, and its specific interface type can be selected according to specific application needs and is not specifically limited here.

[0090] In addition, the memory 22, as a carrier for storing resources, can be a read-only memory, a random access memory, a disk or an optical disk, etc. The resources stored thereon can include an operating system 221, a computer program 222, etc., and the storage method can be temporary storage or permanent storage.

[0091] The operating system 221 is used to manage and control the hardware devices and computer programs 222 on the electronic device 20, which can be Windows Server, Netware, Unix, Linux, etc. In addition to including a computer program that can be used to complete the cloud desktop-based screen display method performed by the electronic device 20 disclosed in any of the aforementioned embodiments, the computer program 222 can further include a computer program that can be used to complete other specific tasks.

[0092] Furthermore, the present application also discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, the aforementioned cloud desktop-based screen display method is implemented. The specific steps of the method can refer to the corresponding contents disclosed in the aforementioned embodiments, and will not be repeated here.

[0093] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0094] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0095] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0096] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0097] The technical solution provided by the present application is introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for general technicians in this field, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A screen display method based on a cloud desktop, applied to a cloud corresponding to the cloud desktop, characterized in that: include: Acquire a user operation corresponding to the first screen transmitted by the client, and process the user operation to generate a second screen; The first screen is a screen corresponding to the current user interface in the client; Comparing the second picture with the first picture to determine whether the comparison result meets the preset transmission condition, and using the second picture to overwrite the first picture in the comparison buffer in the cloud; If the comparison result indicates that the preset transmission condition is met, transmitting the second picture to the client so that the client can save and display the second picture; If the comparison result indicates that the preset transmission condition is not satisfied, a differentiated picture and a pixel position of the differentiated picture in the first picture are generated based on the second picture and the first picture, and the differentiated picture and the pixel position are transmitted to the client so that the client saves and displays a target display picture determined based on the differentiated picture, the pixel position and the first picture.

2. The screen display method based on cloud desktop according to claim 1 is characterized in that: Before acquiring the user operation corresponding to the first screen transmitted by the client and processing the user operation to generate the second screen, the method further includes: Establishing a comparison buffer in a local memory and maintaining the comparison buffer; Generate the first picture corresponding to the current user interface in the client, transmit the first picture to the client through a preset transmission network, and save the first picture to the comparison buffer so as to compare the first picture with the second picture.

3. The screen display method based on cloud desktop according to claim 1 is characterized in that: The acquiring the user operation corresponding to the first screen transmitted by the client, and processing the user operation to generate the second screen, includes: Acquire a user operation corresponding to a first picture transmitted by a client through a preset transmission network, and process the user operation and the first picture to generate a second picture; The user operation includes a mouse cursor movement operation, a keyboard input operation, and a video playback operation.

4. The screen display method based on cloud desktop according to claim 1 is characterized in that: The comparing the second picture with the first picture to determine whether the comparison result meets the preset transmission condition includes: Determining first image pixel content corresponding to the first picture based on the first picture; determining, based on the second picture, pixel content of a second image corresponding to the second picture; Perform differential comparison on the first image pixel content and the second image pixel content to obtain a differential comparison result, and determine whether the differential comparison result meets a preset transmission condition.

5. The screen display method based on cloud desktop according to claim 4 is characterized in that: If the comparison result indicates that the preset transmission condition is not satisfied, generating a differential image and a pixel position of the differential image in the first image based on the second image and the first image, and transmitting the differential image and the pixel position to the client, including: If the comparison result indicates that the pixel difference between the pixel content of the second image and the pixel content of the first image does not satisfy the preset transmission condition, determining a differentiated picture based on the second picture and the first picture; A pixel position corresponding to the differentiated picture is determined based on the differentiated picture and the first picture, and the differentiated picture and the pixel position corresponding to the differentiated picture are transmitted to the client.

6. The screen display method based on cloud desktop according to claim 1, characterized in that: The using the second picture to cover the first picture in the comparison buffer in the cloud includes: The first picture stored in the comparison buffer is deleted, and the second picture is stored in the comparison buffer, so that the second picture can be obtained from the comparison buffer later for comparison with the picture to be compared newly generated based on the user operation on the current user interface.

7. The screen display method based on cloud desktop according to any one of claims 1 to 6, characterized in that: The transmitting the differentiated picture and the pixel position to the client so that the client saves and displays a target display picture determined based on the differentiated picture, the pixel position and the first picture includes: The differentiated picture and the pixel position are transmitted to the client, so that the client determines the picture to be deleted from the first picture based on the pixel position, deletes the picture to be deleted to obtain the picture to be filled, and then fills the picture to be filled with the differentiated picture to obtain the target display picture.

8. A screen display device based on a cloud desktop, characterized in that: Applied to the cloud corresponding to the cloud desktop, including: An operation processing module, used for acquiring a user operation corresponding to a first screen transmitted by a client, and processing the user operation to generate a second screen; the first screen is a screen corresponding to a current user interface in the client; a picture comparison module, configured to compare the second picture with the first picture to determine whether the comparison result meets a preset transmission condition, and to overwrite the first picture in the comparison buffer in the cloud with the second picture; A picture transmission module, configured to transmit the second picture to the client if the comparison result indicates that the preset transmission condition is satisfied, so that the client can save and display the second picture; A differentiated picture generation module is used to generate a differentiated picture and a pixel position of the differentiated picture in the first picture based on the second picture and the first picture if the comparison result representation does not meet the preset transmission condition, and transmit the differentiated picture and the pixel position to the client, so that the client saves and displays a target display picture determined based on the differentiated picture, the pixel position and the first picture.

9. An electronic device, characterized in that: include: Memory, used to store computer programs; A processor is used to execute the computer program to implement the steps of the cloud desktop-based screen display method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: Used to store a computer program, wherein when the computer program is executed by a processor, the steps of the cloud desktop-based screen display method as described in any one of claims 1 to 7 are implemented.

Images