Cloud desktop streaming play method, system, device and storage medium

Abstract

Embodiments of the present application provide a cloud desktop streaming media playing method, system, device and storage medium. The method comprises the following steps: determining a to-be-displayed desktop image according to desktop image data of a cloud desktop sent by a cloud desktop server; a streaming media playing window is created in the cloud desktop; a streaming media playing area is arranged in the streaming media playing window; determining a to-be-displayed media image according to streaming media data corresponding to the streaming media playing window; synthesizing the to-be-displayed media image at a corresponding position in the to-be-displayed desktop image according to first area position information of the streaming media playing area in the to-be-displayed desktop image, to obtain a synthesized desktop image; and displaying the synthesized desktop image in a cloud desktop window of the cloud desktop client. The technical solution provided by the embodiments of the present application can provide an immersive interactive experience for users and improve user experience.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a cloud desktop streaming media playback method, system, device and storage medium. Background Art

[0002] Cloud desktops, based on distributed cloud computing storage technology, integrate internet applications, and rely on highly encrypted algorithms to provide the simplest, most comprehensive, most secure, and most personalized services to internet users at all levels. Cloud desktop technology displays the desktop screen running on a cloud server on a terminal. In other words, all data and calculations involved in the cloud desktop are performed on the server, and the client simply displays the changing desktop image. In traditional cloud desktop technology, the server consumes the majority of resources for streaming media playback, including decoding, transcoding, and compression. If a large number of virtual machines are playing streaming media simultaneously, the server will be overloaded, affecting the streaming quality.

[0003] In order to solve the above problems, some people have proposed to put the decoding and rendering of streaming media on the client side, while avoiding transcoding and compression. Its implementation logic is: redirect the streaming media content in the cloud desktop to the client, and then create a new local window at the default position of the client screen (for example, the lower right corner of the screen) to play the media content, and the newly created local window on the client side covers the cloud desktop window on the client side. This solution often encounters the following situation: the newly created local window blocks other parts of the cloud desktop window outside the streaming media playback area, but this part should not be blocked, which will obviously affect the user's interactive experience. Summary of the Invention

[0004] In view of the above problems, the present application is proposed to provide a cloud desktop streaming media playback method, system, device and storage medium that solve the above problems or at least partially solve the above problems.

[0005] Therefore, in one embodiment of the present application, a cloud desktop streaming media playback method is provided, which is applicable to a cloud desktop client; wherein the method includes:

[0006] Determining a desktop image to be displayed based on desktop image data of a cloud desktop sent from a cloud desktop server; creating a streaming media playback window in the cloud desktop; and providing a streaming media playback area in the streaming media playback window;

[0007] Determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window;

[0008] synthesizing the media image to be displayed at a corresponding position in the desktop image to be displayed according to the first area position information of the streaming media playback area in the desktop image to be displayed, so as to obtain a synthesized desktop image;

[0009] The synthesized desktop image is displayed in a cloud desktop window of the cloud desktop client.

[0010] In another embodiment of the present application, a cloud desktop streaming media playback method is provided, which is applicable to a cloud desktop server, wherein the method includes:

[0011] Determining desktop image data of a cloud desktop; creating a streaming media playback window in the cloud desktop; and providing a streaming media playback area in the streaming media playback window;

[0012] Sending the desktop image data of the cloud desktop and the first area position information of the streaming media playback area in the desktop image to be displayed to the cloud desktop client; the desktop image to be displayed is determined based on the desktop image data of the cloud desktop;

[0013] The cloud desktop client is configured to: determine a desktop image to be displayed based on the desktop image data; determine a media image to be displayed based on the streaming media data corresponding to the streaming media playback window; synthesize the media image to be displayed at a corresponding position in the desktop image to be displayed based on first area position information of the streaming media playback area in the desktop image to be displayed to obtain a synthesized desktop image; and display the synthesized desktop image in the cloud desktop window of the cloud desktop client.

[0014] In another embodiment of the present application, a cloud desktop system is provided, comprising: a cloud desktop server and a cloud desktop client; wherein the cloud desktop client is configured to:

[0015] Determining a desktop image to be displayed based on desktop image data of the cloud desktop sent by the cloud desktop server; creating a streaming media playback window in the cloud desktop; and providing a streaming media playback area in the streaming media playback window;

[0016] Determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window;

[0017] synthesizing the media image to be displayed at a corresponding position in the desktop image to be displayed according to the first area position information of the streaming media playback area in the desktop image to be displayed, so as to obtain a synthesized desktop image;

[0018] The synthesized desktop image is displayed in a cloud desktop window of the cloud desktop client.

[0019] In another embodiment of the present application, a client device is provided. The client device includes: a memory and a processor, wherein:

[0020] The memory is used to store programs;

[0021] The processor is coupled to the memory and is configured to execute the program stored in the memory to implement any of the above-mentioned cloud desktop streaming media playback methods.

[0022] In another embodiment of the present application, a computer-readable storage medium storing a computer program is provided. When the computer program is executed by a computer, the computer program can implement any of the above-mentioned cloud desktop streaming media playback methods.

[0023] In another embodiment of the present application, a server device is provided. The server device includes: a memory and a processor, wherein:

[0024] The memory is used to store programs;

[0025] The processor is coupled to the memory and is configured to execute the program stored in the memory to implement any of the above-mentioned cloud desktop streaming media playback methods.

[0026] In another embodiment of the present application, a computer-readable storage medium storing a computer program is provided. When the computer program is executed by a computer, the computer program can implement any of the above-mentioned cloud desktop streaming media playback methods.

[0027] In the technical solution provided by the embodiment of the present application, a streaming media playback window is created in the cloud desktop; a streaming media playback area is provided in the streaming media playback window. The cloud desktop client synthesizes the media image to be displayed at the corresponding position in the desktop image to be displayed based on the first area position information of the streaming media playback area in the desktop image to be displayed to obtain a synthesized desktop image; and displays the synthesized desktop image in the cloud desktop window of the cloud desktop client. By adopting the technical solution provided by the embodiment of the present application, the cloud desktop client side only needs one cloud desktop window to fully display the cloud desktop content, and there is no need to use two windows to fully display the cloud desktop content as in the prior art; in addition, the synthesized desktop image is determined based on the first area position information of the streaming media playback area, which can ensure that in the synthesized desktop image displayed in the cloud desktop window, the media image to be displayed overlaps with the streaming media playback area, which can reduce the covering of the parts of the cloud desktop that should not be blocked. It can be seen that this solution can provide users with an immersive interactive experience and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0029] Figure 1 An example of streaming media playback provided in an embodiment of the present application Figure 1 ;

[0030] Figure 2 A flowchart of a cloud desktop streaming media playback method provided in one embodiment of the present application;

[0031] Figure 3 An example of streaming media playback provided in an embodiment of the present application Figure 2 ;

[0032] Figure 4 A flowchart of a cloud desktop streaming media playback method provided in one embodiment of the present application;

[0033] Figure 5 A schematic diagram of a cloud desktop system provided in one embodiment of the present application;

[0034] Figure 6 A schematic diagram of the structure of a cloud desktop streaming media player device provided in one embodiment of the present application;

[0035] Figure 7 A schematic diagram of the structure of a cloud desktop streaming media player device provided in one embodiment of the present application;

[0036] Figure 8 This is a structural block diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0037] like Figure 1 As shown, in the streaming media redirection technology, the cloud sends the cloud desktop image data and streaming media data to the cloud desktop client 1. The cloud desktop client 1 needs to create two windows: a cloud desktop window 10 and an actual playback window 11. The cloud desktop image is played in the cloud desktop window 10, and the multimedia playback area 1011 within the cloud desktop window 10 in the cloud desktop image displays a pure blue picture. The streaming media content is played in the actual playback window 11. The two windows are synthesized and displayed by the window synthesizer 13, wherein the actual playback window 11 is located above the cloud desktop window 10 and in the lower right corner of the screen.

[0038] like Figure 1As shown, area H of the cloud desktop window 10 is blocked by the actual playback window 11. However, area H of the cloud desktop window 10 should not be blocked. Not only can the user not see the content in this area, but they can also not interact with the interactive controls in this area. It can be seen that the existing solution cannot provide users with an immersive interactive experience, and the user experience is poor.

[0039] In order to enable those skilled in the art to better understand the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below based on the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0040] In addition, some of the processes described in the specification, claims and the above-mentioned figures of this application include multiple operations that appear in a specific order. These operations may not be executed in the order in which they appear in this document or may be executed in parallel. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish between different operations, and the serial numbers themselves do not represent any order of execution. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this document are used to distinguish different messages, devices, modules, etc., and do not represent the order of precedence, nor do they limit "first" and "second" to be different types.

[0041] Figure 2 The flowchart of the data processing method provided by an embodiment of the present application is shown. The execution subject of the method may be a cloud desktop client. The cloud desktop client may be a hardware with an embedded program integrated on the terminal, or an application software installed in the terminal, or a tool software embedded in the terminal operating system, etc., which is not limited in the embodiment of the present application. The terminal may be any terminal device including a mobile phone, a tablet computer, a desktop computer, etc. Figure 2 As shown, the method includes:

[0042] 201. Determine a desktop image to be displayed based on the desktop image data of the cloud desktop sent by the cloud desktop server.

[0043] A streaming media playback window is created in the cloud desktop; and a streaming media playback area is provided in the streaming media playback window.

[0044] 202. Determine a media image to be displayed according to the streaming media data corresponding to the streaming media playback window.

[0045] 203 : Based on the first area position information of the streaming media playback area in the desktop image to be displayed, synthesize the media image to be displayed at a corresponding position in the desktop image to be displayed to obtain a synthesized desktop image.

[0046] 204. Display the synthesized desktop image in a cloud desktop window of the cloud desktop client.

[0047] In the above step 201, in one example, the desktop image data of the cloud desktop may include a desktop image to be displayed. In actual applications, the cloud desktop server transmits each frame of the cloud desktop image to the cloud desktop client in the form of a video stream, and the cloud desktop client displays the received cloud desktop image. Specifically, the cloud desktop server may send the current cloud desktop image to the cloud desktop client at predetermined time intervals.

[0048] In another example, the desktop image data of the cloud desktop may include: a low-resolution image corresponding to the desktop image to be displayed; the low-resolution image is obtained by reducing the resolution of the desktop image to be displayed. The cloud desktop client can restore the resolution of the low-resolution image corresponding to the desktop image to be displayed to obtain the desktop image to be displayed. Specifically, the low-resolution image corresponding to the desktop image to be displayed can be input into a resolution restoration model, and the resolution restoration model outputs the desktop to be displayed. The resolution restoration model may include a deep learning model, and the deep learning module can be trained using training samples.

[0049] In the above 202, the streaming media data corresponding to the streaming media playback window may be sent by the cloud desktop server or by a third party, wherein the third party may be a streaming media data provider.

[0050] In one embodiment, the above method may further include:

[0051] 205. Receive the streaming media data sent by the cloud desktop server.

[0052] In another example, the above method may further include:

[0053] 206. Receive a streaming media redirection request sent by the cloud desktop server.

[0054] 207. Acquire the streaming media data according to the resource acquisition address.

[0055] In the above 206, the streaming media redirection request includes a resource acquisition address corresponding to the streaming media data.

[0056] In the above 207, a streaming data acquisition request is sent to the streaming data provider according to the resource acquisition address; and the streaming data returned by the streaming data provider is received.

[0057] In the above 203, the first area position information of the streaming media playback area in the desktop image to be displayed may refer to the area position information of the streaming media playback area in the desktop image to be displayed relative to the desktop image to be displayed, and the first area position information may include: coordinate information and size information. Specifically, the first area position information may include: the coordinates of the designated point of the streaming media playback area relative to the desktop image to be displayed and the size information of the streaming media playback area. The shape of the streaming media playback area is not limited. Usually, the shape of the streaming media playback area is a rectangle, then the above designated point may be one of the upper left corner, lower left corner, upper right corner, lower right corner, and center point of the streaming media playback area; the size information may include: length and width.

[0058] According to the first area position information of the streaming media playback area in the desktop image to be displayed, the media image to be displayed can be synthesized at the corresponding position in the desktop image to be displayed to obtain a synthesized desktop image. In the synthesized desktop image, the streaming media playback area in the desktop image to be displayed and the media image to be displayed overlap with each other. Specifically, according to the first area position information of the streaming media playback area in the desktop image to be displayed, the streaming media playback area can be determined in the desktop image to be displayed; and the media image to be displayed can be synthesized into the streaming media playback area in the desktop image to be displayed to obtain a synthesized desktop image.

[0059] In the above 204, the synthesized desktop image is displayed in the cloud desktop window of the cloud desktop client.

[0060] In the technical solution provided in the embodiment of the present application, a streaming media playback window is created in the cloud desktop; a streaming media playback area is provided in the streaming media playback window. The cloud desktop client synthesizes the media image to be displayed at the corresponding position in the desktop image to be displayed based on the first area position information of the streaming media playback area in the desktop image to be displayed to obtain a synthesized desktop image; and displays the synthesized desktop image in the cloud desktop window of the cloud desktop client. By adopting the technical solution provided in the embodiment of the present application, the cloud desktop client side only needs one cloud desktop window to fully display the cloud desktop content, and there is no need to use two windows to fully display the cloud desktop content as in the prior art; in addition, the synthesized desktop image is determined based on the first area position information of the streaming media playback area, which can ensure that in the synthesized desktop image displayed in the cloud desktop window, the media image to be displayed overlaps with the streaming media playback area, which can reduce the covering of the parts of the cloud desktop that should not be blocked. It can be seen that this solution can provide users with an immersive interactive experience, improve the user experience, and provide a complete interactive experience.

[0061] In actual applications, if other windows are created in addition to the above-mentioned streaming media playback window in the cloud desktop, then the following occlusion situation may occur: the streaming media playback window is partially or completely blocked by another window. In this case, when synthesizing the image, it is necessary to consider the situation where the streaming media playback window is blocked. The above-mentioned step 202 "determining the media image to be displayed based on the streaming media data corresponding to the streaming media playback window" can be implemented by the following steps:

[0062] 2021. Determine an initial media image based on the streaming media data corresponding to the streaming media playback window.

[0063] 2022. When there is a blocked portion in the streaming media playback area in the cloud desktop that is blocked by other windows, obtain second area position information of the blocked portion relative to the streaming media playback area.

[0064] 2023. Determine a target occluded portion of the initial media image according to the second region position information.

[0065] 2024. Perform transparency processing on the target blocked portion of the initial media image to obtain the media image to be displayed.

[0066] In the above 2021, the above streaming media data may include: an initial media image.

[0067] In the above 2022, in actual applications, the streaming media playback area in the cloud desktop may be partially blocked or completely blocked by other windows. When it is completely blocked, the blocked part is the entire streaming media playback area; when it is partially blocked, the blocked part is only part of the streaming media playback area.

[0068] The second area position information of the obstructed part relative to the streaming media playback area may include: coordinate information and size information. Specifically, the second area position information may include: the coordinates of the designated point of the obstructed part relative to the streaming media playback area and the size information of the obstructed part. There is no limitation on the shape of the obstructed part. Usually, when the shape of the streaming media playback area is a rectangle and the shapes of other windows are also rectangles, the shape of the obstructed part is also a rectangle. In this way, the above-mentioned designated point can be one of the upper left corner, lower left corner, upper right corner, lower right corner, and center point of the obstructed part; the size information may include: length and width.

[0069] In the above step 2023, the target occluded portion of the initial media image is determined based on the second region position information. The region position information of the target occluded portion in the initial media image is also the second region position information. The number of the aforementioned other windows may be one or more. When there are multiple other windows, the target occluded portion of the initial media image is determined based on the second region position information of the occluded portion of the streaming media playback area that is occluded by each other window relative to the streaming media playback area.

[0070] In the above 2024, the target blocked portion of the initial media image is made transparent to obtain the media image to be displayed.

[0071] The target occluded portion of the initial media image is made transparent, that is, the pixels of the target occluded portion of the initial media image are set as transparent pixels. Specifically, the pixels of the target occluded portion in the transparency channel of the initial media image may be set to 0.

[0072] Optionally, the step of “determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window” in 202 may further include:

[0073] 2025. When there is no blocked portion of the streaming media playback area in the cloud desktop that is blocked by the other windows, determine the initial media image as the media image to be displayed.

[0074] In the above 2025, when there is no blocked portion of the streaming media playback area in the cloud desktop that is blocked by other windows, the initial media image is determined as the media image to be displayed.

[0075] Optionally, the first area location and / or the second area location may be sent by the cloud desktop server. Specifically, the method may further include:

[0076] 208. Receive the first area location information and / or the second area location information sent by the cloud desktop server.

[0077] In practical applications, the synthesis operation between the desktop image to be displayed and the media image to be displayed can be implemented by a preset hardware synthesizer or a GPU (Graphics Processing Unit), which is not specifically limited in the embodiment of the present application.

[0078] In another example, the above method may further include:

[0079] 209 : Receive the third area position information of the blocked portion in the desktop image to be displayed, which is sent by the cloud desktop server.

[0080] 210. Determine the second area location information based on the third area location information and the first area location information.

[0081] In step 210 above, the second region position of the obstructed portion relative to the streaming media playback area is determined based on the first region position information of the streaming media playback area in the desktop image to be displayed and the third region position information of the obstructed portion in the desktop image to be displayed. The specific calculation method can be found in the prior art and will not be described in detail here.

[0082] The following will be combined Figure 3 The technical solutions provided in the embodiments of this application are introduced as follows:

[0083] The cloud desktop runs in the cloud, i.e., on the cloud desktop server. A streaming media playback window 301, a first window 302, and a second window 303 are created within the cloud desktop. The first window 302 and the second window 303 can be any window, such as an application window. A streaming media playback area 3011 is defined within the streaming media playback window 301. The streaming media playback area 3011 is obscured by the first window 302 and the second window 303. The streaming media playback area 3011 includes a first obscured portion Z1 obscured by the first window 302, and the multimedia playback area 3011 also includes a second obscured portion Z2 obscured by the second window 303.

[0084] The cloud (which can be understood as a cloud desktop server) sends the cloud desktop image data, streaming media data, first area position information of the streaming media playback area 3011 in the desktop image to be displayed, second area position information of the first occluded portion Z1 relative to the streaming media playback area 3011, and second area position information of the second occluded portion Z2 relative to the streaming media playback area 3011 to the cloud desktop client 3. The cloud desktop client 3 determines the cloud desktop image 30 to be displayed based on the cloud desktop data and an initial media image (not shown) based on the streaming media data. Based on the second area position information of the first occluded portion Z1 relative to the streaming media playback area 3011 and the second area position information of the second occluded portion Z2 relative to the streaming media playback area 3011, the cloud desktop client 3 determines two target occluded portions in the initial media image. The pixels of the two target occluded portions in the initial media image are set to transparent pixels, thereby obtaining a processed media image 31, which is the media image to be displayed as described above. The hardware synthesizer 32 is used to synthesize the processed media image 31 into the corresponding position in the cloud desktop image 30 to be displayed according to the first area position information of the streaming media playback area 3011 in the cloud desktop image 30 to be displayed, so as to obtain a synthesized desktop image.

[0085] from Figure 3Judging from the synthesized desktop image in the image, first window 302 and second window 303 still cover the media image and are not obscured by the media image. Thus, the user can not only see the completed display content of first window 302 and second window 303, but can also perform all interactive operations on first window 302 and second window 303, avoiding the inability to perform some interactive operations due to partial obstruction of first window 302 and second window 303 by the media image. It can be seen that the technical solution provided by the embodiment of the present application achieves an interactive experience similar to that of a local computer in the media redirection mode.

[0086] Figure 4 The flowchart of the cloud desktop streaming media playback method provided by another embodiment of the present application is shown. The execution subject of the method can be the cloud desktop server. Figure 4 As shown, the method includes:

[0087] 401. Determine desktop image data of the cloud desktop.

[0088] A streaming media playback window is created in the cloud desktop; and a streaming media playback area is provided in the streaming media playback window.

[0089] 402 : Send the desktop image data of the cloud desktop and the first area position information of the streaming media playback area in the desktop image to be displayed to the cloud desktop client.

[0090] The cloud desktop client is configured to: determine a desktop image to be displayed based on the desktop image data; determine a media image to be displayed based on the streaming media data corresponding to the streaming media playback window; synthesize the media image to be displayed at a corresponding position in the desktop image to be displayed based on first area position information of the streaming media playback area in the desktop image to be displayed to obtain a synthesized desktop image; and display the synthesized desktop image in the cloud desktop window of the cloud desktop client.

[0091] In the above 401, the desktop image data of the cloud desktop may include: the desktop image to be displayed or the low-resolution image corresponding to the desktop image to be displayed. The specific process of obtaining the low-resolution image can be referred to the corresponding content of the above embodiments and will not be repeated here.

[0092] In the above 402, a first communication channel may be established between the cloud desktop server and the cloud desktop client; and the desktop image data of the cloud desktop and the first area location information may be sent to the cloud desktop client via the first communication channel.

[0093] In addition, a second communication channel may be established between the cloud desktop server and the cloud desktop client; and the streaming media data corresponding to the streaming media playback window may be sent to the cloud desktop client via the second communication channel.

[0094] In the technical solution provided by the embodiment of the present application, a streaming media playback window is created in the cloud desktop; a streaming media playback area is provided in the streaming media playback window. The cloud desktop client synthesizes the media image to be displayed at the corresponding position in the desktop image to be displayed based on the first area position information of the streaming media playback area in the desktop image to be displayed to obtain a synthesized desktop image; and displays the synthesized desktop image in the cloud desktop window of the cloud desktop client. By adopting the technical solution provided by the embodiment of the present application, the cloud desktop client side only needs one cloud desktop window to fully display the cloud desktop content, and there is no need to use two windows to fully display the cloud desktop content as in the prior art; in addition, the synthesized desktop image is determined based on the first area position information of the streaming media playback area, which can ensure that in the synthesized desktop image displayed in the cloud desktop window, the media image to be displayed overlaps with the streaming media playback area, which can reduce the covering of the parts of the cloud desktop that should not be blocked. It can be seen that this solution can provide users with an immersive interactive experience and improve the user experience.

[0095] Optionally, other windows are created in the cloud desktop; the above method may further include:

[0096] 403. When there is a blocked portion in the streaming media playback area in the cloud desktop that is blocked by the other window, obtain second area position information of the blocked portion relative to the streaming media playback area.

[0097] Correspondingly, the above 402 "sending the desktop image data of the cloud desktop and the first area position information of the streaming media playback area in the desktop image to be displayed to the cloud desktop client" may include: sending the desktop image data of the cloud desktop, the first area position information of the streaming media playback area in the desktop image to be displayed, and the second area position information of the streaming media playback area relative to the streaming media playback area to the cloud desktop client.

[0098] The cloud desktop client is specifically used for:

[0099] Determining an initial media image according to the streaming media data corresponding to the streaming media playback window;

[0100] determining a target blocked portion of the initial media image according to the second region position information;

[0101] The target occluded portion of the initial media image is rendered transparent to obtain the media image to be displayed. It should be noted that for any steps not fully described in detail in the method provided in the embodiments of the present application, reference may be made to the corresponding contents in the aforementioned embodiments, which will not be repeated here. Furthermore, in addition to the aforementioned steps, the method provided in the embodiments of the present application may also include some or all of the other steps in the aforementioned embodiments, which may be further described in detail in the aforementioned embodiments, which will not be repeated here.

[0102] Figure 5 FIG. 1 shows a block diagram of a cloud desktop system provided by an embodiment of the present application. Figure 5 As shown, the cloud desktop system includes: a cloud desktop server 501 and a cloud desktop client 502; wherein, the cloud desktop client 502 is used to:

[0103] Determine the desktop image to be displayed based on the desktop image data of the cloud desktop sent by the cloud desktop server 501; create a streaming media playback window in the cloud desktop; and set a streaming media playback area in the streaming media playback window;

[0104] Determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window;

[0105] synthesizing the media image to be displayed at a corresponding position in the desktop image to be displayed according to the first area position information of the streaming media playback area in the desktop image to be displayed, so as to obtain a synthesized desktop image;

[0106] The synthesized desktop image is displayed in the cloud desktop window of the cloud desktop client 502 .

[0107] In the technical solution provided by the embodiment of the present application, a streaming media playback window is created in the cloud desktop; a streaming media playback area is provided in the streaming media playback window. The cloud desktop client synthesizes the media image to be displayed at the corresponding position in the desktop image to be displayed based on the first area position information of the streaming media playback area in the desktop image to be displayed to obtain a synthesized desktop image; and displays the synthesized desktop image in the cloud desktop window of the cloud desktop client. By adopting the technical solution provided by the embodiment of the present application, the cloud desktop client side only needs one cloud desktop window to fully display the cloud desktop content, and there is no need to use two windows to fully display the cloud desktop content as in the prior art; in addition, the synthesized desktop image is determined based on the first area position information of the streaming media playback area, which can ensure that in the synthesized desktop image displayed in the cloud desktop window, the media image to be displayed overlaps with the streaming media playback area, which can reduce the covering of the parts of the cloud desktop that should not be blocked. It can be seen that this solution can provide users with an immersive interactive experience and improve the user experience.

[0108] Optionally, the cloud desktop server 501 is used to:

[0109] Determine desktop image data of the cloud desktop;

[0110] Sending the desktop image data of the cloud desktop and the first area position information of the streaming media playback area in the desktop image to be displayed to the cloud desktop client;

[0111] It should be noted here that the specific implementation process of the cloud desktop server 501 and the cloud desktop client 502 in the cloud desktop system provided by the embodiment of the present application and the interaction process between the two can be found in the corresponding contents of the above embodiments and will not be repeated here.

[0112] Figure 6 The following is a structural block diagram of a cloud desktop streaming media player provided by an embodiment of the present application. Figure 6 As shown, the cloud desktop streaming media player device includes:

[0113] The first determining module 601 is configured to determine a desktop image to be displayed based on desktop image data of a cloud desktop sent from a cloud desktop server; a streaming media playback window is created in the cloud desktop; and a streaming media playback area is provided in the streaming media playback window;

[0114] A second determining module 602 is configured to determine a media image to be displayed based on the streaming media data corresponding to the streaming media playback window;

[0115] A third determining module 603 is configured to synthesize the media image to be displayed at a corresponding position in the desktop image to be displayed based on the first area position information of the streaming media playback area in the desktop image to be displayed, so as to obtain a synthesized desktop image;

[0116] The display module 604 is configured to display the synthesized desktop image in the cloud desktop window of the cloud desktop client.

[0117] Optionally, the second determining module 602 is specifically configured to:

[0118] Determining an initial media image according to the streaming media data corresponding to the streaming media playback window;

[0119] When there is a blocked portion of the streaming media playback area in the cloud desktop that is blocked by other windows, obtaining second area position information of the blocked portion relative to the streaming media playback area;

[0120] determining a target blocked portion of the initial media image according to the second region position information;

[0121] Performing transparency processing on the target blocked portion of the initial media image to obtain the media image to be displayed;

[0122] Wherein, the other windows are also created in the cloud desktop.

[0123] Optionally, the second determining module 602 is specifically configured to:

[0124] When there is no blocked portion of the streaming media playback area in the cloud desktop that is blocked by the other windows, the initial media image is determined as the media image to be displayed.

[0125] Optionally, the above device may further include:

[0126] The receiving module is configured to receive the first area location information and / or the second area location information sent by the cloud desktop server.

[0127] Optionally, the receiving module is configured to: receive the third area position information of the blocked portion in the desktop image to be displayed, which is sent by the cloud desktop server;

[0128] Optionally, the device further includes:

[0129] The sixth determining module is configured to determine the second area location information according to the third area location information and the first area location information.

[0130] Optionally, the receiving module is further configured to:

[0131] Receive the streaming media data sent by the cloud desktop server.

[0132] Optionally, the receiving module is further configured to: receive a streaming media redirection request sent by the cloud desktop server; the streaming media redirection request includes a resource acquisition address corresponding to the streaming media data;

[0133] Optionally, the device may further include:

[0134] The acquisition module is used to acquire the streaming media data according to the resource acquisition address.

[0135] It should be noted here that the cloud desktop streaming media playback device provided in the above embodiment can implement the technical solutions described in the above method embodiments. The specific implementation principles of the above modules can be found in the corresponding contents of the above method embodiments, which will not be repeated here.

[0136] Figure 7 The following is a structural block diagram of a cloud desktop streaming media player provided by an embodiment of the present application. Figure 7 As shown, the cloud desktop streaming media player device includes:

[0137] The fourth determining module 701 is used to determine desktop image data of a cloud desktop; a streaming media playback window is created in the cloud desktop; and a streaming media playback area is provided in the streaming media playback window;

[0138] A sending module 702 is configured to send the desktop image data of the cloud desktop and the first area position information of the streaming media playback area in the desktop image to be displayed to the cloud desktop client;

[0139] The cloud desktop client is configured to: determine a desktop image to be displayed based on the desktop image data; determine a media image to be displayed based on the streaming media data corresponding to the streaming media playback window; synthesize the media image to be displayed at a corresponding position in the desktop image to be displayed based on first area position information of the streaming media playback area in the desktop image to be displayed to obtain a synthesized desktop image; and display the synthesized desktop image in the cloud desktop window of the cloud desktop client.

[0140] Optionally, the above device may further include:

[0141] A fifth determining module 703 is configured to, when a portion of the streaming media playback area in the cloud desktop is blocked by the other window, obtain second area position information of the blocked portion relative to the streaming media playback area;

[0142] The sending module 702 is specifically configured to: send the desktop image data of the cloud desktop, the first area position information of the streaming media playback area in the desktop image to be displayed, and the second area position information of the streaming media playback area relative to the streaming media playback area to the cloud desktop client;

[0143] The cloud desktop client is specifically used for:

[0144] Determining an initial media image according to the streaming media data corresponding to the streaming media playback window;

[0145] determining a target blocked portion of the initial media image according to the second region position information;

[0146] The target blocked portion of the initial media image is made transparent to obtain the media image to be displayed.

[0147] It should be noted here that the cloud desktop streaming media playback device provided in the above embodiment can implement the technical solutions described in the above method embodiments. The specific implementation principles of the above modules can be found in the corresponding contents of the above method embodiments, which will not be repeated here.

[0148] Figure 8FIG1 shows a schematic diagram of the structure of an electronic device provided by an embodiment of the present application. The electronic device may be a client device or a server device. Figure 8 As shown, the electronic device includes a memory 1101 and a processor 1102. The memory 1101 can be configured to store various other data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device. The memory 1101 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random-access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0149] The memory 1101 is used to store programs;

[0150] The processor 1102 is coupled to the memory 1101 and is configured to execute the program stored in the memory 1101 to implement the methods provided in the above method embodiments.

[0151] Further, if Figure 8 As shown, the electronic device also includes: a communication component 1103, a display 1104, a power component 1105, an audio component 1106 and other components. Figure 8 Only some components are shown schematically, which does not mean that the electronic device only includes Figure 8 Components shown.

[0152] Accordingly, an embodiment of the present application further provides a computer-readable storage medium storing a computer program, which, when executed by a computer, can implement the steps or functions of the methods provided in the above-mentioned method embodiments.

[0153] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0154] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, or of course, by hardware. Based on this understanding, the above technical solution, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM (Random Access Memory), a disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or certain parts of the embodiments.

[0155] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A cloud desktop streaming media playback method, applicable to a cloud desktop client; wherein, include: Determine the desktop image to be displayed based on the desktop image data of the cloud desktop sent by the cloud desktop server; A streaming media playback window is created in the cloud desktop; The streaming media playback window is provided with a streaming media playback area; the desktop image data includes a low-resolution image of the desktop image to be displayed, the low-resolution image being obtained by reducing the resolution of the desktop image to be displayed, and the desktop image to be displayed being obtained by restoring the resolution of the low-resolution image; Determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window; synthesizing the media image to be displayed at a corresponding position in the desktop image to be displayed according to the first area position information of the streaming media playback area in the desktop image to be displayed, so as to obtain a synthesized desktop image; Displaying the synthesized desktop image in a cloud desktop window of the cloud desktop client; Determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window includes: Determining an initial media image according to the streaming media data corresponding to the streaming media playback window; When the streaming media playback area in the cloud desktop has an obstructed portion blocked by other windows, receiving third region position information of the obstructed portion in the desktop image to be displayed, sent by the cloud desktop server; obtaining second region position information of the obstructed portion relative to the streaming media playback area based on the first region position information of the streaming media playback area in the desktop image to be displayed and the third region position information of the obstructed portion in the desktop image to be displayed; Determining a target obstructed portion of the initial media image based on the second region position information; wherein the first region position information includes: coordinates of a designated point of the streaming media playback area relative to the desktop image to be displayed and size information of the streaming media playback area; and the second region position information includes: coordinates of a designated point of the obstructed portion relative to the streaming media playback area and size information of the obstructed portion; Performing transparency processing on the target blocked portion of the initial media image to obtain the media image to be displayed; Wherein, the other windows are also created in the cloud desktop; For the application window that covers the media image to be displayed and is not blocked by the media image to be displayed, the display content of the application window can be viewed by the user, and the application window supports execution of all interactive operations.

2. The method according to claim 1, wherein Determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window includes: When there is no blocked portion of the streaming media playback area in the cloud desktop that is blocked by the other windows, the initial media image is determined as the media image to be displayed.

3. The method according to claim 1, wherein Also includes: Receive the first area location information and / or the second area location information sent by the cloud desktop server.

4. The method according to any one of claims 1 to 3, wherein Also includes: Receive the streaming media data sent by the cloud desktop server.

5. The method according to any one of claims 1 to 3, wherein Also includes: Receiving a streaming media redirection request sent by the cloud desktop server; The streaming media redirection request includes a resource acquisition address corresponding to the streaming media data; The streaming media data is acquired according to the resource acquisition address.

6. A cloud desktop streaming media playback method, applicable to a cloud desktop server, wherein: The method comprises: Determining desktop image data of a cloud desktop; creating a streaming media playback window in the cloud desktop; and providing a streaming media playback area in the streaming media playback window; Sending the desktop image data of the cloud desktop and the first area position information of the streaming media playback area in the desktop image to be displayed to the cloud desktop client; the desktop image to be displayed is determined based on the desktop image data of the cloud desktop; The cloud desktop client is configured to: determine a desktop image to be displayed based on the desktop image data; determine a media image to be displayed based on the streaming media data corresponding to the streaming media playback window; synthesize the media image to be displayed at a corresponding position in the desktop image to be displayed based on the first area position information of the streaming media playback area in the desktop image to be displayed to obtain a synthesized desktop image; and display the synthesized desktop image in the cloud desktop window of the cloud desktop client; The desktop image data includes a low-resolution image of the desktop image to be displayed, wherein the low-resolution image is obtained by reducing the resolution of the desktop image to be displayed, and the desktop image to be displayed is obtained by restoring the resolution of the low-resolution image; Determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window includes: Determining an initial media image according to the streaming media data corresponding to the streaming media playback window; When the streaming media playback area in the cloud desktop has an obstructed portion blocked by other windows, receiving third region position information of the obstructed portion in the desktop image to be displayed, sent by the cloud desktop server; obtaining second region position information of the obstructed portion relative to the streaming media playback area based on the first region position information of the streaming media playback area in the desktop image to be displayed and the third region position information of the obstructed portion in the desktop image to be displayed; Determining a target obstructed portion of the initial media image based on the second region position information; wherein the first region position information includes: coordinates of a designated point of the streaming media playback area relative to the desktop image to be displayed and size information of the streaming media playback area; and the second region position information includes: coordinates of a designated point of the obstructed portion relative to the streaming media playback area and size information of the obstructed portion; Performing transparency processing on the target blocked portion of the initial media image to obtain the media image to be displayed; Wherein, the other windows are also created in the cloud desktop; For the application window that covers the media image to be displayed and is not blocked by the media image to be displayed, the display content of the application window can be viewed by the user, and the application window supports execution of all interactive operations.

7. The method according to claim 6, wherein: Other windows are also created in the cloud desktop; the method further includes: When there is a blocked portion of the streaming media playback area in the cloud desktop that is blocked by the other window, obtaining second area position information of the blocked portion relative to the streaming media playback area; Sending desktop image data of the cloud desktop and first area position information of the streaming media playback area in the desktop image to be displayed to the cloud desktop client includes: Sending desktop image data of the cloud desktop, first area position information of the streaming media playback area in the desktop image to be displayed, and second area position information of the streaming media playback area relative to the streaming media playback area to the cloud desktop client; The cloud desktop client is specifically used for: Determining an initial media image according to the streaming media data corresponding to the streaming media playback window; determining a target blocked portion of the initial media image according to the second region position information; The target blocked portion of the initial media image is made transparent to obtain the media image to be displayed.

8. A cloud desktop system, wherein: include: Cloud desktop server and cloud desktop client; wherein the cloud desktop client is used to: Determining a desktop image to be displayed based on desktop image data of the cloud desktop sent by the cloud desktop server; creating a streaming media playback window in the cloud desktop; and providing a streaming media playback area in the streaming media playback window; the desktop image data including a low-resolution image of the desktop image to be displayed, the low-resolution image being obtained by reducing the resolution of the desktop image to be displayed, and the desktop image to be displayed being obtained by restoring the resolution of the low-resolution image; Determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window; synthesizing the media image to be displayed at a corresponding position in the desktop image to be displayed according to the first area position information of the streaming media playback area in the desktop image to be displayed, so as to obtain a synthesized desktop image; Displaying the synthesized desktop image in a cloud desktop window of the cloud desktop client; Determining a media image to be displayed according to the streaming media data corresponding to the streaming media playback window includes: Determining an initial media image according to the streaming media data corresponding to the streaming media playback window; When the streaming media playback area in the cloud desktop has an obstructed portion blocked by other windows, receiving third region position information of the obstructed portion in the desktop image to be displayed, sent by the cloud desktop server; obtaining second region position information of the obstructed portion relative to the streaming media playback area based on the first region position information of the streaming media playback area in the desktop image to be displayed and the third region position information of the obstructed portion in the desktop image to be displayed; Determining a target obstructed portion of the initial media image based on the second region position information; wherein the first region position information includes: coordinates of a designated point of the streaming media playback area relative to the desktop image to be displayed and size information of the streaming media playback area; and the second region position information includes: coordinates of a designated point of the obstructed portion relative to the streaming media playback area and size information of the obstructed portion; Performing transparency processing on the target blocked portion of the initial media image to obtain the media image to be displayed; Wherein, the other windows are also created in the cloud desktop; For the application window that covers the media image to be displayed and is not blocked by the media image to be displayed, the display content of the application window can be viewed by the user, and the application window supports execution of all interactive operations.

9. A client device, wherein: include: memory and a processor, wherein The memory is used to store programs; The processor is coupled to the memory and is configured to execute the program stored in the memory to implement the cloud desktop streaming media playback method according to any one of claims 1 to 5.

10. A computer-readable storage medium storing a computer program, wherein: When the computer program is executed by a computer, it can implement the cloud desktop streaming media playback method according to any one of claims 1 to 5.

11. A server device, wherein: include: memory and a processor, wherein The memory is used to store programs; The processor is coupled to the memory and is used to execute the program stored in the memory to implement the cloud desktop streaming media playback method according to claim 6 or 7.

12. A computer-readable storage medium storing a computer program, wherein: When the computer program is executed by a computer, it can implement the cloud desktop streaming media playback method described in claim 6 or 7.

Images