Data processing method, device and system for cloud service

Abstract

The embodiment of the invention provides a data processing method and device for a cloud service. The method comprises the steps that first window orientation information of a cloud side display window of the cloud service is acquired; converting the first window azimuth information into second window azimuth information based on a general screen coordinate system; the second window orientation information is sent to the user equipment, the second window orientation information is used for being converted by the user equipment to obtain third window orientation information, and the third window orientation information is used for generating an end side display window of the cloud service and is displayed on the user equipment. By setting the universal screen coordinate system, when the cloud side and the end side perform azimuth data transmission, the azimuth data can be transmitted after being converted to the universal screen coordinate system, so that the requirement that the user equipment of any screen coordinate system is connected with the cloud service of any screen coordinate system is met, and the user experience is improved. The problem of cloud service abnormity caused by incompatibility of the end side screen coordinate system and the cloud side screen coordinate system is solved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method and device for cloud services, a data processing system for cloud services, an electronic device, and a machine-readable medium. Background Art

[0002] Cloud service is a virtualized cloud application. User devices can access cloud services to facilitate office or study.

[0003] In the related art, the server corresponding to the cloud service can transmit the cloud-side window of the cloud service to the user device, and the user device will create a corresponding terminal-side window to display the screen content of the cloud service, wherein the cloud-side window is displayed based on the screen coordinate system of the server, and the terminal-side window is realized based on the screen coordinate system of the user device. The user can use an external device to operate the cloud service in the terminal-side window, and the event information generated by the operation can also be synchronized from the user device to the server, and the server injects the event information into the cloud service to realize interaction.

[0004] However, the inventors have discovered through research that different operating systems have different screen coordinate systems. When the screen coordinate systems of the user device and the server are different, the incompatibility of the two screen coordinate systems may easily lead to abnormal display of the cloud service screen. Summary of the invention

[0005] An embodiment of the present application provides a data processing method for a cloud service to solve the problem in the related art that the screen of the cloud service may display abnormally due to the incompatibility of the screen coordinate system.

[0006] Correspondingly, the embodiments of the present application also provide a data processing device for a cloud service, a data processing system for a cloud service, an electronic device, and a machine-readable medium to ensure the implementation and application of the above method.

[0007] In order to solve the above problems, the embodiment of the present application discloses a data processing method for cloud services, which is applied to a server and includes:

[0008] Obtaining first window position information of a cloud-side display window of a cloud service;

[0009] Converting the first window position information into second window position information based on a universal screen coordinate system;

[0010] The second window orientation information is sent to the user device, and the second window orientation information is used by the user device to convert and obtain third window orientation information. The third window orientation information is orientation information that matches the end-side screen coordinate system formed by multiple display screens connected to the user device. The third window orientation information is used to generate an end-side display window of the cloud service and display it on the user device.

[0011] The present application embodiment discloses a cloud service data processing method, which is applied to a user device connected to multiple display screens, and the method includes:

[0012] When receiving the second window position information sent by the server, converting the second window position information into third window position information matching the terminal-side screen coordinate system formed by the multiple display screens; the second window position information is position information based on the universal screen coordinate system;

[0013] According to the third window orientation information, a terminal-side display window of the cloud service is generated and displayed in the terminal-side screen coordinate system.

[0014] The present application embodiment discloses a data processing device for a cloud service, which is applied to a server, and the device includes:

[0015] A first acquisition module, used to acquire first window position information of a cloud-side display window of a cloud service;

[0016] A first conversion module, used for converting the first window position information into second window position information based on a universal screen coordinate system;

[0017] The first sending module is used to send the second window orientation information to the user device, the second window orientation information is used for the user device to convert and obtain the third window orientation information, the third window orientation information is orientation information that matches the end-side screen coordinate system formed by multiple display screens connected to the user device, and the third window orientation information is used to generate an end-side display window of the cloud service and display it on the user device.

[0018] The embodiment of the present application discloses a data processing device for a cloud service, which is applied to a user device connected to multiple display screens, and the device includes:

[0019] a second acquisition module, configured to, upon receiving the second window position information sent by the server, convert the second window position information into third window position information matching the terminal-side screen coordinate system formed by the multiple display screens; the second window position information is position information based on the universal screen coordinate system;

[0020] A display module is used to generate a terminal-side display window of the cloud service according to the third window orientation information and display it in the terminal-side screen coordinate system.

[0021] The present application embodiment discloses a data processing system for a cloud service, including:

[0022] Server and user equipment connected to multiple displays;

[0023] The server is used to: obtain first window position information of a cloud-side display window of a cloud service; convert the first window position information into second window position information based on a universal screen coordinate system; and send the second window position information to a user device;

[0024] The user device is used to: upon receiving second window orientation information sent by the server, convert the second window orientation information into third window orientation information that matches the end-side screen coordinate system formed by the multiple display screens; and based on the third window orientation information, generate an end-side display window of the cloud service and display it in the end-side screen coordinate system.

[0025] An embodiment of the present application further discloses an electronic device, including: a processor; and a memory, on which executable code is stored. When the executable code is executed, the processor executes one or more methods described in the embodiments of the present application.

[0026] The embodiments of the present application also disclose one or more machine-readable media on which executable codes are stored. When the executable codes are executed, the processor executes one or more methods described in the embodiments of the present application.

[0027] Compared with the related art, the embodiments of the present application have the following advantages:

[0028] The embodiment of the present application sets a universal screen coordinate system so that when the cloud side sends window orientation information to the terminal side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the terminal side then converts the received window orientation information of the universal screen coordinate system into the terminal side screen coordinate system for use. When the terminal side sends window orientation information to the cloud side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the cloud side then converts the received window orientation information of the universal screen coordinate system into the cloud side screen coordinate system for use, thereby ensuring that the window orientation information received by each side is the correct orientation information based on its own screen coordinate system, thereby ensuring the normal execution of the cloud service, meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of cloud service abnormalities caused by incompatibility of the terminal side and cloud side screen coordinate systems. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 This is a system architecture diagram of a data processing process of a cloud service in an embodiment of the present application;

[0030] Figure 2 is a schematic diagram of a data processing process of a cloud service in an embodiment of the present application;

[0031] Figure 3This is a schematic diagram of a data processing scenario of a cloud desktop office application service in an embodiment of the present application;

[0032] Figure 4 This is a schematic diagram of a data processing scenario of a cloud gaming application service according to an embodiment of the present application;

[0033] Figure 5 It is a flowchart of the steps of a data processing method of a cloud service in an embodiment of the present application;

[0034] Figure 6 is a flowchart of another method for processing data of a cloud service according to an embodiment of the present application;

[0035] Figure 7 It is a flowchart of the specific steps of a data processing method of a cloud service in an embodiment of the present application;

[0036] Figure 8 is a schematic diagram of a cloud-side screen coordinate system in an embodiment of the present application;

[0037] Fig. 9 is a schematic diagram of another cloud-side screen coordinate system in an embodiment of the present application;

[0038] Fig.10 is a schematic diagram of a universal screen coordinate system in an embodiment of the present application;

[0039] Fig.11 It is a flowchart of specific steps of another data processing method of cloud service in an embodiment of the present application;

[0040] Fig.12 is a schematic diagram of a data processing process of another cloud service according to an embodiment of the present application;

[0041] Fig.13 It is a schematic diagram of the interactive process of data processing of a cloud service in an embodiment of the present application;

[0042] Fig.14 is a block diagram of a data processing device for a cloud service according to an embodiment of the present application;

[0043] Fig.15 is a block diagram of another data processing device for cloud services according to an embodiment of the present application;

[0044] Fig.16 It is a schematic diagram of the structure of a device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0045] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0046] In order to enable those skilled in the art to better understand the present application, the concepts involved in the present application are explained below:

[0047] Cloud service: A desktop application service on the cloud provided by cloud computing vendors. It is a virtualized cloud application. It supports running applications originally running on desktop computers directly on cloud systems. It can be used to solve the resource requirements of heavy applications and the data security requirements of special applications, and provide users with a convenient and fast application management and distribution model. Cloud service instances run in an independent virtualized environment.

[0048] Server: Responsible for synchronizing the screen content of the cloud service to the user device, and injecting the operation events generated by the user device into the cloud service.

[0049] User device: A local device used by the user, such as a user's own computer, mobile phone, tablet, etc. The operating system on the user's device can be called a local system. The local system corresponds to a remote system such as a cloud service, and refers to a system running on the user's own local device.

[0050] Cloud-side display window: The display window of the cloud service on the server side, used to display the screen content of the cloud service on the cloud side.

[0051] End-side display window: The display window of the cloud service on the client side is used to display the screen content of the cloud service on the end side. The end-side display window is a user-oriented window. Users can view the screen content of the cloud service through the end-side display window and generate operation events for the cloud service in the end-side display window.

[0052] Multi-screen scenario: After the user device is connected to multiple physical displays, the client-side desktop includes multiple displays. After the screen information is synchronized to the server, the cloud-side desktop also includes multiple displays. The display window of the cloud service can be displayed on at least some of the multiple displays.

[0053] Screen coordinate system: When the user device is connected to one or more display screens, after setting, there is a fixed relative position relationship between the display screens, which enables the display screens on the desktop to form a screen coordinate system. The display windows of subsequent cloud services can be displayed in the screen coordinate system. The screen coordinate systems corresponding to different operating systems may be different. The screen coordinate systems of some operating systems use the upper left vertex of the main screen as the origin of the coordinate system, while the screen coordinate systems of other operating systems use the upper left vertex of the left screen as the origin of the coordinate system. There are also some operating systems that use the upper left vertex of each screen to calculate the origin of the coordinate system separately.

[0054] Universal screen coordinate system: In order to solve the problem of incompatibility of screen coordinate systems of different operating systems, the embodiment of the present application sets a universal screen coordinate system. When the screen coordinate systems of the cloud side and the terminal side are different, the cloud side and the terminal side can convert the window orientation information they send into the universal screen coordinate system for transmission during the process of transmitting the window orientation information. The receiving end then restores the received window orientation information of the universal screen coordinate system to its own screen coordinate system for use. For example, the universal screen coordinate system can be defined with the upper left vertex of the main screen as the origin of the coordinate system. Of course, other definition methods can also be selected, and the embodiment of the present application does not limit this.

[0055] Window orientation information: information representing the position coordinates of the display window in the screen coordinate system, which may specifically include the position coordinates of the four vertices of the display window and the size of the display window.

[0056] Operation event information: The trigger control operation (such as mouse operation, keyboard operation, etc.) generated by the external device of the user device in the terminal display window is synchronized from the user device to the server for controlling the cloud service.

[0057] The data processing method of the cloud service in the embodiment of the present application can be specifically applied to the scenario of window orientation information transmission between the user device and the server corresponding to the cloud service, such as: the data processing scenario applied to the cloud desktop office application service, and can also be applied to the data processing scenario of the cloud game application service. Taking the data processing scenario of the cloud desktop office application service as an example, the cloud desktop is also called a virtual desktop or a remote desktop. The user device can access the cloud desktop to realize local office work, and the computing overhead required for office work is generated on the cloud side, which reduces the system overhead on the user device side. Specifically, for the deployment of the office environment, the user device can access multiple display screens to form a terminal-side screen coordinate system. After the user device synchronizes the display screen information to the server, the server can establish a corresponding cloud-side screen coordinate system. When the cloud-side screen coordinate system and the terminal-side screen coordinate system are inconsistent due to the difference between the cloud-side operating system and the terminal-side operating system (such as the different methods for determining the origin of the coordinate system), in order to realize the normal implementation of the cloud desktop office application service, the embodiment of the present application can convert the first window orientation information of the cloud-side display window read by the server to the second window orientation information based on the universal screen coordinate system and send it to the user device during the process of the server sending the cloud-side display window of the cloud desktop office application service to the user device. The user device can convert the second window orientation information into the third window orientation information matching the terminal-side screen coordinate system, and then use the third window orientation information to generate and display the terminal-side display window of the cloud desktop office application service. The user can subsequently use an external device to operate the cloud desktop office application service in the terminal-side display window to realize cloud desktop office. The event information generated by the operation can also be synchronized from the user device to the server, and the server injects the event information into the cloud desktop office application service to realize office interaction. The embodiment of the present application sets a universal screen coordinate system so that when the cloud side sends window position information to the terminal side, the window position information can be converted into the universal screen coordinate system before sending it, and the terminal side then converts the received window position information of the universal screen coordinate system into the terminal side screen coordinate system for use. When the terminal side sends window position information to the cloud side, the window position information can be converted into the universal screen coordinate system before sending it, and the cloud side then converts the received window position information of the universal screen coordinate system into the cloud side screen coordinate system for use, thereby meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of abnormal cloud service display caused by incompatibility of the terminal side and cloud side screen coordinate systems.

[0058] Reference Figure 1 , which shows a system architecture diagram of a data processing process of a cloud service provided by an embodiment of the present application, including: a server and a user device. The server includes: a cloud service module and a first conversion module; the user device includes: a second conversion module and an execution module.

[0059] In an embodiment of the present application, the cloud service has a corresponding cloud-side display window on the cloud side (server), and the cloud-side display window displays the screen content of the cloud service. The implementation of user device access to the cloud service means that the server corresponding to the cloud service can capture the cloud-side display window and the screen content therein through the cloud service module and transmit it to the user device. The user device will create a corresponding terminal-side display window for the execution module to display the screen content of the cloud service, wherein the cloud-side display window is displayed based on the cloud-side screen coordinate system of the server, and the terminal-side display window is implemented based on the terminal-side screen coordinate system of the user device.

[0060] Among them, the user device can facilitate the use of cloud services by connecting to multiple display screens to realize multi-screen scenarios. After multiple display screens are connected, the user device can set the relative position relationship between the multiple display screens in response to the user setting operation, and then build the end-side screen coordinate system based on the origin selection strategy of the end-side screen coordinate system (determined by the end-side operating system). It should be noted that after the user device connects to multiple display screens, the display information will be synchronized to the server, so that the server can build the cloud-side screen coordinate system according to the display screens with set relative position relationships and the origin selection strategy of the cloud-side screen coordinate system (determined by the cloud-side operating system) to realize the construction of the cloud-side desktop. In addition, when the user device changes the connected display screen (addition, replacement, deletion, etc.), it will also send synchronization information to the server so that the server can synchronize the display screen changes.

[0061] In actual applications, different operating systems have different screen coordinate systems. For example, the screen coordinate system of some operating systems uses the upper left vertex of the main screen as the origin of the coordinate system, while the screen coordinate system of some operating systems uses the upper left vertex of the left screen as the origin of the coordinate system. Therefore, the server and user devices will have different screen coordinate systems due to their different operating systems. In this way, when synchronizing the screen content of the cloud service between the user device and the server, there will be deviations in the display of the screen and deviations in the operation positions of the controls in the screen.

[0062] Specifically, in order to solve the above problems, the embodiments of the present application can define a universal screen coordinate system to transmit the window orientation information of the display window between the user device and the server based on the unified universal screen coordinate system. The cloud service module set in the server can capture the cloud-side display window of the cloud service and the screen content therein, and inject the operation events sent by the user device to the cloud service into the cloud service to realize interaction; the first conversion module set on the server side is used to convert the window orientation information of the cloud-side screen coordinate system of the cloud-side display window to be sent into the window orientation information of the universal screen coordinate system and send it to the user device, and convert the received window orientation information of the universal screen coordinate system into the window orientation information of the cloud-side screen coordinate system for use. Furthermore, a second conversion module is provided on the user device side, which is used to convert the window orientation information of the terminal screen coordinate system of the terminal display window to be sent into the window orientation information of the universal screen coordinate system and then send it to the server, and convert the received window orientation information of the universal screen coordinate system into the window orientation information of the terminal screen coordinate system for use; the execution module of the user device is used to display the terminal display window, and receive the operation events triggered by the user for the terminal display window and transmit them to the server. By setting the universal screen coordinate system, the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system are met, and the problem of cloud service anomalies caused by incompatibility of the terminal and cloud screen coordinate systems is solved.

[0063] The following is an example of the data processing process of the cloud service:

[0064] Reference Figure 2 , which shows a schematic diagram of the data processing process of a cloud service. It is assumed that the user device is connected to two display screens: display screen A as the main screen and display screen B as the extended screen, and the relative position relationship between display screen A and display screen B is set as shown in the figure. The end-side display window of the cloud service can be displayed and moved in display screen A or display screen B (assuming that the current end-side display window is in display screen A). The end-side screen coordinate system of the user device takes the upper left vertex of display screen B on the left as the origin. After the screen information is synchronized, the server's desktop is also composed of display screen A and display screen B in the relative position relationship as shown in the figure. The cloud-side display window of the cloud service is in display screen A. The cloud-side screen coordinate system of the server is to calculate the origin independently based on the upper left vertex of each display screen. The defined universal screen coordinate system takes the upper left vertex of display screen A as the main screen as the origin.

[0065] If the server needs to send the upper left vertex of the cloud-side display window as the window orientation information to the user device, based on the principle that the cloud-side screen coordinate system is to calculate the origin independently of the upper left vertex of each display screen, the position coordinate of the upper left vertex of the cloud-side display window captured by the server is A(1,1). After the server converts the upper left vertex position coordinate A(1,1) of the cloud-side screen coordinate system into the universal screen coordinate system, it obtains the upper left vertex position coordinate (1,1) in the universal screen coordinate system and sends it to the user device. The user device can convert the received upper left vertex position coordinate (1,1) in the universal screen coordinate system into the terminal-side screen coordinate system based on the principle that the terminal-side screen coordinate system is the upper left vertex of the left display screen B as the origin, and obtains the upper left vertex position coordinate (3,3) in the terminal-side screen coordinate system for use. The process of the user device sending the window orientation information to the server is similar, and will not be repeated here.

[0066] It should be noted that the data processing method for the cloud service provided in the embodiment of the present application can realize several specific scenarios as follows:

[0067] In one implementation, referring to Figure 3 , which shows a data processing scenario diagram of a cloud desktop office application service provided by an embodiment of the present application, including: a user device and an office server. For the normal implementation of the cloud desktop office application service, the embodiment of the present application can convert the window orientation information of the cloud-side display window read by the office server into window orientation information based on a universal screen coordinate system and send it to the user device during the process of sending the cloud-side display window of the cloud desktop office application service to the user device. The user device can convert the received window orientation information into window orientation information matching the terminal-side screen coordinate system, and then use the converted window orientation information to generate and display the terminal-side display window of the cloud desktop office application service. Subsequently, the user can use an external device to operate the cloud desktop office application service in the terminal-side display window to realize cloud desktop office, and the event information generated by the operation can also be synchronized from the user device to the office server. After the user device adjusts the orientation of the terminal-side display window of the cloud desktop office application service, the orientation information of the corresponding terminal-side screen coordinate system can also be converted into window orientation information based on the universal screen coordinate system and sent to the office server. The office server can convert the received window orientation information into window orientation information that matches the cloud-side screen coordinate system for use, and adjust the position of the cloud-side display window accordingly. The entire solution can ensure that the transmitted window orientation information will not deviate due to the difference in the screen coordinate systems on both sides, thereby meeting the needs of user devices with any screen coordinate system to connect to and use cloud services with any screen coordinate system, and solving the problem of abnormal cloud desktop office application services caused by incompatibility between the terminal-side and cloud-side screen coordinate systems.

[0068] In one implementation, referring to Figure 4 , which shows a data processing scenario diagram of a cloud game application service provided by an embodiment of the present application, including: a user device and a game server. For the normal implementation of cloud games, in the process of the game server sending the cloud-side display window of the cloud game to the user device, the embodiment of the present application can convert the window orientation information of the cloud game read out to the window orientation information based on the universal screen coordinate system and send it to the user device. The user device can convert the received window orientation information into the window orientation information matching the terminal-side screen coordinate system, and then use the converted window orientation information to generate the terminal-side display window of the cloud game and display it. Subsequently, the user can use an external device to operate the cloud game in the terminal-side display window, and the event information generated by the operation can also be synchronized to the game server by the user device. After the user device adjusts the orientation of the terminal-side display window of the cloud game, the orientation information of the corresponding terminal-side screen coordinate system can also be converted to the window orientation information based on the universal screen coordinate system and sent to the game server. The game server can convert the received window orientation information into the window orientation information matching the cloud-side screen coordinate system for use, and operate the cloud game accordingly. The entire solution can ensure that the transmitted window orientation information will not deviate due to the differences in the screen coordinate systems on both sides, thereby meeting the needs of user devices with any screen coordinate system to connect to cloud services with any screen coordinate system, and solving the problem of cloud game anomalies caused by incompatibility between the terminal and cloud screen coordinate systems.

[0069] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0070] Reference Figure 5 , which shows a step flow chart of a data processing method for a cloud service provided by an embodiment of the present application, applied to a server, the method comprising:

[0071] Step 101: Obtain first window position information of a cloud-side display window of a cloud service.

[0072] In the embodiment of the present application, the cloud service is a desktop application service on the cloud provided by a cloud computing vendor. It is a virtualized cloud application that supports running applications originally running on desktop computers directly in the cloud system. Therefore, the server corresponding to the cloud service is a carrier object that supports the cloud service. When the cloud service is running, there will be a corresponding cloud-side display window on the cloud side, and the cloud-side display window is used to display the screen content of the cloud service on the cloud side.

[0073] When a user device accesses and uses a cloud service, the server on the cloud side needs to provide the screen content of the cloud service to the user device in real time, so that the user device side can display the corresponding end-side display window of the cloud service. Specifically, when the server on the cloud side provides the screen content of the cloud service, the server can obtain the first window orientation information of the cloud-side display window of the cloud service. The first window orientation information may include the position coordinates of the four vertices of the cloud-side display window in the cloud-side screen coordinate system, the size information of the cloud-side display window in the cloud-side screen coordinate system, etc. Of course, the server can also extract the screen content data stream of the cloud-side display window and transmit it to the user device for the user device to display in the end-side display window.

[0074] Step 102: convert the first window position information into second window position information based on a universal screen coordinate system.

[0075] Specifically, for the deployment of cloud services, user devices can connect to multiple display screens to form a terminal screen coordinate system. After the user device synchronizes the display screen information to the server, the server can establish a corresponding cloud screen coordinate system. When the cloud screen coordinate system and the terminal screen coordinate system are inconsistent due to differences in the cloud operating system and the terminal operating system (for example, the method of determining the origin of the coordinate system is different), the transmission of window information has the problem of inconsistent screen coordinate systems on both sides. Inconsistent screen coordinate systems on both sides will cause abnormal cloud service execution. For example, when a user device clicks a button in the terminal display window, after the position coordinates of the button are sent to the server, the server will respond with a deviation of the wrong coordinates, causing the response to fail.

[0076] In order to solve the above problems, the embodiment of the present application can define a universal screen coordinate system to transmit the window orientation information of the display window between the user device and the server based on the unified universal screen coordinate system. When the server sends the cloud-side display window of the cloud service to the user device, the first window orientation information of the cloud-side display window can be converted into the second window orientation information based on the universal screen coordinate system and then sent to the user device. Transmitting the window orientation information in a unified form (referring to the unified universal screen coordinate system) can ensure the data consistency of the transmitted information, thereby ensuring that the user device obtains the correct window orientation for use.

[0077] Step 103: Send the second window position information to the user equipment.

[0078] Among them, the second window orientation information is used for the user device to convert and obtain the third window orientation information, and the third window orientation information is orientation information that matches the end-side screen coordinate system formed by multiple display screens connected to the user device. The third window orientation information is used to generate an end-side display window of the cloud service and display it on the user device.

[0079] In the embodiment of the present application, the user device can convert the second window orientation information into the third window orientation information matching the terminal side screen coordinate system, and then use the third window orientation information to generate and display the terminal side display window of the cloud service, thereby ensuring that the converted third window orientation information is the correct orientation information based on the terminal side screen coordinate system, thereby solving the problem of abnormal cloud service display caused by the incompatibility of the terminal side and cloud side screen coordinate systems.

[0080] Subsequently, users can use external devices to operate cloud services in the terminal display window. The event information generated by the operation can also be synchronized from the user device to the server. The server injects the event information into the cloud service to realize interaction.

[0081] In summary, the embodiments of the present application set a universal screen coordinate system so that when the cloud side sends window orientation information to the terminal side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the terminal side then converts the received window orientation information of the universal screen coordinate system into the terminal side screen coordinate system for use. When the terminal side sends window orientation information to the cloud side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the cloud side then converts the received window orientation information of the universal screen coordinate system into the cloud side screen coordinate system for use, thereby ensuring that the window orientation information received by each side is the correct orientation information based on its own screen coordinate system, thereby ensuring the normal execution of the cloud service, meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of cloud service abnormalities caused by incompatibility between the terminal side and cloud side screen coordinate systems.

[0082] Reference Figure 6 , which shows a step flow chart of a data processing method for a cloud service provided by an embodiment of the present application, which is applied to a user device connected to multiple display screens, and the method includes:

[0083] Step 201, upon receiving second window orientation information sent by the server, convert the second window orientation information into third window orientation information matching the terminal screen coordinate system formed by the multiple display screens; the second window orientation information is orientation information based on the universal screen coordinate system.

[0084] Step 202: Generate a terminal-side display window of the cloud service according to the third window position information and display it in the terminal-side screen coordinate system.

[0085] In an embodiment of the present application, for steps 201-202, the user device can facilitate the use of cloud services by connecting to multiple display screens to achieve a multi-screen scenario. After the multiple display screens are connected, the user device can set the relative position relationship between the multiple display screens in response to the user setting operation, and then construct the end-side screen coordinate system based on the origin selection strategy of the end-side screen coordinate system. It should be noted that after the user device connects to multiple display screens, the display screen information will be synchronized to the server, so that the server can construct the cloud-side screen coordinate system according to the display screens with set relative position relationships and the origin selection strategy of the cloud-side screen coordinate system, thereby realizing the construction of the cloud-side desktop.

[0086] Furthermore, the user device can convert the received second window orientation information of the universal screen coordinate system into the third window orientation information of the terminal side screen coordinate system for use. The converted third window orientation information is correct orientation information based on the terminal side screen coordinate system, thereby meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of cloud service anomalies caused by the incompatibility of the terminal side and cloud side screen coordinate systems.

[0087] In summary, the embodiments of the present application set a universal screen coordinate system so that when the cloud side sends window orientation information to the terminal side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the terminal side then converts the received window orientation information of the universal screen coordinate system into the terminal side screen coordinate system for use. When the terminal side sends window orientation information to the cloud side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the cloud side then converts the received window orientation information of the universal screen coordinate system into the cloud side screen coordinate system for use, thereby ensuring that the window orientation information received by each side is the correct orientation information based on its own screen coordinate system, thereby ensuring the normal execution of the cloud service, meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of cloud service abnormalities caused by incompatibility between the terminal side and cloud side screen coordinate systems.

[0088] Reference Figure 7 , which shows a specific step flow chart of a data processing method for a cloud service provided in an embodiment of the present application, applied to a server, the method comprising:

[0089] Step 301: Obtain first window position information of a cloud-side display window of a cloud service.

[0090] This step may specifically refer to the above step 101, which will not be described in detail here.

[0091] Step 302: When the origin of the cloud-side screen coordinate system corresponding to the first window orientation information is different from the origin of the universal screen coordinate system, convert the position coordinates in the first window orientation information into the position coordinates in the universal screen coordinate system to obtain the second window orientation information.

[0092] There is a preset relative position relationship between the multiple display screens connected to the user device, the multiple display screens include a main display screen, and the universal screen coordinate system is a coordinate system with a target vertex set for the main display screen as the origin.

[0093] In the embodiment of the present application, after the user device accesses multiple display screens and sets the relative position relationship between the multiple display screens, the user device will synchronize the information of the display screens to the server. The server can construct a cloud-side screen coordinate system based on the information of the multiple display screens and the relative position relationship between the multiple display screens. The origin selection strategy of the cloud-side screen coordinate system is related to the cloud-side operating system. For example, when the cloud-side operating system sets the upper left vertex of the left display screen among the multiple display screens as the coordinate origin, the cloud-side screen coordinate system uses the upper left vertex of the left display screen among the multiple display screens as the coordinate origin. Figure 8 As shown, it shows a schematic diagram of a cloud side screen coordinate system, in which the cloud side screen coordinate system takes the upper left vertex of the left display screen among multiple display screens as the coordinate origin (0, 0). Assuming that the current cloud side display window is located in display screen B, the coordinates of the upper left vertex of the cloud side display window in the cloud side screen coordinate system are (0, 3).

[0094] In another implementation, the cloud-side screen coordinate system can also be: multiple display screens calculate the origin independently with their respective upper left vertices, such as Fig. 9 As shown, it shows a schematic diagram of another cloud side screen coordinate system, in which the cloud side screen coordinate system independently calculates the origin A(0, 0); B(0, 0) with each upper left vertex. Assuming that the current cloud side display window is located in display screen A, the coordinates of the upper left vertex of the cloud side display window in the cloud side screen coordinate system are A(1, 1).

[0095] Specifically, the embodiment of the present application can set the universal screen coordinate system as: a coordinate system with the target vertex of the main display screen among the multiple display screens as the origin, wherein the target vertex can preferably be set as the upper left vertex of the main display screen. Fig.10 As shown, it shows a schematic diagram of a universal screen coordinate system, in which the universal screen coordinate system takes the upper left vertex of the main display screen among multiple display screens as the origin (0, 0).

[0096] Furthermore, if the origin of the cloud-side screen coordinate system corresponding to the first window position information is different from the origin of the universal screen coordinate system, it means that the current cloud-side screen coordinate system is different from the universal screen coordinate system, and it is necessary to convert the position coordinates in the first window position information of the cloud-side screen coordinate system into the second window position information in the universal screen coordinate system. Figure 2 , assuming that the cloud-side screen coordinate system is a plurality of display screens that independently calculate the origin with their respective upper left vertices, and the current cloud-side display window is located in display screen A, if the first window orientation information includes the coordinate A(1, 1) of the upper left vertex of the cloud-side display window, then after converting the coordinate A(1, 1) of the cloud-side screen coordinate system to the universal screen coordinate system, the corresponding coordinate of the universal screen coordinate system is (1, 1).

[0097] Of course, the cloud-side screen coordinate system of the server may also be consistent with the universal screen coordinate system. In this case, there is no need to convert the first window position information, and the server may directly send the first window position information to the user device for use.

[0098] Step 303: Send the second window position information to the user equipment, where the second window position information is used by the user equipment to convert and obtain third window position information.

[0099] Among them, the third window orientation information is orientation information that matches the end-side screen coordinate system formed by multiple display screens connected to the user device, and the third window orientation information is used to generate an end-side display window of the cloud service and display it on the user device.

[0100] This step may be specifically referred to as the above step 103, which will not be described in detail here.

[0101] Optionally, the method may further include:

[0102] Step 304: upon receiving the operation event information sent by the user device and the fifth window position information based on the universal screen coordinate system, convert the fifth window position information into sixth window position information matching the cloud-side screen coordinate system of the server.

[0103] Step 305: adjust the cloud-side display window of the cloud service according to the sixth window orientation information, and use the operation event information to execute a response in the adjusted cloud-side display window.

[0104] In an embodiment of the present application, for steps 304-305, after the user device synchronously displays the end-side display window of the cloud service, the user can obtain the service content of the cloud service through the end-side display window displayed by the user device, and perform operation events (such as mouse operation events, keyboard operation events, etc.) on the end-side display window through an external device of the user device, and generate operation event information and fifth window orientation information in the universal screen coordinate system and send them to the server, wherein the fifth window orientation information is the orientation information formed after the fourth window orientation information of the end-side display window is converted into the universal screen coordinate system when the user device triggers a response. The fifth window orientation information is used to inform the server of the orientation information of the end-side display window when the user device triggers an operation event. The significance of this is that when the user uses the cloud service, the position of the end-side display window may be moved (such as moving the end-side display window from display screen A to display screen B), and the operation event generated by the user on the end-side display window may be based on the end-side display window with a new position after the move. At this time, it is necessary to inform the server of the new position of the end-side display window (the fifth window orientation information) and the triggered operation event. The server can convert the received fifth window orientation information of the universal screen coordinate system into the sixth window orientation information matching the cloud-side screen coordinate system for use, so that the server can determine the new position of the current end-side display window according to the sixth window orientation information, thereby adjusting the position of the cloud-side display window accordingly. Finally, the server can use the operation event information to execute the response in the adjusted cloud-side display window, thereby achieving the purpose of the cloud service on the cloud side correctly executing the operation event on the end side, and avoiding abnormal responses to the cloud service triggering the operation event due to the different screen coordinate systems on the cloud side and the end side.

[0105] The above process is described through an example:

[0106] Assume that the universal screen coordinate system is a coordinate system with the upper left vertex of the main display screen A in the display screen A and the display screen B as the origin, and define the mouse message of the universal screen coordinate system: (x, y, window ID = 0) Window ID is 0, which means (x, y) is the coordinate relative to the upper left corner of the main display screen. Define the window orientation information of the universal screen coordinate system: (window id, x, y, width, height), where width is the width of the display window of the cloud service, and height is the height of the display window of the cloud service.

[0107] When the operating system of the user device is Windows (Windows operating system) and the operating system of the server is Linux (an open source operating system), the terminal-side screen coordinate system of the user device (with the upper left vertex of the left screen as the origin) is different from the universal screen coordinate system, and data conversion is required; the cloud-side screen coordinate system of the server is the same as the universal screen coordinate system, and no data conversion is required. Assume that the user device moves the end-side display window from display screen A to display screen B, and executes a mouse event in the end-side display window. After the movement is completed and the mouse event is completed, the user device generates a mouse message: (x=10, y=10, window Id=1) and a window message: (window id=1, x=100, y=200, width=200, height=100). At this time, the user device needs to convert the window orientation information of the end-side screen coordinate system: (window id=1, x=100, y=200, width=200, height=100) to the window orientation information of the universal screen coordinate system: (window id=1, x=-630, y=-360, width=200, height=100) and send it to the server. The server converts the window orientation information of the universal screen coordinate system: (window id=1,x=-630,y=-360,width=200,height=100)moves the cloud side display window to a new position and triggers a mouse message in the cloud side display window at the new position.

[0108] In summary, the embodiments of the present application set a universal screen coordinate system so that when the cloud side sends window orientation information to the terminal side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the terminal side then converts the received window orientation information of the universal screen coordinate system into the terminal side screen coordinate system for use. When the terminal side sends window orientation information to the cloud side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the cloud side then converts the received window orientation information of the universal screen coordinate system into the cloud side screen coordinate system for use, thereby ensuring that the window orientation information received by each side is the correct orientation information based on its own screen coordinate system, thereby ensuring the normal execution of the cloud service, meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of cloud service abnormalities caused by incompatibility between the terminal side and cloud side screen coordinate systems.

[0109] Reference Fig.11 , which shows a specific step flow chart of a data processing method for a cloud service provided by an embodiment of the present application, which is applied to a user device connected to multiple display screens, and the method includes:

[0110] Step 401: upon receiving second window position information sent by a server, convert the second window position information into third window position information matching a terminal-side screen coordinate system formed by the multiple display screens.

[0111] The second window position information is position information based on a universal screen coordinate system.

[0112] This step may refer to the above step 201 and will not be described in detail here.

[0113] Step 402: Generate a terminal-side display window of the cloud service according to the third window position information and display it in the terminal-side screen coordinate system.

[0114] This step may refer to the above step 202 and will not be described in detail here.

[0115] Optionally, after step 402, the following steps may also be included:

[0116] Step 403: Acquire the operation event information triggered by the terminal-side display window and the fourth window position information of the terminal-side display window during the trigger response.

[0117] Step 404: Convert the fourth window position information into fifth window position information based on a universal screen coordinate system.

[0118] Step 405: Send the fifth window position information and the operation event information to the server.

[0119] Among them, the fifth window orientation information is used for the server to convert and obtain the sixth window orientation information, the sixth window orientation information is orientation information matching the cloud-side screen coordinate system of the server, the sixth window orientation information is used to adjust the cloud-side display window of the cloud service, and the operation event information is used to execute a response in the adjusted cloud-side display window.

[0120] In the embodiment of the present application, for steps 403-405, the embodiment of the present application can set the universal screen coordinate system as: a coordinate system with the target vertex of the main display screen among the multiple display screens as the origin, wherein the target vertex can preferably be set as the upper left vertex of the main display screen. The form of the universal screen coordinate system can be referred to Fig.10 .

[0121] In one case, the terminal side operating system can be set to use the upper left vertex of the left display screen among the multiple display screens as the coordinate origin. In this case, the terminal side screen coordinate system is in the form of Figure 8 ,

[0122] In another case, the terminal side screen coordinate system can also be: multiple display screens calculate the origin independently with their respective upper left vertices. In this case, the terminal side screen coordinate system is in the form of the figure

[0123] Of course, the terminal screen coordinate system of the user device may also be consistent with the universal screen coordinate system. In this case, there is no need to convert the fourth window position information, and the user device may directly send the fourth window position information to the server for use.

[0124] In an embodiment of the present application, after the user device synchronously displays the end-side display window of the cloud service, the user can obtain the service content of the cloud service through the end-side display window displayed by the user device, and perform operation events (such as mouse operation events, keyboard operation events, etc.) on the end-side display window through an external device of the user device, and generate operation event information and fifth window orientation information in a universal screen coordinate system and send them to the server, wherein the fifth window orientation information is the orientation information formed after the fourth window orientation information of the end-side display window is converted into the universal screen coordinate system when the user device triggers a response. The fifth window orientation information is used to inform the server of the orientation information of the end-side display window when the user device triggers an operation event. The significance of this is that when the user uses the cloud service, the position of the end-side display window may be moved (such as moving the end-side display window from display screen A to display screen B), and the operation event generated by the user on the end-side display window may be based on the end-side display window with a new position after the move. At this time, it is necessary to inform the server of the new position of the end-side display window (the fifth window orientation information) and the triggered operation event. The server can convert the received fifth window orientation information of the universal screen coordinate system into the sixth window orientation information matching the cloud-side screen coordinate system for use, so that the server can determine the new position of the current end-side display window according to the sixth window orientation information, thereby adjusting the position of the cloud-side display window accordingly. Finally, the server can use the operation event information to execute the response in the adjusted cloud-side display window, thereby achieving the purpose of the cloud service on the cloud side correctly executing the operation event on the end side, and avoiding abnormal responses to the cloud service triggering the operation event due to the different screen coordinate systems on the cloud side and the end side.

[0125] Optionally, there is a preset relative position relationship between the multiple display screens connected to the user device, the multiple display screens include a main display screen, and the universal screen coordinate system is a coordinate system with a target vertex set for the main display screen as the origin; step 404 may specifically include:

[0126] Sub-step 4041: when the origin of the terminal side screen coordinate system corresponding to the fourth window orientation information is different from the origin of the universal screen coordinate system, convert the position coordinates in the fourth window orientation information into the position coordinates in the universal screen coordinate system to obtain the fifth window orientation information.

[0127] Sub-step 4041 is described in detail by taking an example:

[0128] Reference Fig.12 , assuming that the user device is connected to two display screens: display screen A as the main screen and display screen B as the extended screen, and the relative position relationship between display screens A and B is set as shown in the figure, the user device's terminal-side screen coordinate system takes the upper left vertex of display screen B on the left as the origin, and the display window of the cloud service is in display screen A. The server's cloud-side screen coordinate system calculates the origin independently based on the upper left vertex of each display screen, and the defined universal screen coordinate system takes the upper left vertex of display screen A as the main screen as the origin.

[0129] If the user device needs to send the upper left vertex of the end-side display window as window orientation information to the server, based on the principle that the end-side screen coordinate system is to independently calculate the origin of the upper left vertex of each display screen, the position coordinate of the upper left vertex of the end-side display window captured by the user device is (3, 3). After the user device converts the upper left vertex position coordinate (3, 3) of the end-side screen coordinate system into the universal screen coordinate system, it obtains the upper left vertex position coordinate (1, 1) in the universal screen coordinate system and sends it to the server. The server can convert the received upper left vertex position coordinate (1, 1) in the universal screen coordinate system into the cloud-side screen coordinate system based on the principle that the cloud-side screen coordinate system is to take the upper left vertex of the left display screen B as the origin, and obtains the upper left vertex position coordinate A (1, 1) of the cloud-side display window in the cloud-side screen coordinate system for use.

[0130] Optionally, the method may further include:

[0131] Step 406: when it is determined that multiple display screens are connected to the user equipment, a relative position relationship between the multiple display screens is set, and the terminal-side screen coordinate system is obtained according to a preset terminal-side coordinate system origin;

[0132] Step 407: Generate screen setting information and send it to the server, where the screen setting information is used by the server to construct a cloud-side screen coordinate system corresponding to the multiple display screens.

[0133] In the embodiment of the present application, for steps 406-407, the user device can realize a multi-screen scenario by connecting to multiple display screens to facilitate the use of cloud services. After multiple display screens are connected, the user device can set the relative position relationship between the multiple display screens in response to the user setting operation. For example, assuming that the user device is connected to two display screens: display screen A and display screen B, the user can set the relative position relationship between display screen A and display screen B as follows: Figure 8 After setting, the relative position relationship between display screen A and display screen B remains unchanged. After that, the user device can build the end-side screen coordinate system based on the origin selection strategy of the end-side screen coordinate system (determined by the end-side operating system). It should be noted that after the user device is connected to multiple display screens, the screen setting information including the display screen information and the relative position relationship between the display screens will be synchronized to the server, so that the server can build the cloud-side screen coordinate system according to the display screens with set relative position relationship and the origin selection strategy of the cloud-side screen coordinate system (determined by the cloud-side operating system), so as to realize the construction of the cloud-side desktop.

[0134] Optionally, the method may further include:

[0135] Step 408: When a display screen connected to the user device is changed, screen synchronization information is generated and sent to the server, where the screen synchronization information is used for the server to synchronously update the display screen corresponding to the cloud-side screen coordinate system.

[0136] In an embodiment of the present application, when a user device changes the connected display screen (adding a new display screen, replacing a display screen, deleting a display screen, etc.), screen synchronization information including the changed display screen information and the relative position relationship between the changed display screens will also be sent to the server so that the server can synchronize the display screen changes.

[0137] Finally, refer to Fig.13 , which shows a schematic diagram of an interactive process of data processing of a cloud service, including a server and a user device. After the cloud service is started at S1, for the transmission process from the cloud side to the terminal side, the server first executes S2, and the server captures the first window orientation information of the cloud side display window of the cloud service; then executes S3, and transmits the first window orientation information of the cloud side display window of the cloud service to the first conversion module of the server; the first conversion module of the server can execute S4, and convert the first window orientation information into the second window orientation information of the universal screen coordinate system; and S5, and send the second window orientation information to the second conversion module of the user device; the second conversion module of the user device can execute S6, and convert the second window orientation information into the third window orientation information of the terminal side screen coordinate system; and S7, and transmit the third window orientation information to the user device; so that the user device executes S8, and uses the third window orientation information to display the cloud service content in the terminal side display window.

[0138] For the transmission process from the end side to the cloud side, the user device executes S9, moves or triggers the end side display window; and S10, transmits the trigger event and the fourth window orientation information of the current end side display window to the second conversion module of the user device; the second conversion module of the user device executes S11, converts the fourth window orientation information into the fifth window orientation information of the universal screen coordinate system; and executes S12, sends the trigger event and the fifth window orientation information to the first conversion module of the server; the first conversion module of the server executes S13, converts the fifth window orientation information into the sixth window orientation information of the cloud side screen coordinate system, so that the server executes S14, uses the sixth window orientation information to adjust the cloud side display window, and the adjusted cloud side display window responds to the trigger event.

[0139] In summary, the embodiments of the present application set a universal screen coordinate system so that when the cloud side sends window orientation information to the terminal side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the terminal side then converts the received window orientation information of the universal screen coordinate system into the terminal side screen coordinate system for use. When the terminal side sends window orientation information to the cloud side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the cloud side then converts the received window orientation information of the universal screen coordinate system into the cloud side screen coordinate system for use, thereby ensuring that the window orientation information received by each side is the correct orientation information based on its own screen coordinate system, thereby ensuring the normal execution of the cloud service, meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of cloud service abnormalities caused by incompatibility between the terminal side and cloud side screen coordinate systems.

[0140] Reference Figure 1 , which shows a data processing system for a cloud service provided by an embodiment of the present application, including: a server and a user device connected to multiple display screens;

[0141] The server is used to: obtain first window position information of a cloud-side display window of a cloud service; convert the first window position information into second window position information based on a universal screen coordinate system; and send the second window position information to a user device;

[0142] The user device is used to: upon receiving the second window orientation information sent by the server, convert the second window orientation information into third window orientation information that matches the end-side screen coordinate system formed by multiple display screens; based on the third window orientation information, generate an end-side display window of the cloud service and display it in the end-side screen coordinate system.

[0143] Specifically, the description of the data processing system for cloud services can refer to the above Figure 1 The embodiments of the present invention are not described in detail here.

[0144] In summary, the embodiments of the present application set a universal screen coordinate system so that when the cloud side sends window orientation information to the terminal side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the terminal side then converts the received window orientation information of the universal screen coordinate system into the terminal side screen coordinate system for use. When the terminal side sends window orientation information to the cloud side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the cloud side then converts the received window orientation information of the universal screen coordinate system into the cloud side screen coordinate system for use, thereby ensuring that the window orientation information received by each side is the correct orientation information based on its own screen coordinate system, thereby ensuring the normal execution of the cloud service, meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of cloud service abnormalities caused by incompatibility between the terminal side and cloud side screen coordinate systems.

[0145] Reference Fig.14 , which shows a block diagram of a data processing device for a cloud service provided by an embodiment of the present application, applied to a server, including:

[0146] A first acquisition module 501 is used to acquire first window position information of a cloud-side display window of a cloud service;

[0147] A first conversion module 502, configured to convert the first window position information into second window position information based on a universal screen coordinate system;

[0148] The first sending module 503 is used to send the second window orientation information to the user device, the second window orientation information is used for the user device to convert and obtain the third window orientation information, the third window orientation information is orientation information that matches the end-side screen coordinate system formed by multiple display screens connected to the user device, and the third window orientation information is used to generate an end-side display window of the cloud service and display it on the user device.

[0149] Optionally, also include:

[0150] a second conversion module, configured to, upon receiving the operation event information sent by the user device and the fifth window position information based on the universal screen coordinate system, convert the fifth window position information into sixth window position information matching the cloud-side screen coordinate system of the server;

[0151] An operation response module is used to adjust the cloud-side display window of the cloud service according to the sixth window orientation information, and use the operation event information to perform a response in the adjusted cloud-side display window.

[0152] Optionally, there is a preset relative position relationship between the multiple display screens connected to the user device, the multiple display screens include a main display screen, and the universal screen coordinate system is a coordinate system with a target vertex set for the main display screen as the origin;

[0153] The first conversion module 502 includes:

[0154] The first conversion submodule is used to convert the position coordinates in the first window orientation information into the position coordinates in the universal screen coordinate system to obtain the second window orientation information when the origin of the cloud-side screen coordinate system corresponding to the first window orientation information is different from the origin of the universal screen coordinate system.

[0155] Optionally, also include:

[0156] The first construction module is used to respond to the screen setting information sent by the user equipment, and obtain the cloud-side screen coordinate system according to the relative position relationship between multiple display screens included in the screen setting information and a preset cloud-side coordinate system origin.

[0157] In summary, the embodiments of the present application set a universal screen coordinate system so that when the cloud side sends window orientation information to the terminal side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the terminal side then converts the received window orientation information of the universal screen coordinate system into the terminal side screen coordinate system for use. When the terminal side sends window orientation information to the cloud side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the cloud side then converts the received window orientation information of the universal screen coordinate system into the cloud side screen coordinate system for use, thereby ensuring that the window orientation information received by each side is the correct orientation information based on its own screen coordinate system, thereby ensuring the normal execution of the cloud service, meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of cloud service abnormalities caused by incompatibility between the terminal side and cloud side screen coordinate systems.

[0158] Reference Fig.15 , which shows a block diagram of another data processing device for cloud services provided by an embodiment of the present application, which is applied to a user device accessing multiple display screens, including:

[0159] The second acquisition module 601 is used for converting the second window orientation information sent by the server into third window orientation information matching the terminal-side screen coordinate system formed by the multiple display screens when the second window orientation information is received; the second window orientation information is orientation information based on the universal screen coordinate system;

[0160] The display module 602 is used to generate a terminal-side display window of the cloud service according to the third window orientation information and display it in the terminal-side screen coordinate system.

[0161] Optionally, also include:

[0162] A trigger event module, used for acquiring operation event information triggered for the terminal side display window, and fourth window position information of the terminal side display window during the trigger response;

[0163] A third conversion module, used for converting the fourth window position information into fifth window position information based on a universal screen coordinate system;

[0164] A second sending module is used to send the fifth window orientation information and the operation event information to the server; the fifth window orientation information is used for the server to convert and obtain the sixth window orientation information, the sixth window orientation information is orientation information that matches the cloud-side screen coordinate system of the server, the sixth window orientation information is used to adjust the cloud-side display window of the cloud service, and the operation event information is used to execute a response in the adjusted cloud-side display window.

[0165] Optionally, there is a preset relative position relationship between the multiple display screens connected to the user device, the multiple display screens include a main display screen, and the universal screen coordinate system is a coordinate system with a target vertex set for the main display screen as the origin;

[0166] The third conversion module comprises:

[0167] The second conversion submodule is used to convert the position coordinates in the fourth window orientation information into the position coordinates in the universal screen coordinate system to obtain the fifth window orientation information when the origin of the terminal side screen coordinate system corresponding to the fourth window orientation information is different from the origin of the universal screen coordinate system.

[0168] Optionally, also include:

[0169] A second construction module is used to set a relative position relationship between the multiple display screens when it is determined that the multiple display screens are connected to the user equipment, and obtain the terminal side screen coordinate system according to a preset terminal side coordinate system origin;

[0170] A generation module is used to generate screen setting information and send it to the server, wherein the screen setting information is used for the server to construct a cloud-side screen coordinate system corresponding to the multiple display screens.

[0171] Optionally, also include:

[0172] The third sending module is used to generate screen synchronization information and send it to the server when the display screen connected to the user device is changed, and the screen synchronization information is used for the server to synchronously update the display screen corresponding to the cloud-side screen coordinate system.

[0173] The embodiment of the present application sets a universal screen coordinate system so that when the cloud side sends window orientation information to the terminal side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the terminal side then converts the received window orientation information of the universal screen coordinate system into the terminal side screen coordinate system for use. When the terminal side sends window orientation information to the cloud side, the window orientation information can be converted into the universal screen coordinate system before sending it, and the cloud side then converts the received window orientation information of the universal screen coordinate system into the cloud side screen coordinate system for use, thereby ensuring that the window orientation information received by each side is the correct orientation information based on its own screen coordinate system, thereby ensuring the normal execution of the cloud service, meeting the needs of user devices of any screen coordinate system to connect to and use cloud services of any screen coordinate system, and solving the problem of cloud service abnormalities caused by incompatibility of the terminal side and cloud side screen coordinate systems.

[0174] The embodiment of the present application also provides a non-volatile readable storage medium, which stores one or more modules (programs). When the one or more modules are applied to a device, the device can execute instructions (instructions) of each method step in the embodiment of the present application.

[0175] The present application embodiment provides one or more machine-readable media on which instructions are stored, and when executed by one or more processors, an electronic device executes one or more of the methods described in the above embodiments. In the present application embodiment, the electronic device includes various types of devices such as terminal devices and servers (clusters).

[0176] The embodiments of the present disclosure may be implemented as a device configured as desired using any appropriate hardware, firmware, software, or any combination thereof, and the device may include electronic devices such as terminal devices and servers (clusters). Fig.16 An exemplary device 1000 that can be used to implement various embodiments described in the embodiments of the present application is schematically shown.

[0177] For one embodiment, Fig.16An exemplary apparatus 1000 is shown having one or more processors 1002, a control module (chip set) 1004 coupled to at least one of the (one or more) processors 1002, a memory 1006 coupled to the control module 1004, a non-volatile memory (NVM) / storage device 1008 coupled to the control module 1004, one or more input / output devices 1010 coupled to the control module 1004, and a network interface 1012 coupled to the control module 1004.

[0178] The processor 1002 may include one or more single-core or multi-core processors, and the processor 1002 may include any combination of general-purpose processors or special-purpose processors (such as graphics processors, application processors, baseband processors, etc.). In some embodiments, the device 1000 can be used as a terminal device, server (cluster), etc. described in the embodiments of the present application.

[0179] In some embodiments, the apparatus 1000 may include one or more computer-readable media (e.g., memory 1006 or NVM / storage device 1008) having instructions 1014 and one or more processors 1002 combined with the one or more computer-readable media and configured to execute the instructions 1014 to implement a module to perform the actions described in the present disclosure.

[0180] For one embodiment, the control module 1004 may include any suitable interface controller to provide any suitable interface to at least one of the processor(s) 1002 and / or any suitable device or component in communication with the control module 1004 .

[0181] The control module 1004 may include a memory controller module to provide an interface to the memory 1006. The memory controller module may be a hardware module, a software module, and / or a firmware module.

[0182] The memory 1006 may be used, for example, to load and store data and / or instructions 1014 for the device 1000. For one embodiment, the memory 1006 may include any suitable volatile memory, such as a suitable DRAM. In some embodiments, the memory 1006 may include double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).

[0183] For one embodiment, control module 1004 may include one or more input / output controllers to provide an interface to NVM / storage device 1008 and input / output device(s) 1010 .

[0184] For example, NVM / storage 1008 may be used to store data and / or instructions 1014. NVM / storage 1008 may include any suitable non-volatile memory (e.g., flash memory) and / or may include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives (HDDs), one or more compact disk (CD) drives, and / or one or more digital versatile disk (DVD) drives).

[0185] NVM / storage device 1008 may include storage resources that are physically part of the device on which apparatus 1000 is installed, or it may be accessible to the device without being part of the device. For example, NVM / storage device 1008 may be accessed via input / output device(s) 1010 over a network.

[0186] (One or more) input / output devices 1010 may provide an interface for the apparatus 1000 to communicate with any other appropriate device, and the input / output device 1010 may include a communication component, an audio component, a sensor component, etc. The network interface 1012 may provide an interface for the apparatus 1000 to communicate through one or more networks, and the apparatus 1000 may wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols, for example, accessing a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, 5G, etc., or a combination thereof for wireless communication.

[0187] For one embodiment, at least one of the processor(s) 1002 may be packaged together with the logic of one or more controllers (e.g., a memory controller module) of the control module 1004. For one embodiment, at least one of the processor(s) 1002 may be packaged together with the logic of one or more controllers of the control module 1004 to form a system-in-package (SiP). For one embodiment, at least one of the processor(s) 1002 may be integrated on the same die with the logic of one or more controllers of the control module 1004. For one embodiment, at least one of the processor(s) 1002 may be integrated on the same die with the logic of one or more controllers of the control module 1004 to form a system-on-chip (SoC).

[0188] In various embodiments, the apparatus 1000 may be, but is not limited to, a terminal device such as a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet computer, a netbook, etc.). In various embodiments, the apparatus 1000 may have more or fewer components and / or a different architecture. For example, in some embodiments, the apparatus 1000 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an application-specific integrated circuit (ASIC), and a speaker.

[0189] Among them, the main control chip can be used as a processor or control module in the detection device, sensor data, location information, etc. are stored in a memory or NVM / storage device, the sensor group can be used as an input / output device, and the communication interface may include a network interface.

[0190] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0191] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0192] The present application embodiment is described with reference to the flowchart and / or block diagram of the method, terminal device (system) and computer program product according to the embodiment of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, and the combination of the process and / or box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device produce a device for implementing the function specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.

[0193] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0194] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce computer-implemented processing, so that the instructions executed on the computer or other programmable terminal device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0195] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0196] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0197] The above is a detailed introduction to a data processing method, device, data processing system, electronic device, and machine-readable medium for a cloud service provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for a person skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data processing method for cloud services, characterized in that: Applied to a server, the method comprises: Obtaining first window position information of a cloud-side display window of a cloud service; Converting the first window position information into second window position information based on a universal screen coordinate system; The second window orientation information is sent to the user device, and the second window orientation information is used by the user device to convert and obtain third window orientation information. The third window orientation information is orientation information that matches the end-side screen coordinate system formed by multiple display screens connected to the user device. The third window orientation information is used to generate an end-side display window of the cloud service and display it on the user device.

2. The method according to claim 1, characterized in that Also includes: Upon receiving the operation event information sent by the user device and the fifth window position information based on the universal screen coordinate system, converting the fifth window position information into sixth window position information matching the cloud-side screen coordinate system of the server; The cloud-side display window of the cloud service is adjusted according to the sixth window orientation information, and a response is executed in the adjusted cloud-side display window using the operation event information.

3. The method according to claim 1, characterized in that There is a preset relative position relationship between the multiple display screens connected to the user equipment, the multiple display screens include a main display screen, and the universal screen coordinate system is a coordinate system with a target vertex set for the main display screen as the origin; The converting the first window position information into second window position information based on a universal screen coordinate system comprises: When the origin of the cloud-side screen coordinate system corresponding to the first window orientation information is different from the origin of the universal screen coordinate system, the position coordinates in the first window orientation information are converted into the position coordinates in the universal screen coordinate system to obtain the second window orientation information.

4. The method according to claim 1, characterized in that Also includes: In response to the screen setting information sent by the user equipment, the cloud-side screen coordinate system is obtained according to the relative position relationship between the multiple display screens included in the screen setting information and a preset cloud-side coordinate system origin.

5. A data processing method for cloud services, characterized in that: Applied to a user device accessing multiple display screens, the method comprises: When receiving the second window position information sent by the server, converting the second window position information into third window position information matching the terminal-side screen coordinate system formed by the multiple display screens; the second window position information is position information based on the universal screen coordinate system; According to the third window orientation information, a terminal-side display window of the cloud service is generated and displayed in the terminal-side screen coordinate system.

6. The method according to claim 5, characterized in that After generating a terminal-side display window of the cloud service according to the third window position information and displaying it in the terminal-side screen coordinate system, the method further includes: Acquire operation event information triggered on the terminal side display window, and fourth window position information of the terminal side display window when the trigger response occurs; Converting the fourth window position information into fifth window position information based on a universal screen coordinate system; The fifth window orientation information and the operation event information are sent to the server; the fifth window orientation information is used by the server to convert and obtain the sixth window orientation information, the sixth window orientation information is orientation information that matches the cloud-side screen coordinate system of the server, the sixth window orientation information is used to adjust the cloud-side display window of the cloud service, and the operation event information is used to execute a response in the adjusted cloud-side display window.

7. The method according to claim 6, characterized in that There is a preset relative position relationship between the multiple display screens connected to the user equipment, the multiple display screens include a main display screen, and the universal screen coordinate system is a coordinate system with a target vertex set for the main display screen as the origin; The converting the fourth window position information into fifth window position information based on a universal screen coordinate system comprises: When the origin of the terminal screen coordinate system corresponding to the fourth window orientation information is different from the origin of the universal screen coordinate system, the position coordinates in the fourth window orientation information are converted into position coordinates in the universal screen coordinate system to obtain the fifth window orientation information.

8. The method according to claim 5, characterized in that Also includes: When it is determined that multiple display screens are connected to the user device, a relative position relationship between the multiple display screens is set, and the terminal-side screen coordinate system is obtained according to a preset terminal-side coordinate system origin; Screen setting information is generated and sent to the server, where the screen setting information is used by the server to construct a cloud-side screen coordinate system corresponding to the multiple display screens.

9. The method according to claim 5, characterized in that Also includes: When a display screen connected to the user device is changed, screen synchronization information is generated and sent to the server, and the screen synchronization information is used for the server to synchronously update the display screen corresponding to the cloud-side screen coordinate system.

10. A data processing device for cloud services, characterized in that: Applied to a server, the device comprises: A first acquisition module, used to acquire first window position information of a cloud-side display window of a cloud service; A first conversion module, used for converting the first window position information into second window position information based on a universal screen coordinate system; The first sending module is used to send the second window orientation information to the user device, the second window orientation information is used for the user device to convert and obtain the third window orientation information, the third window orientation information is orientation information that matches the end-side screen coordinate system formed by multiple display screens connected to the user device, and the third window orientation information is used to generate an end-side display window of the cloud service and display it on the user device.

11. A data processing device for cloud services, characterized in that: Applicable to user equipment accessing multiple display screens, the device comprises: a second acquisition module, configured to, upon receiving the second window position information sent by the server, convert the second window position information into third window position information matching the terminal-side screen coordinate system formed by the multiple display screens; the second window position information is position information based on the universal screen coordinate system; A display module is used to generate a terminal-side display window of the cloud service according to the third window orientation information and display it in the terminal-side screen coordinate system.

12. A data processing system for cloud services, characterized in that: include: Server and user equipment connected to multiple displays; The server is used to: obtain first window position information of a cloud-side display window of a cloud service; Converting the first window position information into second window position information based on a universal screen coordinate system; Sending the second window position information to the user equipment; The user equipment is used to: when receiving the second window position information sent by the server, convert the second window position information into third window position information matching the terminal side screen coordinate system formed by the multiple display screens; According to the third window orientation information, a terminal-side display window of the cloud service is generated and displayed in the terminal-side screen coordinate system.

13. An electronic device, characterized in that: include: processor; and A memory having executable codes stored thereon, which, when the executable codes are executed, enable the processor to perform the method according to any one of claims 1 to 9.

14. One or more machine-readable media having executable codes stored thereon, which, when executed, cause a processor to perform the method according to any one of claims 1 to 9.

Images