Remote control method and apparatus, and device, server, system, medium and product

Abstract

Provided are a remote control method and apparatus, and a device, a server, a system, a medium and a product. The remote control method comprises: in response to a touch operation on a touch screen, sending operation position information of the touch operation to a server, wherein the touch operation is an operation on a first object in a first interface displayed on the touch screen, the operation position information is used by the server to determine a second object corresponding to the touch operation in a second interface, execute a response of the second object and update display content of the second interface, display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object; and receiving a touch response of the server to the touch operation, wherein the touch response is configured to update the display content of the first interface.

Description

Remote control methods, devices, equipment, servers, systems, media and products

[0001] This disclosure claims priority to Chinese patent application No. 202510280065.4, filed on March 10, 2025, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This disclosure relates to the field of computer technology, and in particular to a remote control method, apparatus, device, server, system, medium and product. Background Technology

[0003] Terminal virtualization enables a virtual device (cloud terminal) running on a cloud server. A front-end device connects to this virtual device on the cloud server via a specific communication protocol, displaying the virtual device's system desktop on the front-end device. It also redirects the front-end device's operational data to the virtual device on the cloud server for corresponding responses. This approach concentrates the main computing resources (such as CPU, memory, hard drive, and network) on the cloud server, thus reducing the hardware / software requirements of the front-end device. Summary of the Invention

[0004] In a first aspect, embodiments of this disclosure provide a remote control method executed by a touch device, the touch device including a touch screen, the method comprising: responding to a touch operation on the touch screen, sending operation location information of the touch operation to a server, the touch operation being an operation on a first object in a first interface displayed on the touch screen, the operation location information being used by the server to determine a second object corresponding to the touch operation in a second interface, and executing a response of the second object, updating the display content of the second interface, the display content of the first interface being synchronized with the display content of the second interface, the second object corresponding to the first object; and receiving a touch response from the server to the touch operation, the touch response being used to update the display content of the first interface.

[0005] In one implementation, the operation location information is the touch point coordinates on the touch screen where the touch operation is performed. The touch point coordinates are used by the server to determine the pixel points that constitute the first object targeted by the touch operation.

[0006] In one implementation, the method further includes: in response to the power-on operation of the touch device, sending the resolution of the touch screen to the server; the resolution of the touch screen is used by the server to run a program version that matches the resolution of the touch screen when running the application, with different resolutions corresponding to different program versions.

[0007] In one implementation, the method further includes: receiving the resolution of the second interface sent by the server; and adjusting the resolution of the touch screen to match the resolution of the second interface if the resolution of the second interface is less than the resolution of the touch screen.

[0008] In one implementation, the method further includes: receiving the aspect ratio of the second interface sent by the server; determining the size of the first interface based on the size of the touch screen and the aspect ratio of the second interface, the size including length and width; and displaying the first interface on the touch screen based on the size of the first interface.

[0009] Secondly, embodiments of this disclosure provide a remote control method, which is executed by a server and includes: receiving operation location information sent by a touch device, wherein the operation location information is the location information of a touch operation on the touch screen of the touch device, and the touch operation is an operation on a first object in a first interface displayed on the touch screen of the touch device; determining a second object corresponding to the touch operation in a second interface based on the operation location information, wherein the display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object; executing a response of the second object to update the display content of the second interface; and sending a touch response to the touch operation to the touch device, wherein the touch response is used by the touch device to update the display content of the first interface.

[0010] In one implementation, the operation location information is the touch point coordinates on the touch screen where the touch operation is performed. The touch point coordinates are used by the server to determine the pixel points that constitute the first object targeted by the touch operation.

[0011] In one implementation, the method further includes: receiving the resolution of the touch screen sent by the touch device; and, based on the resolution of the touch screen, running an application version that matches the resolution of the touch screen, with different resolutions corresponding to different application versions.

[0012] In one implementation, the method further includes sending the resolution of a second interface to the touch device, the resolution of the second interface being used by the touch device to adjust the resolution of the touch screen.

[0013] In one implementation, the method further includes: sending the aspect ratio of the second interface to the touch device, the aspect ratio of the second interface being used by the touch device to determine the size of the first interface, the size including: length and width.

[0014] Thirdly, this disclosure provides a remote control device for use in a touch device, the touch device including a touch screen, and the remote control device including a processing unit and a receiving unit;

[0015] The processing unit is configured to respond to a touch operation on the touch screen by sending operation location information of the touch operation to the server. The touch operation is an operation on a first object in a first interface displayed on the touch screen. The operation location information is used by the server to determine a second object corresponding to the touch operation in a second interface, and to execute the response of the second object, updating the display content of the second interface. The display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object. The receiving unit is configured to receive the touch response from the server to the touch operation, and the touch response is used to update the display content of the first interface.

[0016] In one implementation, the operation location information is the touch point coordinates on the touch screen where the touch operation is performed. The touch point coordinates are used by the server to determine the pixel points that constitute the first object targeted by the touch operation.

[0017] In one implementation, the remote control device further includes a sending unit; the sending unit is configured to send the resolution of the touch screen to the server in response to the power-on operation of the touch device; the resolution of the touch screen is used by the server to run a program version that matches the resolution of the touch screen when running the application, and different resolutions correspond to different program versions.

[0018] In one implementation, the receiving unit is further configured to receive the resolution of the second interface sent by the server; the processing unit is further configured to adjust the resolution of the touch screen to match the resolution of the second interface if the resolution of the second interface is less than the resolution of the touch screen.

[0019] In one implementation, the remote control device further includes: a display unit; the receiving unit is further configured to receive the aspect ratio of the second interface sent by the server; the processing unit is further configured to determine the size of the first interface based on the size of the touch screen and the aspect ratio of the second interface, the size including: length and width; and the display unit is configured to display the first interface on the touch screen based on the size of the first interface.

[0020] Fourthly, embodiments of this disclosure provide a remote control device applied to a server. The remote control device includes: a receiving unit, a processing unit, and a sending unit.

[0021] The receiving unit is used to receive operation position information sent by the touch device. The operation position information is the position information of the touch operation on the touch screen of the touch device, and the touch operation is the operation on the first object in the first interface displayed on the touch screen of the touch device.

[0022] The processing unit is used to determine the second object corresponding to the touch operation in the second interface based on the operation position information. The display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object.

[0023] The processing unit is also used to execute the response of the second object and update the display content of the second interface;

[0024] The sending unit is used to send a touch response to the touch operation to the touch device, and the touch response is used by the touch device to update the display content of the first interface.

[0025] In one implementation, the operation location information is the touch point coordinates on the touch screen where the touch operation is performed. The touch point coordinates are used by the server to determine the pixel points that constitute the first object targeted by the touch operation.

[0026] In one implementation, the receiving unit is further configured to receive the resolution of the touch screen sent by the touch device; the processing unit is further configured to, based on the resolution of the touch screen, run a program version that matches the resolution of the touch screen when running the application, with different resolutions corresponding to different program versions.

[0027] In one implementation, the sending unit is further configured to send the resolution of the second interface to the touch device, the resolution of the second interface being used by the touch device to adjust the resolution of the touch screen.

[0028] In one implementation, the sending unit is further configured to send the aspect ratio of the second interface to the touch device, the aspect ratio of the second interface being used by the touch device to determine the size of the first interface, the size including length and width.

[0029] Fifthly, embodiments of this disclosure provide a touch device, including: a processor and a memory; the memory is used to store one or more programs, the one or more programs including computer-executable instructions, and when the touch device is running, the processor executes the computer-executable instructions stored in the memory to cause the touch device to perform a remote control method according to the first aspect.

[0030] In a sixth aspect, embodiments of this disclosure provide a server, including: a processor and a memory; the memory is used to store one or more programs, the one or more programs including computer-executable instructions, and when the server is running, the processor executes the computer-executable instructions stored in the memory to cause the server to perform a remote control method according to the second aspect.

[0031] In a seventh aspect, embodiments of this disclosure provide a remote control system, which includes a touch device and a server. The touch device includes a touch screen, and the remote control system is used to execute a remote control method according to the first or second aspect.

[0032] Eighthly, embodiments of this disclosure provide a computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by a computer, cause the computer to perform a remote control method according to the first or second aspect.

[0033] Ninthly, embodiments of this disclosure provide a computer program product that, when run on a computer, causes the computer to perform a remote control method according to the first or second aspect. Attached Figure Description

[0034] Figure 1 is a schematic diagram of the structure of a remote control system according to some embodiments.

[0035] Figure 2 is a schematic diagram of the structure of another remote control system according to some embodiments.

[0036] Figure 3 is a schematic diagram of the structure of a touch device according to some embodiments.

[0037] Figure 4 is a schematic diagram of the structure of a display processing module according to some embodiments.

[0038] Figure 5 is a structural schematic diagram of a touch screen processing module according to some embodiments.

[0039] Figure 6 is a schematic flowchart of a remote control method according to some embodiments.

[0040] Figure 7 is a schematic diagram of a coordinate system corresponding to a touch screen according to some embodiments.

[0041] Figure 8 is a schematic diagram of an interface display according to some embodiments.

[0042] Figure 9 is a schematic diagram of another interface display according to some embodiments.

[0043] Figure 10 is a schematic flowchart of another remote control method according to some embodiments.

[0044] Figure 11 is a schematic diagram of another interface display according to some embodiments.

[0045] Figure 12 is a schematic diagram of another interface display according to some embodiments.

[0046] Figure 13 is a schematic flowchart of another remote control method according to some embodiments.

[0047] Figure 14 is a schematic diagram of a remote control device according to some embodiments.

[0048] Figure 15 is a schematic diagram of another remote control device structure according to some embodiments.

[0049] Figure 16 is a schematic diagram of an electronic device structure according to some embodiments. Detailed Implementation

[0050] The technical solutions of the embodiments of this disclosure will now be described with reference to the accompanying drawings.

[0051] In the description of this disclosure, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can mean: only A, only B, and A and B. Furthermore, "at least one" and "more than one" refer to two or more. Expressions such as "first," "second," etc., do not limit the quantity or order of execution, and expressions such as "first," "second," etc., do not necessarily imply differences.

[0052] Terminal virtualization enables a virtual device (cloud terminal) running on a cloud server. A front-end device connects to this virtual device on the cloud server via a specific communication protocol, displaying the virtual device's system desktop on the front-end device. It also redirects the front-end device's operational data to the virtual device on the cloud server for corresponding responses. This approach concentrates the main computing resources (such as CPU, memory, hard drive, and network) on the cloud server, thus reducing the hardware / software requirements of the front-end device.

[0053] Currently, the interaction between front-end devices and virtual devices on cloud servers works as follows: based on operations performed on the front-end device, the front-end device determines the corresponding control command, and then transmits the control command to the virtual device on the cloud server for execution of the corresponding response. However, this method still places high demands on the hardware / software configuration of the front-end device, and the latency for the front-end device to receive the response is relatively long, affecting the user experience.

[0054] By running virtual devices on a cloud server and remotely controlling these virtual devices through a front-end device, computing resources can be centralized on the cloud server, reducing the hardware configuration and cost of the front-end device. This approach offers advantages such as centralized management, convenient deployment, ease of use, reduced maintenance, and lower operating costs.

[0055] For example, as shown in FIG1, this disclosure provides a remote control system, which includes a front-end device 110 and a remote cloud device 120. The front-end device 110 is remotely connected to the remote cloud device 120. The front-end device 110 includes a first display screen 111, a first touch sensor 112, and a first touch processing device 113. The remote cloud device 120 includes a second display screen 121, a second touch sensor 122, and a second touch processing device 123. The first touch sensor 112 collects the user's touch operations on the content displayed on the first display screen 111. The first touch processing device 113 generates a remote control event (control command) based on the touch operation and sends the remote control event to the second touch processing device 123, so that the second touch processing device 123 executes a corresponding response according to the remote control event.

[0056] However, this method requires the first touch processing device 113 in the front-end device 110 to process the touch operation and determine the corresponding remote control event. Processing the touch operation on the front-end device 110 places high demands on the hardware / software configuration of the front-end device, and the front-end device will generate a large delay in processing the touch operation, resulting in a long delay in receiving the touch response, which affects the user experience.

[0057] Furthermore, the first display screen 111 of the front-end device 110 and the second display screen 121 of the remote cloud device 120 must use the same display resolution; otherwise, different resolutions will cause touch point positioning drift.

[0058] To address the aforementioned issues, this disclosure provides a remote control method applicable to scenarios where a front-end device remotely controls a virtual device on a cloud server. When remotely controlling the interface content displayed on the server via a touch device, the method sends touch operation location information to the server based on a touch operation performed on a first object within the first displayed interface on the touch screen of the touch device. Since the content displayed on the first interface is synchronized with the content displayed on the second interface, the server can determine the second object corresponding to the first object within the second interface based solely on the touch operation location information sent by the touch device, and then execute the response of the second object to update the displayed content of the second interface.

[0059] Using the above method, when the front-end touch device remotely controls the display content of the second interface on the server, it can send only the operation position information of the touch operation on the touch screen to the server. In this way, the server can determine the target of the touch operation based on the operation position information, and execute the corresponding response, while synchronizing the display content of the first interface on the touch screen with the display content of the second interface on the server. This eliminates the need for the touch device to determine the operation command based on the touch operation and then send the command to the server. Therefore, the touch device only needs to determine the operation position information of the touch operation, without processing other data information. This reduces the hardware / software configuration requirements of the touch device, reduces data processing time, and lowers latency. It solves the problem of high hardware / software configuration requirements and long response latency for front-end devices remotely controlling virtual devices on the server.

[0060] This disclosure provides a remote control method applicable to remote control systems. Figure 2 shows a schematic diagram of a remote control system. As shown in Figure 2, the remote control system includes a touch device 21 and a server 22. The touch device 21 includes a touchscreen. The touch device 21 and the server 22 are remotely connected via a network. The touch device 21 and the server 22 can be connected via a wired or wireless connection; this disclosure does not limit the connection in this way.

[0061] In some embodiments, the connection between the touch device 21 and the server 22 can be any of the following: Universal Serial Bus (USB), Bluetooth, Zigbee (a low-speed, short-range wireless network protocol), Zwave, infrared, Ethernet, Wireless Local Area Network (WLAN), cellular communication, satellite communication, etc.

[0062] The touch device 21 can be used in the Internet of Things (IoT). The touch device 21 may include hardware such as a central processing unit (CPU), memory, and storage devices storing an operating system.

[0063] The touch device 21 can interact with the server 22. For example, the touch device 21 can obtain data sent by the server 22 and then display corresponding content on the touch screen based on the data sent by the server 22. The server 22 can also be used in the Internet of Things (IoT) to send data to the touch device 21.

[0064] In some embodiments, the touch device 21 may be, for example, a mobile phone, tablet computer, monitor, handwriting tablet, or other device that performs input operations via external touch.

[0065] It should be noted that the touch device 21 and the server 22 are independent devices.

[0066] In some embodiments, server 22 can be a cloud server (or server group), providing a means to access service logic for remote control invocation by touch devices. Server 22 can provide application services to users, such as the implementation of Hypertext Transfer Protocol (HTTP) and database connection management, application execution, etc. Server 22 has the functionality to implement the methods provided in the embodiments of this disclosure. The functionality can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described functions.

[0067] In one design, server 22 includes a processor and a transmitter. The processor is configured to support server 22 in performing the corresponding functions described in the above methods. The transmitter supports communication between server 22 and touch device 21, sending data information, responses, etc., involved in the above methods to touch device 21. Server 22 may also include a memory coupled to the processor, which stores necessary program instructions and data of server 22. Server 22 may also include a receiver for receiving data information (e.g., operation position information) sent by touch device 21.

[0068] For example, server 22 can be a central server, an edge server, or a local server in a local data center.

[0069] In some embodiments, the server 22 includes a virtual device corresponding to the touch device 21. The virtual device may include: a touch device access module, an application management module, and an application program, etc.

[0070] In one implementation, the touchscreen consists of a touch module and a display module. These can be two independent devices, and are arranged in an overlapping manner, with the touch module covering the display module. Essentially, the touchscreen has both touch and display functions.

[0071] In one implementation, the touchscreen of touch device 21 can synchronously display the content displayed in the virtual interface of server 22. The user can perform desired touch operations based on the content displayed on the touchscreen of touch device 21 and send the operation position information of the touch operation to server 22. Server 22 then executes the response corresponding to the touch operation and can send the response result back to touch device 21 to display the corresponding content on the touchscreen.

[0072] In some embodiments of this disclosure, as shown in FIG3, FIG3 is a schematic diagram of the structure of a touch device according to some embodiments. The touch device includes: a touch module 311, a touch screen processing module 312, a control host 313, a display module 314, a display screen processing module 315, and a communication module 316.

[0073] The touch module 311 is used to receive user touch operations and is the input module of the touch device. The touch module 311 can receive input signals from sensing devices such as hands and dedicated touch points. The touch operations performed by the user on the touch module 311 are responded to by the touch screen processing module 312 (for example, converting the position of the touch operation into actual touch point coordinates).

[0074] The touch screen processing module 312 is used to determine the operation position information (e.g., touch point coordinates) of the touch operation based on the user's touch operation.

[0075] The control host 313 is used to send the operation position information of the touch operation to the communication module 316. The control host 313 and the communication module 316 are connected via an interface or wirelessly.

[0076] It should be noted that the control host 313 may not be responsible for handling the information interaction between the touch screen processing module 312 and the display screen processing module 315.

[0077] Display module 314 is used to display the interface and is the output module of the touch device. Display module 314 can display images, text and other information, and the content displayed is provided by display processing module 315.

[0078] It should be noted that the touch module 311 and the display module 314 can be independent modules or integrated modules.

[0079] The display processing module 315 is used to decode the encoded video stream (touch response) transmitted to the touch device via the communication module 316, and therefore the display processing module 315 may include a decoder.

[0080] The communication module 316 is used to send the above data (operation position information of touch operation) to the virtual device deployed on the cloud server for processing according to the communication protocol used; or to receive the touch response (encoded video stream) sent by the cloud server.

[0081] In some embodiments of this disclosure, as shown in FIG4, FIG4 is a schematic diagram of the structure of a display processing module according to some embodiments. The display processing module includes: a display resolution determination module 401, a virtual device resolution acquisition module 402, a decoder 403, and a high-definition multimedia (HDMI) interface 404.

[0082] The display resolution determination module 401 is used to determine the resolution of the display module, and the available resolution range of the display module can be obtained through the HDMI interface 404.

[0083] The virtual device resolution acquisition module 402 is used to acquire the resolution of the virtual interface displayed by the virtual device deployed on the cloud server through the communication module.

[0084] Decoder 403 is used to decode the received touch response (encoded video stream) and connect to the display module via HDMI interface 404 to display the decoded video stream through the display module.

[0085] The HDMI interface 404 is used to connect the display processing module and the display module.

[0086] It should be noted that since the virtual devices deployed on the cloud server do not have actual display output devices, the resolution of their virtual interface is the resolution of the video or image virtualized by the graphics card. This resolution does not need to negotiate with the display module of the front-end touch device; it depends solely on the cloud server settings and the available resources of the graphics card.

[0087] In one implementation, by comparing the resolution of the virtual interface displayed by the virtual device with the resolution of the display module, when the resolution of the virtual interface displayed by the virtual device is less than the resolution of the display module, the resolution of the virtual interface displayed by the virtual device is determined as the actual resolution of the display module.

[0088] In one implementation, the aspect ratio of the display module's display interface can be adjusted by stretching or cropping based on the difference between the aspect ratio of the virtual interface displayed by the virtual device and the aspect ratio of the display module.

[0089] In one implementation, when the resolution of the virtual interface displayed by the virtual device is greater than or equal to the resolution of the display module, it is not necessary to adjust the actual resolution of the display module. Alternatively, a prompt message can be displayed to indicate that the display module's resolution is too low or that the display module is unavailable.

[0090] In some embodiments of this disclosure, as shown in FIG5, FIG5 is a schematic structural diagram of a touch screen processing module according to some embodiments. The touch screen processing module includes: a touch point position acquisition module 501, a resolution acquisition module 502, and a touch screen interface 503.

[0091] The touch position acquisition module 501 is used to acquire the operation position information (such as touch coordinates) of the touch operation from the touch module.

[0092] The resolution acquisition module 502 is used to obtain the actual resolution of the display module from the control host.

[0093] In one implementation, based on the obtained operation position information of the touch operation (e.g., touch point coordinates) and the actual resolution of the display module, the identifier of the pixel corresponding to the touch operation can be determined and sent to the control host.

[0094] The following describes a remote control method provided by an embodiment of the present disclosure with reference to the accompanying drawings. As shown in FIG6, FIG6 illustrates a remote control method according to some embodiments, executed by a touch device and a server. The touch device includes a touch screen, and the method includes steps S601-S605.

[0095] S601. In response to a touch operation on the touch screen, the touch device sends the operation position information of the touch operation to the server.

[0096] The touch operation is an operation on the first object in the first interface displayed on the touch screen. The operation position information is used by the server to determine the second object corresponding to the touch operation in the second interface, and execute the response of the second object to update the display content of the second interface. The display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object.

[0097] Corresponding to S601, the server receives operation position information sent by the touch device. The operation position information is the position information of the touch operation on the touch screen of the touch device.

[0098] In one implementation, the touch device can connect to a virtual device running on a server to run the user's required applications using the server's computing resources (such as CPU, memory, hard disk, network, etc.).

[0099] It should be noted that the server includes virtual devices corresponding to touch devices, and when the virtual device is running an application, it can display the application's current content through a virtual interface (i.e., a second interface). Furthermore, the content displayed in the virtual interface can be sent to the touch device so that the same content is synchronously displayed on the touch screen of the touch device.

[0100] Thus, when a user needs to trigger the application to execute a corresponding response through operation input, the user can perform the required touch operation on the touch screen of the touch device based on the displayed content (i.e., the first interface), thereby executing the response corresponding to the touch operation in the server and updating the displayed response content on the touch screen of the touch device.

[0101] In one implementation, a user can use a sensory device, such as a finger or a dedicated touchpad, to input signals on the touchscreen of a touch device and perform touch operations on the desired display content (i.e., a first object, such as a close window control) based on the display content included in the first interface.

[0102] In some embodiments of this disclosure, the operation location information is the touch point coordinates on the touch screen where the touch operation is performed. The touch point coordinates are used by the server to determine the pixel point constituting the first object targeted by the touch operation.

[0103] For example, as shown in Figure 7, a coordinate system can be established with the lower left corner of the touch screen as the origin, the horizontal side of the touch screen as the X-axis, and the vertical side of the touch screen as the Y-axis, so as to determine the corresponding touch point coordinates (x, y) based on the touch point position of the touch operation on the touch screen.

[0104] In one implementation, based on the determined touch point coordinates of the touch operation, combined with the size (length and width) and resolution of the touch screen, the corresponding pixel at the touch point coordinates (x, y) (i.e., the pixel targeted by the touch operation) can be determined. Thus, based on the display content formed by the determined pixels, the object targeted by the touch operation can be determined.

[0105] S602, The server determines the second object corresponding to the touch operation in the second interface based on the operation location information.

[0106] The content displayed on the first interface is synchronized with the content displayed on the second interface, and the second object corresponds to the first object.

[0107] In one implementation, after the server receives the operation location information of the touch operation sent by the touch device, the virtual device corresponding to the touch device in the server can determine the second object corresponding to the touch operation in the virtual interface (i.e., the second interface) of the virtual device based on the operation location information of the touch operation, execute the response of the second object, obtain the touch response of the touch operation, and send the touch response to the touch device.

[0108] Thus, since the content displayed on the first interface is synchronized with the content displayed on the second interface, the second object corresponding to the first object can be determined in the second interface based on the operation position information of the touch operation on the first object on the touch device.

[0109] In one implementation, when the operation location information is the touch point coordinates on the touch screen, the server can determine the pixel targeted by the touch operation in the virtual interface (i.e., the second interface) of the virtual device based on the touch point coordinates. Then, the server determines the virtual object (i.e., the second object) corresponding to the object formed by the pixels targeted by the touch operation (i.e., the first object), executes the response of the second object, obtains the touch response of the touch operation, and sends the touch response to the touch device.

[0110] S603. The server executes the response of the second object and updates the display content of the second interface.

[0111] S604. The server sends a touch response to the touch device in response to the touch operation.

[0112] Touch response is used by touch devices to update the displayed content of the first interface. Touch response includes response data in response to touch operations, and this response data is used by the touch device to synchronously display the same content as the displayed content of the second interface on the touch screen.

[0113] In some embodiments, response data may include video stream data or video frame data.

[0114] Corresponding to S604, the touch device receives the touch response from the server for the touch operation and updates the display content of the first interface.

[0115] S605, Update the content displayed on the first screen of the touch device.

[0116] In one implementation, the touch device synchronously displays the same content as the content displayed on the second interface on the touch screen based on response data.

[0117] In one implementation, the response data includes video stream data of the switched interface displayed by the virtual device corresponding to the touch device in the server after responding to the touch operation in the virtual interface (i.e., the second interface). After receiving the touch response sent by the server, the touch device can synchronously display the switched interface on the touch screen based on the video stream data.

[0118] In some embodiments of this disclosure, synchronously displaying content identical to the content displayed on the second interface on the touch screen based on response data includes: decoding the response data to determine the content displayed on the second interface; and synchronously displaying content identical to the content displayed on the second interface on the touch screen.

[0119] In one implementation, when the response data includes video stream data or video frame data, the touch device can decode the video stream data or video frame data to obtain the corresponding display content (i.e., the display content of the second interface) so as to synchronously display the same display content on the touch screen.

[0120] For example, as shown in Figure 8, a friend chat interface of a social application (i.e., the first interface) is displayed on the touchscreen of a front-end touch device. The social application runs on a virtual device in the server, and a corresponding friend chat interface (i.e., the second interface) is also displayed in the virtual interface of the virtual device. When a user needs to close the friend chat interface displayed on the touchscreen, the user can touch the "close window control" of the friend chat interface. The touch device can then determine the operation location information (e.g., touch point coordinates) of the touch operation and send it to the server. Further, as shown in Figure 9, the server can, based on the received touch operation location information, determine the object corresponding to the operation location information in the friend chat interface displayed in the virtual interface of the virtual device as the "close window control," and execute the response to close the friend chat interface, switching the display to the main interface of the social application. When switching the display of the main interface of the social application in the virtual interface of the virtual device, the switched main interface of the social application is also sent as response data to the front-end touch device via touch response. The front-end touch device then parses the response data to synchronously display the main interface of the social application on the touchscreen.

[0121] This disclosure provides a remote control method applied to scenarios where a front-end device remotely controls a virtual device in a cloud server. When remotely controlling the interface content displayed on the server via a touch device, the method sends touch operation position information to the server based on a touch operation on a first object displayed on the touch screen of the touch device. Since the display content of the first interface on the touch screen is synchronized with the display content of the second interface, the server can determine the second object corresponding to the first object in the second interface based solely on the touch operation position information sent by the touch device. The server then executes the response of the second object to obtain a response result and updates the display content of the second interface. Thus, the server can respond to touch operations based on the touch operation position information and send the touch response to the touch device, enabling the touch device to update the display content of the first interface based on the touch response.

[0122] Using the above method, when the front-end touch device remotely controls the display content of the second interface on the server, it can send only the operation position information of the touch operation on the touch screen to the server. In this way, the server can determine the target of the touch operation based on the operation position information, and execute the corresponding response, while synchronizing the display content of the first interface on the touch screen with the display content of the second interface on the server. This eliminates the need for the touch device to determine the operation command based on the touch operation and then send the command to the server. Therefore, the touch device only needs to determine the operation position information of the touch operation, without processing other data information. This reduces the hardware / software configuration requirements of the touch device, reduces data processing time, and lowers latency. It solves the problem of high hardware / software configuration requirements and long response latency for front-end devices remotely controlling virtual devices on the server.

[0123] In some embodiments of this disclosure, as shown in FIG10, the remote control method may further include S1001.

[0124] S1001. In response to the power-on operation of the touch device, the touch device sends the resolution of the touch screen to the server.

[0125] The touchscreen resolution is used by the server to run an application version that matches the touchscreen resolution; different resolutions correspond to different application versions.

[0126] In one implementation, the touch device needs to first determine the resolution of the touch screen.

[0127] The resolution of the touchscreen is determined by either the user-defined resolution or the touchscreen's default resolution.

[0128] In one implementation, when the touch device switches from a powered-off state to a powered-on state, the touch device needs to establish a connection with the server and send the screen resolution to the server so that the server can determine which version of the application should be run when the application is running.

[0129] It's important to note that because the same application often has different versions for different display resolutions (i.e., different versions are adapted to different screen resolutions), when the version of the application is incompatible with the screen resolution, the application's interface displayed on the screen will appear abnormal. Therefore, to display the application interface on screens (touchscreens) with different resolutions, you can run different versions of the application to ensure the interface is clearly displayed on the screen.

[0130] Therefore, when a touch device is powered on, the resolution of the touch screen needs to be determined and sent to the server.

[0131] In one implementation, the touchscreen can have a fixed resolution (i.e., the resolution is not adjustable) or a range of available resolutions (i.e., the resolution is adjustable). When the touchscreen has a range of available resolutions, the user can select the desired resolution when the touch device is powered on, so that the touchscreen displays the interface based on the user-selected resolution.

[0132] In one implementation, after the server receives the resolution of the touch screen, if it also receives a trigger to run an application (such as a social application), the server can determine the version of the application to be run based on the resolution of the touch screen.

[0133] In this embodiment of the disclosure, when the touch device is powered on, the touch device sends its screen resolution to the server, enabling the server to run a version of the application that matches the touch screen resolution when running the application in the virtual device. This ensures that the application interface is clearly displayed on the touch screen.

[0134] In some embodiments of this disclosure, the server sends the resolution of a second interface to the touch device, the resolution of which is used by the touch device to adjust the resolution of the touch screen.

[0135] Correspondingly, the touch device receives the resolution of the second interface sent by the server; if the resolution of the second interface is less than the resolution of the touch screen, the touch device adjusts the resolution of the touch screen to the resolution of the second interface.

[0136] In one implementation, when the touchscreen has a range of available resolutions, if the touch device receives the resolution of the virtual interface (i.e., the second interface) displayed by the virtual device from the server, the touch device can compare the resolution of the virtual interface with the currently set resolution of the touchscreen. Therefore, if the resolution of the virtual interface is lower than the resolution of the touchscreen, the touchscreen resolution is adjusted.

[0137] In one implementation, when the resolution of the virtual interface (i.e., the second interface) displayed by the virtual device is greater than or equal to the resolution currently set on the touch screen, it is not necessary to adjust the actual resolution of the touch screen.

[0138] In this embodiment, by determining the relationship between the resolution of the second interface and the resolution of the touch screen, and if the resolution of the second interface is less than the resolution of the touch screen, the resolution of the touch screen is adjusted to be the same as the resolution of the second interface. Thus, when determining the pixel targeted by a touch operation based on the coordinates of the touch point on the touch screen, the pixel targeted by the touch operation can be determined more accurately, thereby improving the accuracy of responding to touch operations.

[0139] In some embodiments of this disclosure, the server sends the aspect ratio of the second interface to the touch device. The aspect ratio of the second interface is used by the touch device to determine the size of the first interface, which includes length and width.

[0140] Correspondingly, the touch device receives the aspect ratio of the second interface from the server; based on the size of the touch screen and the aspect ratio of the second interface, it determines the size of the first interface. Then, based on the size of the first interface, it displays the first interface on the touch screen.

[0141] Dimensions include: length and width.

[0142] It should be noted that since the virtual device does not have an actual display output module, the size of the virtual interface it displays is determined by the graphics card. The size of this virtual interface does not need to match the size of the touchscreen; it depends solely on the system settings and the graphics card.

[0143] In one implementation, when the size of the virtual interface (i.e., the second interface) displayed by the virtual device is inconsistent with the size of the touch screen, the aspect ratio of the virtual interface displayed by the virtual device is also different from that of the touch screen. Therefore, when the content displayed on the touch screen is synchronized with the content displayed on the virtual interface, the displayed content needs to be stretched or cropped.

[0144] For example, as shown in Figure 11, the aspect ratio of the virtual interface (i.e., the second interface) displayed by the virtual device is 3:4, while the aspect ratio of the touchscreen is 16:9. For instance, the touchscreen is 32cm long and 18cm wide (height). When the content of the virtual interface is displayed synchronously on the touchscreen, the content of the virtual interface can be stretched proportionally to display the first interface with an aspect ratio of 3:4 on the touchscreen with an aspect ratio of 16:9. Furthermore, the first interface is stretched based on the size of the touchscreen so that the length of the first interface is 13.5cm and the width (height) is 18cm. In this case, the touchscreen will include the first interface and a blank display area outside the first interface (i.e., the area filled with black in Figure 11).

[0145] Alternatively, as shown in Figure 12, the content displayed on the virtual interface can be cropped to obtain the first interface from the 3:4 aspect ratio of the second interface, which is then cropped to a 16:9 aspect ratio for display on the touchscreen. Furthermore, the first interface is stretched based on the touchscreen's dimensions, resulting in a length of 32cm and a width (height) of 18cm. In this case, the touchscreen only displays the first interface, but compared to the content displayed on the second interface, the first interface will have missing portions (i.e., the edge areas of the content displayed on the second interface).

[0146] Alternatively, the content displayed on the virtual interface can be horizontally stretched. This would stretch the content of the second interface (3:4 aspect ratio) to a 16:9 aspect ratio to create the first interface, which would then be displayed on the touchscreen. In this case, the content displayed on the first interface on the touchscreen is synchronized with the content displayed on the second interface, but the content on the first interface will exhibit a horizontally stretched display effect.

[0147] In this embodiment of the disclosure, when the size of the virtual interface (i.e. the second interface) displayed by the virtual device does not match the size of the touch screen, the size of the first interface displayed on the touch screen can be adjusted based on the size of the touch screen and the aspect ratio of the second interface, so as to accurately display content synchronized with the display content of the second interface on the touch screen.

[0148] For example, as shown in FIG13, FIG13 illustrates a remote control method according to some embodiments, executed by a remote control system. The remote control system includes a touch device and a server. The touch device includes a touch module, a touch screen processing module, a display module, and a display processing module. The server includes a virtual device corresponding to the touch device. The virtual device includes a touch device access module, an application management module, and an application program. The method includes steps S1301-S1315.

[0149] S1301 The touch module receives user input for power-on and resolution setting operations and sends them to the touch screen processing module.

[0150] It should be noted that the resolution of the display module is an adjustable parameter, or the resolution of the display module is a fixed parameter (i.e., the resolution of some display modules is a fixed value).

[0151] S1302, The touch screen processing module sets the resolution of the display module and sends it to the display processing module.

[0152] In one implementation, the touch screen processing module can directly obtain the resolution from the display module.

[0153] S1303 The display processing module obtains the resolution of the display module and sends the resolution of the display module to the application management module of the virtual device in the server via the network.

[0154] S1304. The application management module launches the program version corresponding to the resolution of the display module from the application used by the user.

[0155] S1305, The application sends the application interface to the application management module.

[0156] S1306 The application management module performs video encoding on the program interface and sends the encoded data to the display processing module of the touch device via the network.

[0157] S1307 The display processing module decodes the received encoded data and sends the decoded video stream to the display module.

[0158] It should be noted that users can see the current program interface through the display module.

[0159] S1308, the touch module receives the user's touch operation.

[0160] For example, the touch operation could be a click on the "Close Window" button.

[0161] S1309, The touch module sends the operation position information of the touch operation to the touch screen processing module.

[0162] S1310, the touch screen processing module converts the operation position information into touch point coordinates and sends them to the touch device access module of the virtual device in the server.

[0163] S1311 The touch screen device access module determines the pixel corresponding to the touch point coordinates based on the touch point coordinates and the resolution of the display module, and sends it to the application management module.

[0164] S1312, The application management module notifies the application to execute the corresponding touch response.

[0165] For example, a touch response can close the currently displayed window (interface).

[0166] S1313 The application executes the corresponding touch response and sends the response data to the application management module.

[0167] S1314 The application management module encodes the response data and sends it to the display processing module of the touch device via the network.

[0168] S1315 The display processing module decodes the response data and sends the decoded video stream to the display module.

[0169] It should be noted that users can see the screen after the application performs a touch response through the display module.

[0170] The foregoing primarily describes the solutions provided by the embodiments of this disclosure from a methodological perspective. To achieve the aforementioned functions, it includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, in conjunction with the units and algorithm steps of the various examples described in the embodiments disclosed herein, the embodiments of this disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this disclosure.

[0171] This disclosure embodiment can divide a remote control device into functional modules based on the above method example. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. In some embodiments, the module division in this disclosure embodiment is illustrative and only represents a logical functional division; in actual implementation, there may be other division methods.

[0172] Figure 14 is a schematic diagram of a remote control device according to some embodiments. As shown in Figure 14, this disclosure provides a remote control device 1400, applied to a touch device, used to reduce the hardware / software configuration requirements of the front-end device and reduce the latency of the front-end device receiving the response when the front-end device remotely controls a virtual device, for example, for executing a remote control method shown in Figure 6. The remote control device 1400 includes: a processing unit 1401, a receiving unit 1402, a sending unit 1403, and a display unit 1404;

[0173] The processing unit 1401 is used to respond to a touch operation on the touch screen, send the operation position information of the touch operation to the server, the touch operation is an operation on a first object in the first interface displayed on the touch screen, the operation position information is used by the server to determine the second object corresponding to the touch operation in the second interface, execute the response of the second object, update the display content of the second interface, the display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object;

[0174] The receiving unit 1402 is used to receive the touch response from the server to the touch operation, and the touch response is used to update the display content of the first interface.

[0175] In one implementation, the operation location information is the touch point coordinates on the touch screen where the touch operation is performed. The touch point coordinates are used by the server to determine the pixel points that constitute the first object targeted by the touch operation.

[0176] In one implementation, the sending unit 1403 is used to send the resolution of the touch screen to the server in response to the power-on operation of the touch device; the resolution of the touch screen is used by the server to run a program version that matches the resolution of the touch screen when running the application, and different resolutions correspond to different program versions.

[0177] In one implementation, the receiving unit 1402 is further configured to receive the resolution of the second interface sent by the server; the processing unit 1401 is further configured to adjust the resolution of the touch screen to the resolution of the second interface if the resolution of the second interface is less than the resolution of the touch screen.

[0178] In one implementation, the receiving unit 1403 is further configured to receive the aspect ratio of the second interface sent by the server; the processing unit 1401 is further configured to determine the size of the first interface based on the size of the touch screen and the aspect ratio of the second interface, the size including length and width; and the display unit 1404 is configured to display the first interface on the touch screen based on the size of the first interface.

[0179] Figure 15 is a schematic diagram of a remote control device according to some embodiments. As shown in Figure 15, this disclosure provides a remote control device 1500 applied to a server, used to reduce the hardware / software configuration requirements of the front-end device and reduce the latency of the front-end device receiving the response when the front-end device remotely controls the virtual device, for example, for executing a remote control method shown in Figure 6. The remote control device 1500 includes: a receiving unit 1501, a processing unit 1502, and a sending unit 1503;

[0180] The receiving unit 1501 is used to receive operation position information sent by the touch device. The operation position information is the position information of the touch operation on the touch screen of the touch device, and the touch operation is the operation on the first object in the first interface displayed on the touch screen of the touch device.

[0181] The processing unit 1502 is used to determine the second object corresponding to the touch operation in the second interface based on the operation position information. The display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object.

[0182] The processing unit 1502 is also used to execute the response of the second object and update the display content of the second interface;

[0183] The sending unit 1503 is used to send a touch response to the touch operation to the touch device, and the touch response is used by the touch device to update the display content of the first interface.

[0184] In one implementation, the operation location information is the touch point coordinates on the touch screen where the touch operation is performed. The touch point coordinates are used by the server to determine the pixel points that constitute the first object targeted by the touch operation.

[0185] In one implementation, the receiving unit 1501 is further configured to receive the resolution of the touch screen sent by the touch device; the processing unit 1502 is further configured to, based on the resolution of the touch screen, run a program version that matches the resolution of the touch screen when running the application, with different resolutions corresponding to different program versions.

[0186] In one implementation, the sending unit 1503 is further configured to send the resolution of the second interface to the touch device, the resolution of the second interface being used by the touch device to adjust the resolution of the touch screen.

[0187] In one implementation, the sending unit 1503 is further configured to send the aspect ratio of the second interface to the touch device. The aspect ratio of the second interface is used by the touch device to determine the size of the first interface, and the size includes length and width.

[0188] In the case of implementing the functions of the integrated modules described above in hardware, this disclosure provides another structural schematic diagram of the electronic device (i.e., touch device or server) involved in the above embodiments. As shown in FIG16, an electronic device 1600 is used to reduce the hardware / software configuration requirements of the front-end device and reduce the latency of the front-end device receiving the response when the front-end device remotely controls the virtual device, for example, to execute a remote control method shown in FIG6. The electronic device 1600 includes a processor 1601, a memory 1602, and a bus 1603. The processor 1601 and the memory 1602 can be connected through the bus 1603.

[0189] Processor 1601 is the control center of the communication device. It can be a single processor or a collective term for multiple processing elements. For example, processor 1601 can be a general-purpose central processing unit (CPU) or other general-purpose processors. A general-purpose processor can be a microprocessor or any conventional processor.

[0190] As one embodiment, processor 1601 may include one or more CPUs, such as CPU 0 and CPU 1 shown in FIG16.

[0191] The memory 1602 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0192] In one implementation, the memory 1602 can exist independently of the processor 1601. The memory 1602 can be connected to the processor 1601 via a bus 1603 and is used to store instructions or program code. When the processor 1601 calls and executes the instructions or program code stored in the memory 1602, it can implement a remote control method provided in this embodiment of the present disclosure.

[0193] In another implementation, the memory 1602 can also be integrated with the processor 1601.

[0194] Bus 1603 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used in Figure 16, but this does not indicate that there is only one bus or one type of bus.

[0195] It should be noted that the structure shown in Figure 16 does not constitute a limitation on the electronic device 1600. In addition to the components shown in Figure 16, the electronic device 1600 may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0196] As an example, referring to Figure 14, the processing unit 1401, receiving unit 1402, sending unit 1403 and display unit 1404 in the remote control device 1400 perform the same functions as the processor 1601 in Figure 16.

[0197] As an example, referring to Figure 15, the receiving unit 1501, processing unit 1502 and transmitting unit 1503 in the remote control device 1500 perform the same functions as the processor 1601 in Figure 16.

[0198] In some embodiments, as shown in FIG16, the electronic device 1600 provided in this disclosure may further include a communication interface 1604.

[0199] Communication interface 1604 is used to connect with other devices via a communication network. This communication network can be Ethernet, a wireless access network, a wireless local area network (WLAN), etc. Communication interface 1604 may include a receiving unit for receiving data and a transmitting unit for transmitting data.

[0200] In one design, the communication interface in the electronic device provided in this embodiment of the present disclosure may also be integrated into the processor.

[0201] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, only the division of the above functional units is used as an example. In practical applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the device can be divided into different functional units to complete all or part of the functions described above. The detailed working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0202] This disclosure also provides a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium) storing instructions that, when executed by a computer, perform the various steps in the method flow shown in the above method embodiments.

[0203] Embodiments of this disclosure provide a computer program product containing instructions that, when executed on a computer, cause the computer to perform a remote control method as described in the above method embodiments.

[0204] Computer-readable storage media can be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More detailed examples of computer-readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), registers, hard disks, optical fibers, portable compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing, or any other form of computer-readable storage media in the art.

[0205] A storage medium is provided that is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Alternatively, the storage medium can also be a component of the processor. Both the processor and the storage medium can reside within an Application Specific Integrated Circuit (ASIC).

[0206] In this embodiment of the disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0207] Since the electronic devices, computer-readable storage media, and computer program products in the embodiments of this disclosure can be applied to the above methods, the technical effects they can achieve can also be referred to the above method embodiments. The embodiments of this disclosure will not be repeated here.

[0208] The above are merely specific embodiments of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any changes or substitutions within the technical scope disclosed in this disclosure should be covered within the scope of protection of this disclosure.

Claims

1. A remote control method, wherein, The method is performed by a touch device, the touch device including a touchscreen, and the method includes: In response to a touch operation on the touchscreen, the server sends operation location information of the touch operation to the server. The touch operation is an operation on a first object in a first interface displayed on the touchscreen. The operation location information is used by the server to determine a second object corresponding to the touch operation in a second interface, execute the response of the second object, and update the display content of the second interface. The display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object. The system receives a touch response from the server in response to the touch operation, and the touch response is used to update the display content of the first interface.

2. The method according to claim 1, wherein, The operation location information is the touch point coordinates of the touch operation on the touch screen, and the touch point coordinates are used by the server to determine the pixel point constituting the first object targeted by the touch operation.

3. The method according to claim 1, further comprising: In response to the power-on operation of the touch device, the resolution of the touch screen is sent to the server; The resolution of the touchscreen is used by the server to run a program version that matches the resolution of the touchscreen when running the application; different resolutions correspond to different program versions.

4. The method according to claim 3, further comprising: Receive the resolution of the second interface sent by the server; If the resolution of the second interface is lower than the resolution of the touch screen, the resolution of the touch screen is adjusted to the resolution of the second interface.

5. The method according to claim 3, further comprising: Receive the aspect ratio of the second interface sent by the server; Based on the size of the touch screen and the aspect ratio of the second interface, the size of the first interface is determined, and the size includes: length and width; The first interface is displayed on the touch screen based on its size.

6. A remote control method, wherein, The method is executed by the server, and the method includes: Receive operation location information sent by a touch device, wherein the operation location information is the location information of a touch operation on the touch screen of the touch device, and the touch operation is an operation on a first object in a first interface displayed on the touch screen of the touch device; Based on the operation location information, a second object corresponding to the touch operation in the second interface is determined. The display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object. Execute the response of the second object to update the displayed content of the second interface; A touch response to the touch operation is sent to the touch device, and the touch response is used by the touch device to update the display content of the first interface.

7. The method according to claim 6, wherein, The operation location information is the touch point coordinates of the touch operation on the touch screen, and the touch point coordinates are used by the server to determine the pixel point constituting the first object targeted by the touch operation.

8. The method according to claim 6, further comprising: Receive the resolution of the touch screen sent by the touch device; Based on the resolution of the touchscreen, when running an application, a version of the application that matches the resolution of the touchscreen is run; different resolutions correspond to different versions of the application.

9. The method according to claim 8, further comprising: The resolution of the second interface is sent to the touch device, and the resolution of the second interface is used by the touch device to adjust the resolution of the touch screen.

10. The method of claim 8, further comprising: The aspect ratio of the second interface is sent to the touch device. The aspect ratio of the second interface is used by the touch device to determine the size of the first interface. The size includes length and width.

11. A remote control device, wherein, The remote control device is applied to a touch device, the touch device including a touch screen, and the remote control device includes: a processing unit and a receiving unit; The processing unit is configured to respond to a touch operation on the touch screen by sending the operation location information of the touch operation to the server. The touch operation is an operation on a first object in a first interface displayed on the touch screen. The operation location information is used by the server to determine a second object corresponding to the touch operation in a second interface, execute the response of the second object, and update the display content of the second interface. The display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object. The receiving unit is used to receive the touch response from the server to the touch operation, and the touch response is used to update the display content of the first interface.

12. A remote control device, wherein, Applied to servers, the remote control device includes: a receiving unit, a processing unit, and a sending unit; The receiving unit is used to receive operation position information sent by the touch device. The operation position information is the position information of the touch operation on the touch screen of the touch device. The touch operation is an operation on a first object in the first interface displayed on the touch screen of the touch device. The processing unit is used to determine the second object corresponding to the touch operation in the second interface based on the operation position information. The display content of the first interface is synchronized with the display content of the second interface, and the second object corresponds to the first object. The processing unit is further configured to execute the response of the second object and update the display content of the second interface; The sending unit is used to send a touch response to the touch operation to the touch device, and the touch response is used by the touch device to update the display content of the first interface.

13. A touch device, comprising: A processor and a memory; wherein the memory is used to store one or more programs, the one or more programs including computer execution instructions, wherein when the touch device is running, the processor executes the computer execution instructions stored in the memory to cause the touch device to perform the method according to any one of claims 1-5.

14. A server, comprising: A processor and a memory; wherein the memory is used to store one or more programs, the one or more programs including computer-executable instructions, wherein when the server is running, the processor executes the computer-executable instructions stored in the memory to cause the server to perform the method according to any one of claims 6-10.

15. A remote control system, comprising: A touch device and a server, the touch device including a touch screen, the remote control system being used to perform the method according to any one of claims 1-5 or any one of claims 6-10.

16. A computer-readable storage medium storing one or more programs, wherein, The one or more programs include instructions that, when executed by a computer, cause the computer to perform the method according to any one of claims 1-5 or any one of claims 6-10.

17. A computer program product, wherein, When the computer program product is run on a computer, it causes the computer to perform the method according to any one of claims 1-5 or any one of claims 6-10.

Images