Control method, electronic equipment and storage medium

Abstract

The invention provides a control method which is applied to the technical field of remote control. The method comprises: in response to a selection operation of a user for a target device in a device list, obtaining at least one remote control type for the target device, the remote control type having corresponding remote control information, the remote control information is determined by the remote control platform in response to at least one remote control request for the target equipment from the control end according to an equipment identifier of the target equipment and a remote control type contained in the at least one remote control request; according to the respective remote control information of the at least one remote control type, executing a remote control process corresponding to the at least one remote control type; and in response to completion of execution of the remote control process, displaying respective control interfaces of the at least one remote control type, so that the user can remotely control the target equipment through the control interfaces. The invention further provides a control device, electronic equipment, a storage medium and a program product.

Description

Technical Field

[0001] The present disclosure relates to the field of remote control technology, and more particularly, to a control method, device, electronic device, storage medium, and program product. Background Art

[0002] Device remote control refers to remotely monitoring and controlling a device through the Internet or other network technologies. For example, an operator can remotely access and control a device through a device such as a computer, tablet, or mobile phone. In the example, remote control software can be installed on the master control device and the controlled device respectively. When the user uses it, they need to input the ID and password of the controlled device software into the remote control software of the master control device to establish a remote control connection and remotely control the controlled device. However, this method requires manual recording of the ID and password of the controlled device software, which is inconvenient to use; in addition, the ID and password of the controlled device software are prone to leakage, posing a relatively large security risk. Summary of the Invention

[0003] In view of this, the present disclosure provides a control method, device, electronic device, storage medium, and program product.

[0004] One aspect of the present disclosure provides a control method, including:

[0005] In response to a user's selection operation on a target device in a device list, obtaining at least one remote control type for the target device, where the remote control type has corresponding remote control information, and the remote control information is determined by a remote control platform in response to at least one remote control request from a control end for the target device according to the device identifier of the target device and the remote control type included in each of the at least one remote control request;

[0006] Executing remote control processes corresponding to each of the at least one remote control type according to the remote control information of each of the at least one remote control type; and

[0007] In response to the completion of the execution of the remote control process, presenting control interfaces for each of the at least one remote control type, so as to facilitate the user to remotely control the target device through the control interfaces.

[0008] Another aspect of the present disclosure provides a control method, including:

[0009] In response to at least one remote control request from a control end for a target device, determining remote control information corresponding to each of the at least one remote control type according to the device identifier of the target device and the remote control type included in each of the at least one remote control request;

[0010] Send at least one piece of remote control information corresponding to each remote control type to the control end, so that the control end can execute the remote control process corresponding to each remote control type according to the remote control information of each remote control type; and in response to the completion of the execution of the remote control process, display the control interface of each remote control type.

[0011] Another aspect of the present disclosure provides a control device, including:

[0012] A first acquisition module, configured to, in response to a user's selection operation on a target device in a device list, acquire at least one remote control type for the target device, where the remote control type has corresponding remote control information, and the remote control information is determined by the remote control platform in response to at least one remote control request from the control end for the target device according to the device identifier of the target device and the remote control type included in each of the at least one remote control request.

[0013] An execution module, configured to execute the remote control process corresponding to each remote control type according to the remote control information of each remote control type.

[0014] A display module, configured to, in response to the completion of the execution of the remote control process, display the control interface of each remote control type, so that the user can remotely control the target device through the control interface.

[0015] Another aspect of the present disclosure provides a control device, including:

[0016] A determination module, configured to, in response to at least one remote control request from the control end for the target device, determine the remote control information corresponding to each remote control type according to the device identifier of the target device and the remote control type included in each of the at least one remote control request.

[0017] A first sending module, configured to send the remote control information corresponding to each remote control type to the control end, so that the control end can execute the remote control process corresponding to each remote control type according to the remote control information of each remote control type; and in response to the completion of the execution of the remote control process, display the control interface of each remote control type.

[0018] Another aspect of the present disclosure provides an electronic device, including:

[0019] One or more processors;

[0020] A memory, configured to store one or more programs,

[0021] Wherein, when one or more programs are executed by one or more processors, the one or more processors implement the above-mentioned method.

[0022] Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions that are used to implement the above-mentioned method when executed.

[0023] Another aspect of the present disclosure provides a computer program product, which includes computer-executable instructions that are used to implement the above-mentioned method when executed.

[0024] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Through the following description of the embodiments of the present disclosure with reference to the drawings, the above and other objects, features, and advantages of the present disclosure will become clearer. In the drawings:

[0026] Figure 1 A schematic diagram of a remote control architecture in one related example is shown;

[0027] Figure 2A An exemplary system architecture diagram to which the control method can be applied according to an embodiment of the present disclosure is shown;

[0028] Figure 2B An exemplary architecture diagram of an IoT platform is shown;

[0029] Figure 3 A flowchart of the control method according to an embodiment of the present disclosure is shown;

[0030] Figure 4 A schematic diagram of the control interface according to an embodiment of the present disclosure is shown;

[0031] Figure 5 A schematic diagram of the control process according to an embodiment of the present disclosure is shown;

[0032] Figure 6 A flowchart of the target device establishing a connection with the target server according to an embodiment of the present disclosure is shown;

[0033] Figure 7 A flowchart of the control terminal establishing a connection with the target server according to an embodiment of the present disclosure is shown;

[0034] Figure 8 A remote control flowchart for remote desktop control according to an embodiment of the present disclosure is shown;

[0035] Figure 9 Shows a flowchart of a configuration model according to an embodiment of the present disclosure;

[0036] Figure 10 Shows a schematic diagram of a remote control process for performing remote control of a remote control according to an embodiment of the present disclosure;

[0037] Figure 11 Shows a flowchart of a method for updating attribute values according to an embodiment of the present disclosure;

[0038] Figure 12 Shows a flowchart of presenting a visual centralized control button in an embodiment of the present disclosure;

[0039] Figure 13 Shows a flowchart of a control method according to another embodiment of the present disclosure.

[0040] Figure 14 Shows a block diagram of a control device according to an embodiment of the present disclosure;

[0041] Figure 15 Shows a block diagram of a control device according to another embodiment of the present disclosure; and

[0042] Figure 16 Shows a block diagram of an electronic device suitable for implementing the method described above according to an embodiment of the present disclosure. Detailed implementation manners

[0043] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are merely exemplary and are not intended to limit the scope of the present disclosure. In the following detailed description, for the sake of explanation, many specific details are set forth to provide a thorough understanding of the embodiments of the present disclosure. However, it is obvious that one or more embodiments can also be implemented without these specific details. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessarily obscuring the concepts of the present disclosure.

[0044] The terms used herein are merely for describing specific embodiments and are not intended to limit the present disclosure. The terms "including", "comprising", etc. used herein indicate the presence of the described features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0045] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0046] In the case of using expressions such as "at least one of A, B, and C", generally, it should be interpreted according to the meaning that those skilled in the art usually understand this expression (for example, "a system having at least one of A, B, and C" should include but not be limited to a system having only A, only B, only C, having A and B, having A and C, having B and C, and / or having A, B, and C, etc.).

[0047] In the embodiments of the present disclosure, in aspects such as the collection, update, analysis, processing, use, transmission, provision, disclosure, storage, etc. of the involved data (for example, including but not limited to user personal information), they all comply with the provisions of relevant laws and regulations, are used for legal purposes, and do not violate public order and good customs. In particular, necessary measures are taken for user personal information to prevent illegal access to user personal information data and to safeguard user personal information security and network security.

[0048] In the embodiments of the present disclosure, before obtaining or collecting user personal information, the authorization or consent of the user is obtained.

[0049] Device remote control refers to remotely monitoring and controlling a device through the Internet or other network technologies. For example, an operator can remotely access and control through devices such as a computer, a tablet, or a mobile phone.

[0050] Figure 1 A schematic diagram of a remote control architecture in one of the related examples is shown.

[0051] As Figure 1 shown, the remote control architecture diagram in the example includes a controlled end 110, a platform server end 120, and a main control end 130. Among them, the controlled end 110 is installed with remote desktop software 111, the main control end is installed with remote desktop software 131, and the platform end service 120 is provided with a remote desktop server 121, and the remote desktop server 121 is used to provide remote desktop services.

[0052] When a user needs to perform remote control, first, the controlled end 110 needs to start the remote desktop software 111 and establish a connection with the remote desktop server 121 using the ID and density of the remote desktop software 111; then, the user manually enters the ID and density of the remote desktop software 111 on the remote desktop software 131 of the main control end 130 to establish a connection with the remote desktop server 121. After the connection is successful, the interface of the controlled end 110 is displayed on the main control end 130, so that the user can remotely control the controlled end 110 through the displayed interface.

[0053] However, Figure 1The remote control architecture shown has only the single function of remote desktop and a single channel. Both the master control end and the controlled end need to install remote desktop software separately. When users use the remote desktop function, they need to manually record information such as the ID and password of the controlled end, which is inconvenient to use. In addition, the ID and password of the controlled end software are easily leaked, posing a relatively high security risk.

[0054] Based on the above technical problems, embodiments of the present disclosure provide a control method. By maintaining the device's physical model on the Internet of Things platform, when a user needs to remotely control a device, the user selects a target device from the device list displayed on the master control end, thereby obtaining the remote control information of the target device. Then, the remote control process is automatically executed according to the remote control information, and the control interface of the target device is displayed on the master control end. The entire process does not require manual recording of the ID and password of the target device, improving the convenience of user use. At the same time, the ID and password are not displayed on any visible page and are not easily leaked, with a relatively high security factor.

[0055] The Internet of Things (IoT) refers to connecting objects to the network through information sensing devices according to agreed protocols. The objects exchange and communicate information through information dissemination media to achieve functions such as intelligent identification, positioning, tracking, and supervision. An IoT platform is a software service or solution designed to connect and manage IoT devices, sensors, and data, providing rich functions and services so that developers can build, deploy, and manage IoT applications.

[0056] The above sensors can be sensors such as temperature sensors, motion sensors, humidity sensors, air quality sensors, or light sensors. Multiple sensors are connected together, allowing people to automatically collect information from the environment to assist people in making decisions regarding the environment.

[0057] Figure 2A An exemplary system architecture diagram to which the control method according to an embodiment of the present disclosure can be applied is shown.

[0058] Figure 2B An exemplary architecture diagram of the IoT platform is shown.

[0059] It should be noted that Figure 2A What is shown is only an example of the system architecture to which embodiments of the present disclosure can be applied, to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that embodiments of the present disclosure cannot be used in other devices, systems, environments, or scenarios.

[0060] Such as Figure 2AAs shown, the system architecture 200 according to this embodiment may include a master device 210, a controlled device 220, a platform-side service 230, and a network 240. The network 240 is used to provide a medium for communication links among the master device 210, the controlled device 220, and the platform-side service 230. The network 240 may include various connection types, such as wired and / or wireless communication links, etc.

[0061] The master device 210 is used to enable a user to perform remote control operations on this device to remotely control the controlled device 220.

[0062] The platform-side service 230 may include an Internet of Things (IoT) platform service 231, a remote desktop server 232, a remote command server 233, and a message middleware 234. As Figure 2B shown, the IoT platform 231 includes device management, IoT WEB, visual centralized control, remote desktop, remote command, remote control, device model, database, device model control configuration, visual centralized control WEB, RemoteDesk Web. A user can maintain the controlled device 220 through device management. When the user needs to remotely control the controlled device 220, the user can log in to the IoT web on the master device 210 to display a device list in the IoT web. The user selects a target device in the device list to remotely control the target device.

[0063] The remote desktop server 232 is used to provide remote desktop services. When the control method of remote desktop is deployed on the target device selected by the user, after establishing connections between both the master device 210 and the controlled device 220 and the remote desktop server 232, the desktop of the controlled device 220 can be displayed on the master device 210.

[0064] The remote command server 233 is used to provide remote command services. When the control method of remote command is deployed on the target device selected by the user, after establishing connections between both the master device 210 and the controlled device 220 and the remote command server 233, a command control interface for controlling the controlled device 220 can be displayed on the master device 210.

[0065] The controlled device 220 may include different types of devices. For example, the controlled device 220 may include office equipment 221, information dissemination equipment 222, mobile devices 223, etc.

[0066] It should be noted that the control method provided by the embodiments of the present disclosure can generally be executed by the master device 210. Or it can also be executed by other terminal devices different from the master device 210. Correspondingly, the control device provided by the embodiments of the present disclosure can also be set in the master device 210 or in other terminal devices different from the master device 210.

[0067] It should be understood that Figure 2A the numbers of the master device, server, controlled device, and network in Figure 2A are merely illustrative. According to the implementation requirements, there can be any number of master devices, servers, controlled devices, and networks.

[0068] Figure 3 The flowchart of the control method according to an embodiment of the present disclosure is shown.

[0069] As Figure 3 shown, the control method 300 of this embodiment can be executed by the control end. The method includes operations S310 to S330.

[0070] In operation S310, in response to the user's selection operation for the target device in the device list, at least one remote control type for the target device is obtained.

[0071] The remote control type has corresponding remote control information, and the remote control information is determined by the remote control platform in response to at least one remote control request from the control end for the target device according to the device identifier of the target device and the remote control type included in each of the at least one remote control request.

[0072] The remote control platform can be an Internet of Things platform (IoT platform). The user can maintain the information of the controlled device on the IoT platform. When the user needs to remotely control the controlled device, the user can log in to the web of the IoT platform at the control end, select the target device in the device list displayed on the web interface of the IoT platform, and execute the remote control process for the target device.

[0073] The remote control type can include at least one of the following: remote desktop control, remote command control, and remote control component control.

[0074] Different remote control types are independent running programs and are deployed in a pluggable component manner on the target device. The user can flexibly configure the remote control type of the target device according to the needs. For example, remote desktop control and remote command control can be deployed for the target device. Another example is that remote desktop control and remote control component control can be deployed for the target device. Another example is that remote desktop control, remote command control, and remote control component control can be deployed for the target device.

[0075] In operation S320, according to the remote control information of each of the at least one remote control type, the remote control process corresponding to each of the at least one remote control type is executed.

[0076] Different types of remote control correspond to different remote control information and remote control processes. For example, if the remote control type is remote desktop control, the remote control information corresponding to remote desktop control is used to execute the remote control process corresponding to remote desktop control. Another example is that if the remote control type is remote command control, the remote control information corresponding to remote command control is used to execute the remote control process corresponding to remote command control. Another example is that if the remote control type is remote control widget control, the remote control information corresponding to remote control widget control is used to execute the remote control process corresponding to remote control widget control.

[0077] In operation S330, in response to the completion of the execution of the remote control process, at least one control interface for each remote control type is displayed to facilitate the user to remotely control the target device through the control interface.

[0078] After the execution of the remote control process is completed, the interface of the control end jumps from the web interface of the Internet of Things platform to the control interface for the target device.

[0079] The control interface may include at least one of the following: a control interface for remote desktop, a control interface for remote commands, and a control interface for remote controls.

[0080] Figure 4 A schematic diagram of the control interface according to an embodiment of the present disclosure is shown.

[0081] As Figure 4 shown, the control interface 400 displayed on the control end may include a remote desktop interface 410 for remote desktop located in the upper left area, and this interface can control the target device through the operations of a mouse and a keyboard; a remote command interface 420 for remote commands located in the lower area, and this interface can control the target device through adb command operations; a remote control widget interface 430 for remote control widgets located in the right area. The remote control widget interface 430 may include multiple control widgets, such as a power-on widget, a power-off widget, a screen-off widget, a screen-on widget, a volume widget, a brightness widget, etc., and this interface controls the target device through the control widgets.

[0082] After the user selects the target device at the control end, a control request is sent to the remote control platform, so that the remote control platform feeds back the remote control information for the target device, and then the remote control process is automatically executed based on the remote control information, realizing the remote control of the target device. The entire process does not require manual recording of the login ID and password, is imperceptible to the user, and improves the usage convenience; in addition, the ID and password are not displayed on any visible page, and the security factor is relatively high.

[0083] Different remote control types are independent running programs, deployed as pluggable components on the target device, not mutually dependent on the target device, interacting in a non-intrusive manner. If the device requires remote desktop control and remote command control functions, the remote desktop control file and the remote command control file are deployed. If not, there is no need to deploy the remote desktop control file and the remote command control file, without affecting the normal functions.

[0084] Figure 5 The figure shows a schematic diagram of the control flow according to an embodiment of the present disclosure.

[0085] As Figure 5 shown, the remote control method 500 of this embodiment first requires the user 510 to select the target device 520 in the device list. Then, at least one remote control type of the target device 520 is obtained; for example, the remote control types include remote desktop control 530, remote command control 540, and remote control component control 550. Among them, the remote desktop control 530 has corresponding remote control information 531, the remote command control 540 has corresponding remote control information 541, and the remote control component control 550 has corresponding remote control information 551. Then, according to the remote control information of each of the at least one remote control type, the remote control process corresponding to each of the at least one remote control type is executed; for example, for the remote desktop control 530, the remote control process 532 corresponding to the remote desktop control 530 is executed using the remote control information 531, and after the execution is completed, the remote desktop interface 533 is displayed on the control end, such as Figure 4 the remote desktop interface 410 shown; for the remote command control 540, the remote control process 542 corresponding to the remote command control 540 is executed using the remote control information 541, and after the execution is completed, the remote command interface 543 is displayed on the control end, such as Figure 4 the remote command interface 420 shown; for the remote control component control 550, the remote control process 552 corresponding to the remote control component control 550 is executed using the remote control information 551, and after the execution is completed, the remote control component interface 553 is displayed on the control end, such as Figure 4 the remote control component interface 430 shown.

[0086] According to an embodiment of the present disclosure, in the case where the remote control type is remote desktop control or remote command control, the remote control information includes the target server information and login information for the remote control type. In this case, the remote control information can be determined by the following operations: obtaining the target server information for the remote control type; determining the login information for the target device according to the device identifier, where the login information includes the device identifier and the login password for the target device.

[0087] In the case where the remote control type is remote desktop control, obtaining the target server information for the remote control type may include obtaining the target server information for remote desktop control, such as the information of the remote desktop server.

[0088] In the case where the remote control type is remote command control, obtaining the target server information for the remote control type may include obtaining the target server information for remote command control, such as the information of the remote command server.

[0089] The target server information may include the IP information and port information of the target server. For example, the IP information and port information of the remote desktop server; the IP information and port information of the remote command server.

[0090] The login password can be pre-configured and stored in the remote control platform, or randomly generated when establishing a remote control connection.

[0091] For example, according to the preset password generation rule, a login password for the target device can be randomly generated; the login information is determined according to the login password and the device identifier.

[0092] The password generation rule can be set according to actual needs. For example, the password generation rule can include whether to include uppercase and lowercase letters, whether to include special symbols, etc.

[0093] The device identifier can be the unique identifier of the target device. For example, the device identifier can be the device MAC (Medium / Media Access Control).

[0094] Taking the device identifier of the target device as the controlled end ID enables the remote control platform not to record the controlled end ID, saving the query process, being convenient and fast. In addition, the password is randomly generated, and a new random password will be generated each time the Trojan control software is started, without the need for the platform to store it, which is safe and convenient.

[0095] After the remote control platform determines the remote control information, the remote control platform sends a remote control start command including the target server information and the login information to the target device, so that the target device establishes a connection with the target server according to the target server information and sends the login information to the target server, so that the target server can verify the control end according to the login information.

[0096] Figure 6 Shows a flowchart of establishing a connection between the target device and the target server according to an embodiment of the present disclosure.

[0097] Before executing the control method of the present disclosure embodiment, DMA software can be installed on the target device, and a remote desktop control component and a remote command control component can be deployed. DMA (IoT Device Management Agents) is a set of local processes running on the terminal, providing functions such as device access, two-way communication, device management, and remote upgrade.

[0098] As Figure 6 shown, the process for the target device of this embodiment to establish a connection with the target server includes operations S601 to S617.

[0099] In operation S601, the target device receives a remote control start command sent by the IoT platform.

[0100] In operation S602, the remote control start command is parsed to obtain the target server information and login information. The target server information may include the IP and port of the target server, and the login information may include the device MAC and password of the target device.

[0101] In operation S603, it is determined whether the remote control type is remote desktop control or remote command control according to the target server information. In the case where the remote control type is remote desktop control, operations S604 to S610 are executed; in the case where the remote control type is remote desktop control, operations S611 to S617 are executed.

[0102] In operation S604, a remote desktop start command is assembled according to the target server information and login information.

[0103] In operation S605, the remote desktop start command is sent to the remote desktop server.

[0104] In operation S606, the remote desktop server receives the remote desktop start command and executes operations S607 to S610.

[0105] In operation S607, the remote desktop command is parsed to obtain the target server information and login information.

[0106] In operation S608, the ID and password of the target device are set according to the login information.

[0107] In operation S609, a connection is established with the remote desktop server according to the target server information.

[0108] In operation S610, wait for the master control end to perform remote desktop using the login information.

[0109] In operation S611, a remote terminal start command is assembled according to the target server information and login information.

[0110] In operation S612, a start remote terminal command is sent to the remote command server.

[0111] In operation S613, the remote command server receives the start remote terminal command and executes operations S614 to S617.

[0112] In operation S614, the remote terminal command is parsed to obtain the target server information and login information.

[0113] In operation S615, the ID and password of the target device are set according to the login information.

[0114] In operation S616, a remote command service listening is started according to the target server information.

[0115] In operation S617, wait for the master control end to use the login for the remote terminal.

[0116] According to an embodiment of the present disclosure, after the target device establishes a connection with the remote desktop server, it may further include: periodically determining whether there is a remote desktop control connection. In the case of having a remote desktop control connection, determining whether there is an instruction issued within the first time period for the remote desktop connection. If there is no instruction issued, then end the local remote desktop. If there is an instruction issued, then maintain the local remote desktop. In the case of having no remote desktop control connection, then determining whether the connectionless time exceeds the second time period. If it exceeds the second time period, then end the local remote desktop. If it does not exceed the second time period, then maintain the local remote desktop.

[0117] According to an embodiment of the present disclosure, after the target device establishes a connection with the remote command server, it may further include: periodically determining whether there is a remote command control connection. In the case of having a remote command control connection, determining whether there is an instruction issued within the first time period for the remote command connection. If there is no instruction issued, then end the local remote command. If there is an instruction issued, then maintain the local remote command. In the case of having no remote command control connection, then determining whether the connectionless time exceeds the second time period. If it exceeds the second time period, then end the local remote command. If it does not exceed the second time period, then maintain the local remote command.

[0118] The first time period and the second time period can be configured according to the actual situation. For example, the first time period can be 10 minutes and the second time period can be 5 minutes.

[0119] After the remote control platform determines the remote control information, the remote control platform also sends the remote control information to the control end so that the remote control end executes the remote control process according to the remote control information.

[0120] For example, in the case where the remote control type is remote desktop control or remote command control, the remote control information includes target server information and login information for the remote control type. Executing the remote control process corresponding to each of at least one remote control type includes: logging in to the target server according to the target server information, and sending the login information to the target server so that the target server verifies the login information according to the verification information sent by the target device; in response to successful verification, establishing a remote service connection between the control end and the target server.

[0121] Figure 7 Shows a flowchart of establishing a connection between the control end and the target server according to an embodiment of the present disclosure.

[0122] Before the control end establishes a connection with the target server, the target device has logged in to the server and established a connection with the target server waiting for a remote control connection, that is, the target device and the target server have executed Figure 6 the operations shown; then, the control end establishes a connection with the target server.

[0123] As Figure 7 shown, the process of establishing a connection between the control end and the target server includes operations S701 to S713.

[0124] According to an embodiment of the present disclosure, before performing the operation of establishing a connection between the control end and the target server, the controlled end first performs operation S714, logs in to the remote desktop server, and waits for a remote desktop connection. Then operations S701 to S713 are performed.

[0125] In operation S701, the control end receives the remote control information sent by the IoT platform, and obtains the target server information and the login information.

[0126] In operation S702, the Websocket message is assembled using the target server information and the control end ID.

[0127] In operation S703, a login request is sent to the remote desktop server according to the Websocket message.

[0128] In operation S704, the remote desktop server receives the login request.

[0129] In operation S705, the control end ID in the login request is parsed and recorded.

[0130] In operation S706, a login success message is fed back to the control end.

[0131] In operation S707, the control end receives the login success message.

[0132] In operation S708, a remote desktop request is initiated using the login information.

[0133] In operation S709, the remote desktop server receives a remote desktop request.

[0134] In operation S710, the remote desktop request is parsed to obtain login information.

[0135] In operation S711, the login information sent by the controlled end is used to verify the login information sent by the controlling end.

[0136] In operation S712, after the verification passes, a remote desktop connection is established between the controlling end and the remote desktop server.

[0137] In operation S713, the remote desktop interface is displayed on the controlling end to facilitate remote desktop via the remote desktop interface.

[0138] Figure 8 The remote control flowchart for remote desktop control according to an embodiment of the present disclosure is shown.

[0139] As Figure 8 shown, the user 830 can log in to the IoT Web on the controlling end, select the target device 840 from the device list displayed on the IoT Web interface, and then execute the remote control process for remote desktop control as Figure 8 shown, and this process may include operations S801 to S820.

[0140] In operation S801, the controlling end obtains the device Mac of the target device.

[0141] In operation S802, a request to start remote desktop control is initiated to the IoT platform server using the device Mac.

[0142] In operation S803, the IoT platform server receives the remote desktop control request.

[0143] In operation S804, the IP and port of the remote desktop server are queried.

[0144] In operation S805, a password is randomly generated using a random function.

[0145] In operation S806, an MQTT message for starting the remote desktop is assembled based on the remote desktop server IP, port, device Mac, and password.

[0146] In operation S807, an MQTT message for starting the remote desktop is sent to the message middleware.

[0147] In operation S808, the message middleware receives the remote desktop start message and forwards it to the subscriber.

[0148] In operation S809, the target device subscribes to receive messages.

[0149] In operation S810, start the remote desktop.

[0150] In operation S811, feedback a startup success message to the message middleware.

[0151] In operation S812, the message middleware receives the startup success message and forwards it to the subscribers.

[0152] In operation S813, the IoT platform server receives the startup success message.

[0153] In operation S814, feedback the remote desktop server IP, port, target device Mac, and password to the control end.

[0154] In operation S815, the control end receives the remote desktop server IP, port, target device Mac, and password.

[0155] In operation S816, assemble a request to connect to the remote desktop based on the remote desktop server IP, port, target device Mac, and password.

[0156] In operation S817, initiate a request to connect to the remote desktop to the remote desktop server.

[0157] In operation S818, receive the request to connect to the remote desktop.

[0158] In operation S819, perform the remote desktop according to the information in the request to connect to the remote desktop.

[0159] In operation S820, display the remote desktop interface on the control end.

[0160] It should be noted that the remote control process for remote commands is similar to the Figure 8 process shown, except that the target server in the remote control process for remote commands is the remote command server.

[0161] Before executing the control method of the present disclosure, it is necessary to configure the device model for the target device. Among them, the device model of the target device is determined by the following operations: in response to a request to create a device model for the target device, display the control information of at least one attribute control; in response to the user selecting a target attribute control from at least one attribute control, generate a device model for the target device according to the control information of the target attribute control.

[0162] The determination of the device model of the target device is configured through the Internet of Things platform (remote control platform).

[0163] According to an embodiment of the present disclosure, when the displayed property control does not include the required control, a property control can be created. Specifically, it may include: in response to a property control creation request for a target device, displaying a property control creation interface; generating a supplementary property control according to the control information input by the user on the property control creation interface; and then generating a physical model for the target device according to the control information of the target property control and the spatial information of the supplementary property control.

[0164] Figure 9 The flowchart of configuring a physical model according to an embodiment of the present disclosure is shown.

[0165] As Figure 9 shown, the method for configuring a physical model in this embodiment includes operation S901 to operation S911.

[0166] In operation S901, the user logs in to the IoT platform WEB.

[0167] In operation S902, the physical model control configuration page is displayed on the IoT platform WEB.

[0168] In operation S903, the user configures the basic information of the target device on the physical model control configuration page and initiates a physical model creation request for the target device.

[0169] In operation S904, the IoT platform server receives the physical model creation request.

[0170] In operation S905, query the control information of multiple property controls from the database.

[0171] In operation S906, return the property control query result to the IoT platform WEB.

[0172] In operation S907, the IoT platform WEB receives the property control query result.

[0173] In operation S908, display the control information of each property control.

[0174] In operation S909, the user selects a target property control from multiple property controls as the property control for the target device.

[0175] In operation S910, according to the control information of the target property control, initiate a save request for configuring the property control of the target device.

[0176] In operation S911, the IoT platform server receives the save request for configuring the property control, and saves the configuration of the property control of the target device to the database.

[0177] According to an embodiment of the present disclosure, in the case where the remote control type is remote control by a remote control, the remote control information includes the physical model of the target device, where the physical model includes at least one attribute of the target device, the control configuration information of each attribute, and the attribute value. In this case, the remote control information can be determined by the following operations: in response to a physical model query request for the target device, determine the physical model of the target device, where the physical model includes at least one attribute; in response to a control query request for at least one attribute, determine the control configuration information of each of the at least one attribute; in response to an attribute value query request for at least one attribute, determine the attribute value of each of the at least one attribute.

[0178] In some of these embodiments, the physical model may include the following attributes: power on, power off, screen off, screen on, volume, brightness, etc. The control configuration information of an attribute characterizes the display style of the attribute, and the attribute control may include a read-only attribute text field, a text box, a slider, a slide switch, a radio button, a drop-down list, a text area, etc. Each attribute control may have its own control identifier. For example, the control identifier of the attribute control text box may be 001.

[0179] For example Figure 4 As shown, power on, power off, screen off, and screen on are displayed as squares, and the display styles of volume and brightness are sliders. The attribute value of an attribute is the current value of the target device for each attribute. For example, for the attribute volume, if the current volume of the target device is 40, then the attribute value of volume is 40; again, for brightness, if the current brightness of the target device is 40, then the attribute value of brightness is 40.

[0180] According to an embodiment of the present disclosure, in the case where the remote control type is remote control by a remote control, performing a remote control process corresponding to each of at least one remote control type includes: for each of the at least one attribute, generating an attribute control for the attribute according to the control configuration information of the attribute; using the attribute control to display the attribute value, and displaying a remote control interface as shown Figure 4 in the control end.

[0181] Figure 10 FIG. shows a schematic diagram of a remote control process for performing remote control by a remote control according to an embodiment of the present disclosure.

[0182] As Figure 10 shown, user 1010 can log in to IoT Web at the control end, select the target device 1020 from the device list displayed on the IoT Web interface, and then perform a remote control process for remote control by a remote control as shown Figure 10 in which the process may include operation S1030 to operation S1043.

[0183] In operation S1030, the control end obtains the device Mac of the target device.

[0184] In operation S1031, a thing model query request is initiated according to the device Mac.

[0185] In operation S1032, the IoT platform server receives the thing model query request and queries the thing model for the target device.

[0186] In operation S1033, the thing model query result is returned.

[0187] In operation S1034, the control end receives the thing model query result.

[0188] In operation S1035, an attribute control query request for the attribute is initiated according to the thing model query result.

[0189] In operation S1036, the IoT platform server receives the attribute control query request and queries the configuration information of the attribute control.

[0190] In operation S1037, the attribute control query result is returned.

[0191] In operation S1038, the control end receives the attribute control query result.

[0192] In operation S1039, an attribute value query request for the attribute is initiated according to the attribute control query result.

[0193] In operation S1040, the IoT platform server receives the attribute value query request and queries the attribute value of the attribute.

[0194] In operation S1041, the attribute value query result is returned.

[0195] In operation S1042, the control end receives the attribute value query result.

[0196] In operation S1043, the corresponding attribute value is displayed using the attribute control of each attribute to obtain the remote control interface.

[0197] According to an embodiment of the present disclosure, the target device collects the current attribute value of each attribute at a second time interval and sends it to the remote control platform end so that the remote control platform end can update the attribute value in the database in real time.

[0198] According to an embodiment of the present disclosure, the above method further includes: the control end obtains the current attribute value of at least one attribute respectively at a first time interval; in response to the change of the current attribute value of the target attribute among the at least one attribute, the attribute value displayed by the attribute control of the target attribute is updated using the current attribute value.

[0199] The first time interval and the second time interval can be set according to actual needs, and the present disclosure does not limit this.

[0200] Figure 11 The flowchart of the attribute value update method according to an embodiment of the present disclosure is shown.

[0201] As Figure 11 shown, the attribute value update method of this embodiment includes operations S1101 to S1109.

[0202] In operation S1101, the target device collects the current attribute values of each attribute at a second time interval.

[0203] In operation S1102, a reported attribute message is sent according to the current attribute values.

[0204] In operation S1103, the IoT platform receives the reported attribute message.

[0205] In operation S1104, the attribute values recorded in the database are updated

[0206] In operation S1105, the control terminal sends an attribute value query request at a first time interval.

[0207] In operation S1106, the IoT platform receives the attribute value query request and queries the current attribute values from the database.

[0208] In operation S1107, an attribute value query result is returned.

[0209] In operation S1108, the control terminal receives the attribute value query result.

[0210] In operation S1109, the attribute values displayed by the attribute control are updated according to the current attribute values in the attribute value query result.

[0211] By updating the attribute values of the attribute control in real time, the remote interface can accurately display the latest status of the target device.

[0212] According to an embodiment of the present disclosure, the device list includes a visual button for the target device; the selection operation for the target device in the device list includes: clicking the visual button for the target device.

[0213] The visual button for the target device needs the target device to send a visual control request to the remote control platform, so that the remote control platform generates a visual button for the target device according to the visual type included in the visual control request. Among them, the visual control request is generated by the target device scanning local files at a third time interval and in response to the local files containing preset files according to the visual type of the preset files.

[0214] Figure 12 The flowchart showing the visual centralized control button in an embodiment of the present disclosure is shown.

[0215] As Figure 12 shown, the method for displaying the visual centralized control button in this embodiment includes operations S1201 to operation 1211.

[0216] In operation S1201, the target device establishes a connection with the IoT platform.

[0217] In operation S1202, the local directory is scanned periodically. When there is a remote desktop control file in the local directory, operation S1203 is executed; when there is a remote command control file in the local directory, operation S1204 is executed.

[0218] In operation S1203, an mqtt message supporting remote desktop is reported, and then operation S1205 is executed.

[0219] In operation S1204, an mqtt message supporting remote commands is reported, and then operation S1205 is executed.

[0220] In operation S1205, the IoT platform receives the mqtt message.

[0221] In operation S1206, the mqtt message supporting remote desktop is parsed to obtain a parsing result.

[0222] In operation S1207, the mqtt message supporting remote commands is parsed to obtain a parsing result.

[0223] In operation S1208, the parsing results obtained from operations S1206 and S1207 are analyzed and processed.

[0224] In operation S1209, it is determined whether at least one message supporting the visual centralized control button is received. If not, operation S1210 is executed; if so, operation S1211 is executed.

[0225] In operation S1210, the visual centralized control button is not displayed in the device list.

[0226] In operation S1211, the visual centralized control button is displayed in the device list.

[0227] Figure 13 The flowchart of the control method according to another embodiment of the present disclosure is shown.

[0228] As Figure 13 shown, the control method 1300 in this embodiment can be executed by a remote control platform. The method includes operations S1310 to operation S1320.

[0229] In operation S1310, in response to at least one remote control request from a control end for a target device, according to the device identifier of the target device and the remote control types respectively included in the at least one remote control request, determine the remote control information corresponding to each of the at least one remote control type.

[0230] In operation S1320, send the remote control information corresponding to each of the at least one remote control type to the control end, so that the control end can execute the remote control processes corresponding to each of the at least one remote control type according to the remote control information corresponding to each of the at least one remote control type; and in response to the completion of the execution of the remote control process, display the control interfaces corresponding to each of the at least one remote control type.

[0231] According to the control method provided by the present disclosure, by combining with an Internet of Things platform, a 3-channel integration of remote desktop control, remote command control, and remote control component control is achieved, and operations can be performed simultaneously on the same interface. The combination of the remote desktop and the remote command enables the remote command to obtain intuitive feedback from the remote desktop in real time, realizing what you see is what you get.

[0232] In addition, the controlled end uses DMA without the need to install additional software separately, and the master control end uses IoT Web without the need to install software separately, which is convenient and fast.

[0233] Furthermore, the device list is maintained and displayed in the IoT platform. Users do not need to manually record the device list. When using it, they only need to select the device in IoT Web. And the device physical model attributes are in the form of visual UI controls, which are beautiful and easy to understand, realizing what you see is what you get, and are more user-friendly.

[0234] The interfaces involved in the control method of the embodiments of the present disclosure will be described in detail below.

[0235] The interfaces involved in the control method of the embodiments of the present disclosure may include: a visual centralized control query interface, a visual centralized control update interface, a device remote operation and maintenance capability query interface, a remote agent startup interface, a physical model service information query interface, a service execution interface, an attribute and corresponding control query interface, a device attribute value query interface, an execution attribute setting interface, a device attribute value acquisition interface, and a group list refresh interface.

[0236] The visual centralized control query interface is used to query the visual controls of devices. The request parameters corresponding to the visual centralized control query interface may include device type or device number; the returned data may include the following fields: status code, response data, total number (such as the total number of list data), list, unique index (such as the id in the database), attribute identifier, attribute name, available control list for this attribute (such as 000,001,005 separated by commas ","), attribute type, attribute read / write mode, control identifier, control name, whether the attribute is displayed, specification, minimum value, maximum value, step size, error message, response status. Among them, the data type is the data type of the attribute in the physical model editing interface, such as int, float, string, etc.; the specification can be the content information set for the control.

[0237] The visual centralized control update interface is used to update the visual control information. The request parameters corresponding to the visual centralized control update interface may include device type number, attribute identifier, attribute name, attribute type, attribute read / write mode, control identifier, control name, available control list for this attribute, whether the attribute is displayed, specification, minimum value, maximum value, step size. The returned data may include the following fields: status code, response data, attribute type number, attribute identifier, attribute name, attribute type, attribute read / write mode, control identifier, control name, available control list for this attribute, whether the attribute is displayed, specification, minimum value, maximum value, step size, response status.

[0238] The device remote operation and maintenance capability query interface is used to query whether there is remote desktop capability and remote command capability. The request parameters corresponding to the device remote operation and maintenance capability query interface may include the device number. The returned data may include status code, response data, error message, response status.

[0239] The remote agent startup interface is used to start the remote agent, such as the DMA software deployed on the device. The request parameters corresponding to the remote agent startup interface may include the device number, remote control type information (such as remote desktop or remote command), wait, timeout. The returned data structure may include status code, response data, error message, response status.

[0240] The physical model service information query interface is used to query the attribute controls included in the physical model. The request parameters corresponding to the physical model service information query interface may include the device number. The returned data structure may include status code, response data, total number of list data, list, unique index (such as the id in the database), available control list for this attribute, specification, minimum value, maximum value, step size, error message, response status. Among them, the specification can be the content information set for the control.

[0241] The service execution interface is used to call device services and execute the issued commands. The request parameters corresponding to the service execution interface may include the device number, remote control type information such as remote desktop or remote command, and timeout. The returned data structure may include a status code, response data, error information, and response status.

[0242] The attribute and corresponding control query interface is used to query the attributes of the device and the corresponding attribute controls. The request parameters corresponding to the attribute and corresponding control query interface may include the device type or device number; the returned data may include the following fields: status code, response data, total number such as the total number of list data, list, unique index such as the id in the database, attribute identifier, attribute name, list of available controls for this attribute such as "000,00,005" separated by commas ",", attribute type, attribute read / write mode, control identifier, control name, whether the attribute is displayed, specification, minimum value, maximum value, step size, error information, and response status. Among them, the data type is the data type of the attribute in the physical model editing interface, such as int (integer type), float (floating point type), string (string), etc.; the specification may be the content information set for the control.

[0243] The device attribute value query interface is used to query the current value of the device attributes. The request parameters corresponding to the device attribute value query interface may include the device number. The returned data structure may include a status code, response data, error information, and response status.

[0244] The execution attribute setting interface is used to execute the setting of the expected attribute value of the device. The request parameters corresponding to the execution attribute setting interface may include the device number. The returned data structure may include: status code, response data, error information, and response status.

[0245] The device attribute value acquisition interface is used to acquire the attribute values of the attributes reported by the device. The request parameters corresponding to the device attribute value acquisition interface may include the device number. The returned data structure may include: status code, response data, reported attribute information, error information, and response status.

[0246] The group list refresh interface is used to refresh the page of the current group. The request parameters corresponding to the group list refresh interface may include the group id, page number, number of items per page, and mode. The returned data structure may include: status code, response data, list, error information, and response status.

[0247] Figure 14 The block diagram of the control device according to an embodiment of the present disclosure is shown.

[0248] As Figure 14 shown, the control device 1400 of this embodiment includes a first acquisition module 1410, an execution module 1420, and a display module 1430.

[0249] The first acquisition module 1410 is configured to, in response to a user's selection operation on a target device in the device list, acquire at least one remote control type for the target device, where the remote control type has corresponding remote control information, and the remote control information is determined by the remote control platform in response to at least one remote control request from the control end for the target device according to the device identifier of the target device and the remote control type included in each of the at least one remote control request.

[0250] The execution module 1420 is configured to execute a remote control process corresponding to each of the at least one remote control type according to the remote control information of each of the at least one remote control type.

[0251] The display module 1430 is configured to, in response to the completion of the execution of the remote control process, display a control interface for each of the at least one remote control type, so that the user can remotely control the target device through the control interface.

[0252] According to an embodiment of the present disclosure, the at least one remote control type includes at least one of the following: remote desktop control, remote command control, and remote control widget control.

[0253] According to an embodiment of the present disclosure, when the remote control type is remote desktop control or remote command control, the remote control information includes target server information and login information for the remote control type.

[0254] According to an embodiment of the present disclosure, the execution module includes: a sending sub-module and a connection establishment sub-module.

[0255] The sending sub-module is configured to log in to the target server according to the target server information and send the login information to the target server, so that the target server verifies the login information according to the verification information sent by the target device.

[0256] The connection establishment sub-module is configured to establish a remote service connection between the control end and the target server in response to successful verification.

[0257] According to an embodiment of the present disclosure, when the remote control type is remote control widget control, the remote control information includes the device model of the target device, where the device model includes at least one attribute for the target device, control configuration information for each attribute, and attribute values.

[0258] According to an embodiment of the present disclosure, the execution module further includes: a generation sub-module and a display sub-module.

[0259] The generation sub-module is configured to generate an attribute control for each attribute in the at least one attribute according to the control configuration information of the attribute.

[0260] A display sub-module, configured to display an attribute value by using an attribute control.

[0261] According to an embodiment of the present disclosure, the above-mentioned device further includes: a second acquisition module and an update module.

[0262] The second acquisition module is configured to acquire the current attribute value of each of at least one attribute at a first time interval.

[0263] The update module is configured to, in response to a change in the current attribute value of a target attribute among at least one attribute, update the attribute value displayed by the attribute control of the target attribute by using the current attribute value.

[0264] According to an embodiment of the present disclosure, the current attribute value is collected by a target device for each of at least one attribute at a second time interval and sent to a remote control platform side.

[0265] According to an embodiment of the present disclosure, the device list includes a visual button for a target device; the selection operation for the target device in the device list includes: clicking the visual button for the target device.

[0266] According to an embodiment of the present disclosure, any plurality of modules, sub-modules, units, and sub-units, or at least part of the functions of any of them can be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure can be split into multiple modules for implementation. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by any other reasonable way of integrating or packaging circuits in hardware or firmware, or implemented in any one of the three implementation manners of software, hardware, and firmware, or in a suitable combination of any several of them. Alternatively, one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure can be at least partially implemented as a computer program module, and when the computer program module runs, it can execute the corresponding functions.

[0267] For example, any combination of the first acquisition module 1410, the execution module 1420, and the display module 1430 may be combined and implemented in one module / unit / sub-unit, or any one of the modules / units / sub-units may be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units may be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present disclosure, at least one of the first acquisition module 1410, the execution module 1420, and the display module 1430 may be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on chip, a system on substrate, a system on package, an application specific integrated circuit (ASIC), or any other reasonable way of integrating or packaging circuits, etc., implemented by hardware or firmware, or implemented in any one of the three implementation manners of software, hardware, and firmware, or in an appropriate combination of any several of them. Alternatively, at least one of the first acquisition module 1410, the execution module 1420, and the display module 1430 may be at least partially implemented as a computer program module, and when the computer program module is run, it can execute the corresponding functions.

[0268] Figure 15 The block diagram of a control device according to another embodiment of the present disclosure is shown.

[0269] As Figure 15 shown, the control device 1500 of this embodiment includes a determination module 1510 and a first transmission module 1520.

[0270] The determination module 1510 is configured to, in response to at least one remote control request from a control end for a target device, determine remote control information corresponding to each of the at least one remote control type according to the device identifier of the target device and the remote control type included in each of the at least one remote control request.

[0271] The first transmission module 1520 is configured to send the remote control information corresponding to each of the at least one remote control type to the control end, so that the control end can execute the remote control process corresponding to each of the at least one remote control type according to the remote control information corresponding to each of the at least one remote control type; and in response to the completion of the execution of the remote control process, display the control interface corresponding to each of the at least one remote control type.

[0272] According to an embodiment of the present disclosure, when the remote control type includes remote desktop control or remote command control, the remote control information includes target server information and login information.

[0273] According to an embodiment of the present disclosure, the determination module includes: an acquisition sub-module and a first determination sub-module.

[0274] The acquisition sub-module is configured to acquire target server information for a remote control type.

[0275] The first determination sub-module is configured to determine login information for a target device according to a device identifier, where the login information includes the device identifier and a login password for the target device.

[0276] According to an embodiment of the present disclosure, the first determination sub-module includes: a generation unit and a determination unit.

[0277] The generation unit is configured to randomly generate a login password for the target device according to a preset password generation rule.

[0278] The determination unit is configured to determine the login information according to the login password and the device identifier.

[0279] According to an embodiment of the present disclosure, the above device further includes: a second sending module.

[0280] The second sending module is configured to send a remote control start command including the target server information and the login information to the target device, so that the target device establishes a connection with the target server according to the target server information and sends the login information to the target server, so as to facilitate the target server to verify the control end according to the login information.

[0281] According to an embodiment of the present disclosure, when the remote control type includes remote control by a remote control, the remote control information includes at least one attribute of the target device, control configuration information of each attribute, and an attribute value.

[0282] According to an embodiment of the present disclosure, the determination module includes: a second determination sub-module, a third determination sub-module, and a fourth determination sub-module.

[0283] The second determination sub-module is configured to determine a physical model of the target device in response to a physical model query request for the target device, where the physical model includes at least one attribute.

[0284] The third determination sub-module is configured to determine control configuration information of at least one attribute in response to a control query request for at least one attribute.

[0285] The fourth determination sub-module is configured to determine an attribute value of at least one attribute in response to an attribute value query request for at least one attribute.

[0286] According to an embodiment of the present disclosure, the above device further includes: a receiving module and a generating module.

[0287] A receiving module, configured to receive a visualization control request from a target device, where the visualization control request is generated by the target device scanning local files at a third time interval and, in response to a local file containing a preset file, generating the visualization control request according to the visualization type of the preset file.

[0288] A generating module, configured to generate a visualization button for the target device according to the visualization type included in the visualization control request.

[0289] According to embodiments of the present disclosure, any plurality of modules, sub-modules, units, and sub-units, or at least part of the functions of any of them can be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to embodiments of the present disclosure can be split into multiple modules for implementation. Any one or more of the modules, sub-modules, units, and sub-units according to embodiments of the present disclosure can be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a System on Chip, a System on Substrate, a System in Package, an Application Specific Integrated Circuit (ASIC), or can be implemented by any other reasonable way of integrating or packaging circuits, or implemented in any one of the three implementation manners of software, hardware, and firmware, or in an appropriate combination of any several of them. Alternatively, one or more of the modules, sub-modules, units, and sub-units according to embodiments of the present disclosure can be at least partially implemented as a computer program module, and when the computer program module is run, it can execute the corresponding functions.

[0290] For example, any plurality of the determination module 1510 and the first sending module 1520 can be combined and implemented in one module / unit / sub-unit, or any one of the module / unit / sub-unit can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to embodiments of the present disclosure, at least one of the determination module 1510 and the first sending module 1520 can be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a System on Chip, a System on Substrate, a System in Package, an Application Specific Integrated Circuit (ASIC), or can be implemented by any other reasonable way of integrating or packaging circuits, or implemented in any one of the three implementation manners of software, hardware, and firmware, or in an appropriate combination of any several of them. Alternatively, at least one of the determination module 1510 and the first sending module 1520 can be at least partially implemented as a computer program module, and when the computer program module is run, it can execute the corresponding functions.

[0291] It should be noted that the control device part in the embodiments of the present disclosure corresponds to the control method part in the embodiments of the present disclosure. For the description of the control device part, please refer to the control method part specifically, and it will not be elaborated here.

[0292] Figure 16 The block diagram of an electronic device suitable for implementing the method described above according to an embodiment of the present disclosure is shown. Figure 16 The electronic device shown is merely an example and should not impose any limitation on the functions and usage scope of the embodiments of the present disclosure.

[0293] As Figure 16 shown, the electronic device 1600 according to an embodiment of the present disclosure includes a processor 1601, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1602 or the program loaded from the storage part 1608 into the random access memory (RAM) 1603. The processor 1601 can include, for example, a general microprocessor (such as a CPU), an instruction set processor, and / or a related chipset, and / or a dedicated microprocessor (such as an application-specific integrated circuit (ASIC)), and so on. The processor 1601 can also include on-board memory for caching purposes. The processor 1601 can include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0294] In the RAM 1603, various programs and data required for the operation of the electronic device 1600 are stored. The processor 1601, the ROM 1602, and the RAM 1603 are connected to each other through a bus 1604. The processor 1601 performs various operations of the method flow according to an embodiment of the present disclosure by executing the programs in the ROM 1602 and / or the RAM 1603. It should be noted that the program can also be stored in one or more memories other than the ROM 1602 and the RAM 1603. The processor 1601 can also perform various operations of the method flow according to an embodiment of the present disclosure by executing the programs stored in the one or more memories.

[0295] According to an embodiment of the present disclosure, the electronic device 1600 may further include an input / output (I / O) interface 1605, and the input / output (I / O) interface 1605 is also connected to the bus 1604. The electronic device 1600 may further include one or more of the following components connected to the input / output (I / O) interface 1605: an input portion 1606 including a keyboard, a mouse, etc.; an output portion 1607 including, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 1608 including a hard disk, etc.; and a communication portion 1609 including a network interface card such as a LAN card, a modem, etc. The communication portion 1609 performs communication processing via a network such as the Internet. A drive 1610 is also connected to the input / output (I / O) interface 1605 as needed. A removable medium 1611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1610 as needed so that a computer program read from it is installed into the storage portion 1608 as needed.

[0296] According to an embodiment of the present disclosure, the method flow according to the embodiment of the present disclosure may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program includes program codes for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 1609, and / or installed from the removable medium 1611. When the computer program is executed by the processor 1601, the above functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the above-described system, device, apparatus, module, unit, etc. may be implemented by computer program modules.

[0297] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist separately without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0298] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. For example, it may include but is not limited to: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, apparatus, or device.

[0299] For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include one or more memories other than the above-described ROM 1602 and / or RAM 1603 and / or ROM 1602 and RAM 1603.

[0300] An embodiment of the present disclosure also includes a computer program product, which includes a computer program that contains program code for executing the method provided by the embodiment of the present disclosure. When the computer program product runs on an electronic device, the program code is used to cause the electronic device to implement the control method provided by the embodiment of the present disclosure.

[0301] When the computer program is executed by the processor 1601, the above functions defined in the system / apparatus of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the above-described systems, apparatuses, modules, units, etc. may be implemented by computer program modules.

[0302] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices and magnetic storage devices. In another embodiment, the computer program may also be transmitted and distributed in the form of a signal on a network medium, and downloaded and installed through the communication part 1609, and / or installed from the removable medium 1611. The program code contained in the computer program can be transmitted by any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0303] In accordance with embodiments of the present disclosure, program code for executing the computer programs provided by the embodiments of the present disclosure may be written in any combination of one or more programming languages. Specifically, these computing programs may be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages include, but are not limited to, such as Java, C++, Python, the "C" language, or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., by connecting through the Internet using an Internet service provider).

[0304] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, and combinations of blocks in the block diagram or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions. Those skilled in the art will understand that the features described in the various embodiments of the present disclosure can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments of the present disclosure can be combined and / or combined in various ways. All such combinations and / or combinations fall within the scope of the present disclosure.

[0305] The above describes the embodiments of the present disclosure. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in each embodiment cannot be used advantageously in combination. Without departing from the scope of the present disclosure, those skilled in the art can make various substitutions and modifications, and all such substitutions and modifications should fall within the scope of the present disclosure.

Claims

1. A control method, comprising: In response to a user's selection operation on a target device in the device list, obtaining at least one remote control type for the target device, wherein the remote control type has corresponding remote control information, and the remote control information is determined by the remote control platform in response to at least one remote control request for the target device from the control end, according to the device identification of the target device and the remote control type respectively included in at least one remote control request; executing a remote control process corresponding to at least one of the remote control types according to the remote control information of the at least one remote control type; and In response to the remote control process being completed, displaying at least one control interface of each of the remote control types, so that the user can remotely control the target device through the control interface.

2. The method according to claim 1, wherein: At least one of the remote control types includes at least one of the following: remote desktop control, remote command control, and remote control component control.

3. The method according to claim 2, wherein: In the case where the remote control type is remote desktop control or remote command control, the remote control information includes target server information and login information for the remote control type; The executing of the remote control process corresponding to at least one of the remote control types comprises: Logging in to the target server according to the target server information, and sending the login information to the target server, so that the target server verifies the login information according to the verification information sent by the target device; In response to the verification being successful, a remote service connection is established between the control end and the target service end.

4. The method according to claim 2, wherein: In the case where the remote control type is remote control control, the remote control information includes a physical model of the target device, wherein the physical model includes at least one property for the target device, control configuration information for each property, and a property value; The executing of the remote control process corresponding to at least one of the remote control types comprises: For each attribute of the at least one attribute, generating an attribute control of the attribute according to the control configuration information of the attribute; The attribute value is displayed using the attribute control.

5. The method according to claim 4, further comprising: Obtaining a current attribute value of each of at least one of the attributes at a first time interval; In response to a change in a current attribute value of a target attribute among at least one of the attributes, the attribute value displayed by the attribute control of the target attribute is updated using the current attribute value.

6. The method according to claim 5, wherein: The current attribute value is obtained by collecting the attribute value of at least one attribute at a second time interval by the target device and sending the collected attribute value to the remote control platform.

7. The method according to claim 1, wherein: The device list includes a visual button for the target device; The selection operation for the target device in the device list includes: Click the visualization button for the target device.

8. A control method, comprising: In response to at least one remote control request from the control end for the target device, determining remote control information corresponding to at least one remote control type according to a device identification of the target device and a remote control type respectively included in at least one remote control request; Sending remote control information corresponding to at least one of the remote control types to the control terminal, so that the control terminal executes the remote control process corresponding to at least one of the remote control types according to the remote control information of at least one of the remote control types; In response to the completion of the remote control process, a control interface of at least one of the remote control types is displayed.

9. The method according to claim 8, wherein: In the case where the remote control type includes remote desktop control or remote command control, the remote control information includes target server information and login information; The determining of the remote control information corresponding to at least one of the remote control types comprises: Obtain target server information for the remote control type; Login information for the target device is determined according to the device identification, wherein the login information includes the device identification and a login password for the target device.

10. The method according to claim 9, wherein: The determining the login information for the target device includes: Randomly generate a login password for the target device according to a preset password generation rule; The login information is determined according to the login password and the device identification.

11. The method according to claim 9, further comprising: A remote control start command including the target server information and login information is sent to the target device, so that the target device establishes a connection with the target server according to the target server information, and sends the login information to the target server, so that the target server can verify the control end according to the login information.

12. The method according to claim 8, wherein: In the case where the remote control type includes remote control control, the remote control information includes at least one attribute for the target device, respective control configuration information for each attribute, and an attribute value; The determining of the remote control information corresponding to at least one of the remote control types comprises: In response to a physical model query request for the target device, determining a physical model for the target device, wherein the physical model includes at least one attribute; In response to a control query request for the at least one property, determining control configuration information of each of the at least one property; In response to an attribute value query request for the at least one attribute, an attribute value of each of the at least one attribute is determined.

13. The method according to claim 8, further comprising: Receiving a visualization control request from the target device, wherein the visualization control request is generated by the target device scanning a local file at a third time interval, in response to the local file containing a preset file, and according to a visualization type of the preset file; A visualization button for the target device is generated according to the visualization type included in the visualization control request.

14. An electronic device, comprising: one or more processors; a memory for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 13.

15. A computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, enables the processor to implement the method according to any one of claims 1 to 13.

Images