Remote control method and device, electronic equipment and storage medium

Abstract

The invention provides a remote control method and device, electronic equipment and a storage medium, and is applied to a controlled end of remote control software, and the method comprises the steps: responding to a starting instruction of the remote control software, and generating watermark information of the controlled end; creating a first virtual desktop according to the environmental parameters of the controlled end under the condition that the controlled end is successfully connected with the master control end; packaging the watermark information and the first virtual desktop to obtain to-be-transmitted data, and sending the to-be-transmitted data to the master control end; a second virtual desktop is created, the current display interface is switched to the second virtual desktop, and the second virtual desktop is used for prompting that the controlled end is in the remote control state; and receiving an operation instruction returned by the main control end, and executing a corresponding operation on the first virtual desktop based on the operation instruction. Therefore, the controlled end displays the second virtual desktop and prompts that the controlled end is in the remote control state, and at the moment, even if an unauthorized person is beside the desktop screen of the controlled end, information leakage can be avoided, and effective information protection is realized.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a remote control method, device, electronic device and storage medium. Background Art

[0002] Remote work is an increasingly popular way of working. In some scenarios, remote work needs to rely on a remote desktop control system, where the remote desktop control system includes a master terminal and a controlled terminal. Users can remotely control the controlled terminal by operating the master terminal.

[0003] Typically, remote desktop control systems use encrypted network communication channel technology to obtain desktop image data from the controlled end in real time, and securely transmit it to the desktop screen of the master end for display, thereby realizing remote control operation functions.

[0004] However, when a user remotely controls a controlled end, the desktop screen of the controlled end will display the operations that the user is performing. At this time, if there is an unauthorized person next to the desktop screen of the controlled end, he will see the operations that the user is currently performing, causing information leakage. Therefore, it is impossible to effectively protect the information on the desktop screen of the controlled end. Summary of the invention

[0005] To solve the above technical problems, the present application discloses a remote control method, device, electronic device and storage medium, so as to at least solve the problem that the desktop screen of the controlled terminal cannot be effectively protected in the related art. The technical solution disclosed in the present application is as follows:

[0006] In a first aspect, the present application shows a remote control method, which is applied to a controlled end of a remote control software, comprising:

[0007] In response to a startup instruction of the remote control software, generating watermark information of the controlled terminal;

[0008] When the controlled terminal is successfully connected to the main control terminal, a first virtual desktop is created according to the environmental parameters of the controlled terminal;

[0009] Encapsulating the watermark information and the first virtual desktop to obtain data to be transmitted, and sending the data to be transmitted to the main control end;

[0010] Creating a second virtual desktop, and switching the current display interface to the second virtual desktop, wherein the second virtual desktop is used to prompt that the controlled terminal is in a remote control state;

[0011] The operation instruction returned by the main control end is received, and a corresponding operation is performed on the first virtual desktop based on the operation instruction.

[0012] Optionally, when the controlled terminal is successfully connected to the controlling terminal, before creating the first virtual desktop according to the environmental parameters of the controlled terminal, the method includes:

[0013] In response to a system startup instruction of the controlled terminal, installing a graphics card filter driver;

[0014] Run the graphics card filter driver to divide the graphics card resources of the controlled end into a first virtual graphics card and a second virtual graphics card; wherein the first virtual graphics card is used for image processing of the current display interface of the controlled end, and the second virtual graphics card is used for image processing of the first virtual desktop and the second virtual desktop.

[0015] Optionally, when the controlled terminal is successfully connected to the controlling terminal, creating a first virtual desktop according to the environmental parameters of the controlled terminal includes:

[0016] Receiving a remote control request sent by the master control terminal, and performing identity authentication on the master control terminal;

[0017] When the identity authentication of the master terminal is passed, the desktop creation interface is called through the second virtual graphics card to create a first virtual desktop according to the environmental parameters of the controlled terminal.

[0018] Optionally, the remote control request carries session control information of the master control end;

[0019] The step of calling a desktop creation interface through the second virtual graphics card and creating a first virtual desktop according to the environment parameters of the controlled terminal includes:

[0020] Associating the session control information with the second virtual graphics card;

[0021] According to the session control information, the desktop creation interface is called by using the second virtual graphics card, and the first virtual desktop is created according to the environmental parameters of the controlled terminal.

[0022] Optionally, the creating the second virtual desktop includes:

[0023] In the case where the identity authentication of the master control end is passed, or in the case where the identity authentication of the master control end is passed and notification information of the master control end is received, determining the second virtual graphics card according to the session control information; the notification information is used to indicate that the connection between the master control end and the controlled end is stable;

[0024] The second virtual desktop is created by calling a desktop creation interface through the second virtual graphics card.

[0025] Optionally, the watermark information is an invisible digital watermark, and the step of generating the watermark information of the controlled terminal includes:

[0026] generating a watermark window including the invisible digital watermark;

[0027] The encapsulating the watermark information and the first virtual desktop to obtain data to be transmitted includes:

[0028] The watermark window is embedded in the first virtual desktop to obtain data to be transmitted.

[0029] Optionally, after sending the data to be transmitted to the master control end, the method further includes:

[0030] In response to the exit instruction of the master terminal, the first virtual desktop and the second virtual desktop are destroyed, and the current display interface is switched to the original desktop of the controlled terminal.

[0031] In a second aspect, an embodiment of the present invention provides a remote control device, which is applied to a controlled end of remote control software, comprising:

[0032] A response module, used for generating watermark information of the controlled terminal in response to a startup instruction of the remote control software;

[0033] A first creation module, configured to create a first virtual desktop according to the environment parameters of the controlled terminal when the controlled terminal is successfully connected to the master terminal;

[0034] An encapsulation module, used for encapsulating the watermark information and the first virtual desktop, obtaining data to be transmitted, and sending the data to be transmitted to the main control end;

[0035] A second creation module, used for creating a second virtual desktop and switching the current display interface to the second virtual desktop, wherein the second virtual desktop is used for prompting that the controlled terminal is in a remote control state;

[0036] The execution module is used to receive the operation instruction returned by the main control end, and execute a corresponding operation on the first virtual desktop based on the operation instruction.

[0037] In a third aspect, an embodiment of the present invention provides an electronic device, including:

[0038] processor;

[0039] a memory for storing instructions executable by the processor;

[0040] The processor is configured to execute the instructions to implement any of the remote control methods described above.

[0041] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium. When instructions in the computer-readable storage medium are executed by a processor of a remote-controlled electronic device, the remote-controlled electronic device is enabled to execute any of the remote control methods described above.

[0042] Compared with the prior art, this application has the following advantages:

[0043] The technical solution provided by the embodiment of the present application is applied to a controlled end of remote control software, wherein the controlled end generates watermark information of the controlled end in response to a startup instruction of the remote control software; when the controlled end is successfully connected to the main control end, a first virtual desktop is created according to the environmental parameters of the controlled end; the watermark information and the first virtual desktop are encapsulated to obtain data to be transmitted, and the data to be transmitted is sent to the main control end; a second virtual desktop is created, and the current display interface is switched to the second virtual desktop, wherein the second virtual desktop is used to prompt that the controlled end is in a remote control state; an operation instruction returned by the main control end is received, and a corresponding operation is performed on the first virtual desktop based on the operation instruction.

[0044] In this way, the controlled end can create a first virtual desktop and a second virtual desktop after the remote control software is started, wherein the first virtual desktop is generated according to the environmental parameters of the controlled end, and after being encapsulated with the watermark information, it is sent to the main control end, so that the main control end can remotely control the controlled end based on the first virtual desktop. At the same time, the controlled end displays the second virtual desktop to prompt that the controlled end is in a remote control state. Even if there are unauthorized personnel next to the desktop screen of the controlled end during the remote control process, information leakage can be avoided, thereby achieving effective information protection of the desktop screen of the controlled end. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 It is a flowchart of the steps of a remote control method of the present application;

[0046] Figure 2 It is a controlled end process diagram of a remote control software of the present application;

[0047] Figure 3 This is a schematic diagram of the main control end process of a remote control software of the present application;

[0048] Figure 4 It is a system schematic diagram of a remote control method of the present application;

[0049] Figure 5 It is a structural block diagram of a remote control device of the present application;

[0050] Figure 6 is a schematic diagram of an electronic device of the present application;

[0051] Figure 7It is a block diagram of a device for remote control of the present application. DETAILED DESCRIPTION

[0052] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0053] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0054] Reference Figure 1 , shows a flowchart of the steps of a remote control method of the present application, which is applied to the controlled end of the remote control software and may specifically include the following steps:

[0055] In step S11, in response to the start-up instruction of the remote control software, watermark information of the controlled terminal is generated.

[0056] The remote desktop control system consists of a master terminal and a controlled terminal. Users can remotely control the controlled terminal by operating the master terminal. However, when the user remotely controls the controlled terminal, the desktop screen of the controlled terminal will display the operation the user is performing. At this time, if there is an unauthorized person next to the desktop screen of the controlled terminal, he will see the operation the user is currently performing, causing information leakage.

[0057] The application of the remote control method provided in this application can solve the above-mentioned problems and realize effective information protection of the desktop screen of the controlled end.

[0058] In this step, first, the user operates on the controlled end to start the remote control software, and then the controlled end responds to the start-up instruction of the remote control software to generate the watermark information of the controlled end, wherein the watermark information carries special attribute information corresponding to the controlled end, that is, the corresponding controlled end can be uniquely determined based on the watermark information.

[0059] The watermark information can be image data or text data composed of characters or codes. This application does not limit this. After the watermark information is generated, it is set to a hidden state and is invisible to the naked eye. It needs to be processed by a corresponding algorithm to be recognized. It can be used to identify the controlled end and improve the data security of the remote desktop control system.

[0060] In one implementation, the above steps may be implemented by a virtual desktop module. After the remote control software is started, the virtual desktop module notifies the virtualization driver to construct watermark information with special attributes of the controlled end.

[0061] In step S12, when the controlled terminal is successfully connected to the controlling terminal, a first virtual desktop is created according to the environmental parameters of the controlled terminal.

[0062] In this step, after receiving the remote control software startup instruction, the controlled end needs to start the remote control software and connect to the main control end. If the controlled end is successfully connected to the main control end, the virtual desktop module can obtain the environmental parameters of the controlled end and then create the first virtual desktop according to the environmental parameters of the controlled end.

[0063] It can be understood that the first virtual desktop is created based on the environment parameters of the controlled end, and the environment parameters are used to provide information required for the operation of the application. Therefore, the first virtual desktop is the same as the original desktop of the controlled end, and the original desktop is the desktop displayed after the controlled end is turned on. In other words, for the host end, the operation results obtained by running the application and performing operations on the first virtual desktop through the remote control software and running the application and performing operations on the original desktop are the same.

[0064] In this way, in the subsequent steps, the user remote control screen displayed on the master end can be switched to the newly created first virtual desktop, instead of directly displaying the current display interface of the controlled end on the master end. It can be understood that the current display interface of the controlled end is the desktop of the controlled end when it is not remotely controlled, that is, the real desktop of the controlled end. Therefore, the real desktop of the controlled end can be redirected through the first virtual desktop, while avoiding certain operations or information in the current display interface of the controlled end from being displayed to the master end.

[0065] Among them, the environmental parameters of the controlled end include system login setting parameters, mouse and keyboard setting parameters, desktop icon setting parameters, etc., and this application does not limit this.

[0066] In one implementation, when the controlled terminal is successfully connected to the main control terminal, before creating the first virtual desktop according to the environment parameters of the controlled terminal, the following steps are included:

[0067] In response to a system startup instruction of the controlled end, a graphics card filter driver is installed; the graphics card filter driver is run to divide the graphics card resources of the controlled end into a first virtual graphics card and a second virtual graphics card; wherein the first virtual graphics card is used for image processing of the current display interface of the controlled end, and the second virtual graphics card is used for image processing of the first virtual desktop and the second virtual desktop.

[0068] That is to say, after the system is turned on, the controlled end automatically installs the graphics card filter driver, and then uses the graphics card filter driver to realize the virtual division of the system graphics card resources. Specifically, after the filter layer driver is loaded, the graphics card resources of the controlled end are divided into the first virtual graphics card and the second virtual graphics card, wherein the first virtual graphics card is used for image processing of the real desktop of the controlled end, and the second virtual graphics card is reserved for image processing of the first virtual desktop and the second virtual desktop required for remote control.

[0069] In one implementation, when the controlled terminal is successfully connected to the main control terminal, creating a first virtual desktop according to the environmental parameters of the controlled terminal includes:

[0070] A remote control request sent by the master control end is received, and the master control end is authenticated; if the master control end passes the authentication, a desktop creation interface is called through the second virtual graphics card, and a first virtual desktop is created according to the environmental parameters of the controlled end.

[0071] That is to say, identity authentication is required between the controlled end and the master end to improve the security of remote control. Therefore, after receiving the remote control request sent by the master end, the controlled end can authenticate the master end; if the identity authentication is successful, the controlled end can automatically call the desktop creation interface through the second virtual graphics card to create a first virtual desktop, redirect the real desktop, and switch the user's remote control screen to the first virtual desktop, thereby realizing information protection of the real desktop of the controlled end.

[0072] Specifically, the identity authentication process between the master terminal and the controlled terminal includes the following steps:

[0073] First, after the system is turned on, the master end starts the remote control software and obtains the remote control parameters of the controlled end, such as the controlled end's IP (Internet Protocol), user name, random verification code, etc. Then, based on the controlled end's remote control parameters, it actively sends a remote control request to connect to the controlled end and waits for the controlled end's connection response;

[0074] The controlled end responds to the remote control request of the master end, completes a series of handshake verifications based on the remote control parameters, and realizes the identity authentication of the master end. If the identity authentication is successful, it returns a connection success instruction to the master end. If the identity authentication fails, it returns a connection failure instruction to the master end.

[0075] Furthermore, if the master end receives a connection success command sent by the controlled end, it means that the master end and the controlled end have been successfully connected, and can wait for data sent by the controlled end to realize remote control of the controlled end; if a connection failure command is received, the master end needs to re-acquire the remote control parameters of the controlled end and try to establish a connection with the controlled end again.

[0076] In one implementation, the remote control request carries the session control information of the master terminal; then, calling the desktop creation interface through the second virtual graphics card and creating the first virtual desktop according to the environment parameters of the controlled terminal include:

[0077] The session control information is associated with the second virtual graphics card; according to the session control information, the desktop creation interface is called using the second virtual graphics card, and the first virtual desktop is created according to the environmental parameters of the controlled terminal.

[0078] That is to say, after the controlled end is successfully connected to the main control end, the session control information can be associated with the second virtual graphics card. Then, based on the session control information, the second virtual graphics card corresponding to the main control end can be determined. Then, the second virtual graphics card can be used to call the desktop creation interface and create the first virtual desktop based on the environmental parameters of the controlled end.

[0079] Among them, the desktop creation interface can be an API (Application Programming Interface). The functions that can be called when the desktop creation interface creates the first virtual desktop include but are not limited to CreateWindowStation (create window station object), CreateDesktop (create desktop), SwitchDesktop (switch desktop), SetThreadDesktop (connect desktop thread), etc. This application does not limit this.

[0080] In this way, each second virtual graphics card can only serve the associated master terminal. When there are multiple master terminals, each master terminal only calls the system graphics card resources of some of the controlled terminals associated with itself, thereby avoiding excessive occupation of the system graphics card resources of the controlled terminals, resulting in system crashes or abnormalities.

[0081] In step S13, the watermark information and the first virtual desktop are encapsulated to obtain the data to be transmitted, and the data to be transmitted is sent to the main control end.

[0082] In this step, the desktop watermark placement operation is completed by encapsulating the watermark information and the first virtual desktop. In this way, the image data received at the main control end includes the watermark information. In this way, the controlled end can be traced back based on the watermark information, thereby achieving the confidentiality and non-repudiation of the data to be transmitted, which is conducive to improving the security of remote control.

[0083] In one implementation, the watermark information is an invisible digital watermark, and then generating the watermark information of the controlled terminal includes:

[0084] generating a watermark window including an invisible digital watermark;

[0085] Correspondingly, the watermark information and the first virtual desktop are encapsulated to obtain data to be transmitted, including:

[0086] The watermark window is embedded in the first virtual desktop to obtain the data to be transmitted.

[0087] That is to say, the watermark information in the present application can be an invisible digital watermark that is invisible to the naked eye, and the watermark information can be added to the first virtual desktop by calling out a watermark window. Specifically, the watermark window including the invisible digital watermark can be directly embedded above the first virtual desktop for storage to obtain the data to be transmitted. Furthermore, after the master terminal receives the data to be transmitted, when displaying the data to be transmitted, the data to be transmitted can be decoded by a corresponding algorithm to identify the corresponding watermark information, thereby determining the controlled terminal remotely controlled by the master terminal.

[0088] In step S14, a second virtual desktop is created, and the current display interface is switched to the second virtual desktop, where the second virtual desktop is used to prompt that the controlled terminal is in a remote control state.

[0089] In this step, a second virtual desktop environment is constructed in real time, and the current display interface of the controlled terminal is switched to the second virtual desktop. The second virtual desktop is used to prompt the controlled terminal that it is in a remote control state. For example, the second virtual desktop can display an information protection screen and prompt through text that the current computer is under remote control.

[0090] In this way, what is displayed on the controlled end is neither the real desktop before being remotely controlled nor the first virtual desktop being remotely controlled by the control end, thereby effectively realizing information protection of the controlled end.

[0091] In one implementation, creating a second virtual desktop includes:

[0092] When the identity authentication of the master end is passed, or when the identity authentication of the master end is passed and notification information from the master end is received, the second virtual graphics card is determined according to the session control information; the notification information is used to indicate that the connection between the master end and the controlled end is stable; the desktop creation interface is called through the second virtual graphics card to create a second virtual desktop.

[0093] That is to say, after the identity authentication of the master end is successful, or after the remote control connection with the master end is stable, the controlled end can determine the second virtual graphics card corresponding to the master end according to the session control information of the connected master end, and then call the desktop creation interface through the second virtual graphics card to build a second virtual desktop.

[0094] Specifically, the method of using the second virtual graphics card to call the desktop creation interface to build the second virtual desktop in this application is consistent with the method of using the second virtual graphics card to call the desktop creation interface to create the first virtual desktop in step S13, and this application will not repeat it again.

[0095] In this way, each second virtual graphics card can only serve the associated master terminal. When there are multiple master terminals, each master terminal only calls the system graphics card resources of some of the controlled terminals associated with itself, thereby avoiding excessive occupation of the system graphics card resources of the controlled terminals, resulting in system crashes or abnormalities.

[0096] In step S15, an operation instruction returned by the main control end is received, and a corresponding operation is performed on the first virtual desktop based on the operation instruction.

[0097] In the present application, after the master end obtains the data to be transmitted, it can display the data to be transmitted and issue operation instructions based on the first virtual desktop of the controlled end. Then, these operation instructions need to be returned to the controlled end, and the controlled end performs the corresponding operation on the first virtual desktop based on the received operation instructions. It should be noted that after the controlled end performs the corresponding operation, the operation process and results will be reflected on the first virtual desktop. Therefore, the master end can obtain the operation process and results of the operation instructions in real time by continuously obtaining the data to be transmitted encapsulated with the watermark information, thereby realizing remote control of the controlled end.

[0098] That is to say, the master control end will receive the first virtual desktop with watermark information sent by the controlled end in real time, and display it on the main interface of the master control end in real time; then, the master control end repeatedly executes remote control operations, including operation instructions such as keyboard or mouse events, until the remote control task is completed, and then actively closes the remote control software and ends the process. In this way, the remote control of the controlled end by the master control end is realized.

[0099] In one implementation, after the data to be transmitted is sent to the master control end, the method further includes:

[0100] In response to the exit instruction of the master terminal, the first virtual desktop and the second virtual desktop are destroyed, and the current display interface is switched to the original desktop of the controlled terminal.

[0101] That is to say, the controlled end can receive an exit command sent by the master end, and the exit command is used to indicate that the remote control software has been exited. In this case, with the exit of the master end, the controlled end is no longer remotely controlled. Then, the controlled end can destroy the first virtual desktop and the second virtual desktop, and switch the current display interface to the original desktop of the controlled end.

[0102] Furthermore, after the master end exits, the controlled end can also determine whether it needs to exit the remote control software. If it needs to exit, the controlled end can close the remote control software as the master end exits. If it does not need to exit, the remote control software can be maintained running in the background and wait for the master end to send a remote control request again in order to connect to the master end.

[0103] Specifically, the controlled end can decide whether it needs to exit the remote control software based on the initial settings of the remote control software. For example, the remote control software can pre-set the waiting time or exit trigger event of the controlled end after the main control end exits; or, it can also send a query request to the user and decide whether it needs to exit the remote control software based on the user's feedback. This application does not specifically limit this.

[0104] For example, Figure 2 The present invention is a schematic diagram of a controlled end process of a remote control software of the present invention, wherein after the controlled end starts the remote control software, watermark information is generated; the remote control request sent by the master end is monitored, and the master end is authenticated; when the identity authentication is successful, a first virtual desktop is created in response to the remote control request, and the watermark information and the first virtual desktop are encapsulated to obtain data to be transmitted; and the data to be transmitted is sent to the master end;

[0105] Furthermore, the controlled end can also receive operation instructions such as keyboard or mouse events returned by the master end, and perform corresponding operations on the first virtual desktop based on the operation instructions; until the exit instruction sent by the master end is received, the controlled end needs to determine whether it needs to exit the remote control software. If it needs to exit, then the remote control software can be closed. If it does not need to exit, then it can return to the step of monitoring the remote control request sent by the master end.

[0106] and Figure 2 The controlled end process diagram shown corresponds to, Figure 3 The present invention is a schematic diagram of the master control end process of a remote control software of the present invention, wherein the master control end can obtain and configure the remote control parameters of the controlled end, including the IP, user name, random verification code, etc. of the controlled end; then, actively send a remote control request to connect to the controlled end, and wait for the connection response of the controlled end; if the identity authentication of the controlled end fails, the remote control parameters need to be reconfigured; if the identity authentication of the controlled end passes, the data to be transmitted sent by the controlled end is received, and the integrity check of the data to be transmitted is performed, and after the check passes, the first virtual desktop encapsulated with watermark information is displayed; then, the corresponding operation can be performed on the first virtual desktop, and the operation instructions such as keyboard or mouse events are returned to the controlled end;

[0107] Furthermore, if it is detected that the controlled end exits the remote control software, the main control end needs to determine whether it needs to exit the remote control software. If it needs to exit, it can close the remote control software. If it does not need to exit, it can continue to wait for receiving the data to be transmitted sent by the controlled end.

[0108] Figure 4 It is a system diagram of a remote control method of the present application. The remote control software generally consists of two modules: a graphics card virtualization module and a virtual desktop module.

[0109] The graphics card virtualization module is applied to the kernel layer in the operating system, and uses the filter layer driver in the kernel layer to realize the virtualization division of the system graphics card resources. Among them, the filter layer driver used by the graphics card virtualization module includes a mouse filter driver, a graphics card filter driver, and a keyboard filter driver, etc. In addition, the filter layer driver also includes a network filter driver, a file filter driver, and a disk filter driver, etc. This application does not specifically limit this. The virtualization division of the system graphics card resources can divide the graphics card resources of the controlled end into two parts, one part is used for the image processing of the current display interface of the controlled end, and the other part is reserved for the virtual desktop image processing during remote control, that is, for the image processing of the first virtual desktop and the second virtual desktop.

[0110] The virtual desktop module is applied to the application layer in the operating system to achieve desktop redirection during remote control of the controlled end. When the controlled end is successfully connected remotely, the virtualization module can obtain the session control information of the master end and dynamically create two virtual desktops, namely the first virtual desktop and the second virtual desktop, through the API interface. Then, the interface of the real desktop can be redirected to the first virtual desktop to complete the desktop operation display when it is remotely controlled by the master end; at the same time, the second virtual desktop is displayed on the controlled end to prevent the computer desktop of the controlled end from being peeped by a third party when it is remotely controlled.

[0111] In addition, the operating system application layer of the controlled end also includes a real desktop module for processing image data of the real desktop when the controlled end is not remotely controlled.

[0112] As can be seen from the above, the technical solution provided by the embodiment of the present disclosure is that the controlled end can create a first virtual desktop and a second virtual desktop after the remote control software is started, wherein the first virtual desktop is generated according to the environmental parameters of the controlled end, and after being encapsulated with the watermark information, it is sent to the main control end, so that the main control end can remotely control the controlled end based on the first virtual desktop. At the same time, the controlled end displays the second virtual desktop to prompt that the controlled end is in a remote control state. Even if there are unauthorized personnel next to the desktop screen of the controlled end during the remote control process, information leakage can be avoided, thereby achieving effective information protection of the desktop screen of the controlled end.

[0113] Reference Figure 5 , shows a schematic diagram of the structure of a remote control device of the present application, which is applied to the controlled end of the remote control software and may specifically include:

[0114] A response module 201, configured to generate watermark information of the controlled terminal in response to a startup instruction of the remote control software;

[0115] A first creation module 202, configured to create a first virtual desktop according to the environment parameters of the controlled terminal when the controlled terminal is successfully connected to the master terminal;

[0116] The encapsulation module 203 is used to encapsulate the watermark information and the first virtual desktop to obtain data to be transmitted, and send the data to be transmitted to the main control end;

[0117] A second creation module 204, used to create a second virtual desktop and switch the current display interface to the second virtual desktop, where the second virtual desktop is used to prompt that the controlled terminal is in a remote control state;

[0118] The execution module 205 is used to receive the operation instruction returned by the main control end, and execute a corresponding operation on the first virtual desktop based on the operation instruction.

[0119] In one implementation, the first creation module 202 is further configured to:

[0120] In response to a system startup instruction of the controlled terminal, installing a graphics card filter driver;

[0121] Run the graphics card filter driver to divide the graphics card resources of the controlled end into a first virtual graphics card and a second virtual graphics card; wherein the first virtual graphics card is used for image processing of the current display interface of the controlled end, and the second virtual graphics card is used for image processing of the first virtual desktop and the second virtual desktop.

[0122] In one implementation, the first creation module 202 is specifically configured to:

[0123] Receiving a remote control request sent by the master control terminal, and performing identity authentication on the master control terminal;

[0124] When the identity authentication of the master terminal is passed, the desktop creation interface is called through the second virtual graphics card to create a first virtual desktop according to the environmental parameters of the controlled terminal.

[0125] In one implementation, the remote control request carries the session control information of the master terminal;

[0126] The first creation module 202 is specifically used for:

[0127] Associating the session control information with the second virtual graphics card;

[0128] According to the session control information, the desktop creation interface is called by using the second virtual graphics card, and the first virtual desktop is created according to the environmental parameters of the controlled terminal.

[0129] In one implementation, the second creation module 204 is specifically configured to:

[0130] In the case where the identity authentication of the master control end is passed, or in the case where the identity authentication of the master control end is passed and notification information of the master control end is received, determining the second virtual graphics card according to the session control information; the notification information is used to indicate that the connection between the master control end and the controlled end is stable;

[0131] The desktop creation interface is called through the second virtual graphics card to create a second virtual desktop.

[0132] In one implementation, the response module 201 is specifically configured to:

[0133] generating a watermark window including the invisible digital watermark;

[0134] The encapsulation module 203 is specifically used for:

[0135] The watermark window is embedded in the first virtual desktop to obtain data to be transmitted.

[0136] In one implementation, the device further includes:

[0137] An exit module is used to respond to an exit instruction of the master terminal, destroy the first virtual desktop and the second virtual desktop, and switch the current display interface to the original desktop of the controlled terminal.

[0138] As can be seen from the above, the technical solution provided by the embodiment of the present disclosure is that the controlled end can create a first virtual desktop and a second virtual desktop after the remote control software is started, wherein the first virtual desktop is generated according to the environmental parameters of the controlled end, and after being encapsulated with the watermark information, it is sent to the main control end, so that the main control end can remotely control the controlled end based on the first virtual desktop. At the same time, the controlled end displays the second virtual desktop to prompt that the controlled end is in a remote control state. Even if there are unauthorized personnel next to the desktop screen of the controlled end during the remote control process, information leakage can be avoided, thereby achieving effective information protection of the desktop screen of the controlled end.

[0139] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0140] Figure 6 The invention is a block diagram of an electronic device for remote control according to an exemplary embodiment, which includes a processor and a memory, wherein the memory is used to store computer programs; and the processor is used to execute the programs stored in the memory.

[0141] The memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0142] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0143] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the above instructions can be executed by a processor of an electronic device to perform the above method. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0144] In an exemplary embodiment, a computer program product is also provided. When the computer program product is executed on a computer, the computer implements the above-mentioned method for remote control of comments.

[0145] As can be seen from the above, the technical solution provided by the embodiment of the embodiment of the present invention is that the controlled end can create a first virtual desktop and a second virtual desktop after the remote control software is started, wherein the first virtual desktop is generated according to the environmental parameters of the controlled end, and after being encapsulated with the watermark information, it is sent to the main control end, so that the main control end can remotely control the controlled end based on the first virtual desktop. At the same time, the controlled end displays the second virtual desktop to prompt that the controlled end is in a remote control state. Even if there are unauthorized personnel next to the desktop screen of the controlled end during the remote control process, information leakage can be avoided, thereby achieving effective information protection of the desktop screen of the controlled end.

[0146] Figure 7 is a block diagram of a device 800 for remote control according to an exemplary embodiment.

[0147] For example, apparatus 800 may be a mobile phone, a computer, a digital broadcast electronic device, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0148] Reference Figure 7 , the device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0149] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0150] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0151] The power supply component 807 provides power to the various components of the device 800. The power supply component 807 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0152] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the account. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the account. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data to be processed. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0153] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0154] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0155] The sensor assembly 814 includes one or more sensors for providing various aspects of the status assessment of the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, and the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of contact with the device 800, the orientation or acceleration / deceleration of the device 800, and the temperature change of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0156] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0157] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the methods described in the first and second aspects.

[0158] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the device 800 to complete the above method. Optionally, for example, the storage medium can be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0159] In an exemplary embodiment, a computer program product including instructions is also provided. When the computer program product is executed on a computer, the computer is enabled to execute the remote control method described in any one of the above embodiments.

[0160] As can be seen from the above, the technical solution provided by the embodiment of the embodiment of the present invention is that the controlled end can create a first virtual desktop and a second virtual desktop after the remote control software is started, wherein the first virtual desktop is generated according to the environmental parameters of the controlled end, and after being encapsulated with the watermark information, it is sent to the main control end, so that the main control end can remotely control the controlled end based on the first virtual desktop. At the same time, the controlled end displays the second virtual desktop to prompt that the controlled end is in a remote control state. Even if there are unauthorized personnel next to the desktop screen of the controlled end during the remote control process, information leakage can be avoided, thereby achieving effective information protection of the desktop screen of the controlled end.

[0161] Those skilled in the art will readily appreciate other implementations of the embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The embodiments of the present invention are intended to cover any variations, uses, or adaptations of the embodiments of the present invention that follow the general principles of the embodiments of the present invention and include common knowledge or customary technical means in the art that are not disclosed in the embodiments of the present invention. The specification and embodiments are to be regarded as exemplary only, and the true scope and spirit of the embodiments of the present invention are indicated by the following claims.

[0162] It should be understood that the embodiments of the present invention are not limited to the precise structures described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the embodiments of the present invention is limited only by the appended claims.

Claims

1. A remote control method, characterized in that: Applied to the controlled end of remote control software, including: In response to a startup instruction of the remote control software, generating watermark information of the controlled terminal; When the controlled terminal is successfully connected to the main control terminal, a first virtual desktop is created according to the environmental parameters of the controlled terminal; Encapsulating the watermark information and the first virtual desktop to obtain data to be transmitted, and sending the data to be transmitted to the main control end; Creating a second virtual desktop, and switching the current display interface to the second virtual desktop, wherein the second virtual desktop is used to prompt that the controlled terminal is in a remote control state; The operation instruction returned by the main control end is received, and a corresponding operation is performed on the first virtual desktop based on the operation instruction.

2. The method according to claim 1, characterized in that When the controlled terminal is successfully connected to the master terminal, before creating the first virtual desktop according to the environment parameters of the controlled terminal, the method includes: In response to a system startup instruction of the controlled terminal, installing a graphics card filter driver; Run the graphics card filter driver to divide the graphics card resources of the controlled end into a first virtual graphics card and a second virtual graphics card; wherein the first virtual graphics card is used for image processing of the current display interface of the controlled end, and the second virtual graphics card is used for image processing of the first virtual desktop and the second virtual desktop.

3. The method according to claim 2, characterized in that When the controlled terminal is successfully connected to the master terminal, creating a first virtual desktop according to the environment parameters of the controlled terminal includes: Receiving a remote control request sent by the master control terminal, and performing identity authentication on the master control terminal; When the identity authentication of the master terminal is passed, the desktop creation interface is called through the second virtual graphics card to create a first virtual desktop according to the environmental parameters of the controlled terminal.

4. The method according to claim 3, characterized in that The remote control request carries the session control information of the master terminal; The step of calling a desktop creation interface through the second virtual graphics card and creating a first virtual desktop according to the environment parameters of the controlled terminal includes: Associating the session control information with the second virtual graphics card; According to the session control information, the desktop creation interface is called by using the second virtual graphics card, and the first virtual desktop is created according to the environmental parameters of the controlled terminal.

5. The method according to claim 4, characterized in that The step of creating the second virtual desktop includes: In the case where the identity authentication of the master control end is passed, or in the case where the identity authentication of the master control end is passed and notification information of the master control end is received, determining the second virtual graphics card according to the session control information; the notification information is used to indicate that the connection between the master control end and the controlled end is stable; The desktop creation interface is called through the second virtual graphics card to create a second virtual desktop.

6. The method according to claim 1, characterized in that The watermark information is an invisible digital watermark, and the step of generating the watermark information of the controlled terminal includes: generating a watermark window including the invisible digital watermark; The encapsulating the watermark information and the first virtual desktop to obtain data to be transmitted includes: The watermark window is embedded in the first virtual desktop to obtain data to be transmitted.

7. The method according to claim 1, characterized in that After sending the data to be transmitted to the master control end, the method further includes: In response to the exit instruction of the master terminal, the first virtual desktop and the second virtual desktop are destroyed, and the current display interface is switched to the original desktop of the controlled terminal.

8. A remote control device, characterized in that: Applied to the controlled end of remote control software, including: A response module, used for generating watermark information of the controlled terminal in response to a startup instruction of the remote control software; A first creation module, configured to create a first virtual desktop according to the environment parameters of the controlled terminal when the controlled terminal is successfully connected to the master terminal; An encapsulation module, used for encapsulating the watermark information and the first virtual desktop, obtaining data to be transmitted, and sending the data to be transmitted to the main control end; A second creation module, used for creating a second virtual desktop and switching the current display interface to the second virtual desktop, wherein the second virtual desktop is used for prompting that the controlled terminal is in a remote control state; The execution module is used to receive the operation instruction returned by the main control end, and execute a corresponding operation on the first virtual desktop based on the operation instruction.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the remote control method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the remote control method according to any one of claims 1 to 7 are implemented.

Images