Remote control method and device

Abstract

The present invention provides a remote control method and device, including: after a first terminal shares the control function of a second terminal on a device, receiving a media stream transmitted by a server; playing the media stream on a shared page; when a control operation for a target function on the shared page is detected, generating a control instruction for the target function, and transmitting the control instruction to the target device through a server. In the present invention, the server caches the screenshot transmitted by the second terminal to generate a media stream, so that the first terminal receives the media stream without image distortion and freeze, and can identify the function of the device that the user corresponding to the second terminal needs to control through the media stream, so that the second terminal can accurately and timely control the device that the second terminal needs to control, thereby improving the reliability of remote control of home appliances.

Description

Technical Field

[0001] The present invention relates to remote control technology, and in particular to a remote control method and device. Background Art

[0002] With the development of society and household appliance technology, smart home appliances have become indispensable appliances in people's lives.

[0003] Special groups such as the elderly have some difficulties in learning to use smart home appliances. In order to facilitate these special groups to use smart home appliances, control devices with takeover functions have been developed. Special groups can start the takeover function in the control device, so that the control device can share the screen, and then request others to remotely control the smart home appliances through the terminal through the control page of the screen sharing.

[0004] At present, in screen sharing technology, the requester and the requested party need to be online at the same time, that is, the terminal of the requester needs to transmit images or videos to the terminal of the requested party in real time. However, if the terminal has poor network performance, the transmitted images or videos will be stuck and distorted, resulting in the inability to control home appliances, and the remote control reliability of home appliances is poor. Summary of the invention

[0005] The present invention provides a remote control method and device for solving the problem of poor reliability of remote control of household electrical appliances.

[0006] In one aspect, the present invention provides a remote control method, applied to a first terminal, comprising:

[0007] After the first terminal shares the control function of the second terminal on the device, receiving a media stream transmitted by the server, wherein the media stream is generated by the server according to the screenshot transmitted by the second terminal, and the screenshot is used to record the user's operation on the control page on the second terminal;

[0008] Playing the media stream on the shared page, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device;

[0009] When a control operation on the target function on the shared page is detected, a control instruction for the target function is generated, and the control instruction is transmitted to the target device through the server.

[0010] In one embodiment, the step of transmitting the control instruction to the target device via the server includes:

[0011] Generate icon information corresponding to the control instruction;

[0012] The icon information is transmitted to the second terminal through the server, and the control instruction is transmitted to the target device through the server, wherein the second terminal adds the icon corresponding to the icon information to the control page, and when a touch operation of the icon is detected, the second terminal sends the control instruction to the target device.

[0013] In one embodiment, after the first terminal shares the control function of the second terminal on the device, before the step of receiving the media stream transmitted by the server, the step further includes:

[0014] receiving a takeover request sent by the second terminal;

[0015] Obtaining an encrypted message according to the takeover request, and performing a takeover verification according to the encrypted message;

[0016] When the takeover verification passes, prompt information indicating that the takeover verification passes is sent to the second terminal, and the prompt information indicating that the takeover verification passes is used by the second terminal to authorize the first terminal to share the control function of the second terminal.

[0017] In one embodiment, the step of receiving the media stream transmitted by the server includes:

[0018] When receiving the prompt information sent by the server that the media stream has been generated, stop sending the picture displayed by the first terminal to the second terminal through the server, and send a first acquisition request to the server;

[0019] A response to the first acquisition request sent by the server is received, wherein the response to the second acquisition request includes the media stream.

[0020] In one embodiment, the step of receiving the image information transmitted by the server includes:

[0021] Acquire a second acquisition request input through the sharing page, where the second acquisition request is used to request acquisition of the media stream;

[0022] Sending the second acquisition request to the server;

[0023] A response to the second acquisition request sent by the server is received, where the response to the second acquisition request includes the media stream.

[0024] On the other hand, the present invention provides a remote control method, applied to a second terminal, comprising:

[0025] When the second terminal authorizes the first terminal to share the control function of the second terminal on the device and an operation on the control page of the second terminal is detected, a screenshot corresponding to the control page is generated, where the screenshot is used to record the user's operation on the control page;

[0026] Transmitting each of the screenshots to the server, wherein each of the screenshots is used by the server to generate a media stream, and the first terminal controls a target function of a target device according to the media stream sent by the server;

[0027] Receive prompt information of target function control sent by the target device controlled by the second terminal, where the prompt information of target function control is sent after the first terminal controls the target function of the target device.

[0028] In one embodiment, after the step of receiving the prompt information of the target function control sent by the target device controlled by the second terminal, the method further includes:

[0029] Receiving icon information sent by the server;

[0030] An icon corresponding to the icon information is added on the control page, wherein the second terminal sends the control instruction to the target device when detecting a touch operation of the icon.

[0031] In one embodiment, before the step of generating a screenshot corresponding to the control page when the second terminal authorizes the first terminal to share the control function of the second terminal on the device and the user operates the control page of the second terminal, the step further includes:

[0032] Obtaining an encrypted message, and generating a takeover request according to the encrypted message;

[0033] Sending the takeover request to the first terminal, wherein the encrypted message is used by the first terminal to perform takeover verification;

[0034] When receiving the prompt information sent by the second terminal indicating that the takeover verification has passed, authorization information is sent to the second terminal, where the authorization information is used by the second terminal to authorize the first terminal to share the control function of the second terminal over the device.

[0035] In one embodiment, the step of transmitting each of the screenshots to the server includes:

[0036] Outputting a selection interface, wherein the selection interface displays a sharing mode in which the second terminal shares the control function;

[0037] Acquire selection information of the selection interface;

[0038] When it is determined according to the selection information that the sharing mode is delayed sharing, generating sharing information corresponding to the delayed sharing;

[0039] The sharing information is sent to the server, where the sharing information is used to indicate that the sharing mode is delayed sharing.

[0040] On the other hand, the present invention provides a remote control method, applied to a server, comprising:

[0041] After the first terminal shares the control function of the second terminal on the device, receiving each screenshot transmitted by the second terminal, wherein the screenshot is used to record the user's operation on the control page on the second terminal;

[0042] generating a media stream according to each of the screenshots, and sending the media stream to the first terminal, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device;

[0043] A control instruction sent by the first terminal is received, and the control instruction is sent to the target device, wherein the control instruction is generated when the second terminal detects a control operation on the target function on the shared page.

[0044] In one embodiment, the step of receiving a control instruction sent by the first terminal and sending the control instruction to the target device includes:

[0045] Receiving a control instruction sent by the first terminal and icon information corresponding to the control instruction;

[0046] The control instruction is sent to the target device, and the icon information is sent to the second terminal, wherein the second terminal adds the icon corresponding to the icon information to the control page, and sends the control instruction to the target device when a touch operation of the icon is detected.

[0047] In one embodiment, the step of sending the media stream to the first terminal includes:

[0048] Prompt information that the media stream has been generated is sent to the first terminal;

[0049] Receiving a first acquisition request sent by the first terminal;

[0050] A response to the first acquisition request is sent to the first terminal, where the response to the first acquisition request includes the media stream.

[0051] In one embodiment, the step of sending the media stream to the first terminal includes:

[0052] receiving a second acquisition request sent by the first terminal;

[0053] A response to the second acquisition request is sent to the first terminal, where the response to the second acquisition request includes the media stream.

[0054] In one embodiment, the step of generating a media stream according to each of the screenshots includes:

[0055] receiving the shared information sent by the second terminal;

[0056] When it is determined according to the sharing information that the first terminal delays sharing of the control function of the second terminal, a media stream is generated according to each of the screenshots.

[0057] In another aspect, the present invention provides a terminal, comprising:

[0058] A first receiving module, configured to receive a media stream transmitted by a server after the first terminal shares the control function of the second terminal on the device, wherein the media stream is generated by the server according to a screenshot transmitted by the second terminal, and the screenshot is used to record the user's operation on the control page on the second terminal;

[0059] A playing module, used for playing the media stream on the shared page, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device;

[0060] The first generating module is used to generate a control instruction of the target function when a control operation on the target function on the shared page is detected, and transmit the control instruction to the target device through the server.

[0061] In another aspect, the present invention provides a terminal, comprising:

[0062] A second receiving module is used to generate a screenshot corresponding to the control page when the second terminal authorizes the first terminal to share the control function of the second terminal on the device and an operation on the control page of the second terminal is detected, and the screenshot is used to record the user's operation on the control page;

[0063] A transmission module, used to transmit each of the screenshots to the server, wherein each of the screenshots is used by the server to generate a media stream, and the first terminal controls a target function of a target device according to the media stream sent by the server;

[0064] The second receiving module is further configured to receive prompt information of target function control sent by the target device controlled by the second terminal, wherein the prompt information of target function control is sent after the first terminal controls the target function of the target device.

[0065] In another aspect, the present invention provides a server, comprising:

[0066] A third receiving module, configured to receive each screenshot transmitted by the second terminal after the first terminal shares the control function of the second terminal on the device, wherein the screenshot is used to record the user's operation on the control page on the second terminal;

[0067] A second generating module, configured to generate a media stream according to each of the screenshots, and send the media stream to the first terminal, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device;

[0068] The third receiving module is further configured to receive a control instruction sent by the first terminal and send the control instruction to the target device, wherein the control instruction is generated when the second terminal detects a control operation on the target function on the shared page.

[0069] The remote control method and device provided by the present invention, after the first terminal shares the control function of the second terminal on the device, receives the media stream generated by the server based on all the screenshots sent by the second terminal that record the user's operations on the control page, and plays the media stream on the shared page so that the user corresponding to the first terminal can identify the target device that the second terminal user needs to control and the control operation of the target device. After detecting the control operation for the target function of the target device on the shared page, a control instruction corresponding to the target function is generated, and the control instruction is sent to the target device through the server. In the present invention, the server caches all the screenshots transmitted by the second terminal to generate a media stream, so that the first terminal does not have image distortion and freeze when receiving the media stream, and can identify the function of the device that the user corresponding to the second terminal needs to control through the media stream, so that the second terminal can accurately and timely control the device that the second terminal needs to control, thereby improving the reliability of remote control of home appliances. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0071] Figure 1 A system architecture diagram for realizing the remote control method of the present invention;

[0072] Figure 2It is a flowchart of the first embodiment of the remote control method of the present invention;

[0073] Figure 3 It is a flowchart of a second embodiment of the remote control method of the present invention;

[0074] Figure 4 It is a flowchart of a third embodiment of the remote control method of the present invention;

[0075] Figure 5 A schematic diagram of a functional module of a terminal of the present invention;

[0076] Figure 6 is another functional module schematic diagram of the terminal of the present invention;

[0077] Figure 7 It is a schematic diagram of the functional modules of the server of the present invention;

[0078] Figure 8 Schematic diagram of the hardware structure of the terminal / server of the present invention.

[0079] The above drawings show clear embodiments of the present disclosure, which will be described in more detail below. These drawings and text descriptions are not intended to limit the scope of the present disclosure in any way, but to illustrate the concepts of the present disclosure to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0080] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0081] The present invention provides a remote control method, which can be Figure 1 The system architecture diagram shown in the figure is implemented. Figure 1As shown, the first terminal 100 is connected to the second terminal 200 in communication, and both the first terminal 100 and the second terminal 200 are connected to the server 300 in communication. The first terminal 100 and the second terminal 200 can be home appliances or control terminals, and the two terminals have screens, so that the first terminal 100 can share the screen with the second terminal 200. The screen sharing between the first terminal 100 and the second terminal 200 is realized by the server 300, that is, the second terminal 200 sends the content displayed on the screen to the server 300, and the server 300 forwards these contents to the first terminal 100. The first terminal 100 and the second terminal 200 can share the screen in real time, and the real-time sharing means that the server 300 transmits the content of the screen of the second terminal 200 to the first terminal 100 in real time, and the first terminal 100 and the second terminal 200 can make a voice call through the server, and the server 300 then feeds back the coordinates of the operation of the first terminal 100 to the second terminal 200, and the second terminal 200 performs the same operation as the user of the first terminal 100 according to the coordinates. The first terminal 100 and the second terminal 200 can also perform delayed screen sharing. The second terminal 200 can record screenshots of the user's operations on the screen of the second terminal 200 and upload the screenshots to the server 300. The server 300 generates media streams from all the screenshots. The server 300 then notifies the first terminal 100 of the generation of the media stream. If the user of the first terminal 100 is idle, the media stream can be downloaded from the server 300. The device and the function of the device to be controlled by the second terminal 200 can be identified through the played media stream, and then the corresponding operation can be performed on the first terminal 100 to generate the corresponding control instruction. The first terminal 100 then sends the control instruction to the server 300 without sending the operation performed on the screen of the first terminal 100. The server 300 then sends the control instruction to the device to be controlled, thereby realizing delayed screen sharing of the first terminal 100 and the second terminal 200.

[0082] The following specific embodiments are used to describe in detail the technical solutions of the present invention and how the technical solutions of the present application solve the above-mentioned technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0083] Reference Figure 2 , Figure 2 This is a first embodiment of the remote control method of the present invention, which is applied to a first terminal. The remote control method includes the following steps:

[0084] Step S10, after the first terminal shares the control function of the second terminal on the device, receives the media stream transmitted by the server, wherein the media stream is generated by the server according to the screenshot transmitted by the second terminal, and the screenshot is used to record the user's operation on the control page on the second terminal.

[0085] In this embodiment, the execution subject is the first terminal. The first terminal can be a device with a screen such as a mobile phone, a computer, or a home appliance. The first terminal can take over the second terminal. Taking over means that the first terminal shares the control function of the second terminal on the device, that is, the device can respond to the control instructions issued by the first terminal, and can also respond to the control instructions issued by the second terminal. The device refers to home appliances such as washing machines and televisions. The second terminal is the party requesting help, and the first terminal is the helping party.

[0086] The second terminal has a takeover function. After the takeover function is started, the first terminal can share the control function of the second terminal on the device. After the takeover function is started, the second terminal can start screen sharing. Screen sharing includes two sharing methods. One sharing method is real-time sharing, that is, the second terminal transmits the content of its own screen to the first terminal through the server, and the first terminal and the second terminal can have real-time voice, which facilitates the remote control of the second terminal by the first terminal. Another sharing method is delayed sharing. Delayed sharing means that the operations performed by the user on the control page of the second terminal are screenshoted by the second terminal, and each screenshot is sent to the server, and the user can leave without waiting for feedback from the first terminal after the operation. This embodiment describes delayed sharing in detail.

[0087] When the second terminal opens delayed sharing, the second terminal will take a screenshot when it detects the user's operation on the control page. That is, the screenshot is used to record the user's operation on the control page on the second terminal. The control page is the interface displayed on the screen of the second terminal. The user can control the device and its functions through the control page. The second terminal will take a screenshot. Figure 1 Once sent to the server, after receiving all the screenshots, the server generates a media stream according to the sending time of the screenshots. The media stream records the user's actions on the control page.

[0088] The server sends the generated media stream to the first terminal. Since the real-time sharing of the second terminal is to share the screen of the second terminal to the second terminal in real time, when the first terminal receives the media stream, it can be determined that the second terminal has enabled delayed sharing.

[0089] Step S20: Play the media stream on the shared page, wherein the media stream includes the target device to be controlled by the second terminal and the target function to be controlled by the target device.

[0090] The first terminal is provided with a shared page, which is an H5 page. The shared page is generated based on the control page of the second terminal, that is, the operation of the user of the first terminal on the shared page is equivalent to the operation of the user of the second terminal on the control page. The first terminal plays the media stream on the shared page. Since the media stream is generated by each screenshot, there are actions of the second terminal operating on the control page in the media stream, and the action can determine the target device to be controlled by the user at the second terminal and the target function to be controlled by the target device, that is, the media stream includes the target device to be controlled by the second terminal and the target function to be controlled by the target device.

[0091] The user of the first terminal can determine the target device that the user of the second terminal needs to control and the target function to be controlled by the target device based on the played media stream. The user of the first terminal can operate on the shared page, that is, perform control operations on the target function on the shared page, and the first terminal can generate control instructions for the target function based on the first control operation.

[0092] Step S30, when a control operation on a target function on a shared page is detected, a control instruction for the target function is generated, and the control instruction is transmitted to the target device through the server.

[0093] If the first terminal detects a control operation on a target function on a shared page, it can generate a control instruction for the target function, and then transmit the control instruction to the target device through the server, so that the target device responds to the control instruction, thereby enabling the first terminal to help the second terminal control the target function of the target device, thereby completing the request for help from the user of the first terminal. It should be noted that since the sharing method of the first terminal is delayed sharing, the user of the first terminal may not be waiting online, so the screen of the operation of the shared page on the second terminal does not need to be sent to the first terminal through the server.

[0094] In the technical solution provided in the embodiment of this year, after the first terminal shares the control function of the second terminal on the device, the receiving server generates a media stream based on all the screenshots sent by the second terminal that record the user's operations on the control page, and plays the media stream on the shared page for the user corresponding to the first terminal to identify the target device that the second terminal user needs to control and the control operation of the target device. When the control operation for the target function of the target device on the shared page is detected, a control instruction corresponding to the target function is generated, and the control instruction is sent to the target device through the server. In the present invention, the server caches all the screenshots transmitted by the second terminal to generate a media stream, so that the first terminal does not experience image distortion and freeze when receiving the media stream, and can identify the function of the device that the user corresponding to the second terminal needs to control through the media stream, so that the second terminal can accurately and timely control the device that the second terminal needs to control, thereby improving the reliability of remote control of home appliances.

[0095] In one embodiment, step S30 includes:

[0096] Generate icon information corresponding to the control instruction;

[0097] The icon information is transmitted to the second terminal through the server, and the control instruction is transmitted to the target device through the server, wherein the second terminal adds the icon corresponding to the icon information to the control page, and when a touch operation of the icon is detected, the second terminal sends the control instruction to the target device.

[0098] In this embodiment, after generating a control instruction, the first terminal generates icon information of the control instruction and sends the icon information to the second terminal through the server. The icon information is the data encapsulated by the icon corresponding to the control instruction. There may be multiple control instructions, that is, the control of the target function may require multiple control instructions to achieve the control of the target function. The first terminal forms each control instruction into an icon, which is a key icon, and gives the icon the function of controlling the target function. The first terminal sends the icon to the second terminal. The second terminal outputs a prompt message whether to save the icon. If the second terminal agrees to save the icon, the second terminal adds the icon to the control page, and the user can click on the icon through the control page to directly control the target function without performing multiple operations to obtain multiple control instructions to achieve the control of the target function. The user can rename the icon on the control page, and then know the function of the icon through the renamed name. It can be understood that the second terminal adds the icon corresponding to the icon information to the control page, and when the touch operation of the icon is detected, the second terminal sends the control instruction to the target device. The icon information can be parsed to obtain the icon corresponding to the icon information.

[0099] In the technical solution provided in this embodiment, the first terminal generates an icon corresponding to the control instruction and transmits the icon to the second terminal through the server, so that the user of the second terminal can directly control the target function of the target device through the icon, avoiding the user of the second terminal from repeatedly asking the first terminal for help to control the same function.

[0100] In one embodiment, before step S10, the method further includes:

[0101] receiving a takeover request sent by the second terminal;

[0102] Obtaining the encrypted message according to the takeover request, and performing takeover verification based on the encrypted message;

[0103] When the takeover verification is passed, a prompt message indicating that the takeover verification is passed is sent to the second terminal, and the prompt message indicating that the takeover verification is passed is used by the second terminal to authorize the first terminal to share the control function of the second terminal.

[0104] In this embodiment, considering the security of user data and devices, the first terminal enables the takeover function, and a specific encryption verification is required between the first terminal and the second terminal. In addition, in order to facilitate the request initiator to use the takeover function, the takeover function of the first terminal needs to be made into a one-key takeover trigger button. After the verification of the first terminal and the second terminal is passed, the takeover function of the first terminal is authorized successfully, and the first terminal can enable the takeover function.

[0105] Specifically, the second terminal obtains verification data, encrypts the verification data to obtain an encrypted message, generates a takeover request based on the encrypted message, and sends the takeover request to the first terminal. After receiving the takeover request, the first terminal parses the takeover request to obtain an encrypted message, decrypts the encrypted message to obtain verification data, and then uses the verification data to perform takeover verification. If the verification data is the same as the verification data stored in the first terminal, the takeover verification passes, and the first terminal sends a prompt message indicating that the takeover verification passes to the second terminal. When the second terminal receives the prompt message, it authorizes the first terminal to share the second terminal's control function of the device, that is, the second terminal successfully starts the takeover function.

[0106] In one embodiment, step S10 includes:

[0107] When receiving the prompt information sent by the server that the media stream has been generated, stop sending the picture displayed by the first terminal to the second terminal through the server, and send a first acquisition request to the server;

[0108] A response to the first acquisition request sent by the server is received, where the response to the first acquisition request includes a media stream.

[0109] In this embodiment, the user of the first terminal can delay helping the second terminal to control the device. After generating the media stream, the server sends a prompt message to the first terminal that the media stream has been generated, prompting the user of the first terminal to help the second terminal control the device. It should be noted that when the first terminal receives the prompt message that the media stream has been generated, the first terminal can determine that the second terminal is delayed sharing, that is, the user of the second terminal is not online, so the first terminal wirelessly shares the screen with the second terminal. When the first terminal receives the prompt message that the media stream has been generated sent by the server, it stops sending the screen displayed by the first terminal to the second terminal through the server.

[0110] After the user of the first terminal is idle, he can click on the prompt information, and the first terminal sends a first acquisition request to the server. The first acquisition request is used to obtain the media stream from the server. When the server receives the first acquisition request, it feeds back a response to the first acquisition request to the first terminal, and the response to the first acquisition request includes the media stream. That is, the first terminal receives the response to the first acquisition request sent by the server, and can obtain the media stream.

[0111] In one embodiment, step S10 includes:

[0112] Acquire a second acquisition request input through the sharing page, where the second acquisition request is used to request acquisition of a media stream;

[0113] Sending a second get request to the server;

[0114] A response to the second acquisition request sent by the server is received, where the response to the second acquisition request includes a media stream.

[0115] In this embodiment, the user of the first terminal can instantly help the second terminal to control the device, that is, the user of the first terminal actively requests the server to obtain the media stream.

[0116] Specifically, the user of the first terminal enters a second acquisition request on the sharing page, and the second acquisition request is used to request to obtain the media stream, that is, the first terminal obtains the second acquisition request. The first terminal sends the second acquisition request to the server. After generating the media stream, the server sends a response to the second acquisition request to the first terminal, and the response to the second acquisition request includes the media stream.

[0117] The invention also provides a remote control method.

[0118] Reference Figure 3 , Figure 3 The second embodiment of the remote control method of the present invention is applied to a second terminal. The remote control method includes:

[0119] Step S40, when the second terminal authorizes the first terminal to share the control function of the second terminal on the device and detects an operation on the control page of the second terminal, a screenshot corresponding to the control page is generated, and the screenshot is used to record the user's operation on the control page.

[0120] In this embodiment, the execution subject is the second terminal. The second terminal can be a device with a screen such as a mobile phone, a computer, or a home appliance. The first terminal can take over the second terminal. Taking over means that the first terminal shares the control function of the second terminal on the device, that is, the device can respond to the control instructions issued by the first terminal, and can also respond to the control instructions issued by the second terminal. The device refers to home appliances such as washing machines and televisions. The second terminal is the party requesting help, and the first terminal is the helping party.

[0121] The second terminal has a takeover function. After the takeover function is started, the first terminal can share the control function of the second terminal on the device. After the takeover function is started, the second terminal can start screen sharing. Screen sharing includes two sharing methods. One sharing method is real-time sharing, that is, the second terminal transmits the content of its own screen to the first terminal through the server, and the first terminal and the second terminal can have real-time voice, which facilitates the remote control of the second terminal by the first terminal. Another sharing method is delayed sharing. Delayed sharing means that the operations performed by the user on the control page of the second terminal are screenshoted by the second terminal, and each screenshot is sent to the server, and the user can leave without waiting for feedback from the first terminal after the operation. This embodiment describes delayed sharing in detail.

[0122] When the second terminal turns on delayed sharing, that is, the second terminal authorizes the first terminal to share the second terminal's control function of the device, and the second terminal generates a screenshot corresponding to the control page when detecting an operation on the control page, that is, a screenshot of the user's operation on the control page.

[0123] The control page is the interface displayed on the second terminal screen, and the user can control the device and its functions through the control page.

[0124] Step S50: transmitting each screenshot to the server, wherein each screenshot is used by the server to generate a media stream, and the first terminal controls the target function of the target device according to the media stream sent by the server.

[0125] The second terminal will Figure 1 Once sent to the server, after receiving all the screenshots, the server generates a media stream according to the sending time of the screenshots, and the media stream records the user's actions on the control page. It should be noted that the server can compress the screenshots to generate a media stream with a smaller data volume.

[0126] The server sends the generated media stream to the first terminal. Since the real-time sharing of the second terminal is to share the screen of the second terminal to the second terminal in real time, when the first terminal receives the media stream, it can be determined that the second terminal has enabled delayed sharing.

[0127] The first terminal is provided with a shared page, which is an H5 page. The shared page is generated based on the control page of the second terminal, that is, the operation of the user of the first terminal on the shared page is equivalent to the operation of the user of the second terminal on the control page. The first terminal plays the media stream on the shared page. Since the media stream is generated by each screenshot, there are actions of the second terminal operating on the control page in the media stream, and the action can determine the target device to be controlled by the user at the second terminal and the target function to be controlled by the target device, that is, the media stream includes the target device to be controlled by the second terminal and the target function to be controlled by the target device.

[0128] The user of the first terminal can determine the target device that the user of the second terminal needs to control and the target function to be controlled by the target device based on the played media stream. The user of the first terminal can operate on the shared page, that is, perform control operations on the target function on the shared page, and the first terminal can generate control instructions for the target function based on the first control operation.

[0129] The control instructions of the function are transmitted to the target device through the server.

[0130] If the first terminal detects a control operation on a target function on a shared page, it can generate a control instruction for the target function, and then transmit the control instruction to the target device through the server, so that the target device responds to the control instruction, thereby enabling the first terminal to help the second terminal control the target function of the target device, thereby completing the request for help from the user of the first terminal. It should be noted that since the sharing method of the first terminal is delayed sharing, the user of the first terminal may not be waiting online, so the screen of the operation of the shared page on the second terminal does not need to be sent to the first terminal through the server.

[0131] Step S60: receiving prompt information of target function control sent by the target device controlled by the second terminal, where the prompt information of target function control is sent after the first terminal controls the target function of the target device.

[0132] After the target function of the target device responds to the control instruction, the target device sends a prompt message of the target function control to the second terminal, that is, the prompt message of the target function control is sent by the first terminal after the target function of the target device is controlled. The prompt message is used to prompt the user of the first terminal to complete the control of the target device.

[0133] In the technical solution provided in this embodiment, when the second terminal authorizes the first terminal to share the control function of the second terminal on the device, and the user operates the control page of the second terminal, a screenshot corresponding to the control page is generated, and each screenshot is sent to the server, so that the server generates a media stream based on the screenshot, so that the second terminal can control the target function of the target device based on the media stream. In the present invention, the server caches all the screenshots transmitted by the second terminal to generate a media stream, so that the first terminal receives the media stream without image distortion and freeze, and the function of the device that the user corresponding to the second terminal needs to control can be identified through the media stream, so that the second terminal can accurately and timely control the device that the second terminal needs to control, thereby improving the reliability of remote control of home appliances.

[0134] In one embodiment, after step S60, the method further includes:

[0135] Receive icon information sent by the server;

[0136] An icon corresponding to the icon information is added on the control page, wherein the second terminal sends a control instruction to the target device when a touch operation of the icon is detected.

[0137] In this embodiment, after generating a control instruction, the first terminal generates icon information of the control instruction and sends the icon information to the second terminal through the server. The icon information is the data encapsulated by the icon corresponding to the control instruction. There may be multiple control instructions, that is, the control of the target function may require multiple control instructions to achieve the control of the target function. The first terminal forms each control instruction into an icon, which is a key icon, and gives the icon the function of controlling the target function. The first terminal sends the icon to the second terminal. The second terminal outputs a prompt message whether to save the icon. If the second terminal agrees to save the icon, the second terminal adds the icon to the control page, and the user can click on the icon through the control page to directly control the target function without performing multiple operations to obtain multiple control instructions to achieve the control of the target function. The user can rename the icon on the control page, and then know the function of the icon through the renamed name. It can be understood that the second terminal adds the icon corresponding to the icon information to the control page, and when the touch operation of the icon is detected, the second terminal sends the control instruction to the target device. The icon information can be parsed to obtain the icon corresponding to the icon information.

[0138] In the technical solution provided in this embodiment, the second terminal receives the icon corresponding to the control instruction generated by the first terminal, and adds the icon to the control page, so that the user of the second terminal can directly control the target function of the target device through the icon, avoiding the user of the second terminal from repeatedly asking the first terminal for help to control the same function.

[0139] In one embodiment, before step S40, the method further includes:

[0140] Obtaining the encrypted message, and generating a takeover request according to the encrypted message;

[0141] Sending a takeover request to the first terminal, wherein the encrypted message is used by the first terminal to perform takeover verification;

[0142] When receiving the prompt information sent by the second terminal indicating that the takeover verification has passed, the authorization information is sent to the second terminal, where the authorization information is used by the second terminal to authorize the first terminal to share the control function of the second terminal over the device.

[0143] In this embodiment, considering the security of user data and devices, the first terminal enables the takeover function, and a specific encryption verification is required between the first terminal and the second terminal. In addition, in order to facilitate the request initiator to use the takeover function, the takeover function of the first terminal needs to be made into a one-key takeover trigger button. After the verification of the first terminal and the second terminal is passed, the takeover function of the first terminal is authorized successfully, and the first terminal can enable the takeover function.

[0144] Specifically, the second terminal obtains verification data, encrypts the verification data to obtain an encrypted message, generates a takeover request based on the encrypted message, and sends the takeover request to the first terminal. After receiving the takeover request, the first terminal parses the takeover request to obtain an encrypted message, decrypts the encrypted message to obtain verification data, and then uses the verification data to perform takeover verification. If the verification data is the same as the verification data stored in the first terminal, the takeover verification passes, and the first terminal sends a prompt message indicating that the takeover verification passes to the second terminal. When the second terminal receives the prompt message, it sends authorization information to the second terminal, that is, the authorization information is used to authorize the first terminal to share the control function of the second terminal on the device, that is, the second terminal successfully turns on the takeover function.

[0145] In one embodiment, step S50 includes:

[0146] Outputting a selection interface, wherein the selection interface displays a sharing mode of the sharing control function of the second terminal;

[0147] Get the selection information of the selection interface;

[0148] When the sharing mode is determined to be delayed sharing according to the selection information, generating sharing information corresponding to the delayed sharing;

[0149] The sharing information is sent to the server, where the sharing information is used to indicate that the sharing mode is delayed sharing.

[0150] In this embodiment, after the second terminal authorizes the first terminal to share the control function of the second terminal on the device, the second terminal can output a selection interface, which displays the sharing method of the second terminal sharing the control function, that is, the user can choose real-time sharing or delayed sharing in the selection interface.

[0151] After the second terminal outputs the selection interface, the second user's terminal can perform a selection operation on the selection interface, so that the selection interface generates selection information corresponding to the selection operation. The selection information is the sharing method. When the selection information is delayed sharing, that is, when the sharing method is determined to be delayed sharing based on the selection information, sharing information corresponding to delayed sharing is generated. The second terminal sends the sharing information to the server, so that the server determines that the sharing method of the second terminal is delayed sharing based on the sharing information, that is, after receiving all the screenshots, the server compresses the screenshots and generates a media stream. If the server does not receive the sharing information, the server directly forwards the picture transmitted by the second terminal to the first terminal in real time without generating a media stream.

[0152] Reference Figure 4 , Figure 4 The third embodiment of the remote control method of the present invention is applied to a server. The remote control method includes:

[0153] Step S70, after the first terminal shares the control function of the second terminal on the device, receiving each screenshot transmitted by the second terminal, wherein the screenshot is used to record the user's operation on the control page on the second terminal.

[0154] In this embodiment, the execution subject is a server. The first terminal can share the control function of the second terminal on the device through the server.

[0155] The second terminal and the second terminal can be devices with screens such as mobile phones, computers, and home appliances. The first terminal can take over the second terminal. Taking over means that the first terminal shares the control function of the second terminal on the device, that is, the device can respond to the control instructions issued by the first terminal, and can also respond to the control instructions issued by the second terminal. The device refers to home appliances such as washing machines and televisions. The second terminal is the party requesting help, and the first terminal is the helping party.

[0156] The second terminal has a takeover function. After the takeover function is started, the first terminal can share the control function of the second terminal on the device. After the takeover function is started, the second terminal can start screen sharing. Screen sharing includes two sharing methods. One sharing method is real-time sharing, that is, the second terminal transmits the content of its own screen to the first terminal through the server, and the first terminal and the second terminal can have real-time voice, which facilitates the remote control of the second terminal by the first terminal. Another sharing method is delayed sharing. Delayed sharing means that the operations performed by the user on the control page of the second terminal are screenshoted by the second terminal, and each screenshot is sent to the server, and the user can leave without waiting for feedback from the first terminal after the operation. This embodiment describes delayed sharing in detail.

[0157] When the second terminal turns on delayed sharing, that is, the second terminal authorizes the first terminal to share the second terminal's control function of the device, and the second terminal detects the user's operation on the control page, it generates a screenshot corresponding to the control page, that is, it takes a screenshot of the user's operation on the control page.

[0158] The control page is the interface displayed on the second terminal screen, and the user can control the device and its functions through the control page.

[0159] The second terminal will Figure 1 One is sent to the server, that is, the server receives each screenshot transmitted by the second terminal.

[0160] Step S80: Generate a media stream according to each screenshot, and send the media stream to the first terminal, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device.

[0161] After receiving all the screenshots, the server generates a media stream according to the time point of sending the screenshots. The media stream records the user's actions on the control page, that is, the media stream includes the target device to be controlled by the second terminal and the target function to be controlled by the target device. It should be noted that the server can compress the screenshots to generate a media stream with a smaller data volume.

[0162] The server sends the generated media stream to the first terminal. Since the real-time sharing of the second terminal is to share the screen of the second terminal to the second terminal in real time, when the first terminal receives the media stream, it can be determined that the second terminal has enabled delayed sharing.

[0163] Step S90, receiving a control instruction sent by the first terminal, and sending the control instruction to the target device, wherein the control instruction is generated when the second terminal detects a control operation on a target function on the shared page.

[0164] The first terminal is provided with a shared page, which is an H5 page. The shared page is generated based on the control page of the second terminal, that is, the operation of the user of the first terminal on the shared page is equivalent to the operation of the user of the second terminal on the control page. The first terminal plays the media stream on the shared page. Since the media stream is generated by each screenshot, there are actions of the second terminal operating on the control page in the media stream, and the action can determine the target device to be controlled by the user at the second terminal and the target function to be controlled by the target device, that is, the media stream includes the target device to be controlled by the second terminal and the target function to be controlled by the target device.

[0165] The user of the first terminal can determine the target device that the user of the second terminal needs to control and the target function to be controlled by the target device based on the played media stream. The user of the first terminal can operate on the shared page, that is, perform control operations on the target function on the shared page, and the first terminal can generate control instructions for the target function based on the first control operation.

[0166] The control instructions of the function are transmitted to the target device through the server.

[0167] If the first terminal detects a control operation on a target function on a shared page, it can generate a control instruction for the target function, and then transmit the control instruction to the target device through the server, so that the target device responds to the control instruction, thereby enabling the first terminal to help the second terminal control the target function of the target device, thereby completing the request for help from the user of the first terminal. It should be noted that since the sharing method of the first terminal is delayed sharing, the user of the first terminal may not be waiting online, so the screen of the operation of the shared page on the second terminal does not need to be sent to the first terminal through the server.

[0168] In the technical solution provided in this embodiment, after the first terminal shares the control function of the second terminal on the device, the server receives each screenshot transmitted by the second terminal for recording the user's operation on the control page on the second terminal, and then generates a media stream based on each screenshot, and sends the media stream to the first terminal, so that the first terminal generates a control instruction to control the function of the target device based on the media stream, and the server then forwards the control instruction to the target device. In this embodiment, the server caches all the screenshots transmitted by the second terminal to generate a media stream, so that the first terminal does not experience image distortion and freeze when receiving the media stream, and can identify the function of the device that the user corresponding to the second terminal needs to control through the media stream, so that the second terminal can accurately and timely control the device that the second terminal needs to control, thereby improving the reliability of remote control of home appliances.

[0169] In one embodiment, step S90 includes:

[0170] Receiving a control instruction and icon information corresponding to the control instruction sent by the first terminal;

[0171] The control instruction is sent to the target device, and the icon information is sent to the second terminal, wherein the second terminal adds the icon corresponding to the icon information to the control page, and sends the control instruction to the target device when a touch operation of the icon is detected.

[0172] In this embodiment, after generating a control instruction, the first terminal generates icon information of the control instruction and sends the icon information to the second terminal through the server. The icon information is the data encapsulated by the icon corresponding to the control instruction. There may be multiple control instructions, that is, the control of the target function may require multiple control instructions to achieve the control of the target function. The first terminal forms each control instruction into an icon, which is a key icon, and gives the icon the function of controlling the target function. The first terminal sends the icon to the second terminal. The second terminal outputs a prompt message whether to save the icon. If the second terminal agrees to save the icon, the second terminal adds the icon to the control page, and the user can click on the icon through the control page to directly control the target function without performing multiple operations to obtain multiple control instructions to achieve the control of the target function. The user can rename the icon on the control page, and then know the function of the icon through the renamed name. It can be understood that the second terminal adds the icon corresponding to the icon information to the control page, and when the touch operation of the icon is detected, the second terminal sends the control instruction to the target device. The icon information can be parsed to obtain the icon corresponding to the icon information.

[0173] In the technical solution provided in this embodiment, the server receives the icon corresponding to the control instruction generated by the first terminal, and transmits the icon to the second terminal, so that the user of the second terminal can directly control the target function of the target device through the icon, avoiding the user of the second terminal from repeatedly asking the first terminal for help to control the same function.

[0174] In one embodiment, step S80 includes:

[0175] Prompt information that a media stream has been generated and sent to the first terminal;

[0176] Receiving a first acquisition request sent by a first terminal;

[0177] A response to the first acquisition request is sent to the first terminal, where the response to the first acquisition request includes a media stream.

[0178] In this embodiment, the user of the first terminal can help the second terminal control the device in a delayed manner. After generating the media stream, the server sends a prompt message that the media stream has been generated to the first terminal, prompting the user of the first terminal to help the second terminal control the device.

[0179] After the user of the first terminal is idle, he can click on the prompt information, and the first terminal sends a first acquisition request to the server. The first acquisition request is used to obtain the media stream from the server. When the server receives the first acquisition request, it feeds back a response to the first acquisition request to the first terminal, and the response to the first acquisition request includes the media stream. That is, the first terminal receives the response to the first acquisition request sent by the server, and the first terminal can obtain the media stream.

[0180] In one embodiment, step S80 includes:

[0181] Receiving a second acquisition request sent by the first terminal;

[0182] A response to the second acquisition request is sent to the first terminal, where the response to the second acquisition request includes a media stream.

[0183] In this embodiment, the user of the first terminal can instantly help the second terminal to control the device, that is, the user of the first terminal actively requests the server to obtain the media stream.

[0184] Specifically, the user of the first terminal enters a second acquisition request on the sharing page, and the second acquisition request is used to request to obtain the media stream, that is, the first terminal obtains the second acquisition request. The first terminal sends the second acquisition request to the server. After generating the media stream, the server sends a response to the second acquisition request to the first terminal, and the response to the second acquisition request includes the media stream.

[0185] In one embodiment, step S70 includes:

[0186] receiving shared information sent by the second terminal;

[0187] When it is determined according to the sharing information that the first terminal delays sharing of the control function of the second terminal, a media stream is generated according to each screenshot.

[0188] In this embodiment, after the second terminal authorizes the first terminal to share the second terminal's control function of the device, the second terminal can output a selection interface, which includes the sharing method of the second terminal's sharing control function, that is, the user can choose real-time sharing or delayed sharing in the selection interface.

[0189] After the second terminal outputs the selection interface, the second user's terminal can perform a selection operation on the selection interface, so that the selection interface generates selection information corresponding to the selection operation. The selection information is the sharing method. When the selection information is delayed sharing, that is, when the sharing method is determined to be delayed sharing based on the selection information, sharing information corresponding to delayed sharing is generated. The second terminal sends the sharing information to the server. After receiving the sharing information, the server parses the sharing information. If the sharing method obtained from the parsed sharing information is delayed sharing, that is, the server determines that the sharing method of the second terminal is delayed sharing based on the sharing information, the server will not forward the image sent by the second terminal to the first terminal in real time, but will compress the screenshots and generate a media stream after receiving all the screenshots. If the server does not receive the sharing information, the server directly forwards the picture transmitted by the second terminal to the first terminal in real time without generating a media stream.

[0190] The present invention also provides a terminal, referring to Figure 5, the terminal 500 comprises:

[0191] A first receiving module 510 is configured to receive a media stream transmitted by a server after the first terminal shares the control function of the second terminal on the device, wherein the media stream is generated by the server according to a screenshot transmitted by the second terminal, and the screenshot is used to record the user's operation on the control page on the second terminal;

[0192] The playing module 520 is used to play the media stream on the shared page, wherein the media stream includes the target device to be controlled by the second terminal and the target function to be controlled by the target device;

[0193] The first generating module 530 is used to generate a control instruction of the target function when a control operation on the target function on the shared page is detected, and transmit the control instruction to the target device through the server.

[0194] In one embodiment, the terminal 500 includes:

[0195] A first generating module 530, used to generate icon information corresponding to the control instruction;

[0196] The transmission module is used to transmit the icon information to the second terminal through the server, and transmit the control instruction to the target device through the server, wherein the second terminal adds the icon corresponding to the icon information to the control page, and when the touch operation of the icon is detected, the second terminal sends the control instruction to the target device.

[0197] In one embodiment, the terminal 500 includes:

[0198] A first receiving module 510, configured to receive a takeover request sent by a second terminal;

[0199] An acquisition module, used to acquire an encrypted message according to a takeover request, and perform takeover verification according to the encrypted message;

[0200] The sending module is used to send a prompt message of the takeover verification passing to the second terminal when the takeover verification passes, and the prompt message of the takeover verification passing is used by the second terminal to authorize the first terminal to share the control function of the second terminal.

[0201] In one embodiment, the terminal 500 includes:

[0202] A sending module, configured to stop sending the picture displayed by the first terminal to the second terminal through the server upon receiving the prompt information that the media stream has been generated sent by the server, and send a first acquisition request to the server;

[0203] The first receiving module 510 is configured to receive a response to a first acquisition request sent by a server, where the response to the first acquisition request includes a media stream.

[0204] In one embodiment, the terminal 500 includes:

[0205] An acquisition module, used to acquire a second acquisition request input through the sharing page, where the second acquisition request is used to request to acquire a media stream;

[0206] A sending module, used for sending a second acquisition request to the server;

[0207] The first receiving module 510 is configured to receive a response to the second acquisition request sent by the server, where the response to the second acquisition request includes a media stream.

[0208] The present invention also provides a terminal, referring to Figure 6 , the terminal 600 comprises:

[0209] The second receiving module 610 is used to generate a screenshot corresponding to the control page when the second terminal authorizes the first terminal to share the control function of the second terminal on the device and detects an operation on the control page of the second terminal, and the screenshot is used to record the user's operation on the control page;

[0210] A transmission module 620, configured to transmit each screenshot to a server, wherein each screenshot is used by the server to generate a media stream, and the first terminal controls a target function of a target device according to the media stream sent by the server;

[0211] The second receiving module 610 is used to receive prompt information of target function control sent by the target device controlled by the second terminal. The prompt information of target function control is sent after the first terminal controls the target function of the target device.

[0212] In one embodiment, the terminal 600 includes:

[0213] The second receiving module 610 is used to receive icon information sent by the server;

[0214] The adding module is used to add an icon corresponding to the icon information on the control page, wherein the second terminal sends a control instruction to the target device when detecting a touch operation of the icon.

[0215] In one embodiment, the terminal 600 includes:

[0216] An acquisition module, used to acquire the encrypted message and generate a takeover request according to the encrypted message;

[0217] A sending module, used for sending a takeover request to the first terminal, wherein the encrypted message is used for the first terminal to perform takeover verification;

[0218] The sending module is used to send authorization information to the second terminal when receiving the prompt information sent by the second terminal indicating that the takeover verification has passed. The authorization information is used by the second terminal to authorize the first terminal to share the control function of the second terminal on the device.

[0219] In one embodiment, the terminal 600 includes:

[0220] An output module, configured to output a selection interface, wherein the selection interface displays a sharing mode of the sharing control function of the second terminal;

[0221] An acquisition module is used to obtain selection information of a selection interface;

[0222] A generating module, configured to generate sharing information corresponding to delayed sharing when the sharing mode is determined to be delayed sharing according to the selection information;

[0223] The sending module is used to send the sharing information to the server, where the sharing information is used to indicate that the sharing mode is delayed sharing.

[0224] The present invention also provides a server, referring to Figure 7 , the server 700 includes:

[0225] The third receiving module 710 is used to receive each screenshot transmitted by the second terminal after the first terminal shares the control function of the second terminal on the device, wherein the screenshot is used to record the user's operation on the control page on the second terminal;

[0226] A second generating module 720, configured to generate a media stream according to each screenshot, and send the media stream to the first terminal, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device;

[0227] The third receiving module 710 is used to receive a control instruction sent by the first terminal and send the control instruction to the target device, wherein the control instruction is generated when the second terminal detects a control operation on a target function on the shared page.

[0228] In one embodiment, the server 700 includes:

[0229] The third receiving module 710 is used to receive the control instruction sent by the first terminal and the icon information corresponding to the control instruction;

[0230] The sending module is used to send the control instruction to the target device and send the icon information to the second terminal, wherein the second terminal adds the icon corresponding to the icon information to the control page and sends the control instruction to the target device when a touch operation of the icon is detected.

[0231] In one embodiment, the server 700 includes:

[0232] A sending module, used for sending prompt information that a media stream has been generated to the first terminal;

[0233] The third receiving module 710 is used to receive a first acquisition request sent by a first terminal;

[0234] The sending module is used to send a response to the first acquisition request to the first terminal, where the response to the first acquisition request includes a media stream.

[0235] In one embodiment, the server 700 includes:

[0236] The third receiving module 710 is used to receive a second acquisition request sent by the first terminal;

[0237] The sending module is used to send a response to the second acquisition request to the first terminal, where the response to the second acquisition request includes a media stream.

[0238] In one embodiment, the server 700 includes:

[0239] The third receiving module 710 is used to receive the shared information sent by the second terminal;

[0240] The second generating module 720 is configured to generate a media stream according to each screenshot when it is determined according to the sharing information that the first terminal delays sharing the control function of the second terminal.

[0241] Figure 8 The diagram is a schematic diagram of a hardware structure of a terminal / server according to an exemplary embodiment.

[0242] The terminal / server 800 may include: a processor 81, such as a CPU, a memory 82, and a transceiver 83. Those skilled in the art will appreciate that Figure 8 The structure shown in the figure does not constitute a limitation on the terminal / server, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently. The memory 82 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0243] The processor 81 may call a computer program stored in the memory 82 to complete all or part of the steps of the above-mentioned remote control method.

[0244] The transceiver 83 is used to receive information sent by an external device and send information to the external device.

[0245] A non-transitory computer-readable storage medium, when the control instructions in the storage medium are executed by the processor of a terminal / server, enables the terminal / server to execute the above-mentioned remote control method.

[0246] A computer program product comprises a computer program. When the computer program is executed by a processor of a terminal / server, the terminal / server is enabled to execute the above remote control method.

[0247] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be regarded as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0248] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A remote control method, applied to a first terminal, characterized in that: include: After the first terminal shares the control function of the second terminal on the device, receiving a media stream transmitted by the server, wherein the media stream is generated by the server according to the screenshot transmitted by the second terminal, and the screenshot is used to record the user's operation on the control page on the second terminal; Playing the media stream on the shared page, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device; When a control operation on the target function on the shared page is detected, a control instruction for the target function is generated, and the control instruction is transmitted to the target device through the server.

2. The remote control method according to claim 1, characterized in that: The step of transmitting the control instruction to the target device via the server comprises: Generate icon information corresponding to the control instruction; The icon information is transmitted to the second terminal through the server, and the control instruction is transmitted to the target device through the server, wherein the second terminal adds the icon corresponding to the icon information to the control page, and when a touch operation of the icon is detected, the second terminal sends the control instruction to the target device.

3. The remote control method according to claim 1, characterized in that: Before the step of receiving the media stream transmitted by the server after the first terminal shares the control function of the second terminal on the device, the step further includes: receiving a takeover request sent by the second terminal; Obtaining an encrypted message according to the takeover request, and performing a takeover verification according to the encrypted message; When the takeover verification passes, prompt information indicating that the takeover verification passes is sent to the second terminal, and the prompt information indicating that the takeover verification passes is used by the second terminal to authorize the first terminal to share the control function of the second terminal.

4. The remote control method according to any one of claims 1 to 3, characterized in that: The step of receiving the media stream transmitted by the server comprises: When receiving the prompt information sent by the server that the media stream has been generated, stop sending the picture displayed by the first terminal to the second terminal through the server, and send a first acquisition request to the server; A response to the first acquisition request sent by the server is received, where the response to the first acquisition request includes the media stream.

5. The remote control method according to any one of claims 1 to 3, characterized in that: The step of receiving the image information transmitted by the server comprises: Acquire a second acquisition request input through the sharing page, where the second acquisition request is used to request acquisition of the media stream; Sending the second acquisition request to the server; A response to the second acquisition request sent by the server is received, where the response to the second acquisition request includes the media stream.

6. A remote control method, applied to a second terminal, characterized in that: include: When the second terminal authorizes the first terminal to share the control function of the second terminal on the device and an operation on the control page of the second terminal is detected, a screenshot corresponding to the control page is generated, where the screenshot is used to record the user's operation on the control page; Transmitting each of the screenshots to the server, wherein each of the screenshots is used by the server to generate a media stream, and the first terminal controls a target function of a target device according to the media stream sent by the server; Receive prompt information of target function control sent by the target device controlled by the second terminal, where the prompt information of target function control is sent after the first terminal controls the target function of the target device.

7. The remote control method according to claim 6, characterized in that: After the step of receiving the prompt information of the target function control sent by the target device controlled by the second terminal, the method further includes: Receiving icon information sent by the server; An icon corresponding to the icon information is added on the control page, wherein the second terminal sends the control instruction to the target device when detecting a touch operation of the icon.

8. The remote control method according to claim 6, characterized in that: Before the step of generating a screenshot corresponding to the control page when the second terminal authorizes the first terminal to share the control function of the second terminal on the device and the user operates the control page of the second terminal, the step further includes: Obtaining an encrypted message, and generating a takeover request according to the encrypted message; Sending the takeover request to the first terminal, wherein the encrypted message is used by the first terminal to perform takeover verification; When receiving the prompt information sent by the second terminal indicating that the takeover verification has passed, authorization information is sent to the second terminal, where the authorization information is used by the second terminal to authorize the first terminal to share the control function of the second terminal over the device.

9. The remote control method according to any one of claims 6 to 8, characterized in that: The step of transmitting each of the screenshots to the server comprises: Outputting a selection interface, wherein the selection interface displays a sharing mode in which the second terminal shares the control function; Acquire selection information of the selection interface; When it is determined according to the selection information that the sharing mode is delayed sharing, generating sharing information corresponding to the delayed sharing; The sharing information is sent to the server, where the sharing information is used to indicate that the sharing mode is delayed sharing.

10. A remote control method, applied to a server, characterized in that: include: After the first terminal shares the control function of the second terminal on the device, receiving each screenshot transmitted by the second terminal, wherein the screenshot is used to record the user's operation on the control page on the second terminal; generating a media stream according to each of the screenshots, and sending the media stream to the first terminal, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device; A control instruction sent by the first terminal is received, and the control instruction is sent to the target device, wherein the control instruction is generated when the second terminal detects a control operation on the target function on the shared page.

11. The remote control method according to claim 10, characterized in that: The step of receiving the control instruction sent by the first terminal and sending the control instruction to the target device includes: Receiving a control instruction sent by the first terminal and icon information corresponding to the control instruction; The control instruction is sent to the target device, and the icon information is sent to the second terminal, wherein the second terminal adds the icon corresponding to the icon information to the control page, and sends the control instruction to the target device when a touch operation of the icon is detected.

12. The remote control method according to claim 10, characterized in that: The step of sending the media stream to the first terminal comprises: Prompt information that the media stream has been generated is sent to the first terminal; Receiving a first acquisition request sent by the first terminal; A response to the first acquisition request is sent to the first terminal, where the response to the first acquisition request includes the media stream.

13. The remote control method according to claim 10, characterized in that: The step of sending the media stream to the first terminal comprises: receiving a second acquisition request sent by the first terminal; A response to the second acquisition request is sent to the first terminal, where the response to the second acquisition request includes the media stream.

14. The remote control method according to any one of claims 10 to 13, characterized in that: The step of generating a media stream according to each of the screenshots comprises: receiving the shared information sent by the second terminal; When it is determined according to the sharing information that the first terminal delays sharing of the control function of the second terminal, a media stream is generated according to each of the screenshots.

15. A terminal, characterized in that: The terminal comprises: A first receiving module, configured to receive a media stream transmitted by a server after the first terminal shares the control function of the second terminal on the device, wherein the media stream is generated by the server according to a screenshot transmitted by the second terminal, and the screenshot is used to record the user's operation on the control page on the second terminal; A playing module, used for playing the media stream on the shared page, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device; The first generating module is used to generate a control instruction of the target function when a control operation on the target function on the shared page is detected, and transmit the control instruction to the target device through the server.

16. A terminal, characterized in that: The terminal comprises: A second receiving module is used for, when the second terminal authorizes the first terminal to share the control function of the second terminal on the device and detects an operation on the control page of the second terminal, to generate a screenshot corresponding to the control page, wherein the screenshot is used to record the user's operation on the control page; A transmission module, used to transmit each of the screenshots to the server, wherein each of the screenshots is used by the server to generate a media stream, and the first terminal controls a target function of a target device according to the media stream sent by the server; The second receiving module is further configured to receive prompt information of target function control sent by the target device controlled by the second terminal, wherein the prompt information of target function control is sent after the first terminal controls the target function of the target device.

17. A server, characterized in that: The server comprises: A third receiving module, configured to receive each screenshot transmitted by the second terminal after the first terminal shares the control function of the second terminal on the device, wherein the screenshot is used to record the user's operation on the control page on the second terminal; A second generating module, configured to generate a media stream according to each of the screenshots, and send the media stream to the first terminal, wherein the media stream includes a target device to be controlled by the second terminal and a target function to be controlled by the target device; The third receiving module is further configured to receive a control instruction sent by the first terminal and send the control instruction to the target device, wherein the control instruction is generated when the second terminal detects a control operation on the target function on the shared page.

Images