Remote control method, device, storage medium and program product

Abstract

Embodiments of the present application provide a remote control method, device, storage medium and program product, and relate to the technical field of Internet. The method comprises: in the case that a first client participates in a multi-person online conference and a screen sharing function of the first client is started, sending screen content to at least one other client participating in the multi-person online conference; and establishing a remote control connection by interacting with a second client, the second client being a client participating in the multi-person online conference; after the remote control connection is established, receiving remote control information from the second client, the remote control information being used to control the first client to perform a target operation; and performing the target operation corresponding to the remote control information. The technical scheme provided by the embodiments of the present application can improve the convenience of the remote control connection.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of Internet, and particularly relate to a remote control method, device, storage medium and program product. BACKGROUND

[0002] With the development of Internet technology, more and more communication and interaction between people can be completed online.

[0003] In the related art, two terminals are respectively installed with remote control software, a control terminal sends a link to a controlled terminal, and the user of the controlled terminal clicks the link, so that the two terminals can establish a remote control connection, and the control terminal can control the controlled terminal.

[0004] In the above related art, the remote control connection needs to be established by installing special remote control software, which is not convenient. SUMMARY

[0005] Embodiments of the present application provide a remote control method, device, storage medium and program product, which can improve the convenience of establishing a remote control connection. The technical solution is as follows:

[0006] According to an aspect of the embodiments of the present application, a remote control method is provided, and the method comprises:

[0007] In the case of participating in a multi-person online conference and the first client enabling a screen sharing function, screen content is sent to at least one other client participating in the multi-person online conference;

[0008] A remote control connection is established by interacting with a second client, and the second client is a client participating in the multi-person online conference;

[0009] After the remote control connection is established, remote control information from the second client is received, and the remote control information is used to control the first client to perform a target operation;

[0010] The target operation corresponding to the remote control information is performed.

[0011] According to an aspect of the embodiments of the present application, a remote control method is provided, and the method comprises:

[0012] In the case of participating in a multi-person online conference and the first client enabling a screen sharing function, screen content provided by the first client is displayed, and the first client is a client participating in the multi-person online conference;

[0013] A remote control connection is established by interacting with the first client;

[0014] After the remote control connection is established, remote control information is sent to the first client in response to a remote control operation, the remote control information being used to control the first client to perform a target operation.

[0015] According to an aspect of an embodiment of the present application, a remote control method is provided, the method comprising:

[0016] During a multi-person online conference, screen content of a first client participating in the multi-person online conference is sent to at least one other client participating in the multi-person online conference;

[0017] A remote control connection between the first client and a second client is established, the second client being a client participating in the multi-person online conference;

[0018] After the remote control connection is established, remote control information is received from the second client, the remote control information being used to control the first client to perform a target operation;

[0019] The remote control information is sent to the first client.

[0020] According to an aspect of an embodiment of the present application, a remote control apparatus is provided, the apparatus comprising:

[0021] A content sending module is configured to, in a case where a first client participates in a multi-person online conference and the first client starts a screen sharing function, send screen content to at least one other client participating in the multi-person online conference;

[0022] A connection establishing module is configured to establish a remote control connection with a second client, the second client being a client participating in the multi-person online conference;

[0023] An information receiving module is configured to, after the remote control connection is established, receive remote control information from the second client, the remote control information being used to control the first client to perform a target operation;

[0024] An operation performing module is configured to perform the target operation corresponding to the remote control information.

[0025] According to an aspect of an embodiment of the present application, a remote control apparatus is provided, the apparatus comprising:

[0026] A content displaying module is configured to, in a case where a first client participates in a multi-person online conference and the first client starts a screen sharing function, display screen content provided by the first client; the first client being a client participating in the multi-person online conference;

[0027] The connection establishing module is configured to establish a remote control connection between the first client and a second client, the second client being a client participating in the multi-person online conference.

[0028] The information sending module is configured to send remote control information to the first client in response to a remote control operation after the remote control connection is established, the remote control information being used to control the first client to perform a target operation.

[0029] According to an aspect of an embodiment of the present application, a remote control device is provided, the device comprising:

[0030] The content sending module is configured to send screen content of a first client participating in the multi-person online conference to at least one other client participating in the multi-person online conference during the multi-person online conference.

[0031] The connection establishing module is configured to establish a remote control connection between the first client and a second client, the second client being a client participating in the multi-person online conference.

[0032] The information receiving module is configured to receive remote control information from the second client after the remote control connection is established, the remote control information being used to control the first client to perform a target operation.

[0033] The information sending module is configured to send the remote control information to the first client.

[0034] According to an aspect of an embodiment of the present application, a computer device is provided, the computer device comprising a processor and a memory, the memory storing at least one instruction, at least one program, a code set or an instruction set, the at least one instruction, the at least one program, the code set or the instruction set being loaded and executed by the processor to implement the remote control method described above.

[0035] According to an aspect of an embodiment of the present application, a computer readable storage medium is provided, the computer readable storage medium storing at least one instruction, at least one program, a code set or an instruction set, the at least one instruction, the at least one program, the code set or the instruction set being loaded and executed by a processor to implement the remote control method described above.

[0036] According to an aspect of an embodiment of the present application, a computer program product or a computer program is provided, the computer program product or the computer program comprising computer instructions stored in a computer readable storage medium. A processor of a computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device executes the remote control method described above.

[0037] The technical scheme provided by the embodiments of the present application can include the following beneficial effects:

[0038] By establishing a remote control connection between a client and another client in a multi-person online conference when the screen sharing function of the client is started, the other client can control the client to perform a target operation, so that the remote control between the two clients / terminals can be realized through the multi-person online conference, without installing a software program specially used for remote control, and the convenience of remote control is improved.

[0039] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF DRAWINGS

[0040] In order to more clearly illustrate the technical scheme in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0041] Figure 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application;

[0042] Figure 2 is a flowchart of a remote control method provided by an embodiment of the present application;

[0043] Figure 3 is a schematic diagram of conference control provided by an embodiment of the present application;

[0044] Figure 4 is a screen diagram provided by an embodiment of the present application;

[0045] Figure 5 is a flowchart of a remote control method provided by another embodiment of the present application;

[0046] Figure 6 is a screen diagram provided by another embodiment of the present application;

[0047] Figure 7 is a screen diagram provided by another embodiment of the present application;

[0048] Figure 8 is a flowchart of a remote control method provided by another embodiment of the present application;

[0049] Figure 9 is a flowchart of a remote control method provided by another embodiment of the present application;

[0050] Figure 10 is a schematic diagram of a remote control system provided by an embodiment of the present application;

[0051] Figure 11 is a flow chart of a remote control method provided by another embodiment of the present application;

[0052] Figure 12 is a block diagram of a remote control device provided by an embodiment of the present application;

[0053] Figure 13 is a block diagram of a remote control device provided by another embodiment of the present application;

[0054] Figure 14 is a block diagram of a remote control device provided by another embodiment of the present application;

[0055] Figure 15 is a block diagram of a terminal provided by an embodiment of the present application;

[0056] Figure 16 is a block diagram of a server provided by an embodiment of the present application. DETAILED DESCRIPTION

[0057] The exemplary embodiments will be described in detail herein with reference to the attached drawings. The following description is made with reference to the accompanying drawings in which like reference numerals refer to like elements, unless the context of use indicates otherwise. The following description of exemplary embodiments is not representative of all embodiments consistent with the present application. Rather, they are merely examples of methods consistent with some aspects of the present application as detailed in the appended claims.

[0058] Remote control refers to connecting a terminal to be controlled through computer network remote dialing or both parties accessing the Internet, etc. to display the display content of the controlled terminal on the master terminal, and the master terminal can execute application installation, system setting, etc. on the controlled terminal through remote control. In the online conference scenario, the remote control needs to control the screen content of the controlled party, such as forms and presentation documents.

[0059] Reference is made to Figure 1 which shows a schematic diagram of an implementation environment provided by an embodiment of the present application, which can be implemented as a remote control system. As Figure 1 shown, the system 10 can include a first terminal 11, a second terminal 12 and a server 13.

[0060] The target application program is installed and run in the first terminal 11 and the second terminal 12, such as a client of the target application program. Optionally, a user account is logged in the client. The terminal is an electronic device with data computing, processing and storage capabilities. The terminal can be a smart phone, a tablet computer, a PC (Personal Computer), a wearable device, etc., and the embodiments of the present application do not limit this. The target application program can be an online meeting application program. The target application program can also be an instant messaging application program, a mail application program, a game application program, a social application program, a payment application program, a video application program, a music application program, a shopping application program, a news application program, etc. Any application program supporting multi-person online meeting and remote control functions. The execution subject of the terminal corresponding step in the method provided by the embodiments of the present application can be the client, such as the first client running in the first terminal 11 and the second client running in the second terminal 12.

[0061] In some embodiments, the server 13 establishes a communication connection (such as a network connection) with the first terminal 11 and the second terminal 12 respectively, and the server 13 is used to provide background services for the target application program. The server can be a stand-alone physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.

[0062] In some embodiments, the following systems are run in the server 13:

[0063] (1) Remote control system

[0064] The remote control system mainly manages the remote control function. When screen sharing is performed in the meeting, the functions of initiating remote control, stopping remote control, pausing remote control, distributing verification information (such as the first verification information and the second verification information), remote control permission verification, remote control message pushing, etc. are realized. Moreover, the remote control system can also receive security alarms of the security management system, and send the security alarms to the first client or the second client, or directly interrupt the ongoing remote control connection, so as to protect the user safety.

[0065] The remote control related information is managed by the remote control system, and all the remote control information of the meeting exists in the redis cache. After the remote control is successfully established, the remote control system sends the information that the remote control is successfully established to part or all of the participating clients in the meeting, and sends the screen content of the controlled party to other clients, so that the users corresponding to the other clients can see the real-time remote control operation process.

[0066] In some embodiments, during the remote control process, both control parties (i.e. the master and the slave) can terminate the control at any time. In some embodiments, the host of the conference can terminate or suspend the remote control according to actual needs. The remote control information of the conference is synchronized to the security management module through kafka (message service).

[0067] (2) Conference control system

[0068] The conference control system includes a conference management system, which includes functions such as conference management and message pushing. The conference control system is mainly used for managing online conferences with multiple users, user entry and exit of the conference, user state and related data change notification, etc. The conference control system also has the authority to control the remote control connection.

[0069] (3) Security monitoring system

[0070] The security monitoring system is mainly used for monitoring the risks of the conference and the users in the conference. When a risky conference or participant is found, a security alarm is sent in time. The security monitoring system obtains the conference ID (Identity Document) and participant information (i.e. the information of the user account participating in the conference) from the kafka, and manages the security risks of the conference ID and participant information. When the security monitoring system detects that the conference or the participant has a security risk, it will call the interface provided by the remote control system to send a security alarm information. The remote control system determines whether to interrupt the current remote control according to the risk level.

[0071] In some embodiments, the system 10 further includes a third terminal 14, in which a target application program is installed and run, such as a third client of the target application program. Optionally, after the remote control connection is established between the first client and the second client through the server 13, the second client can control the terminal where the first client is located, and the third client can receive and display the controlled screen of the first terminal.

[0072] In the following, the technical solutions of the present application are introduced and explained through several embodiments.

[0073] Please refer to Figure 2 , which shows a flowchart of a remote control method provided by an embodiment of the present application. In this embodiment, the method is applied to the remote control system introduced above. The method can include the following steps (201-205):

[0074] Step 201, in the case that the first client participates in a multi-user online conference and the screen sharing function of the first client is turned on, the first client sends the screen content to at least one other client participating in the multi-user online conference.

[0075] In some embodiments, the plurality of target application programs are involved in a multi-person online conference, and the first client starts a screen sharing function to share screen content of a first terminal where the first client is located to other users corresponding to other clients for viewing. In some embodiments, the multi-person online conference is a video conference. Alternatively, when the multi-person online conference is a voice conference, if the first client shares the screen content of the first terminal where the first client is located to other clients in the multi-person online conference, the multi-person online conference changes from a voice conference to a video conference.

[0076] In some embodiments, during the multi-person online conference, the first client first sends the screen content to the server, and the server sends the screen content of the first client participating in the multi-person online conference to at least one other client participating in the multi-person online conference.

[0077] In some embodiments, the conference control system in the server mainly serves as whether a remote control control of the multi-person online conference is available (equivalent to a remote control switch of the multi-person online conference). As shown in Figure 3 The client 15 sends a conference creation request to the conference control system 16, and the conference creation request is used to apply for creating a multi-person online conference. The conference control system 16 sends an authority query request to the account management system 17. After the account management system 17 queries the authority information of the user account corresponding to the client 15, the authority information is sent to the conference control system 16. The conference control system 16 sends a switch instruction of the remote control control to the client 15 according to the authority information. If it is queried from the authority information that the user account corresponding to the client 15 has no remote control authority, the switch instruction sent to the client 15 is used to close the remote control function of all clients in the multi-person online conference, such as that the remote control control displayed by the client is not triggerable. If it is queried from the authority information that the user account corresponding to the client 15 has the remote control authority, the switch instruction sent to the client 15 is used to open the remote control function of all clients in the multi-person online conference, such as that the remote control control displayed by the client is triggerable.

[0078] Step 202, the second client displays the screen content provided by the first client.

[0079] In some embodiments, the at least one other client includes the second client, so that the second client (where the second terminal is located) can display the screen content provided by the first client.

[0080] Step 203, the first client and the second client interact to establish a remote control connection, and the second client is a client participating in the multi-person online conference.

[0081] In some embodiments, the interaction between the first client and the second client is implemented by the first client issuing a controlled request or by the second client issuing a control request, and the remote control connection is established. In some embodiments, the remote control connection between the first client and the second client is established by the server.

[0082] In some embodiments, through the remote control connection, the second client can control the first client, i.e., the second client can control the first terminal where the first client is located, such as controlling the setting information in the first terminal, controlling the client of various application programs in the first terminal, controlling the files in the first terminal, controlling the movement of the cursor in the screen in the first terminal, and the like.

[0083] In some embodiments, after the first client and the second client interact to establish the remote control connection, the method further includes the following steps: the server receives the screen content from the first client; the server eliminates the content that the second client has no right to display in the screen content according to the display permission information of the second client, to obtain the processed screen content; wherein the display permission information is used to indicate the content that the second client has the right to display or has no right to display; and the server sends the processed screen content to the second client.

[0084] In some embodiments, the first client corresponds to a first screen, and the second client corresponds to a second screen. In the above-mentioned embodiments, the server obtains the display permission information of the second client, which can indicate which screen content in the screen content contained in the first screen can be displayed in the second screen and which screen content cannot be displayed in the second screen.

[0085] In some embodiments, the server can identify the content that the second client has no right to display according to the display permission information of the second client through image recognition technology. In some embodiments, the way to eliminate the content that the second client has no right to display can be to cover the part of the screen content that the second client has no right to display with a cover picture.

[0086] In some embodiments, the content that the second client has no right to display can be a folder, a file, an identifier (such as an icon or a text identifier) of a communication application program, a communication interface (such as contact information, a chat interface, or email content) of a communication application program, an identifier of an entertainment application program (such as a game application program, a live broadcast application program, or a video application program), a client interface of an entertainment application program, and the like. The content that the second client has no right to display can also include other types of display content, which are not limited in the embodiments of the present application.

[0087] In some embodiments, the content that the second client has no right to display is set by the first client or the server.

[0088] In addition, the method for eliminating the content that the second client has no right to display can also be performed by the first client or the second client, and embodiments of the present application do not make specific limitation thereon.

[0089] In step 204, after the remote control connection is established, the second client sends remote control information to the first client in response to the remote control operation, and the remote control information is used to control the first client to perform the target operation.

[0090] In some embodiments, after the remote control connection is established and the second client identifies the remote control operation, the second client generates the remote control information and sends the remote control information to the server; after the server receives the remote control information from the second client, the server sends the remote control information to the first client. Optionally, the remote control information includes a control instruction that can be identified and responded by the first terminal where the first client is located. Wherein, the first terminal can respond to the control instruction contained in the remote control information, that is, the end performs the target operation.

[0091] In some embodiments, the second client sends the remote control information to the server, and the server sends the remote control information to the first client.

[0092] In some embodiments, after the server receives the remote control information sent by the second client, the following step is further included: in the case that the first client and the second client run on different operating systems, the server converts the remote control information to obtain converted remote control information; wherein the converted remote control information is information that can be identified by the operating system where the first client runs; and the server sends the converted remote control information to the first client.

[0093] In some embodiments, the first client and the second client run on different operating systems, and due to the difference between the operating systems, the first terminal where the first client is located cannot recognize or respond to the control information sent by the second client after receiving the control information, resulting in operation failure. In the above embodiment, the server can identify the operating systems to which the first client and the second client are attached, and after identifying that the remote control information sent by the second client is information that the operating system where the first client is located cannot respond to, the server converts the remote control information into information that the operating system where the first client is located can recognize, i.e., obtains the converted remote control information; after the server sends the converted remote control information to the first client, the first client can recognize and respond to the remote control information, i.e., the target operation corresponding to the remote control information is realized. Through the above embodiment, the probability of remote operation of the second client (i.e., the master) in the remote control process due to the difference between the operating systems is reduced, and the compatibility of the target application program client for different operating systems is improved; further, since the user corresponding to the second client (i.e., the master) does not need to adjust the operation habit to adapt to different operating systems, the efficiency and convenience of remote control are improved.

[0094] In the above embodiment, the server can identify the operating systems to which the first client and the second client are attached, and after identifying that the remote control information sent by the second client is information that the operating system where the first client is located cannot respond to, the server converts the remote control information into information that the operating system where the first client is located can recognize, i.e., obtains the converted remote control information; after the server sends the converted remote control information to the first client, the first client can recognize and respond to the remote control information, i.e., the target operation corresponding to the remote control information is realized. Through the above embodiment, the probability of remote operation of the second client (i.e., the master) in the remote control process due to the difference between the operating systems is reduced, and the compatibility of the target application program client for different operating systems is improved; further, since the user corresponding to the second client (i.e., the master) does not need to adjust the operation habit to adapt to different operating systems, the efficiency and convenience of remote control are improved.

[0095] After the remote control connection is established, as shown in FIG. 18, the first client displays prompt information 18 for prompting that the second client is controlling the first client. Figure 4

[0096] Step 205, the first client performs the target operation corresponding to the remote control information.

[0097] In some embodiments, the first client receives the remote control information and controls the first terminal to perform the target operation according to the remote control information. For example, the remote control operation corresponding to the remote control information is double-clicking the icon of a folder, and the first client controls the first screen corresponding to the first terminal to display the content contained in the folder, i.e., controls the first terminal to open the folder. For another example, the remote control operation corresponding to the remote control information is moving the cursor (such as the cursor controlled by the mouse) from the first display position to the second display position, and the first client controls the cursor in the first screen corresponding to the first terminal to move from the first display position to the second display position.

[0098] ​In some embodiments, the method further comprises the following steps: the first client acquires operation permission information of the second client, the permission information being used to indicate that the second client has the right to perform remote control operations; in the case that the target operation belongs to the remote control operations that the second client has the right to perform, the first client performs the target operation corresponding to the remote control information; in the case that the target operation belongs to the remote control operations that the second client does not have the right to perform, the first client does not perform the target operation corresponding to the remote control information.

[0099] In some embodiments, after the remote control connection is established between the first client and the second client, the second client only has the right to perform part of the operations on the terminal where the first client is located, and the second client cannot completely control the first terminal where the first client is located.

[0100] In some embodiments, the second client can only control part of the area in the first screen corresponding to the first client. In some embodiments, the display area in the first screen corresponding to the first client includes a remote control area and a non-remote control area. The remote control area refers to an area that allows the second client to perform remote control, and the non-remote control area refers to an area that does not allow the second client to perform remote control. That is, the remote control operation performed by the second client on the remote control area can be received by the first client / first terminal and responded to (i.e., the corresponding target operation is performed); the remote control operation performed by the second client on the non-remote control area cannot be received by the first client / first terminal, or can be received but not responded to.

[0101] In some embodiments, the remote control area and the non-remote control area are displayed in the first screen, and the first client only sends the screen content of the remote control area to the server, and the server sends the screen content of only the remote control area to the second client; or the first client sends the screen content of the remote control area and the non-remote control area to the server, and the server removes the screen content of the non-remote control area and only sends the screen content of the remote control area to the second client. Thus, the second screen corresponding to the second client displays the above-mentioned remote control area, but does not display the non-remote control area.

[0102] In some embodiments, the first screen displays a remotely controlled area and a non-remotely controlled area. The first client sends the screen content of both the remotely controlled area and the non-remotely controlled area to the server, and the server sends the screen content of both the remotely controlled area and the non-remotely controlled area to the second client. Therefore, the second screen corresponding to the second client displays the aforementioned remotely controlled area and non-remotely controlled area. However, the non-remotely controlled area can only be displayed on the second screen, and the second client cannot control the non-remotely controlled area.

[0103] In summary, the technical solution provided by the embodiments of this application enables remote control between a client and another client in the same multi-person online conference when the client has enabled screen sharing. This allows the other client to control the client to perform target operations, thus achieving remote control between two clients / terminals through a multi-person online conference without the need to install a separate client dedicated to remote control, thereby improving the convenience of remote control.

[0104] like Figure 5 As shown, in some embodiments, the above Figure 2 Step 203 in the embodiment further includes the following sub-steps (501-506):

[0105] Step 501: In response to the controlled operation, the first client sends a controlled request to the server. The controlled request is used to invite the second client to remotely control the first client.

[0106] In some embodiments, the first client is the controlled party, and actively invites another party (i.e., the second client) to remotely control the first client (i.e., the terminal where the first client is located).

[0107] In some embodiments, such as Figure 6 As shown, after the first client sends a controlled request to the server, the first client displays a prompt message 19 to confirm the sending of the controlled request. In some embodiments, the prompt message 19 includes a cancellation control 20 and an invitation control 21. The cancellation control 20 is used to cancel sending the controlled request, and the invitation control 21 is used to confirm sending the controlled request.

[0108] In some embodiments, after receiving the controlled request sent by the first client, the server further includes the following steps: the server detects whether the first client has the right to establish a remote control connection in a multi-person online conference; if the first client has the right to establish a remote control connection in a multi-person online conference, the server performs the step of sending a controlled confirmation request to the second client.

[0109] The detecting whether the first client has the right to establish the remote control connection in the multi-person online conference includes at least one of the following: detecting whether the first client has the right to establish the remote control connection, and detecting whether there is another remote control connection in the multi-person online conference.

[0110] In some embodiments, the server needs to detect the sender of the controlled request (i.e., the first client) after receiving the controlled request.

[0111] In some embodiments, the target application program only allows part of the clients to establish the remote control connection, i.e., only part of the clients have the right to establish the remote control connection. Optionally, the conditions for the first client to have the right to establish the remote control connection include, but are not limited to, at least one of the following: the user account logged in the first client is a remote permission account, and the performance of the first terminal corresponding to the first client meets the remote operation requirement. In some embodiments, the security monitoring system in the server detects that the first client or the user account logged in the first client has a fraud risk or a criminal risk, and the first client does not have the right to establish the remote control connection. In some embodiments, the requirement for the device performance of the participants in the remote control (whether the controlled party or the master party) is high, and therefore, for the terminal device whose performance cannot meet the requirement of the remote control, even if the client in which the remote permission account is running is logged in, the client cannot establish the remote control connection, i.e., the client does not have the right to establish the remote control connection, thereby saving the time wasted due to the unsmooth remote control connection, and improving the exchange efficiency of the multi-person online conference.

[0112] In some embodiments, a multi-person online conference only allows one remote control connection to exist at the same time, and therefore, if the multi-person online conference has established another remote control connection, the first client also does not have the right to establish the remote control connection in the multi-person online conference.

[0113] In some embodiments, if the user account corresponding to the initiating client of the multi-person online conference is a non-remote permission account, no remote control connection can be established in the multi-person online conference, and therefore, the first client also does not have the right to establish the remote control connection in the multi-person online conference.

[0114] Step 502: The server sends a controlled confirmation request to the second client based on the controlled request.

[0115] In some embodiments, the server generates a controlled confirmation request based on the controlled request sent by the first client, and sends the controlled confirmation request to the second client. The controlled confirmation request is used to request the second client to confirm whether to agree to the controlled request.

[0116] Step 503, the second client sends a controlled confirmation response to the server in response to the consent operation for the controlled confirmation request.

[0117] The controlled confirmation response is used to indicate that the second client agrees to the controlled confirmation request.

[0118] In some embodiments, as shown in FIG. 22, after the second client receives the controlled confirmation request, the second client displays prompt information 22 corresponding to the controlled confirmation request; in response to a consent operation for the controlled confirmation request, such as clicking the first control 23 in the prompt information 22 corresponding to the controlled confirmation request, the second client indicates that it agrees to the controlled confirmation request; then the second client generates a controlled confirmation response according to the controlled confirmation request and sends the controlled confirmation response to the server. Figure 7

[0119] Step 504, the server sends a controlled response to the first client.

[0120] In some embodiments, the server generates a controlled response according to the controlled confirmation response and sends the controlled response to the first client.

[0121] The controlled response contains first verification information, which is used to verify the legality of the first client.

[0122] In some embodiments, the first verification information is encrypted information generated by a first encryption algorithm according to the control identity information of the first client and the identifier of the first client. The control identity information is used to indicate whether the client is a controller or a controlled party; the identifier of the client is uniquely determined according to the user account in the client login and the terminal where the client is located.

[0123] In some embodiments, after receiving the controlled response sent by the second client, the server detects whether the second client has the right to establish a remote control connection in the multi-person online meeting. The detection of whether the second client has the right to establish a remote control connection in the multi-person online meeting includes at least one of the following: detecting whether the second client has the permission to establish a remote control connection, and detecting whether there is already another remote control connection in the multi-person online meeting. If the second client has the right to establish a remote control connection in the multi-person online meeting, the step of sending the controlled response to the first client is performed.

[0124] The detection of whether the second client has the right to establish a remote control connection in the multi-person online meeting can refer to the explanation of whether the first client has the right to establish a remote control connection in the multi-person online meeting, which will not be repeated here. If the second client has the right to establish a remote control connection in the multi-person online meeting, the step of sending the controlled response to the first client is performed.

[0125] ​Step 505: The server sends the second verification information to the second client.

[0126] The second verification information is used to verify the legitimacy of the second client.

[0127] In some embodiments, the second verification information is encrypted information generated using a second encryption algorithm based on the control identity information of the second client and the identifier of the second client.

[0128] Optionally, the first encryption algorithm and the second encryption algorithm may be the same or different.

[0129] Step 506: Based on the first verification information and the second verification information, a remote control connection is established between the first client and the second client.

[0130] In some embodiments, after the server verifies the first verification information and the second verification information and they pass, a remote control connection is established between the first client and the second client.

[0131] In the above embodiment, the controlled party (i.e., the first client) invites the controlling party (i.e., the second client) to control the first client. During this process, the server also confirms the remote control permissions of the first client and the second client in the multi-person online meeting to confirm whether the remote control connection is allowed to be established, thereby improving the security of remote control.

[0132] like Figure 8 As shown, in some embodiments, the above Figure 2 Step 203 in the embodiment further includes the following sub-steps (801-806):

[0133] Step 801: In response to the control operation, the second client sends a control request to the server. The control request is used to request remote control of the first client.

[0134] In some embodiments, the second client is the controlling party and actively requests to remotely control the first client (i.e., requests to remotely control the terminal where the first client is located).

[0135] In some embodiments, after receiving a control request from a second client, the server further includes the following steps: the server detects whether the second client has the right to establish a remote control connection in a multi-person online conference; if the second client has the right to establish a remote control connection in a multi-person online conference, the server performs the step of sending a control confirmation request to the first client.

[0136] The detecting whether the second client has the right to establish the remote control connection in the multi-person online conference includes at least one of the following: detecting whether the second client has the right to establish the remote control connection, and detecting whether there is another remote control connection in the multi-person online conference.

[0137] The receiving of the detecting whether the second client has the right to establish the remote control connection in the multi-person online conference can refer to the above Figure 5 Embodiments, which will not be described herein again.

[0138] In step 802, the server sends a control confirmation request to the first client based on the control request.

[0139] In some embodiments, after the server receives the control request sent by the second client, the control confirmation request is generated according to the control request. The control confirmation request is used to request the first client to confirm whether to agree to the control request.

[0140] In step 803, the first client sends a control confirmation response to the server in response to an agreement operation for the control confirmation request.

[0141] The control confirmation response is used to indicate that the first client agrees to the control request.

[0142] In some embodiments, after the first client receives the control confirmation request, prompt information corresponding to the control confirmation request is displayed; in response to an agreement operation for the control confirmation request, such as clicking a second control in the prompt information corresponding to the control confirmation request, it is indicated that the first client agrees to the control confirmation request; then the first client generates a control confirmation response according to the control confirmation request and sends the control confirmation response to the server.

[0143] In step 804, the server sends a control response to the second client. The control response contains second verification information, and the second verification information is used to verify the legality of the second client.

[0144] In some embodiments, the server generates a control response according to the control confirmation response and sends the control response to the first client.

[0145] In some embodiments, the second verification information is encrypted information generated by using a second encryption algorithm according to the control identity information of the second client and the identifier of the second client.

[0146] In some embodiments, after receiving the control confirmation response sent by the first client, the server detects whether the first client has the right to establish the remote control connection in the multi-person online conference. Wherein, the detection of whether the first client has the right to establish the remote control connection in the multi-person online conference comprises at least one of the following: detecting whether the first client has the right to establish the remote control connection, and detecting whether there is already another remote control connection in the multi-person online conference. In the case that the first client has the right to establish the remote control connection in the multi-person online conference, the step of sending the control response to the second client is performed.

[0147] The reception of the detection of whether the second client has the right to establish the remote control connection in the multi-person online conference can refer to the above Figure 5 embodiments, which will not be repeated here.

[0148] At step 805, the server sends first verification information to the first client.

[0149] Wherein, the first verification information is used for legitimacy verification of the first client.

[0150] In some embodiments, the first verification information is encrypted information generated by using a first encryption algorithm according to the control identity information of the first client and the identifier of the first client.

[0151] At step 806, the first client and the second client establish the remote control connection based on the first verification information and the second verification information.

[0152] In some embodiments, after the server verifies that the first verification information and the second verification information pass, the remote control connection is established between the first client and the second client.

[0153] In the above embodiments, the master (i.e. the second client) actively requests the control of the first client to the slave (i.e. the first client), and in this process, the server also confirms the remote control right of the first client and the second client in the multi-person online conference to confirm whether the remote control connection is allowed to be established, thereby improving the security of the remote control.

[0154] As shown in Figure 9 In some embodiments, the first client and the second client establish the remote control connection based on the first verification information and the second verification information, comprising the following steps:

[0155] At step 901, the first client sends a first connection establishment request to the server.

[0156] In some embodiments, the first connection establishment request is used to request to establish a remote control connection with the second client, and the first connection establishment request comprises first verification information, control identity information of the first client, and an identifier of the first client, the control identity information being used to indicate whether the client is a controller or a controlled party.

[0157] At step 902, the server verifies the first verification information based on the control identity information of the first client and the identifier of the first client.

[0158] In some embodiments, the server generates third verification information according to the control identity information of the first client and the identifier of the first client by using a first encryption algorithm, and compares the third verification information with the first verification information. If the third verification information is the same as the first verification information, it indicates that the first connection establishment request is a legal request; if the third verification information is different from the first verification information, it indicates that the first connection establishment request is an illegal request, and the remote control connection between the first client and the second client cannot be established.

[0159] At step 903, the second client sends a second connection establishment request to the server.

[0160] In some embodiments, the second connection establishment request is used to request to establish a remote control connection with the second client, and the second connection establishment request comprises second verification information, control identity information of the second client, and an identifier of the second client, the control identity information being used to indicate whether the client is a controller or a controlled party.

[0161] At step 904, the server verifies the second verification information based on the control identity information of the second client and the identifier of the second client.

[0162] In some embodiments, the server generates fourth verification information according to the control identity information of the second client and the identifier of the second client by using a second encryption algorithm, and compares the fourth verification information with the second verification information. If the fourth verification information is the same as the second verification information, it indicates that the second connection establishment request is a legal request; if the fourth verification information is different from the second verification information, it indicates that the second connection establishment request is an illegal request, and the remote control connection between the first client and the second client cannot be established.

[0163] At step 905, when the first verification information and the second verification information are both verified, the server sends a first connection establishment response to the first client and a second connection establishment response to the second client.

[0164] In some embodiments, the first connection establishment response and the second connection establishment response are used to indicate that the remote control connection has been successfully established.

[0165] In the above embodiments, by checking the first check information sent by the first client and the second check information sent by the second client, it is confirmed whether the first connection establishment request and the second connection establishment request are legitimate requests or illegitimate requests, so as to prevent malicious requests to the server, such as preventing malicious codes carried in the connection establishment request, preventing high-frequency connection establishment requests (from the connection establishment request) from the same client or the same IP (Internet Protocol Address), and thus improving the security of remote control.

[0166] In some embodiments, as shown in Figure 10 The remote control system can also be implemented as a system 100. The system 100 includes a remote control media service (pere) 27, a protocol conversion service (XMPP, Extensible Messaging and Presence Protocol) 28, a conference control core service (center) 29, a message service (Kafka) 30, and a remote control conference control service 31. Among them, the remote control media service 27 is used to support remote control between clients; the protocol conversion service 28 is used for signaling format conversion; the conference control core service 29 is used to support the conference control system; the message service 30 is used to distribute and push messages; and the remote control conference control service 31 is used to establish a remote control connection.

[0167] In some embodiments, as shown in Figure 11 The system 100 can also include a security service (safe_server) 33, a conference state query service (meet_query) 34, and an identification service (id_server) 35. Among them, the security service 33 is used for security management; the conference state query service 34 is used to query the conference state; and the identification service 35 is used to allocate an ID for the remote control connection.

[0168] The following is an apparatus embodiment of the present application, which can be used to execute the method embodiments of the present application. For details not disclosed in the apparatus embodiments of the present application, please refer to the method embodiments of the present application.

[0169] Please refer to Figure 12 , which shows a block diagram of a remote control apparatus provided by an embodiment of the present application. The apparatus has the functions of implementing the above-mentioned method examples of remote control, which can be implemented by hardware or corresponding software executed by hardware. The apparatus 1200 can be the first terminal introduced above, or can be arranged on the first terminal. The apparatus 1200 can include:

[0170] The content sending module 1210 is configured to send screen content to at least one other client participating in the multi-person online conference, when the first client participates in the multi-person online conference and the screen sharing function is enabled.

[0171] The connection establishing module 1220 is configured to establish a remote control connection with a second client, the second client being a client participating in the multi-person online conference.

[0172] The information receiving module 1230 is configured to receive remote control information from the second client after the remote control connection is established, the remote control information being used to control the first client to perform a target operation.

[0173] The operation performing module 1240 is configured to perform the target operation corresponding to the remote control information.

[0174] In an example embodiment, the connection establishing module 1220 is configured to:

[0175] send a controlled request to a server in response to a controlled operation, the controlled request being used to invite the second client to remotely control the first client;

[0176] receive a controlled response sent by the server, the controlled response being sent when the second client agrees to the controlled request, and the controlled response containing first verification information, the first verification information being used to verify the legality of the first client;

[0177] establish the remote control connection between the first verification information and the second client.

[0178] In an example embodiment, the connection establishing module 1220 is configured to:

[0179] receive a control request sent by a server, the control request being a request initiated by the second client to remotely control the first client;

[0180] send a control confirmation response to the server in response to an agreeing operation to the control request, the control confirmation response being used to indicate that the first client agrees to the control request;

[0181] receive first verification information sent by the server, the first verification information being used to verify the legality of the first client;

[0182] establish the remote control connection between the first verification information and the second client.

[0183] In an example embodiment, the connection establishing module 1220 is configured to:

[0184] sending a first connection establishment request to the server, the first connection establishment request being used to request to establish the remote control connection with the second client, the first connection establishment request comprising the first check information, control identity information of the first client and an identity of the first client, the control identity information being used to indicate whether the client is a controller or a controlled party;

[0185] receiving a first connection establishment response sent by the server, the first connection establishment response being used to indicate that the remote control connection has been successfully established, wherein the first connection establishment response is sent by the server based on that the first check information is verified to be passed by the control identity information of the first client and the identity of the first client.

[0186] In summary, the technical scheme provided by the embodiments of the present application, in the multi-person online conference, in the case that the screen sharing function is started on a client, the client can establish a remote control connection with another client in the multi-person online conference, so that another client controls the client to perform a target operation, thereby realizing remote control between two clients / terminals through the multi-person online conference, without the need to additionally install a software program specially used for remote control, and the convenience of remote control is improved.

[0187] Please refer to Figure 13 which shows a block diagram of a remote control device provided by another embodiment of the present application. The device has the functions of implementing the method examples of remote control, which can be implemented by hardware or corresponding software executed by hardware. The device 1300 can be the second terminal introduced above, or can be arranged on the second terminal. The device 1300 can comprise:

[0188] a content display module 1310, configured to display screen content provided by the first client in the case that a multi-person online conference is participated and the screen sharing function of the first client is started, wherein the first client is a client participating in the multi-person online conference;

[0189] a connection establishment module 1320, configured to interact with the first client to establish a remote control connection;

[0190] an information sending module 1330, configured to send remote control information to the first client in response to a remote control operation after the remote control connection is established, the remote control information being used to control the first client to perform a target operation.

[0191] In the exemplary embodiments, the connection establishment module 1320 is configured to:

[0192] receive a controlled request sent by the server, the controlled request being a request initiated by the first client for inviting the second client to remotely control the first client;

[0193] send a controlled response to the server in response to an approval operation for the controlled request, the controlled response being used to indicate that the second client approves the controlled request;

[0194] receive second verification information sent by the server, the second verification information being used to verify the legality of the second client;

[0195] establish the remote control connection between the second verification information and the first client.

[0196] In an example embodiment, the connection establishment module 1320 is configured to:

[0197] send a control request to the server in response to a control operation, the control request being used to request to remotely control the first client;

[0198] receive a control response sent by the server, the control response being sent in the case that the first client approves the control request, and the control response containing second verification information, the second verification information being used to verify the legality of the second client;

[0199] establish the remote control connection between the second verification information and the first client.

[0200] In an example embodiment, the connection establishment module 1320 is configured to:

[0201] send a second connection establishment request to the server, the second connection establishment request being used to request to establish the remote control connection with the second client, the second connection establishment request containing the second verification information, control identity information of the second client and an identity of the second client, the control identity information being used to indicate whether a client is a controller or a controlled party;

[0202] receive a second connection establishment response sent by the server, the second connection establishment response being used to indicate that the remote control connection has been successfully established; wherein the second connection establishment response is sent by the server in the case that the second verification information is verified to be correct based on the control identity information of the second client and the identity of the second client.

[0203] In summary, the technical scheme provided by the embodiments of the present application, in the multi-person online conference, in the case that the screen sharing function is started on a client, the client can establish a remote control connection with another client in the multi-person online conference, so that the other client controls the client to perform a target operation, thereby realizing remote control between two clients / terminals through the multi-person online conference, without installing a software program specially used for remote control, and the convenience of remote control is improved.

[0204] Reference is made to Figure 14 which shows a block diagram of a remote control device provided by another embodiment of the present application. The device has functions of implementing the method examples of remote control, which can be implemented by hardware or corresponding software executed by hardware. The device 1400 can be the server introduced above, or can be arranged on the server. The device 1400 can include:

[0205] a content sending module 1410, configured to send, in a process of a multi-person online conference, screen content of a first client participating in the multi-person online conference to at least one other client participating in the multi-person online conference;

[0206] a connection establishing module 1420, configured to establish a remote control connection between the first client and a second client;

[0207] an information receiving module 1430, configured to receive, after the remote control connection is established, remote control information from the second client, the remote control information being used to control the first client to perform a target operation;

[0208] an information sending module 1440, configured to send the remote control information to the first client.

[0209] In the exemplary embodiments, the connection establishing module 1420 is configured to:

[0210] receive a control requested sent by the first client, the control requested being used to invite the second client to remotely control the first client;

[0211] send, based on the control requested, a control confirmed requested to the second client, the control confirmed requested being used to request the second client to confirm whether to agree to the control requested;

[0212] receive a control confirmed response sent by the second client, the control confirmed response being used to indicate that the second client agrees to the control requested;

[0213] sending a second verification information to the second client, the second verification information being used for legitimacy verification of the second client.

[0214] sending a second verification information to the second client, the second verification information being used for legitimacy verification of the second client.

[0215] In exemplary embodiments, the connection establishing module 1420 is configured to:

[0216] receiving a control request sent by the second client, the control request being used for requesting remote control of the first client;

[0217] sending a control confirmation request to the first client based on the control request, the control confirmation request being used for requesting the first client to confirm whether to agree with the control request;

[0218] receiving a control confirmation response sent by the first client, the control confirmation response being used for indicating that the first client agrees with the control request;

[0219] sending a control response to the second client, the control response including a second verification information, the second verification information being used for legitimacy verification of the second client;

[0220] sending a first verification information to the first client, the first verification information being used for legitimacy verification of the first client.

[0221] In exemplary embodiments, the apparatus 1400 is further configured to:

[0222] receiving a first connection establishing request sent by the first client, the first connection establishing request being used for requesting establishment of the remote control connection with the second client, the first connection establishing request including the first verification information, control identity information of the first client and an identity of the first client, the control identity information being used for indicating whether the client is a controller or a controllee;

[0223] verifying the first verification information based on the control identity information of the first client and the identity of the first client;

[0224] receiving a second connection establishing request sent by the second client, the second connection establishing request being used for requesting establishment of the remote control connection with the second client, the second connection establishing request including the second verification information, control identity information of the second client and an identity of the second client;

[0225] verify the second verification information based on the control identity information of the second client and the identity of the second client;

[0226] in a case where the first verification information and the second verification information are both verified successfully, send a first connection establishment response to the first client and a second connection establishment response to the second client, the first connection establishment response and the second connection establishment response being used to indicate that the remote control connection has been successfully established.

[0227] In an example embodiment, the connection establishment module 1420 is further configured to:

[0228] detect whether the first client has the right to establish the remote control connection in the multi-person online conference according to the control request;

[0229] The detection of whether the first client has the right to establish the remote control connection in the multi-person online conference includes at least one of the following: detection of whether the first client has the right to establish a remote control connection, and detection of whether a remote control connection already exists in the multi-person online conference.

[0230] In a case where the first client has the right to establish the remote control connection in the multi-person online conference, send the control request to the second client;

[0231] detect whether the second client has the right to establish the remote control connection in the multi-person online conference according to the control response;

[0232] The detection of whether the second client has the right to establish the remote control connection in the multi-person online conference includes at least one of the following: detection of whether the second client has the right to establish a remote control connection, and detection of whether a remote control connection already exists in the multi-person online conference.

[0233] In an example embodiment, the connection establishment module 1420 is further configured to:

[0234] detect whether the second client has the right to establish the remote control connection in the multi-person online conference according to the control request;

[0235] The detection of whether the second client has the right to establish the remote control connection in the multi-person online conference includes at least one of the following: detection of whether the second client has the right to establish a remote control connection, and detection of whether a remote control connection already exists in the multi-person online conference.

[0236] send the control request to the first client in a case that the second client has the right to establish the remote control connection in the multi-person online conference;

[0237] detect whether the first client has the right to establish the remote control connection in the multi-person online conference according to the control confirmation response;

[0238] The detecting whether the first client has the right to establish the remote control connection in the multi-person online conference comprises at least one of the following: detecting whether the first client has the right to establish the remote control connection, and detecting whether a remote control connection already exists in the multi-person online conference.

[0239] In an example embodiment, the apparatus 1400 is further configured to:

[0240] receive screen content from the first client;

[0241] eliminate content in the screen content that the second client does not have the right to display according to display permission information of the second client, to obtain processed screen content; wherein the display permission information is used to indicate content that the second client has the right to display or does not have the right to display;

[0242] send the processed screen content to the second client.

[0243] In an example embodiment, the apparatus 1400 is further configured to:

[0244] In a case that the first client and the second client run on different operating systems, convert the remote control information to obtain converted remote control information; wherein the converted remote control information is information that can be recognized by the operating system run by the first client.

[0245] The information sending module 1440 is configured to:

[0246] send the converted remote control information to the first client.

[0247] In summary, the technical scheme provided by the embodiments of the present application enables a client to establish a remote control connection with another client in a multi-person online conference in a case that the screen sharing function of the client is enabled, so that the other client can control the client to perform a target operation, thereby realizing remote control between two clients / terminals through the multi-person online conference, without the need to additionally install a software program specially used for remote control, and improving the convenience of remote control.

[0248] It should be noted that the apparatus provided by the above embodiments, in realizing its functions, is only exemplified by the above division of each functional module, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the above described functions. In addition, the apparatus and method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

[0249] Please refer to Figure 15 , which shows a structural block diagram of a terminal 1500 provided by an embodiment of the present application. The terminal 1500 can be an electronic device such as a mobile phone, a tablet computer, a game console, an e-book reader, a multimedia playback device, a wearable device, a PC, etc. The terminal 1500 is used to implement the above-mentioned first client-side remote control method or the second client-side remote control method. The terminal can be Figure 1 the first terminal 11 or the second terminal 12 in the implementation environment shown. Specifically:

[0250] Generally, the terminal 1500 includes a processor 1501 and a memory 1502.

[0251] The processor 1501 can include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1501 can be implemented in at least one of the hardware forms of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1501 can also include a main processor and a coprocessor, the main processor is a processor for processing data in the wake-up state, also known as CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1501 can be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed by the display screen. In some embodiments, the processor 1501 can also include an AI (Artificial Intelligence) processor, which is used to process machine learning-related computing operations.

[0252] The memory 1502 can include one or more computer-readable storage media. The computer-readable storage media can be non-transitory. The memory 1502 can also include high-speed random access memory and can include nonvolatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other nonvolatile solid-state storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1502 is used for storing at least one instruction, at least one program, a set of codes or an instruction set, and is configured to be executed by one or more processors to implement the first client-side remote control method or the second client-side remote control method described above.

[0253] In some embodiments, the terminal 1500 can also optionally include a peripheral device interface 1503 and at least one peripheral device. The processor 1501, the memory 1502 and the peripheral device interface 1503 can be connected through a bus or a signal line. Each peripheral device can be connected to the peripheral device interface 1503 through a bus, a signal line or a circuit board. Specifically, the peripheral device includes at least one of a radio frequency circuit 1504, a display screen 1505, an audio circuit 1507 and a power supply 1509.

[0254] Those skilled in the art can understand that Figure 15 The structure shown in FIG. 15 is not a limitation on the terminal 1500, and can include more or fewer components than shown, or combine certain components, or use different arrangements of components.

[0255] Please refer to Figure 16 which shows a structure block diagram of a server provided by an embodiment of the present application. The server is used to implement the server-side remote control method provided in the above embodiments. Specifically:

[0256] The server 1600 includes a CPU (Central Processing Unit) 1601, a system memory 1604 including a RAM (Random Access Memory) 1602 and a ROM (Read-Only Memory) 1603, and a system bus 1605 connecting the system memory 1604 and the central processing unit 1601. The server 1600 also includes a basic I / O (Input / Output) system 1606 that helps transfer information between various devices in the computer, and a mass storage device 1607 for storing an operating system 1613, application programs 1614 and other program modules 1615.

[0257] The basic input / output system 1606 includes the various components needed to display information, such as a display 1608 and input devices 1609, such as a mouse and keyboard, for inputting information. Both the display 1608 and input devices 1609 are connected to the central processing unit 1601 through the input / output controller 1610, which is connected to the system bus 1605. The basic input / output system 1606 can also include the input / output controller 1610 for receiving and processing input from a number of other devices, including a keyboard, mouse, or electronic stylus. Similarly, the input / output controller 1610 provides output to a display screen, a printer, or other type of output device.

[0258] The mass storage device 1607 is connected to the central processing unit 1601 through a mass storage controller (not shown), which is connected to the system bus 1605. The mass storage device 1607 and its associated computer-readable media provide non-volatile storage for the server 1600. That is, the mass storage device 1607 can include a computer-readable medium (not shown) such as a hard disk or a CD-ROM (Compact Disc Read-Only Memory) drive.

[0259] Without loss of generality, the computer-readable media can include computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash memory or other solid state memory, CD-ROM, DVD (Digital Video Disc), or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices. Computer storage media would not, however, include communication media including wired or wireless signaling media that transmit program code in the form of packets, cells, or the like. The system memory 1604 and mass storage device 1607, as described above, can together comprise a memory.

[0260] According to various embodiments of the present application, the server 1600 can also be operated by connecting to a remote computer on a network, such as the Internet. That is, the server 1600 can be connected to a network 1612 through a network interface unit 1611 connected to the system bus 1605, or can be connected to other types of networks or remote computer systems (not shown) using the network interface unit 1611.

[0261] In an example embodiment, a computer readable storage medium is also provided, and the storage medium stores at least one instruction, at least one program, a code set or an instruction set, which, when executed by a processor, implements the above-mentioned first client-side remote control method.

[0262] Optionally, the computer readable storage medium can include a ROM (Read-Only Memory), a RAM (Random-Access Memory), a SSD (Solid State Drives), an optical disc, or the like. Among them, the random access memory can include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0263] In an example embodiment, a computer readable storage medium is also provided, and the storage medium stores at least one instruction, at least one program, a code set or an instruction set, which, when executed by a processor, implements the above-mentioned second client-side remote control method.

[0264] In an example embodiment, a computer readable storage medium is also provided, and the storage medium stores at least one instruction, at least one program, a code set or an instruction set, which, when executed by a processor, implements the above-mentioned server-side remote control method.

[0265] In an example embodiment, a computer program product or computer program is also provided, and the computer program product or computer program includes computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device executes the above-mentioned first client-side remote control method.

[0266] In an exemplary embodiment, a computer program product or computer program is also provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the remote control method described above on the second client side.

[0267] In an exemplary embodiment, a computer program product or computer program is also provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the aforementioned server-side remote control method.

[0268] It is understood that the specific implementation of this application involves user information and other related data. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0269] It should be understood that "multiple" as used in this article refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0270] The above description is merely an exemplary embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A remote control method characterized by, The method is executed by a first client, and the method comprises: In a case where a multi-person online conference is participated in and a screen sharing function of the first client is enabled, screen content is sent to at least one other client participating in the multi-person online conference; wherein a conference control system corresponding to the multi-person online conference is configured to send a switch instruction of a remote control control to the first client according to permission information of a user account corresponding to the first client, in a case where it is indicated in the permission information that the user account corresponding to the first client has no remote control permission, the switch instruction is configured to close the remote control function of all clients in the multi-person online conference, and in a case where it is indicated in the permission information that the user account corresponding to the first client has remote control permission, the switch instruction is configured to enable the remote control function of all clients in the multi-person online conference; In a case where no other remote control connection exists in the multi-person online conference and both the first client and a second client have permission to establish a remote control connection in the multi-person online conference, the remote control connection is established by interaction with the second client, which is a client participating in the multi-person online conference; After the remote control connection is established, screen content of a first screen corresponding to the first client is sent to a server, the server is configured to eliminate content in the screen content that the second client has no right to display according to display permission information of the second client, to obtain processed screen content, and to send the processed screen content to the second client, the display permission information is configured to indicate content that the second client has a right to display or has no right to display; the first screen comprises a remote control region and a non-remote control region, the remote control region is a region that allows the second client to perform remote control, and the non-remote control region is a region that does not allow the second client to perform remote control, the remote control region and the non-remote control region are displayed in a second screen corresponding to the second client, and the second client cannot control the non-remote control region; Remote control information from the second client is received, the remote control information is configured to control the first client to perform a target operation; Operation permission information of the second client is obtained, the operation permission information is configured to indicate an operation that the second client has a right to perform remote control on; In a case where the target operation belongs to the operation that the second client has a right to perform remote control on, the target operation corresponding to the remote control information is executed; In a case where the target operation belongs to the operation that the second client has no right to perform remote control on, the target operation corresponding to the remote control information is not executed; In a case where there is a security risk in the multi-person online conference or a client participating in the multi-person online conference, security alarm information is received, and a security monitoring system corresponding to the multi-person online conference is configured to determine whether to interrupt the remote control connection according to a risk level of the security risk.

2. The method of claim 1, wherein, The interaction with the second client to establish the remote control connection comprises: sending a controlled request to a server in response to a controlled operation, the controlled request being used to invite the second client to remotely control the first client; receiving a controlled response sent by the server, the controlled response being sent in the case that the second client agrees to the controlled request, and the controlled response containing first verification information, the first verification information being used to verify the legality of the first client; establishing the remote control connection between the first verification information and the second client.

3. The method of claim 1, wherein, The interaction with the second client to establish the remote control connection comprises: receiving a control request sent by a server, the control request being a request initiated by the second client to remotely control the first client; sending a control confirmation response to the server in response to an agreeing operation for the control request, the control confirmation response being used to indicate that the first client agrees to the control request; receiving first verification information sent by the server, the first verification information being used to verify the legality of the first client; establishing the remote control connection between the first verification information and the second client.

4. The method according to claim 2 or 3, characterized in that, The establishment of the remote control connection between the first verification information and the second client comprises: sending a first connection establishment request to the server, the first connection establishment request being used to request the establishment of the remote control connection with the second client, the first connection establishment request containing the first verification information, control identity information of the first client, and an identifier of the first client, the control identity information being used to indicate whether a client is a controller or a controlled party; receiving a first connection establishment response sent by the server, the first connection establishment response being used to indicate that the remote control connection has been successfully established; wherein the first connection establishment response is sent by the server in the case that the first verification information passes the verification based on the control identity information of the first client and the identifier of the first client.

5. A remote control method characterized by, The method is performed by a second client, and the method comprises: displaying screen content provided by a first client in the case that a multi-person online conference is participated in and the first client starts a screen sharing function; wherein the first client is a client participating in the multi-person online conference, and a conference control system corresponding to the multi-person online conference is used to send an on-off instruction of a remote control control to the first client according to permission information of a user account corresponding to the first client, the on-off instruction being used to turn off the remote control function of all clients in the multi-person online conference in the case that the permission information indicates that the user account corresponding to the first client has no remote control permission, and the on-off instruction being used to turn on the remote control function of all clients in the multi-person online conference in the case that the permission information indicates that the user account corresponding to the first client has remote control permission. In the case that there is no other remote control connection in the multi-person online conference, and the first client and the second client both have the authority to establish a remote control connection in the multi-person online conference, the remote control connection is established by interacting with the first client; After the remote control connection is established, the processed screen content in the first screen corresponding to the first client is received, the second screen corresponding to the second client displays a remote control area and a non-remote control area, and the second client cannot control the non-remote control area, the remote control area is an area that allows the second client to remotely control, and the non-remote control area is an area that does not allow the second client to remotely control; In response to a remote control operation, remote control information is sent to the first client, the remote control information is used to control the first client to perform a target operation; the first client is used to receive remote control information from the second client, and in the case that the target operation belongs to an operation that the second client has the right to remotely control, the target operation corresponding to the remote control information is executed, and in the case that the target operation belongs to an operation that the second client does not have the right to remotely control, the target operation corresponding to the remote control information is not executed; In the case that there is a security risk in the multi-person online conference or a client participating in the multi-person online conference, security alarm information is received, and a security monitoring system corresponding to the multi-person online conference is used to determine whether to interrupt the remote control connection according to a risk level of the security risk.

6. The method of claim 5, wherein, The remote control connection is established by interacting with the first client, including: A controlled request sent by a server is received, the controlled request is a request initiated by the first client to invite the second client to remotely control the first client; In response to an agreement operation for the controlled request, a controlled response is sent to the server, the controlled response is used to indicate that the second client agrees to the controlled request; Second verification information sent by the server is received, the second verification information is used to verify the legality of the second client; The remote control connection is established between the second verification information and the first client.

7. The method of claim 5, wherein, The remote control connection is established by interacting with the first client, including: In response to a control operation, a control request is sent to a server, the control request is used to request to remotely control the first client; A control response sent by the server is received, the control response is sent in the case that the first client agrees to the control request, and the control response includes second verification information, the second verification information is used to verify the legality of the second client; The remote control connection is established between the second verification information and the first client.

8. The method according to claim 6 or 7, characterized in that, The remote control connection is established between the second verification information and the first client, including: sending a second connection establishment request to the server, the second connection establishment request being used to request to establish the remote control connection with the second client, the second connection establishment request comprising the second check information, control identity information of the second client and an identifier of the second client, the control identity information being used to indicate whether the client is a controller or a controlled party; receiving a second connection establishment response sent by the server, the second connection establishment response being used to indicate that the remote control connection has been successfully established, wherein the second connection establishment response is sent by the server based on that the second check information passes the check based on the control identity information of the second client and the identifier of the second client.

9. A remote control method characterized by, The method is performed by a server, and the method comprises: In the process of a multi-person online conference, screen content of a first client participating in the multi-person online conference is sent to at least one other client participating in the multi-person online conference. A conference control system corresponding to the multi-person online conference sends a switch instruction of a remote control control to the first client according to permission information of a user account corresponding to the first client, in a case where the permission information indicates that the user account corresponding to the first client does not have the permission of remote control, the switch instruction is used to close the remote control function of all clients in the multi-person online conference, and in a case where the permission information indicates that the user account corresponding to the first client has the permission of remote control, the switch instruction is used to open the remote control function of all clients in the multi-person online conference. In a case where there is no other remote control connection in the multi-person online conference, and the first client and the second client both have the permission of establishing a remote control connection in the multi-person online conference, a remote control connection between the first client and the second client is established, the second client being a client participating in the multi-person online conference. After the remote control connection is established, screen content of a first screen of the first client is received, the first screen comprising a remote control region and a non-remote control region, the remote control region being a region allowing the second client to perform remote control, and the non-remote control region being a region not allowing the second client to perform remote control. According to display permission information of the second client, content in the screen content that the second client does not have the permission to display is eliminated, to obtain processed screen content, wherein the display permission information is used to indicate content that the second client has the permission to display or does not have the permission to display. The processed screen content is sent to the second client, the second screen corresponding to the second client displaying the remote control region and the non-remote control region, and the second client being unable to control the non-remote control region. Remote control information from the second client is received, the remote control information being used to control the first client to perform a target operation. sending the remote control information to the first client, the first client being configured to receive remote control information from the second client and perform the target operation corresponding to the remote control information if the target operation belongs to operations that the second client has the right to remotely control, and not performing the target operation corresponding to the remote control information if the target operation belongs to operations that the second client does not have the right to remotely control; sending security alert information to each client participating in the multi-person online conference if there is a security risk in the multi-person online conference or the client participating in the multi-person online conference; the security monitoring system corresponding to the multi-person online conference determines whether to interrupt the remote control connection according to the risk level of the security risk.

10. The method of claim 9, wherein, The method further comprises: receiving a controlled request sent by the first client, the controlled request being used to invite the second client to remotely control the first client; sending a controlled confirmation request to the second client based on the controlled request, the controlled confirmation request being used to request the second client to confirm whether to agree to the controlled request; receiving a controlled confirmation response sent by the second client, the controlled confirmation response being used to indicate that the second client agrees to the controlled request; sending a controlled response to the first client, the controlled response containing first verification information, the first verification information being used to verify the legality of the first client; sending second verification information to the second client, the second verification information being used to verify the legality of the second client.

11. The method of claim 9, wherein, The method further comprises: receiving a control request sent by the second client, the control request being used to request to remotely control the first client; sending a control confirmation request to the first client based on the control request, the control confirmation request being used to request the first client to confirm whether to agree to the control request; receiving a control confirmation response sent by the first client, the control confirmation response being used to indicate that the first client agrees to the control request; sending a control response to the second client, the control response containing second verification information, the second verification information being used to verify the legality of the second client; sending first verification information to the first client, the first verification information being used to verify the legality of the first client.

12. The method according to claim 10 or 11, characterized in that, The method further comprises: receiving a first connection establishment request sent by the first client, the first connection establishment request being used to request to establish the remote control connection with the second client, the first connection establishment request containing the first verification information, control identity information of the first client, and an identifier of the first client, the control identity information being used to indicate whether the client is a controller or a controlled party; verify the first check information based on the control identity information of the first client and the identity of the first client; receive a second connection establishment request sent by the second client, the second connection establishment request being used to request to establish the remote control connection with the second client, and the second connection establishment request comprising the second check information, control identity information of the second client and the identity of the second client; verify the second check information based on the control identity information of the second client and the identity of the second client; in a case where the first check information and the second check information are both verified, send a first connection establishment response to the first client and send a second connection establishment response to the second client, the first connection establishment response and the second connection establishment response being used to indicate that the remote control connection has been successfully established.

13. The method of claim 9, wherein, after the remote control information from the second client is received, the method further comprises: in a case where the first client and the second client run on different operating systems, converting the remote control information to obtain converted remote control information, wherein the converted remote control information is information that can be recognized by the operating system on which the first client runs; the sending of the remote control information to the first client comprises: sending the converted remote control information to the first client.

14. A computer device, comprising: The computer device comprises a processor and a memory, and the memory stores at least one program, the at least one program is loaded and executed by the processor to implement the remote control method of any one of claims 1 to 13.

15. A computer-readable storage medium, characterized in that, The computer readable storage medium stores at least one program, and the at least one program is loaded and executed by the processor to implement the remote control method of any one of claims 1 to 13.

16. A computer program product, characterised in that, The computer program product comprises computer instructions stored in a computer readable storage medium, and the processor reads and executes the computer instructions from the computer readable storage medium to implement the remote control method of any one of claims 1 to 13.

Images