Remote access method, electronic equipment, personal computer and system

Abstract

The embodiment of the invention provides a remote access method, electronic equipment and a personal computer. In the method, when the electronic equipment successfully establishes remote connection with the PC, the electronic equipment judges whether the PC is currently used by a user according to state information of the PC, and flexibly determines a display mode of the PC according to a judgment result, so that different use experiences are provided for the user in a remote control application scene.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent terminals, and in particular to a remote access method, electronic equipment, personal computer and system. Background Art

[0002] As technology becomes more and more advanced, the Internet has become an indispensable part of people's lives. Smart phones, tablet computers (pads), PCs (Personal Computers) and other electronic devices can establish remote access connections with PCs through the Internet, allowing users to use these electronic devices to remotely operate PCs anytime and anywhere, bringing many conveniences to people's work and life. Summary of the invention

[0003] The embodiment of the present application provides a remote access method, electronic device, personal computer and system. In the method, the electronic device provides a user with a different remote control experience according to whether the PC is currently being used by the user.

[0004] In a first aspect, an embodiment of the present application provides a remote access method. The method includes:

[0005] The electronic device displays a first interface, the first interface including a device list; in response to a user selecting a first PC from the device list, the electronic device establishes a first remote access connection with the first PC; when the electronic device successfully establishes the first remote access connection with the first PC, the electronic device obtains status information of the first PC;

[0006] When the status information indicates that the first PC is not being used by the user, the electronic device displays a first UI interface of the first PC and sends first indication information to the first PC, and the first PC displays a second interface according to the first indication information, the second interface includes the first prompt information, the second interface does not include the content in the first UI interface, and the first prompt information is used to indicate that the current PC is being remotely controlled;

[0007] When the status information indicates that the first PC is in use by the user, the electronic device displays the second UI interface of the first PC and sends second indication information to the first PC. The first PC pops up a prompt window on the second UI interface displayed according to the second indication information. The information in the prompt window is used to indicate that the PC is currently being remotely accessed by other devices.

[0008] The device list may also be referred to as a remote control device list, and the device list displays one or more PCs that can establish a remote access connection with the electronic device.

[0009] Exemplarily, the operation of the user selecting the first PC from the device list may be an operation of the user clicking a remote access control corresponding to the first PC in the device list.

[0010] Exemplarily, the second interface may refer to the security screen interface mentioned below, which is used to prevent the PC UI interface from being viewed by other irrelevant users.

[0011] In this way, when the electronic device successfully establishes a remote access connection with the first PC, the electronic device can determine the display mode of the first PC differently according to whether the first PC is in use by the user, thereby providing the user with a different remote control experience.

[0012] It should be pointed out that no matter whether the status of the first PC indicates that the first PC is in use by the user or indicates that the first PC is not in use by the user, when the electronic device successfully establishes a first remote access connection with the first PC, the UI interface of the first PC can be displayed on the electronic device side. The difference lies in the different display methods on the first PC side.

[0013] According to the first aspect, the display resolution of the electronic device is a first resolution, the display resolution of the first PC is a second resolution, and the first resolution is different from the second resolution. The method further includes:

[0014] When the status information indicates that the first PC is not in use by the user, the electronic device sends third indication information to the first PC, and the first PC adjusts its display resolution from the second resolution to the third resolution according to the third indication information; wherein, when the display resolution of the first PC is the second resolution, the display area of ​​the first UI interface of the first PC in the display interface of the electronic device accounts for a first ratio; when the display resolution of the first PC is the third resolution, the display area of ​​the first UI interface of the first PC in the display interface of the electronic device accounts for a second ratio; the second ratio is greater than the first ratio.

[0015] When the status information indicates that the first PC is being used by the user, the display resolution of the first PC may not be adjusted.

[0016] Among them, the display area ratio of the first UI interface of the first PC in the display interface of the electronic device refers to the ratio of the display area area of ​​the first UI interface of the first PC to the display interface area of ​​the electronic device (i.e., the sum of the display area area of ​​the first UI interface of the first PC and the black border area) in the display interface of the electronic device.

[0017] In this way, when the electronic device successfully establishes a remote access connection with the first PC, the electronic device can determine the display resolution of the first PC differently according to whether the first PC is in use by the user, and adjust the display resolution of the first PC to match the resolution of the electronic device display screen when the first PC is not currently in use by the user, thereby reducing the black border area when the electronic device displays the UI interface of the first PC and improving the visual experience of the user on the electronic device side. At the same time, when the first PC is currently in use by the user, the display resolution of the first PC is not adjusted, thereby giving priority to the user experience on the PC side.

[0018] According to the first aspect, or any implementation of the first aspect above, when the first resolution is a display resolution supported by the first PC, the third resolution is the same as the first resolution.

[0019] In this way, if the display resolution supported by the first PC includes the display resolution of the electronic device, the first PC directly adjusts its display resolution to the display resolution of the electronic device, so that no black border area appears when the electronic device displays the first PC UI interface.

[0020] According to the first aspect, or any implementation of the first aspect above, when the first resolution is not a display resolution supported by the first PC, among the display resolutions supported by the first PC, the aspect-to-height pixel ratio or the height-to-width pixel ratio of the third resolution is most similar to the first resolution.

[0021] In this way, if the display resolution supported by the first PC does not include the display resolution of the electronic device, the first PC directly adjusts its display resolution to a resolution most similar to the display resolution of the electronic device, so that the range of the black border area is minimized when the electronic device displays the first PC UI interface.

[0022] According to the first aspect, or any implementation of the first aspect above, the method further includes: when the status information indicates that the first PC is in use by the user, the electronic device sends fourth indication information to the first PC, and the first PC maintains the display resolution currently set for the first PC according to the fourth indication information.

[0023] In this way, when the first PC is currently used by the user, the display resolution of the first PC is not adjusted, thereby giving priority to ensuring the user experience of the PC side.

[0024] Optionally, when the status information indicates that the first PC is being used by the user, the electronic device may not send the fourth indication information to the first PC, that is, the electronic device does not perform any operation to instruct the first PC to adjust its display resolution so that the first PC maintains its currently set display resolution.

[0025] According to the first aspect, or any implementation of the first aspect above, the second interface also includes second prompt information, and the second prompt information is used to prompt the PC to exit the target operation mode of displaying the second interface.

[0026] The method further includes: in response to the target operation indicated by the second prompt information, the first PC exits displaying the second interface; or, in response to other keyboard and mouse operations except the target operation, the first PC continues to display the second interface.

[0027] In this way, only when the user performs a specific operation can the first PC exit the display security screen interface, which greatly protects the operation privacy of the remote user.

[0028] According to the first aspect, or any implementation of the first aspect above, the method further includes:

[0029] When the state information indicates that the first PC is not in use by the user, the electronic device sets the default states of the microphone option and the speaker option to be turned on;

[0030] When the state information indicates that the first PC is in a state of being used by the user, the electronic device sets the default states of the microphone option and the speaker option to off;

[0031] When the microphone option is turned on, the sound signal is collected through the microphone of the electronic device, and when the microphone option is turned off, the sound signal is collected through the microphone of the first PC;

[0032] When the state of the speaker option is turned on, the sound signal is output through the speaker of the electronic device, and when the state of the speaker option is turned off, the sound signal is output through the speaker of the first PC.

[0033] In this way, when the electronic device successfully establishes a remote access connection with the first PC, the electronic device can set the default states of the microphone option and the speaker option differently according to whether the first PC is being used by the user, thereby improving the user's remote control experience.

[0034] According to the first aspect, or any implementation of the first aspect above, the device list includes at least one PC; in the device list, the state of the remote access control corresponding to the first PC is an available state, and the state of the remote access control corresponding to the second PC is an unavailable state.

[0035] The method further includes:

[0036] After the second PC is turned on, or after the second PC exits the sleep mode, the state of the remote access control corresponding to the second PC changes from an unavailable state to an available state;

[0037] After the second PC is shut down, or the second PC enters the sleep mode, the state of the remote access control corresponding to the second PC changes from an available state to an unavailable state.

[0038] In this embodiment, the PC included in the device list may be in a remote control state or in a non-remote control state, which is related to the power on / off state of the PC or whether it is in sleep mode. According to the change of the PC state, the availability state of the remote access control corresponding to the PC in the device list will also change accordingly.

[0039] According to the first aspect, or any implementation of the first aspect above, when the first PC is in a shutdown state, a dormant state, or a sleeping state, the remote wake-up function is not supported.

[0040] If the status information of the first PC is that the screen is on and unlocked, the status information indicates that the first PC is being used by the user; otherwise, the status information indicates that the first PC is not being used by the user.

[0041] According to the first aspect, or any implementation of the first aspect, when the first PC is in a shutdown state, a dormant state, or a sleeping state, a remote wake-up function is supported.

[0042] If the status information of the first PC is that the screen is on and unlocked, and the first PC is not remotely awakened, the status information indicates that the first PC is being used by the user; otherwise, the status information indicates that the first PC is not being used by the user.

[0043] According to the first aspect, or any implementation of the first aspect above, after the first PC adjusts its display resolution from the second resolution to the third resolution according to the third indication information, the method further includes: in response to the operation of disconnecting the first remote access connection, the electronic device sends fifth indication information to the first PC and disconnects the remote access connection with the first PC; the first PC restores the display resolution of the first PC to the second resolution according to the fifth indication information;

[0044] Alternatively, in response to the operation of disconnecting the first remote access connection, the first PC disconnects the remote access connection with the electronic device and restores the display resolution of the first PC to the second resolution;

[0045] Alternatively, after the remote access connection between the first PC and the electronic device is disconnected due to network reasons, the first PC restores the display resolution of the first PC to the second resolution.

[0046] In this way, in the scenario where the display resolution of the first PC is adjusted during the remote access connection, no matter what the reason is that the remote access connection is disconnected, the display resolution of the first PC can be restored to the original resolution, which will not affect the user's visual experience when using the PC subsequently.

[0047] According to the first aspect, or any implementation of the first aspect above, when the electronic device displays the first UI interface of the first PC, the method further includes:

[0048] In response to the first operation on the first UI interface, the electronic device sends a first remote control instruction to the first PC; the first PC responds to the first remote control instruction, executes a first program related to the first remote control instruction, and feeds back data of a third UI interface corresponding to the execution of the first program to the electronic device, while the first PC continues to display the second interface. The electronic device receives the data of the third UI interface and displays the third UI interface of the first PC.

[0049] The first operation may be any operation performed by the user on the first PC UI interface on the electronic device side. For example, the first operation may be an operation of opening a folder or a file in the first PC, an operation of opening an application, or an operation of selecting, clicking, double-clicking, copying, cutting, or moving a control.

[0050] Correspondingly, the first remote control instruction is a remote control instruction that matches the first operation, so that the first PC can respond to the user operation according to the remote control instruction.

[0051] In this case, after receiving the first remote control instruction, the first PC executes the first program related to the first remote control instruction, and feeds back the relevant data of its UI interface changes to the electronic device, so that the electronic device side can display the UI interface changes of the first PC to the user. At the same time, the first PC side will not display its UI interface changes, but continue to display the second interface to avoid information leakage caused by remote operations of the user on the electronic device side. That is, when the first PC is not in use by the user, if the user remotely controls the first PC on the electronic device side, the UI interface of the first PC displayed on the electronic device side changes accordingly, and the first PC side continues to display the second interface (that is, the security screen interface).

[0052] According to the first aspect, or any implementation of the first aspect above, when the electronic device displays the second UI interface of the first PC, the method further includes:

[0053] In response to the second operation on the second UI interface, the electronic device sends a second remote control instruction to the first PC; the first PC executes a second program related to the second remote control instruction in response to the second remote control instruction, the first PC displays a fourth UI interface corresponding to the execution of the second program, and feeds back the data of the fourth UI interface to the electronic device; the electronic device receives the data of the fourth UI interface and displays the fourth UI interface of the first PC.

[0054] The second operation may be any operation performed by the user on the second PC UI interface on the electronic device side. For example, the second operation may be an operation of opening a folder or a file in the first PC, an operation of opening an application, or an operation of selecting, clicking, double-clicking, copying, cutting, or moving a control.

[0055] Correspondingly, the second remote control instruction is a remote control instruction that matches the second operation, so that the first PC can respond to the user operation according to the remote control instruction.

[0056] In this case, after the first PC receives the second remote control instruction, it executes the first program related to the second remote control instruction, and the UI interface on the first PC side changes at any time. At the same time, the first PC will feed back the relevant data of its UI interface changes to the electronic device, so that the electronic device side can also display the UI interface changes of the first PC to the user. That is, when the first PC is in use by the user, if the user remotely controls the first PC on the electronic device side, the changes in the UI interface of the first PC displayed on the electronic device side are consistent with the changes in its UI interface on the first PC side.

[0057] In a second aspect, an embodiment of the present application provides an electronic device. The electronic device includes: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device executes the method steps executed by the electronic device in the remote control method of the first aspect and any one of the first aspects.

[0058] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0059] In a third aspect, an embodiment of the present application provides a PC. The PC includes: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the PC executes the method steps executed by the first PC in the remote control method of the first aspect and any one of the first aspects.

[0060] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0061] In a fourth aspect, an embodiment of the present application provides a remote access system, wherein the system includes the electronic device as shown in the second aspect and any one of the implementations of the second aspect, and at least one PC as shown in the third aspect and any one of the implementations of the third aspect.

[0062] The fourth aspect and any implementation of the fourth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0063] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium. The computer-readable storage medium includes a computer program, and when the computer program is executed on an electronic device, the electronic device executes the method steps executed by the electronic device or the method steps executed by the first PC in the remote access method of the first aspect and any one of the first aspects.

[0064] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1a is a schematic diagram of an interface of a PAD-side remote control application shown as an example;

[0066] Figure 1b is a schematic diagram of an interface of a PAD-side remote control application shown as an example;

[0067] Figure 1cA schematic diagram of an application scenario of a remote access connection is shown as an example;

[0068] Figure 2 A schematic diagram of terminal interaction involved in the remote access method is shown as an example;

[0069] Figure 3 is a schematic diagram showing an exemplary PC being remotely woken up;

[0070] Figure 4 The following are examples of the resolution of PC and PAD / mobile phone shown for example;

[0071] Figure 5 This is an example of a screen when the PAD displays a PC UI interface;

[0072] Figure 6a This is an example of screen comparison when a PAD displays a PC UI interface;

[0073] Figure 6b This is an example of screen comparison when a PAD displays a PC UI interface;

[0074] Figure 7 An example of an interface change when a PC is remotely accessed is shown as an example;

[0075] Figure 8 An example of an interface change when a PC is remotely accessed is shown as an example;

[0076] Fig. 9 An example of an interface change when a PC is remotely accessed is shown as an example;

[0077] Fig.10a The following is an example of a PAD interface when a PAD remotely accesses a PC;

[0078] Fig.10b The following is an example of a PC interface when a PAD remotely accesses a PC;

[0079] Fig.11 The following is an example of a PAD interface when a PAD remotely accesses a PC;

[0080] Fig.12 The following is an example of PAD operation when the PAD remotely accesses the PC;

[0081] Fig.13 is a schematic diagram of the hardware structure of an electronic device shown as an example;

[0082] Fig.14 The software structure diagram of an electronic device is shown as an example. DETAILED DESCRIPTION

[0083] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0084] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0085] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0086] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0087] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0088] As technology becomes more and more advanced, the Internet has become an indispensable part of people's lives. Electronic devices such as smartphones, tablet computers (PADs) or PCs can establish remote access connections with other PCs (or computers, such as laptops, desktop computers, etc.) through the Internet, allowing users to use these electronic devices to remotely operate PCs anytime and anywhere, bringing many conveniences to people's work and life.

[0089] For example, when people forget to copy important files from their PCs when they are on a business trip, or when company leaders need files from their PCs temporarily, they can use these electronic devices to establish a remote access connection with the corresponding PCs to remotely control the PCs, and related problems can be solved. For another example, when parents are away from home and want to check on their children's use of the PC, they can also use these electronic devices to establish a remote access connection with the corresponding PCs to check on the use of the PCs.

[0090] The following uses a PAD as an example to explain a method for a user to remotely control a PC using an electronic device. This embodiment does not limit the type of electronic device that remotely controls a PC.

[0091] Among them, the way in which electronic devices such as PADs establish remote connections with PCs is related to the method of using remote control applications, which is not limited in this embodiment. Remote control applications refer to applications used to achieve remote access or remote control of PCs. They can be system-level applications or user-level applications, which are not limited in this embodiment. For electronic devices that belong to the same developer as the remote control application (including mobile phones, remote control devices such as PADs, and PCs), the remote control application can be pre-installed in the operating systems of remote devices (such as mobile phones, PADs, etc.) and PCs; for electronic devices that do not belong to the same developer as the remote control application (including mobile phones, remote control devices such as PADs, and PCs), users can install the remote control application in the operating systems of these devices through operations such as downloading.

[0092] In an optional implementation, electronic devices such as PADs and PCs can achieve remote access connection based on the same terminal account (or account). For electronic devices that are developed by the same developer as the remote control application, users can log in to the terminal account in the terminal account login interface of the device, so that the remote control application installed in the device system also logs in to the terminal account by default; for electronic devices that are not developed by the same developer as the remote control application, users can directly log in to the terminal account in the remote control application installed in the device system.

[0093] Taking the electronic device that belongs to the same developer as the remote control application as an example, after the user registers a terminal account, the server side (such as a cloud server) creates a trust ring corresponding to the terminal account, and each electronic device logged in to the terminal account will be added to the trust ring corresponding to the terminal account. Among them, the electronic devices logged in to the same terminal account can be understood as belonging to the same user (or the same family household), that is, the electronic devices in the same trust ring can be understood as belonging to the same user.

[0094] In the embodiment of the present application, if a PAD and multiple PCs belong to the same trust ring, the PAD can remotely control the multiple PCs respectively. For example, if a PAD and multiple PCs log in to the same terminal account (that is, a PAD and multiple PCs belong to the same trust ring), the device names of the multiple PCs will be displayed in the remote control device list of the PAD.

[0095] like Figure 1aAs shown in (1), the user clicks on the remote control option 101 in the relevant interface of the PAD. In response to the user's operation, the PAD displays the following Figure 1a The remote control interface 102 shown in (2) in FIG. 1 shows a remote control device list in the remote control interface 102. For example, when the PAD and PC "book1", PC "book2" and PC "book3" log in to the same terminal account, the remote control device list of the PAD shows three remotely controllable PCs, namely PC "book1", PC "book2" and PC "book3". Figure 1a Chinese (2).

[0096] Among them, the remote access control 1021 corresponding to PC "book1" and the remote access control 1022 corresponding to PC "book2" are in a clickable state, indicating that the PC is currently in a remote control state, such as a power-on state; the remote access control 1023 corresponding to PC "book3" is in an unclickable state, indicating that the PC is currently in a state that cannot be remotely controlled, such as a power-off state, a sleep state, etc. It can be seen that although PC "book3" is currently in a state that cannot be remotely controlled, since the terminal account logged in by PC "book3" and the PAD is the same (that is, PC "book3" and the PAD belong to the same trust ring), PC "book3" can also be displayed in the remote control device list of the PAD to prompt the user that after PC "book3" is turned on, the PAD can also remotely access PC "book3".

[0097] At this time, if the user clicks on the remote access control 1021 or the remote access control 1022, in response to the user's operation, the PAD can interact with the PC "book1" or PC "book2" to establish a remote access connection. For example, when the remote access connection between the PAD and the PC "book1" is successful, the control corresponding to the PC "book1" in the remote control device list of the PAD is changed from the remote access control to the disconnect remote access control, such as Figure 1b As shown, the user is prompted that the current PAD has established a remote access connection with PC "book1". Among them, the control corresponding to PC "book1" is the disconnect remote access control 1024. If the user clicks the disconnect remote access control 1024, the PAD and PC "book1" exchange information to disconnect the remote access connection between the PAD and PC "book1". After the remote access connection between the PAD and PC "book1" is disconnected, the control corresponding to PC "book1" in the remote control device list of the PAD is changed from the disconnect remote access control to the remote access control, as shown in FIG. Figure 1aAs shown in the remote access control 1021 in the figure. At this time, the user can choose to click the remote access control 1022 corresponding to PC "book2" to establish a remote access connection between the PAD and PC "book2". Then, after the remote access connection between the PAD and PC "book2" is successful, the user can use the PAD to remotely access PC "book2", so that the PAD synchronously displays the UI (User Interface) interface of PC "book2", which can be referred to Figure 1c shown.

[0098] For example, in response to the user clicking the remote access control 1022 corresponding to PC "book2", a remote access connection is established between the PAD and PC "book2", and the PAD directly displays the following when the remote access connection is successful: Figure 1c In another exemplary embodiment, in response to the user clicking the remote access control 1022 corresponding to PC "book2", a remote access connection is established between the PAD and PC "book2". When the remote access connection is successful, the PAD pops up a remote control notification window or permanently displays the remote control notification window in the notification bar. In response to the user clicking the access entry control in the remote control notification window, the PAD displays Figure 1c After the remote access connection between the PAD and a PC is successful, this embodiment does not limit how the PAD jumps to display the PC UI interface.

[0099] like Figure 1c As shown, it is assumed that a user at location B uses PAD 200 to remotely access PC 100 (such as PC "book1" or PC "book2") at location A. After a remote access connection is successfully established between PAD 200 and PC 100, PC 100 sends its UI interface data to PAD 200, and the UI interface of PC 100 is displayed on the screen of PAD 200. At this time, the user can view the UI interface of PC 100 through the screen of PAD 200, and can also perform related operations on PAD 200 to realize remote control of PC 100. For example, the user can open file 1 on the PAD and edit file 1.

[0100] However, in the remote control application scenario, the user experience is the same, which may bring a bad experience to some users, such as privacy leakage or poor visual experience. Therefore, how to improve the user experience when remotely controlling the PC is an urgent problem to be solved.

[0101] The embodiment of the present application provides a remote access method. In this method, when the remote connection between an electronic device such as a PAD and a PC is successful, the electronic device such as the PAD can determine the display mode of the electronic device such as the PAD (i.e., the remote control terminal) and the PC (i.e., the remotely controlled terminal) according to the current status information of the PC to improve the user experience. Among them, the status information of the PC is used to indicate whether the PC is currently being used by the user.

[0102] Among them, when the PC status information indicates that the PC is not currently being used by the user, electronic devices such as PAD can adjust the resolution (or display resolution) of the PC to a target resolution, which is a resolution adapted to electronic devices such as PAD, and at the same time control the PC to display a target interface, which is used to prevent the PC interface from being viewed by others. For example, the target interface can be called a security screen interface or a privacy screen interface.

[0103] When the PC status information indicates that the PC is currently being used by the user, the PAD or other electronic device can control the PC to pop up a prompt message, which is used to indicate that the PC is currently being remotely controlled by other devices. At the same time, the PC maintains its current resolution, that is, the PC does not adjust its resolution.

[0104] Figure 2 The schematic diagram of the interaction between the PAD and the PC is shown as an example. Figure 2 The remote access method provided in this embodiment may specifically include the following steps:

[0105] S201, in response to a user operation, the PAD establishes a remote access connection with the PC.

[0106] Exemplarily, the user operation may be an operation of clicking a remote control corresponding to the PC, for example, clicking Figure 1a The operation of control 1021 or control 1022 shown in (2).

[0107] Exemplarily, the PAD receives a user operation, and in response to the user operation, the PAD sends a remote access connection request to the PC. After receiving the remote access connection request, the PC feeds back connection response information to the PAD to establish a remote access connection with the PAD. The specific process of establishing a remote access connection between the PAD and the PC is related to the development of the remote control application, and this embodiment does not limit the process of establishing a remote access connection.

[0108] It should be noted that, in the present embodiment, the setting items of the remote control function can be set in the PC. If the remote control function of the PC is turned on, the PC allows remote control by other electronic devices. In addition, the information interaction between the PC and the PAD is based on the router and the server (such as a cloud server) corresponding to the remote application, and the router can play the role of transparent transmission of information. For example, the PAD sends a remote connection request to the server, and the server forwards the remote connection request to the router to which the PC is connected, and then forwards the remote connection request to the corresponding PC through the router.

[0109] S202: When the remote access connection between the PAD and the PC is successful, the remote control application of the PAD sends a PC status acquisition request to the remote control application of the PC.

[0110] For example, if the remote access connection between the PAD and the PC "book1" is successful, the remote control list of the PAD displays a disconnect remote access control corresponding to the PC "book1". Figure 1b In addition, if the remote access connection between the PAD and the PC "book1" is successful, the remote control application of the PAD can be triggered to send a PC status acquisition request to the remote control application of the PC.

[0111] S203: The remote control application of the PC sends PC status information to the remote control application of the PAD.

[0112] After receiving the PC status acquisition request, the PC remote control application acquires the current status information of the PC and feeds back the current status information of the PC to the PAD remote control application. The PC status information is used to indicate whether the PC is currently being used by the user.

[0113] S204, the remote control application of the PAD determines whether the PC status information indicates that the PC is not currently being used by the user, if so, execute S205, if not, execute S211.

[0114] In one application scenario, if the PC does not support the remote wake-up function, such as the PC cannot be remotely awakened when it is in a shutdown state, a dormant state, or a sleeping state, the PC status information may include a screen on / off state and a screen lock state.

[0115] If the PC status information is in a screen-on and unlocked state, the PC status information is used to indicate that the PC is currently being used by the user; if the PC status information is in a screen-off or locked state, the PC status information is used to indicate that the PC is not currently being used by the user.

[0116] In another application scenario, if the PC supports the remote wake-up function, such as the PC can be remotely awakened when it is in shutdown, hibernation or sleep state, the PC status information may include the screen on / off status, screen lock status and whether it is currently in the remote wake-up state.

[0117] If the PC status information is in a screen-on and unlocked state, and the PC is not currently being remotely awakened, the PC status information is used to indicate that the PC is currently being used by the user; if the PC status information is in a screen-off state or a locked state, or the PC is currently being remotely awakened, the PC status information is used to indicate that the PC is not currently being used by the user.

[0118] Figure 3 The following is a schematic diagram showing an application scenario of a PC supporting a remote wake-up function. Figure 3 As shown, the PC may include a main communication chip, an auxiliary communication chip (or a small communication chip), an EC module, a power on / off control circuit, and a battery. Among them, the main communication chip has Wi-Fi communication capability, and the auxiliary communication chip has Wi-Fi communication capability. Optionally, the main communication chip also has Bluetooth communication capability, and the auxiliary communication chip also has Bluetooth communication capability.

[0119] In the PC, the battery supplies power to the main communication chip and other modules through the first power supply circuit, and the battery supplies power to the auxiliary communication chip and the EC module through the second power supply circuit. Optionally, after the PC is shut down or enters hibernation or sleep mode, the battery supplies power to the auxiliary communication chip and the EC module through the second power supply circuit, so that the auxiliary communication chip and the EC module are in a powered-on state during the process of the PC being shut down or in hibernation or sleep. Optionally, the battery supplies power to the auxiliary communication chip and the EC module through the second power supply circuit all the time, so that the auxiliary communication chip and the EC module are in a powered-on state all the time. Among them, event interaction can be performed between the auxiliary communication chip and the EC module, and the EC module implements relevant control of the PC, such as power on, wake up, etc., by setting relevant pins of the power on and off control circuit. Regarding other modules in the PC, such as the CPU, memory, display, etc., please refer to the existing technology and will not be repeated here.

[0120] When the PC is in normal working state, the PC can access the Wi-Fi network of the router through the main communication chip, and then establish a wireless connection with the cloud server, so that the PC can establish a remote connection with the mobile phone through the cloud server. At this time, the user can use the mobile phone to remotely control the PC. In the PC, after the main communication chip is powered on, it will establish a wired communication link with the auxiliary communication chip, and synchronize the relevant information of accessing the network (or network configuration information) to the auxiliary communication chip, and the auxiliary communication chip saves the access information of accessing the network. Among them, the relevant information of accessing the network may include but is not limited to the SSID (Service Set Identifier) ​​and password of the Wi-Fi network, the URL (Uniform Resource Locator) address of the cloud server, the password for accessing the cloud server, the device identification (Device ID) information of the PC in the cloud server, etc.

[0121] Continue to refer to Figure 3 After the auxiliary communication chip receives the relevant information about accessing the network synchronized by the main communication chip, the auxiliary communication chip saves this information so that when the main communication chip operates abnormally, it can automatically access the router's Wi-Fi network based on this information and establish a wireless connection with the cloud server. For example, after the PC is turned off, or after the PC enters a dormant or sleeping state, the wireless connection between the main communication chip and the cloud server is disconnected because the main communication chip is powered off. The auxiliary communication chip accesses the router's Wi-Fi network based on the pre-stored network configuration information, and then establishes a wireless connection with the cloud server.

[0122] After the auxiliary communication chip establishes a wireless connection with the cloud server, the auxiliary communication chip can periodically send messages to the cloud server, such as MQTT (Message Queuing Telemetry Transport) messages or other heartbeat messages, to keep the wireless communication link between the auxiliary communication chip and the cloud server alive. Among them, the power consumption of the PC when keeping the wireless communication link between the auxiliary communication chip and the cloud server alive is also low, for example, the power consumption does not exceed 5mW. In this way, since the auxiliary communication chip keeps the wireless communication link between it and the cloud server alive, the cloud server will not release the link resources allocated to the auxiliary communication chip, so that the wireless communication link between the auxiliary communication chip and the cloud server always remains unobstructed, which is convenient for users to send remote control instructions based on the wireless connection between the auxiliary communication chip and the cloud server at any time.

[0123] When the PC establishes a wireless connection with the cloud server through the auxiliary communication chip, and the PAD establishes a remote connection with the PC through the cloud server, the user can perform a wake-up operation on the PC in the remote control application in the PAD. In response to the user's operation, the PAD sends a remote wake-up instruction to the PC through the cloud server. After the auxiliary communication chip of the PC receives the remote wake-up instruction, it wakes up the PC according to the remote wake-up instruction. Among them, the auxiliary communication chip can perform relevant operations on the pins of the PC power on / off circuit through the EC module to wake up the PC.

[0124] In this way, in addition to the existing main communication chip, the PC also adds an auxiliary communication chip. When the PC is in normal working state, the PC accesses the local Wi-Fi network through the main communication chip for external communication, so that the user can use electronic devices to remotely control the PC. When the PC is in an abnormal working state, such as shutdown, hibernation, sleep, etc., the wireless communication connection of the main communication chip is disconnected, and the PC accesses the local Wi-Fi network through the auxiliary communication chip for external communication, so that the user can continue to use electronic devices such as PAD to remotely wake up the PC.

[0125] Therefore, in this situation, if the PC status information is a screen-on and unlocked state, and the PC is not currently remotely awakened through the auxiliary communication chip, then the PC status information is used to indicate that the PC is currently being used by the user; if the PC status information is a screen-off state or a locked state, or the PC is currently remotely awakened through the auxiliary communication chip, then the PC status information is used to indicate that the PC is not currently being used by the user.

[0126] S205 , the remote control application of the PAD sends a resolution adjustment instruction and a security display instruction to the remote control application of the PC.

[0127] Optionally, when the PC is not being used by the user, the remote control application of the PAD may send a resolution adjustment instruction and a safety display instruction to the remote control application of the PC at the same time, or may send a resolution adjustment instruction and a safety display instruction to the remote control application of the PC in sequence. This embodiment does not limit the timing of sending the resolution adjustment instruction and the safety display instruction.

[0128] In this embodiment, the resolution adjustment instruction may include but is not limited to a target resolution, which is used to instruct the PC to adjust its resolution to the target resolution, wherein the target resolution refers to a resolution that is adapted to the screen size of an electronic device such as a PAD, for example, a resolution currently set for an electronic device such as a PAD.

[0129] Considering that the resolution of electronic devices such as PADs is different from that of PCs (see Figure 4If the PAD displays the PC UI interface according to the PC display resolution, in order to display the complete PC UI interface, the PAD may have black display areas (referred to as black edges) on the left and right ends of the display interface, that is, black edges appear on the left and right sides of the PC UI interface displayed on the PAD, such as Figure 5 As shown in (1), or the PAD end may have black display areas at the upper and lower ends of the display interface, that is, black edges appear on the upper and lower sides of the PC UI interface displayed on the PAD end, such as Figure 5 As shown in (2).

[0130] In this way, when the PC status information indicates that the PC is not currently being used by the user, the remote control application of the PAD sends a resolution adjustment instruction to the remote control application of the PC, so that the PC adjusts its resolution to a resolution that fits the screen size of the PAD.

[0131] For example, the original resolution of the PC is 2520*1440, and the current resolution of the PAD is 1440*900. If the display resolution of the PC is not adjusted, the effect of the PC UI interface displayed on the PAD can be referred to Figure 6a As shown in (1), black edges appear on the left and right sides of the display interface. If the resolution adjustment command sent by the PAD indicates that the display resolution of the PC is adjusted to 1440*900, then after the PC adjusts its display resolution to 1440*900, the effect of the PC UI interface displayed on the PAD can be referred to Figure 6a As shown in (2), there will be no black edges in the display interface. Figure 6a From (1) and (2), it can be seen that after the display resolution of the PC is adjusted to a resolution that matches the screen size of the PAD, there will be no black edges when the PC UI interface is displayed on the PAD, which improves the user's visual experience.

[0132] In one possible scenario, if the resolution adjustment instruction sent by the PAD indicates that the display resolution of the PC should be adjusted to 1366*768, and the PC does not support setting its display resolution to 1366*768, then the PC selects a resolution close to 1366*768 from the supported display resolutions as the resolution that fits the PAD screen size, and adjusts its display resolution to this resolution that fits the PAD screen size. Figure 4 Among the display resolutions supported by the PC, assuming that the resolution 2048*1152 is the closest to the resolution 1366*768, the PC adjusts its display resolution to the resolution 2048*1152 so that the adjusted display resolution fits the PAD screen size.

[0133] For example, the original resolution of the PC is 2520*1440, and the current resolution of the PAD is 1366*768. If the display resolution of the PC is not adjusted, the effect of the PC UI interface displayed on the PAD can be referred to Figure 6b As shown in (1), black edges appear on the left and right sides of the display interface. If the resolution adjustment command sent by the PAD indicates that the display resolution of the PC is adjusted to 1366*768, since the display resolution of the PC does not support 1366*768, after the PC adjusts its display resolution to 2048*1152, which is the resolution closest to 1366*768, the effect of the PC UI interface displayed on the PAD can be referred to Figure 6b As shown in (2). Figure 6b From (1) and (2), we can see that after the display resolution of the PC is adjusted to match the PAD resolution, when the PAD displays the PC UI interface, the coverage of the black border in the screen will be greatly reduced, which can also improve the user's visual experience.

[0134] It should also be noted that after adjusting the display resolution of the PC to match the resolution of the PAD, black edges may appear on the display interface of the PC because the resolution may not match the screen size of the PC. However, since the PC is not currently being used by the user, modifying the display resolution of the PC will not cause a bad visual impact on other users (referring to PC users).

[0135] In this embodiment, the safe display instruction is used to instruct the PC to display a target interface, which is used to prevent the PC display interface from being viewed by other users (or other irrelevant users). The target interface does not include the content in the PC UI interface. Figure 7 As shown in (2), the target interface may display, but is not limited to, indication information and an interface exit method (or screen unlocking method). For example, the indication information is used to indicate that the current computer is being remotely controlled, and the interface exit method may be pressing a key combination, such as pressing the "CTRL+SHIFT+DELETE" key combination. When the user presses the "CTRL+SHIFT+DELETE" key combination, the PC exits displaying the target interface in response to the user operation. When the user presses other keys or other key combinations, or when the user operates the mouse, the PC does not respond to the user operation, and the PC continues to display the target interface.

[0136] In this embodiment, the target interface can be understood as a layer covering the existing interface of the PC. When the PC exits displaying the target interface, the PC can display a lock screen interface or other UI interfaces, which is not limited in this embodiment.

[0137] Among them, the target interface can also be called a security screen interface or a privacy screen interface, etc.

[0138] In this way, when the PC status information indicates that the PC is not currently being used by the user, the PAD's remote control application sends a security display instruction to the PC's remote control application to make the PC display the security screen interface, thereby preventing the user's remote control operation on the PAD from being leaked and improving the privacy of the user's remote operation. At the same time, the security screen interface displays an interface exit method, which is convenient for the PC user to exit the PC's security screen interface at any time to use the PC.

[0139] S206, the remote control application of the PC adjusts the resolution of the display screen through the display driver.

[0140] The remote control application of the PC parses the target resolution in the resolution adjustment instruction and sends the target resolution to the display driver, so that the display resolution of the display screen is adjusted to a resolution matching the target resolution through the display driver, that is, the display resolution of the display screen is adjusted to a resolution that matches the PAD screen size.

[0141] After the display driver of the PC obtains the target resolution, it determines whether the display resolution currently supported by the PC includes the target resolution, so as to adjust the display resolution of the PC according to the determination result.

[0142] If the display resolution currently supported by the PC includes the target resolution, the display driver adjusts the display resolution of the PC to the target resolution. Figure 4 , if the target resolution is 1440*900, the display driver of the PC determines that the display resolution currently supported by the PC includes 1440*900, then the display driver adjusts the display resolution of the PC to 1440*900. For example, before the PC adjusts its display resolution to 1440*900, the effect of the PC UI interface displayed on the PAD can refer to Figure 6a As shown in (1), there are black edges in the display interface. After the PC adjusts its display resolution to 1440*900, the effect of the PC UI interface displayed on the PAD can be referred to Figure 6a As shown in (2), there will be no black edges in the display interface. Figure 6a From (1) and (2), we can see that after the display resolution of the PC is adjusted to the PAD resolution, there will be no black edges when the PC UI interface is displayed on the PAD, which improves the user's visual experience.

[0143] If the display resolution currently supported by the PC does not include the target resolution, the display driver selects a resolution close to the target resolution from the display resolutions currently supported by the PC, such as a resolution with an aspect ratio (or height-to-width ratio) equal to that of the target resolution, or a resolution with the highest similarity to the target resolution, and adjusts the display resolution of the PC to the selected resolution.

[0144] Assume that the display resolution currently set by the PC is resolution p0, and the display resolution to be adjusted selected by the PC among the display resolutions currently supported by the PC is resolution p0' (assuming that resolution p0' is the resolution with the highest similarity to the target resolution). When the display resolution set by the PC is resolution p0, the display area of ​​the PC UI interface in the display interface of the electronic device accounts for a first ratio, and when the display resolution set by the PC is resolution p0', the display area of ​​the PC UI interface in the display interface of the electronic device accounts for a second ratio. The second ratio is greater than the first ratio.

[0145] The display area ratio of the PC UI interface in the display interface of the electronic device can be understood as: in the display interface of the electronic device, the ratio of the display area of ​​the PC UI interface to the display interface area of ​​the electronic device (i.e., the sum of the display area of ​​the PC UI interface and the black border area).

[0146] In one example, the display driver can select resolution p1 as the resolution with the highest similarity to the target resolution from the display resolutions currently supported by the PC, so that after the display resolution of the PC is adjusted to resolution p1, when the PAD displays the PC UI interface, there is no black border in the width direction of the interface, and relative to other display resolutions currently supported by the PC, the black border area in the height direction of the display interface is the narrowest. For example, the display driver can calculate the aspect ratio of each display resolution currently supported by the PC. If the aspect ratio of resolution p1 is greater than the aspect ratio of the PAD resolution, and the difference between the aspect ratio of resolution p1 and the aspect ratio of the PAD resolution is the smallest, then the display driver selects resolution p1 as the resolution with the highest similarity to the target resolution.

[0147] In another example, the display driver can select resolution p2 as the resolution with the highest similarity to the target resolution from the display resolutions currently supported by the PC, so that after the display resolution of the PC is adjusted to resolution p2, when the PAD displays the PC UI interface, there is no black border in the height direction of the interface, and relative to other display resolutions currently supported by the PC, the black border area in the width direction of the display interface is the narrowest. For example, the display driver can calculate the aspect ratio of each display resolution currently supported by the PC. If the aspect ratio of resolution p2 is greater than the aspect ratio of the PAD resolution, and the difference between the aspect ratio of resolution p2 and the aspect ratio of the PAD resolution is the smallest, then the display driver selects resolution p2 as the resolution with the highest similarity to the target resolution.

[0148] In another example, the display driver can select resolution p3 as the resolution with the highest similarity to the target resolution among the display resolutions currently supported by the PC. Among them, relative to other display resolutions currently supported by the PC, after the display resolution of the PC is adjusted to resolution p3, the coverage area of ​​the black border area on the display interface is the smallest when the PAD displays the PC UI interface. For example, the display driver can calculate the aspect ratio (or height-to-width ratio) of each display resolution currently supported by the PC. If the absolute value of the difference between the aspect ratio (or height-to-width ratio) of resolution p3 and the height-to-width ratio (or height-to-width ratio) of the PAD resolution is the smallest, the display driver selects resolution p3 as the resolution with the highest similarity to the target resolution.

[0149] Continue to refer to Figure 4 , if the target resolution is 1366*768, and the display driver of the PC determines that the display resolution currently supported by the PC does not include the resolution 1366*768, then the display driver selects a resolution that is most similar to the target resolution among the display resolutions currently supported by the PC, such as the resolution 2048*1152, and adjusts the display resolution of the PC to the resolution 2048*1152. For example, before the PC adjusts its display resolution to 2048*1152, the effect of the PC UI interface displayed on the PAD can be referred to Figure 6b As shown in (1), there is no black border in the height direction of the display interface, but there is a wider black border in the width direction; after the PC adjusts its display resolution to 2048*1152, the effect of the PC UI interface displayed on the PAD can be referred to Figure 6b As shown in (2), there is no black border in the height direction of the display interface, and the black border in the width direction is relatively narrow. Figure 6b From (1) and (2), we can see that after the display resolution of the PC is adjusted to match the resolution of the PAD screen size, when the PAD displays the PCUI interface, the coverage of the black border in the screen will be greatly reduced, which improves the user's visual experience.

[0150] S207, the remote control application of the PC controls the display screen to display the security screen interface according to the security display instruction.

[0151] Exemplarily, the remote control application of the PC parses the identifier of the security screen interface in the security display instruction, and controls the display screen to display the security screen interface.

[0152] This embodiment does not limit the execution order of S206 and S207.

[0153] S208, the display screen of the PC displays a security screen interface.

[0154] The process of drawing and displaying the security screen interface can refer to the existing technology and will not be repeated here.

[0155] In one scenario, before the PAD establishes a remote access connection with the PC, the PC displays the lock screen, such as Figure 7 In response to the user's remote access operation on the PAD to the PC, the PAD establishes a remote access connection with the PC. When the remote access connection between the PAD and the PC is successful, since the PC is in a locked screen state, indicating that the PC is not currently being used by the user, the PC adjusts its display interface to a secure screen interface according to the secure display instruction of the PAD, as shown in FIG. Figure 7 As shown in (2).

[0156] Figure 7 (2) shows an example of a security screen interface, in which the indication message "the current computer is being remotely controlled" and the interface exit method "press CTRL+SHIFT+DELETE to unlock the screen" are displayed. Figure 7 When the user presses the "CTRL+SHIFT+DELETE" key combination when the security screen interface is displayed, the PC exits the security screen interface and displays the lock screen interface, and then the user can enter the unlock password to unlock the PC.

[0157] In another scenario, if the PC is in sleep mode before the PAD establishes a remote access connection with the PC, and the PC supports the remote wake-up function, you can refer to the following: Figure 3 In response to the user's remote access operation on the PC at the PAD end, after the PC is remotely awakened (i.e., switched from a dormant state to a normal operating state), the PAD establishes a remote access connection with the PC. When the remote access connection between the PAD and the PC is successful, since the PC is remotely awakened, it indicates that the PC is not currently being used by the user. At this time, the PC adjusts its display interface to a secure screen interface according to the secure display instruction of the PAD. The changes in the PC display interface can be referred to in Figure 8 As shown. Among them, Figure 8 The interface shown in (1) indicates that the PC is in sleep mode. Figure 8 The interface shown in (2) indicates that the PC has been remotely awakened. Figure 8 The interface shown in (3) represents the PC display security screen interface.

[0158] In this way, when the PC is not in use by the user, the PC displays a security screen interface. In this case, if the user performs a remote control operation on the PC UI interface displayed by the PAD on the PAD side, for example, it can be an operation to open a folder or a file in the PC, or an operation to open an application, etc., and for example, the operation of selecting, clicking, double-clicking, copying, cutting, and moving a certain control, the PAD sends a remote control instruction corresponding to the remote control operation to the PC, so that the PC executes the program corresponding to the remote control instruction. At this time, the PC sends the UI interface change data corresponding to the execution of the program to the PAD, so that the PAD side shows the user the changes in the PC UI interface. At the same time, the PC continues to display the security screen interface. That is, when the PC is not in use by the user, if the user remotely controls the PC on the PAD side, the PC UI interface displayed on the PAD side changes accordingly, and the PC side continues to display the security screen interface to avoid information leakage caused by the remote operation of the user on the PAD side.

[0159] When the PC is in use by the user, if the user remotely controls the PC on the PAD side, the changes in the first PCUI interface displayed on the PAD side are consistent with the changes in its UI interface on the PC side. In this case, if the user performs a remote control operation on the PC UI interface displayed on the PAD side, such as opening a folder or a file in the PC, or opening an application, etc., and for example, selecting, clicking, double-clicking, copying, cutting, and moving a control, the PAD sends a remote control instruction corresponding to the remote control operation to the PC, so that the PC executes the program corresponding to the remote control instruction. At the same time, the PC side displays the UI interface changes corresponding to the execution of the program, and sends the corresponding UI interface change data to the PAD, so that the PAD side also synchronously displays the changes in the PC UI interface to the user.

[0160] S209, the remote control application of the PC sends the UI interface data with adjusted resolution to the remote control application of the PAD.

[0161] After the resolution of the display screen of the PC is adjusted, the remote control application of the PC sends the UI interface data after the resolution is adjusted to the remote control application of the PAD, so that the PAD can display the PC UI interface adapted to its resolution.

[0162] This embodiment does not limit the sequence of S209, S207, and S208. After the display screen of the PC completes the resolution adjustment, the remote control application of the PC can send the UI interface data after the resolution adjustment to the PAD end.

[0163] S210, the PAD display shows the PC UI interface after the resolution is adjusted.

[0164] Among them, regarding the decoding, encoding and display process of PC UI interface data on the PAD side, reference can be made to the existing technology and will not be repeated here.

[0165] In an optional implementation, after the remote access connection between the PAD and the PC is successfully established, the remote control application of the PC will send its UI interface data to the remote control application of the PAD.

[0166] In this case, after the remote access connection between the PAD and the PC is successfully established, before the resolution of the PC display screen is adjusted, the PC's remote control application may have sent its UI interface data to the PAD's remote control application. At this time, the resolution of the UI interface data sent by the PC is adapted to the resolution of the PC. After the resolution of the PC display screen is adjusted, the resolution of the UI interface data sent by the PC's remote control application to the PAD's remote control application is adapted to the resolution of the PAD. As a result, the display resolution of the PC UI interface displayed on the PAD side will change once, that is, it will change from the resolution adapted to the PC to the resolution adapted to the PAD. For example, the interface displayed on the PAD side changes from the interface shown in (1) in Figure 6 to the interface shown in (2) in Figure 6. Among them, when the display resolution of the PC UI interface is different, the icon layout in the interface may also change.

[0167] In another optional implementation, after the remote access connection between the PAD and the PC is successfully established, the PC's remote control application sends its UI interface data to the PAD's remote control application only after the PC receives the resolution adjustment instruction sent by the PAD and completes the corresponding resolution adjustment, or after the PC receives the resolution maintenance instruction sent by the PAD (see below for details on the resolution maintenance instruction).

[0168] In this case, after the remote access connection between the PAD and the PC is successfully established, the PC's remote control application does not send its UI interface data to the PAD's remote control application before the PC's display screen completes the resolution adjustment. Instead, the PC's remote control application sends its UI interface data to the PAD's remote control application after the PC's display screen completes the resolution adjustment. In this way, the resolution of the PC UI interface displayed on the PAD side is always adapted to the resolution of the PAD, and there will be no problem of resolution jumps in the PC UI interface, which improves the visual experience of the PAD user.

[0169] S211, the remote control application of the PAD sends a pop-up window instruction to the remote control application of the PC.

[0170] In this embodiment, the pop-up window instruction is used to instruct the PC to pop up a prompt window on the display interface, and the information in the prompt window is used to indicate that the PC is currently remotely controlled by other devices. Exemplarily, the pop-up window instruction may include but is not limited to a prompt window identifier.

[0171] S212, the remote control application of the PC controls the display screen to display a pop-up window according to the pop-up window instruction.

[0172] S213, a remote control prompt window pops up on the display screen of the PC.

[0173] Regarding the drawing and display process of the prompt window, you can refer to the existing technology and will not go into details here.

[0174] Fig. 9 The following is an example of a change in a PC display interface. Fig. 9 As shown in the figure, when the remote access connection between the PAD and the PC is successful, the PC status is bright and unlocked (refer to Fig. 9 As shown in (1) in the figure, it indicates that the PC may be currently being used by the user, and the PAD sends a pop-up window instruction to the PC to instruct the PC to pop up a prompt window. Fig. 9 As shown in (2), the PC pops up a prompt window 301 to indicate that the PC is currently being remotely controlled by other devices. Exemplarily, as shown in the prompt window 301, the prompt window includes a prompt message 3011, a disconnect remote access control 3012, and a window close control 3013. Among them, the prompt message 3011 is used to indicate that a certain device is viewing and not controlling the machine, the disconnect remote access control 3012 is used to disconnect the remote access connection between the PC and other devices, and the window close control 3013 is used to close (i.e., cancel the display) the prompt window 301.

[0175] In this way, when the remote control application of the PAD determines that the PC status information indicates that the PC is currently being used by the user, a prompt window pops up on the PC to prompt the PC user that the PC is currently being remotely controlled by other devices. When the PC is remotely accessed by other devices (such as PAD, etc.), both the PC user and the PAD user can control the PC. At this time, there may be a situation where the PC user and the PAD user compete for the right to control the PC. For example, when the PC user controls the mouse, the PAD user also controls the PC mouse. The PAD user may compete for the right to control the mouse, and the PC user may also snatch the right to control the mouse back. If the PC control right is seized by the PC user, the PC will respond to the PC user's operation; if the PC control right is seized by the PAD user, the PC will respond to the PAD user's operation.

[0176] Continue to refer to Fig. 9 As shown in (2), if the PC user does not want his PC to be remotely controlled by other devices, he can click the disconnect remote access control 3012 in the prompt window 301. In response to the user operation, the remote access connection between the PC and the PAD is disconnected, and the control corresponding to the PC in the remote control list of the PAD is changed from the disconnect remote access control to the remote access control. Figure 1a shown.

[0177] In addition, when the PAD's remote control application determines that the PC status information indicates that the PC is currently being used by the user, the PAD may not adjust the display resolution of the PC, but instead maintain the current display resolution of the PC to prioritize the PC user's visual experience.

[0178] In an optional implementation, if the remote control application of the PAD determines that the PC status information indicates that the PC is currently being used by the user, the remote control application of the PAD may also send a resolution maintenance instruction to the remote control application of the PC. The resolution maintenance instruction is used to instruct the PC to maintain its current display resolution and not adjust its display resolution. In this case, when the remote access connection between the PAD and the PC is successful, the remote control application of the PC receives the resolution maintenance instruction sent by the PAD, and the PC does not adjust its display resolution. At this time, the display resolution of the UI interface data sent by the remote control application of the PC to the PAD is adapted to the resolution of the PC (such as the display resolution currently set by the PC).

[0179] Optionally, after the remote access connection between the PAD and the PC is successful, after the PC receives the resolution maintenance instruction sent by the PAD, the remote control application of the PC sends its UI interface data to the remote control application of the PAD, and the display resolution of the UI interface data is adapted to the resolution of the PC.

[0180] In the remote access method provided in the embodiment of the present application, the PAD end provides users with remote access experience differently according to whether the PC end is currently used by the user. Among them, when the remote access connection between the PAD and the PC is successful, if the PAD end determines that the PC end is not currently used by the user based on the PC status information, the PAD end actively modifies the display resolution of the PC end to adapt to the display resolution of the PAD, avoiding the problem of black edges when the PAD end displays the PC UI interface due to resolution mismatch. At the same time, the PAD can also trigger the PC end to display the security screen interface to avoid the risk of remote control user operations being leaked. If the PAD end determines that the PC end may be currently being used by the user based on the PC status information, the PAD end will no longer modify the display resolution of the PC end, but maintain the display resolution currently set on the PC end, giving priority to the visual experience of the PC end user. At the same time, the PAD can also trigger the PC end to pop up a prompt window to remind the PC end user that the current computer is being remotely controlled by other devices.

[0181] In an application scenario, after the user completes remote access to the PC through the PAD, the user can disconnect the remote access connection with the PC on the PAD.

[0182] For example, refer to Figure 1b , the user clicks on the disconnect remote access control 1024, which can trigger the disconnection of the remote access connection between the PAD and the PC "book1".

[0183] Another example is Fig.10a As shown, when the remote access connection between the PAD and the PC is successful, the PAD generates a permanent notification 302 in the notification bar, and the window of the permanent notification 302 may include a disconnect control 3021. If the user clicks the disconnect control 3021, in response to the user operation, the PAD disconnects the remote access connection with the PC.

[0184] Optionally, when the user clicks the disconnect control 3021, in response to the user operation, the PAD may also pop up a secondary confirmation window, and the information in the secondary confirmation window is used to prompt the user whether to end the remote access to the PC. At this time, if the user's operation on the confirmation control in the secondary confirmation window is received, then in response to the user operation, the PAD disconnects the remote access connection with the PC. This embodiment does not limit the operation method of the PC user actively disconnecting the remote access connection between the PC and the PAD.

[0185] To ensure the user experience of the PC end, if the PAD end actively modifies the display resolution of the PC end when remotely controlling the PC, the PAD end can actively restore the display resolution of the PC before disconnecting the remote access connection with the PC.

[0186] Exemplarily, the remote access method provided in this embodiment may further include, after the remote control application of the PAD sends a resolution adjustment instruction to the remote control application of the PC:

[0187] In response to the user's operation of disconnecting the remote access connection on the PAD side, the remote control application of the PAD sends a resolution recovery instruction to the remote control application of the PC, and the remote control application of the PAD disconnects the remote access connection with the PC.

[0188] The resolution recovery instruction is used to instruct the PC to restore its display resolution, that is, to adjust the resolution adapted to the PAD to the resolution adapted to the PC. Optionally, when the PC adjusts its display resolution from resolution 1 (i.e., the resolution adapted to the PC) to resolution 2 (i.e., the resolution adapted to the PAD) according to the resolution adjustment instruction, the PC records the resolution 1 before the adjustment, so that the PC can restore its display resolution to resolution 1 (i.e., the resolution adapted to the PC before the adjustment) when receiving the resolution recovery instruction, which will not affect the user's visual experience when using the PC subsequently.

[0189] Optionally, the remote access method provided in this embodiment may further include, after the remote control application of the PAD sends a security display instruction to the remote control application of the PC: in response to the user disconnecting the remote access connection at the PAD end, the remote control application of the PAD sends a security display exit instruction to the remote control application of the PC. The security display exit instruction is used to instruct the PC to exit the display security screen interface.

[0190] In another application scenario, after the remote access connection between the PAD and the PC is successfully established, the PC user can also actively disconnect the remote access connection between the PC and the PAD.

[0191] For example, refer to Fig. 9 As shown in (2), the user clicks the disconnect control 3012. In response to the user operation, the PC disconnects the remote access connection with the PAD.

[0192] Another example is Fig.10b As shown, when the remote access connection between the PAD and the PC is successful, the PC generates a permanent notification 303 in the notification bar, and the window of the permanent notification 303 may include a disconnect control 3031. If the user clicks the disconnect control 3031, in response to the user operation, the PC disconnects the remote access connection with the PAD.

[0193] Optionally, when the user clicks the disconnect control 3012 or the disconnect control 3031, in response to the user operation, the PC may also pop up a secondary confirmation window, and the information in the secondary confirmation window is used to prompt the user whether to end the remote access of other devices to the local computer. At this time, if the user operates the confirmation control in the secondary confirmation window, the PC disconnects the remote access connection with the PAD in response to the user operation.

[0194] It should be noted that the PC user can also perform related operations in the setting interface of the remote control application to disconnect the remote access connection between the PC and the PAD. This embodiment does not limit the operation method of the PC user actively disconnecting the remote access connection between the PC and the PAD.

[0195] If the PAD actively modifies the display resolution of the PC when remotely controlling the PC, the PC can also actively restore the display resolution of the PC before disconnecting the remote access connection with the PAD.

[0196] Exemplarily, the remote access method provided in this embodiment may further include, after the remote control application of the PC adjusts the display resolution of the display screen according to the resolution adjustment instruction:

[0197] In response to the user's operation of disconnecting the remote access connection on the PC, the remote control application of the PAD restores the display resolution of the PC, and the remote control application of the PC disconnects the remote access connection with the PAD.

[0198] Optionally, when the PC adjusts its display resolution from resolution 1 (i.e., the resolution adapted to the PC) to resolution 2 (i.e., the resolution adapted to the PAD) according to the resolution adjustment instruction, the PC will record the resolution 1 before the adjustment, so that after the PC receives the user's operation to disconnect the remote access connection on the PC side, the PC can restore its display resolution to resolution 1 (i.e., the resolution adapted to the PC before the adjustment), which will not affect the user's visual experience when using the PC subsequently.

[0199] In another application scenario, the remote access connection between the PAD and the PC may also be disconnected due to network reasons (such as network anomalies or network disconnection, etc.). If the PAD actively modifies the display resolution of the PC when remotely controlling the PC, the PC can also actively restore the display resolution of the PC after the remote access connection between the PAD and the PC is disconnected due to network reasons.

[0200] Exemplarily, the remote access method provided in this embodiment may further include, after the remote control application of the PC adjusts the display resolution of the display screen according to the resolution adjustment instruction:

[0201] After the remote access connection between the PC and the PAD is disconnected due to network reasons, the remote control application of the PC restores the display resolution of the PC.

[0202] Optionally, when the PC adjusts its display resolution from resolution 1 (i.e., the resolution adapted to the PC) to resolution 2 (i.e., the resolution adapted to the PAD) according to the resolution adjustment instruction, the PC will record the resolution 1 before the adjustment, so that after the remote access connection between the PC and the PAD is disconnected due to network reasons, the PC can restore its display resolution to resolution 1 (i.e., the resolution adapted to the PC before the adjustment), which will not affect the user's visual experience when using the PC subsequently.

[0203] After the remote access connection between the PAD and the PC is successful, the PAD displays the UI interface of the PC, and the remote operation bar 401 can also be displayed in the display interface of the PAD, such as Fig.11 Among them, a plurality of quick control options are displayed in the remote operation bar 401, such as a copy option, a return option, a keyboard option, a setting option, etc.

[0204] Exemplarily, after the user selects some content (such as text characters or pictures, etc.) in the PC UI interface, if the user clicks the copy option, the PAD responds to the user operation and sends a copy instruction to the PC, so that the PC executes the operation of copying the relevant content according to the copy instruction.

[0205] Exemplarily, if the user clicks on the return option, the PAD sends a return instruction to the PC in response to the user operation, so that the PC cancels the previous user operation according to the return instruction.

[0206] Exemplarily, if the user clicks on the keyboard option, the PAD displays a PC keyboard window in response to the user operation, so that the user can perform typing operations in the PC keyboard window.

[0207] For example, Fig.12 As shown in (1), if the user clicks the setting option 4013, the PAD responds to the user operation and displays the PC setting window 4014. Fig.12 (2). Exemplarily, the PC setting window 4014 may include but is not limited to a start security screen option, a lock screen option, an adjust picture quality option, an adjust screen resolution option, a display network speed option, a disconnect option 40141, etc. Among them, the start security screen option is used to control the PC to display the security screen, the lock screen option is used to control the PC to display the lock screen interface, the adjust picture quality option is used to adjust the display picture quality of the PC, the adjust screen resolution option is used to control the PC to adjust its display resolution, the display network speed option is used to obtain and display the network speed information of the PC, and the disconnect option 40141 is used to disconnect the remote access connection between the PAD and the PC.

[0208] If the user clicks on the disconnect option 40141, the PAD disconnects the remote access connection with the PC in response to the user operation. Optionally, when the user clicks on the disconnect option 40141, in response to the user operation, the PAD may also pop up a secondary confirmation window, and the information in the secondary confirmation window is used to prompt the user whether to end the remote access to the PC. At this time, if the user's operation on the confirmation control in the secondary confirmation window is received, the PAD disconnects the remote access connection with the PC in response to the user operation.

[0209] In addition, the remote operation bar 401 also displays a microphone option 4011 and a speaker option 4012. The microphone option 4011 is used to set the sound signal collection device when the PAD remotely accesses the PC, and the speaker option 4012 is used to set the sound signal playback device when the PAD remotely accesses the PC. In this embodiment, when the microphone option 4011 is turned on, you can refer to Fig.11 As shown in (1), the PAD device collects sound signals, while the PC device no longer collects sound signals; when the microphone option 4011 is turned off, you can refer to Fig.11 As shown in (2), the PAD device does not collect sound signals, while the PC device collects sound signals (assuming that the microphone of the PC device is set to be turned on). When the speaker option 4012 is turned on, you can refer to Fig.11 As shown in (1), the PAD device plays the sound signal, while the PC device no longer plays the sound signal; when the speaker option 4012 is turned off, you can refer to Fig.11 As shown in (2), the PAD device does not play a sound signal, while the PC device plays a sound signal (assuming that the speaker of the PC device is set to be turned on).

[0210] That is, the switch state of the microphone option 4011 is used to indicate whether to collect sound signals on the PAD end, and the switch state of the speaker option 4012 is used to indicate whether to play sound signals on the PAD end. It should be noted that when the microphone option 4011 is turned on, if the user turns off the microphone of the PAD, the PAD does not collect any sound; when the speaker option 4012 is turned on, if the user turns off the speaker of the PAD, the PAD does not play any sound.

[0211] In one application scenario, a user uses a PAD to remotely access a PC and uses the PC to participate in a network conference. The user can set the microphone option 4011 and the speaker option 4012 to an on state to collect the user's voice through the PAD and play the sound through the PAD.

[0212] In another application scenario, the user uses a PAD to remotely access a PC to check the situation of the child taking online classes on the PC. The user can set the microphone option 4011 and the speaker option 4012 to be turned off so that the PC can collect the user's voice and play the sound. In this case, the user's behavior of using a PAD to remotely access the PC will not affect the PC user's use of the PC.

[0213] In combination with the above application scenarios, the remote access method provided in this embodiment may further include:

[0214] S501, the remote control application of the PAD determines whether the PC status information indicates that the PC is not currently being used by the user, if not, execute S502, if yes, execute S503.

[0215] Among them, regarding how the remote control application of the PAD determines whether the PC is currently being used by the user based on the PC status information, please refer to the explanation in the previous text and will not be repeated here.

[0216] S502, the remote control application of the PAD turns off the microphone option and the speaker option, and sends a near-end sound collection and playback instruction to the remote control application of the PC, and then executes S504.

[0217] The near-end sound collection and playback instruction is used to instruct the PC to collect sound signals and play sound signals at its local end.

[0218] S503, the remote control application of the PAD turns on the microphone option and the speaker option, and sends a sound remote collection and playback instruction to the remote control application of the PC, and then executes S505.

[0219] The remote sound collection and playback instruction is used to instruct the PC to collect sound signals and play sound signals at the remote control device end (such as the PAD end).

[0220] When collecting and playing sound signals on the remote control device side (such as the PAD side), the remote control device can send the sound signals collected by its microphone to the PC side for sound processing through the PC side, and the PC side can send the sound signals to be played to the remote control device side (such as the PAD side) for sound playing through the remote control device side (such as the PAD side).

[0221] S504, the remote control application of the PC is configured to collect sound signals and play sound signals on the PC side according to the near-end sound collection and playback instruction.

[0222] S505, the remote control application of the PC is set not to collect sound signals and play sound signals on the PC side according to the remote sound collection and playback instruction.

[0223] In this way, when the remote access connection between the PAD and the PC is successful, if the PAD determines based on the PC status information that the PC may be currently being used by the user, the PAD will actively trigger the default state of the microphone option and the speaker option to be set to the off state, so as to collect and play sound signals through the PC, thereby avoiding affecting the user experience of the PC. If the PAD determines based on the PC status information that the PC is not currently being used by the user, the PAD will actively trigger the default state of the PC's microphone option and the speaker option to be set to the on state, so as to collect and play sound signals through the PAD, so as to facilitate the PAD user to input voice and listen to the sound played by the PC during the remote access to the PC, thereby improving the user experience of the PAD user in remote access to the PC.

[0224] In one example, Fig.13 The schematic diagram of the structure of an electronic device 200 is shown. Optionally, the electronic device 200 may be a terminal, which may also be referred to as a terminal device. The terminal may be a cellular phone or a tablet computer (PAD), etc., which is not limited in this application. It should be noted that the schematic diagram of the structure of the electronic device 100 may be applicable to the mobile phone in the accompanying drawings. It should be understood that Fig.13 The electronic device 200 shown is only one example of an electronic device, and the electronic device 200 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different configuration of components. Fig.13 The various components shown in the drawings may be implemented in hardware, including one or more signal processing and / or application specific integrated circuits, software, or a combination of hardware and software.

[0225] The electronic device 200 may include: a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc. The sensor module 280 may include a pressure sensor, a gyroscope sensor, an acceleration sensor, a temperature sensor, a motion sensor, an air pressure sensor, a magnetic sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0226] The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0227] The wireless communication function of the electronic device 200 can be realized by antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor and baseband processor, etc. The electronic device 100 realizes the display function by GPU, display screen 294 and application processor, etc.

[0228] The software system of the electronic device 200 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 200.

[0229] Fig.14 It is a software structure block diagram of the electronic device 200 according to an embodiment of the present application.

[0230] The layered architecture of the electronic device 200 divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android Runtime) and the system library, and the kernel layer.

[0231] Among them, the application layer can include a series of application packages.

[0232] like Fig.14 As shown, the application package may include remote control applications, camera, gallery, WLAN, Bluetooth and other applications. The application package may also include call, calendar, map, navigation, music, video, short message and other applications.

[0233] In this embodiment, the remote control application in the electronic device 200 is used to communicate with the remote control application in the PC so that the electronic device 200 and the PC directly establish a remote access connection. In this embodiment, the remote control application in the electronic device 200 can also determine whether the PC is currently being used by the user based on the status information of the PC, and set the display resolution of the PC, whether to display the security screen interface, whether to pop up the remote control prompt window, the microphone switch status, etc. based on the judgment result.

[0234] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0235] like Fig.14 As shown, the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, and the like.

[0236] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0237] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0238] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0239] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0240] The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and disappear automatically after a short stay without user interaction.

[0241] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

[0242] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0243] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0244] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0245] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0246] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0247] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis and layer processing, etc.

[0248] A 2D graphics engine is a drawing engine for 2D drawings.

[0249] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, audio driver, Wi-Fi driver, sensor driver, etc. Among them, the hardware includes at least processor, display, Wi-Fi module, sensor, etc.

[0250] Understandably, Fig.14 The layers in the software structure shown and the components included in each layer do not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer layers, and each layer may include more or fewer components, which is not limited in the present application.

[0251] It is understandable that, in order to implement the remote control method in the embodiment of the present application, the electronic device 200 includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiment disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0252] In another example, an embodiment of the present application further provides a device, which may include: a processor and a transceiver / transceiver pin, and optionally, a memory.

[0253] The various components of the device are coupled together through a bus, wherein the bus includes a power bus, a control bus and a status signal bus in addition to a data bus. However, for the sake of clarity, various buses are referred to as buses in the figure.

[0254] Optionally, the memory can be used to store instructions executed by electronic devices such as PAD or PC in the above remote access method embodiment. The processor can be used to execute the instructions in the memory, and control the receiving pin to receive signals, and control the sending pin to send signals.

[0255] The device may be an electronic device such as a PAD or a chip of a PC in the above-mentioned remote access method embodiment.

[0256] Among them, all relevant contents of each step involved in any of the above embodiments can be referred to the functional description of the corresponding functional module, and will not be repeated here.

[0257] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the remote access method in the above-mentioned embodiment.

[0258] This embodiment also provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the remote access method in the above-mentioned embodiment.

[0259] Among them, the electronic devices (such as mobile phones, tablets, PCs, etc.), computer storage media, computer program products or chips provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0260] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0261] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0262] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A remote access method, characterized in that: include: The electronic device displays a first interface, where the first interface includes a device list; In response to a user selecting a first personal computer PC from the device list, the electronic device establishes a first remote access connection with the first PC; When the electronic device successfully establishes a first remote access connection with the first PC, the electronic device obtains status information of the first PC; When the state information indicates that the first PC is not in use by the user, the electronic device displays a first UI interface of the first PC and sends first indication information to the first PC; The first PC displays a second interface in response to the first indication information, the second interface includes the first prompt information, the second interface does not include the content in the first UI interface, and the first prompt information is used to indicate that the current PC is being remotely controlled; When the state information indicates that the first PC is in use by the user, the electronic device displays a second UI interface of the first PC and sends second indication information to the first PC; In response to the second indication information, the first PC pops up a prompt window on the second UI interface displayed by the first PC, and the information in the prompt window is used to indicate that the PC is currently being remotely accessed by other devices.

2. The method according to claim 1, characterized in that: The display resolution of the electronic device is a first resolution, and the display resolution of the first PC is a second resolution; the first resolution is different from the second resolution; The method further comprises: When the state information indicates that the first PC is not being used by the user, the electronic device sends third indication information to the first PC; The first PC adjusts its display resolution from the second resolution to a third resolution in response to the third indication information; Among them, when the display resolution of the first PC is the second resolution, the display area of ​​the first UI interface of the first PC in the display interface of the electronic device accounts for a first ratio; when the display resolution of the first PC is the third resolution, the display area of ​​the first UI interface of the first PC in the display interface of the electronic device accounts for a second ratio; the second ratio is greater than the first ratio.

3. The method according to claim 2, characterized in that When the first resolution is a display resolution supported by the first PC, the third resolution is the same as the first resolution; When the first resolution is not a display resolution supported by the first PC, among various display resolutions supported by the first PC, the aspect ratio or the height-to-width ratio of the third resolution is most similar to the first resolution.

4. The method according to claim 1, characterized in that Also includes: When the state information indicates that the first PC is in use by the user, the electronic device sends fourth indication information to the first PC, and the first PC maintains the display resolution currently set for the first PC according to the fourth indication information.

5. The method according to claim 1, characterized in that The second interface also includes second prompt information, and the second prompt information is used to prompt the PC to exit the target operation mode of displaying the second interface; The method further comprises: In response to the target operation indicated by the second prompt information, the first PC exits displaying the second interface; Alternatively, in response to other keyboard and mouse operations except the target operation, the first PC continues to display the second interface.

6. The method according to claim 1, characterized in that Also includes: When the state information indicates that the first PC is not in use by the user, the electronic device sets the default states of the microphone option and the speaker option to be turned on; When the state information indicates that the first PC is in use by the user, the electronic device sets the default states of the microphone option and the speaker option to off; Wherein, when the state of the microphone option is turned on, the sound signal is collected through the microphone of the electronic device, and when the state of the microphone option is turned off, the sound signal is collected through the microphone of the first PC; When the state of the speaker option is turned on, the sound signal is output through the speaker of the electronic device, and when the state of the speaker option is turned off, the sound signal is output through the speaker of the first PC.

7. The method according to claim 1, characterized in that The device list includes at least one PC; In the device list, the state of the remote access control corresponding to the first PC is an available state, and the state of the remote access control corresponding to the second PC is an unavailable state; The method further comprises: After the second PC is turned on, or after the second PC exits the sleep mode, the state of the remote access control corresponding to the second PC changes from an unavailable state to an available state; After the second PC is shut down, or after the second PC enters the sleep mode, the state of the remote access control corresponding to the second PC changes from an available state to an unavailable state.

8. The method according to any one of claims 1 to 7, characterized in that: When the first PC is in a shutdown state, a dormant state, or a sleeping state, the remote wake-up function is not supported; If the status information of the first PC is that the screen is on and unlocked, the status information indicates that the first PC is being used by the user; otherwise, the status information indicates that the first PC is not being used by the user.

9. The method according to any one of claims 1 to 7, characterized in that: When the first PC is in shutdown state, hibernation state or sleep state, a remote wake-up function is supported; If the status information of the first PC is that the screen is on and unlocked, and the first PC is not remotely awakened, the status information indicates that the first PC is being used by the user; otherwise, the status information indicates that the first PC is not being used by the user.

10. The method according to claim 2, characterized in that After the first PC adjusts its display resolution from the second resolution to a third resolution according to the third indication information, the method further includes: In response to the operation of disconnecting the first remote access connection, the electronic device sends fifth indication information to the first PC and disconnects the remote access connection with the first PC; the first PC restores the display resolution of the first PC to the second resolution according to the fifth indication information; or, In response to the operation of disconnecting the first remote access connection, the first PC disconnects the remote access connection with the electronic device and restores the display resolution of the first PC to the second resolution; or, After the remote access connection between the first PC and the electronic device is disconnected due to network reasons, the first PC restores the display resolution of the first PC to the second resolution.

11. The method according to claim 1, characterized in that: When the electronic device displays the first UI interface of the first PC, it also includes: In response to a first operation on the first UI interface, the electronic device sends a first remote control instruction to the first PC; The first PC executes a first program related to the first remote control instruction in response to the first remote control instruction, and feeds back data of a third UI interface corresponding to the execution of the first program to the electronic device, and the first PC continues to display the second interface; The electronic device receives the data of the third UI interface and displays the third UI interface of the first PC; or, When the electronic device displays the second UI interface of the first PC, it also includes: In response to a second operation on the second UI interface, the electronic device sends a second remote control instruction to the first PC; The first PC executes a second program related to the second remote control instruction in response to the second remote control instruction, the first PC displays a fourth UI interface corresponding to the execution of the second program, and feeds back data of the fourth UI interface to the electronic device; The electronic device receives the data of the fourth UI interface and displays the fourth UI interface of the first PC.

12. An electronic device, characterized in that: include: one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device executes the method steps performed by the electronic device in the remote access method as described in any one of claims 1-11.

13. A PC, characterized in that: include: one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, the PC executes the method steps performed by the first PC in the remote access method as described in any one of claims 1-11.

14. A remote access system, characterized in that: include: The electronic device as claimed in claim 12 and at least one PC as claimed in claim 13.

Images