Toolbar display method and device

Abstract

The embodiment of the invention provides a toolbar display method and device, under the condition that a first device remotely accesses a second device, the first device displays content displayed by the second device and a first toolbar, and the first toolbar covers the content displayed by the second device. The first toolbar comprises at least one function button for remotely controlling the second equipment; responding to a first operation for the first toolbar, the content displayed by the first device and the second device and a first suspension ball corresponding to the first toolbar, wherein an icon in the first suspension ball is used for indicating that the first device is remotely accessing other devices; and in response to a second operation for the third interface, the first device displays the second interface. Therefore, the first toolbar can be displayed in different forms based on the user operation, such as in the form of the first suspension ball, so that the occupation of a remote control interface is reduced.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a method and device for displaying a toolbar. Background Art

[0002] With the popularization and development of the Internet, the types and number of terminal devices are increasing, and users have a growing demand for flexible switching between devices in multi-device scenarios. For example, users can have terminal devices such as tablets and computers, and use the tablet at hand to remotely access the computer at home.

[0003] Typically, when a tablet establishes a remote connection with a computer, the tablet can display a remote control interface based on user operations, where the left area of ​​the remote control interface can display a toolbar and the right area of ​​the remote control interface can display an interface in the computer.

[0004] However, when the display screen of the tablet is small, the above-mentioned method of displaying the toolbar takes up more space. Summary of the invention

[0005] The embodiments of the present application provide a method and device for displaying a toolbar, so that the toolbar can be flexibly called based on user operations to reduce the occupancy of a remote control interface.

[0006] In the first aspect, the embodiment of the present application provides a method for displaying a toolbar, which is applied to a first device, and the method includes: the first device displays a first interface, the first interface includes the content displayed by the first device; the first device establishes a remote communication connection with a second device; after the remote communication connection is established, the first device displays a second interface, the second interface includes the content displayed by the second device and the first toolbar, the first toolbar covers the content displayed by the second device, and the first toolbar includes at least one function button for remotely controlling the second device; in response to a first operation on the first toolbar, the first device displays a third interface, the third interface includes: the content displayed by the second device and a first floating ball corresponding to the first toolbar, the icon in the first floating ball is used to indicate that the first device is remotely accessing other devices; in response to a second operation on the third interface, the first device displays a second interface. In this way, the first toolbar can be displayed in different forms based on user operations, for example, in the form of a first floating ball, so as to reduce the occupation of the remote control interface.

[0007] The first interface may be an interface displayed by the first device before remote access to the second device; the second interface may be an interface displayed by the second device when remote access to the second device is performed. Figure 3 The interface shown in a or Figure 8 The interface shown in b in FIG. 3 can be Figure 6 The interface or diagram shown in d Figure 8 The interface shown in a.

[0008] In a possible implementation, in response to a first operation on the first toolbar, the first device displays a third interface, including: in response to the first operation, the first device displays a fourth interface, the fourth interface includes: the content displayed by the second device and the second floating ball, the first floating ball is half of the second floating ball; in response to a third operation on the second floating ball, the first device displays a third interface, the third operation is an operation that continues the first operation, and the third operation is used to move the second floating ball to a first area close to the edge of the display screen of the first device, the first area includes the first floating ball. In this way, the first device can realize that by dragging the second floating ball, the first floating ball can be displayed close to the edge of the display screen to expand the operation interface of the remote control function.

[0009] Among them, the fourth interface can be Figure 6 c in (or Figure 7 a in or Figure 7 c in or Figure 7 In the interface shown in e), the first area may be the area indicated by the dotted frame 601 (or the dotted frame 701, or the dotted frame 702, or the dotted frame 703).

[0010] In a possible implementation, the method further includes: in response to a fourth operation on the first toolbar, the first device displays a fourth interface; in response to a fifth operation on the second floating ball, the first device displays a fifth interface, the fifth interface includes: the content displayed by the second device and the first toolbar, the fifth operation is an operation that continues the fourth operation, and the fifth operation is used to move the second floating ball to a second area at the edge of the display screen, the short side of the second area is larger than the short side of the first area, and the second area includes the first toolbar. In this way, the first device can flexibly drag the first toolbar to different positions by dragging the second floating ball.

[0011] Among them, the fifth interface can be Figure 4 c in (or Figure 5 a in or Figure 5 c in or Figure 5 In the interface shown in e), the second area may be the area indicated by the dotted frame 403 (or the dotted frame 501, or the dotted frame 503, or the dotted frame 505).

[0012] In a possible implementation, the method further includes: in response to an operation on the second interface, the first device displays a sixth interface, the sixth interface includes the content displayed by the second device, the third toolbar, and the first prompt information, the third toolbar includes at least one function button different from that in the first toolbar, and the first prompt information is used to prompt the first toolbar to switch to the third toolbar. In this way, the first device can flexibly switch the function buttons in the first toolbar based on the user operation to improve the user's experience of using the remote access function.

[0013] The third toolbar is the first toolbar in the editing state, and the sixth interface can be Figure 8 In the interface shown in c, the first prompt information may be prompt information 805.

[0014] In a possible implementation, the third toolbar includes a first button, and the method further includes: in response to an operation on the first button, the first device displays second prompt information, the second prompt information being used to prompt a function corresponding to the first button. In this way, the user can determine the specific function when the user triggers the first button according to the second prompt information.

[0015] In a possible implementation, the first toolbar includes one or more of the following function buttons: a button for displaying the desktop, a multitasking button, an undo button, a button for calling the keyboard, a button for calling the microphone of the second device, or a button for setting the function buttons in the first toolbar, and the third toolbar includes one or more of the following function buttons: a return button, an undo button, a cut button, a copy button, or a save button. It is understandable that the specific function buttons in the first toolbar or the third toolbar are not limited in the embodiments of the present application.

[0016] In a possible implementation, any function button in the first toolbar or the third toolbar can be displayed as an icon corresponding to the function button. In this way, the first toolbar or the third toolbar can be displayed more concisely in the interface to expand the operation interface of the remote control function.

[0017] In a possible implementation, the method further includes: when the second interface also includes the first icon, in response to the operation on the first icon, the first device sends the first instruction to the second device, and displays the keyboard corresponding to the second device in the second interface; or, when the second interface also includes the second icon, in response to the operation on the second icon, the first device displays the keyboard corresponding to the first device, the first icon is displayed in the second device, and the second icon is not displayed in the second device. This allows the first device to conveniently call out the keyboard according to the user operation, reducing the scenario where the keyboard cannot be called.

[0018] In a possible implementation, the first device is in a horizontal screen state, and the method further includes: when the first device detects that the first device is switched from a horizontal screen state to a vertical screen state, the first device displays a seventh interface, the seventh interface includes the content displayed by the second device and the first toolbar, wherein the first relative position is the same as the second relative position, the first relative position is the relative position between the first toolbar and the content displayed by the second device in the second interface, and the second relative position is the relative position between the first toolbar and the content displayed by the second device in the seventh interface. The first toolbar can also support horizontal and vertical screen switching. When the terminal device switches the horizontal and vertical screens, the relative position of the first toolbar remains unchanged to improve the user experience when using the first toolbar.

[0019] In a possible implementation, the first suspension ball is semi-transparent and the first toolbar is capsule-shaped. The semi-transparent first suspension ball does not affect the user's viewing of other content in the interface, which is more in line with the actual use scenario of the remote control function.

[0020] In the second aspect, the embodiment of the present application provides a method for displaying a toolbar, which is applied to a first device, and the method includes: the first device displays a first interface, and the first interface includes the content displayed by the first device; the first device establishes a remote communication connection with the second device; after the remote communication connection is established, the first device displays an eighth interface, and the eighth interface includes the content displayed by the second device; the first device receives a sixth operation for the eighth interface; in response to the sixth operation, the first device displays a second toolbar in the eighth interface, and the second toolbar includes at least one function button for remotely controlling the second device, and the second toolbar covers the content displayed by the second device. In this way, when the first device displays the content in the second device, the second toolbar can be called out based on a user trigger, and the second toolbar can support hiding again, so that the first interface can display the content in the second device to the maximum extent.

[0021] The eighth interface can be Figure 3 In the interface shown in c in FIG. 1 , in some embodiments, the second toolbar can also be hidden based on user operation, so that the first device is Figure 3 The interface shown in d in the figure switches to Figure 3 The interface shown in c.

[0022] In one possible implementation, the second toolbar includes one or more of the following function buttons: a button for locking the second device, a button for disconnecting, a button for turning on high-definition mode, a button for matching the resolution of the first device, a button for playing sound in the first device, or a button for inputting sound in the first device.

[0023] In a possible implementation, any function button in the second toolbar can be displayed as: an icon corresponding to the function button and the name of the function button. In this way, the user can understand the specific meaning of each button through the name of the function button, thereby improving the usability of the second toolbar.

[0024] In one possible implementation, the method also includes: when the eighth interface also includes the first icon, in response to the operation on the first icon, the first device sends a first instruction to the second device, and displays the keyboard corresponding to the second device in the eighth interface; or, when the eighth interface also includes the second icon, in response to the operation on the second icon, the first device displays the keyboard corresponding to the first device, the first icon is displayed in the second device, and the second icon is not displayed in the second device. The first device can conveniently call out the keyboard according to user operations, reducing the three aspects of the keyboard being unable to be called. An embodiment of the present application provides a toolbar display device, a display unit of the first device, for displaying a first interface, the first interface including content displayed by the first device; a communication unit of the first device, for establishing a remote communication connection with a second device; after the remote communication connection is established, the display unit of the first device, for displaying a second interface, the second interface including content displayed by the second device and a first toolbar, the first toolbar overlays the content displayed by the second device, and the first toolbar includes at least one function button for remotely controlling the second device; the processing unit of the first device responds to a first operation on the first toolbar, and the display unit of the first device is used to display a third interface, the third interface including: content displayed by the second device and a first floating ball corresponding to the first toolbar, the icon in the first floating ball is used to indicate that the first device is remotely accessing other devices; the processing unit of the first device responds to a second operation on the third interface, and the display unit of the first device is also used to display the second interface.

[0025] In one possible implementation, the processing unit of the first device responds to the first operation, and the display unit of the first device is specifically used to display a fourth interface, where the fourth interface includes: content displayed by the second device and a second floating ball, where the first floating ball is half of the second floating ball; the processing unit of the first device responds to a third operation on the second floating ball, and the display unit of the first device is also specifically used to display a third interface, where the third operation is a continuation of the first operation, and the third operation is used to move the second floating ball to a first area near the edge of the display screen of the first device, where the first area includes the first floating ball.

[0026] In one possible implementation, the processing unit of the first device responds to the fourth operation on the first toolbar, and the display unit of the first device is also used for the fourth interface; the processing unit of the first device responds to the fifth operation on the second floating ball, and the display unit of the first device is also used for the fifth interface, the fifth interface includes: the content displayed by the second device and the first toolbar, the fifth operation is an operation that continues the fourth operation, and the fifth operation is used to move the second floating ball to a second area at the edge of the display screen, the short side of the second area is larger than the short side of the first area, and the second area includes the first toolbar.

[0027] In one possible implementation, the processing unit of the first device responds to the operation on the second interface, and the display unit of the first device is also used for the sixth interface, the sixth interface includes the content displayed by the second device, the third toolbar and the first prompt information, the third toolbar includes at least one function button different from the first toolbar, and the first prompt information is used to prompt the first toolbar to switch to the third toolbar.

[0028] In one possible implementation, the third toolbar includes a first button, the processing unit of the first device responds to the operation on the first button, and the display unit of the first device is also used for second prompt information, and the second prompt information is used to prompt the function corresponding to the first button.

[0029] In one possible implementation, the first toolbar includes one or more of the following function buttons: a button for displaying the desktop, a multitasking button, an undo button, a button for calling the keyboard, a button for calling the microphone of the second device, or a button for setting the function buttons in the first toolbar, and the third toolbar includes one or more of the following function buttons: a return button, an undo button, a cut button, a copy button, or a save button.

[0030] In a possible implementation, any function button in the first toolbar or the third toolbar may be displayed as an icon corresponding to the function button.

[0031] In one possible implementation, when the second interface also includes the first icon, the processing unit of the first device responds to the operation on the first icon, the first device sends a first instruction to the second device, and displays the keyboard corresponding to the second device in the second interface; or, when the second interface also includes the second icon, the processing unit of the first device responds to the operation on the second icon, the display unit of the first device is also used for the keyboard corresponding to the first device, the first icon is displayed in the second device, and the second icon is not displayed in the second device.

[0032] In one possible implementation, the first device is in a landscape state. When the first device detects that the first device switches from a landscape state to a portrait state, the display unit of the first device is also used for a seventh interface, and the seventh interface includes content displayed by the second device and a first toolbar, wherein the first relative position is the same as the second relative position, that is, the first relative position being the relative position between the first toolbar and the content displayed by the second device in the second interface, and the second relative position being the relative position between the first toolbar and the content displayed by the second device in the seventh interface.

[0033] In a possible implementation, the first suspension ball is translucent, and the first toolbar is capsule-shaped.

[0034] In a fourth aspect, an embodiment of the present application provides a toolbar display device, wherein the display unit of the first device is also used for the first interface, and the first interface includes the display unit of the first device, and is also used for content; the communication unit of the first device is used to establish a remote communication connection with the second device; after the remote communication connection is established, the display unit of the first device is also used for an eighth interface, and the eighth interface includes content displayed by the second device; the first device receives a sixth operation for the eighth interface; the processing unit of the first device responds to the sixth operation, and the first device displays a second toolbar in the eighth interface, the second toolbar includes at least one function button for remotely controlling the second device, and the second toolbar covers the content displayed by the second device.

[0035] In one possible implementation, the second toolbar includes one or more of the following function buttons: a button for locking the second device, a button for disconnecting, a button for turning on high-definition mode, a button for matching the resolution of the first device, a button for playing sound in the first device, or a button for inputting sound in the first device.

[0036] In a possible implementation, any function button in the second toolbar may be displayed as: an icon corresponding to the function button and the name of the function button.

[0037] In one possible implementation, when the eighth interface also includes the first icon, the processing unit of the first device responds to the operation on the first icon, the first device sends a first instruction to the second device, and displays the keyboard corresponding to the second device in the eighth interface; or, when the eighth interface also includes the second icon, the processing unit of the first device responds to the operation on the second icon, the display unit of the first device is also used for the keyboard corresponding to the first device, the first icon is displayed in the second device, and the second icon is not displayed in the second device.

[0038] In a fifth aspect, an embodiment of the present application provides a terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the terminal device executes the method described in any implementation of the second aspect, or the method described in any implementation of the second aspect, or the method described in any implementation of the third aspect.

[0039] In a sixth aspect, an embodiment of the present application provides a toolbar display system, the toolbar display system comprising a first device and a second device, the first device being used to execute the method described in any one of the implementations of the second aspect, or the method described in any one of the implementations of the second aspect, and the second device being used to execute the method described in any one of the implementations of the second aspect, or the method described in any one of the implementations of the second aspect.

[0040] In the seventh aspect, an embodiment of the present application provides a computer-readable storage medium, which stores instructions. When the instructions are executed, the computer executes the method described in any implementation of the second aspect, or the method described in any implementation of the second aspect.

[0041] In an eighth aspect, a computer program product comprises a computer program, which, when executed, enables a computer to execute the method described in any one of the implementations of the second aspect, or the method described in any one of the implementations of the second aspect.

[0042] It can be understood that the corresponding effects of the fifth aspect to the eighth aspect can be found in the description of the first aspect to the second aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 A schematic diagram of a scenario provided for an embodiment of the present application;

[0044] Figure 2 A schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present application;

[0045] Figure 3 A schematic diagram of a toolbar interface provided in an embodiment of the present application;

[0046] Figure 4 A schematic diagram of an interface for moving a first toolbar provided in an embodiment of the present application Figure 1 ;

[0047] Figure 5 A schematic diagram of an interface for moving a first toolbar provided in an embodiment of the present application Figure 2 ;

[0048] Figure 6A schematic diagram of an interface for moving a first toolbar provided in an embodiment of the present application Figure 3 ;

[0049] Figure 7 A schematic diagram of an interface for moving a first toolbar provided in an embodiment of the present application Figure 4 ;

[0050] Figure 8 A schematic diagram of an interface for calling a first toolbar provided in an embodiment of the present application;

[0051] Fig. 9 A schematic diagram of an interface using a second toolbar provided in an embodiment of the present application;

[0052] Fig.10 A schematic diagram of a keyboard calling interface provided in an embodiment of the present application;

[0053] Fig.11 A schematic diagram of an interface for calling a stylus provided in an embodiment of the present application;

[0054] Fig.12 A schematic diagram of an interface for switching between horizontal and vertical screens provided in an embodiment of the present application;

[0055] Fig.13 A schematic diagram of the structure of a display device for a toolbar provided in an embodiment of the present application;

[0056] Fig.14 A schematic diagram of the hardware structure of another terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] In order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. For example, the first value and the second value are only used to distinguish different values, and their order is not limited. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit them to be different.

[0058] It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0059] In the present application, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0060] For example, Figure 1 A schematic diagram of a scenario provided in an embodiment of the present application. Figure 1 As shown, the scenario may include: a first device with a remote access function, the first device is used to implement remote access to a second device and display an interface displayed in the second device.

[0061] In the embodiments of the present application, an example is given in which the first device is a tablet and the second device is a computer. This example does not constitute a limitation on the embodiments of the present application.

[0062] In the scenario where a tablet and a computer are remotely connected, the tablet can remotely access the computer based on user operations and display the interface of the computer. For example, the tablet can display Figure 1 The interface shown.

[0063] like Figure 1 As shown, the interface can be called a remote access interface. For example, the interface may include: a toolbar 101 and a window 102. The toolbar 101 can be displayed in the black area on the left side of the display screen, such as the display area shown by the dotted box, and the window 102 can be displayed on the right side of the toolbar 101.

[0064] The toolbar 101 may include: a button for exiting the remote access function, a button for opening the privacy screen, a button for displaying the desktop, a button for locking the screen, a button for taking screenshots, and a button for setting the toolbar, etc. The window 102 may be called a remote control window, and the window 102 is used to implement remote control of the computer. For example, the window 102 may display the interface of the computer when the tablet initiates remote access, for example, the window 102 may display the desktop of the computer. The desktop of the computer may include: a toolbar and multiple buttons on the desktop, such as a computer button, a recycle bin button, a browser button, a new folder button, a target file button, and a target picture button, etc.

[0065] The user can simplify the remote access function through the function buttons in the toolbar 101, and access the contents in the computer through the window 102. However, since the toolbar 101 occupies a large space of the flat screen, the space of the window 102 is small, which makes it inconvenient for the user to remotely control the computer in the window 102. Moreover, when the user uses the first device with a small screen for remote control, the existence of the toolbar will cause the remote control window to become smaller, affecting the user's experience of using the remote control function.

[0066] In view of this, an embodiment of the present application provides a method for displaying a toolbar, so that when a first device remotely accesses a second device, the toolbar can not only be displayed on the remote control window, but can also be displayed in different forms based on the user's operation, so as to expand the operation interface of the remote control function and improve the user's experience of using the remote control function.

[0067] The first device (or second device) mentioned above may be referred to as a terminal, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. For example, the terminal device may be a mobile phone, a smart TV, a wearable device, a tablet computer (Pad), a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, etc. The embodiments of the present application do not limit the specific technology and specific device form adopted by the terminal device.

[0068] In order to better understand the embodiment of the present application, the structure of the terminal device of the embodiment of the present application is introduced below. Figure 2 A schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present application.

[0069] Figure 2The terminal device described in may be the first device or the second device mentioned in the embodiment of the present application. The hardware structure of the first device may be the same as the hardware structure of the second device, or may be different. This is not specifically limited in the embodiment of the present application.

[0070] like Figure 2 As shown, the terminal device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, an indicator 192, a camera 193, and a display screen 194, etc.

[0071] The sensor module 180 may include one or more of the following, for example: a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, or a bone conduction sensor.

[0072] It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the terminal device. In other embodiments of the present application, the terminal device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0073] The processor 110 may include one or more processing units. Different processing units may be independent devices or integrated into one or more processors. The processor 110 may also be provided with a memory for storing instructions and data.

[0074] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the terminal device, and can also be used to transfer data between the terminal device and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other devices, such as AR devices, etc.

[0075] The charging management module 140 is used to receive charging input from a charger, which may be a wireless charger or a wired charger. The power management module 141 is used to connect the charging management module 140 to the processor 110 .

[0076] The wireless communication function of the terminal device can be realized through the antenna 2, the mobile communication module 150, the wireless communication module 160 and the baseband processor.

[0077] Antenna 2 is used to transmit and receive electromagnetic wave signals. The antenna in the terminal device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization rate of the antenna.

[0078] The mobile communication module 150 can provide wireless communication solutions including 2G / 3G / 4G / 5G etc. applied to the terminal device. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA) etc.

[0079] The wireless communication module 160 can provide wireless communication solutions applied to terminal devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), etc.

[0080] The modem may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker, a receiver, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem may be an independent device. In other embodiments, the modem may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0081] The terminal device realizes the display function through the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.

[0082] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the terminal device may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0083] The terminal device can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0084] The camera 193 is used to capture static images or videos. In some embodiments, the terminal device may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0085] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

[0086] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 can include a program storage area and a data storage area.

[0087] The terminal device can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor.

[0088] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Speaker 170A, also known as "speaker", is used to convert audio electrical signals into sound signals. The terminal device can listen to music or listen to hands-free calls through speaker 170A. Receiver 170B, also known as "earpiece", is used to convert audio electrical signals into sound signals. When the terminal device answers a call or voice message, the voice can be answered by placing receiver 170B close to the human ear. Headphone interface 170D is used to connect wired headphones. Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. In an embodiment of the present application, the terminal device may have a microphone 170C.

[0089] The button 190 includes a power button, a volume button, etc. The button 190 may be a mechanical button. It may also be a touch button. The terminal device may receive the button input and generate a key signal input related to the user settings and function control of the terminal device. The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, message, missed call, notification, etc.

[0090] In addition, on top of the above components, the device also runs an operating system, such as an iOS operating system, an Android operating system, or a Windows operating system, etc. Applications can be installed and run on the operating system.

[0091] The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, etc., which will not be elaborated here.

[0092] The following specific embodiments are used to describe in detail the technical solution of the present application and how the technical solution of the present application solves the above technical problems. The following specific embodiments can be implemented independently or in combination with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0093] To solve Figure 1 In the corresponding embodiment, the problem of the toolbar occupying a large space is solved. In the embodiment of the present application, a method for displaying the toolbar is provided, so that the toolbar can be displayed over the remote control window. In the embodiment of the present application, the first device is a tablet and the second device is a computer. This example does not constitute a limitation on the embodiment of the present application.

[0094] For example, Figure 3 A schematic diagram of a toolbar interface provided in an embodiment of the present application.

[0095] In the scenario where a tablet and a computer are remotely connected, when the tablet receives a trigger operation from a user on a button used to remotely control the computer, the tablet can Figure 3 The first toolbar 301 is displayed in the remote control window shown in a of FIG. 1 , or the tablet can also display the first toolbar 301 in the remote control window shown in a of FIG. 1 . Figure 3 The remote control window shown in c in FIG. 1 is a window in which a toolbar is hidden, and a second hidden toolbar is displayed based on a user trigger.

[0096] Among them, when the same device account is logged in to the tablet and the computer, and both the tablet and the computer are connected to the network, a remote connection can be established between the tablet and the computer through the server.

[0097] In one implementation, Figure 3In the interface shown in a in FIG. 1 , the first toolbar 301 may be in a capsule shape and include at least one function button, and at least one function button is displayed in the first toolbar 301 in the form of an icon. Among them, the function buttons in the first toolbar 301 may be, from left to right, a button for displaying the desktop, a multitasking button, a cancel button, a button for calling the keyboard, a button for calling the microphone of the second device, and a button for setting the first toolbar 301, etc. The multitasking button is equivalent to WIN+TAB in a computer. In the embodiment of the present application, the function buttons displayed in the first toolbar 301 are not specifically limited.

[0098] The first toolbar 301 may be displayed on the upper half of the display screen by default to reduce accidental touches by the user.

[0099] The first toolbar 301 can present different states according to user operations. Figure 3 In the interface shown in a of FIG. 1 , when the tablet does not detect any user operation for 5 seconds or the like, the color of the first toolbar 301 is dimmed, and in the Figure 3 The interface shown in b in FIG. 1 shows a semi-transparent first toolbar 301 .

[0100] like Figure 3 In the interface shown in b in FIG. 1 , the tablet can also deepen the color of the first toolbar 301 when detecting any operation of the user, so that the first toolbar 301 can be highlighted. Figure 3 In the interface shown in a.

[0101] in, Figure 3 The toolbar 301 in the interface shown in a in FIG. 1 may be in a highlighted state. Figure 3 The toolbar 301 in the interface shown in b can be in an idle state, and the highlighted state can be understood as the state when the toolbar is in use. The first transparency corresponding to the first toolbar 301 in the highlighted state is a value such as 0%-5%; the idle state can be understood as the state when the toolbar is not in use. The second transparency corresponding to the first toolbar 301 in the idle state is a value such as 30%-80%, and the first transparency is less than the second transparency.

[0102] The first toolbar 301 can be displayed horizontally or vertically in the tablet according to the position manually dragged by the user. Figure 4-Figure 5 Corresponding embodiment: The tablet can record the display position of the first toolbar 301, and when the remote function is turned on, the first toolbar 301 is displayed according to the last recorded display position of the first toolbar 301.

[0103] The first toolbar 301 can be folded to the edge of the display screen. The folded toolbar can be displayed as a semicircular floating ball. Figure 6-Figure 7Corresponding embodiment: The tablet can also record the display state of the first toolbar 301, and when the remote function is turned on, the first toolbar 301 is displayed according to the last recorded display state of the first toolbar 301.

[0104] In another implementation, Figure 3 In the interface shown in c in FIG. 1 , when the tablet receives an operation of the user sliding downward along the upper side of the display screen (in the direction indicated by the dotted arrow), the tablet may display the following Figure 3 The interface shown in d, Figure 3 The interface shown in d in FIG. 1 may include: a second toolbar 302 with function names.

[0105] The second toolbar 302 may include at least one function button, which is displayed in the second toolbar 302 in the form of an icon and a function name. For example, the at least one function button may include: a button for locking the second device (such as a PC), a button for disconnecting, a button for turning on high-definition mode, a button for matching the resolution of the first device (such as a tablet), a button for playing sound in the first device, or a button for inputting sound in the first device. In the embodiment of the present application, the function buttons displayed in the second toolbar 302 are not specifically limited.

[0106] The second toolbar 302 may be displayed on the upper half of the display screen by default.

[0107] In a possible implementation, the second toolbar 302 may be displayed at different positions on the display screen according to the user's sliding operation or may be fixedly displayed on the display screen such as Figure 3 At the position shown by d in the figure, this is not limited in the embodiments of the present application.

[0108] For example, in Figure 3 In the interface shown in d in FIG. 1 , when the tablet receives an operation of sliding upward along the lower side of the display screen by the user, the tablet may also hide the second toolbar 302 and display the following Figure 3 The interface shown in c in FIG. 3 allows the user to have a larger remote operation space. The tablet can record the display or hiding of the second toolbar 301, and when the remote function is turned on, the first toolbar 301 is displayed or hidden according to the last recorded state of the first toolbar 301.

[0109] In a possible implementation, the second toolbar 302 may also include a function button for setting the second toolbar ( Figure 3 (not shown in the interface shown in d in FIG. 1 ), so that the user can flexibly set the function buttons in the second toolbar 302.

[0110] It is understandable that the first toolbar 301 and the second toolbar 302 can be different forms of toolbars. The common advantages of the first toolbar 301 and the second toolbar 302 are: they do not occupy a fixed display area and are displayed over the remote control window. In addition, the first toolbar 301 has the advantages of occupying less space and having simple and clear function buttons, and the second toolbar 302 has the advantages of being able to be hidden and having clear functions.

[0111] Therefore, the tablet can support both the first toolbar 301 and the second toolbar 302, and provide a function control for selecting to use the first toolbar 301 or the second toolbar 302 in the remote access function, so that the user can select an appropriate toolbar according to usage requirements.

[0112] In a possible implementation, the first toolbar 301 or the second toolbar 302 may further include one or more of the following function buttons: a button for starting a privacy screen, a button for adjusting the screen resolution, or a button for displaying the network speed, etc. The user can use the resolution of the first device or the resolution of the second device by triggering the button for adjusting the screen resolution.

[0113] In a possible implementation, the tablet may support zooming in and out of the display screen. For example, when the tablet receives an operation of the user sliding two fingers on the display screen outward, the tablet may zoom in on the displayed content according to the magnification factor; or, when the tablet receives an operation of the user sliding two fingers on the display screen inward, the tablet may zoom out on the displayed content.

[0114] In the process of zooming in or out of the displayed content, the first toolbar (or the second toolbar) does not zoom in or out along with the user's operation, that is, the size and position of the first toolbar (or the second toolbar) remain unchanged, so that the user can use the first toolbar (or the second toolbar) at any time.

[0115] Based on this, the embodiment of the present application provides a method for displaying a toolbar, so that the toolbar can not only be displayed on the remote control window, but also can be flexibly hidden and called based on the user's operation, so as to expand the operation interface of the remote control function and improve the user's experience of using the remote control function. In addition, the first device can also provide multiple toolbars, so that the user can select a suitable toolbar according to the use requirements, that is, the user can use the first toolbar when the user fully understands the meaning of each function button in the toolbar, or the user can use the second toolbar when the user is not familiar with the meaning of each function icon in the toolbar, so as to improve the utilization of the toolbar.

[0116] exist Figure 3 Based on the corresponding embodiment, the use of the first toolbar can refer to Figure 4-Figure 8In a corresponding embodiment, for example, the first toolbar can be displayed in the interface in a capsule shape according to the position of the movement (see Figure 4-Figure 5 Alternatively, the first toolbar may also be displayed in the interface as a suspended ball according to the position of the movement (see Figure 6-Figure 7 corresponding embodiments).

[0117] For example, Figure 4 A schematic diagram of an interface for moving a first toolbar provided in an embodiment of the present application Figure 1 .

[0118] The tablet displays Figure 4 The interface shown in a in FIG. 1 may include: a first toolbar 401 in a capsule shape.

[0119] like Figure 4 In the interface shown in a of FIG. 1 , when the tablet receives the user's operation of dragging the first toolbar 401 (the user does not release the first toolbar at this time), the tablet may display the following Figure 4 The interface shown in b. Figure 4 The interface shown in b in FIG. 1 may include a floating ball 402 , and an icon indicating that the remote access function is in effect may be displayed in the floating ball 402 . The floating ball 402 may be highlighted in the tablet.

[0120] exist Figure 4 a- Figure 4 During the change of b in FIG. 1 , due to the operation of the user dragging the first toolbar 401, the capsule-shaped first toolbar 401 gradually shrinks with the user's finger point as the center until it shrinks into a floating ball 402. The floating ball 402 occupies a small space, which can avoid affecting the user's viewing of other contents in the remote control interface during the dragging process.

[0121] It is understandable that the operation of dragging the first toolbar 401 to shrink the first toolbar 401 to the floating ball 402 can also be replaced by a long press operation or other triggering operations, etc., which is not limited in the embodiments of the present application.

[0122] like Figure 4 In the interface shown in b in FIG. 1 , when the drag operation continues to act on the floating ball 402, when the tablet receives that the user continues to drag the floating ball 402 to the upper edge area of ​​the display screen (such as the display area indicated by the dotted frame 403) (the user does not release the hand at this time), the tablet can display the following Figure 4 The interface shown in c.

[0123] like Figure 4 In the interface shown in c in FIG. 1 , when the tablet detects that the user ends the dragging operation, the tablet can display the following Figure 4 The interface shown in d in the figure. Figure 4The interface shown in d in the figure may include a first toolbar 401. The first toolbar 401 may be displayed outside the upper edge area of ​​the display screen (such as the display area indicated by the dotted box 404), and the first toolbar 401 is within the scope of the dotted box 403.

[0124] exist Figure 4 c- Figure 4 During the change of d in , when detecting that the user ends the dragging operation, the tablet can calculate the direction from which the floating ball 402 can be fully displayed on the display screen when it is expanded.

[0125] For example, Figure 4 In the interface shown in c, when the tablet computing floating ball 402 is expanded to the right and can be fully displayed on the display screen, the floating ball 402 gradually expands from the right until it expands to the first toolbar 401. Alternatively, when the tablet computing floating ball 402 is expanded to the left, the expanded area cannot be fully displayed on the display screen, and the tablet can switch the expansion direction of the floating ball 402, such as expanding to the right, expanding upward, or expanding downward. It is understandable that when multiple directions of the tablet computing floating ball 402 are allowed to expand, any direction can be selected to expand.

[0126] like Figure 4 The interface shown in c and Figure 4 In the interface shown in d in FIG. 4 , the short side length of the display area indicated by the dotted frame 403 is greater than the short side length of the display area indicated by the dotted frame 404. The first toolbar 403 may be displayed in the dotted frame 403.

[0127] exist Figure 4 c- Figure 4 During the change of d in , the floating ball 402 may first expand to the first toolbar 401 and then move to the outside of the display area indicated by the dotted frame 404, or the floating ball 402 may first move to the outside of the display area indicated by the dotted frame 404 and then expand to the first toolbar 401. It is understandable that even if the user Figure 4 In the interface shown in c, the position where the user ends the dragging is not at, Figure 4 In the interface shown in d in FIG. , the floating ball 402 may also be moved to the outside of the display area indicated by the dotted frame 404 and displayed close to the edge of the display screen.

[0128] For example, Figure 5 A schematic diagram of an interface for moving a first toolbar provided in an embodiment of the present application Figure 2 .in, Figure 5 In - Figure 5 b in FIG. 1 is an example of a tablet moving the first toolbar to the left edge of the display screen. Figure 5 c- Figure 5 d in FIG. 1 is an example of a tablet moving the first toolbar to the right edge of the display screen. Figure 5 e- Figure 5 The f in FIG. 1 is an example in which the tablet moves the first toolbar to the lower edge of the display screen.

[0129] In one implementation, Figure 4 In the interface shown in a of FIG. 1 , when the tablet receives an operation of the user dragging the first toolbar 401 to the left edge area of ​​the display screen (such as the area indicated by the dotted frame 501) (the user does not release the first toolbar 401 at this time), the tablet can Figure 5 The interface shown in a in FIG. 4 shows a suspended ball 402. Figure 5 In the interface shown in a of FIG, when the tablet detects that the user ends the drag operation, the tablet can Figure 5 The first toolbar 401 is displayed in the interface shown in b in the figure. The first toolbar 401 can be displayed on the right side of the left edge area of ​​the display screen (such as the area indicated by the dotted box 502).

[0130] In another implementation, Figure 4 In the interface shown in a of FIG. 1 , when the tablet receives an operation of the user dragging the first toolbar 401 to the right edge area of ​​the display screen (such as the display area indicated by the dotted frame 503) (the user does not release the first toolbar 401 at this time), the tablet can Figure 5 The interface shown in c in FIG. 4 shows a suspended ball 402. Figure 5 In the interface shown in c in the figure, when the tablet detects that the user ends the drag operation, the tablet can Figure 5 The first toolbar 401 is displayed in the interface shown in d in the figure. The first toolbar 401 can be displayed on the left side of the right edge area of ​​the display screen (such as the display area indicated by the dotted box 504).

[0131] In another implementation, Figure 4 In the interface shown in a of FIG. 1 , when the tablet receives an operation of the user dragging the first toolbar 401 to the lower edge area of ​​the display screen (such as the display area indicated by the dotted frame 505) (the user does not release the first toolbar 401 at this time), the tablet can Figure 5 The interface shown in FIG. e shows a suspended ball 402. Figure 5 In the interface shown in e in the figure, when the tablet detects that the user ends the drag operation, the tablet can Figure 5 The first toolbar 401 is displayed in the interface shown in f in FIG. 5 . The first toolbar 401 can be displayed on the upper side of the lower edge area of ​​the display screen (such as the display area indicated by the dotted frame 506 ).

[0132] The specific process examples of shrinking the first toolbar to the floating ball and expanding the floating ball to the first toolbar can be found in Figure 4 The description in the corresponding embodiments will not be repeated here.

[0133] Similarly, the first toolbar is displayed in a dotted line frame 501 , a dotted line frame 503 , or a dotted line frame 505 .

[0134] The length of the short side of the display area indicated by the dotted frame 403, the length of the short side of the display area indicated by the dotted frame 501, the length of the short side of the display area indicated by the dotted frame 503, and the length of the short side of the display area indicated by the dotted frame 505 are consistent. The length of the short side of the display area indicated by the dotted frame 404, the length of the short side of the display area indicated by the dotted frame 502, the length of the short side of the display area indicated by the dotted frame 504, and the length of the short side of the display area indicated by the dotted frame 506 are consistent.

[0135] Combination Figure 4 as well as Figure 5 In a corresponding embodiment, the first toolbar can be displayed at different positions near the edge of the display screen according to the user's drag operation. The first toolbar displayed near the edge can make it easier for the user to use the remote control function and reduce the situation where the first toolbar is blocked when opening any interface in the remote control function.

[0136] In a possible implementation, the first toolbar may also be displayed in the middle of the display screen or at a position away from the edge of the display screen according to the user's dragging operation, which is not limited in the embodiments of the present application.

[0137] For example, Figure 6 A schematic diagram of an interface for moving a first toolbar provided in an embodiment of the present application Figure 3 .

[0138] The tablet displays Figure 6 The interface shown in a in FIG. 1 may include: a first toolbar 401 in a capsule shape.

[0139] In the interface shown in a of FIG. b, when the tablet receives the user's operation of dragging the first toolbar 401 (the user does not release the first toolbar at this time), the tablet may display the following Figure 6 The interface shown in b. Figure 6 The interface shown in b in FIG. 4 may include a suspended ball 402 .

[0140] like Figure 6 In the interface shown in b in FIG. 1 , when the drag operation continues to act on the floating ball 402, when the tablet receives the user continuing to drag the floating ball 402 to the upper edge area of ​​the display screen (such as the display area indicated by the dotted frame 601), the tablet can display the following Figure 6 The interface shown in c.

[0141] like Figure 6 In the interface shown in c in FIG. 1 , when the tablet detects that the user ends the dragging operation, the tablet displays the following Figure 6 The interface shown in d in the figure. Figure 6 The interface shown in d in the figure may include a semicircular floating ball 602, which is displayed in the display area indicated by the dotted frame 601. The upper half of the semicircular floating ball 602 is not displayed in the interface. The semicircular floating ball 602 can also be displayed translucently. The specific display state of the semicircular floating ball 602 is not limited in the embodiment of the present application.

[0142] Among them, Figure 4 c- Figure 4 During the change of d in , the suspended ball 402 can continue to move vertically toward the upper edge of the display screen along the current position until the upper half of the suspended ball 402 disappears. At this time, the suspended ball 602 in a semicircular shape can be displayed in the dotted frame 601.

[0143] It is understandable that when the user does not need to use the floating ball for a long time, the floating ball can be dragged to the edge of the display screen so that the floating ball can be displayed in a semicircular and / or translucent shape to avoid affecting the user's normal use of the remote access function.

[0144] See also Figure 4 as well as Figure 6 In a corresponding embodiment, when the user drags the first toolbar to shrink the first toolbar to a floating ball, and continues to drag the floating ball closer to the edge of the display screen, the floating ball is more likely to be displayed as a semicircle, that is, Figure 4 The short side length of the display area indicated by the dashed box 403 in the interface shown in c is greater than Figure 6 The dashed box 601 in the interface shown in c indicates the short side length of the display area.

[0145] For example, Figure 7 A schematic diagram of an interface for moving a first toolbar provided in an embodiment of the present application Figure 4 .in, Figure 7 In - Figure 7 b in FIG. 1 is an example of a tablet moving the first toolbar to the left edge of the display screen. Figure 7 c- Figure 7 d in FIG. 1 is an example of a tablet moving the first toolbar to the right edge of the display screen. Figure 7 e- Figure 7 The f in FIG. 1 is an example in which the tablet moves the first toolbar to the lower edge of the display screen.

[0146] In one implementation, Figure 4 In the interface shown in a of FIG. 1 , when the tablet receives an operation of the user dragging the first toolbar 401 to the left edge area of ​​the display screen (such as the display area indicated by the dotted frame 701) (the user does not release the first toolbar 401 at this time), the tablet can Figure 7 The interface shown in a in FIG. 4 shows a suspended ball 402. Figure 7 In the interface shown in a of FIG, when the tablet detects that the user ends the drag operation, the tablet can Figure 7 The interface shown in b in FIG. 1 shows a semicircular floating ball 704 . The semicircular floating ball 704 can be displayed in a dotted frame 701 , and the left half of the semicircular floating ball 704 is not displayed in the interface.

[0147] Combination Figure 7 The interface shown in a and Figure 5 In the interface shown in a, the short side length of the display area indicated by the dotted box 501 is greater than the short side length of the display area indicated by the dotted box 701.

[0148] In another implementation, Figure 4 In the interface shown in a of FIG. 1 , when the tablet receives an operation of the user dragging the first toolbar 401 to the right edge area of ​​the display screen (such as the display area indicated by the dotted frame 702) (the user does not release the first toolbar 401 at this time), the tablet can Figure 7 The interface shown in c in FIG. 4 shows a suspended ball 402. Figure 7 In the interface shown in c in the figure, when the tablet detects that the user ends the drag operation, the tablet can Figure 7 The interface shown in d in FIG. 1 shows a semicircular floating ball 705 . The semicircular floating ball 705 can be displayed in a dotted frame 702 , and the right half of the semicircular floating ball 705 is not displayed in the interface.

[0149] Combination Figure 7 The interface shown in c and Figure 5 In the interface shown in c, the length of the short side of the display area indicated by the dotted box 502 is greater than the length of the short side of the display area indicated by the dotted box 702.

[0150] In another implementation, Figure 4 In the interface shown in a of FIG. 1 , when the tablet receives an operation of the user dragging the first toolbar 401 to the lower edge area of ​​the display screen (such as the display area indicated by the dotted frame 703) (the user does not release the first toolbar 401 at this time), the tablet can Figure 7 The interface shown in FIG. e shows a suspended ball 402. Figure 7 In the interface shown in e in the figure, when the tablet detects that the user ends the drag operation, the tablet can Figure 7 The interface shown in f in FIG. 7 shows a semicircular floating ball 706 . The semicircular floating ball 706 can be displayed in a dotted frame 703 , and the lower half of the semicircular floating ball 706 is not displayed in the interface.

[0151] Combination Figure 7 The interface shown in e and Figure 5 In the interface shown in e in FIG. 1 , the short side length of the display area indicated by the dotted box 503 is greater than the short side length of the display area indicated by the dotted box 703 .

[0152] The length of the short side of the display area indicated by the dotted box 601, the length of the short side of the display area indicated by the dotted box 701, the length of the short side of the display area indicated by the dotted box 702, and the length of the short side of the display area indicated by the dotted box 703 are consistent.

[0153] Combination Figure 6 as well as Figure 7 In a corresponding embodiment, the semicircular floating ball can allow the user to use the remote access function without being disturbed.

[0154] exist Figure 6 or Figure 7 On the basis of the corresponding embodiment, in a possible implementation, the tablet can also restore the semicircular floating ball to the first toolbar.

[0155] For example, Figure 8 A schematic diagram of an interface for calling a first toolbar provided in an embodiment of the present application.

[0156] like Figure 8 The interface shown in a of FIG. 1 may include: a semicircular suspended ball 801. When the tablet receives a sliding operation from the user's multiple fingers (such as three fingers indicated in the dotted frame 802) along the display screen from top to bottom, the tablet may display the following Figure 8 The interface shown in b in the figure, Figure 8 The interface shown in b in FIG. 8 shows the expanded first toolbar 803 .

[0157] In a possible implementation, the tablet may also be triggered by other means of the user, such as the user clicking on the display screen with multiple fingers to call up the semicircular floating ball 801 to switch it to the first toolbar 803, which is not limited in the embodiments of the present application.

[0158] like Figure 8 In the interface shown in b in FIG. 1 , when the tablet receives a sliding operation from the user on the display screen (such as three fingers indicated in the dotted frame 802) from top to bottom along the display screen, the tablet may display the following Figure 8 The interface shown in c in Figure 1. Or, Figure 8 In the interface shown in c in FIG. 1 , when the tablet receives a multi-finger sliding operation from top to bottom along the display screen, the tablet may display the following Figure 8 The interface shown in b.

[0159] like Figure 8In the interface shown in c in FIG. 1 , the interface may display a first toolbar 804 in an editing state and a prompt message 805 for prompting the toolbar to switch to an editing state, such as the prompt message 805 may be displayed as “Switch to the editing state toolbar”. The function buttons in the first toolbar 804 in an editing state may be, from left to right, a return button, an undo button, a cut button, a copy button, and a save button, so as to improve the convenience of the user in remote access functions. The first toolbar in an editing state may also be referred to as a third toolbar.

[0160] It is understandable that the method of switching the first toolbar from the normal state to the editing state may not be limited to the above-mentioned multi-finger sliding operation, or may also be a multi-finger click or other gesture operation, which is not limited in the embodiments of the present application.

[0161] Possible implementations include Figure 8 In the interface shown in c in FIG. 8 , when the tablet detects that the user has triggered an operation on any function button in the first toolbar 804, the tablet can execute the process corresponding to the function button and display the prompt information corresponding to the function button, so that the user can clearly understand the specific function of the current operation button. For example, when the user selects any content, when the tablet detects that the user has triggered an operation on the copy button in the first toolbar 804, the tablet can copy the selected content and display a prompt information with the word "copy" to prompt the user that the tablet is executing the copy process.

[0162] Based on this, the tablet can enrich the function buttons in the first toolbar to facilitate users to conveniently use more functions in the remote access function, thereby improving the user's experience of using the remote access function.

[0163] exist Figure 3 Based on the corresponding embodiment, the use of the second toolbar can be seen in Figure 9-10 The corresponding embodiments.

[0164] For example, Fig. 9 A schematic diagram of an interface using a second toolbar provided in an embodiment of the present application.

[0165] like Fig. 9 The interface shown in a in , the interface may include: a second toolbar 302.

[0166] When the tablet receives a trigger operation from the user for the button for locking the PC in the second toolbar 302, the tablet may display the following information: Fig. 9 The interface shown in b, Fig. 9The interface shown in b may include: prompt information for prompting that the second device is being remotely accessed, and prompt information for unlocking the screen. The prompt information for prompting that the second device is being remotely accessed may be displayed as "The current computer is being remotely controlled", and the prompt information for unlocking the screen may be displayed as "Press CTRL+SHIFT+DELETE to unlock the screen".

[0167] When the tablet receives a trigger operation of a button for locking the PC by the user, the tablet can remotely send an instruction for locking the PC to the second device, so that the second device locks the display screen.

[0168] like Fig. 9 In the interface shown in a of FIG. 1 , when the tablet receives a trigger operation from the user for a button for matching the tablet resolution, the tablet may display the following Fig. 9 In the interface shown in c, the Fig. 9 The interface shown in c may include: Fig. 9 A part of the interface shown in a. Fig. 9 In the interface shown in c in FIG. 1 , the user can view the complete interface content by dragging. In this scenario, the resolution of the tablet is smaller than the resolution of the computer.

[0169] like Fig. 9 In the interface shown in a in FIG, when the tablet receives a trigger operation from the user on a button for disconnecting the connection, the tablet may disconnect the remote connection. For example, the tablet may send an instruction to disconnect the remote connection to the computer.

[0170] Based on this, the tablet can provide users with a variety of functions in the remote access function to improve the user's experience of using the remote access function.

[0171] exist Figure 3 Based on the corresponding embodiment, in the remote access function, the tablet can also provide a button for calling the keyboard (see Fig.10 corresponding embodiment), and a button for calling the stylus (see Fig.11 Corresponding embodiments), etc., allow users to flexibly control the keyboard and stylus in the remote access function.

[0172] For example, Fig.10 A schematic diagram of an interface for calling a keyboard provided in an embodiment of the present application.

[0173] In the scenario where the tablet and the computer are remotely connected and the document application is displayed on the computer, when the tablet receives a trigger operation from the user on a button for remotely controlling the computer, the tablet may display the following Fig.10 The interface shown in a or Fig.10 The interface shown in c.

[0174] In one implementation, Fig.10 The interface shown in a in the figure can display a button 1001 for calling the keyboard, and the button 1001 is displayed in the task bar at the bottom of the interface. It can be understood that when the computer detects that a remote connection is established with the tablet, the computer can display the button 1001 for calling the keyboard in the task bar according to the pre-set settings, so that the user can use the keyboard in the remote access function.

[0175] like Fig.10 In the interface shown in a of FIG. 1 , when the tablet receives a trigger operation of the user on the button 1001 for calling the keyboard, the tablet may send a first instruction corresponding to the operation of the trigger button 1001 to the second device, and then the tablet may display the following Fig.10 Further, when the tablet receives a trigger operation from the user at any position other than the keyboard 1003, the tablet may display the following Fig.10 The interface shown in a.

[0176] Fig.10 The interface shown in b in FIG. 1 may display a keyboard 1003 , where the keyboard 1003 may be a keyboard corresponding to the computer, for example, 1003 may be a soft keyboard of the computer system, where a soft keyboard may be understood as a keyboard displayed on a computer screen.

[0177] In another implementation, Fig.10 The interface shown in c in FIG. 1 may display a button 1002 for calling a keyboard. The button 1002 is displayed in the interface in the form of a floating ball, and the button 1002 may be fixed at any position of the interface according to the user's drag.

[0178] like Fig.10 In the interface shown in c in FIG. 1 , when the tablet receives a trigger operation from the user for the button 1002 for calling the keyboard, the tablet may display the following Fig.10 Further, when the tablet receives a trigger operation from the user at any position other than the button 1002 and the keyboard 1004, the tablet may display the following: Fig.10 The interface shown in c.

[0179] like Fig.10 The interface shown in d in the figure may display a keyboard 1004 and a button 1002. The keyboard 1004 may be a keyboard corresponding to the tablet. For example, the keyboard 1004 may use the Android system input method of the tablet and support multiple keyboard inputs, such as Pinyin 9-key input, Pinyin 27-key input, Wubi input, stroke input, or emoticon input. The button 1002 may also be displayed in a capsule shape or other form such as Fig.10In the interface shown in d, no specific limitation is made in the embodiments of the present application.

[0180] It is understandable that due to Fig.10 The button 1001 in the interface shown in a is actually displayed in the computer taskbar, so when the computer receives the user trigger button 1001, the computer keyboard 1003 can be called. Fig.10 The keyboard 1004 in the interface shown in d is triggered and displayed by the tablet, so the tablet keyboard 1004 can be displayed when the tablet receives the user trigger button 1002.

[0181] Combination Fig.10 In a corresponding embodiment, when the second device is a computer with a taskbar, the button for calling the keyboard can be displayed in the taskbar, or displayed in the form of a floating ball at any position on the computer interface. When the second device is a device such as a tablet or a mobile phone that does not include a taskbar, the button for calling the keyboard can be displayed in the form of a floating ball at any position on the interface.

[0182] It is understandable that, since the tablet can usually expand the keyboard when receiving an operation of the user triggering any input box, the tablet can be based on Fig.10 The corresponding embodiment displays a button for invoking the keyboard, so that the user can expand the keyboard by triggering the button, and the button 1002 and the button 1002 are convenient for using the keyboard in the remote access function at any time.

[0183] Understandably, Fig.10 Taking the second toolbar not being displayed in the remote control window as an example for explanation, it can be understood that no matter whether the first toolbar or the second toolbar is displayed in the remote control window, Fig.10 In the corresponding embodiments, buttons for invoking the keyboard may all exist.

[0184] For example, Fig.11 A schematic diagram of an interface for calling a stylus provided in an embodiment of the present application.

[0185] When the tablet detects that a stylus pen is connected, the following information can be displayed: Fig.11 The interface shown in a in FIG. 1 may include a button 1101 for using a stylus.

[0186] like Fig.11 In the interface shown in a of FIG. 1 , when the tablet receives a trigger operation of the user on button 1102, the tablet may display the following Fig.11 The interface shown in b in the figure is that the user can Fig.11In the interface shown in b in FIG. 1 , a stylus is used, and at least one function button in the toolbar 1102 corresponding to the stylus is used. The toolbar 1102 may include one or more of the following: a button for starting global handwriting, a return button, an undo button, a space button, a delete button, or a button for setting the toolbar 1102, etc.

[0187] Possible implementations include Fig.10 In the interface shown in c in FIG. 1 , when the tablet detects that the stylus pen is connected, the tablet can replace button 1002 with button 1101 and display the following Fig.11 The interface shown in a in FIG. In this scenario, the user can use a stylus pen to replace the keyboard to continue inputting content.

[0188] Based on this, the user can determine whether the stylus is connected to the tablet through button 1101 and use more functions of the stylus through button 1102, thereby improving the flexibility of the user in using the stylus in the remote access function.

[0189] In a possible implementation, the toolbar described in the embodiment of the present application may also support horizontal and vertical screen switching, that is, when the terminal device switches between horizontal and vertical screens, the relative position of the toolbar remains unchanged. For example, when the terminal device is in the vertical screen state, the toolbar is displayed on the left side of the display screen. When the terminal device switches to the horizontal screen state based on user operation, the toolbar is also displayed on the left side of the display screen. Among them, the terminal device can detect the horizontal and vertical screen state of the device through an acceleration sensor and / or a gyroscope sensor.

[0190] For example, Fig.12 A schematic diagram of a horizontal and vertical screen switching interface provided in an embodiment of the present application. Fig.12 In the corresponding embodiment, the toolbar is taken as the first toolbar as an example for illustration. The display state of the second toolbar when the tablet is switched between horizontal and vertical screens can be similar to that of the first toolbar, which will not be repeated here.

[0191] The tablet can display the following in landscape mode: Fig.12 In the interface shown in a of FIG. 1 , the first toolbar may be located at the left edge of the display screen, and the content displayed in the interface may be Figure 5 The interface shown in b is similar and will not be repeated here.

[0192] When the tablet receives an operation of flipping the display screen by the user, the tablet can detect that the screen is in the vertical state and display the following information: Fig.12 In the interface shown in b, the first toolbar can be displayed on the left edge of the display screen as the display screen is flipped.

[0193] Similarly, when the first toolbar is displayed on the right edge of the display screen, the first toolbar may also be displayed on the right edge of the display screen as the display screen is flipped, or when the first toolbar is displayed on the upper edge of the display screen, the first toolbar may also be displayed on the upper edge of the display screen as the display screen is flipped, or when the first toolbar is displayed on the lower edge of the display screen, the first toolbar may also be displayed on the lower edge of the display screen as the display screen is flipped.

[0194] It is understandable that when the first toolbar is reduced to Figure 7 When the floating ball is displayed at the left edge of the display screen, the floating ball may also be displayed at a relative position following the flipping of the display screen. For example, when the floating ball is displayed at the left edge of the display screen, the floating ball may also be displayed at the left edge of the display screen following the flipping of the display screen; or when the floating ball is displayed at the right edge of the display screen, the floating ball may also be displayed at the right edge of the display screen following the flipping of the display screen; or when the floating ball is displayed at the upper edge of the display screen, the floating ball may also be displayed at the upper edge of the display screen following the flipping of the display screen; or when the floating ball is displayed at the lower edge of the display screen, the floating ball may also be displayed at the lower edge of the display screen following the flipping of the display screen.

[0195] Based on this, the toolbar can also support horizontal and vertical screen switching. When the terminal device switches the horizontal and vertical screens, the relative position between the toolbar and the content displayed on the computer remains unchanged, so as to improve the user experience when using the toolbar.

[0196] It can be understood that, when the tablet displays the first toolbar or the second toolbar, when the tablet receives a target operation for either the first toolbar or the second toolbar for controlling the second device in remote access, the tablet can send the target instruction corresponding to the target operation to the second device, so that the second device can execute the target operation and display the interface corresponding to the target instruction, and then the first device can also view the interface displayed by the second device in response to the target instruction in the interface displayed by the first device.

[0197] An embodiment of the present application provides a toolbar display system, which includes a first device and a second device. The processes executed by the first device and the second device can refer to the description in the above embodiment.

[0198] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0199] Combined with the above Figure 4-Figure 12 , the method provided in the embodiment of the present application is described, and the device for executing the above method provided in the embodiment of the present application is described below. Fig.13 As shown, Fig.13 A structural schematic diagram of a toolbar display device provided in an embodiment of the present application. The toolbar display device may be the first device or the second device in the embodiment of the present application, or may be a chip or chip system in the first device or a chip or chip system in the second device.

[0200] like Fig.13 As shown, the display device 1300 of the toolbar can be used in a communication device, circuit, hardware component or chip, and the display device 1300 of the toolbar includes: a display unit 1301, a processing unit 1302, and a communication unit 1303, etc. Among them, the display unit 1301 is used to support the display step of the toolbar display method; the processing unit 1302 is used to support the display device 1300 of the toolbar to perform information processing steps; and the communication unit 1303 is used to support the display device 1300 of the toolbar to perform steps such as receiving or sending messages.

[0201] The display device of the toolbar of the first device (or the second device) described in the embodiments of the present application may include: Fig.13 The units described in the corresponding embodiments.

[0202] Specifically, the processing unit 1302 and the display unit 1301 may be integrated together, and the processing unit 1302 and the display unit 1301 may communicate with each other.

[0203] In a possible implementation, the toolbar display device 1300 may further include: a storage unit 1304. The storage unit 1304 may include one or more memories, and the memory may be a device in one or more devices or circuits for storing programs or data.

[0204] The storage unit 1304 may exist independently and be connected to the processing unit 1302 via a communication bus. The storage unit 1304 may also be integrated with the processing unit 1302.

[0205] Taking the display device 1300 of the toolbar as an example, which can be a chip or chip system of the terminal device in the embodiment of the present application, the storage unit 1304 can store computer execution instructions of the method of the terminal device, so that the processing unit 1302 executes the method of the terminal device in the above embodiment. The storage unit 1304 can be a register, a cache, or a random access memory (RAM), etc. The storage unit 1304 can be integrated with the processing unit 1302. The storage unit 1304 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, and the storage unit 1304 can be independent of the processing unit 1302.

[0206] In a possible implementation, the display device 1300 of the toolbar may further include: a communication unit 1303. The communication unit 1303 is used to support the display device 1300 of the toolbar to interact with other devices. Exemplarily, when the display device 1300 of the toolbar is a terminal device, the communication unit 1303 may be a communication interface or an interface circuit. When the display device 1300 of the toolbar is a chip or a chip system in the terminal device, the communication unit 1303 may be a communication interface. For example, the communication interface may be an input / output interface, a pin or a circuit, etc.

[0207] The device of this embodiment can be used to execute the steps executed in the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail here.

[0208] Fig.14 A schematic diagram of the hardware structure of another terminal device provided in an embodiment of the present application is shown in FIG. Fig.14 As shown, the terminal device may be the first device or the second device described in the embodiments of the present application.

[0209] The terminal device includes a processor 1401, a communication line 1404 and at least one communication interface ( Fig.14 The communication interface 1403 is used as an example for explanation).

[0210] The processor 1401 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0211] Communications link 1404 may include circuitry to transmit information between the above-described components.

[0212] The communication interface 1403 uses any transceiver or other device for communicating with other devices or communication networks, such as Ethernet, wireless local area networks (WLAN), etc.

[0213] Possibly, the terminal device may further include a memory 1402 .

[0214] The memory 1402 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may exist independently and be connected to the processor via a communication line 1404. The memory may also be integrated with the processor.

[0215] The memory 1402 is used to store computer-executable instructions for executing the solution of the present application, and the execution is controlled by the processor 1401. The processor 1401 is used to execute the computer-executable instructions stored in the memory 1402, thereby implementing the method provided by the embodiment of the present application.

[0216] Possibly, the computer-executable instructions in the embodiments of the present application may also be referred to as application code, and the embodiments of the present application do not specifically limit this.

[0217] In a specific implementation, as an embodiment, the processor 1401 may include one or more CPUs, such as Fig.14 CPU0 and CPU1 in.

[0218] In a specific implementation, as an embodiment, the terminal device may include multiple processors, such as Fig.141401 and 1405 in the embodiment of the present invention. Each of these processors may be a single-CPU processor or a multi-CPU processor. The processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0219] In the above embodiments, the instructions stored in the memory for execution by the processor may be implemented in the form of a computer program product, wherein the computer program product may be pre-written in the memory, or may be downloaded and installed in the memory in the form of software.

[0220] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or data center that includes one or more available media integrated. For example, the available medium can include a magnetic medium (e.g., a floppy disk, a hard disk or a tape), an optical medium (e.g., a digital versatile disc (digital versatile disc, DVD)), or a semiconductor medium (e.g., a solid state drive (solid state disk, SSD)), etc.

[0221] The embodiments of the present application also provide a computer-readable storage medium. The methods described in the above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. Computer-readable media may include computer storage media and communication media, and may also include any medium that can transfer a computer program from one place to another. The storage medium may be any target medium that can be accessed by a computer.

[0222] As a possible design, the computer readable medium may include a compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM or other optical disc storage; the computer readable medium may include a magnetic disk storage or other magnetic disk storage device. Moreover, any connection line may also be appropriately referred to as a computer readable medium. For example, if the software is transmitted from a website, server or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology (such as infrared, radio and microwave), the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology such as infrared, radio and microwave are included in the definition of medium. Disk and disc as used herein include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, where disks usually reproduce data magnetically, while optical discs reproduce data optically using lasers.

[0223] The above combinations should also be included in the scope of computer-readable media. The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A method for displaying a toolbar, characterized in that: Applied to a first device, the method includes: The first device displays a first interface, where the first interface includes content displayed by the first device; The first device establishes a remote communication connection with the second device; After the remote communication connection is established, the first device displays a second interface, the second interface includes content displayed by the second device and a first toolbar, the first toolbar covers the content displayed by the second device, and the first toolbar includes at least one function button for remotely controlling the second device; In response to a first operation on the first toolbar, the first device displays a third interface, wherein the third interface includes: content displayed by the second device and a first floating ball corresponding to the first toolbar, wherein the icon in the first floating ball is used to indicate that the first device is remotely accessing other devices; In response to a second operation on the third interface, the first device displays the second interface.

2. The method according to claim 1, characterized in that In response to the first operation on the first toolbar, the first device displays a third interface, including: In response to the first operation, the first device displays a fourth interface, wherein the fourth interface includes: content displayed by the second device and a second suspended ball, wherein the first suspended ball is half of the second suspended ball; In response to a third operation on the second floating ball, the first device displays the third interface, wherein the third operation is an operation that continues the first operation, and the third operation is used to move the second floating ball to a first area near the edge of the display screen of the first device, wherein the first area includes the first floating ball.

3. The method according to claim 2, characterized in that The method further comprises: In response to a fourth operation on the first toolbar, the first device displays the fourth interface; In response to the fifth operation on the second floating ball, the first device displays a fifth interface, and the fifth interface includes: the content displayed by the second device and the first toolbar. The fifth operation is an operation that continues the fourth operation. The fifth operation is used to move the second floating ball to a second area at the edge of the display screen. The short side of the second area is larger than the short side of the first area, and the second area includes the first toolbar.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to an operation on the second interface, the first device displays a sixth interface, wherein the sixth interface includes content displayed by the second device, a third toolbar, and a first prompt message, wherein the third toolbar includes at least one function button different from that in the first toolbar, and the first prompt message is used to prompt the first toolbar to switch to the third toolbar.

5. The method according to claim 4, characterized in that The third toolbar includes a first button, and the method further includes: In response to an operation on the first button, the first device displays second prompt information, where the second prompt information is used to prompt a function corresponding to the first button.

6. The method according to claim 4 or 5, characterized in that: The first toolbar includes one or more of the following function buttons: a button for displaying the desktop, a multitasking button, an undo button, a button for calling the keyboard, a button for calling the microphone of the second device, or a button for setting the function buttons in the first toolbar; the third toolbar includes one or more of the following function buttons: a return button, an undo button, a cut button, a copy button or a save button.

7. The method according to any one of claims 4 to 6, characterized in that: Any function button in the first toolbar or the third toolbar may be displayed as an icon corresponding to the function button.

8. The method according to claim 6, characterized in that The method further comprises: In a case where the second interface also includes a first icon, in response to an operation on the first icon, the first device sends a first instruction to the second device, and displays a keyboard corresponding to the second device in the second interface; Alternatively, when the second interface also includes a second icon, in response to an operation on the second icon, the first device displays a keyboard corresponding to the first device, the first icon is displayed in the second device, and the second icon is not displayed in the second device.

9. The method according to any one of claims 1 to 7, characterized in that: The first device is in a horizontal screen state, and the method further includes: When the first device detects that the first device switches from the horizontal screen state to the vertical screen state, the first device displays a seventh interface, and the seventh interface includes the content displayed by the second device and the first toolbar, wherein the first relative position is the same as the second relative position, the first relative position being the relative position between the first toolbar and the content displayed by the second device in the second interface, and the second relative position being the relative position between the first toolbar and the content displayed by the second device in the seventh interface.

10. The method according to any one of claims 1 to 3, characterized in that: The first suspension ball is translucent, and the first toolbar is capsule-shaped.

11. A method for displaying a toolbar, characterized in that: Applied to a first device, the method includes: The first device displays a first interface, where the first interface includes content displayed by the first device; The first device establishes a remote communication connection with the second device; After the remote communication connection is established, the first device displays an eighth interface, wherein the eighth interface includes content displayed by the second device; The first device receives a sixth operation on the eighth interface; In response to the sixth operation, the first device displays a second toolbar in the eighth interface, where the second toolbar includes at least one function button for remotely controlling the second device, and the second toolbar is overlaid on the content displayed by the second device.

12. The method according to claim 11, characterized in that The second toolbar includes one or more of the following functional buttons: a button for locking the second device, a button for disconnecting, a button for turning on high-definition mode, a button for matching the resolution of the first device, a button for playing sound in the first device, or a button for inputting sound in the first device.

13. The method according to claim 11 or 12, characterized in that: Any function button in the second toolbar may be displayed as: an icon corresponding to the function button and the name of the function button.

14. The method according to any one of claims 11 to 13, characterized in that: The method further comprises: In a case where the eighth interface also includes a first icon, in response to an operation on the first icon, the first device sends a first instruction to the second device, and displays a keyboard corresponding to the second device in the eighth interface; Alternatively, when the eighth interface also includes a second icon, in response to an operation on the second icon, the first device displays a keyboard corresponding to the first device, the first icon is displayed in the second device, and the second icon is not displayed in the second device.

15. A terminal device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the terminal device executes the method according to any one of claims 1 to 10, or executes the method according to any one of claims 11 to 14.

16. A toolbar display system, characterized in that: The display system of the toolbar includes a first device and a second device, the first device is used to execute the method as described in any one of claims 1-10 or 11-14, and the second device is used to execute the method as described in any one of claims 1-10 or 11-14.

17. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the computer executes the method according to any one of claims 1 to 10, or the method according to any one of claims 11 to 14.

Images