Interface display method and device, computing equipment and storage medium

Abstract

The invention provides an interface display method and device, equipment and a medium. A method is applied to a computing device that includes first and second display screens electrically connected and having first and second relative position states, the first display screen being closer to a user in the first relative position state than in the second relative position state. The method comprises the steps of obtaining relative position information of a first display screen and a second display screen; when it is determined that the first display screen and the second display screen are in the first relative position state, a first main interface suitable for touch operation is displayed on the first display screen, and a first auxiliary interface is displayed on the second display screen; when it is determined that the first display screen and the second display screen are in the second relative position state, a second main interface suitable for keyboard and mouse operation is displayed on the first display screen, and a second auxiliary interface comprising a keyboard is displayed on the second display screen. According to the method and the device, the characteristic of flexible use mode of the double-screen display terminal can be fully utilized, different interfaces are displayed according to different position states, and user operation is facilitated.

Description

Technical Field

[0001] The present invention relates to the field of human-computer interaction technology, and in particular to an interface display method, an interface display device, a computing device and a computer-readable storage medium. Background Art

[0002] In the art, there are terminal products with two or more display screens, and these display screens can have a variety of relative position states or configurations as needed to meet the different operating needs of users. However, the prior art does not design different display interaction interfaces for these different position configurations, resulting in the user being unable to or requiring cumbersome operations to have a relatively comfortable operating interface when changing the relative position states of the two display screens. Therefore, the art urgently needs a technology that can automatically switch different display interfaces according to the relative position changes of two or more display screens to adapt to the different operating habits of users. Summary of the invention

[0003] To this end, the present application is committed to providing an interface display method, an interface display device, a computing device and a computer-readable storage medium, which can give full play to the characteristics of a multi-screen terminal and display different operation interfaces according to the relative position changes of two or more display screens to adapt to the different operating habits of users.

[0004] On the one hand, the present application provides an interface display method, which is applied to a computing device, wherein the computing device includes a first display screen and a second display screen, wherein the first display screen and the second display screen are electrically connected and have a first relative position state and a second relative position state, wherein the first display screen is closer to a user in the first relative position state than in the second relative position state, and the method includes: obtaining relative position information of the first display screen and the second display screen; when it is determined that the first display screen and the second display screen are in the first relative position state, displaying a first main interface suitable for touch operation on the first display screen, and displaying a first auxiliary interface on the second display screen; when it is determined that the first display screen and the second display screen are in the second relative position state, displaying a second main interface suitable for keyboard and mouse operation on the first display screen, and displaying a second auxiliary interface including a keyboard on the second display screen.

[0005] According to this aspect, when one of the two display screens is brought closer, it can be determined that the user wants to operate the display content on the display screen through touch operation, so a display interface suitable for touch operation is used, and when the two display screens are not brought closer, it can be determined that the user wants to control the display content on the display screen through keyboard and mouse operation, so a display interface suitable for keyboard and mouse operation is used. In this way, as long as the relative position configuration of the two display screens changes, the system automatically determines that the user needs to switch the operation mode, thereby providing corresponding display content to adapt to the user's operating habits, greatly improving the usability of dual-screen or multi-screen terminals and improving the user's operating experience.

[0006] In a particular embodiment of the present application, both the first main interface and the second main interface include application icons, and the application icons have a larger area in the first main interface than in the second main interface.

[0007] According to this embodiment, by displaying icons with larger areas, it is more convenient for users to click and operate application programs by touching with their fingers, so that the first main interface is more suitable for touch operation than the second main interface.

[0008] In a particular embodiment of the present application, both the first main interface and the second main interface include application icons, and the application icons have a larger sensing area in the first main interface than in the second main interface.

[0009] According to this embodiment, by making the icon have a larger sensing area, it is more convenient for the user to click or move the finger when operating the first main interface, reducing the occurrence of misoperation, so that the first main interface is more suitable for touch operation than the second main interface.

[0010] In a particular embodiment of the present application, the first display screen and the second display screen are separated from each other in the first relative position state, and the first display screen and the second display screen are rotatably connected in the second relative position state.

[0011] According to this embodiment, the first relative position state is a state in which the two display screens are separated from each other, and the second relative position state is a state in which the two display screens are connected to each other, so that the first relative position state is more suitable for users to operate the display interface through touch, and the second relative position state is more suitable for users to operate through keyboard and mouse, because when the two display screens are separated, the user can naturally pull one of the display screens closer to the front, and thus naturally choose the touch operation method; while in the connected state, the positional relationship between the two display screens is relatively fixed, which is more suitable for users to operate through keyboard and mouse.

[0012] In a particular embodiment of the present application, the first display screen and the second display screen are connected by plugging or magnetic attraction in the second relative position state.

[0013] According to this embodiment, the first and second display screens connected by plugging or magnetic attraction are separable or detachable. Plug-in and magnetic attraction are mature technical means of detachable connection in the field. Using such technical means to achieve detachable connection of two display screens is conducive to reducing costs and ensuring reliability.

[0014] In a particular embodiment of the present application, in the first relative position state, the bottom of the first display screen abuts against the middle of the second display screen, and in the second relative position state, the bottom of the first display screen is rotatably connected to the top of the second display screen.

[0015] According to this embodiment, the first relative position state is a state where the first display screen is against the middle of the second display screen, and the second relative position state is a state where the first display screen is against the top of the second display screen, so that the first relative position state is more suitable for touch operation, and the second relative position state is more suitable for keyboard and mouse operation. This is because, in the first relative position state, the first display screen is closer to the user's head or eyes, so that the user is more inclined to directly point or touch the display screen with a finger, while in the second relative position, the two display screens present a configuration of an ordinary laptop computer, so that the user is more inclined to use keyboard and mouse operation.

[0016] In a particular embodiment of the present application, the second main interface includes a cursor for displaying a mouse position, and the second auxiliary interface also includes a touchpad for controlling the cursor.

[0017] According to this embodiment, by displaying a cursor on the main interface and displaying a touchpad on the auxiliary interface, the two interfaces cooperate with each other, which is more conducive to the user to implement keyboard and mouse operations.

[0018] On the other hand, the present application provides an interface display device, which is applied to a computing device, wherein the computing device includes a first display screen and a second display screen, wherein the first display screen is electrically connected to the second display screen and has a first relative position state and a second relative position state, wherein the first display screen is closer to the user in the first relative position state than in the second relative position state, and the device includes: an acquisition module, which is used to acquire relative position information of the first display screen and the second display screen; a touch module, which is used to display a first main interface suitable for touch operation on the first display screen and a first auxiliary interface on the second display screen when it is determined that the first display screen and the second display screen are in the first relative position state; and a keyboard and mouse module, which is used to display a second main interface suitable for keyboard and mouse operation on the first display screen and a second auxiliary interface including a keyboard on the second display screen when it is determined that the first display screen and the second display screen are in the second relative position state.

[0019] On the other hand, the present application provides a computing device, which includes a first display screen, a second display screen, a memory and a processor. The first display screen is electrically connected to the second display screen and has a first relative position state and a second relative position state. The first display screen is closer to the user in the first relative position state than in the second relative position state. The memory stores the code of the graphical user interface of the application. The processor is used to execute the code of the graphical user interface stored in the memory to display the graphical user interface on the first display screen and / or the second display screen. The graphical user interface is configured to: obtain relative position information of the first display screen and the second display screen; when it is determined that the first display screen and the second display screen are in the first relative position state, display a first main interface suitable for touch operation on the first display screen, and display a first auxiliary interface on the second display screen; when it is determined that the first display screen and the second display screen are in the second relative position state, display a second main interface suitable for keyboard and mouse operation on the first display screen, and display a second auxiliary interface including a keyboard on the second display screen.

[0020] On the other hand, the present application provides a computer-readable storage medium, which stores a computer program, and the computer program is used to execute the above-mentioned interface display method.

[0021] On the other hand, the present application provides a computer program product, including program code, which enables a computer to implement the above-mentioned interface display method when the computer runs the computer program product.

[0022] Any of the interface display devices, computing devices, computer-readable storage media or computer program products provided above are used to execute the interface display method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding schemes in the corresponding methods provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The specific implementation of the present application is described in detail below with reference to the accompanying drawings, wherein:

[0024] Figure 1 A schematic diagram showing the structure of a computing device according to an embodiment of the present application is shown;

[0025] Figure 2 Show according to Figure 1 A schematic flow chart of an interface display method applicable to a computing device of an embodiment;

[0026] Figure 3 Show according to Figure 1 Another schematic diagram of the structure of a computing device according to an embodiment;

[0027] Figure 4 Show according to Figure 1Another schematic diagram of the structure of a computing device according to an embodiment;

[0028] Figure 5 Show according to Figure 1 A schematic diagram of first and second main interfaces of a computing device of an embodiment;

[0029] Figure 6 Show according to Figure 1 Another schematic diagram of the first and second main interfaces of the computing device of an embodiment;

[0030] Figure 7 Show according to Figure 1 A schematic diagram of a second main interface and a second auxiliary interface of a computing device of an embodiment;

[0031] Figure 8 Show according to Figure 1 Another schematic diagram of the first and second main interfaces of the computing device of an embodiment;

[0032] Fig. 9A Show according to Figure 1 A schematic diagram of a first auxiliary interface of a computing device of an embodiment;

[0033] Fig. 9B Show according to Figure 1 Another schematic diagram of the first auxiliary interface of the computing device of an embodiment;

[0034] Fig. 9C Show according to Figure 1 A schematic diagram of a first or second auxiliary interface of a computing device of an embodiment;

[0035] Fig.9D Show according to Figure 1 Another schematic diagram of the first or second secondary interface of the computing device of an embodiment;

[0036] Fig.9E Show according to Figure 1 Another schematic diagram of the first or second secondary interface of the computing device of an embodiment;

[0037] Fig.9F Show according to Figure 1 Another schematic diagram of the first auxiliary interface of the computing device of an embodiment;

[0038] Figure 9G Show according to Figure 1 Another schematic diagram of the first auxiliary interface of the computing device of an embodiment;

[0039] Fig.10 A schematic diagram showing the structure of an interface display device according to an embodiment of the present application is shown;

[0040] Fig.11A schematic diagram of the structure of a computing device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0041] In order to make those skilled in the art understand the concept and thought of the present application more clearly, the present application is described in detail below in conjunction with specific embodiments. It should be understood that the embodiments provided herein are only a part of all embodiments that the present application may have. After reading the specification of the present application, those skilled in the art have the ability to make improvements, transformations, or replacements to part or all of the following embodiments, and these improvements, transformations, or replacements are also included in the scope of the present application.

[0042] In this document, the terms "one", "an" and other similar words are not intended to indicate that there is only one of the things described, but rather that the relevant description is only for one of the things described, and the things described may have one or more. In this document, the terms "comprises", "includes" and other similar words are intended to indicate logical relationships, and cannot be regarded as indicating spatial structural relationships. For example, "A includes B" is intended to indicate that B logically belongs to A, but does not mean that B is spatially located inside A. In addition, the meanings of the terms "comprises", "includes" and other similar words should be regarded as open, rather than closed. For example, "A includes B" is intended to indicate that B belongs to A, but B does not necessarily constitute the whole of A, and A may also include other elements such as C, D, and E.

[0043] In this document, the terms "first", "second" and other similar words are not intended to imply any order, quantity and importance, but are only used to distinguish different elements. In this document, the terms "embodiment", "present embodiment", "one embodiment" and "an embodiment" do not mean that the relevant description is only applicable to a specific embodiment, but rather that these descriptions may also be applicable to one or more other embodiments. Those skilled in the art should understand that in this document, any description made for a certain embodiment can be replaced, combined, or otherwise combined with the relevant description in one or more other embodiments, and the new embodiment produced by the replacement, combination, or other combination is easily conceivable by those skilled in the art and belongs to the scope of protection of this application.

[0044] In various embodiments of the present application, an interface may refer to a medium for interaction between a person and an object, such as a graphical state on a display screen presented to a user. In some embodiments, an interface may refer to a graphical user interface (GUI) or other interface suitable for human-computer interaction of an electronic product or computing device such as a computer, a mobile phone, or a smart watch.

[0045] During the use of dual-screen terminals, the demand for flexible use of screens is getting higher and higher, one is the main display screen (first display screen), and the other is the auxiliary display screen (second display screen). The main screen sometimes needs to be used in a close-range state for touch interaction, and sometimes needs to be used in a slightly farther state for mouse or TOUCHPAD interaction. When the state of the main screen changes, the display content requirements for the system interface are also different, such as the size of the APP icon, the size of the text, etc., so the display content of the main screen and the auxiliary screen also needs to change accordingly in different states. Some products in this field still have deficiencies in the ergonomic experience when the dual screens are used flexibly and the instant adaptability to the display content of the system interface. The first is the ergonomic experience problem, either the main screen lacks keyboard input after being pulled closer, or the auxiliary screen cannot be used normally after the main screen is pulled closer, or other accessories are required for auxiliary use. Secondly, when the main screen enters different usage states, the system interface fails to change accordingly to adapt to the current state at the same time, so that consumers can interact better. Therefore, this application is committed to solving the usability and human-computer interaction experience problems of dual-screen terminal products in different states.

[0046] Some technologies in this field have proposed a technical solution that changes the angle between the two screens to enter multiple usage states. However, in these technical solutions, firstly, when the main screen enters the close-range touch usage state, the auxiliary screen cannot be used normally, resulting in screen waste. Only independent keyboard accessories and bracket accessories can be used to achieve a complete dual-screen display and a comfortable horizontal keyboard input experience. Secondly, the system interface does not change after the screen is brought closer, and it is still an interface more suitable for keyboard and mouse operation.

[0047] Some other technologies in the field have proposed a technical solution in which the height and angle of the auxiliary screen can change, while the main screen only changes its angle. In response to these technologies, the inventors of this application found that, firstly, the main screen fails to get closer to the user, which will result in a poor touch experience. Secondly, the system interface has not changed and is still an interface more suitable for keyboard and mouse operation.

[0048] To this end, some embodiments of the present application propose such a technical solution: first, the main screen can adjust the distance between it and the user without completely blocking the auxiliary screen; second, when the main screen enters different distance states, the display content of the main screen and the auxiliary screen changes to adapt to the interactive experience in different states.

[0049] In some embodiments of the present application, the terminal device has two states. State 1 is a non-contact state, in which the auxiliary display screen is in a horizontal position and is located in the second body, the main display screen is located at an angle of >0°, ≤180° relative to the auxiliary display screen and is located in the first body, and the main display screen (or the first body) is not in contact with the auxiliary display screen (or the second body); State 2 is a contact state, in which the auxiliary display screen is in a horizontal position and is located in the second body, the main display screen is located at an angle of >0°, ≤180° relative to the auxiliary display screen and is located in the first body, and the main display screen (or the first body) is in contact with the auxiliary display screen (or the second body), and the main display screen or the first body after contact does not block the auxiliary display screen or only blocks a part of the auxiliary display screen. When the two states are switched to each other, the display contents of the main display screen and the auxiliary display screen will change at the same time or one of the screens will change. The connection method between the first body and the second body includes but is not limited to wireless, magnetic suction, and mechanical structure.

[0050] Some embodiments of the present application can be applied to terminal devices such as laptops, tablet computers, desktop computers, mobile phones, etc. The main usage scenario is to change the screen content by switching the screen position status during use to enhance the interactive experience.

[0051] The technical problems to be solved by some embodiments of the present application include: 1) There is a lack of keyboard input and the auxiliary screen cannot be used normally after the main screen is zoomed in; 2) After the state and position of the main screen change, the content of the main screen or the auxiliary screen fails to change immediately to adapt to the interactive experience of the current state. To this end, some embodiments of the present application propose a new interaction process and rule logic: after the position of the main screen and the auxiliary screen enters state 2 from state 1 or enters state 1 from state 2, the display content of the main screen or the auxiliary screen is triggered to change at the same time. In this way, the user can also use a more ergonomic posture for keyboard input in the touch interaction state, and can also touch the APP icon more conveniently, reduce the false touch rate, and improve work efficiency, reduce the switching steps between APPs, and efficiently use the auxiliary screen to display more effective content to improve work efficiency.

[0052] Some embodiments of the present application can be applied to other fields that require dual-screen interaction, such as the screen of the center console inside the car and the screen at the driver's armrest changing the screen content by changing the position. Those skilled in the art should know that the same technical purpose can be achieved by adding or changing the trigger conditions, such as adding other components to the trigger conditions that must also be touched at the same time to be effective, such as changing the trigger conditions to manual switching of buttons.

[0053] Figure 1 A schematic diagram of the structure of a computing device 100 according to an embodiment of the present application is shown. Figure 2 Shown to be applied according to Figure 1 A schematic flowchart of an interface display method of a computing device 100 according to an embodiment.

[0054] According to this embodiment, the interface display method is applied to Figure 1 The computing device 100 shown includes a first display screen 110 and a second display screen 120. The first display screen 110 and the second display screen 120 are electrically connected and have a first relative position state and a second relative position state. The first display screen 110 is allowed to be closer to the user in the first relative position state than in the second relative position state.

[0055] In this embodiment, the display screen may refer to a display tool that displays a certain electronic file on the screen through a specific transmission device. For example, the display screen is an I / O device of the terminal product, that is, an output device. In some embodiments, the display screen may refer to the screen of the terminal product, which receives the signal of the terminal product and forms an image.

[0056] In this embodiment, the two display screens are electrically connected, which may mean that the two display screens can be powered on or communicate with each other, so that the two display screens can transfer electrical energy and / or electrical signals to each other. For example, the electrical connection between the two display screens allows one of the display screens to control the display content of the other display screen, or allows a control unit to control the control content of the two display screens at the same time. The electrical connection between the two display screens may be a mechanical plug-in, a wired connection, or a wireless connection.

[0057] In this embodiment, the relative position state may refer to the position state of two display screens relative to each other. In a relative position state, the absolute position or relative position of each of the two display screens makes them suitable for some form of operation by the user. For example, in a relative position state, the two display screens are suitable for being operated by the user in a touch mode, and at this time one or both display screens are closer to the user, which is convenient for the user's fingers to contact the display screen. For another example, in a relative position state, the two display screens are suitable for being operated by the user in a keyboard and mouse mode (i.e., keyboard and mouse mode), and at this time one or both display screens are far away from the user, which is convenient for the user to operate the display content on the display screen placed far away through the keyboard and mouse placed nearby. For another example, in a relative position state, the two display screens are suitable for being operated by the user using a stylus pen, and at this time one or both display screens can be spread out on the desktop in front of the user, so that the user can use a stylus pen to click, write or draw on the screen. Other types of relative position states are also conceivable.

[0058] The first display screen is closer to the user in the first relative position state than in the second relative position state, which may specifically mean that, in the first relative position state, the first display screen may be in front of or near the user and the second display screen may be far away from or behind the first display screen, or the user may move the first display screen in front of or near the user or closer to the second display screen as needed; in the second relative position state, the first display screen may be farther away from the user and the second display screen may be near or in front of the first display screen, or the user may not move the first display screen in front of or near the user or may not move the first display screen closer to the second display screen.

[0059] like Figure 1 As shown on the left, in the first relative position state, the first display screen 110 is far away from the user. At this time, the first display screen may be behind the second display screen 120 or at other positions far away from the user relative to the user, so that the user can fully observe the content on the first display screen 110. For example, the distance between the first display screen 110 and the user is suitable for the user to watch the first display screen 110, but not suitable for the user to touch and manipulate the display content on the first display screen 110 with his hands.

[0060] like Figure 1 As shown on the right, in the second relative position state, the first display screen 110 is closer to the user. At this time, the first display screen 110 may be in front of the second display screen 120 or at other positions closer to the user relative to the user, so that the user can not only see the display content on the first display screen 110 carefully, but also control the content on the first display screen 210 by hand or other control devices (such as a stylus). For example, the distance between the first display screen 110 and the user is suitable for the user to touch the first display screen 110 by hand, but not suitable (or relatively unsuitable) for the user to control or observe the second display screen 120 by hand.

[0061] As an example, Figure 3 The computing device 300 to which the interface display method according to the present embodiment is applied is shown. In the first relative position state, the first display screen 310 and the second display screen 320 are separated from each other. In the second relative position state, the first display screen 310 and the second display screen 320 are rotatably connected.

[0062] Specifically, in the first relative position state, the first display screen 310 can be moved in front of the user to facilitate the user to perform touch operation with fingers. At this time, the first display screen 310 can display the first main interface 311 suitable for touch operation, and the second display screen 320 can display the first auxiliary interface 321. The first auxiliary interface 321 can be displayed or displayed or not displayed according to the user's choice. In the second relative position state, the first display screen 310 can be installed or connected to the top of the second display screen 320 to form the configuration of an ordinary laptop computer. At this time, the first display screen 310 can display the second main interface 312 suitable for keyboard and mouse operation, and the second display screen 320 can display the second auxiliary interface 322 including the keyboard. It should be understood that the top of the second display screen 320 can refer to the side of the display screen that is normally placed on the desktop and is farther away from the user when the user faces the display screen, the bottom of the second display screen 320 can refer to the side of the display screen that is normally placed on the desktop and is closer to the user when the user faces the display screen, and the middle of the second display screen 320 can refer to the middle position between the top and the bottom.

[0063] The first display screen 310 and the second display screen 320 are connected to each other through a connector. The first display screen 310 has a first connector 313, and the second display screen 320 has a second connector 323. The first connector 313 and the second connector 323 can be connected mechanically (e.g., plugged in) or in other ways (e.g., magnetically). Common connection methods in the art can be used to connect the first and second display screens, which will not be described in detail here.

[0064] In the first relative position state, the first body where the first display screen is located and the second body where the second display screen is located are wirelessly connected or not connected, which belongs to the split mode. In the second relative position state, the first body is in contact with the second body, and the contact area is connected by a physical connection. The connection module includes but is not limited to magnetic suction and mechanical structure to form a whole. At this time, in the split mode of the first relative position state, the distance between the main screen and the person can be brought very close, and the auxiliary screen can still be used independently. The connection and trigger area between the bodies in the second relative position state are reused.

[0065] As an example, the first display screen and the second display screen are connected by plugging or magnetic attraction in the second relative position state.

[0066] As an example, Figure 4 The computing device 400 to which the interface display method according to this embodiment is applied is shown. In the first relative position state, the bottom of the first display screen 410 abuts against the middle of the second display screen 420. In the second relative position state, the bottom of the first display screen 410 is rotatably connected to the top of the second display screen 420. It can be understood that Figure 3 and Figure 4 In the figure, the size and position of the screen are only an example, and the first display screen and the second display screen may be larger or smaller in size.

[0067] Specifically, in the first relative position state, the first display screen 410 is pulled closer to a position closer to the user (eyes or head). At this time, the bottom of the first display screen 410 is against the middle position of the second display screen 420, and the first display screen 410 can display a first main interface 411 suitable for touch operation, and the second display screen 420 can display a first auxiliary interface 421, wherein the first auxiliary interface 421 can be displayed, display a keyboard or not display a keyboard according to user needs (or choices). In the second relative position state, the first display screen 410 is placed at a position farther away from the user. At this time, the bottom of the first display screen 410 is connected to the top of the second display screen 420, thereby forming a configuration of an ordinary laptop computer, so that the user at this time is more convenient to operate by keyboard and mouse. In the first relative position state, the back of the first display screen 410 is supported by a support 430 to keep it closer to the user.

[0068] In the first relative position state, the first body where the first display screen 410 is located can be in contact with the second body where the second display screen 420 is located and only partially covers the auxiliary display screen, or can be in contact with the auxiliary display screen and completely behind the auxiliary display screen. In the second relative position state, the first body is behind the second body, and the first body and the second body are connected to form a whole through the support member 430, and the support member can adjust the angle to change the position of the main display screen to enter the first or second relative position state. At this time, after the main screen is pulled closer, the auxiliary screen can still be effectively used, and the main screen can be stably supported for convenient touch interaction.

[0069] According to this embodiment, the interface display method includes steps S210 to S230, and each step is described in detail below.

[0070] S210: Obtain relative position information of the first display screen and the second display screen.

[0071] In this embodiment, the relative position information may refer to information about the relative position or placement of two display screens. The relative position information of the two display screens can be obtained specifically through a connection status sensing device between the two display screens. For example, when the two display screens are connected or disconnected, it means that the two display screens are in different relative positions. For example, when the two display screens are connected to each other at different positions or mechanical structures, it means that the two display screens are in different relative positions. The relative position information of the two display screens can also be obtained through the posture sensors or position sensors of the two display screens. For example, when the distance between the two display screens exceeds a certain threshold, it means that the two display screens are in another relative position. For example, when the two display screens are in another posture or placement angle, it means that the relative position information of the two display screens has changed. Other means of obtaining relative position information are also conceivable.

[0072] S220: When it is determined that the first display screen and the second display screen are in a first relative position state, a first main interface suitable for touch operation is displayed on the first display screen, and a first auxiliary interface is displayed on the second display screen. The first auxiliary interface can display a keyboard according to the user's selection.

[0073] In this embodiment, the main interface may refer to an interface for displaying primary information or the interface that the user most often views or uses. The auxiliary interface may refer to an interface for displaying secondary information or the interface that the user rarely views or uses. For example, the main interface displays a dialog window or graphic information, and the auxiliary interface displays operating controls (buttons, keyboards, touchpads, etc.) for operating the dialog window or graphic information. For another example, the main interface displays a video or movie image that the user is watching, and the auxiliary interface displays auxiliary content such as a play / pause button and a progress bar. Other display configurations of the main interface and the auxiliary interface are also conceivable.

[0074] In this embodiment, the interface suitable for touch operation may refer to an interface that is convenient for users to use fingers or other human organs to manipulate icons, buttons, control bars, etc. of the display interface. For example, the display interface of commercially available smart phones and tablet computers is usually an interface suitable for touch control. Such a display interface usually has a large icon or operation area, which is suitable for users to manipulate by gestures or postures such as clicking, sliding, long pressing, zooming, etc.

[0075] In this embodiment, the first auxiliary interface displays a keyboard according to the user's choice, which specifically means that the first auxiliary interface can display or not display the keyboard according to the user's choice. For example, when the user needs or is used to key input or manual typing on the auxiliary interface of another display screen, the keyboard can be displayed on the first auxiliary interface; when the user does not need or is not used to typing on another display screen, the keyboard can be not displayed on the first auxiliary interface.

[0076] S230: When it is determined that the first display screen and the second display screen are in a second relative position state, a second main interface suitable for keyboard and mouse operation is displayed on the first display screen, and a second auxiliary interface including a keyboard is displayed on the second display screen.

[0077] In this embodiment, the interface suitable for keyboard and mouse operation may refer to an interface that is convenient for users to operate the displayed content using a keyboard, a mouse, or other similar operating devices. For example, the display interface of a commercially available desktop or all-in-one computer is usually an interface suitable for keyboard and mouse operation. Such an interface usually has a large display window and small operating controls or icons, and usually has a cursor. The user can control the movement of the cursor by moving the mouse and operate in combination with the left and right buttons and the scroll wheel of the mouse. Usually, gestures such as long press and swipe are not allowed to be used for operation.

[0078] In this embodiment, the second auxiliary interface including the keyboard may specifically refer to a keyboard displayed on the second auxiliary interface, thereby allowing the user to perform keyboard and mouse operations. For example, when the two display screens are in the second relative position state, the user can only or more conveniently use the keyboard and mouse to control the display content on the first display screen. The second display screen, as a device providing a keyboard, displays the keyboard to the user, so that the user can perform operations through the keyboard on the second display screen in combination with the mouse (or touchpad).

[0079] As an example, Figure 5 Show according to Figure 1 Schematic diagram of the first and second main interfaces of the computing device of the embodiment. Figure 5 As shown, both the first main interface and the second main interface include application icons, and the application icons in the first main interface can be larger than those in the second main interface. By displaying icons with larger areas, it is more convenient for users to click and operate applications by touching with their fingers, increasing the success rate of clicking, so that the first main interface is more suitable for touch operation than the second main interface.

[0080] Specifically, an application icon may refer to an icon used to represent a certain application in a user's desktop interface or other resident interfaces, and the main interface of the application can be entered by clicking (eg, double-clicking) the icon.

[0081] As an example, Figure 6 Show according to Figure 1 Schematic diagram of the first and second main interfaces of the computing device of the embodiment. Figure 6 As shown, both the first main interface and the second main interface include application icons, and the application icons in the first main interface may have a larger sensing area than in the second main interface.

[0082] Specifically, the sensing area (also called touch hotspot) can refer to the application icon and the surrounding area that can respond to the user's click or selection to select or enter a certain application. The sensing area is usually slightly larger than the area of ​​the icon to facilitate user operation or reduce misoperation. Figure 6 In the figure, the sensing area is a circle around the rounded rectangular icon, and its boundary is indicated by a dotted line.

[0083] As an example, Figure 7 Show according to Figure 1 Schematic diagram of a second main interface and a secondary interface of a computing device of an embodiment. Figure 7 As shown, the second main interface includes a cursor for displaying the mouse position, the second auxiliary interface can display a keyboard, and the second auxiliary interface can also include a touchpad for controlling the cursor.

[0084] Specifically, the cursor may refer to an arrow or other icon used to indicate the current selection position. For example, in a window operation interface, the cursor is often used to indicate the currently selected window, the currently selected icon or control, and the current input position. The touchpad may refer to a (rounded) rectangular area used to control the movement and selection of the cursor, and to perform operations by sensing finger gestures (e.g., sliding two fingers up and down instead of turning pages up and down with a scroll wheel).

[0085] Figure 8 Show according to Figure 1 A schematic diagram of another example of the first and second main interfaces of a computing device of an embodiment. Figure 8 As shown, there are 7 application (APP) icons in the first main interface, among which the icons of the 1st to 3rd commonly used APPs can be larger in area for touch operation. The application icons of the second main interface can be smaller in area and of the same size. In addition, an arrow cursor appears on the second main interface to indicate the current position of the mouse, which is convenient for users to operate with keyboard and mouse.

[0086] Fig. 9A , Fig. 9B , Fig. 9C , Fig.9D , Fig.9E , Fig.9F and Figure 9G Show according to Figure 1 Schematic diagram of other examples of the first or second auxiliary interface of the computing device of the embodiment. Fig. 9A , Fig. 9B , Fig. 9C , Fig.9D , Fig.9E , Fig.9F and Figure 9G The display interface is applicable to the first auxiliary interface. Fig. 9C , Fig.9Dand Fig.9E The display interface is suitable for the second auxiliary interface.

[0087] like Fig. 9A As shown, in the first relative position state, according to the user's choice, the first auxiliary interface may not display any content, and the user can complete all operations completely by manipulating the first main interface.

[0088] like Fig. 9B As shown, in the first relative position state, according to the user's choice, the first auxiliary interface may not display the keyboard, but may display other controls, such as a touchpad. At this time, the user can complete the operation by manipulating the first main interface or by manipulating the touchpad of the first auxiliary interface.

[0089] like Fig. 9C As shown, in the first relative position state, according to the user's choice, the first auxiliary interface can display a keyboard, at which point the user can complete the operation of the icons on the first display interface through touch operations, and can complete text input by tapping the keyboard on the first auxiliary interface. In the second relative position state, the second auxiliary interface displays a keyboard, at which point the user can use the keyboard on the second auxiliary interface to input text in the second main interface, and can also use the mouse to move the cursor or complete the selection.

[0090] like Fig.9D As shown, in the first relative position state, according to the user's choice, the first auxiliary interface can display a keyboard and a touchpad. At this time, the user can operate the display content of the first main interface through touch operations, and can also use the keyboard and touchpad (equivalent to a mouse) on the first auxiliary interface to perform keyboard and mouse operations on the display content of the first main interface. In the second relative position state, the second auxiliary interface displays a keyboard and can also display a touchpad. At this time, the user can use the keyboard and touchpad on the second auxiliary interface to perform keyboard and mouse operations.

[0091] like Fig.9E As shown, in the first relative position state, according to the user's choice, the first auxiliary interface can display a keyboard, and can also display application icons (APP icons) and small program icons or windows. At this time, in addition to performing touch operations on the first main interface, the user can also perform touch operations on the icons on the first auxiliary interface, and can still use the keyboard on the first auxiliary interface to input text. In the second relative position state, the second auxiliary interface displays a keyboard, and also displays application icons and small program icons. At this time, the user can use the keyboard on the second auxiliary interface to perform keyboard and mouse operations, and can also perform touch operations on the icons on the second auxiliary interface.

[0092] like Fig.9FAs shown, in the first relative position state, according to the user's choice, the first auxiliary interface may not display the keyboard, but may display application icons, small program icons, background APP icons and touchpad areas. At this time, the user can not only perform touch operations on the first main interface, but also perform touch operations on the first auxiliary interface, and use the touchpad in the first auxiliary interface to perform mouse operations on the cursor on the first main interface.

[0093] like Figure 9G As shown, in the first relative position state, according to the user's choice, the first auxiliary interface may not display the keyboard, but may display application icons, mini-program icons, and background APP icons. At this time, the user can perform touch operations on the first main interface and the first auxiliary interface at the same time.

[0094] In some embodiments, the display contents of the first display screen and the second display screen change after the relative position status is switched, and the changes may occur simultaneously or only one of the screens may change. The changes on the first display screen include but are not limited to: 1) changes in the text of the APP icon and its name, including but not limited to the simultaneous changes of all APPs, or changes in APPs in a set area, or changes in APPs set to high priority; 2) the disappearance or appearance of the mouse icon; 3) the enlargement or reduction of the status bar and the content it contains; 4) changes in the touch hot zone (sensing area). The changes on the second display screen include but are not limited to: 1) no display; 2) the display content includes but is not limited to TOUCHPAD, keyboard, background running APP interface on the main screen, quick APP icons set to be displayed with priority, weather\calendar\schedule and other quick applets, and the display contents can be arbitrarily combined.

[0095] Based on the above Figure 2 The method embodiment described above, the present application embodiment also provides an interface display device 1000, whose structural diagram is as follows Fig.10 The device is used to perform the above Figure 2 The various steps in .

[0096] According to this embodiment, the interface display device 1000 is applied to a computing device 1001, and the computing device 1001 includes a first display screen 1002 and a second display screen 1003. The first display screen 1002 is electrically connected to the second display screen 1003 and has a first relative position state and a second relative position state. The first display screen 1002 is closer to the user in the first relative position state than in the second relative position state.

[0097] According to this embodiment, the interface display device 1000 includes an acquisition module 1010, a touch module 1020, and a keyboard and mouse module 1030. The acquisition module is used to acquire relative position information of the first display screen 1002 and the second display screen 1003. The touch module is used to display a first main interface suitable for touch operation on the first display screen 1002 and a first auxiliary interface on the second display screen 1003 when it is determined that the first display screen 1002 and the second display screen 1003 are in a first relative position state. The keyboard and mouse module is used to display a second main interface suitable for keyboard and mouse operation on the first display screen 1002 and a second auxiliary interface including a keyboard on the second display screen 1003 when it is determined that the first display screen 1002 and the second display screen 1003 are in a second relative position state.

[0098] In one embodiment, both the first main interface and the second main interface include application icons, and the application icons are larger in area in the first main interface than in the second main interface.

[0099] In one embodiment, both the first main interface and the second main interface include application icons, and the application icons have a larger sensing area in the first main interface than in the second main interface.

[0100] In one embodiment, the first display screen 1002 and the second display screen 1003 are separated from each other in the first relative position state, and the first display screen 1002 and the second display screen 1003 are rotatably connected in the second relative position state.

[0101] In one embodiment, the first display screen and the second display screen are connected by plugging or magnetic attraction in the second relative position state.

[0102] In one embodiment, in the first relative position state, the bottom of the first display screen 1002 abuts against the middle of the second display screen 1003 , and in the second relative position state, the bottom of the first display screen 1002 is rotatably connected to the top of the second display screen 1003 .

[0103] In one embodiment, the second main interface includes a cursor for displaying a mouse position, and the second auxiliary interface also includes a touch pad for controlling the cursor.

[0104] It should be noted that Fig.10 The interface display device 1000 provided in the illustrated embodiment only uses the division of the above-mentioned functional modules as an example when executing the method. In practical applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. Figure 2The interface display method embodiments shown belong to the same concept, and their specific implementation processes are detailed in the method embodiments, which will not be repeated here.

[0105] Fig.11 It is a schematic diagram of the hardware structure of a computing device 1100 provided in an embodiment of the present application.

[0106] See also Fig.11 , the computing device 1100 includes a first display screen 1110, a second display screen 1120, a processor 1130, a memory 1140, a communication interface 1150, and a bus 1160. The processor 1130, the memory 1140, and the communication interface 1150 are connected to each other via the bus 1160. The processor 1130, the memory 1140, and the communication interface 1150 may also be connected in other connection modes other than the bus 1160.

[0107] The first display screen 1110 and the second display screen 1120 are electrically connected and have a first relative position state and a second relative position state. The first display screen 1110 is closer to the user in the first relative position state than in the second relative position state.

[0108] The memory 1140 may be various types of storage media, such as random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, optical storage, hard disk, etc. In this embodiment, the memory 1140 stores the code of the graphical user interface 1170 of the application.

[0109] The processor 1130 may be a general-purpose processor, which may be a processor that performs specific steps and / or operations by reading and executing the contents stored in a memory (e.g., the memory 620). For example, the general-purpose processor may be a central processing unit (CPU). The processor 1130 may include at least one circuit to execute Figure 2All or part of the steps of the interface display method provided in the illustrated embodiment. In this embodiment, the processor 1130 is used to execute the code of the graphical user interface stored in the memory 1140 to display the graphical user interface 1170 in the first display screen 1110 and / or the second display screen 1120. The graphical user interface 1170 is configured to: obtain the relative position information of the first display screen 1110 and the second display screen 1120; when it is determined that the first display screen 1110 and the second display screen 1120 are in the first relative position state, display the first main interface suitable for touch operation on the first display screen 1110, and display the first auxiliary interface on the second display screen 1120; when it is determined that the first display screen 1110 and the second display screen 1120 are in the second relative position state, display the second main interface suitable for keyboard and mouse operation on the first display screen 1110, and display the second auxiliary interface including the keyboard on the second display screen 1120.

[0110] Among them, the communication interface 1150 includes input / output (I / O) interfaces, physical interfaces, and logical interfaces for interconnecting devices within the computing device 1100, as well as interfaces for interconnecting the computing device 1100 with other devices (such as other computing devices or user devices). The physical interface can be an Ethernet interface, an optical fiber interface, an ATM interface, etc. The communication interface 1150 can be connected to an external input device and an output device. For example, the input device can be a microphone or a microphone array for capturing voice input signals; it can be a communication network connector for receiving collected input signals from the cloud or other devices; it can also include, for example, a keyboard, a mouse, etc. The output device can output various information to the outside, including determined distance information, direction information, etc. The output device can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, etc. In this embodiment, the output device includes a first display screen 1110 and a second display screen 1120.

[0111] The bus 1160 may be any type of communication bus for interconnecting the processor 1130 , the memory 1140 , and the communication interface 1150 , such as a system bus.

[0112] The above devices may be arranged on independent chips, or at least partially or completely on the same chip. Whether to arrange each device independently on different chips or to integrate them on one or more chips often depends on the needs of product design. The embodiments of the present application do not limit the specific implementation form of the above devices.

[0113] Fig.11 The computing device 1100 shown is merely exemplary. During implementation, the computing device 1100 may also include other components, which are not listed one by one herein.

[0114] An embodiment of the present application may also be a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, causes the processor to execute the steps of the interface display method according to various embodiments of the present application described above in this specification.

[0115] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0116] The concepts, principles and ideas of the present application are described in detail above in conjunction with specific implementation methods (including embodiments and examples). Those skilled in the art should understand that the implementation methods of the present application are more than the several forms given above. After reading the application documents, those skilled in the art can make any possible improvements, replacements and equivalent forms to the steps, methods, devices and components in the above-mentioned implementation methods, and these improvements, replacements and equivalent forms should be deemed to fall within the scope of the present application. The scope of protection of the present application shall be subject only to the claims.

Claims

1. An interface display method, characterized in that: Applied to a computing device, the computing device comprising a first display screen and a second display screen, the first display screen and the second display screen being electrically connected and having a first relative position state and a second relative position state, the first display screen being closer to a user in the first relative position state than in the second relative position state, the method comprising: Acquire relative position information of the first display screen and the second display screen; When it is determined that the first display screen and the second display screen are in the first relative position state, displaying a first main interface suitable for touch operation on the first display screen, and displaying a first auxiliary interface on the second display screen; When it is determined that the first display screen and the second display screen are in the second relative position state, a second main interface suitable for keyboard and mouse operation is displayed on the first display screen, and a second auxiliary interface including a keyboard is displayed on the second display screen.

2. The interface display method according to claim 1, characterized in that: The first main interface and the second main interface both include application icons, and the application icons have a larger area in the first main interface than in the second main interface.

3. The interface display method according to claim 1, characterized in that: The first main interface and the second main interface both include application icons, and the application icons have a larger sensing area in the first main interface than in the second main interface.

4. The interface display method according to claim 1, characterized in that: In the first relative position state, the first display screen and the second display screen are separated from each other, and in the second relative position state, the first display screen and the second display screen are rotatably connected.

5. The interface display method according to claim 4, characterized in that: The first display screen and the second display screen are connected in the second relative position state by plugging or magnetic attraction.

6. The interface display method according to claim 1, characterized in that: In the first relative position state, the bottom of the first display screen abuts against the middle of the second display screen, and in the second relative position state, the bottom of the first display screen is rotatably connected to the top of the second display screen.

7. The interface display method according to claim 1, characterized in that: The second main interface includes a cursor for displaying a mouse position, and the second auxiliary interface also includes a touch pad for controlling the cursor.

8. An interface display device, characterized in that: Applied to a computing device, the computing device comprising a first display screen and a second display screen, the first display screen being electrically connected to the second display screen and having a first relative position state and a second relative position state, the first display screen being closer to a user in the first relative position state than in the second relative position state, the apparatus comprising: An acquisition module, used to acquire relative position information of the first display screen and the second display screen; a touch module, configured to display a first main interface suitable for touch operation on the first display screen and display a first auxiliary interface on the second display screen when it is determined that the first display screen and the second display screen are in the first relative position state; The keyboard and mouse module is used to display a second main interface suitable for keyboard and mouse operation on the first display screen, and display a second auxiliary interface including a keyboard on the second display screen when it is determined that the first display screen and the second display screen are in the second relative position state.

9. A computing device, characterized in that The computing device includes a first display screen, a second display screen, a memory, and a processor. The first display screen and the second display screen are electrically connected and have a first relative position state and a second relative position state. The first display screen is closer to a user in the first relative position state than in the second relative position state. The memory stores a code of a graphical user interface of an application. The processor is used to execute the code of the graphical user interface stored in the memory to display the graphical user interface on the first display screen and / or the second display screen. The graphical user interface is configured to: Acquire relative position information of the first display screen and the second display screen; When it is determined that the first display screen and the second display screen are in the first relative position state, displaying a first main interface suitable for touch operation on the first display screen, and displaying a first auxiliary interface on the second display screen; When it is determined that the first display screen and the second display screen are in the second relative position state, a second main interface suitable for keyboard and mouse operation is displayed on the first display screen, and a second auxiliary interface including a keyboard is displayed on the second display screen.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is used to execute the interface display method according to any one of claims 1 to 7.

Images