Window display method, electronic device, and related apparatus

Abstract

This application provides a window display method, an electronic device, and related apparatus. In this method, the electronic device includes a display screen and a keyboard. The electronic device displays a first interface on the display screen, the first interface including a first window and a second window. The first window is the focus window. When the user's gaze is detected to be on the second window, in response to the user triggering a first shortcut key on the keyboard, the electronic device can switch the focus window of the first interface to the second window. In this method, the user can trigger the electronic device to switch the focus window of the first interface from the first window to the second window by gazing at the second window and operating the first shortcut key on the keyboard. The operation is simple and the focus window switching efficiency is high.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and in particular to a window display method, electronic device, and related apparatus. Background Technology

[0002] Multi-window display refers to displaying multiple windows on a single user interface (UI). These windows can belong to different applications or the same application. Multi-window display allows users to see multiple windows simultaneously, improving user processing efficiency.

[0003] Currently, when a UI displays multiple windows, if a user needs to switch the focus window, the user needs to select it using the mouse or by pressing multiple keys on the keyboard. This is inefficient and affects the user's processing efficiency. Summary of the Invention

[0004] This application provides a window display method, an electronic device, and related apparatus, which can improve the switching efficiency of the focus window and thus improve the user's processing efficiency.

[0005] In a first aspect, embodiments of this application provide a window display method. The executing entity of this method can be an electronic device or a chip within an electronic device. The following description uses an electronic device as an example. The electronic device includes a display screen and a keyboard. In this method, the electronic device can display a first interface on the display screen. The first interface includes a first window and a second window, with the first window being the focus window. When the user's gaze is detected to be on the second window, in response to the user triggering a first shortcut key on the keyboard, the electronic device can switch the focus window of the first interface to the second window.

[0006] In this embodiment, the user can switch the focus window of the first interface from the first window to the second window by looking at the second window and pressing the first shortcut key on the keyboard. The operation is simple and the focus window switching efficiency is high.

[0007] In one possible implementation, the first interface also includes a mouse cursor, and the electronic device can move the mouse cursor to the second window in response to the user triggering a first shortcut key on the keyboard if the user's gaze is detected to be on the second window.

[0008] In this implementation, when the electronic device switches the focus window of the first interface from the first window to the second window, the electronic device can also move the mouse cursor to the second window, making it convenient for the user to operate the second window without the user having to perform the operation of moving the mouse cursor separately.

[0009] In one possible implementation, the first window and the second window do not overlap. For example, the first interface is a split-screen interface, and the first window and the second window are displayed in a tiled manner on the first interface.

[0010] The window display method provided in this application can be applied to split-screen interface scenarios, multi-task view interfaces, and other interfaces that "contain multiple windows", thus having a wide range of applications.

[0011] In one possible implementation, the first interface further includes a third window that obscures the first window and / or a second window. The third window can be a non-member window of the split-screen interface, while the first and second windows can be member windows of the split-screen interface. In this implementation, upon detecting that the user's gaze is on the second window, in response to the user triggering a first shortcut key on the keyboard, the electronic device can further place the third window below the hierarchy of the first and second windows, and switch the focus window of the first interface to the second window.

[0012] In this implementation, in a scenario where the first interface is a split-screen interface, if a non-member window obscures a member window, in response to the user's gaze point and the user's operation of triggering the first shortcut key, the electronic device can first place the non-member window below all member windows, so that the non-member window does not obscure the member window. This ensures that the electronic device accurately determines the user's gaze point and accurately realizes the switching of the focus window in the split-screen interface.

[0013] In one possible implementation, before the electronic device switches the focus window of the first interface to the second window, it can also detect that the focus of the first interface is not in the second window. If the focus of the first interface is not in the second window, and the user's gaze is detected to be in the second window, the electronic device can switch the focus window of the first interface to the second window in response to the user triggering a first shortcut key on the keyboard.

[0014] In one possible implementation, the first interface further includes a fourth window. The fourth window, the first window, and the second window are displayed in a tiled manner on the first interface. In this implementation, the fourth window, the first window, and the second window are member windows of the split-screen interface. Additionally, the fourth window is the previous focused window of the first interface.

[0015] In this implementation, when the user's gaze is detected to be on the dividing line between windows, the electronic device can switch the focused window of the first interface to the fourth window in response to the user triggering a first shortcut key on the keyboard. Additionally, the electronic device can also move the mouse cursor to the fourth window.

[0016] In this implementation, users can look at (or gaze at) the dividing line between member windows in the split-screen interface and trigger the first shortcut key to quickly switch the electronic device to the previous focus window, resulting in high switching efficiency.

[0017] In one possible implementation, in response to detecting that the user's gaze is switching between windows, the electronic device can determine that the user's gaze is on the boundary line between the windows.

[0018] In one possible implementation, the user triggers the first shortcut key on the keyboard by briefly pressing the first shortcut key.

[0019] In this implementation, in response to the user long-pressing the first shortcut key, the electronic device can display a second interface on the screen, which is a multi-tasking view interface.

[0020] In this implementation, different user actions on the first shortcut key on the keyboard can be used to distinguish the different functions triggered by the electronic device. Specifically, a short press of the first shortcut key triggers the electronic device to switch the focus window in the split-screen interface, while a long press triggers the electronic device to display a multi-tasking view interface. This operation is simple and user-friendly.

[0021] In a second aspect, embodiments of this application provide an electronic device, including a processor and a memory, wherein the memory is used to store code instructions and the processor is used to execute the code instructions to perform the methods described in the first aspect or any possible implementation thereof.

[0022] Thirdly, embodiments of this application provide a computer-readable storage medium storing a computer program or instructions that, when executed on a computer, cause the computer to perform the methods described in the first aspect or any possible implementation thereof.

[0023] Fourthly, embodiments of this application provide a computer program product including a computer program, which, when run on a computer, causes the computer to perform the methods described in the first aspect or any possible implementation of the first aspect.

[0024] Fifthly, this application provides a chip or chip system including at least one processor and a communication interface. The communication interface and the at least one processor are interconnected via a circuit. The at least one processor is used to run computer programs or instructions to perform the methods described in the first aspect or any possible implementation thereof. The communication interface in the chip can be an input / output interface, pins, or circuits, etc.

[0025] In one possible implementation, the chip or chip system described above in this application further includes at least one memory storing instructions. The memory can be an internal storage unit of the chip, such as a register or cache, or it can be a storage unit of the chip itself (e.g., read-only memory, random access memory, etc.).

[0026] It should be understood that the second to fifth aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0027] Figure 1A This is a schematic diagram of a window that switches focus.

[0028] Figure 1B This is a diagram illustrating another type of focus-switching window;

[0029] Figure 2A This is a diagram illustrating another type of focus-switching window;

[0030] Figure 2B This is a diagram illustrating another type of focus-switching window;

[0031] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0032] Figure 4 A flowchart illustrating one embodiment of the window display method provided in this application;

[0033] Figure 5A A schematic diagram of a focus switching window provided in an embodiment of this application;

[0034] Figure 5B Another schematic diagram of the focus switching window provided in the embodiments of this application;

[0035] Figure 5C Another schematic diagram of the focus switching window provided in the embodiments of this application;

[0036] Figure 6 A flowchart illustrating another embodiment of the window display method provided in this application;

[0037] Figure 7 Another schematic diagram of the focus switching window provided in the embodiments of this application;

[0038] Figure 8A Another schematic diagram of the focus switching window provided in the embodiments of this application;

[0039] Figure 8BAnother schematic diagram of the focus switching window provided in the embodiments of this application;

[0040] Figure 9 Another schematic diagram of the focus switching window provided in the embodiments of this application;

[0041] Figure 10 A flowchart illustrating another embodiment of the window display method provided in this application;

[0042] Figure 11 This is another structural schematic diagram of the electronic device provided in the embodiments of this application. Detailed Implementation

[0043] To facilitate understanding, the relevant terms and concepts involved in the embodiments of this application will be introduced below:

[0044] 1. User Interface (UI):

[0045] In this application, the term "user interface" or "interface" refers to the medium through which an application (APP) or operating system interacts and exchanges information with a user. It facilitates the conversion between the internal form of information and a form acceptable to the user. A user interface is source code written in a specific computer language such as Java or Extensible Markup Language (XML). This source code is parsed and rendered on an electronic device, ultimately presenting content that the user can recognize. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be visible interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of an electronic device.

[0046] 2. Windows: Windows are one of the primary ways for users to interact with electronic devices. Windows can contain various elements, such as title bars, menu bars, toolbars, and workspaces. Each window is an independent operating area, and users can individually control the size, position, and content displayed in each window.

[0047] In some embodiments, each window can run different applications or tasks, thereby enabling multitasking.

[0048] 3. Focused window: This is a window state. The focused window refers to the window that currently has input. Usually, only one window can be in the focus state and receive user input.

[0049] In this embodiment of the application, an interface may include at least two windows to switch the focus window, as described in the following embodiments.

[0050] In some embodiments, the focus state may also be referred to as the focusing state.

[0051] 4. Focus Attention Activity: This refers to the focus attention activity of windows on the interface. Focus attention activity refers to the degree to which a window receives user attention, participation, and interaction within a specific time period; it can also be understood as the degree to which a window gains focus within a specific time period.

[0052] 5. Shortcut key: In this embodiment of the application, it refers to a shortcut key on the keyboard. A shortcut key may include at least one key on the keyboard.

[0053] 6. Eye movement detection: This can be used to detect the movement of a user's eyeballs, such as identifying the trajectory of eye movement and the direction of gaze. In the embodiments of this application, eye movement detection is used to detect the user's gaze point.

[0054] 7. Gaze Point: Used to indicate the target the user's eyes are looking at. In a general context, the target can be other users, objects, buildings, animals, etc. In this embodiment, it is applied to an interface scenario, where the gaze point indicates the position of the user's eyes on the interface. For example, the gaze point can be a window in the interface, or the dividing line between windows, etc.

[0055] 8. Electronic equipment:

[0056] The electronic device in this application embodiment can be a device including a display screen and a keyboard. In some embodiments, the electronic device can be referred to as user equipment (UE), terminal, etc. For example, the electronic device can be a desktop computer, personal computer (PC), tablet computer with keyboard, computing device, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal in industrial control, wireless terminal in smart home, etc. The form of the electronic device is not specifically limited in this application embodiment.

[0057] It should be understood that the following embodiments use a PC as an example for illustration.

[0058] The windowing method provided in this application is applicable to scenarios where multiple windows are displayed on an interface. The following examples illustrate the applicable scenarios for this application:

[0059] Scenario 1: Multi-task view interface

[0060] In some embodiments, users can use keyboard shortcuts to trigger the PC to display a multitasking view interface. This multitasking view interface may include at least one window. To facilitate the explanation of the current method for switching the focus window in the multitasking view interface, the following example uses a multitasking view interface with multiple windows.

[0061] In some embodiments, PCs configured with different operating systems use different shortcut keys to trigger the display of the multitasking view interface. Figure 1A Taking a PC with a Mac operating system as an example, Figure 1B Taking a PC with a Windows operating system as an example.

[0062] Taking the macOS operating system as an example, pressing the keyboard shortcut "Ctrl+↑" will trigger the PC to display a multitasking view. This multitasking view can include windows for multiple applications, with each application having at least one window. For example, refer to... Figure 1A In the context of the multitasking view interface 101, window 1, window 2, window 3, and window 4 are included. Window 1 is the window of application 1, window 2 is the window of application 2, and windows 3 and 4 are both windows of application 3. In the multitasking view interface 101, windows of different applications can be arranged according to the order in which the applications are opened, and windows of the same application can be stacked. For example, refer to... Figure 1A In the case of 'a', the windows of application 1, application 2, and application 3 do not overlap. For the window of application 3, window 4 is below window 3. Window 3 and window 4 partially overlap, and window 3 obscures part of the area of ​​window 4.

[0063] In this example, assuming the focused window is window 1, if the user needs to switch the focused window, they can use the keyboard shortcut "Command+Tab" to switch the focused window between different application windows in the order they were opened. Alternatively, the user can use the keyboard shortcut "Command+~" to switch the focused window between different windows of the same application. It should be understood that... Figure 1A The numbers 'a' and 'b' in the diagram illustrate how the user uses the keyboard shortcut "Command+Tab" to switch the focus window from window 1 to window 2.

[0064] In this example, assuming the focus window is window 1, if the user needs to switch the focus window, the user can also move the mouse and click the corresponding window to switch the focus window.

[0065] Taking the Windows operating system as an example, users can use the keyboard shortcut "Alt+Tab" to trigger the PC to display a multitasking view. This multitasking view can include windows for multiple applications, with each application corresponding to one window. For example, refer to... Figure 1B In the context of application 1, the multitasking view interface 102 includes window 1, window 2, and window 3. Window 1 is the window for application 1, window 2 is the window for application 2, and window 3 is the window for application 3. In the multitasking view interface 102, windows can be arranged according to their engagement level. For example, refer to... Figure 1B In the multitasking view interface 102, window 1, window 2, and window 3 can be arranged from left to right in the following order: window 1, window 2, and window 3. Among them, the focus activity of window 1 is greater than that of window 2, and the focus activity of window 2 is greater than that of window 3.

[0066] In this example, assuming the focused window is window 1, if the user needs to switch the focused window, they can use the keyboard shortcut "Tab" to switch between the different windows sequentially from left to right. It should be understood that... Figure 1B The numbers 'a' and 'b' in the text illustrate the process of switching the focus window from window 1 to window 2 by using the keyboard shortcut "Tab".

[0067] In this example, assuming the focus window is window 1, if the user needs to switch the focus window, the user can also move the mouse and click the corresponding window to switch the focus window.

[0068] Scenario 2: Split-screen interface

[0069] In some embodiments, a user can drag any window on the interface to a preset position on the interface to trigger the PC to display a split-screen interface. The split-screen interface may include at least one window; for ease of explanation of the current method for switching the focus window in a split-screen interface, the following example uses a split-screen interface with multiple windows. In some embodiments, the preset position of the interface may be the top, upper left corner, or upper right corner, etc., and this application embodiment does not impose any limitations on this. Figure 2A Taking the top left corner of the interface as an example, Figure 2B Taking the top of the interface as a preset position as an example.

[0070] Reference Figure 2A In the diagram, 'a' refers to the PC display interface 201, which can be the PC desktop or the interface of any application. Taking the desktop as an example, window 1 is displayed on the interface 201, and this window 1 is the window of application 1. In addition, the bottom of the interface 201 also displays the icons of minimized windows, such as window 2 and window 3. For example, window 2 can be the window of application 2, and window 3 can be the window of application 3. Figure 2A In the diagram, 2 represents the minimized window 2, and 3 represents the minimized window 3. (See reference...) Figure 2A In step b, the user can drag window 1 to the top left corner of the interface and release the mouse. The PC can then display split-screen interface 202 on interface 201. (See reference...) Figure 2A In the split-screen interface 202, c represents window 1, window 2, and window 3. Window 1, window 2, and window 3 do not overlap, and window 1 is located in the left area of ​​the split-screen interface 202, while window 2 and window 3 are arranged in the right area of ​​the split-screen interface 202. Window 1, window 2, and window 3 are displayed in a tiled manner in the split-screen interface 202.

[0071] Reference Figure 2A In the split-screen interface 202, the focus window is window 1. For example, window 1 is the window for a spreadsheet application, and window 2 is the window for a document application. If the user wants to edit the document, the user needs to switch the focus window from window 1 to window 2. On one hand, the user can use keyboard shortcuts to trigger the PC to display the multitasking view interface, and the user can switch the focus window in the manner described in Scenario 1 above (such as using the keyboard or mouse).

[0072] In one possible scenario, taking split-screen interface 202 as an example, if the user is typing on the keyboard and there are multiple member windows in split-screen interface 202 (such as window 1, window 2, and window 3), and the user needs to switch the focus window from one member window to another, the user can use a keyboard shortcut (such as Alt+Tab) to trigger the PC to display a multitasking view interface. In the multitasking view interface, the user can use the keyboard keys (such as Tab) to view thumbnails one by one to determine the focus window. During this process, if the member window to be switched has low focus activity, the user needs to press the shortcut key multiple times to select the member window, and cannot directly select it in the split-screen interface. Furthermore, if the member window to be switched is accidentally missed during the switching process, a more complex shortcut key (such as Alt+Shift+Tab) is needed to select it again, or the shortcut key needs to be pressed multiple times again to select it, making the operation complicated. In addition, during the process of selecting the member window to be switched in the multitasking view interface, the user may also select the wrong window, causing a non-member window to gain focus, which may cause the non-member window to obscure the member window. In addition, if a user switches windows using the mouse, the user needs to take one hand off the keyboard. Using the mouse involves finding the mouse cursor, adapting to the mouse movement speed, and moving the mouse to select. After selecting, the user's hand needs to return to the keyboard to continue typing. If the user needs to switch the focus window multiple times, the processing efficiency will be very low.

[0073] Alternatively, users can use the mouse to click on windows in the split-screen interface 202 to switch the focus window. For example, if a user clicks on window 2, the focus window can be switched from window 1 to window 2. However, window 2 will become larger and occupy the entire right side area of ​​the split-screen interface 202. If the user needs to switch the focus window to window 3, other operations are required, making the process complex.

[0074] Reference Figure 2B In the diagram, 'a' indicates the PC display interface 201, which shows window 1. Additionally, the bottom of interface 201 displays indicators for minimized windows, such as window 2 and window 3. (See reference...) Figure 2B In step b, the user can use the mouse to drag window 1 to a preset area at the top of the interface. At this time, the PC can display identifier 21, which indicates that window 1 has reached the preset area at the top of the interface. When the user releases the mouse, the PC can display the split-screen template frame 22 in the top area. (See reference...) Figure 2B In section c, the split-screen template frame 22 can include multiple split-screen templates. These templates indicate the window arrangement within the split-screen interface. (See reference...) Figure 2B In the 'c' section, windows in the split-screen template can be arranged in a grid pattern, a cross pattern, or a square pattern.

[0075] For example, when a user clicks on split-screen template 1 with the mouse, the PC can trigger the display of split-screen interface 203. (See reference...) Figure 2B In the split-screen interface 203, window 1, window 2, and window 3 are arranged in a "grid" pattern according to the split-screen template 1. Window 1, window 2, and window 3 do not overlap each other, and they are displayed in a tiled manner in the split-screen interface 203.

[0076] In some embodiments, after a user clicks on split-screen template 1 with the mouse, the PC can also provide a window selection interface. This interface instructs the user to select a window to display in split-screen interface 203. Windows displayed in split-screen interface 203 can be called member windows, and windows not displayed in split-screen interface 203 can be called non-member windows. (See reference...) Figure 2B In the context of 'd', windows 1, 2, and 3 can be referred to as member windows.

[0077] For example, after a user clicks on split-screen template 1 with the mouse, the PC displays a window selection interface. The user selects window 1 and window 2, but not window 3. The split-screen interface displayed on the PC will include windows 1 and 2 displayed in a tiled format, but will not include window 3. In this example, windows 1 and 2 can be referred to as member windows, and window 3 can be referred to as a non-member window.

[0078] exist Figure 2B In the example shown, in the split-screen interface 203, if the user needs to switch the focus window, they can use... Figure 2A Switching via the method described in the text can also present the problem of complex operation.

[0079] It is understood that the above scenarios 1 and 2 are examples of scenarios applicable to the embodiments of this application. The window display method provided by the embodiments of this application can also be applied to other scenarios where "multiple windows are displayed on one interface". The embodiments of this application do not exhaustively list the scenarios.

[0080] In summary, in scenarios where multiple windows are displayed on a single interface, switching between the focused window is complex and inefficient for users. Therefore, in such scenarios, quickly switching between the focused window is a key issue for improving user processing efficiency.

[0081] To address the above issues, this application provides a window display method. In scenarios where multiple windows are displayed on an interface, a user can trigger an electronic device to switch the focus window by looking at the window and pressing a keyboard shortcut once. Correspondingly, the electronic device can determine the user's gaze point based on eye-tracking detection results. Once the user's gaze point is determined, the user can simply press a keyboard shortcut once to trigger the switching of the focus window on the interface. In this application embodiment, when a user needs to switch the focus window, the user only needs to look at the window and press a keyboard shortcut once. This simple operation improves the efficiency of focus window switching, thereby improving the user's processing efficiency.

[0082] Before introducing the window display method provided in the embodiments of this application, the structure of the electronic device provided in the embodiments of this application will be introduced first:

[0083] Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 3 Taking the PC as an example, refer to Figure 3 The electronic device may include: a display screen 31, a keyboard 32, and a camera 33.

[0084] Display screen 31 is used to display the interface of an electronic device.

[0085] The keyboard 32 can be considered as an input device for an electronic device. The keyboard 32 includes multiple keys, and the user can operate at least one key to trigger a shortcut key.

[0086] In some embodiments, the keyboard 32 may include a touch area 321. In this example, the user can also input data via the touch area 321; for instance, the user can control the mouse cursor on the display screen 31 by operating the touch area 321.

[0087] In some embodiments, the display screen 31 and the keyboard 32 can be integrated as a single unit, such as... Figure 3 The structure of the electronic device shown. In some embodiments, the display screen 31 and the keyboard 32 can be set independently, such as by means of wired connection or wireless connection.

[0088] Camera 33 is used to capture an image of the user's face, including the user's eyes. The electronic device can then determine the user's gaze point based on this facial image.

[0089] In some embodiments, the camera 33 may be integrated into an electronic device, such as... Figure 3 As shown, the camera 33 can be positioned above the display screen of the electronic device. In some embodiments, the camera 33 can also be set independently of the electronic device, and the camera 33 and the electronic device can be connected via wired or wireless connections so that the electronic device can acquire facial images captured by the camera.

[0090] In some embodiments, an electronic device can determine the user's gaze point based on a facial image using a keypoint localization method. For example, the electronic device can estimate the gaze point by locating key facial features (such as eyes, nose tip, corners of the mouth, etc.) and further analyzing the direction of the eyes and the position of the pupils. In this example, deep learning techniques, particularly convolutional neural networks, are widely used in facial keypoint localization. Deep learning techniques automatically learn the positional distribution patterns of key facial features by training on a large number of facial images annotated with key facial features. The electronic device can then use deep learning techniques to locate these key facial features to obtain the user's gaze point.

[0091] In some embodiments, the electronic device can determine the user's gaze point based on machine learning methods. For example, a large number of face images labeled with gaze points can be used as training data to train a model for recognizing the user's gaze point. The electronic device can input the face image captured by the camera 33 into the model to obtain the user's gaze point.

[0092] It should be understood that the method by which an electronic device determines a user's gaze point based on a user's facial image is not limited in the embodiments of this application.

[0093] In some embodiments, refer to Figure 3Electronic devices may also include: a mouse 34.

[0094] The mouse 34 can be considered an input device for electronic devices. By operating the mouse 34, the user can manipulate the mouse cursor displayed on the screen 31. Additionally, the user can also click, drag, and perform other operations on windows by operating the mouse 34.

[0095] In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0096] The window display method provided in this application will be described below with reference to specific embodiments. These embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0097] Figure 4 This is a schematic flowchart of one embodiment of the window display method provided in this application. (Refer to...) Figure 4 The window display method provided in this application embodiment may include:

[0098] S401 displays a first interface on the display screen. The first interface includes a first window and a second window, with the first window being the focus window.

[0099] The first interface is an interface containing multiple windows. In this embodiment, the first interface includes a first window and a second window as an example. In some embodiments, for example, the first interface can be a split-screen interface, which can be referred to as... Figure 2A and Figure 2B The description in [the document] is provided. In some embodiments, for example, the first interface can be a multitasking view interface, which can be referred to [the document]. Figure 1A and Figure 1B As described in the text. In some embodiments, the first interface can also be a user-customizable interface, such as the user arranging the first window and the second window in the first interface using the mouse.

[0100] This application does not limit the triggering method for the electronic device to display the first interface. In order to facilitate the explanation of the window display method provided in this application, the first window in the first interface can be taken as the focus window.

[0101] In some embodiments, the first window and the second window may overlap. For example, the first window may obscure a portion of the second window. For instance, when a user arranges the first and second windows in a first interface using a mouse, the first and second windows may overlap.

[0102] In some embodiments, the first window and the second window do not overlap. For example, when the first interface is a split-screen interface or a multi-tasking view interface, the first window and the second window do not overlap; that is, the first window may not obscure the second window, and the second window may not obscure the first window. Specifically, when the first interface is a split-screen interface, the first window and the second window are displayed in a tiled manner on the first interface, as can be seen from... Figure 2A and Figure 2B As described in the text. For example, when a user arranges a first window and a second window in a first interface using the mouse, the first window and the second window may not overlap.

[0103] S402, when the user's gaze is detected to be on the second window, in response to the user triggering the first shortcut key on the keyboard, the focus window of the first interface is switched to the second window.

[0104] In some embodiments, the camera of the electronic device is always on, so that the camera can capture images of the user's face, and the electronic device can determine the user's gaze point based on the facial images.

[0105] In some embodiments, to reduce power consumption caused by keeping the camera constantly on, the electronic device can turn on the camera when it detects multiple windows displayed on the first interface, so that the camera can begin capturing the user's facial image. For example, when the first interface is a split-screen interface, the electronic device can turn on the camera in response to displaying the split-screen interface. In this example, because the user can trigger the electronic device to display the split-screen interface through a specific operation (see [reference]... Figure 2A and Figure 2B (as described in the text), therefore, in response to a specific action performed by the user, the electronic device can determine whether to display a split-screen interface or to turn on the camera.

[0106] In this embodiment, the electronic device can determine the user's gaze point. When the user's gaze point is detected to be within the second window, the user can trigger the electronic device to switch the focus window of the first interface from the first window to the second window by operating a first shortcut key on the keyboard. Here, "the user's gaze point is within the second window" can be understood as: the user's gaze point is contained within the second window.

[0107] In some embodiments, the first shortcut key may be different from the shortcut keys already present on the electronic device, so as to facilitate the differentiation of different shortcut keys.

[0108] In some embodiments, the first shortcut key may be the same as existing shortcut keys on the electronic device, but the way the user operates the first shortcut key is different, thus distinguishing it from existing shortcut keys. For example, a user long-presses the "Alt+Tab" shortcut key on the keyboard to trigger the electronic device to display a multitasking view interface; the first shortcut key can be "Alt+Tab." However, in this embodiment, the user can short-press "Alt+Tab" to trigger the electronic device to switch the focus window in the first interface. In this example, the user triggering the first shortcut key on the keyboard can specifically be a short-press of "Alt+Tab." This embodiment does not limit the specific operation by which the user triggers the first shortcut key on the keyboard. For example, the user can also trigger the first shortcut key by double-clicking "Alt+Tab," as long as the operation method is different from that of existing shortcut keys on the electronic device.

[0109] Figure 5A This is a schematic diagram of a focus switching window provided in an embodiment of this application. Figure 5A Taking the first screen as an example of a split-screen interface, refer to... Figure 5A In the example 'a', the PC displays a split-screen interface 501. The split-screen interface 501 can include windows 1A, 2A, 3A, and 4A. Window 1A, 2A, 3A, and 4A belong to different applications, and they are displayed in a tiled format within the split-screen interface 501. Figure 5A In the example of window 1A, window 2A, window 3A, and window 4A arranged in a "grid" shape, take window 1A, window 2A, window 3A, and window 4A as an example.

[0110] Reference Figure 5A In the split-screen interface 501, the focus window is window 1A. The display mode of the focus window differs from that of the non-focus windows. For example, the split-screen interface 501 can highlight the focus window, such as by making the window color of window 1A brighter than that of the non-focus windows, or by making the edge lines of window 1A thicker than those of the non-focus windows. It should be understood that in order to highlight the focus window, Figure 5A In this example, the focused window is black, and the non-focused window is white. (See reference...) Figure 5A In step b, if the user looks at window 2A and briefly presses "Alt+Tab" on the keyboard, the PC can detect that the user's gaze is in window 2A and that the user has pressed "Alt+Tab". The PC can then switch the focus window from window 1A to window 2A. Figure 5A As shown in c in the figure.

[0111] In this example, refer to Figure 5AIn the context of "a", when the PC is displaying split-screen interface 501, if the user presses and holds "Alt+Tab", the PC can display a second interface 502 on the screen. The second interface 502 is a multi-tasking view interface, such as... Figure 5A As shown in d.

[0112] As mentioned above Figure 5A In the example shown, window 1A can be considered as the first window, and window 2A can be considered as the second window.

[0113] in addition, Figure 5A The text also demonstrates changes in the focus activity of windows on the interface. For example, see [link to example]. Figure 5A In the context of 'a', when the focused window is window 1A, assume the focus activity of the windows is ordered in the following order: window 1A, window 2A, window 3A, window 4A. (Refer to...) Figure 5A In the case of c, when the focus window switches from window 1A to window 2A, window 2A gains focus while window 1A loses focus. Window 2A can be ranked before window 1A, meaning that the focus activity of window 2A is higher than that of window 1A.

[0114] Figure 5B This is another schematic diagram of the focus switching window provided in the embodiments of this application. Figure 5B Taking the first interface as an example of a multitasking view, for instance, a user can long-press "Alt+Tab" on the keyboard to trigger the PC to display the multitasking view interface 501A. (Refer to...) Figure 5B In the context of "a", the PC displays a multitasking view interface 501A, which may include window 1A, window 2A, window 3A, and window 4A. When the user releases the "Tab" key, if window 1A is the focused window in the multitasking view interface 501A, Figure 5B The example shown is highlighting the focus window by displaying a bounding box (51) around it. (Refer to...) Figure 5B In the context of 'a', the focused window of the multi-task view interface 501A is window 1A, which is surrounded by a bounding box 51. (See reference...) Figure 5B In step b, if the user looks at window 4A and briefly presses "Alt+Tab" on the keyboard, the PC can switch the focus window from window 1A to window 4A, as shown. Figure 5B As shown in c in the figure.

[0115] As mentioned above Figure 5B In the example shown, window 1A can be considered as the first window, and window 4A can be considered as the second window.

[0116] Figure 5C This is another schematic diagram of the focus switching window provided in the embodiments of this application. Figure 5C Taking the first interface as an example of a user-defined interface, refer to... Figure 5CIn the diagram 'a', the PC displays a first interface 503, which may include window 1B and window 2B. Window 1B and window 2B can be arranged randomly within the first interface 503, and they may overlap or not. Figure 5C In section 'a', we take the example of windows 1B and 2B not overlapping. (Refer to...) Figure 5C In step b, if the user looks at window 2B and briefly presses "Alt+Tab" on the keyboard, the PC can switch the focus window from window 1A to window 2A, as shown below. Figure 5C As shown in c in the figure.

[0117] As mentioned above Figure 5C In the example shown, window 1B can be considered as the first window, and window 2B can be considered as the second window.

[0118] In this embodiment of the application, in a scenario where the first interface includes multiple windows, such as a first window and a second window, the user can switch the focus window of the first interface from the first window to the second window by looking at the second window and operating the first shortcut key on the keyboard. The operation is simple and the switching efficiency of the focus window is high.

[0119] In some embodiments, the first interface also includes a mouse cursor. When the electronic device switches the focus window of the first interface from the first window to the second window, if the user wants to use the mouse to operate the second window, but the mouse cursor is still in the previous focus window (such as the first window), the user still needs to try to operate the mouse to find the mouse cursor and perform the operation of moving the mouse to move the mouse cursor to the second window, wasting the user's time. Accordingly, in the window display method provided in this application embodiment, when the electronic device switches the focus window of the first interface from the first window to the second window, the electronic device can also move the mouse cursor to the second window, which makes it convenient for the user to directly use the mouse to operate the second window.

[0120] Figure 6 This is a flowchart illustrating another embodiment of the window display method provided in this application. (Refer to...) Figure 6 The window display method provided in this application embodiment may include:

[0121] S601 displays a first interface on the display screen. The first interface includes a first window and a second window, with the first window being the focus window.

[0122] S602, when it is detected that the user's gaze is on the second window, in response to the user triggering the first shortcut key on the keyboard, the focus window of the first interface is switched to the second window.

[0123] S601-S602 can be referred to in the descriptions in S401-S402.

[0124] S603, move the mouse cursor to the second window.

[0125] In some embodiments, the steps in S603 can be performed when the electronic device detects that the user's gaze is on the second window and in response to the user triggering a first shortcut key on the keyboard. In other words, S602 can be replaced by S602A: when the user's gaze is detected to be on the second window, in response to the user triggering a first shortcut key on the keyboard, the focus window of the first interface is switched to the second window, and the mouse cursor is moved to the second window.

[0126] In some embodiments, the steps in S603 may also be performed after S602. This application does not limit the order in which the electronic device "switches the focus window of the first interface to the second window" and "moves the mouse cursor to the second window".

[0127] Reference Figure 5A In the split-screen interface 501, the focused window is window 1A, and the mouse cursor 52 is located within window 1A. (See reference...) Figure 5A In the context of bc, when the PC switches the focus window from window 1A to window 2A, the PC can move the mouse cursor 52 to window 2A.

[0128] It is understandable that the mouse cursor may not be displayed on the multitasking view interface 501A, so the focus window switching of the multitasking view interface 501A does not involve the movement of the mouse cursor.

[0129] Reference Figure 5C In the first interface 503, the focused window is window 1B, and the mouse cursor 52 is located within window 1B. (See reference...) Figure 5C In the context of bc, when the PC switches the focus window from window 1B to window 2B, the PC can move the mouse cursor 52 to window 2B.

[0130] Figure 5A and Figure 5C The instantaneous change in the position of the mouse cursor 52 represents the movement process of the mouse cursor 52 by the electronic device. Among them, Figure 5A and Figure 5C Taking the instantaneous movement of the mouse cursor 52 as an example, the position of the mouse cursor 52 may suddenly change from a position in the first window to a position in the second window. In some embodiments, when the electronic device moves the mouse cursor, the electronic device may also display a mouse cursor movement animation, which is not limited in this embodiment.

[0131] In this embodiment, the user can switch the focus window of the first interface from the first window to the second window by looking at the second window and pressing a first shortcut key on the keyboard. The operation is simple and the switching efficiency is high. In addition, the electronic device can also move the mouse cursor to the second window, making it convenient for the user to operate the second window without requiring the user to manually move the mouse cursor.

[0132] In scenarios where the first interface is a split-screen interface, if non-member windows are also displayed on the first interface, and these non-member windows obscure member windows, the electronic device may be unable to determine whether the user's gaze is on a non-member window or a member window, thus affecting the switching of the focus window between member windows. In this embodiment, when determining the focus window for switching the split-screen interface, the electronic device can first place the non-member windows below all member windows, ensuring that the non-member windows do not obscure member windows. This guarantees that the electronic device accurately determines the user's gaze point, thereby enabling the switching of the focus window.

[0133] In some embodiments, if the split-screen interface includes a first window and a second window, and further includes a third window, this third window is a non-member window. In this embodiment, the third window obscures the first window and / or the second window. In this example, to enable switching of the focus window between member windows in the split-screen interface, the electronic device can place the third window below the layers of the first and second windows. This ensures that the non-member window does not obscure the member windows; that is, the third window does not obscure the first or second window. In this scenario, the user can trigger the switching of the focus window in the split-screen interface by focusing on the second window and pressing a first shortcut key on the keyboard.

[0134] Figure 7 This is another schematic diagram of a focus-switching window provided in an embodiment of this application. (Refer to...) Figure 7 In the diagram, 'a' refers to the PC display split-screen interface 701, which may include window 1A, window 2A, window 3A, and window 4A. The arrangement of window 1A, window 2A, window 3A, and window 4A can be referenced. Figure 5A The description of 'a' in the text. Window 1A, Window 2A, Window 3A, and Window 4A are member windows of the split-screen interface 701. For example, refer to... Figure 2B According to the relevant description, users can select windows 1A, 2A, 3A, and 4A as member windows in the split-screen interface 701. (Refer to...) Figure 7 In the case of 'a', the focus window of the split-screen interface 701 is window 1A, and the mouse cursor 71 is in window 1A.

[0135] Reference Figure 7In the example, window 5A is also displayed on the split-screen interface 701. Window 5A is a non-member window of the split-screen interface 701. For example, the user opens windows 1A, 2A, 3A, 4A, and 5A, and selects windows 1A, 2A, 3A, and 4A as member windows of the split-screen interface 701, but does not select window 5A. Figure 7 In the example 'a', window 5A obscures windows 2A, 3A, and 4A. In this example, window 1A can be considered the first window, window 2A the second window, windows 3A and 4A the member windows of the split-screen interface, and window 5A the third window.

[0136] Reference Figure 7 In step b, when the user looks at window 2A and briefly presses "Alt+Tab" on the keyboard, the PC detects that a non-member window 5A is obscuring window 2A. The PC can then place window 5A below the hierarchy of all member windows (such as window 1A, window 2A, window 3A, and window 4A). Because window 5A is obscured by the member windows of the split-screen interface 701, the user cannot see window 5A on the display screen. Figure 7 As shown in c. Additionally, after the PC places window 5A below the hierarchy of all member windows, the PC can switch the focus window from window 1A to window 2A, and move the mouse cursor 71 to window 2A, as shown. Figure 7 As shown in d.

[0137] Understandable, Figure 7 The 'c' in the split-screen interface 701 can also display the focus window switching to window 2A, as well as the screen where the mouse cursor 71 moves to window 2A. Figure 7 To demonstrate the steps performed by the PC, the steps of "the PC places window 5A below the hierarchy of all member windows" and "the PC switches the focus window from window 1A to window 2A and moves the mouse cursor 71 into window 2A" are shown in two separate screens.

[0138] in addition, Figure 7 The text also demonstrates changes in the focus activity of windows on the interface. For example, see [link to example]. Figure 7 In the context of 'a', when the focused window is window 1A, assume the windows' focus activity is ordered as follows: window 1A, window 5A, window 2A, window 3A, window 4A. (Refer to...) Figure 7 In step c, after PC places window 5A below the hierarchy of all member windows, window 5A's focus activity is less than that of all member windows. Therefore, window 5A can be sorted after window 4A. (See reference...) Figure 7In the context of d, when the focus window switches from window 1A to window 2A, window 2A gains focus while window 1A loses focus. Window 2A can be ranked before window 1A, meaning that the focus activity of window 2A is higher than that of window 1A.

[0139] In this embodiment of the application, in a scenario where the first interface is a split-screen interface, if a non-member window obscures a member window, in response to the user's gaze point and the user's operation of triggering the first shortcut key, the electronic device can first place the non-member window below all member windows, so that the non-member window does not obscure the member window. This can ensure that the electronic device accurately determines the user's gaze point and accurately realizes the switching of the focus window in the split-screen interface.

[0140] As illustrated in the above embodiments, an example is given where the user's gaze is within a window (such as the second window) in a split-screen interface. In one possible scenario, there are also dividing lines between member windows in the split-screen interface, and the user's gaze may also be located at the dividing line between member windows. In this scenario, this application embodiment also provides a method for quickly switching the focus window to the previous focus window. That is, when the electronic device detects that the user's gaze is located at the dividing line between member windows, the electronic device can switch the focus window of the split-screen interface to the previous focus window, which can also simplify the user's operation of switching focus windows and improve the efficiency of focus window switching.

[0141] In some embodiments, taking a first interface as a split-screen interface as an example, the split-screen interface may include a first window, a second window, and a fourth window. The first window, second window, and fourth window are all member windows of the split-screen interface, and there are dividing lines between them. Assuming the current focus window of the split-screen interface is the first window, and the previous focus window was the fourth window, when the electronic device detects that the user's gaze point is on the dividing line between the windows, in response to the user triggering a first shortcut key on the keyboard, the electronic device can switch the focus window of the first interface to the fourth window and move the mouse cursor to the fourth window. Here, the electronic device detecting that the user's gaze point is on the dividing line between the windows can be understood as: the user's gaze point is on the dividing line between any two of the "first window, second window, and fourth window".

[0142] In some embodiments, when the eye-tracking detection of the electronic device is highly accurate, the electronic device can accurately detect the position of the user's gaze point on the first interface. Therefore, the electronic device can accurately detect whether the user's gaze point is within a window or on the boundary line between windows.

[0143] In some embodiments, when the accuracy of eye-tracking detection by the electronic device is low, the electronic device can also determine that the user's gaze is located at the boundary line between windows when it detects that the user's gaze is switching between windows. For example, if the electronic device detects that the user's gaze stays in the first window for less than a first preset time, it switches to the second window, and the user's gaze stays in the second window for less than the first preset time, it switches back to the first window, and this situation continues for a second preset time, the electronic device can determine that the user's gaze is switching between windows.

[0144] Figure 8A This is another schematic diagram of the focus switching window provided in the embodiments of this application. Figure 8A a in Figure 5A The 'a' in them is the same. Figure 8A The 'a' in the text can be referenced. Figure 5A The description of 'a' in the text. Specifically, in the split-screen interface 801, the focused window is window 1A, and window 3A is the previous focused window. (Refer to...) Figure 8A In example b, the user looks at the dividing line between window 1A and window 2A and briefly presses "Alt+Tab" on the keyboard. The PC can then switch the focus window from window 1A to the previous focus window 3A and move the mouse cursor to window 3A. Figure 8A As shown in c in the example. In this example, window 1A can be considered the first window, and window 3A can be considered the fourth window.

[0145] in addition, Figure 8A The text also demonstrates changes in the focus activity of windows on the interface. For example, see [link to example]. Figure 8A In the context of 'a', when the focused window is window 1A, assume the windows' focus activity is ordered as follows: window 1A, window 3A, window 2A, window 4A, meaning window 3A is the previous focused window. (Refer to...) Figure 8A In the case of c, when the focus window switches from window 1A to window 3A, window 3A gains focus while window 1A loses focus. Window 3A can be ranked before window 1A, meaning that the focus activity of window 3A is higher than that of window 1A.

[0146] It should be understood that Figure 8A Taking the scenario where no non-member window obscures a member window on the split-screen interface 801 as an example, in some embodiments, the method of quickly switching the focus window to the previous focus window can also be applied to scenarios where non-member windows obscure member windows on the split-screen interface 801, as follows: Figure 8B As shown.

[0147] Figure 8B This is another schematic diagram of a focus-switching window provided in an embodiment of this application. (Refer to...) Figure 8B a in Figure 7The 'a' in them is the same. Figure 8B The 'a' in the text can be referenced. Figure 7 The description of 'a' in the text. Specifically, in the split-screen interface 802, the focused window is window 1A, and window 3A is the previous focused window. (Refer to...) Figure 8B In example b, the user looks at the dividing line between window 1A and window 2A and briefly presses "Alt+Tab" on the keyboard. The PC can first place window 5A below the hierarchy of all member windows, then switch the focus window from window 1A to the previous focus window 3A, and move the mouse cursor to window 3A. Figure 8B As shown in c in the example. In this example, window 1A can be considered the first window, window 3A can be considered the fourth window, and window 5A can be considered the third window.

[0148] in addition, Figure 8B The text also demonstrates changes in the focus activity of windows on the interface. For example, see [link to example]. Figure 8B In the context of 'a', when the focused window is window 1A, assuming the windows' focus activity is ordered as follows: window 1A, window 5A, window 3A, window 2A, window 4A, with window 3A being the previous focused window among the member windows. (Refer to...) Figure 8B In the case of c, when the focus window switches from window 1A to window 3A, the PC places window 5A below the hierarchy of all member windows. Since the focus activity of window 5A is less than that of all member windows, window 5A can be sorted after window 4A. Window 3A is in focus, window 1A is out of focus, and window 3A can be sorted before window 1A. That is, the focus activity of window 3A is higher than that of window 1A.

[0149] In some embodiments, the electronic device may also support users to continuously switch the focus window. Figure 9 Taking a split-screen interface as an example, and using a scenario where there are no non-member windows obscuring member windows in the split-screen interface as an example for explanation, it can be understood that even in a scenario where there are non-member windows obscuring the split-screen interface, electronic devices can still continuously switch the focus window.

[0150] Figure 9 a in Figure 5A The 'a' in the same letter can be referred to as 'a'. Figure 5A The description of 'a' in [reference]. Figure 9 In section a, the focus window of the split-screen interface 901 is window 1A. Referring to section b in section 9, when the user looks at window 2A and briefly presses "Alt+Tab" on the keyboard, the PC can detect that the user's gaze is in window 2A. Upon detecting the user's brief press of "Alt+Tab," the PC can switch the focus window from window 1A to window 2A and move the mouse cursor to window 2A. Figure 9 As shown in c in the diagram. (Refer to...) Figure 9 In the context of window 3A, if the user looks at window 2A and briefly presses "Alt+Tab" on the keyboard, the PC can switch the focus window from window 2A to window 3A and move the mouse cursor to window 3A. Figure 9 As shown in 'e'. (Refer to...) Figure 9 In the context of window 'f', the user looks at the dividing line between windows 3A and 4A and briefly presses "Alt+Tab" on the keyboard. The PC can then switch the focus window from window 3A to window 2A and move the mouse cursor to window 2A. Figure 9 As shown in g in the figure.

[0151] in addition, Figure 9 The text also demonstrates changes in the focus activity of windows on the interface. For example, see [link to example]. Figure 9 In the context of 'a', when the focused window is window 1A, assume the focus activity of the windows is ordered in the following order: window 1A, window 2A, window 3A, window 4A. (Refer to...) Figure 9 In point c, when the focus window switches from window 1A to window 2A, window 2A gains focus while window 1A loses focus. Window 2A can then be prioritized before window 1A, meaning window 2A has a higher focus engagement rate than window 1A. (Refer to...) Figure 9 In the context of point 'e', ​​when the focus window switches from window 2A to window 3A, window 3A gains focus while window 2A loses focus. Window 3A can be prioritized before window 2A, meaning window 3A has a higher focus acquisition activity than window 2A. (Refer to...) Figure 9 In the context of 'g', when the focus window switches from window 3A to window 2A, window 2A gains focus while window 3A loses focus. Window 2A can be ranked before window 3A, meaning that the focus activity of window 2A is higher than that of window 3A.

[0152] In some embodiments, when N windows can be displayed on the split-screen interface, if the number of member windows selected by the user is less than N, that is, the split-screen interface is not filled by member windows, where N is an integer greater than or equal to 3. For example, in this scenario, the windows in the split-screen interface can be displayed in a "grid" shape. The split-screen interface can display 4 windows, but if the user selects window 1A, window 2A, and window 3A as member windows of the split-screen interface, when the electronic device displays the split-screen interface, it can display window 1A, window 2A, and window 3A, leaving a blank area where no window is displayed.

[0153] In this example, assuming the focus window of the split-screen interface is window 1A, the user looks at window 2A and triggers the first shortcut key on the keyboard, the electronic device can switch the focus window to window 2A and move the mouse cursor to window 2A.

[0154] In this example, assuming the focus window of the split-screen interface is window 1A, the user looks at the dividing line between the windows and triggers the first shortcut key on the keyboard. The electronic device can switch the focus window to the previous focus window and move the mouse cursor to the previous focus window.

[0155] In this example, assuming the focus window of the split-screen interface is window 1A, the user looks at the blank area and triggers the first shortcut key on the keyboard, the electronic device can avoid performing the operation of switching the focus window.

[0156] In this embodiment, the user can look at (or gaze at) the dividing line between member windows in the split-screen interface and trigger the first shortcut key to quickly switch the electronic device to the previous focus window. Additionally, in this embodiment, the electronic device can also support continuous switching of focus windows, facilitating user operation.

[0157] In some embodiments, the window display method provided in this application can also be summarized as follows: Figure 10 The process shown, in some embodiments, refers to Figure 10 The window display method provided in this application embodiment may include:

[0158] S1001, Displays a split-screen interface, which includes a first window and a second window.

[0159] S1002, turn on the camera and determine the user's gaze point based on the facial image captured by the camera.

[0160] S1003 responds to the user's operation of the first shortcut key on the keyboard (such as Alt+Tab) and detects whether the first shortcut key has been pressed briefly.

[0161] S1004: When the user briefly presses the first shortcut key, check if there is a third window (not a member window) obscuring the first window and / or the second window on the split-screen interface. If yes, proceed to S1005; otherwise, proceed to S1006.

[0162] S1005, place the third window's layer below the first window's layer and the second window's layer.

[0163] S1006, Detect whether the user's gaze point is in the first window that is currently in focus. If not, proceed to S1007; if yes, proceed to S1011.

[0164] S1007, Detect whether the user's gaze point is on the boundary line between windows. If not, proceed to S1008; if yes, proceed to S1009.

[0165] S1008, switch the focus window to the second window that the user is looking at, and move the mouse cursor to the second window.

[0166] S1009: Switch the focus window to the previous focus window and move the mouse cursor to the previous focus window.

[0167] In this embodiment, the electronic device can detect whether the user's gaze point is in the currently focused first window. For example, in a split-screen interface, the first window is the focus window. After determining the user's gaze point, the electronic device can detect whether the user's gaze point is in the first window. If the user's gaze point is in the first window, the electronic device determines that there is no need to switch the focus window and can stop execution. If the user's gaze point is not in the first window, the electronic device can detect whether the user's gaze point is on the boundary line between windows. If the user's gaze point is on the boundary line between windows, the electronic device can switch the focus window to the previous focus window and move the mouse cursor to the previous focus window. If the user's gaze point is not on the boundary line between windows, but is in the unfocused second window, the electronic device can switch the focus window to the second window the user is looking at and move the mouse cursor to the second window.

[0168] The S1010 displays a multitasking view interface when the user presses and holds the first shortcut key.

[0169] exist Figure 10 In the illustrated embodiment, different user actions on the first shortcut key on the keyboard can be used to distinguish the different functions triggered by the electronic device. Specifically, a short press of the first shortcut key can trigger the electronic device to switch the focus window in the split-screen interface, while a long press of the first shortcut key can trigger the electronic device to display a multi-tasking view interface.

[0170] S1011, Stop.

[0171] In this embodiment, S1001-S1011 can be referred to the relevant descriptions in the above embodiments, and will not be repeated here.

[0172] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

[0173] This application provides an electronic device, with reference to... Figure 11 The electronic device may include a processor 1101 (e.g., CPU) and a memory 1102. The memory 1102 may include high-speed random-access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage device. The memory 1102 may store various instructions for performing various processing functions and implementing the method steps of this application.

[0174] The electronic device involved in this application may further include: a display screen 1106, a keyboard 1107, and a camera 1108. The display screen 1106 is used to display the interface of the electronic device. The keyboard 1107 is used for inputting data into the electronic device; for example, a user can trigger shortcut keys on the keyboard 1107 to input data into the electronic device, as described in the above embodiments. The camera 1108 is used to capture the user's facial image so that the electronic device can determine the user's gaze point based on the facial image to implement the method steps of this application.

[0175] Optionally, the electronic device involved in this application may also include a mouse 1109. By operating the mouse 1109, the user can manipulate the mouse cursor displayed on the display screen 1106. Additionally, by operating the mouse 1109, the user can also click, drag, and perform other operations on the windows displayed on the display screen 1106.

[0176] Optionally, the electronic device involved in this application may further include: a power supply 1103, a communication bus 1104, and a communication port 1105. The aforementioned communication port 1105 is used to enable communication between the electronic device and other peripherals. In this embodiment, the memory 1102 is used to store computer-executable program code, which includes instructions; when the processor 1101 executes the instructions, the instructions cause the processor 1101 of the electronic device to perform the actions described in the above method embodiment. The implementation principle and technical effects are similar and will not be repeated here.

[0177] This application provides a chip. The chip includes a processor, which is used to call a computer program in memory to execute the technical solutions in the above embodiments. Its implementation principle and technical effects are similar to those in the related embodiments described above, and will not be repeated here.

[0178] This application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, it implements the methods described above. The methods described in the above embodiments can be implemented wholly or partially by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted over the computer-readable medium. The computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0179] In one possible implementation, a computer-readable medium may include random access memory (RAM), read-only memory (ROM), compact discread-only memory (CD-ROM) or other optical disc storage, magnetic disk storage or other magnetic storage devices, or any other medium targeted to carry or to store required program code in the form of instructions or data structures, and accessible by a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disks and optical discs include optical discs, laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0180] This application provides a computer program product, which includes a computer program that, when run, causes a computer to perform the above-described method.

[0181] It should be noted that the modules or components described in the above embodiments can be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs), etc. Furthermore, when a module is implemented through processing element scheduler code, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processors capable of calling program code, such as a controller. Additionally, these modules can be integrated together to implement a system-on-a-chip (SOC).

[0182] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).

[0183] The term "multiple" in this document refers to two or more. The term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. Furthermore, the character " / " in this document generally indicates an "or" relationship between the preceding and following related objects; in formulas, " / " indicates a "division" relationship. Additionally, it should be understood that in the description of this application, words such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating or implying relative importance or order.

[0184] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application.

[0185] It is understood that, in the embodiments of this application, the order of the above-mentioned process numbers does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

Claims

1. A window display method, characterized in that, Applied to an electronic device, the electronic device including a display screen and a keyboard, the method includes: A first interface is displayed on the display screen, the first interface including a first window and a second window, the first window being the focus window; If the user's gaze is detected to be on the second window, the focus window of the first interface is switched to the second window in response to the user triggering a first shortcut key on the keyboard.

2. The method according to claim 1, characterized in that, The first interface also includes a mouse cursor. When the user's gaze is detected to be on the second window, in response to the user triggering a first shortcut key on the keyboard, the method further includes: Move the mouse cursor to the second window.

3. The method according to claim 1 or 2, characterized in that, The first window and the second window do not overlap.

4. The method according to any one of claims 1-3, characterized in that, The first interface is a split-screen interface, and the first window and the second window are displayed in a tiled manner on the first interface.

5. The method according to claim 4, characterized in that, The first interface further includes a third window, which obscures the first window and / or the second window; before switching the focus window of the first interface to the second window, the method further includes: The third window is placed below the levels of the first window and the second window.

6. The method according to claim 4 or 5, characterized in that, Before switching the focus window of the first interface to the second window, the following steps are included: It was detected that the focus of the first interface was not on the second window.

7. The method according to any one of claims 4-6, characterized in that, The first interface further includes a fourth window, wherein the fourth window, the first window, and the second window are displayed in a tiled manner on the first interface, and the fourth window is the previous focused window of the first interface. The method further includes: If the user's gaze point is detected to be on the dividing line between windows, in response to the user triggering the first shortcut key on the keyboard, the focus window of the first interface is switched to the fourth window.

8. The method according to claim 7, characterized in that, When the user's gaze point is detected to be on the dividing line between windows, in response to the user triggering the first shortcut key on the keyboard, the method further includes: Move the mouse cursor to the fourth window.

9. The method according to claim 8, characterized in that, The method further includes: In response to detecting that the user's gaze point is switching between windows, it is determined that the user's gaze point is located at the boundary line between the windows.

10. The method according to any one of claims 1-9, characterized in that, The user triggers the first shortcut key on the keyboard by briefly pressing the first shortcut key.

11. The method according to claim 10, characterized in that, The method further includes: In response to the user pressing and holding the first shortcut key, a second interface is displayed on the screen, which is a multi-task view interface.

12. An electronic device, characterized in that, The electronic device includes: one or more processors and memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-11.

13. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the one or more processors being used to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-11.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1-11.

15. A computer program product, characterized in that, The computer program product includes computer program code that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1-11.

Images