Interaction method, electronic device, readable medium and program product

Abstract

The present application relates to the technical field of computers, and in particular to an interaction method, an electronic device, a readable medium and a program product. According to the method, thumbnail windows corresponding to one or more task windows displayed on a screen are displayed in one area in a centralized mode, which can be referred to as a task control area hereinafter. On this basis, on the basis of an operation of a user on the thumbnail windows in the task control area for instructing to move a window display position, a foldable device can recognize a window operated by a user and a target area or target position to which the user intends to drag the window. Therefore, the interaction solution provided by the present application avoids damage to a screen caused by sliding operations of a user on the screen, and can improve the efficiency of adjusting the position of each window displayed by the screen by the user, thereby improving the use experience of the user.

Description

Interactive method, electronic device, readable medium and program product

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on February 7, 2024, with application number 202410176385.0 and application name “Interactive Method, Electronic Device, Readable Medium and Program Product”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present invention relates to the field of computer technology, and in particular to an interaction method, electronic equipment, readable medium and program product. Background Art

[0003] With the development of smart terminal technology, the emergence of foldable devices meets users' demand for different screen sizes. A foldable device may include one or more display screens that can display application interfaces. When a foldable device includes a single screen, the screen may be folded using flexible folding technology, such as a flexible folding screen. When a foldable device includes multiple screens, each screen may be folded using flexible folding technology or a hinge or other folding technology.

[0004] While foldable devices provide users with more screen space, users switch between multiple screens more frequently. Referring to (a) shown in Figure 1, when the foldable device 10 enters the unfolded state through an unfolding operation, screen B and screen C can form a larger screen A, on which one or more windows are displayed. Continuing to refer to (b) in Figure 1, after the foldable device 10 enters the semi-expanded state through a folding operation, or after the foldable device 10 enters the semi-expanded state through an unfolding operation, screen B and screen C can respectively display one or more task windows. For example, a user can edit a document in the window displayed on screen B and open multiple reference documents on screen C for viewing. When the user needs to move the window displaying the reference document on screen C to screen B, or when the user needs to move the window being edited on screen B to screen C, the user needs to drag the window across the screen.

[0005] However, the operation path of dragging a window across the screen is long, and the user may cause wear and tear to the screen of the foldable device 10 during the dragging process. Moreover, if the foldable screen device 10 is placed on an object, such as a desktop, if the user applies pressure to screen B while dragging the window, it may cause the foldable device 10 to fall over, resulting in a poor user experience.

[0006] Summary of the Invention

[0007] The present application provides an interactive method, electronic device, readable medium, and program product that facilitate users to quickly adjust window positions on foldable devices or various collaborative devices that require dragging windows across screens. Furthermore, the user's operation path for adjusting window positions across screens can be shortened, and the window position can be adjusted by simply dragging the mouse or sliding a touch object a short distance on the foldable device's screen. This can prevent screen damage caused by sliding operations on the user's screen and improve the user's efficiency in adjusting the positions of windows displayed on the screen, thereby enhancing the user experience.

[0008] In a first aspect, the present application provides an interaction method, applied to an electronic device, the method comprising: displaying a first interface, wherein the first interface includes a first window and a first display area, the first display area includes a first identification image of the first window; detecting a first drag operation of the user on the first identification image; and moving the first window in response to the first drag operation.

[0009] For example, the electronic device may be a foldable screen notebook, and the first interface may be an interface or window displayed when the electronic device runs various applications, such as a desktop. The first window may be a task window that displays the corresponding application interface, such as a window that displays the homepage interface of a video application. Alternatively, the first window may also be a sub-page window on the corresponding application interface, such as a video playback window of a video application. The first display area may be, for example, a task control area that includes thumbnail windows or application icons corresponding to one or more task windows displayed by the electronic device. The thumbnail window may include the first identification image of the first window, that is, the thumbnail window or application icon of the first window. The first dragging operation may be an operation in which the user drags the first identification image in the task control area. Correspondingly, the first window may be adjusted to be displayed in the area specified by the user according to the direction and distance of the dragging operation.

[0010] In some implementations, the logo image is also called a preview image, or in other implementations, the logo image can be carried or implemented in the form of a control, a button, or other forms.

[0011] In this way, the user can adjust the screen displayed by the actual window by applying a small sliding operation to the thumbnail window in the task control area. For example, without using an access device such as a mouse, the user's finger only needs to slide up or down a short distance on the thumbnail window in the task control area to adjust the corresponding window from one screen to another. This can not only prevent the sliding operation on the user's screen from causing damage to the screen, but also improve the efficiency of the user in adjusting the position of each window displayed on the screen, thereby improving the user's experience.

[0012] In a possible implementation of the first aspect, the electronic device includes a foldable device, wherein the foldable device includes a first screen portion and a second screen portion located on both sides of a folding axis.

[0013] For example, the electronic device may be a foldable laptop, which may be a bifold, trifold, or multifold device. Taking a bifold device as an example, the first screen portion of the foldable laptop may be the screen on one side of the folding axis, and the second screen portion may be the screen on the other side of the folding axis. When the foldable laptop is unfolded, the two screen portions may form a larger screen. The screen portions may be components of the same screen or may be two relatively independent screens, without limitation.

[0014] In a possible implementation of the first aspect, the first screen portion is located in a first direction of the second screen portion, and the second screen portion is located in a second direction of the first screen portion, wherein the first direction is opposite to the second direction.

[0015] For example, a foldable notebook can have one screen portion located on one side of a folding axis, while the other screen portion can be located on the other side of the folding axis. Thus, one screen portion can be positioned in a certain direction relative to the other screen portion, such as the first direction or the second direction described above. The first direction can be, for example, upward, and the second direction can be, for example, downward. The first screen portion can be screen A in FIG2a below, and the second screen portion can be screen B in FIG2b below. The first screen portion, i.e., screen A, can be suspended in mid-air, while the second screen portion, i.e., screen B, can be placed on a table or other support surface.

[0016] In a possible implementation of the first aspect above, the first display area is located in the first screen portion.

[0017] In a possible implementation of the first aspect, detecting a first dragging operation of the user on the first identification image includes: detecting an operation of the user dragging the first identification image to move in a second direction.

[0018] The first display area, such as the task control area, can be displayed in the first screen portion, such as in an area of ​​the first screen portion near an edge of the second screen portion, as shown in FIG. 2a to FIG. 2c below. In another implementation scenario below, the task control area can also be displayed in the second screen portion, as described below, without limitation.

[0019] In a possible implementation of the first aspect above, the second screen portion includes a displayed second interface, the second interface includes a second window, and the first display area includes a second identification image corresponding to the second window.

[0020] In a possible implementation of the first aspect above, the method further includes: detecting a second dragging operation in which the user drags the second identification image toward the first direction; and corresponding to the second dragging operation, moving the second window to the first interface displayed on the first screen portion.

[0021] In a possible implementation of the first aspect above, detecting a first dragging operation of a user on a first identification image includes: detecting that a first distance that the user drags the first identification image to a second direction satisfies a first threshold condition; and / or detecting a second dragging operation of a user dragging a second identification image to a first direction includes: detecting that a second distance that the user drags the second identification image to a first direction satisfies a first threshold condition.

[0022] For example, the first window is originally displayed on the first screen portion, and the user drags the first logo image to move in the second direction, which can indicate that the first window corresponding to the first logo image is displayed on the second screen portion.

[0023] Similarly, the second window is originally displayed on the second screen portion, and the user drags the second identification image to move in the first direction, which can indicate that the second window corresponding to the second identification image is displayed on the first screen portion.

[0024] In a possible implementation of the first aspect, detecting a first drag operation on the first logo by the user includes:

[0025] A first combined operation of a user on a first identification image is detected, wherein the first combined operation includes a first operation of dragging the first identification image to a second direction and hovering it, and an operation of a user selecting a first area in a second display area displayed by triggering the first operation is detected, wherein the second display area includes at least one display area recommended for the first window, at least one display area includes the first area, and at least one display area is located within the display area of ​​the second screen portion.

[0026] In a possible implementation of the first aspect, moving the first window in response to the first drag operation includes: displaying the first window in a corresponding area of ​​the first area in the second screen portion in response to the first combination operation.

[0027] For example, the above-mentioned first combined operation may include operation ② shown in Figure 2b below. The user may drag the window downward and then hover it or press the finger on the window and hover it. At this time, the user may trigger the display of the second display area of ​​the operation, such as clicking the selected layout position in the layout menu shown in Figure 2b.

[0028] In a possible implementation of the first aspect above, the method includes: detecting a second combination operation of the user on the second identification image, wherein the second combination operation includes a second operation of dragging the second identification image to a first direction and hovering it, and detecting an operation of the user selecting a second area in a third display area triggered by the second operation, wherein the third display area includes at least one display area recommended for the second window, at least one display area includes the second area, and at least one display area is located within the display area of ​​the first screen portion; corresponding to the second combination operation, displaying the second window in the second area in the corresponding area of ​​the first screen portion.

[0029] For example, the above-mentioned second combined operation may include operation ① shown in Figure 2b below. The user may drag the window upward and hover it or press the finger on the window and hover it. At this time, the user may trigger the display of the second display area of ​​the operation, such as clicking the selected layout position in the layout menu shown in Figure 2b.

[0030] In a possible implementation of the first aspect above, dragging the first identification image to move in the second direction for a third distance satisfies the second threshold condition; and / or dragging the second identification image to move in the first direction for a fourth distance satisfies the second threshold condition.

[0031] In a possible implementation of the first aspect above, a duration corresponding to the hovering operation satisfies a third threshold condition.

[0032] In a possible implementation of the first aspect above, detecting a first drag operation of a user on a first identification image includes: detecting a third combined operation of the user acting on the first identification image with a mouse, the third combined operation including a third operation of placing the mouse on the first identification image and hovering the mouse, and detecting an operation of the user clicking a mouse on a first control among multiple controls triggered by the third operation to be displayed, wherein the first control is used to indicate the portion of the screen where the first window is displayed.

[0033] For example, the third combined operation may include operation ③ or operation ④ shown in FIG. 2c below. The user may place the mouse on window 211 and hover the mouse over it to cause the electronic device to display the layout controls, i.e., the multiple controls displayed by the third operation. Correspondingly, the first control may be any of the controls in the layout controls.

[0034] In a possible implementation of the first aspect, the first control indicates that the displayed screen portion is the second screen portion.

[0035] In a possible implementation of the first aspect, moving the first window in response to the first drag operation includes: displaying the first window in the second screen portion indicated by the first control in response to the third combination operation.

[0036] In a possible implementation of the first aspect above, an icon indicating the second direction is displayed on the first control.

[0037] In a possible implementation of the first aspect above, a duration corresponding to the hovering operation satisfies a fourth threshold condition.

[0038] In a possible implementation of the first aspect above, the first display area is located in the second screen portion.

[0039] In a possible implementation of the first aspect, detecting a first dragging operation of the user on the first identification image includes: detecting an operation of the user dragging the first identification image to move in a first direction.

[0040] For example, the first display area mentioned above is a task control area, and the task control area can also be displayed in the second screen part placed on the desktop.

[0041] In a possible implementation of the first aspect above, detecting a first drag operation of a user on a first identification image includes: detecting a fourth combination operation of the user on the first identification image, wherein the fourth combination operation includes a fourth operation of dragging the first identification image to a first direction and hovering, and detecting an operation of the user selecting a third area in a fourth display area triggered by the fourth operation, wherein the fourth display area includes at least one display area recommended for the first window, at least one display area includes the third area, and at least one display area is located within the display area of ​​the first screen portion.

[0042] In a possible implementation of the first aspect above, detecting a first drag operation of a user on a first identification image includes: detecting a fifth combined operation of the user acting on the first identification image with a mouse, the fifth combined operation including a fifth operation of placing the mouse on the first identification image and hovering the mouse, and detecting an operation of a second control among multiple controls triggered by the fifth operation of the user clicking the mouse, wherein the second control is used to indicate a portion of the screen where the first window is displayed, and the screen portion includes a first screen portion or a second screen portion.

[0043] In a possible implementation of the first aspect above, the first identification image includes: a thumbnail window corresponding to the first window; or an application icon corresponding to the application program interface displayed in the first window.

[0044] In a second aspect, the present application provides an electronic device comprising: one or more processors; one or more memories; one or more memories storing one or more programs, which, when one or more programs are executed by one or more processors, enables the electronic device to execute the interaction method provided in the above-mentioned first aspect and various possible implementations of the first aspect.

[0045] In a third aspect, the present application provides a computer-readable medium having instructions stored thereon, which, when executed on a computer, causes the computer to execute the interaction method provided in the above-mentioned first aspect and various possible implementations of the first aspect.

[0046] In a fourth aspect, the present application provides a computer program product, comprising a computer program / instruction, which, when executed by a processor, implements the interaction method provided in the above-mentioned first aspect and various possible implementations of the first aspect.

[0047] The beneficial effects of the second to fourth aspects mentioned above can be found in the relevant descriptions of the first aspect and various possible implementations of the first aspect, and will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] FIG1 is a schematic diagram showing an application scenario of an interaction method provided in an embodiment of the present application.

[0049] FIG2 a shows a schematic diagram of an interface corresponding to a touch-based interaction method provided in an embodiment of the present application.

[0050] FIG2 b shows a schematic diagram of an interface corresponding to a touch-based interaction method provided in an embodiment of the present application.

[0051] FIG2 c is a schematic diagram showing an interface corresponding to a mouse-based interaction method provided in an embodiment of the present application.

[0052] FIG2 d is a schematic diagram showing the display position and style of a task control area in an interactive system consisting of a foldable device and an external display screen provided in an embodiment of the present application.

[0053] FIG3 a is a schematic diagram showing the state changes of a two-fold folding device during an unfolding operation provided in an embodiment of the present application.

[0054] FIG3 b is a schematic diagram showing the state changes of another two-fold folding device provided in an embodiment of the present application during an unfolding operation.

[0055] FIG3 c is a schematic diagram showing the state changes of a multi-fold folding device during an unfolding operation provided in an embodiment of the present application.

[0056] FIG4 is a schematic diagram showing an implementation flow of an interaction method provided in an embodiment of the present application.

[0057] FIG5 is a schematic diagram showing an interface for opening / closing a super window function provided in an embodiment of the present application.

[0058] FIG6 a is a schematic diagram of an operation interface in which a user drags a target window downwards, including a third user operation provided in an embodiment of the present application.

[0059] FIG6 b is a schematic diagram showing a response interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window downward.

[0060] FIG6 c is a schematic diagram of an operation interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window upward.

[0061] FIG6 d is a schematic diagram showing a response interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window upward.

[0062] FIG7 a is a schematic diagram of an operation interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window downward and hovering the window.

[0063] FIG7 b is a schematic diagram showing a response interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window downward and hovering the window.

[0064] FIG7 c is a schematic diagram showing a response interface after a user selects a target area in a layout menu triggered by downward hovering, including a third user operation provided in an embodiment of the present application.

[0065] FIG8 a is a schematic diagram of an operation interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window upward and hovering the window.

[0066] FIG8 b is a schematic diagram showing a response interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window upward and hovering the window.

[0067] FIG8 c is a schematic diagram showing a response interface after a user selects a target area in a layout menu triggered by upward hovering, including a third user operation provided in an embodiment of the present application.

[0068] FIG9 a is a schematic diagram of an operation interface in which a third user operation provided in an embodiment of the present application includes a user hovering a mouse over a target window.

[0069] FIG9 b shows a schematic diagram of an operation interface corresponding to a third user operation provided in an embodiment of the present application, in which a user uses a mouse to click a control indicating downward in a layout control displayed by hovering triggering.

[0070] FIG9c is a schematic diagram showing a response interface corresponding to a third user operation provided in an embodiment of the present application, in which the user uses a mouse to click a control indicating downward in a layout control displayed by hovering triggering.

[0071] FIG9 d is a schematic diagram of another operation interface in which the third user operation provided in an embodiment of the present application includes a user hovering a mouse over a target window.

[0072] FIG9e is a schematic diagram of an operation interface corresponding to a third user operation provided in an embodiment of the present application, in which a user uses a mouse to click on an upward-pointing control in a layout control displayed by hovering triggering.

[0073] FIG9f is a schematic diagram showing a response interface corresponding to a third user operation provided in an embodiment of the present application, in which the user uses a mouse to click an upward-pointing control in a layout control displayed by hovering triggering.

[0074] FIG10 is a schematic diagram showing an application scenario of another interaction method provided in an embodiment of the present application.

[0075] FIG11 is a schematic diagram showing an implementation flow of another interactive method provided in an embodiment of the present application.

[0076] FIG12 is a schematic diagram of an operating system software structure provided in an embodiment of the present application.

[0077] FIG13 is a schematic diagram showing another operating system software structure provided in an embodiment of the present application.

[0078] FIG14 is a schematic diagram showing the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0079] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings and specific implementation methods.

[0080] It is understood that the electronic devices in the embodiments of the present application may also be referred to as terminals, terminal devices, user equipment (UE), mobile stations (MS), mobile terminals (MT), etc. The terminal devices may be foldable notebooks, foldable mobile phones, foldable tablets (pads), wireless terminals in industrial control, wireless terminals in self-driving systems, wireless terminals in smart cities, wireless terminals in smart homes, etc.

[0081] As mentioned above, in the semi-expanded state of a foldable device such as that shown in Figure 1 above, when the user drags a window across the screen from screen B to screen C or from screen C to screen B, the path is long, which will cause wear and tear on the screen of the foldable device and easily cause the device to fall over, resulting in a poor user experience.

[0082] In order to solve the above problems, the present application provides an interactive method. Specifically, the method displays the thumbnail windows corresponding to one or more task windows displayed on the screen in one area, which may be referred to as the task control area below. Based on this, the foldable device can identify the window operated by the user and the target area or target position to which the user intends to drag the window according to the operation of the user applying the instruction to move the window display position to the thumbnail window in the task control area. For example, in the task control area 210 shown in Figure 2a, window 211, window 212, etc. are respectively thumbnail windows corresponding to the display windows of each application interface on the screen of the foldable device 10. The user can drag window 211 or window 212 upward in the task control area 210 to control the actual task window corresponding to window 211 to be displayed in the screen B or display area B of the foldable device 10. The user can also drag window 211 or window 212 downward in the task control area 210 to control the actual task window corresponding to window 211 to be displayed in the screen C or display area C of the foldable device 10.

[0083] In this way, it is convenient for users to quickly adjust the window position on foldable devices or various collaborative devices that need to drag windows across screens, and the operation path for users to adjust the window position across screens can be shortened. They only need to drag the mouse on the screen of the foldable device or slide a short distance with a touch object to complete the adjustment of the window position. For example, without using an access device such as a mouse, the user's finger only needs to slide up or down a short distance on the corresponding window in the task control area to adjust the corresponding window from one screen to another. The interactive solution provided by this application not only avoids damage to the screen caused by sliding operations on the user's screen, but also improves the efficiency of users in adjusting the positions of the windows displayed on the screen, thereby improving the user experience.

[0084] It can be understood that the above-mentioned task control area can also be called a task center in some embodiments. The electronic device supports the function of displaying the above-mentioned task control area, which can be called a super window function in some embodiments, etc., and is not limited here.

[0085] The user's operation on the task control area is not limited to the operation of dragging the window up or down, but may also include the operation of dragging the corresponding window up and then hovering or hovering on the corresponding window.

[0086] As an example, referring to operation ① shown in FIG2b , the user can drag window 211 and slide it upwards and then hover it or press the finger on window 211 and hover it. At this time, the foldable device 10 can display the layout menu 221 shown in FIG2b in the task control area or above the task control area. The user clicks on the selected layout position in the layout menu 221, and the actual task window corresponding to window 211 can be adjusted to the corresponding layout position in screen B or display area B. Continuing to refer to operation ② shown in FIG2b , the user can drag window 212 and slide it downwards and then hover it or press the finger on window 212 and hover it. At this time, the foldable device 10 can display the layout menu 222 shown in FIG2C in the task control area or below the task control area. The user clicks on the selected layout position in the layout menu 222, and the actual task window corresponding to window 212 can be adjusted to the corresponding layout position in screen C or display area C.

[0087] The user's operations on the above-mentioned task control area may also include placing the mouse on the corresponding window in the task control area, hovering it, and clicking on the called control, etc., which are not limited here. As an example, referring to operation ③ shown in Figure 2c, the user can place the mouse on window 211 and hover it. At this time, the foldable device 10 can display the layout control illustrated in Figure 2c on window 211. The user moves the mouse to the upward control 231 in the layout control and clicks the control, and the actual task window corresponding to window 211 can be adjusted to screen B or display area B. Continuing to refer to operation ④ shown in Figure 2c, the user can place the mouse on window 212 and hover it. At this time, the foldable device 10 can display the layout control illustrated in Figure 2c on window 212. The user moves the mouse to the downward control 232 in the layout control and clicks the control, and the actual task window corresponding to window 212 can be adjusted to screen C or display area C.

[0088] It is understood that the electronic devices to which the interactive method provided in this application is applicable may not be limited to foldable devices, but may also include two or more cross-screen collaborative devices that need to drag windows across the screen. At this time, the display position and style of the task control area may not be limited to the positions and styles illustrated in Figures 2a to 2c above. Referring to Figure 2d, for the foldable device 10 and the external display screen 20, the task control area 240 may also be displayed on the right edge of screen B. When the user moves the mouse to hover over the corresponding window of the task control area 240, the control indicating right can be clicked in the corresponding layout control to control the corresponding actual task window to be displayed in screen A of the external display screen 20. In some embodiments, the placement direction of the foldable device 10 and the external display screen 20 may also be opposite or different from that shown in Figure 2b. The foldable device 10 may also be other forms of electronic devices such as notebooks, desktop computers or tablet computers. The display position and style of the task control area on the screen of the foldable device 10 may also be other positions and styles, which are not limited here.

[0089] It can be understood that the foldable device to which the interactive method provided in the present application is applicable can be a two-fold folding device, or a three-fold folding device or other multi-folding folding device, and there is no limitation here. In an example scenario, referring to Figure 3a, the folding screen 10 is a two-fold folding device 100, and the two-fold folding device 100 may include a main screen 100a, a sub-screen 100b, a folding axis 103, a folding portion 104 and a folding portion 105. Among them, the main screen 100a is located on the folding portion 104, the sub-screen 100b is located on the folding portion 105, and the folding portion 104 and the folding portion 105 are folded and connected by the folding axis 103. In this way, the two-fold folding device 100 can support the unfolding operation of unfolding the folding portion 104 and the folding portion 105 to the same plane④. After the two-fold folding device 100 is unfolded, the main screen 100a and the sub-screen 100b can form a larger display screen.

[0090] It will be understood that when the angle α between the folding portion 104 and the folding portion 105, which is unfolded about the folding axis 103, is less than the preset angle that triggers the folded state, the bi-folding device 100 is in the folded state. In this folded state, the main screen 100a can be in an active state, which can be used to display an application interface or respond to user operations, and the secondary screen 100b can be in an inactive state, for example, a state where the screen is off and no interface is displayed. When the angle α between the folding portion 104 and the folding portion 105, which is unfolded about the folding axis 103, is greater than the aforementioned preset angle, the bi-folding device 100 can switch to the unfolded state. In this unfolded state, both the main screen 100a and the secondary screen 100b can be in an active state, that is, the display interface is displayed on both the main screen 100a and the secondary screen 100b. At this point, based on the interaction method provided in this application, the user can quickly adjust the display position of the task window on the bi-folding device 100 to display on the main screen 100a or on the secondary screen 100b.

[0091] In other embodiments, as shown in FIG3b , the bi-folding device 100 may further include a secondary screen 100c. For example, the main screen 100a is located on the front of the folding portion 104, the secondary screen 100c is located on the back of the folding portion 104, and the secondary screen 100b is located on the folding portion 105. The user may also unfold the bi-folding device 100 in other ways, such as the unfolding operation ⑤ shown in FIG3b , in which the user unfolds the folded secondary screens 100b and 100c of the bi-folding device 100 onto the same plane. When the bi-folding device 100 is unfolded, the secondary screens 100c and 100b can form a larger display screen. In this folded state, the main screen 100a can be active, while the secondary screens 100c and 100b can both be inactive. When the angle α between the folding portion 104 and the folding portion 105, about the folding axis 103, is greater than the aforementioned predetermined angle, the bi-folding device 100 can switch to the unfolded state. In this unfolded state, the secondary screen 100c and the secondary screen 100b may both be in an active state, and the main screen 100a may be in an inactive state. At this time, based on the interaction method provided by the present application, the user can quickly adjust the display position of the task window on the bi-folding device 100 to display on the secondary screen 100b or to display on the secondary screen 100c.

[0092] In another example scenario, as shown in FIG3c , the foldable device may be a tri-fold folding device 200. The tri-fold folding device 200 may include a main screen 200a, a secondary screen 200b, a secondary screen 200c, a secondary screen 200d, a folding axis 204, a folding axis 205, a folding portion 206, a folding portion 207, and a folding portion 208. The main screen 200a is located in front of the folding portion 206, the secondary screen 200b is located behind the folding portion 206, the secondary screen 200c is located on the folding portion 207, and the secondary screen 200d is located on the folding portion 208. The folding portion 206 and the folding portion 207 are foldably connected by the folding axis 204, and the folding portion 207 and the folding portion 208 are foldably connected by the folding axis 205. Based on the folding axis 204, the tri-fold folding device 200 can support an unfolding operation ⑥ that enables the folding portion 206 and the folding portion 207 to unfold to the same plane. It can be understood that the unfolding operation ⑥ unfolds the secondary screen 200c, which is folded behind the main screen 200a in the tri-fold device 200, to be on the same plane as the secondary screen 200b. After the tri-fold device 200 is unfolded based on the unfolding operation ⑥, the secondary screen 200b and the secondary screen 200c can form a larger display screen.

[0093] When the angle α1 between the folding portion 206 and the folding portion 207, which is unfolded about the folding axis 204, is less than the aforementioned preset angle, and the angle α2 between the folding portion 207 and the folding portion 208, which is unfolded about the folding axis 205, is also less than the aforementioned preset angle, the bi-folding device 100 is in a folded state. In this folded state, the main screen 200a may be active, while the subsidiary screens 200b, 200c, and 200d may all be inactive. When the angle α1 between the folding portion 206 and the folding portion 207, which is unfolded about the folding axis 204, is greater than the aforementioned preset angle, the bi-folding device 100 may deem that the user has performed an unfolding operation ⑥. At this point, the state in which the bi-folding device 100 is in which the angle α1 is greater than the aforementioned preset angle and the angle α2 is less than the aforementioned preset angle may be referred to as a semi-expanded state. In this semi-expanded state, the subsidiary screens 200b and 200c may both be active, while the main screen 200a and the subsidiary screen 200d may both be inactive. At this time, based on the interaction method provided in this application, the user can quickly adjust the display position of the task window on the two-fold folding device 100 to display on the secondary screen 200b or to display on the secondary screen 200c.

[0094] Furthermore, the user can also unfold the folded secondary screen 200d in the tri-fold folding device 200 to the same plane as the secondary screen 200b and the secondary screen 200c through the unfolding operation ⑦. After the secondary screen 200d is unfolded, the secondary screen 200b, the secondary screen 200c and the secondary screen 200d can form a larger display screen. At this time, the tri-fold folding device 200 has unfolded the secondary screen 200b, the secondary screen 200c and the secondary screen 200d to the same plane based on the unfolding operation ⑥ and the unfolding operation ⑦, which may be referred to as the unfolded state below. In this unfolded state, the secondary screen 200b, the secondary screen 200c and the secondary screen 200d may all be in an activated state, and the main screen 200a may be in an inactivated state. At this time, the tri-fold folding device 200 can display one or more task windows on the secondary screen 200c and the secondary screen 200d, and display one or more task windows such as an input method soft keyboard on the secondary screen 200b. Among them, the secondary screen 200c and the secondary screen 200d form a larger display screen based on the above-mentioned expansion operation ⑦. At this time, based on the interaction method provided by the present application, the user can quickly adjust the display position of the task window on the tri-folding device 200 to display it on the secondary screen 200b, or adjust it to display it on the larger display screen composed of the secondary screens 200c and 200d.

[0095] This application does not provide any restrictive description of the folding axis setting position, folding method and folding direction of the foldable device.

[0096] Based on the interaction methods provided by the task control area in the examples of Figures 2a to 2d above, as well as examples such as the display position and style of the task control area, the implementation process of the interaction method provided in this application is described in detail below in combination with specific embodiments of different application scenarios.

[0097] The following first describes in detail the specific implementation process of the interaction method provided by this application in a foldable device in conjunction with Example 1.

[0098] Example 1

[0099] The embodiments of the present application provide a specific implementation process of an interaction method applied to a foldable device. The foldable device can refer to the foldable device 10 in the scenario shown in Figure 1 above, and can be an electronic device such as a foldable screen notebook or foldable screen mobile phone, foldable screen tablet, foldable screen large screen device, etc. The following continues to use the foldable device 10 in the scenario shown in Figure 1 above as an example to introduce the specific implementation process of the interaction method provided in the embodiments of the present application.

[0100] FIG4 is a schematic diagram illustrating an implementation flow of an interaction method according to an embodiment of the present application. It is understood that the execution entity of each step of the process shown in FIG4 can be a foldable device 10. As mentioned above, the foldable device can include electronic devices such as a foldable screen notebook or foldable screen mobile phone, a foldable screen tablet, and a foldable screen large screen device.

[0101] Specifically, as shown in FIG4 , the implementation process may include the following steps:

[0102] 401: An expansion operation within the preset angle range is detected.

[0103] For example, the foldable device 10 may include the two-fold foldable device supporting different folding modes as illustrated in Figures 3a and 3b above, the three-fold foldable device illustrated in Figure 3c, other multi-fold foldable devices, other foldable devices supporting different folding modes, and the like, without limitation. As an example, referring to Figures 3a to 3c above, the unfolding operation detected by the foldable device may include unfolding operation ④ shown in Figure 3a above, unfolding operation ⑤ shown in Figure 3b, unfolding operations ⑥ and ⑦ shown in Figure 3c, and the like.

[0104] It is understood that when the foldable device 10 is in the process of transitioning from the folded state to the unfolded state, when the angle between adjacent screens connected to the folding axis is greater than a smaller preset angle (which may be recorded as the first preset angle), the two adjacent screens are activated, and the foldable device 10 may first enter the aforementioned semi-expanded state. At this point, the foldable device 10 may continue to implement the following steps 402 to 408, such as displaying the task control area in response to user operations and adjusting the position of the relevant task window in the display area of ​​each screen based on the task control area, thereby continuing to implement the interaction method provided in the embodiment of the present application.

[0105] During the process of the foldable device 10 continuing to unfold, when the angle between the two adjacent screens connected to the folding axis reaches a larger preset angle (which can be recorded as the second preset angle), for example, when it reaches 180 degrees, the two screens can be combined into a larger screen, or in other words, the two adjacent screens as different display areas of the same screen are now combined into the same larger display area. At this time, the foldable device 10 is in the unfolded state and the interface can be displayed through the larger screen or larger display area. At this time, the foldable device 20 does not need to cross-screen operation, and the following steps can be no longer performed. The window control of the super window function can be turned on, and there is no need to display the task control area.

[0106] 402: In response to the first user operation, display a window control capable of enabling the super window function.

[0107] Exemplarily, the first user operation includes an operation of opening a control center, or an operation related to a super window function in a setting interface.

[0108] As an example, referring to FIG5 , when the foldable device 10 is in the semi-expanded state, the user can operate to open the control center 510 in the task bar displayed on the screen C of the foldable device 10. As shown in FIG5 , the control center 510 may include a window control 511 that can quickly open the super window function.

[0109] It is understood that in the embodiment of the present application, the first user operation is, for example, the user operation of opening the control center 510 as shown in Figure 5. In other embodiments, the first user operation may also be a voice command operation, etc. This is not limited here.

[0110] 403: A second user operation acting on the window control is detected, and a task control area corresponding to the super window function is displayed.

[0111] Exemplarily, the above-mentioned second user operation may include a click operation by the user on the window control, and an operation by the user through a voice command to instruct the foldable device 10 to start the switch of the super window function controlled by the above-mentioned window control, etc., which is not limited here.

[0112] As an example, referring to FIG5 , a user clicking on a window control 511 in the control center 510 can trigger the foldable device 10 to display a task control area 520. The task control area 520 can be used to control the actual task windows currently displayed. The thumbnail windows displayed in the task control area 520 can correspond to the actual task windows currently opened on the foldable device 10. It will be understood that the actual task windows can be interface display windows of applications running on the foldable device 10.

[0113] It is understood that the task control area 520 shown in FIG5 can be displayed on screen B, and can be displayed near the connection between screen B and screen C. In other embodiments, the display position and style of the task control area can also be different from the display position and style shown in FIG5 . For example, the task control area can also be displayed on screen C, which is not limited here.

[0114] In other embodiments, instead of displaying a thumbnail window, the task control area 520 may display icons of related applications or other identification graphics that can indicate the actual task window of the corresponding application, etc., which is not limited here.

[0115] 404: A third user operation acting on a target window in the task control area is detected.

[0116] Exemplarily, the third user operation includes at least one of the operations of dragging the target window up or down (refer to FIG. 2 a above), dragging the target window up and then hovering it or hovering it over the corresponding window (refer to FIG. 2 b above), and placing the mouse on the target window in the task control area, hovering it, and clicking on the called control (refer to FIG. 2 c above), etc., without limitation. It can be understood that the target window can be any window of one or more task windows displayed in the task control area, and the third user operation can control the target window to be displayed in any display area of ​​screen B or screen C of the foldable device 10, without limitation.

[0117] It is understandable that the foldable device 10 may preset a relevant threshold value corresponding to the above-mentioned third user operation as an identification condition for identifying the above-mentioned third user operation and thereby triggering the foldable device 10 to continue to perform the following steps. For example, with reference to FIG2a above, the foldable device 10 may preset a first distance threshold value corresponding to the user moving up or down, as an identification condition for detecting whether the user's operation of dragging the target window up or down can trigger the implementation of the following step 405. For another example, with reference to FIG2b above, the foldable device 10 may preset a second distance threshold value corresponding to the user moving up or down before hovering, as an identification condition for detecting whether the user wants to call out the layout menu, and this identification condition can be used to identify the user's intention. It is understandable that in some embodiments, the above-mentioned first distance threshold value may be greater than the above-mentioned second distance threshold value.

[0118] In other embodiments, as shown in FIG. 2 c above, a time threshold corresponding to the mouse hovering duration may be preset in the foldable device 10 as an identification condition for detecting whether the user wants to call up or down controls, etc., and no limitation is imposed here.

[0119] Specifically, the user performs the above-mentioned third user operation on the screen of the foldable device 10, and the interface change process of the foldable device 10 in response to the above-mentioned third user operation will be introduced in detail below in conjunction with the relevant interface schematic diagrams, and will not be repeated here.

[0120] 405: Determine the display area coordinates of the target window indicated by the third user operation.

[0121] For example, the foldable device 10 may determine the coordinates of the display area indicated by the third user operation based on the drag direction of the third user operation, or based on the position information of the display area selected by the third user operation. In some embodiments, the display area coordinates may be determined based on the position information of the layout area selected by the user in the layout menu. For example, if the user drags the target window upward, hovers over it, and selects a layout area under one of the layout styles in the layout menu that is triggered to display, the foldable device 10 may display the actual task window corresponding to the target window in the layout area.

[0122] It can be understood that the above-mentioned display area coordinates may include a set of coordinate information corresponding to the boundary position of the display area. The coordinate information set may include the coordinate values ​​of each point in the display area that can be determined in the display screen of the foldable device, which will not be elaborated here.

[0123] 406: Displaying the actual task window corresponding to the target window in the target display area indicated by the determined display area coordinates.

[0124] Exemplarily, the foldable device 10 determines the corresponding target display area based on the display area coordinates determined above. Referring to Figures 2a to 2c above, the display area can be located in screen B of the foldable device 10 or in screen C of the foldable device 10, without limitation. Furthermore, the foldable device 10 can control the display of the actual application window corresponding to the target window in the target display area. It is understood that the actual application window can be an interactive interface display window for an application such as an office application or a browser application.

[0125] The following will be combined with Figures 6a to 6d, Figures 7a to 7c, Figures 8a to 8c, and Figures 9a to 9f to illustrate the interface changes involved in the process of executing steps 404 to 406 on the foldable device 10. Specifically:

[0126] 6a to 6d are schematic diagrams showing an interface change process triggered by an operation mode of a third user operation according to an embodiment of the present application.

[0127] Referring to Figure 6a, after the foldable device 10 executes step 403 above and detects the second user operation, it can display the task control area 520 shown in Figure 6a, that is, the task control area 520 shown in Figure 5 above. As shown in Figure 6a, the user can drag window 521 downward in the task control area 520 displayed on the foldable device 10. The window 521 can be a thumbnail window corresponding to the actual task window 610 currently displayed on screen B. Therefore, the operation of dragging window 521 downward as shown in Figure 6a can instruct the foldable device 10 to display the actual task window 610 on screen C, or to adjust the actual task window 610 to be displayed on screen C. Among them, the window 521 in the task control area 520 can be a thumbnail window of the actual task window 610.

[0128] It is understood that the foldable device 10 can determine to display the actual task window 610 corresponding to the window 521 on the screen C when detecting that the user drags the window 521 downward for a distance exceeding the first preset distance. At this time, the foldable device 10 can continue to display the interface shown in Figure 6b.

[0129] 6b , in response to a third user operation of dragging a thumbnail window in the task control area downward, the foldable device 10 may display an actual task window 610 corresponding to the thumbnail window on screen C. At this point, the user may continue to perform other operations in the actual task window 610 displayed on screen C to interact with the application corresponding to the actual task window 610.

[0130] Referring to Figure 6c , after the foldable device 10 performs step 403 above and detects the second user operation, it may display the task control area 520 shown in Figure 6c , i.e., the task control area 520 shown in Figure 5 . Within the task control area 520 displayed on the foldable device 10 , the user may drag window 522 upward. This window 522 may be a thumbnail window corresponding to the actual task window 620 currently displayed on screen C. Therefore, the upward dragging of window 522 shown in Figure 6c may instruct the foldable device 10 to display the actual task window 620 on screen B, or in other words, to adjust the actual task window 620 to be displayed on screen B. Window 522 in the task control area 520 may be a thumbnail window of the actual task window 620. Window 522 and window 521 may be the same thumbnail window or different thumbnail windows. Correspondingly, the actual task window 620 may be the same task window or a different task window, without limitation.

[0131] It is understood that the foldable device 10 can determine to display the actual task window 620 corresponding to the window 522 on the screen B when detecting that the user drags the window 522 upward for a distance exceeding the first preset distance. At this time, the foldable device 10 can continue to display the interface shown in Figure 6d.

[0132] 6d , in response to a third user operation of dragging a thumbnail window in the task control area downward, the foldable device 10 may display an actual task window 620 corresponding to the thumbnail window on screen B. At this point, the user may continue to perform other operations in the actual task window 620 displayed on screen B to interact with the application corresponding to the actual task window 620.

[0133] 7a to 7c are schematic diagrams illustrating an interface change process triggered by another operation mode of a third user operation according to an embodiment of the present application.

[0134] Referring to Figure 7a , after the foldable device 10 performs step 403 and detects the second user operation, it may display the task control area 520 shown in Figure 7a , which is the task control area 520 shown in Figure 5 . Referring to operation ⑧ shown in Figure 7a , the user may drag window 521 downward a certain distance within the task control area 520 displayed on the foldable device 10 and then hover the window. This operation ⑧ may trigger the foldable device 10 to display a layout menu, the format of which may be referred to as layout menu 710 shown in Figure 7b below.

[0135] Referring to Figure 7b , in response to the aforementioned operation (8), the foldable device 10 displays a layout menu 710 above the layer where the task control area 520 is located. As shown in Figure 7b , the layout menu 710 may be displayed below the dragged window 521 in response to the downward movement operation in the aforementioned operation (8). The layout menu 710 may display multiple recommended layouts, each of which controls the display area of ​​the actual task window 720 corresponding to the window 521 on the lower screen C. For example, a user may select the recommended window 711 in the layout menu 710 shown in Figure 7b . In response to the user selecting the recommended window 711, the foldable device 10 may display the actual task window 720 in the lower area of ​​screen C. See Figure 7c for the display position of the actual task window 720 on screen C. Window 521 may be a thumbnail window corresponding to the actual task window 720 displayed on screen B as shown in Figures 7a and 7b . This window 720 may be the same as or different from the actual task window 610 described above, without limitation.

[0136] Continuing to refer to FIG. 7 c , the upper area 730 of the screen C of the foldable device 10 may display task windows corresponding to other applications that were originally displayed, such as an input method soft keyboard window, etc., or may not display other task windows.

[0137] 8a to 8c are schematic diagrams illustrating an interface change process triggered by another operation mode of a third user operation according to an embodiment of the present application.

[0138] Referring to Figure 8a , after the foldable device 10 performs step 403 and detects the second user operation, it may display the task control area 520 shown in Figure 8a , which is the task control area 520 shown in Figure 5 . Referring to operation 9 in Figure 8a , the user may drag window 521 upward a certain distance and then hover it within the task control area 520 displayed on the foldable device 10 . This operation 9 may trigger the foldable device 10 to display a layout menu, the format of which may be referred to as layout menu 810 shown in Figure 8b below.

[0139] Referring to Figure 8b , in response to the aforementioned operation ⑨, the foldable device 10 displays a layout menu 810 above the layer where the task control area 520 is located. As shown in Figure 8b , the layout menu 810 may be displayed below the dragged window 521, corresponding to the upward movement operation in the aforementioned operation ⑨. This layout menu 810 may display multiple recommended layouts, each of which controls the display area of ​​the actual task window 820 corresponding to window 521 on the upper screen B. For example, a user may click on the recommended window 811 in the layout menu 810 shown in Figure 8b . In response to the user selecting the recommended window 811, the foldable device 10 may display the actual task window 820 in the upper left area of ​​screen B. Refer to Figure 8c for the display position of the actual task window 820 on screen B. Window 521 may be a thumbnail window corresponding to the actual task window 820 displayed on screen C, as shown in Figures 8a and 8b . This window 820 may be the same as or different from the actual task window 610 described above, without limitation.

[0140] 8c , the upper right and lower display areas 830 of the screen B of the foldable device 10 may display task windows corresponding to other applications that were originally displayed, such as an input method soft keyboard window, or may not display other task windows.

[0141] 9a to 9f are schematic diagrams illustrating an interface change process triggered by another operation mode of a third user operation according to an embodiment of the present application.

[0142] Referring to Figure 9a, after the foldable device 10 executes the above step 403 and detects the second user operation, it can display the task control area 520 shown in Figure 9a, that is, the task control area 520 shown in Figure 5 above. As shown in Figure 9a, the user can operate the mouse 910 to hover over the window 521 in the task control area 520. At this time, the foldable device 10 can display the layout control 911 and the layout control 912 on the window 521 in response to the mouse hovering operation. Among them, the layout control 911 can be used to adjust the actual task window corresponding to the window 521 to be displayed on the screen C below, and can also be described as a control indicating downward; the layout control 912 can be used to adjust the actual task window corresponding to the window 521 to be displayed on the screen B above, and can also be described as a control indicating upward.

[0143] Continuing with Figure 9b , a user can operate mouse 910 to click on layout control 911 displayed on foldable device 10. Correspondingly, foldable device 10, in response to the mouse click, can control the display of actual task window 920 corresponding to window 521 on screen C indicated by layout control 911. See Figure 9c for actual task window 920 displayed on screen C. It will be appreciated that actual task window 920 could originally be displayed on screen B. In other embodiments, task window 920 could also originally be displayed on screen C.

[0144] Continuing with reference to FIG9d , the user can operate the mouse to place the mouse over the window 522 in the task control area 520 and hover it. At this point, the foldable device 10 can respond to the mouse hovering operation and also display the layout control 911 and the layout control 912 on the window 522. At this point, as shown in FIG9e , the user can operate the mouse 910 to click the layout control 912 displayed by the foldable device 10. Correspondingly, as shown in FIG9f , the foldable device 10 can control the actual task window 930 corresponding to the window 522 to be displayed on the screen B indicated by the layout control 912 in response to the mouse click operation. FIG9f shows the actual task window 930 displayed on the screen B. It can be understood that the actual task window 930 can originally be a window displayed on the screen C. In other embodiments, the timing task window 930 can also originally be a window displayed on the screen B.

[0145] It is understood that in some embodiments, the foldable device 10 may not display other windows before responding to the third user operation and adjusting the actual task window corresponding to the thumbnail window in the task control area operated by the user to be displayed on screen C. In this case, the foldable device 10 may display the relevant actual task window in the center area of ​​screen C in response to the third user operation, and the actual task window may be enlarged to adapt to the size of screen C.

[0146] In other embodiments, the screen C of the foldable device 10 may also display the task window of the input method soft keyboard or other application before displaying the actual task window indicated by the third user operation. In this case, the foldable device 10 may reduce the size of the task window of the input method soft keyboard or other application originally displayed on the screen C in response to the third user operation, and display the actual task window indicated by the third user operation in an area of ​​the screen C where no other windows are currently displayed. In other embodiments, the foldable device 10 may also display the actual task window indicated by the third user operation above the task window of the input method soft keyboard or other application originally displayed on the screen C, or control the display area of ​​the actual task window to partially overlap with the display area of ​​the task window of the input method soft keyboard or other application, etc., in response to the third user operation, and is not limited here. The above-mentioned actual task window may include the above-mentioned actual task window 610, actual task window 720, and actual task window 920, etc., which are not limited here.

[0147] Similarly, in some embodiments, screen B of the foldable device 10 may not display other windows before displaying the actual task window indicated by the third user operation. In this case, the foldable device 10, in response to the third user operation, may control the display of the actual task window indicated by the third user operation in the center area of ​​screen B, and the actual task window may be enlarged to adapt to the size of screen B.

[0148] In other embodiments, the screen B of the foldable device 10 may also display task windows of other applications before displaying the actual task window indicated by the third user operation. In this case, the foldable device 10 may reduce the size of the task window of the other application originally displayed on the screen B in response to the third user operation, and display the actual task window indicated by the third user operation in an area of ​​the screen B where no other windows are currently displayed. In other embodiments, the foldable device 10 may also display the actual task window indicated by the third user operation above the task window of the other application originally displayed on the screen B in response to the third user operation, or control the display area of ​​the actual task window to partially overlap with the display area of ​​the task window of other applications, etc., which are not limited here. Among them, the above-mentioned actual task window may include the above-mentioned actual task window 610, actual task window 720 and actual task window 920, etc., which are not limited here.

[0149] It can be understood that based on the implementation process of steps 401 to 406 shown in Figure 4 above, as well as the operation methods and related interface change processes of the third user operation exemplified in Figures 6a to 6d, 7a to 7c, 8a to 8c, and 9a to 9f above, the interaction method provided in the embodiment of the present application, when applied to the foldable device 10, can provide users with more convenient cross-screen operation services such as adjusting the window display position across screens, and the task control area displayed near the screen folding axis of the foldable device 10 or on the lower screen C in a semi-expanded state can effectively avoid the problem of the user applying pressure on the screen of the foldable device 10 when sliding, which can easily cause the device to tip over.

[0150] The following first describes in detail the specific implementation process of the interaction method provided by the present application in the scenario of an external extended display screen in conjunction with Example 2.

[0151] Example 2

[0152] The present application provides a specific implementation process of an interaction method applied to a scenario where an electronic device has an externally extended display screen. The electronic device may include a mobile phone, tablet, laptop, desktop computer, large-screen device, or other electronic device. The electronic device may be a foldable device or an electronic device with a non-foldable display screen, without limitation.

[0153] FIG10 shows a schematic diagram of a scenario in which an electronic device is connected to an external extended display screen according to an embodiment of the present application.

[0154] As shown in Figure 10, the scene includes an electronic device 30 and an external extended display screen 20. The extended display screen 20 can be connected to the electronic device 30 and provide an extended screen display area for the electronic device 30 for user convenience.

[0155] Figure 11 illustrates a schematic flow diagram of an implementation of an interactive method according to an embodiment of the present application. It is understood that the execution entity of each step of the process shown in Figure 11 can be the aforementioned electronic device 30. As previously mentioned, the electronic device 30 can be a tablet, notebook, desktop computer, large-screen device, etc., or the aforementioned foldable device 10, without limitation.

[0156] Specifically, as shown in FIG11 , the implementation process may include the following steps:

[0157] 1101: A connection with an extended display was detected.

[0158] For example, the electronic device 30 can be connected to the extended display screen 20 via a data cable, and the interface type of the data cable may include a high-definition multimedia interface (HDMI), mini HDMI, micro HDMI, or a universal serial bus (USB). In other embodiments, the electronic device 30 and the extended display screen 20 can also establish a data connection via wireless communication, which is not limited here.

[0159] It can be understood that after the connection between the electronic device 30 and the extended display screen 20 is established, display data related to the window or interface can be transmitted between the two to display the task windows of some application programs running on the electronic device 30.

[0160] 1102: In response to the first user operation, display a window control capable of enabling the super window function.

[0161] The first user operation may refer to the operation of opening the control center 510 in the taskbar as shown in FIG5 in the embodiment 1. The detailed process of the electronic device 30 performing this step 1102 may refer to the description of step 402 in the embodiment 1, which will not be repeated here.

[0162] 1103: A second user operation acting on the window control is detected, and a task control area corresponding to the super window function is displayed.

[0163] The first user operation may refer to the operation of clicking the window control 511 as shown in FIG5 in the embodiment 1. The detailed process of the electronic device 30 performing step 1103 may refer to the description of step 403 in the embodiment 1, which will not be repeated here.

[0164] 1104: A third user operation acting on a target window in the task control area is detected.

[0165] For example, the display position and style corresponding to the task control area in the embodiment of the present application can refer to the display position and style illustrated in Figure 2d above. The specific operation method of the above-mentioned third user operation can refer to the relevant description of the click indication to the right or left control in Figure 2d above, which will not be repeated here.

[0166] The detailed process of the electronic device 30 executing step 1104 can refer to the relevant description of step 404 in the above embodiment 1, and will not be repeated here.

[0167] 1105: Determine the display area coordinates of the target window indicated by the third user operation.

[0168] For example, in an embodiment of the present application, the display area coordinates of the target window indicated by the third user operation indication can be located in screen A of the extended display screen 20 in the scene shown in FIG10 , or in screen B of the electronic device 30 , or in screen C of the foldable device 10 , without limitation herein.

[0169] The detailed process of the electronic device 30 executing step 1105 can refer to the relevant description of step 405 in the above embodiment 1, and will not be repeated here.

[0170] 1106: Display the actual task window corresponding to the target window in the target display area indicated by the determined display area coordinates.

[0171] The detailed process of the electronic device 30 executing step 1106 can refer to the relevant description of step 406 in the above embodiment 1, and will not be repeated here.

[0172] It can be understood that based on the implementation process of steps 1101 to 1106 shown in FIG. 11 above, when the interactive method provided in the embodiment of the present application is applied to electronic devices other than the foldable device 10, it can provide users with more convenient cross-screen operation services such as adjusting the display position of windows across screens, making it convenient for users to switch the screen display of the actual task window between the local display screen of the electronic device 30 and the extended display screen 20. Moreover, when the electronic device 30 is a foldable device 10, it can also facilitate users to transfer the actual task window displayed on the foldable device 10 to the extended display screen 20 for display. In this scenario, the interactive method provided in the present application can effectively avoid the problem of the user applying pressure when sliding on the screen of the foldable device 10, which can easily cause the device to tip over.

[0173] The following is an exemplary introduction to the operating system software structure and hardware structure of the electronic device to which the interactive method provided in the embodiment of the present application is applied, in conjunction with the relevant drawings.

[0174] FIG12 is a schematic diagram of the software structure of an operating system according to an embodiment of the present application.

[0175] It is understood that the operating system of the electronic device 30 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. TM Taking the system as an example, the system software structure of the electronic device 30 is exemplified.

[0176] A layered architecture divides software into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces.

[0177] Windows TMThe operating system can generally be divided into kernel mode and user mode.

[0178] User mode applications include system applications, office applications, conference applications, video applications, and creative applications, as shown in Figure 12. Applications in user mode can call core capabilities and drivers in kernel mode based on the Windows subsystem and native application programming interfaces (native APIs).

[0179] Continuing with reference to FIG12 , the kernel mode can provide a super window component, a control center, and a driver management module. The super window component can provide the electronic device 30 with the ability to manage window layouts. This component can integrate capabilities such as a window layout menu, a task hub window, and a floating ball.

[0180] Among them, the task hub window can correspond to the window displayed in the above-mentioned task control area, and the user can operate the thumbnail window in the task hub window to adjust the display position of the corresponding actual task window. The task hub window is the core window of the super window component, which can provide the ability to display the thumbnail window corresponding to the actual task window, and provide convenient layout capabilities such as adjusting the actual task window layout by sliding the thumbnail window up and down. In other embodiments, the above-mentioned task hub window or task control area can display icons or window icons of related applications, which are not limited here.

[0181] The window layout menu can be used to display the layout menu for the target window when the trigger condition is met. For example, when a drag operation of the user moving the target window and hovering it is detected in the task center window, a quick layout menu pops up to facilitate the user to quickly preview the layout effect and real-time layout, such as the layout menu 221 or layout menu 222 shown in Figure 2b above, or the layout menu 710 shown in Figure 7b above or the layout menu 810 shown in Figure 8b above, etc.

[0182] The hover ball can be used to provide convenient access to the mission hub window when folding and unfolding. The hover ball can be closed in the control center.

[0183] The control center can be used to provide a switch entrance for the super window function, for example, by displaying the above-mentioned window control 511 and providing a switch entrance for the super window function.

[0184] The driver management module can be used to manage various driver programs, including the following display driver and integrated sensor driver, for example, providing driver version installation and upgrade capabilities.

[0185] The Super Window component can also include a design for X (DFX) plug-in for each stage of the product life cycle, which can provide the Super Window with design capabilities for each stage of the product life cycle (referred to as DFX capabilities). Electronic devices can provide DFX capabilities for the Super Window component through the HiViewDFX plug-in (a type of DFX plug-in).

[0186] Continuing to refer to Figure 12, Windows TM The kernel mode of the operating system may also include an integrated sensor driver (ISH driver) and a display driver. The ISH driver may provide notifications of device state switching. For example, if the electronic device 30 is a foldable device, the ISH driver may provide notifications related to state switching of the foldable device from a folded state to a semi-expanded state, and from an expanded state to a semi-expanded state.

[0187] Continuing to refer to Figure 12, Windows TM The kernel mode of the operating system can also provide basic capability components and background business components.

[0188] Basic capability components include gesture recognition, upgrades, shape change recognition, and monitoring of keyboard and mouse events and window events. These basic capability components provide the foundation for capabilities such as backend services, window layout menus, task hub windows, and floating balls.

[0189] Backend business components can provide background feature business logic processing, such as icon management, throwing algorithm, waterfall flow, window memory, and window movement effects.

[0190] Continuing to refer to Figure 12, Windows TM The kernel mode of the operating system may also include a basic input / output system (BIOS), which is used to receive input and output signals and calculation perception results provided by an embedded controller (EC, also known as an EC chip) and an integrated sensor framework (ISH FW), including keyboard adsorption signals connected to the electronic device 30, opening and closing cover signals of foldable devices, etc., and calculation perception results determined by the ISH FW based on angle calculation and pattern recognition based on sensor information such as gyroscope sensors and acceleration sensors, etc., which will not be elaborated here.

[0191] Next, we will continue with Harmony with a layered architecture. TMTaking the system as an example, the system software structure of the electronic device 30 is exemplified.

[0192] FIG13 provides a schematic diagram of the software structure of another operating system according to an embodiment of the present application.

[0193] As shown in FIG13 , the electronic device 30 can be equipped with a distributed system, such as Hongmeng TM Operating System (Harmony TM The distributed system may adopt a layered architecture, which may include an application layer, an application framework and system service layer, a driver layer, and a hardware abstraction layer (HAL).

[0194] The application layer may include a series of application packages, including system applications, office applications, conference applications, video applications, and creative applications, for example, application packages including input methods, main applications, video applications, and browser applications, without limitation.

[0195] The application framework and system service layer can provide distributed framework services for the application layer. The system service is the core of the distributed operating system and can provide services to applications and SDKs in the application layer through the application framework. Among them, the distributed framework services may include desktop management services, window management services, graphics services, Ark development framework, and multi-modal input framework. Among them, the desktop management service can determine whether an operation gesture for adjusting the window display position across the screen is detected based on the posture recognition of the foldable device and finger touch events, and notify the window management service.

[0196] The window management service can manage the actual task window corresponding to the target window to be displayed across the screen to the part of the screen indicated by the above operation gesture based on the detected operation gesture for adjusting the window display position across the screen, and perform cross-screen layout window processing.

[0197] The application framework and system service layer can also include system services such as folding gesture feedback, layer control and composition, display memory management, and touch screen management. Touch screen management can be used to report touch events corresponding to user finger operations on the touch screen, for example, to the desktop management service.

[0198] The driver layer, also known as the kernel layer, can include various driver programs that control the hardware devices controlled by the hardware abstraction layer to implement related functions. In the embodiment of the present application, the driver layer can include sensor drivers, frame buffers (a type of display device driver), and touch drivers.

[0199] The Hardware Abstraction Layer (HAL) is an interface layer between the operating system kernel and the hardware circuit, used to abstract the hardware devices. In the embodiment of the present application, the hardware devices abstracted in the HAL may include sensors or sensor modules, touch screens, keyboards, mice, etc., without limitation.

[0200] FIG14 shows a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application.

[0201] As shown in Figure 14, the electronic device 30 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identity module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0202] It should be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 30. In other embodiments of the present application, the electronic device 30 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0203] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0204] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0205] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0206] In an embodiment of the present application, the processor 110 can complete the control of fetching instructions and executing instructions from the memory through the controller, so that the electronic device 30 implements the steps of the implementation process shown in Figure 4 provided in the above embodiment 1 or implements the steps of the implementation process shown in Figure 11 provided in the above embodiment 2 to realize the interactive method provided by the present application.

[0207] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a universal serial bus (USB) interface.

[0208] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 30. In other embodiments of the present application, the electronic device 30 may also adopt a different interface connection method from the above embodiment, or a combination of multiple interface connection methods.

[0209] The wireless communication function of the electronic device 30 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0210] Electronic device 30 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0211] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. In embodiments of the present application, display screen 194 of electronic device 30 may include screen B and screen C of the foldable device 10 described above in a semi-unfolded state. In some embodiments, electronic device 30 may include one or N display screens 194, where N is a positive integer greater than one.

[0212] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 30. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0213] The internal memory 121 can be used to store computer executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 30 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 30 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0214] The electronic device 30 can implement audio functions such as music playback and recording through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0215] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device including at least two parallel plates with conductive material. When force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 30 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 30 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 30 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.

[0216] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 30. In some embodiments, the angular velocity of the electronic device 30 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 30 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 30 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0217] Accelerometer 180E can detect the magnitude of acceleration of electronic device 30 in all directions (generally three axes). When electronic device 30 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0218] The touch sensor 180K is also referred to as a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also referred to as a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 30, at a location different from that of the display screen 194.

[0219] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 30 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 30.

[0220] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. In addition, touch operations acting on different areas of the display screen 194 can also correspond to different vibration feedback effects of motor 191. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects.

[0221] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0222] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 30 by inserting or removing the SIM card into or from the SIM card interface 195 .

[0223] The embodiments of the present application also provide a computer program product for implementing the interaction methods provided in the above embodiments.

[0224] The various embodiments of the mechanisms disclosed in this application can be implemented in hardware, software, firmware, or a combination of these implementation methods. The embodiments of the present application can be implemented as computer program modules or module codes executed on a programmable system, which includes at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0225] A computer program module or module code can be applied to input instructions to perform the functions described herein and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.

[0226] Module code can be implemented with high-level modular language or object-oriented programming language to communicate with the processing system. When necessary, module code can also be implemented with assembly language or machine language. In fact, the mechanism described in this application is not limited to the scope of any specific programming language. In either case, the language can be a compiled language or an interpreted language.

[0227] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, instructions may be distributed over a network or through other computer-readable media. Therefore, a machine-readable medium may include any mechanism for storing or transmitting information in a machine (e.g., computer) readable form, including but not limited to a floppy disk, an optical disk, an optical disk, a magneto-optical disk, a read-only memory (ROM), a random access memory (RAM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic card or an optical card, a flash memory, or a tangible machine-readable memory for transmitting information (e.g., a carrier wave, an infrared signal, a digital signal, etc.) using the Internet in an electrical, optical, acoustic, or other form of propagation signal. Accordingly, machine-readable media includes any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a form readable by a machine (eg, a computer).

[0228] References in the specification to "one embodiment" or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one exemplary implementation or technique disclosed according to the embodiment of the present application. The appearances of the phrase "in one embodiment" in various places in the specification do not necessarily all refer to the same embodiment.

[0229] The disclosure of the embodiments of the present application also relates to an operating device for executing the text. The device can be constructed specifically for the required purpose or it can include a general-purpose computer that is selectively activated or reconfigured by a computer program stored in the computer. Such a computer program can be stored in a computer-readable medium, such as, but not limited to, any type of disk, including a floppy disk, an optical disk, a CD-ROM, a magneto-optical disk, a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM, a magnetic or optical card, an application-specific integrated circuit (ASIC) or any type of medium suitable for storing electronic instructions, and each can be coupled to a computer system bus. In addition, the computer mentioned in the specification can include a single processor or can be an architecture involving multiple processors for increased computing power.

[0230] In addition, the language used in this specification has been primarily selected for readability and instructional purposes and may not be selected to describe or limit the disclosed subject matter. Therefore, the present disclosure of embodiments is intended to illustrate, not to limit, the scope of the concepts discussed herein.

Claims

1. An interactive method, applied to an electronic device, characterized in that: The method comprises: Displaying a first interface, wherein the first interface includes a first window and a first display area, and the first display area includes a first logo of the first window; detecting a first drag operation of the user on the first logo; Corresponding to the first drag operation, the first window is moved.

2. The method according to claim 1, characterized in that The electronic device comprises a foldable device, wherein the foldable device comprises a first screen portion and a second screen portion located on either side of a folding axis.

3. The method according to claim 2, characterized in that The first screen portion is located in a first direction of the second screen portion, and the second screen portion is located in a second direction of the first screen portion, wherein the first direction is opposite to the second direction.

4. The method according to claim 3, characterized in that The first display area is located in the first screen portion.

5. The method according to claim 4, characterized in that The detecting a first drag operation of the user on the first logo image includes: An operation of a user dragging the first identification image to move toward the second direction is detected.

6. The method according to claim 4, characterized in that The second screen portion includes a displayed second interface, the second interface includes a second window, and the first display area includes a second logo corresponding to the second window.

7. The method according to claim 6, characterized in that The method comprises: detecting a second dragging operation of the user dragging the second identification image toward the first direction; Corresponding to the second drag operation, the second window is moved to the first interface displayed on the first screen portion.

8. The method according to claim 7, characterized in that The detecting a first drag operation of the user on the first logo image includes: It is detected that a first distance that the user drags the first identification image in the second direction satisfies a first threshold condition; and / or, The detecting a second dragging operation in which the user drags the second identification image to move in the first direction includes: It is detected that a second distance for the user to drag the second identification image in the first direction satisfies the first threshold condition.

9. The method according to claim 4, characterized in that The detecting a first drag operation of the user on the first logo image includes: detecting a first combined operation of the user on the first logo, wherein the first combined operation includes a first operation of dragging the first logo toward the second direction and hovering the first logo, and An operation of a user selecting a first area in a second display area displayed by the first operation trigger is detected, wherein: The second display area includes at least one display region recommended for the first window, the at least one display region includes the first region, and the at least one display region is located within the display region of the second screen portion.

10. The method according to claim 9, characterized in that The moving the first window in response to the first drag operation includes: Corresponding to the first combining operation, the first window is displayed in a corresponding area of the first area in the second screen portion.

11. The method according to claim 6, characterized in that The method comprises: detecting a second combined operation of the user on the second logo, wherein the second combined operation includes a second operation of dragging the second logo toward the first direction and hovering the second logo, and detecting an operation of a user selecting a second area in a third display area displayed by the second operation trigger, wherein the third display area includes at least one display area recommended for the second window, the at least one display area includes the second area, and the at least one display area is located within the display area of the first screen portion; Corresponding to the second combining operation, the second window is displayed in a corresponding area of the second area in the first screen portion.

12. The method according to claim 11, characterized in that The third distance of dragging the first logo image to the second direction satisfies a second threshold condition; and / or, The fourth distance of dragging the second identification image toward the first direction satisfies the second threshold condition.

13. The method according to any one of claims 9 to 12, characterized in that The duration corresponding to the hovering operation meets a third threshold condition.

14. The method according to claim 4, characterized in that The detecting a first drag operation of the user on the first logo image includes: detecting a third combined operation performed by a user on the first logo using a mouse, the third combined operation including placing the mouse on the first logo and hovering the mouse; and An operation of a user clicking a first control among the multiple controls displayed by the third operation triggering display by a mouse is detected, wherein the first control is used to indicate a screen portion where the first window is displayed.

15. The method according to claim 14, characterized in that The screen portion displayed by the first control indication is the second screen portion.

16. The method according to claim 15, characterized in that The moving the first window in response to the first drag operation includes: Corresponding to the third combined operation, the first window is displayed in the second screen portion indicated by the first control.

17. The method according to claim 16, characterized in that An icon indicating the second direction is displayed on the first control.

18. The method according to any one of claims 14 to 17, characterized in that The duration corresponding to the hovering operation meets a fourth threshold condition.

19. The method according to claim 3, characterized in that The first display area is located in the second screen portion.

20. The method according to claim 19, characterized in that The detecting a first drag operation of the user on the first logo image includes: An operation of a user dragging the first identification image to move toward the first direction is detected.

21. The method according to claim 19, wherein The detecting a first drag operation of the user on the first logo image includes: detecting a fourth combined operation of the user on the first logo, wherein the fourth combined operation includes a fourth operation of dragging the first logo toward the first direction and hovering the first logo, and An operation of selecting a third area in a fourth display area triggered by the fourth operation is detected, wherein: The fourth display area includes at least one display region recommended for the first window, the at least one display region includes the third region, and the at least one display region is located within the display region of the first screen portion.

22. The method according to claim 19, wherein The detecting a first drag operation of the user on the first logo image includes: detecting a fifth combined operation performed by a user on the first logo using a mouse, the fifth combined operation including a fifth operation of placing the mouse on the first logo and hovering the mouse; and An operation of a user clicking a second control among the multiple controls displayed by the fifth operation is detected, wherein the second control is used to indicate the screen portion where the first window is displayed, and the screen portion includes the first screen portion or the second screen portion.

23. The method according to any one of claims 1 to 19, characterized in that The first identification diagram includes: The thumbnail window corresponding to the first window; or The application icon corresponding to the application interface displayed in the first window.

24. An electronic device, characterized in that: include: one or more processors; One or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device executes the interaction method according to any one of claims 1 to 23.

25. A computer-readable medium, characterized in that The readable medium stores instructions, which, when executed on a computer, cause the computer to execute the interactive method according to any one of claims 1 to 23.

26. A computer program product, characterized in that The method comprises a computer program / instruction, which implements the interactive method according to any one of claims 1 to 23 when executed by a processor.

Images