Interaction method, electronic device, readable medium and program product
By adjusting the window position in the task control area of the foldable device, the problem of long cross-screen operation paths and easy to damage the screen is solved, and efficient window position adjustment and improved user experience is achieved.
Patent Information
- Application Number
- CN202410176385.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-02-07
- Publication Date
- 2025-08-08
AI Technical Summary
The foldable device has a long path when dragging the window across the screen, which can easily cause wear on the screen and may cause the device to tip over, making the user experience poor.
The task control area is displayed on the screen of the foldable device, and the window position is adjusted by the thumbnail window operation in the area, identify the user's drag intention and quickly move the window to the target area, reducing the cross-screen operation distance.
It avoids damage to the direct sliding operation of the screen, improves the efficiency of window position adjustment, and improves the user experience.
Smart Images

Figure CN120447791A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to an interaction method, electronic equipment, readable medium and program product. Background Art
[0002] With the development of smart terminal technology, the emergence of foldable devices meets users' demand for different screen sizes. A foldable device may include one or more display screens that can display application interfaces. When a foldable device includes a single screen, the screen may be folded using flexible folding technology, such as a flexible folding screen. When a foldable device includes multiple screens, each screen may be folded using flexible folding technology or a hinge or other folding technology.
[0003] While foldable devices provide users with more screen space, users switch between multiple screens more frequently. Figure 1 As shown in (a), when the foldable device 10 enters the unfolded state after the unfolding operation, the screen B and the screen C can form a larger screen A, and one or more windows are displayed on the screen A. Figure 1 In (b) of the embodiment, after the foldable device 10 enters the semi-expanded state through a folding operation, or after the foldable device 10 enters the semi-expanded state through an unfolding operation, screen B and screen C can each display one or more task windows. For example, a user can edit a document in a window displayed on screen B and open multiple reference documents for viewing on screen C. When the user needs to move the window displaying the reference documents on screen C to screen B, or when the user needs to move the window being edited on screen B to screen C, the user needs to drag the windows across the screens.
[0004] However, the operation path of dragging a window across the screen is long, and the user may cause wear and tear to the screen of the foldable device 10 during the dragging process. Moreover, if the foldable screen device 10 is placed on an object, such as a desktop, if the user applies pressure to screen B while dragging the window, it may cause the foldable device 10 to fall over, resulting in a poor user experience. Summary of the Invention
[0005] The present application provides an interactive method, electronic device, readable medium, and program product that facilitate users to quickly adjust window positions on foldable devices or various collaborative devices that require dragging windows across screens. Furthermore, the user's operation path for adjusting window positions across screens can be shortened, and the window position can be adjusted by simply dragging the mouse or sliding a touch object a short distance on the foldable device's screen. This can prevent screen damage caused by sliding operations on the user's screen and improve the user's efficiency in adjusting the positions of windows displayed on the screen, thereby enhancing the user experience.
[0006] In a first aspect, the present application provides an interaction method applied to an electronic device, the method comprising: displaying a first interface, wherein the first interface includes a first window and a first display area, the first display area includes a first identification image of the first window; detecting a first drag operation of the user on the first identification image; and moving the first window in response to the first drag operation.
[0007] For example, the electronic device may be a foldable screen notebook, and the first interface may be an interface or window displayed when the electronic device runs various applications, such as a desktop. The first window may be a task window that displays the corresponding application interface, such as a window that displays the homepage interface of a video application. Alternatively, the first window may also be a sub-page window on the corresponding application interface, such as a video playback window of a video application. The first display area may be, for example, a task control area that includes thumbnail windows or application icons corresponding to one or more task windows displayed by the electronic device. The thumbnail window may include the first identification image of the first window, that is, the thumbnail window or application icon of the first window. The first dragging operation may be an operation in which the user drags the first identification image in the task control area. Correspondingly, the first window may be adjusted to be displayed in the area specified by the user according to the direction and distance of the dragging operation.
[0008] In some implementations, the logo image is also called a preview image, or in other implementations, the logo image can be carried or implemented in the form of a control, a button, or other forms.
[0009] In this way, the user can adjust the screen displayed by the actual window by applying a small sliding operation to the thumbnail window in the task control area. For example, without using an access device such as a mouse, the user's finger only needs to slide up or down a short distance on the thumbnail window in the task control area to adjust the corresponding window from one screen to another. This can not only prevent the sliding operation on the user's screen from causing damage to the screen, but also improve the efficiency of the user in adjusting the position of each window displayed on the screen, thereby improving the user's experience.
[0010] In a possible implementation of the first aspect, the electronic device includes a foldable device, wherein the foldable device includes a first screen portion and a second screen portion located on both sides of a folding axis.
[0011] For example, the electronic device may be a foldable laptop, which may be a bifold, trifold, or multifold device. Taking a bifold device as an example, the first screen portion of the foldable laptop may be the screen on one side of the folding axis, and the second screen portion may be the screen on the other side of the folding axis. When the foldable laptop is unfolded, the two screen portions may form a larger screen. The screen portions may be components of the same screen or may be two relatively independent screens, without limitation.
[0012] In a possible implementation of the first aspect, the first screen portion is located in a first direction of the second screen portion, and the second screen portion is located in a second direction of the first screen portion, wherein the first direction is opposite to the second direction.
[0013] For example, a screen portion of a foldable notebook may be located on one side of a folding axis, and another screen portion may be located on the other side of the folding axis. Therefore, one screen portion may be located in a certain direction relative to the other screen portion, such as the first direction or the second direction mentioned above. The first direction may be, for example, an upward direction, the second direction may be, for example, a downward direction, and the first screen portion may be the following: Figure 2a The screen A and the second screen portion may be as follows Figure 2b In the screen B, the first screen part, i.e., screen A, can be in a suspended state, and the second screen part, i.e., screen B, can be placed on a desktop or other supporting surface.
[0014] In a possible implementation of the first aspect above, the first display area is located in the first screen portion.
[0015] In a possible implementation of the first aspect, detecting a first dragging operation of the user on the first identification image includes: detecting an operation of the user dragging the first identification image to move in a second direction.
[0016] The first display area, such as the task control area, can be displayed in the first screen portion, such as an area located near the edge of the first screen portion near the second screen portion, etc., refer to the following Figures 2a to 2c The task control area 210 shown. In another implementation scenario below, the task control area can also be displayed in the second screen part. Please refer to the relevant description below for details, which is not limited here.
[0017] In a possible implementation of the first aspect above, the second screen portion includes a displayed second interface, the second interface includes a second window, and the first display area includes a second identification image corresponding to the second window.
[0018] In a possible implementation of the first aspect above, the method further includes: detecting a second dragging operation in which the user drags the second identification image toward the first direction; and corresponding to the second dragging operation, moving the second window to the first interface displayed on the first screen portion.
[0019] In a possible implementation of the first aspect above, detecting a first dragging operation of a user on a first identification image includes: detecting that a first distance that the user drags the first identification image to a second direction satisfies a first threshold condition; and / or detecting a second dragging operation of a user dragging a second identification image to a first direction includes: detecting that a second distance that the user drags the second identification image to a first direction satisfies a first threshold condition.
[0020] For example, the first window is originally displayed on the first screen portion, and the user drags the first logo image to move in the second direction, which can indicate that the first window corresponding to the first logo image is displayed on the second screen portion.
[0021] Similarly, the second window is originally displayed on the second screen portion, and the user drags the second identification image to move in the first direction, which can indicate that the second window corresponding to the second identification image is displayed on the first screen portion.
[0022] In a possible implementation of the first aspect, detecting a first drag operation on the first logo by the user includes:
[0023] A first combined operation of a user on a first identification image is detected, wherein the first combined operation includes a first operation of dragging the first identification image to a second direction and hovering it, and an operation of a user selecting a first area in a second display area displayed by triggering the first operation is detected, wherein the second display area includes at least one display area recommended for the first window, at least one display area includes the first area, and at least one display area is located within the display area of the second screen portion.
[0024] In a possible implementation of the first aspect, moving the first window in response to the first drag operation includes: displaying the first window in a corresponding area of the first area in the second screen portion in response to the first combination operation.
[0025] For example, the first combination operation may include the following: Figure 2b In the operation ② shown, the user can drag the window down and hover it or press the finger on the window and hover it. At this time, the user can trigger the second display area displayed by the operation, such as Figure 2b In the layout menu that appears, click to select a layout position.
[0026] In a possible implementation of the first aspect above, the method includes: detecting a second combination operation of the user on the second identification image, wherein the second combination operation includes a second operation of dragging the second identification image to a first direction and hovering it, and detecting an operation of the user selecting a second area in a third display area triggered by the second operation, wherein the third display area includes at least one display area recommended for the second window, at least one display area includes the second area, and at least one display area is located within the display area of the first screen portion; corresponding to the second combination operation, displaying the second window in the second area in the corresponding area of the first screen portion.
[0027] For example, the second combined operation may include the following: Figure 2b In the operation ① shown, the user can drag the window upward and then hover it or press the finger on the window and hover it. At this time, the user can trigger the second display area displayed by the operation, such as Figure 2b In the layout menu that appears, click to select a layout position.
[0028] In a possible implementation of the first aspect above, dragging the first identification image to move in the second direction for a third distance satisfies the second threshold condition; and / or dragging the second identification image to move in the first direction for a fourth distance satisfies the second threshold condition.
[0029] In a possible implementation of the first aspect above, a duration corresponding to the hovering operation satisfies a third threshold condition.
[0030] In a possible implementation of the first aspect above, detecting a first drag operation of a user on a first identification image includes: detecting a third combined operation of the user acting on the first identification image with a mouse, the third combined operation including a third operation of placing the mouse on the first identification image and hovering the mouse, and detecting an operation of the user clicking a mouse on a first control among multiple controls triggered by the third operation to be displayed, wherein the first control is used to indicate the portion of the screen where the first window is displayed.
[0031] For example, the third combined operation mentioned above may include the following: Figure 2c In operation ③ or operation ④, the user can place the mouse on window 211 and hover it to make the electronic device display layout controls, that is, the multiple controls displayed by the third operation. Correspondingly, the first control can be any control in the layout controls.
[0032] In a possible implementation of the first aspect, the first control indicates that the displayed screen portion is the second screen portion.
[0033] In a possible implementation of the first aspect, moving the first window in response to the first drag operation includes: displaying the first window in the second screen portion indicated by the first control in response to the third combination operation.
[0034] In a possible implementation of the first aspect above, an icon indicating the second direction is displayed on the first control.
[0035] In a possible implementation of the first aspect above, a duration corresponding to the hovering operation satisfies a fourth threshold condition.
[0036] In a possible implementation of the first aspect above, the first display area is located in the second screen portion.
[0037] In a possible implementation of the first aspect, detecting a first dragging operation of the user on the first identification image includes: detecting an operation of the user dragging the first identification image to move in a first direction.
[0038] For example, the first display area mentioned above is a task control area, and the task control area can also be displayed in the second screen part placed on the desktop.
[0039] In a possible implementation of the first aspect above, detecting a first drag operation of a user on a first identification image includes: detecting a fourth combination operation of the user on the first identification image, wherein the fourth combination operation includes a fourth operation of dragging the first identification image to a first direction and hovering, and detecting an operation of the user selecting a third area in a fourth display area triggered by the fourth operation, wherein the fourth display area includes at least one display area recommended for the first window, at least one display area includes the third area, and at least one display area is located within the display area of the first screen portion.
[0040] In a possible implementation of the first aspect above, detecting a first drag operation of a user on a first identification image includes: detecting a fifth combined operation of the user acting on the first identification image with a mouse, the fifth combined operation including a fifth operation of placing the mouse on the first identification image and hovering the mouse, and detecting an operation of a second control among multiple controls triggered by the fifth operation of the user clicking the mouse, wherein the second control is used to indicate a portion of the screen where the first window is displayed, and the screen portion includes a first screen portion or a second screen portion.
[0041] In a possible implementation of the first aspect above, the first identification image includes: a thumbnail window corresponding to the first window; or an application icon corresponding to the application program interface displayed in the first window.
[0042] In a second aspect, the present application provides an electronic device comprising: one or more processors; one or more memories; one or more memories storing one or more programs, which, when one or more programs are executed by one or more processors, enables the electronic device to execute the interaction method provided in the above-mentioned first aspect and various possible implementations of the first aspect.
[0043] In a third aspect, the present application provides a computer-readable medium having instructions stored thereon, which, when executed on a computer, causes the computer to execute the interaction method provided in the above-mentioned first aspect and various possible implementations of the first aspect.
[0044] In a fourth aspect, the present application provides a computer program product, comprising a computer program / instruction, which, when executed by a processor, implements the interaction method provided in the above-mentioned first aspect and various possible implementations of the first aspect.
[0045] The beneficial effects of the second to fourth aspects mentioned above can be found in the relevant descriptions of the first aspect and various possible implementations of the first aspect, and will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Figure 1 The figure shows an application scenario diagram of an interaction method provided in an embodiment of the present application.
[0047] Figure 2a Shown is a schematic diagram of an interface corresponding to a touch-based interaction method provided in an embodiment of the present application.
[0048] Figure 2b Shown is a schematic diagram of an interface corresponding to a touch-based interaction method provided in an embodiment of the present application.
[0049] Figure 2c Shown is an interface diagram corresponding to a mouse-based interaction method provided in an embodiment of the present application.
[0050] Figure 2d The figure shows a schematic diagram of the display position and style of the task control area in an interactive system consisting of a foldable device and an external display screen provided by an embodiment of the present application.
[0051] Figure 3a Shown is a schematic diagram of the state changes of a two-fold folding device provided in an embodiment of the present application during an unfolding operation.
[0052] Figure 3b Shown is a schematic diagram of the state changes of another two-fold folding device provided in an embodiment of the present application during the unfolding operation.
[0053] Figure 3cShown is a schematic diagram of the state changes of a multi-fold folding device provided in an embodiment of the present application during an unfolding operation.
[0054] Figure 4 The figure shows a schematic diagram of the implementation process of an interactive method provided in an embodiment of the present application.
[0055] Figure 5 Shown is a schematic diagram of an interface for turning on / off the super window function provided in an embodiment of the present application.
[0056] Figure 6a The figure shows a schematic diagram of an operation interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window downward.
[0057] Figure 6b Shown is a schematic diagram of a response interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window downward.
[0058] Figure 6c The figure shows a schematic diagram of an operation interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window upward.
[0059] Figure 6d Shown is a schematic diagram of a response interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window upward.
[0060] Figure 7a The figure shows a schematic diagram of an operation interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window downward and hovering the window.
[0061] Figure 7b Shown is a schematic diagram of a response interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window downward and hovering the window.
[0062] Figure 7c The third user operation provided in an embodiment of the present application includes a schematic diagram of a response interface after the user selects a target area in a layout menu triggered by hovering downward.
[0063] Figure 8a The figure shows a schematic diagram of an operation interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window upward and hovering the window.
[0064] Figure 8b Shown is a schematic diagram of a response interface in which a third user operation provided in an embodiment of the present application includes a user dragging a target window upward and hovering the window.
[0065] Figure 8c Shown is a schematic diagram of a response interface after a user selects a target area in a layout menu triggered by upward hovering, including a third user operation provided in an embodiment of the present application.
[0066] Figure 9a The figure shows a schematic diagram of an operation interface in which a third user operation provided in an embodiment of the present application includes a user hovering a mouse over a target window.
[0067] Figure 9b The third user operation provided in an embodiment of the present application is shown as a schematic diagram of an operation interface corresponding to a control indicating downward in a layout control displayed by hovering triggering a user using a mouse.
[0068] Figure 9c The third user operation provided in an embodiment of the present application is shown as a schematic diagram of a response interface corresponding to a user clicking a downward-pointing control in a layout control displayed by hovering trigger using a mouse.
[0069] Figure 9d Shown is another operation interface schematic diagram of a third user operation provided in an embodiment of the present application, including a user hovering a mouse over a target window.
[0070] Figure 9e The third user operation provided in an embodiment of the present application is shown as a schematic diagram of an operation interface corresponding to a control indicating upward in a layout control displayed by hovering triggering a user using a mouse.
[0071] Figure 9f The third user operation provided in an embodiment of the present application is shown as a schematic diagram of a response interface corresponding to a user using a mouse to click an upward-pointing control in a layout control displayed by hovering triggering.
[0072] Figure 10 The figure shows an application scenario diagram of another interaction method provided in an embodiment of the present application.
[0073] Figure 11 The figure shows a schematic diagram of the implementation process of another interactive method provided in an embodiment of the present application.
[0074] Figure 12 The figure shows a schematic diagram of the software structure of an operating system provided in an embodiment of the present application.
[0075] Figure 13 Shown is another schematic diagram of the operating system software structure provided in an embodiment of the present application.
[0076] Figure 14 Shown is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0077] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings and specific implementation methods.
[0078] It is understood that the electronic devices in the embodiments of the present application may also be referred to as terminals, terminal devices, user equipment (UE), mobile stations (MS), mobile terminals (MT), etc. The terminal devices may be foldable notebooks, foldable mobile phones, foldable tablet computers (pads), wireless terminals in industrial control, wireless terminals in self-driving systems, wireless terminals in smart cities, wireless terminals in smart homes, etc.
[0079] As mentioned above, Figure 1 In the semi-expanded state of the foldable device shown, when the user drags a window across the screen from screen B to screen C or from screen C to screen B, the path is long, which will cause wear and tear on the screen of the foldable device and easily cause the device to fall over, resulting in a poor user experience.
[0080] In order to solve the above problems, the present application provides an interactive method. Specifically, the method displays the thumbnail windows corresponding to one or more task windows displayed on the screen in one area, which may be referred to as the task control area below. Based on this, the foldable device can identify the window operated by the user and the target area or target position to which the user intends to drag the window according to the operation of the user on the thumbnail window in the task control area to indicate the moving window display position. For example Figure 2a In the illustrated task control area 210, windows 211 and 212 are thumbnail windows corresponding to the display windows of various application interfaces on the screen of the foldable device 10. The user can drag window 211 or window 212 upward in the task control area 210 to control the actual task window corresponding to window 211 to be displayed on screen B or display area B of the foldable device 10. The user can also drag window 211 or window 212 downward in the task control area 210 to control the actual task window corresponding to window 211 to be displayed on screen C or display area C of the foldable device 10.
[0081] In this way, it is convenient for users to quickly adjust the window position on foldable devices or various collaborative devices that need to drag windows across screens, and the operation path for users to adjust the window position across screens can be shortened. They only need to drag the mouse on the screen of the foldable device or slide a short distance with a touch object to complete the adjustment of the window position. For example, without using an access device such as a mouse, the user's finger only needs to slide up or down a short distance on the corresponding window in the task control area to adjust the corresponding window from one screen to another. The interactive solution provided by this application not only avoids damage to the screen caused by sliding operations on the user's screen, but also improves the efficiency of users in adjusting the positions of the windows displayed on the screen, thereby improving the user experience.
[0082] It can be understood that the above-mentioned task control area can also be called a task center in some embodiments. The electronic device supports the function of displaying the above-mentioned task control area, which can be called a super window function in some embodiments, etc., and is not limited here.
[0083] The user's operation on the task control area is not limited to the operation of dragging the window up or down, but may also include the operation of dragging the corresponding window up and then hovering or hovering on the corresponding window.
[0084] As an example, refer to Figure 2b In the operation ① shown, the user can drag the window 211 upward and then hover it or press the finger on the window 211 and hover it. At this time, the foldable device 10 can display the task control area or above the task control area. Figure 2b The layout menu 221 shown in the example. The user clicks the selected layout position in the layout menu 221, and the actual task window corresponding to the window 211 can be adjusted to the corresponding layout position in the screen B or the display area B. Figure 2b In operation ② shown, the user can drag window 212 downward and then hover it, or press a finger on window 212 and hover it. At this time, the foldable device 10 can display the layout menu 222 shown in Figure 2C in the task control area or below the task control area. The user clicks on the selected layout position in layout menu 222, and the actual task window corresponding to window 212 is adjusted to the corresponding layout position on screen C or display area C.
[0085] The user's operation on the task control area may also include hovering the mouse over the corresponding window in the task control area and clicking on the control that is called out, etc., which is not limited here. Figure 2c In operation ③ shown, the user can place the mouse on the window 211 and hover it. At this time, the foldable device 10 can display Figure 2cIn the illustrated layout control, the user moves the mouse to the up control 231 in the layout control and clicks the control, and the actual task window corresponding to the window 211 can be adjusted to the screen B or the display area B. Figure 2c In operation ④ shown, the user can place the mouse on the window 212 and hover it. At this time, the foldable device 10 can display Figure 2c In the illustrated layout control, the user moves the mouse to the downward control 232 in the layout control and clicks the control, and the actual task window corresponding to the window 212 can be adjusted to the screen C or the display area C.
[0086] It is understood that the electronic devices to which the interactive method provided by this application is applicable are not limited to foldable devices, but may also include two or more cross-screen collaborative devices that require dragging windows across screens. In this case, the display position and style of the task control area may also be limited to the above Figures 2a to 2c The location and style of the example. Figure 2d As shown, for the foldable device 10 and the external display 20, the task control area 240 can also be displayed on the right edge of the screen B. When the user moves the mouse to hover over the corresponding window of the task control area 240, the user can click the control indicating the right in the corresponding layout control to control the corresponding actual task window to be displayed on the screen A of the external display 20. In some embodiments, the placement direction of the foldable device 10 and the external display 20 can also be the same as Figure 2b Contrary to or different from what is shown, the foldable device 10 may also be other forms of electronic devices such as laptops, desktop computers or tablet computers, and the display position and style of the task control area on the screen of the foldable device 10 may also be other positions and styles, which are not limited here.
[0087] It is understood that the foldable device to which the interactive method provided in this application is applicable may be a two-fold foldable device, or a three-fold foldable device or other multi-fold foldable device, and is not limited here. In an example scenario, see Figure 3a As shown, the folding screen 10 is a bifolding device 100, which may include a main screen 100a, a secondary screen 100b, a folding axis 103, a folding portion 104, and a folding portion 105. The main screen 100a is located on the folding portion 104, the secondary screen 100b is located on the folding portion 105, and the folding portion 104 and the folding portion 105 are folded and connected by the folding axis 103. In this way, the bifolding device 100 can support an unfolding operation (4) in which the folding portion 104 and the folding portion 105 are unfolded to the same plane. After the bifolding device 100 is unfolded, the main screen 100a and the secondary screen 100b can form a larger display screen.
[0088] It will be understood that when the angle α between the folding portion 104 and the folding portion 105, which is unfolded about the folding axis 103, is less than the preset angle that triggers the folded state, the bi-folding device 100 is in the folded state. In this folded state, the main screen 100a can be in an active state, which can be used to display an application interface or respond to user operations, and the secondary screen 100b can be in an inactive state, for example, a state where the screen is off and no interface is displayed. When the angle α between the folding portion 104 and the folding portion 105, which is unfolded about the folding axis 103, is greater than the aforementioned preset angle, the bi-folding device 100 can switch to the unfolded state. In this unfolded state, both the main screen 100a and the secondary screen 100b can be in an active state, that is, the display interface is displayed on both the main screen 100a and the secondary screen 100b. At this point, based on the interaction method provided in this application, the user can quickly adjust the display position of the task window on the bi-folding device 100 to display on the main screen 100a or on the secondary screen 100b.
[0089] In other embodiments, see Figure 3b As shown, the bi-folding device 100 may further include a secondary screen 100c. For example, the main screen 100a is located on the front of the folding portion 104, the secondary screen 100c is located on the back of the folding portion 104, and the secondary screen 100b is located on the folding portion 105. The user may also use other methods to unfold the bi-folding device 100, such as Figure 3b In the unfolding operation ⑤ shown, the user can unfold the folded secondary screen 100b and secondary screen 100c in the bi-folding device 100 to the same plane. After the bi-folding device 100 is unfolded, the secondary screen 100c and the secondary screen 100b can form a larger display screen. In this folded state, the main screen 100a can be in an active state, and the secondary screen 100c and the secondary screen 100b can both be in an inactive state. When the angle α between the folding portion 104 and the folding portion 105 based on the folding axis 103 is greater than the aforementioned preset angle, the bi-folding device 100 can switch to an unfolded state. In this unfolded state, the secondary screen 100c and the secondary screen 100b can both be in an active state, and the main screen 100a can be in an inactive state. At this time, based on the interactive method provided in the present application, the user can quickly adjust the display position of the task window on the bi-folding device 100 to display on the secondary screen 100b or to display on the secondary screen 100c.
[0090] In another example scenario, see Figure 3cAs shown, the foldable device can be a three-fold folding device 200. The three-fold folding device 200 may include a main screen 200a, a sub-screen 200b, a sub-screen 200c, a sub-screen 200d, a folding axis 204, a folding axis 205, a folding portion 206, a folding portion 207 and a folding portion 208. Among them, the main screen 200a is located in front of the folding portion 206, the sub-screen 200b is located behind the folding portion 206, the sub-screen 200c is located on the folding portion 207, and the sub-screen 200d is located on the folding portion 208. The folding portion 206 and the folding portion 207 are foldably connected by the folding axis 204, and the folding portion 207 and the folding portion 208 are foldably connected by the folding axis 205. Among them, based on the folding axis 204, the three-fold folding device 200 can support the unfolding operation ⑥ that can unfold the folding portion 206 and the folding portion 207 to the same plane. It can be understood that the unfolding operation ⑥ unfolds the secondary screen 200c, which is folded behind the main screen 200a in the tri-fold device 200, to be on the same plane as the secondary screen 200b. After the tri-fold device 200 is unfolded based on the unfolding operation ⑥, the secondary screen 200b and the secondary screen 200c can form a larger display screen.
[0091] When the angle α1 between the folding portion 206 and the folding portion 207, which is unfolded about the folding axis 204, is less than the aforementioned preset angle, and the angle α2 between the folding portion 207 and the folding portion 208, which is unfolded about the folding axis 205, is also less than the aforementioned preset angle, the bi-folding device 100 is in a folded state. In this folded state, the main screen 200a may be active, while the subsidiary screens 200b, 200c, and 200d may all be inactive. When the angle α1 between the folding portion 206 and the folding portion 207, which is unfolded about the folding axis 204, is greater than the aforementioned preset angle, the bi-folding device 100 may deem that the user has performed an unfolding operation ⑥. At this point, the state in which the bi-folding device 100 is in which the angle α1 is greater than the aforementioned preset angle and the angle α2 is less than the aforementioned preset angle may be referred to as a semi-expanded state. In this semi-expanded state, the subsidiary screens 200b and 200c may both be active, while the main screen 200a and the subsidiary screen 200d may both be inactive. At this time, based on the interaction method provided in this application, the user can quickly adjust the display position of the task window on the two-fold folding device 100 to display on the secondary screen 200b or to display on the secondary screen 200c.
[0092] Furthermore, the user can also unfold the folded secondary screen 200d in the tri-fold folding device 200 to the same plane as the secondary screen 200b and the secondary screen 200c through the unfolding operation ⑦. After the secondary screen 200d is unfolded, the secondary screen 200b, the secondary screen 200c and the secondary screen 200d can form a larger display screen. At this time, the tri-fold folding device 200 has unfolded the secondary screen 200b, the secondary screen 200c and the secondary screen 200d to the same plane based on the unfolding operation ⑥ and the unfolding operation ⑦, which may be referred to as the unfolded state below. In this unfolded state, the secondary screen 200b, the secondary screen 200c and the secondary screen 200d may all be in an activated state, and the main screen 200a may be in an inactivated state. At this time, the tri-fold folding device 200 can display one or more task windows on the secondary screen 200c and the secondary screen 200d, and display one or more task windows such as an input method soft keyboard on the secondary screen 200b. Among them, the secondary screen 200c and the secondary screen 200d form a larger display screen based on the above-mentioned expansion operation ⑦. At this time, based on the interaction method provided by the present application, the user can quickly adjust the display position of the task window on the tri-folding device 200 to display it on the secondary screen 200b, or adjust it to display it on the larger display screen composed of the secondary screens 200c and 200d.
[0093] This application does not provide any restrictive description of the folding axis setting position, folding method and folding direction of the foldable device.
[0094] Based on the above Figures 2a to 2d The interactive mode provided by the example task control area, as well as the display position and style of the task control area, are described in detail below in combination with specific embodiments of different application scenarios to implement the interactive method provided by this application.
[0095] The following first describes in detail the specific implementation process of the interaction method provided by this application in a foldable device in conjunction with Example 1.
[0096] Example 1
[0097] The embodiment of the present application provides a specific implementation process of an interactive method applied to a foldable device. Figure 1 The foldable device 10 in the scene shown can be an electronic device such as a foldable screen notebook or a foldable screen mobile phone, a foldable screen tablet, a foldable screen large screen device, etc. Figure 1 Taking the foldable device 10 in the illustrated scenario as an example, the specific implementation process of the interaction method provided in the embodiment of the present application is introduced.
[0098] Figure 4 According to the embodiment of the present application, a schematic diagram of the implementation process of an interaction method is shown. It can be understood that Figure 4The execution entity of each step of the process shown can be a foldable device 10. As mentioned above, the foldable device can include electronic devices such as a foldable screen notebook or a foldable screen mobile phone, a foldable screen tablet, a foldable screen large screen device, etc.
[0099] Specifically, if Figure 4 As shown, the implementation process may include the following steps:
[0100] 401: An expansion operation within the preset angle range is detected.
[0101] Exemplarily, the foldable device 10 may include the above Figure 3a 、 Figure 3b The example supports two-fold folding devices with different folding methods, Figure 3c The three-fold folding device and other multi-fold folding devices, other foldable devices that support different folding methods, etc. are not limited here. Figures 3a to 3c , the unfolding operation detected by the foldable device can include the above Figure 3a The expansion operation shown in ④, Figure 3b The expansion operation shown in ⑤, Figure 3c The expansion operations ⑥ and ⑦ are shown.
[0102] It is understood that when the foldable device 10 is in the process of transitioning from the folded state to the unfolded state, when the angle between adjacent screens connected to the folding axis is greater than a smaller preset angle (which may be recorded as the first preset angle), the two adjacent screens are activated, and the foldable device 10 may first enter the aforementioned semi-expanded state. At this point, the foldable device 10 may continue to implement the following steps 402 to 408, such as displaying the task control area in response to user operations and adjusting the position of the relevant task window in the display area of each screen based on the task control area, thereby continuing to implement the interaction method provided in the embodiment of the present application.
[0103] During the process of the foldable device 10 continuing to unfold, when the angle between the two adjacent screens connected to the folding axis reaches a larger preset angle (which can be recorded as the second preset angle), for example, when it reaches 180 degrees, the two screens can be combined into a larger screen, or in other words, the two adjacent screens as different display areas of the same screen are now combined into the same larger display area. At this time, the foldable device 10 is in the unfolded state and the interface can be displayed through the larger screen or larger display area. At this time, the foldable device 20 does not need to cross-screen operation, and the following steps can be no longer performed. The window control of the super window function can be turned on, and there is no need to display the task control area.
[0104] 402: In response to the first user operation, display a window control capable of enabling the super window function.
[0105] Exemplarily, the first user operation includes an operation of opening a control center, or an operation related to a super window function in a setting interface.
[0106] As an example, refer to Figure 5 As shown, when the foldable device 10 is in the semi-expanded state, the user can operate to open the control center 510 in the task bar displayed on the screen C of the foldable device 10. Figure 5 As shown, the control center 510 may include a window control 511 that can quickly open the super window function.
[0107] It can be understood that in the embodiment of the present application, the above-mentioned first user operation is, for example, Figure 5 The user operation shown is to open the control center 510. In other embodiments, the first user operation may also be a voice command operation, etc. This is not limited here.
[0108] 403: A second user operation acting on the window control is detected, and a task control area corresponding to the super window function is displayed.
[0109] Exemplarily, the above-mentioned second user operation may include a click operation by the user on the window control, and an operation by the user through a voice command to instruct the foldable device 10 to start the switch of the super window function controlled by the above-mentioned window control, etc., which is not limited here.
[0110] As an example, continue to refer to Figure 5 As shown, a user clicking on the window control 511 in the control center 510 can trigger the foldable device 10 to display the task control area 520. The task control area 520 can be used to control the actual task windows currently displayed. The thumbnail windows displayed in the task control area 520 can respectively correspond to the actual task windows currently opened on the foldable device 10. It is understood that the actual task window can be the interface display window of the application running on the foldable device 10.
[0111] It is understandable that the above Figure 5 The task control area 520 shown can be displayed in screen B and can be displayed near the connection between screen B and screen C. In other embodiments, the display position and style of the task control area can also be different from Figure 5 The display position and style shown in the example, for example, the task control area can also be displayed in screen C, which is not limited here.
[0112] In other embodiments, instead of displaying a thumbnail window, the task control area 520 may display icons of related applications or other identification graphics that can indicate the actual task window of the corresponding application, etc., which is not limited here.
[0113] 404: A third user operation acting on a target window in the task control area is detected.
[0114] Exemplarily, the third user operation includes the above-mentioned operation of dragging the target window up or down (refer to the above Figure 2a ), drag the target window upward and hover it, or hover over the corresponding window (refer to the above Figure 2b ) and when using the mouse, hover the mouse over the target window in the task control area and click on the control that is called out (refer to the above Figure 2c ), etc., without limitation. It is understood that the target window may be any one of one or more task windows displayed in the task control area, and the third user operation may control the target window to be displayed in any display area of screen B or screen C of the foldable device 10, without limitation.
[0115] It is understood that the foldable device 10 may preset a relevant threshold value corresponding to the third user operation as a recognition condition for identifying the third user operation and then triggering the foldable device 10 to continue to perform the following steps. Figure 2a As shown, the foldable device 10 may preset a first distance threshold corresponding to the user moving up or down, as a recognition condition for detecting whether the user's operation of dragging the target window up or down can trigger the implementation of the following step 405. For example, referring to the above Figure 2b As shown, the foldable device 10 can be preset with a second distance threshold corresponding to the user's upward or downward movement before hovering as a recognition condition for detecting whether the user intends to call out the layout menu. This recognition condition can be used to identify the user's intention. It is understood that in some embodiments, the first distance threshold can be greater than the second distance threshold.
[0116] In other embodiments, referring to the above Figure 2c As shown, the foldable device 10 may also preset a time threshold corresponding to the mouse hovering duration as an identification condition for detecting whether the user wants to call out the up or down control, etc., which is not limited here.
[0117] Specifically, the user performs the above-mentioned third user operation on the screen of the foldable device 10, and the interface change process of the foldable device 10 in response to the above-mentioned third user operation will be introduced in detail below in conjunction with the relevant interface schematic diagrams, and will not be repeated here.
[0118] 405: Determine the display area coordinates of the target window indicated by the third user operation.
[0119] For example, the foldable device 10 may determine the coordinates of the display area indicated by the third user operation based on the drag direction of the third user operation, or based on the position information of the display area selected by the third user operation. In some embodiments, the display area coordinates may be determined based on the position information of the layout area selected by the user in the layout menu. For example, if the user drags the target window upward, hovers over it, and selects a layout area under one of the layout styles in the layout menu that is triggered to display, the foldable device 10 may display the actual task window corresponding to the target window in the layout area.
[0120] It can be understood that the above-mentioned display area coordinates may include a set of coordinate information corresponding to the boundary position of the display area. The coordinate information set may include the coordinate values of each point in the display screen of the foldable device that can determine the display area, which will not be elaborated here.
[0121] 406: Displaying the actual task window corresponding to the target window in the target display area indicated by the determined display area coordinates.
[0122] For example, the foldable device 10 determines the corresponding target display area according to the display area coordinates determined above. Figures 2a to 2c As shown, the display area can be located in screen B of the foldable device 10 or in screen C of the foldable device 10, without limitation. Furthermore, the foldable device 10 can control the display of the actual application window corresponding to the target window in the target display area. It is understood that the actual application window can be an interactive interface display window for an application such as an office application or a browser application.
[0123] The following will be combined Figures 6a to 6d 、 Figures 7a to 7c 、 Figures 8a to 8c 、 Figures 9a to 9f , the relevant interface change process involved in the process of executing the above steps 404 to 406 on the foldable device 10. Specifically:
[0124] Figures 6a to 6d According to an embodiment of the present application, a schematic diagram of an interface change process triggered by an operation mode of a third user operation is shown.
[0125] refer to Figure 6a After the foldable device 10 executes the above step 403 and detects the second user operation, it can display Figure 6a The task control area 520 shown is the above Figure 5 The task control area 520 is shown. Figure 6aAs shown, the user can drag the window 521 downward in the task control area 520 displayed on the foldable device 10. The window 521 can be a thumbnail window corresponding to the actual task window 610 currently displayed on the screen B. Figure 6a The operation of dragging the window 521 downward may instruct the foldable device 10 to display the actual task window 610 on the screen C, or to adjust the actual task window 610 to be displayed on the screen C. The window 521 of the task control area 520 may be a thumbnail window of the actual task window 610.
[0126] It is understood that the foldable device 10 can determine to display the actual task window 610 corresponding to the window 521 on the screen C when it is detected that the user drags the window 521 downward for a distance exceeding the first preset distance. At this time, the foldable device 10 can continue to display the actual task window 610 corresponding to the window 521. Figure 6b The interface shown.
[0127] refer to Figure 6b In response to the third user operation of the user dragging the thumbnail window in the task control area downward, the foldable device 10 can display the actual task window 610 corresponding to the thumbnail window on screen C. At this time, the user can continue to perform other operations in the actual task window 610 displayed on screen C to achieve interaction with the application corresponding to the actual task window 610.
[0128] refer to Figure 6c After the foldable device 10 executes the above step 403 and detects the second user operation, it can display Figure 6c The task control area 520 shown is the above Figure 5 The task control area 520 shown. The user can drag the window 522 upward in the task control area 520 displayed on the foldable device 10. The window 522 can be a thumbnail window corresponding to the actual task window 620 currently displayed on the screen C. Therefore, Figure 6c The operation of dragging window 522 upward can instruct the foldable device 10 to display the actual task window 620 on screen B, or to adjust the actual task window 620 to be displayed on screen B. The window 522 in the task control area 520 can be a thumbnail window of the actual task window 620. The window 522 and the window 521 can be the same thumbnail window or different thumbnail windows. Correspondingly, the actual task window 620 can be the same task window or a different task window, without limitation.
[0129] It is understood that the foldable device 10 can determine to display the actual task window 620 corresponding to the window 522 on the screen B when it is detected that the user drags the window 522 upward to move the distance exceeding the first preset distance. At this time, the foldable device 10 can continue to display the actual task window 620 corresponding to the window 522. Figure 6d The interface shown.
[0130] refer to Figure 6d In response to the third user operation of the user dragging the thumbnail window in the task control area downward, the foldable device 10 can display the actual task window 620 corresponding to the thumbnail window on screen B. At this time, the user can continue to perform other operations in the actual task window 620 displayed on screen B to achieve interaction with the application corresponding to the actual task window 620.
[0131] Figures 7a to 7c According to an embodiment of the present application, a schematic diagram of the interface change process triggered by another operation mode of a third user operation is shown.
[0132] refer to Figure 7a After the foldable device 10 executes the above step 403 and detects the second user operation, it can display Figure 7a The task control area 520 shown is the above Figure 5 The task control area 520 is shown. Figure 7a In the operation ⑧ shown, the user can drag the window 521 downward for a distance and then hover it in the task control area 520 displayed on the foldable device 10. This operation ⑧ can trigger the foldable device 10 to display a layout menu. The form of the layout menu can refer to the following Figure 7b Layout menu 710 is shown.
[0133] refer to Figure 7b In response to the above operation ⑧, the foldable device 10 displays the layout menu 710 above the layer where the task control area 520 is located. Figure 7b As shown, the layout menu 710 may correspond to the downward movement operation in the above operation ⑧ and be displayed below the dragged window 521. The layout menu 710 may display a plurality of recommended layout modes, each of which may control the display area of the actual task window 720 corresponding to the window 521 in the lower screen C. For example, the user may Figure 7b In the layout menu 710 shown, the recommended window 711 is clicked. In response to the user selecting the recommended window 711, the foldable device 10 may display the actual task window 720 in the lower area of the screen C. Figure 7c The actual task window 720 is shown in the display position of the screen C. Among them, the window 521 can be Figure 7a and Figure 7b The thumbnail window corresponding to the actual task window 720 displayed in screen B is shown. The window 720 may be the same as or different from the actual task window 610 , which is not limited here.
[0134] Continue to refer Figure 7cThe upper area 730 of the screen C of the foldable device 10 may display task windows corresponding to other applications originally displayed, such as an input method soft keyboard window, or may not display other task windows.
[0135] Figures 8a to 8c According to an embodiment of the present application, a schematic diagram of the interface change process triggered by another operation mode of a third user operation is shown.
[0136] refer to Figure 8a After the foldable device 10 executes the above step 403 and detects the second user operation, it can display Figure 8a The task control area 520 shown is the above Figure 5 The task control area 520 is shown. Figure 8a In operation 9 shown, the user can drag the window 521 upwards for a distance and then hover it in the task control area 520 displayed on the foldable device 10. This operation 9 can trigger the foldable device 10 to display a layout menu. The form of the layout menu can refer to the following Figure 8b Layout menu 810 is shown.
[0137] refer to Figure 8b In response to the above operation ⑨, the foldable device 10 displays the layout menu 810 above the layer where the task control area 520 is located. Figure 8b As shown, the layout menu 810 may correspond to the upward movement operation in the above operation ⑨ and be displayed below the dragged window 521. The layout menu 810 may display a plurality of recommended layout modes, each of which may control the display area of the actual task window 820 corresponding to the window 521 in the upper screen B. For example, the user may Figure 8b Click the recommended window 811 in the layout menu 810 shown in FIG. Then, in response to the user selecting the recommended window 811, the foldable device 10 may display the actual task window 820 in the upper left area of the screen B. Figure 8c The actual task window 820 is shown in the display position of the screen B. Among them, the window 521 can be Figure 8a and Figure 8b The thumbnail window corresponding to the actual task window 820 displayed in screen C is shown. The window 820 may be the same as or different from the actual task window 610 , which is not limited here.
[0138] Continue to refer Figure 8c The upper right and lower display areas 830 of the screen B of the foldable device 10 may display task windows corresponding to other applications originally displayed, such as an input method soft keyboard window, etc., or may not display other task windows.
[0139] Figures 9a to 9fAccording to an embodiment of the present application, a schematic diagram of the interface change process triggered by another operation mode of a third user operation is shown.
[0140] refer to Figure 9a After the foldable device 10 executes the above step 403 and detects the second user operation, it can display Figure 9a The task control area 520 shown is the above Figure 5 The task control area 520 is shown. Figure 9a As shown, a user can operate mouse 910 to hover over window 521 in task control area 520. At this time, foldable device 10 can display layout control 911 and layout control 912 on window 521 in response to the mouse hovering operation. Layout control 911 can be used to adjust the actual task window corresponding to window 521 to be displayed on screen C below, and can also be described as a control indicating downward; layout control 912 can be used to adjust the actual task window corresponding to window 521 to be displayed on screen B above, and can also be described as a control indicating upward.
[0141] Continue to refer Figure 9b , the user can operate the mouse 910 to click the layout control 911 displayed on the foldable device 10. Correspondingly, the foldable device 10 can control the actual task window 920 corresponding to the window 521 to be displayed on the screen C indicated by the layout control 911 in response to the mouse click operation. Figure 9c The actual task window 920 is shown in screen C. It can be understood that the actual task window 920 can originally be the window displayed in screen B. In other embodiments, the opportunity task window 920 can also originally be the window displayed in screen C.
[0142] Continue to refer Figure 9d , the user can operate the mouse to hover over the window 522 in the task control area 520. At this time, the foldable device 10 can respond to the mouse hovering operation and also display the layout control 911 and the layout control 912 on the window 522. At this time, referring to Figure 9e As shown, the user can operate the mouse 910 to click the layout control 912 displayed on the foldable device 10. Figure 9f In response to the mouse click operation, the foldable device 10 can control the actual task window 930 corresponding to the window 522 to be displayed on the screen B indicated by the layout control 912. Figure 9f The actual task window 930 is shown in screen B. It can be understood that the actual task window 930 can originally be the window displayed in screen C. In other embodiments, the opportunity task window 930 can also originally be the window displayed in screen B.
[0143] It is understood that in some embodiments, the foldable device 10 may not display other windows before responding to the third user operation and adjusting the actual task window corresponding to the thumbnail window in the task control area operated by the user to be displayed on screen C. In this case, the foldable device 10 may display the relevant actual task window in the center area of screen C in response to the third user operation, and the actual task window may be enlarged to adapt to the size of screen C.
[0144] In other embodiments, the screen C of the foldable device 10 may also display the task window of the input method soft keyboard or other application before displaying the actual task window indicated by the third user operation. In this case, the foldable device 10 may reduce the size of the task window of the input method soft keyboard or other application originally displayed on the screen C in response to the third user operation, and display the actual task window indicated by the third user operation in an area of the screen C where no other windows are currently displayed. In other embodiments, the foldable device 10 may also display the actual task window indicated by the third user operation above the task window of the input method soft keyboard or other application originally displayed on the screen C, or control the display area of the actual task window to partially overlap with the display area of the task window of the input method soft keyboard or other application, etc., in response to the third user operation, and is not limited here. The above-mentioned actual task window may include the above-mentioned actual task window 610, actual task window 720, and actual task window 920, etc., which are not limited here.
[0145] Similarly, in some embodiments, screen B of the foldable device 10 may not display other windows before displaying the actual task window indicated by the third user operation. In this case, the foldable device 10, in response to the third user operation, may control the display of the actual task window indicated by the third user operation in the center area of screen B, and the actual task window may be enlarged to adapt to the size of screen B.
[0146] In other embodiments, the screen B of the foldable device 10 may also display task windows of other applications before displaying the actual task window indicated by the third user operation. In this case, the foldable device 10 may reduce the size of the task window of the other application originally displayed on the screen B in response to the third user operation, and display the actual task window indicated by the third user operation in an area of the screen B where no other windows are currently displayed. In other embodiments, the foldable device 10 may also display the actual task window indicated by the third user operation above the task window of the other application originally displayed on the screen B in response to the third user operation, or control the display area of the actual task window to partially overlap with the display area of the task window of other applications, etc., which are not limited here. Among them, the above-mentioned actual task window may include the above-mentioned actual task window 610, actual task window 720 and actual task window 920, etc., which are not limited here.
[0147] It is understandable that based on the above Figure 4 The implementation process of step 401 to step 406 shown in FIG. Figures 6a to 6d 、 Figures 7a to 7c 、 Figures 8a to 8c 、 Figures 9a to 9f The operation mode of the third user operation illustrated and the related interface change process illustrated, when the interactive method provided in the embodiment of the present application is applied to the foldable device 10, can provide the user with more convenient cross-screen operation services such as adjusting the window display position across the screen, and the task control area displayed near the screen folding axis of the foldable device 10 or displayed on the lower screen C in the semi-expanded state can effectively avoid the problem that the user may easily cause the device to tip over when applying pressure when sliding on the screen of the foldable device 10.
[0148] The following first describes in detail the specific implementation process of the interaction method provided by the present application in the scenario of an external extended display screen in conjunction with Example 2.
[0149] Example 2
[0150] The present application provides a specific implementation process of an interaction method applied to a scenario where an electronic device has an externally extended display screen. The electronic device may include a mobile phone, tablet, laptop, desktop computer, large-screen device, or other electronic device. The electronic device may be a foldable device or an electronic device with a non-foldable display screen, without limitation.
[0151] Figure 10 According to an embodiment of the present application, a schematic diagram of a scenario in which an electronic device is connected to an external extended display screen is shown.
[0152] like Figure 10As shown, the scene includes an electronic device 30 and an external extended display screen 20. The extended display screen 20 can be connected to the electronic device 30 and provide an extended screen display area for the electronic device 30 for user use.
[0153] Figure 11 According to the embodiment of the present application, a schematic diagram of the implementation process of an interaction method is shown. It can be understood that Figure 11 The execution subject of each step of the process shown can be the above-mentioned electronic device 30. As mentioned above, the electronic device 30 can be the above-mentioned tablet, notebook, desktop computer, large-screen device, etc., or the above-mentioned foldable device 10, without limitation.
[0154] Specifically, if Figure 11 As shown, the implementation process may include the following steps:
[0155] 1101: A connection with an extended display was detected.
[0156] For example, the electronic device 30 can be connected to the extended display screen 20 via a data cable, and the interface type of the data cable may include a high-definition multimedia interface (HDMI), mini HDMI, micro HDMI, or a universal serial bus (USB). In other embodiments, the electronic device 30 and the extended display screen 20 can also establish a data connection via wireless communication, which is not limited here.
[0157] It can be understood that after the connection between the electronic device 30 and the extended display screen 20 is established, display data related to the window or interface can be transmitted between the two to display the task windows of some application programs running on the electronic device 30.
[0158] 1102: In response to the first user operation, display a window control capable of enabling the super window function.
[0159] The first user operation can refer to the above embodiment 1. Figure 5 The example operation is to open the control center 510 in the taskbar, etc. The detailed process of the electronic device 30 performing this step 1102 can refer to the relevant description of step 402 in the above embodiment 1, and will not be repeated here.
[0160] 1103: A second user operation acting on the window control is detected, and a task control area corresponding to the super window function is displayed.
[0161] The first user operation can refer to the above embodiment 1. Figure 5The example operation is clicking the window control 511. The detailed process of the electronic device 30 performing this step 1103 can refer to the relevant description of step 403 in the above embodiment 1, which will not be repeated here.
[0162] 1104: A third user operation acting on a target window in the task control area is detected.
[0163] For example, the display position and style of the task control area in the embodiment of the present application can refer to the above Figure 2d For the display position and style of the example, and the specific operation method of the third user operation, please refer to the above Figure 2d The description of the relevant click instructions to the right or left controls is not repeated here.
[0164] The detailed process of the electronic device 30 executing step 1104 can refer to the relevant description of step 404 in the above embodiment 1, and will not be repeated here.
[0165] 1105: Determine the display area coordinates of the target window indicated by the third user operation.
[0166] For example, in the embodiment of the present application, the display area coordinates of the third user operation indication display target window may be located at Figure 10 The extended display screen 20 in the illustrated scenario may be located in screen A, screen B of the electronic device 30, or screen C of the foldable device 10, without limitation.
[0167] The detailed process of the electronic device 30 executing step 1105 can refer to the relevant description of step 405 in the above embodiment 1, and will not be repeated here.
[0168] 1106: Display the actual task window corresponding to the target window in the target display area indicated by the determined display area coordinates.
[0169] The detailed process of the electronic device 30 executing step 1106 can refer to the relevant description of step 406 in the above embodiment 1, and will not be repeated here.
[0170] It is understandable that based on the above Figure 11As shown in the implementation process of steps 1101 to 1106, when the interactive method provided in the embodiment of the present application is applied to electronic devices other than the foldable device 10, it can provide users with more convenient cross-screen operation services such as adjusting the display position of windows across screens, making it convenient for users to switch the screen display of the actual task window between the local display screen of the electronic device 30 and the extended display screen 20. Moreover, when the electronic device 30 is a foldable device 10, it can also facilitate users to transfer the actual task window displayed on the foldable device 10 to the extended display screen 20 for display. In this scenario, the interactive method provided in the present application can effectively avoid the problem of the user applying pressure when sliding on the screen of the foldable device 10, which can easily cause the device to tip over.
[0171] The following is an exemplary introduction to the operating system software structure and hardware structure of the electronic device to which the interactive method provided in the embodiment of the present application is applied, in conjunction with the relevant drawings.
[0172] Figure 12 According to an embodiment of the present application, a schematic diagram of the software structure of an operating system is provided.
[0173] It is understood that the operating system of the electronic device 30 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. TM Taking the system as an example, the system software structure of the electronic device 30 is exemplified.
[0174] A layered architecture divides software into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces.
[0175] Windows TM The operating system can generally be divided into kernel mode (kernel model) and user mode (usermodel).
[0176] User mode can include Figure 12 The system applications, office applications, conference applications, video applications, and creative applications shown in the figure are shown in the figure. Applications in user mode can call the core capabilities and drivers in kernel mode based on the Windows subsystem and the native application programming interface (native API).
[0177] Continue to refer Figure 12As shown, the kernel mode can provide a super window component, a control center, and a driver management module. Among them, the super window component can provide the electronic device 30 with the ability to manage window layout. This component can integrate capability components such as a window layout menu, a task hub window, and a floating ball.
[0178] Among them, the task hub window can correspond to the window displayed in the above-mentioned task control area, and the user can operate the thumbnail window in the task hub window to adjust the display position of the corresponding actual task window. The task hub window is the core window of the super window component, which can provide the ability to display the thumbnail window corresponding to the actual task window, and provide convenient layout capabilities such as adjusting the actual task window layout by sliding the thumbnail window up and down. In other embodiments, the above-mentioned task hub window or task control area can display icons or window icons of related applications, which are not limited here.
[0179] The window layout menu can be used to display the layout menu of the target window when the trigger condition is met. For example, when the user moves the target window and hovers the drag operation in the task hub window, the quick layout menu pops up to facilitate the user to quickly preview the layout effect. Real-time layout, such as the above Figure 2b The layout menu 221 or the layout menu 222 shown, or the above Figure 7b The layout menu 710 shown or the above Figure 8b Layout menu 810 etc. shown.
[0180] The hover ball can be used to provide easy access to the mission hub window when it is folded and unfolded. The hover ball can be closed in the control center.
[0181] The control center can be used to provide a switch entrance for the super window function, for example, by displaying the above-mentioned window control 511 and providing a switch entrance for the super window function.
[0182] The driver management module can be used to manage various driver programs, including the following display driver and integrated sensor driver, for example, providing driver version installation and upgrade capabilities.
[0183] The Super Window component can also include a design for X (DFX) plug-in for each stage of the product life cycle, which can provide the Super Window with design capabilities for each stage of the product life cycle (referred to as DFX capabilities). Electronic devices can provide DFX capabilities for the Super Window component through the HiViewDFX plug-in (a type of DFX plug-in).
[0184] Continue to refer Figure 12 As shown, Windows TMThe kernel mode of the operating system may also include an integrated sensor driver (ISH driver) and a display driver. The ISH driver may provide notifications of device state switching. For example, if the electronic device 30 is a foldable device, the ISH driver may provide notifications related to state switching of the foldable device from a folded state to a semi-expanded state, and from an expanded state to a semi-expanded state.
[0185] Continue to refer Figure 12 As shown, Windows TM The kernel mode of the operating system can also provide basic capability components and background business components.
[0186] Basic capability components include gesture recognition, upgrades, shape change recognition, and monitoring of keyboard and mouse events and window events. These basic capability components provide the foundation for capabilities such as backend services, window layout menus, task hub windows, and floating balls.
[0187] Backend business components can provide background feature business logic processing, such as icon management, throwing algorithm, waterfall flow, window memory, and window movement effects.
[0188] Continue to refer Figure 12 As shown, Windows TM The kernel mode of the operating system may also include a basic input / output system (BIOS), which is used to receive input and output signals and calculation perception results provided by an embedded controller (EC, also known as an EC chip) and an integrated sensor framework (ISH FW), including keyboard adsorption signals connected to the electronic device 30, opening and closing cover signals of foldable devices, etc., and calculation perception results determined by the ISH FW based on angle calculation and pattern recognition based on sensor information such as gyroscope sensors and acceleration sensors, etc., which will not be elaborated here.
[0189] Next, we will continue with Harmony with a layered architecture. TM Taking the system as an example, the system software structure of the electronic device 30 is exemplified.
[0190] Figure 13 According to an embodiment of the present application, a software structure diagram of another operating system is provided.
[0191] like Figure 13 As shown, the electronic device 30 can be equipped with a distributed system, such as Hongmeng TMOperating System (Harmony TM The distributed system may adopt a layered architecture, which may include an application layer, an application framework and system service layer, a driver layer, and a hardware abstraction layer (HAL).
[0192] The application layer may include a series of application packages, including system applications, office applications, conference applications, video applications, and creative applications, for example, application packages including input methods, main applications, video applications, and browser applications, without limitation.
[0193] The application framework and system service layer can provide distributed framework services for the application layer. The system service is the core of the distributed operating system and can provide services to applications and SDKs in the application layer through the application framework. Among them, the distributed framework services may include desktop management services, window management services, graphics services, Ark development framework, and multi-modal input framework. Among them, the desktop management service can determine whether an operation gesture for adjusting the window display position across the screen is detected based on the posture recognition of the foldable device and finger touch events, and notify the window management service.
[0194] The window management service can manage the actual task window corresponding to the target window to be displayed across the screen to the part of the screen indicated by the above operation gesture based on the detected operation gesture for adjusting the window display position across the screen, and perform cross-screen layout window processing.
[0195] The application framework and system service layer can also include system services such as folding gesture feedback, layer control and composition, display memory management, and touch screen management. Touch screen management can be used to report touch events corresponding to user finger operations on the touch screen, for example, to the desktop management service.
[0196] The driver layer, also known as the kernel layer, can include various drivers for controlling the hardware devices controlled by the hardware abstraction layer to implement related functions. In the embodiment of the present application, the driver layer can include sensor drivers, frame buffers (a type of display device driver), and touch drivers.
[0197] The Hardware Abstraction Layer (HAL) is an interface layer between the operating system kernel and the hardware circuit, used to abstract the hardware devices. In the embodiment of the present application, the hardware devices abstracted in the HAL may include sensors or sensor modules, touch screens, keyboards, mice, etc., without limitation.
[0198] Figure 14 According to an embodiment of the present application, a schematic diagram of the hardware structure of an electronic device is shown.
[0199] like Figure 14 As shown, the electronic device 30 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identity module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0200] It should be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 30. In other embodiments of the present application, the electronic device 30 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0201] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0202] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0203] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0204] In the embodiment of the present application, the processor 110 can complete the control of fetching instructions from the memory and executing instructions through the controller, so that the electronic device 30 implements the above embodiment 1. Figure 4 The steps of the implementation process shown or the implementation of the above embodiment 2 Figure 11 The steps of the implementation process shown are used to realize the interactive method provided by this application.
[0205] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a universal serial bus (USB) interface.
[0206] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 30. In other embodiments of the present application, the electronic device 30 may also adopt a different interface connection method from the above embodiment, or a combination of multiple interface connection methods.
[0207] The wireless communication function of the electronic device 30 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0208] Electronic device 30 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0209] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. In embodiments of the present application, display screen 194 of electronic device 30 may include screen B and screen C of the foldable device 10 described above in a semi-unfolded state. In some embodiments, electronic device 30 may include one or N display screens 194, where N is a positive integer greater than one.
[0210] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 30. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0211] The internal memory 121 can be used to store computer executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 30 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 30 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.
[0212] The electronic device 30 can implement audio functions such as music playback and recording through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0213] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device including at least two parallel plates with conductive material. When force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 30 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 30 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 30 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.
[0214] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 30. In some embodiments, the angular velocity of the electronic device 30 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 30 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 30 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.
[0215] Accelerometer 180E can detect the magnitude of acceleration of electronic device 30 in all directions (generally three axes). When electronic device 30 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.
[0216] The touch sensor 180K is also referred to as a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also referred to as a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 30, at a location different from that of the display screen 194.
[0217] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 30 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 30.
[0218] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. In addition, touch operations acting on different areas of the display screen 194 can also correspond to different vibration feedback effects of motor 191. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects.
[0219] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.
[0220] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 30 by inserting or removing the SIM card into or from the SIM card interface 195 .
[0221] The embodiments of the present application also provide a computer program product for implementing the interaction methods provided in the above embodiments.
[0222] The various embodiments of the mechanisms disclosed in this application can be implemented in hardware, software, firmware, or a combination of these implementation methods. The embodiments of the present application can be implemented as computer program modules or module codes executed on a programmable system, which includes at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.
[0223] A computer program module or module code can be applied to input instructions to perform the functions described herein and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.
[0224] Module code can be implemented with high-level modular language or object-oriented programming language to communicate with the processing system. When necessary, module code can also be implemented with assembly language or machine language. In fact, the mechanism described in this application is not limited to the scope of any specific programming language. In either case, the language can be a compiled language or an interpreted language.
[0225] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, instructions may be distributed over a network or through other computer-readable media. Therefore, a machine-readable medium may include any mechanism for storing or transmitting information in a machine (e.g., computer) readable form, including but not limited to a floppy disk, an optical disk, an optical disk, a magneto-optical disk, a read-only memory (ROM), a random access memory (RAM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic card or an optical card, a flash memory, or a tangible machine-readable memory for transmitting information (e.g., a carrier wave, an infrared signal, a digital signal, etc.) using the Internet in an electrical, optical, acoustic, or other form of propagation signal. Accordingly, machine-readable media includes any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a form readable by a machine (eg, a computer).
[0226] References in the specification to "one embodiment" or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one exemplary implementation or technique disclosed according to the embodiment of the present application. The appearances of the phrase "in one embodiment" in various places in the specification do not necessarily all refer to the same embodiment.
[0227] The disclosure of the embodiments of the present application also relates to an operating device for executing the text. The device can be constructed specifically for the required purpose or it can include a general-purpose computer that is selectively activated or reconfigured by a computer program stored in the computer. Such a computer program can be stored in a computer-readable medium, such as, but not limited to, any type of disk, including a floppy disk, an optical disk, a CD-ROM, a magneto-optical disk, a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM, a magnetic or optical card, an application-specific integrated circuit (ASIC) or any type of medium suitable for storing electronic instructions, and each can be coupled to a computer system bus. In addition, the computer mentioned in the specification can include a single processor or can be an architecture involving multiple processors for increased computing power.
[0228] In addition, the language used in this specification has been primarily selected for readability and instructional purposes and may not be selected to describe or limit the disclosed subject matter. Therefore, the present disclosure of embodiments is intended to illustrate, not to limit, the scope of the concepts discussed herein.
Claims
1. An interactive method, applied to an electronic device, characterized in that: The method comprises: Displaying a first interface, wherein the first interface includes a first window and a first display area, and the first display area includes a first logo of the first window; detecting a first drag operation of the user on the first logo; Corresponding to the first drag operation, the first window is moved.
2. The method according to claim 1, characterized in that The electronic device comprises a foldable device, wherein the foldable device comprises a first screen portion and a second screen portion located on either side of a folding axis.
3. The method according to claim 2, characterized in that The first screen portion is located in a first direction of the second screen portion, and the second screen portion is located in a second direction of the first screen portion, wherein the first direction is opposite to the second direction.
4. The method according to claim 3, characterized in that The first display area is located in the first screen portion.
5. The method according to claim 4, characterized in that The detecting a first drag operation of the user on the first logo image includes: An operation of a user dragging the first identification image to move toward the second direction is detected.
6. The method according to claim 4, characterized in that The second screen portion includes a displayed second interface, the second interface includes a second window, and the first display area includes a second logo corresponding to the second window.
7. The method according to claim 6, characterized in that The method comprises: detecting a second dragging operation of the user dragging the second identification image toward the first direction; Corresponding to the second drag operation, the second window is moved to the first interface displayed on the first screen portion.
8. The method according to claim 7, characterized in that The detecting a first drag operation of the user on the first logo image includes: It is detected that a first distance that the user drags the first identification image in the second direction satisfies a first threshold condition; and / or, The detecting a second dragging operation in which the user drags the second identification image to move in the first direction includes: It is detected that a second distance for the user to drag the second identification image in the first direction satisfies the first threshold condition.
9. The method according to claim 4, characterized in that The detecting a first drag operation of the user on the first logo image includes: detecting a first combined operation of the user on the first logo, wherein the first combined operation includes a first operation of dragging the first logo toward the second direction and hovering the first logo, and An operation of a user selecting a first area in a second display area displayed by the first operation trigger is detected, wherein: The second display area includes at least one display region recommended for the first window, the at least one display region includes the first region, and the at least one display region is located within the display region of the second screen portion.
10. The method according to claim 9, characterized in that The moving the first window in response to the first drag operation includes: Corresponding to the first combining operation, the first window is displayed in a corresponding area of the first area in the second screen portion.
11. The method according to claim 6, characterized in that The method comprises: detecting a second combined operation of the user on the second logo, wherein the second combined operation includes a second operation of dragging the second logo toward the first direction and hovering the second logo, and detecting an operation of a user selecting a second area in a third display area displayed by the second operation trigger, wherein the third display area includes at least one display area recommended for the second window, the at least one display area includes the second area, and the at least one display area is located within the display area of the first screen portion; Corresponding to the second combining operation, the second window is displayed in a corresponding area of the second area in the first screen portion.
12. The method according to claim 11, characterized in that The third distance of dragging the first logo image to the second direction satisfies a second threshold condition; and / or, The fourth distance of dragging the second identification image toward the first direction satisfies the second threshold condition.
13. The method according to any one of claims 9 to 12, characterized in that The duration corresponding to the hovering operation meets a third threshold condition.
14. The method according to claim 4, characterized in that The detecting a first drag operation of the user on the first logo image includes: detecting a third combined operation performed by a user on the first logo using a mouse, the third combined operation including placing the mouse on the first logo and hovering the mouse; and An operation of a user clicking a first control among the multiple controls displayed by the third operation triggering display by a mouse is detected, wherein the first control is used to indicate a screen portion where the first window is displayed.
15. The method according to claim 14, characterized in that The screen portion displayed by the first control indication is the second screen portion.
16. The method according to claim 15, characterized in that The moving the first window in response to the first drag operation includes: Corresponding to the third combined operation, the first window is displayed in the second screen portion indicated by the first control.
17. The method according to claim 16, characterized in that An icon indicating the second direction is displayed on the first control.
18. The method according to any one of claims 14 to 17, characterized in that The duration corresponding to the hovering operation meets a fourth threshold condition.
19. The method according to claim 3, characterized in that The first display area is located in the second screen portion.
20. The method according to claim 19, characterized in that The detecting a first drag operation of the user on the first logo image includes: An operation of a user dragging the first identification image to move toward the first direction is detected.
21. The method according to claim 19, wherein The detecting a first drag operation of the user on the first logo image includes: detecting a fourth combined operation of the user on the first logo, wherein the fourth combined operation includes a fourth operation of dragging the first logo toward the first direction and hovering the first logo, and An operation of selecting a third area in a fourth display area triggered by the fourth operation is detected, wherein: The fourth display area includes at least one display region recommended for the first window, the at least one display region includes the third region, and the at least one display region is located within the display region of the first screen portion.
22. The method according to claim 19, wherein The detecting a first drag operation of the user on the first logo image includes: detecting a fifth combined operation performed by a user on the first logo using a mouse, the fifth combined operation including a fifth operation of placing the mouse on the first logo and hovering the mouse; and An operation of a user clicking a second control among the multiple controls displayed by the fifth operation is detected, wherein the second control is used to indicate the screen portion where the first window is displayed, and the screen portion includes the first screen portion or the second screen portion.
23. The method according to any one of claims 1 to 19, characterized in that The first identification diagram includes: The thumbnail window corresponding to the first window; or The application icon corresponding to the application program interface displayed in the first window.
24. An electronic device, characterized in that: include: one or more processors; One or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device executes the interaction method according to any one of claims 1 to 23.
25. A computer-readable medium, characterized in that The readable medium stores instructions, which, when executed on a computer, cause the computer to execute the interactive method according to any one of claims 1 to 23.
26. A computer program product, characterized in that The invention comprises a computer program / instruction, which implements the interactive method according to any one of claims 1 to 23 when executed by a processor.
Citation Information
Cited By
Interaction method, electronic device, readable medium and program product
WO2025167110A1