An object control method, an electronic device, and a storage medium
By using side touch operation, the utilization rate of the side area of electronic devices is improved, enabling convenient control and management of objects. This solves the problem of low utilization rate of the side area in existing technologies and improves the convenience and efficiency of one-handed operation.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2025-01-23
- Publication Date
- 2026-07-24
AI Technical Summary
The side areas of existing electronic devices are underutilized, causing touch operation to rely on touchscreens, which is inconvenient, especially in one-handed operation scenarios.
Side touch controls allow users to control and move objects on the screen, improving the utilization of the side area. Functions include object copying, labeling, sharing, and window management.
It improves the utilization of the side area, enhances the convenience and efficiency of touch operation, and reduces the reliance on the touch screen, especially in one-handed operation scenarios.
Smart Images

Figure CN122450359A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to an object control method, electronic device, and storage medium. Background Technology
[0002] With the widespread use of touchscreens, touch operations on electronic devices (such as mobile phones) largely rely on touchscreens, resulting in relatively low utilization of the side areas of these devices. Taking mobile phones as an example, the side areas are primarily used for the power and volume buttons, failing to fully utilize their potential. Summary of the Invention
[0003] This application provides an object control method, an electronic device, and a storage medium that can control objects on a display screen through side touch operation, improve the utilization of the side area, make touch operation not completely dependent on the touch screen, and improve the convenience and efficiency of operation in some scenarios (e.g., one-handed operation scenarios) by performing touch operation in the side area.
[0004] Firstly, an object control method is provided, which can be applied to an electronic device. For example, the electronic device may be a mobile phone, tablet computer, etc. In this method, the electronic device displays N objects, which are either N windows or N objects located within the same window. When the N objects are located within the same window, the N objects include at least one of images, text, videos, or documents, where N is a positive integer. In response to a first operation, the electronic device moves a target object among the N objects to a first position, where the first operation is an operation performed on the side area of the electronic device, the first position is a position on the display screen of the electronic device near the first operation, and the target object is at least one of the N objects.
[0005] Therefore, in this embodiment, on the one hand, users can control objects on the display screen of an electronic device through side touch operations. This method helps improve the utilization rate of the side area of the electronic device, making touch operations not entirely dependent on the touchscreen. Moreover, in some scenarios (e.g., one-handed operation scenarios), side touch operations can improve the convenience and efficiency of operation. On the other hand, in this embodiment, users can move a target object on the display screen to a first position through side touch operations. The first position is the position on the display screen closest to the user's side touch operation; in other words, moving the target object closer to the user's finger makes it easier for the user to operate on the target object, further improving convenience. Furthermore, in this embodiment, through side touch operations, a target window in N windows on the display screen can be moved to a first position, achieving convenient window management; or, through side touch operations, a target object (e.g., image, text, etc.) among N objects in a window can be moved to a first position, thereby achieving convenient management of each object in the window. Therefore, side touch operations can achieve a variety of rich functions and are highly flexible.
[0006] In one possible design, the N objects are located within the same window. Moving the target object among the N objects to a first position in response to the first operation includes: copying the target object among the N objects in response to the first operation, and moving the copied object to the first position. Therefore, in this embodiment, a user can trigger an electronic device to copy a target object (e.g., an image) on the display screen via side touch operation, and move the copied target object to a first position so that the target object is close to the user's finger, facilitating user operation on the target object (e.g., transferring the target object across applications), thus improving convenience.
[0007] In one possible design, the N objects are located within the same window. Moving a target object among the N objects to a first position in response to a first operation includes: moving an indicator of the target object to the first position in response to the first operation, while the target object remains in its original position. Therefore, in this embodiment, a user can trigger the electronic device to move the indicator of a target object on the display screen to a first position via side touch operation. This improves the utilization of the side area and, after the target object's indicator is moved to the first position, facilitates user operation on the target object (e.g., cross-application transfer of the target object), enhancing convenience.
[0008] As an example, the identifier indicating the target object may include: an object obtained by copying the target object, or it may not be a copy of the target object, but rather an identifier in various forms such as icons, images, or symbols, as long as it can demonstrate the visual effect of the target object being moved. The identifier can locate the target object; therefore, after the identifier moves to a first position, if the electronic device receives an operation targeting the identifier, it can open the target object. It is understood that if the target object is stored locally, the identifier can be mapped to the target object's local storage address; if the target object is not stored locally (e.g., the target object is text, images, etc. on a webpage), the identifier can be mapped to a webpage link used to open the target object (e.g., the target object's URL link), or the target object can be downloaded and stored, in which case the identifier can be mapped to the target object's local storage address.
[0009] In one possible design, the method further includes: in response to a second operation, displaying M identifiers, where M is a positive integer, each of the M identifiers indicating a sharing method or a sharing object, the second operation being an operation applied to the side area; and in response to a selection operation on a first identifier among the M identifiers, sharing the target object using the sharing method corresponding to the first identifier, or sharing the target object to the sharing object corresponding to the first identifier. Therefore, in this embodiment, after the target object moves to the first position, the user can bring up a quick sharing interface via side touch operation. This quick sharing interface includes M identifiers, and the user can select one of them. If the selected identifier indicates a sharing method, then that sharing method is used to share the target object; if the selected identifier indicates a sharing object, then the target object is shared to that sharing object. In this method, convenient sharing of the target object is achieved through side touch operation, resulting in a better user experience.
[0010] In one possible design, the N objects are located within a first window, and the method further includes: displaying a second window; and moving the target object into the second window in response to a drag operation on the target object at the first position. Therefore, in this embodiment, when the first window includes N objects, the user moves the target object from the N objects to the first position via a side touch operation. Then, the electronic device opens the second window, allowing the target object to be moved into the second window. Thus, in this method, the user transfers the target object from the first window to the second window via a side touch operation. It should be understood that if the first window and the second window are windows of different applications, then the technical solution of this embodiment achieves cross-application information transfer; if the first window and the second window are windows of the same application, then the technical solution of this embodiment achieves cross-window information transfer within the same application.
[0011] In one possible design, the N objects represent N windows. Moving the target object among the N objects to a first position in response to the first operation includes: obtaining a floating window corresponding to the target window based on the target window among the N windows, and moving the floating window to the first position. Therefore, in this embodiment, the user can move the floating window corresponding to the target window among the N windows of the electronic device to the first position via side touch operation, achieving convenient window management. Furthermore, moving the floating window to the first position closest to the user's finger facilitates user operation of the floating window, improving convenience.
[0012] In one possible design, the method further includes: in response to an operation on the floating window, switching the floating window to a full-screen window, or entering a split-screen mode, wherein the floating window is switched to a window within a first area of the split-screen mode. Therefore, in this embodiment, after the floating window corresponding to the target window moves to the first position, the user can operate the floating window, such as switching it to a full-screen window or entering a split-screen mode. Thus, the window can be flexibly controlled via side touch operation, offering high convenience.
[0013] In one possible design, the target object is the object selected by the user. Therefore, in this embodiment, when the electronic device displays N objects, the user can select a target object and trigger the electronic device to move the target object closer to the user's finger via a side touch operation, making it convenient for the user to operate on the target object and improving convenience.
[0014] In one possible design, after the target object moves to the first position, the method further includes hiding the target object. Therefore, in this embodiment, the target object can be hidden after moving to the first position to avoid obscuring the interface and affecting the user experience.
[0015] In one possible design, hiding the target object includes: determining that the target object has been displayed at the first position for a preset duration, and then hiding the target object; or, in response to a hiding operation of the target object, hiding the target object, wherein the hiding operation applies to the side area. Therefore, in this embodiment, after the target object moves to the first position, it can be automatically or manually hidden to avoid obscuring the interface and affecting the user experience.
[0016] In one possible design, after hiding the target object, the method further includes displaying a first marker, which indicates that a target object has been hidden. Therefore, in this embodiment, after the target object is moved to a first position, it can be hidden. To prevent the user from forgetting, a first marker can be displayed to indicate that a target object has been hidden, resulting in a better user experience.
[0017] In one possible design, after hiding the target object, the method further includes: displaying the target object in response to a recall operation of the target object, the recall operation being applied to the side area. Therefore, in this embodiment, after the target object is hidden, it can be recalled via side touch operation when needed by the user, which is convenient and provides a good user experience.
[0018] In one possible design, the method further includes: in response to a locking operation of the target object, the target object enters a locked state, and in the locked state, the target object remains continuously displayed on the top layer of the display screen, the locking operation acting on the side area. Therefore, in this embodiment, the user can lock the target object on the top layer of the display screen through side touch operation, preventing the target object from being obscured, resulting in a better user experience.
[0019] In one possible design, the method further includes: in response to a release operation of the locked state of the target object, the target object exits the locked state, and the release operation is applied to the side area. Therefore, in this embodiment, after the target object is locked to the top layer of the display screen, the locked state can be released so that the target object can be hidden and displayed. For example, it can be hidden when the user does not need it to avoid obstructing the interface; and it can be displayed when the user needs it, resulting in a better user experience.
[0020] In one possible design, the target object comprises multiple objects, which are displayed stacked after the target object is moved to the first position. Therefore, in this embodiment, when there are multiple target objects, they can be stacked at the first position to avoid excessive obstruction of the interface and negatively impacting the user experience.
[0021] In one possible design, the method further includes: in response to an expand operation of a target object, expanding the stacked plurality of objects, the expand operation acting on the side area; or, in response to a switch operation of a target object, switching the topmost object among the stacked plurality of objects to a lower-level object, the switch operation acting on the side area. Therefore, in this embodiment, when multiple target objects are stacked at a first position, the user can trigger the expansion or switch of the multiple target objects through side touch operations, allowing the user to view each target object, resulting in a better user experience.
[0022] In one possible design, the method further includes: the electronic device, in response to moving the target object to a first position, sending information about the target object to another electronic device, so that the other electronic device displays the target object. Therefore, in this embodiment, when a user moves a target object to a first position on device A via a side touch operation, device A can send information about the target object to device B, causing device B to also display the target object. Thus, in this approach, a user performing a side touch operation on device A can affect / map / influence device B, achieving cross-device interaction and providing a better user experience.
[0023] In one possible design, the side area is the side frame of the electronic device; or, the side area is the side screen formed when the foldable screen of the electronic device is in a folded state. Therefore, in this embodiment, the user can perform touch operations on the side frame of the electronic device or the side screen formed by folding to trigger the electronic device to move the target object to a first position, thereby improving the utilization rate of the side frame or the side screen and making the touch operation not entirely dependent on the touchscreen.
[0024] In one possible design, the side area includes a first button, and the first operation is an operation on the first button. Therefore, in this embodiment, the user can trigger the electronic device to move the target object to a first position by operating the first button in the side area, thus improving the utilization rate of the side area. For example, the first button can be a power button, volume button, camera control button, etc., in the side area, and is not limited thereto.
[0025] In one possible design, the first operation is two consecutive taps at the same location within the side area. Therefore, in this embodiment, the user can trigger the electronic device to move the target object to the first position by performing two consecutive taps at the same location within the side area, which is convenient and provides a good user experience.
[0026] Secondly, an object control method is also provided, which can be applied to electronic devices. For example, the electronic device can be a mobile phone, tablet computer, etc. In this method, the electronic device displays a first window; in response to a first operation, the first window is adjusted to a floating window and moved to a first position, wherein the first operation is an operation acting on the side area of the electronic device, and the first position is a position on the display screen of the electronic device close to the first operation.
[0027] Therefore, in this embodiment, the user can control the foreground window (e.g., a full-screen window) of the electronic device via side touch operation, such as switching the foreground window to a floating window and moving the floating window to a first position. It is understood that after the foreground window is switched to a floating window and moved to the first position, other windows, such as the desktop or the previous window, can be displayed in the foreground. This allows for quick switching of the foreground window, resulting in a better user experience. Furthermore, moving the foreground window to the first position, i.e., close to the user's finger, after switching to a floating window, facilitates user operation of the floating window, further enhancing the user experience.
[0028] In one possible design, the electronic device displays the first window in two ways: either the electronic device displays the first window in full-screen mode, or the electronic device is in split-screen mode and displays the first window within a first area of the split-screen mode. In summary, in the embodiments of this application, when the electronic device displays the first window (in full-screen or split-screen mode) in the foreground, the user can switch the first window to a floating window and move it to a first position via side touch operations, thus achieving flexible control over the foreground window.
[0029] In one possible design, the method further includes: in response to an operation on the floating window, switching the floating window to a full-screen window, or entering a split-screen mode, whereby the floating window is switched to a window within a second area of the split-screen mode. Therefore, in this embodiment, after switching the foreground window to a floating window and moving it to a first position via side touch operation, if an operation on the floating window is received, the floating window can be switched to a full-screen window or enter a split-screen mode, resulting in a better user experience.
[0030] In one possible design, after the floating window is moved to the first position, the method further includes hiding the floating window. Therefore, in this way, the floating window can be prevented from obscuring the interface.
[0031] In one possible design, hiding the floating window includes: determining that the display duration of the floating window at the first position has reached a preset duration, and then hiding the floating window; or, in response to a hiding operation of the floating window, hiding the floating window, wherein the hiding operation applies to the side area. Therefore, in this embodiment, after the floating window moves to the first position, it can be automatically or manually hidden to avoid obscuring the interface.
[0032] In one possible design, after hiding the floating window, the method further includes displaying a first marker, which indicates that a floating window has been hidden. Therefore, this approach prevents users from forgetting that a floating window has been hidden, resulting in a better user experience.
[0033] In one possible design, after hiding the floating window, the method further includes: displaying the floating window in response to a recall operation of the floating window, the recall operation being applied to the side area. Therefore, in this embodiment, after the floating window is hidden, it can be recalled by side touch operation when needed, which is convenient and provides a good user experience.
[0034] In one possible design, the method further includes: in response to a locking operation of the floating window, the floating window enters a locked state, and in the locked state, the floating window remains displayed on the top layer of the display screen; the locking operation applies to the side area. Therefore, in this way, after the floating window moves to a first position, it can be locked on the top layer of the display screen via a side touch operation, preventing the floating window from being obstructed and affecting the user's view of its content.
[0035] In one possible design, the method further includes: in response to an unlocking operation of the floating window's locked state, the floating window exits the locked state, and the unlocking operation is applied to the side area. Therefore, in this embodiment, after the floating window is locked to the top layer of the display screen, the user can unlock it through a side touch operation. That is, the floating window can be hidden and brought up; for example, it can be hidden when the user does not need it and brought up when the user needs it, resulting in a better user experience.
[0036] In one possible design, the first window is one of multiple windows currently displayed on the electronic device. That is, when the electronic device displays multiple windows (multiple windows displayed in split-screen or tiled / stacked display), the user can use side touch operations to switch one of the multiple windows into a floating window and move the floating window to the first position.
[0037] In one possible design, the first window is the user-selected window among the multiple windows. That is, when the electronic device displays multiple windows (multiple windows displayed in split-screen or tiled / stacked display), the user can select one window among the multiple windows, switch that window to a floating window through side touch operation, and move the floating window to the first position.
[0038] In one possible design, before adjusting the first window to a floating window in response to the first operation, the electronic device also displays a second window. The method further includes: adjusting the second window to a floating window in response to the first operation, and moving the floating window to a first position. That is, when the electronic device displays multiple windows (multiple windows displayed in split-screen or tiled / stacked display), the user can switch all windows to floating windows via side touch operation, and then move all floating windows to a first position, thus clearing the foreground windows through side touch operation.
[0039] In one possible design, multiple floating windows can be stacked and displayed after being moved to the first position. This avoids obscuring the interface and negatively impacting the user experience.
[0040] In one possible design, the method further includes: in response to an expand operation of the floating windows, expanding the stacked plurality of floating windows, the expand operation acting on the side area; or, in response to a switch operation of the floating windows, switching the topmost floating window among the stacked plurality of floating windows to a lower floating window, the switch operation acting on the side area. Therefore, in this embodiment, when multiple floating windows are stacked at a first position, the user can trigger the expansion or switch of the multiple floating windows through side touch operations, allowing the user to view each floating window, resulting in a better user experience.
[0041] In one possible design, the method further includes: in response to moving the floating window to a first position, the electronic device sends information about the floating window to another electronic device, causing the other electronic device to display the floating window. Therefore, in this approach, when a user performs a side-touch operation on device A to switch the foreground window of device A to a floating window and move it to the first position, the floating window will also be displayed on device B, achieving convenient cross-device interaction and providing a better user experience.
[0042] In one possible design, the side area is the side frame of the electronic device; or, the side area is the side screen formed when the foldable screen of the electronic device is in a folded state.
[0043] In one possible design, the side area includes a first button, and the first operation is an operation performed on the first button.
[0044] In one possible design, the first operation is two consecutive light touches at the same location within the side area.
[0045] Thirdly, an electronic device is also provided, comprising:
[0046] Processor, memory, and one or more programs;
[0047] The one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the method provided in the first or second aspect above.
[0048] Fourthly, a communication system is also provided, comprising: a first device and a second device;
[0049] A first device is configured to display N objects, wherein the N objects are N windows, or the N objects are located within the same window, wherein when the N objects are located within the same window, the N objects include at least one of images, text, videos, or documents, and N is a positive integer; further configured to, in response to a first operation, move a target object among the N objects to a first position, wherein the first operation is an operation performed on a side area of the electronic device, the first position is a position on the display screen of the electronic device near the first operation, and the target object is at least one of the N objects; further configured to, in response to the target object moving to the first position, send information about the target object to a second device;
[0050] The second device is used to receive information about the target object sent by the first device, and to display the target object based on the information about the target object.
[0051] Fifthly, a communication system is also provided, comprising: a first device and a second device;
[0052] A first device is configured to display a first window, and, in response to a first operation, adjust the first window to a floating window and move the floating window to a first position, wherein the first operation is an operation performed on the side area of the electronic device, and the first position is a position on the display screen of the electronic device close to the first operation; and is further configured to send information about the floating window to a second device in response to the floating window moving to the first position.
[0053] The second device is used to receive information about the floating window sent by the first device, and to display the floating window based on the information about the floating window.
[0054] In a sixth aspect, a computer-readable storage medium is also provided for storing a computer program that, when run on a computer, causes the computer to perform the methods provided in the first or second aspect above.
[0055] In a seventh aspect, a computer program product is also provided, comprising a computer program that, when run on a computer, causes the computer to perform the methods provided in the first or second aspect above.
[0056] Eighthly, a chip is also provided, the chip being used to execute the technical solutions provided in the first or second aspect above.
[0057] For the technical effects that can be achieved in aspects two through eight above, please refer to the description of the technical effects that can be achieved in the corresponding design schemes in aspect one above. This application will not repeat them here. Attached Figure Description
[0058] Figure 1 A schematic diagram illustrating cross-application information transmission provided in an embodiment of this application;
[0059] Figure 2 A schematic diagram of an electronic device provided according to an embodiment of this application;
[0060] Figures 3A to 3C A schematic diagram illustrating an application scenario provided in one embodiment of this application;
[0061] Figures 4 to 7 A schematic diagram of an object control process provided in an embodiment of this application;
[0062] Figures 8A to 8B A schematic diagram illustrating object switching or expansion provided in an embodiment of this application;
[0063] Figures 9A to 9B A schematic diagram illustrating object sharing as provided in one embodiment of this application;
[0064] Figures 10A to 10C Another schematic diagram illustrating an application scenario provided by an embodiment of this application;
[0065] Figure 11 A schematic diagram of a window control process provided in an embodiment of this application;
[0066] Figures 12 to 13 A schematic diagram of a window control process provided in an embodiment of this application;
[0067] Figures 14A to 14B A schematic diagram illustrating the hiding and summoning of a target window according to an embodiment of this application;
[0068] Figure 15 A schematic diagram of the locked state of a target window provided in an embodiment of this application;
[0069] Figures 16A to 16B A schematic diagram illustrating the switching or expansion of a target window according to an embodiment of this application;
[0070] Figures 17A to 17B A schematic diagram illustrating the usage process of a target window provided in an embodiment of this application;
[0071] Figures 18 to 19 A schematic diagram illustrating a cross-device information transmission scenario provided in an embodiment of this application;
[0072] Figure 20 A schematic diagram of an electronic device provided in an embodiment of this application;
[0073] Figure 21 Another schematic diagram of an electronic device provided in an embodiment of this application. Detailed Implementation
[0074] The following explanations of some terms used in the embodiments of this application are provided to facilitate understanding by those skilled in the art.
[0075] The embodiments of this application involve at least one, including one or more; where "multiple" means two or more. Furthermore, it should be understood that in the description of this specification, terms such as "first," "second," and "third" are used only for descriptive purposes and should not be construed as indicating relative importance or order. For example, "first device" and "second device" do not represent the degree of importance of the two or their order, but are merely for descriptive distinction. In the embodiments of this application, "and / or" merely describes an association relationship, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Additionally, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.
[0076] The directional terms mentioned in the embodiments of this application, such as "up", "down", "left", "right", "inner", and "outer", are only for reference to the directions in the accompanying drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of this application, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the embodiments of this application.
[0077] References to "one embodiment," "in some examples," or "some embodiments" as described in the embodiments of this application mean that one or more embodiments of this specification include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in some examples," "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0078] The technical solutions provided in this application can be applied to electronic devices. For example, an electronic device can be a mobile terminal. Exemplary mobile terminals can be portable devices such as mobile phones, tablets, laptops, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs); or they can be wearable devices such as watches and wristbands; or they can be virtual reality (VR) devices, augmented reality (AR) devices, mixed reality (MR) devices, etc. In short, this application does not limit the specific type of mobile terminal. Optionally, the mobile terminal in this application can have a foldable screen or not, and this is not limited. For ease of understanding, the following description mainly uses mobile phones or tablets as examples of electronic devices.
[0079] With the maturity of touch technology, touchscreens have become an indispensable feature of electronic devices, providing convenient services for user operation. However, in some scenarios, relying solely on touchscreens for operation can be ineffective. For ease of understanding, the following example illustrates this scenario: cross-application information transfer within an electronic device.
[0080] It's understandable that electronic devices contain a wide variety of applications, and in actual use, scenarios requiring information transfer across applications are inevitable. For example, if a user needs information from application B while using application A, they can switch the device from application A to application B, retrieve (e.g., copy) the necessary information from application B, and then switch back to application A to use (e.g., paste) the information. This method requires switching between two applications. Understandably, if information needs to be retrieved from application B multiple times while using application A, repeated switching between the two applications is cumbersome and inefficient. To reduce repeated switching between applications, one possible approach is for the electronic device to provide a cache area (or transit area) where users can temporarily store (or store) information from application B. This way, if a user needs information from application B while using application A, they can retrieve the information from the cache area without switching to application B, reducing the application switching process. The following explains the process of a user temporarily storing information from application B in the cache area.
[0081] One possible approach is for the user to temporarily store the information in application B's cache area by long-pressing and dragging the information within application B's window. For example, ... Figure 1 In (a), the electronic device displays a first window of application B (e.g., a browser application), and the first window includes a first object, such as an image. Figure 1 In (b) of the example, when the electronic device detects a long press and drag operation on the first object, it generates a second object based on the first object, and the second object moves with the drag operation. For example, the second object can be a copy of the first object. Figure 1 In step (c), when the electronic device detects that the dragging distance has reached a preset distance, it displays the buffer area. For example, the buffer area is displayed floating on the top layer. Optionally, the buffer area can be displayed in a fixed position; considering that the upper right corner of the screen is more convenient for user operation, the buffer area can be displayed in the upper right corner. Figure 1 In step (d), after the electronic device detects that the second object has been dragged to the cache area and the drag operation is released (i.e., the user's finger leaves the screen), the second object is temporarily stored in the cache area. If the user wants to temporarily store other objects, they can also do so by long-pressing and dragging. Once the cache area contains objects, if the user needs to use objects within the cache area while using application A, they can retrieve those objects from the cache area. For example, ... Figure 1 In (e), the electronic device displays a second window of application A (e.g., a memo application). Figure 1In (f), when the electronic device detects a long press and drag operation on a second object within the cache area, the second object moves along with the drag operation. For example... Figure 1 In step (g), if the electronic device detects that the drag operation has been released, the second object is displayed in the second window of application A. Therefore, through... Figure 1 It can be seen that the existence of the cache area avoids repeated switching between different applications in cross-application information transmission scenarios, thus improving efficiency.
[0082] It should be noted that, Figure 1 The cross-application information transfer process shown relies entirely on user operation on the touchscreen, which can be quite difficult in certain scenarios. For example, in a one-handed operation scenario, the user's thumb has limited reach on the touchscreen. If the first object is located in a position that the thumb cannot reach, then the long press and drag operation is difficult to implement and not convenient enough.
[0083] In view of this, this application provides a solution applicable to the aforementioned cross-application information transmission scenarios, which improves the convenience of information temporary storage. For example, users can temporarily store objects within a window via side touch operation, without needing to long-press and drag objects on the touchscreen. This reduces reliance on the touchscreen, increases the utilization rate of the side area, and, in one-handed operation scenarios, makes touch operation in the side area easier and more convenient.
[0084] As mentioned above, users can temporarily store objects within a window using side-touch operations. Side-touch operations refer to touch operations performed on the side area of the electronic device. For ease of understanding, let's first explain the side area of the electronic device. Optionally, the side area of the electronic device can be the side border of the electronic device. For example, as... Figure 2 In (a) of this application, taking a mobile phone as an example, the side area of the mobile phone can be the side frame of the mobile phone. It should be understood that a mobile phone can have multiple side frames, such as the top side frame, bottom sidebar, left side frame, and right side frame. The "side area" in this embodiment can be any one or more of these multiple side frames, such as the right side frame of the mobile phone. Optionally, in the case of an electronic device with a foldable screen, the side area can also be the side screen formed by the foldable screen in the folded state, such as... Figure 2 (b) In this case, one possible scenario is that when the foldable screen of the electronic device is in the folded state, the user temporarily saves the objects in the window through touch operations on the side screen; when the foldable screen of the electronic device is in the unfolded state, the user temporarily saves the objects in the window through touch operations on the side frame.
[0085] Therefore, in this embodiment, the electronic device temporarily stores objects within a window in response to a side touch operation. For example, when the electronic device displays a first window of a first application and detects a side touch operation, it copies objects within the first window and moves the copied objects to a first position, thereby achieving object temporary storage. Figure 2 For example, in (a) of the above, the electronic device displays a first window of a first application on its screen. In response to a side touch operation, the electronic device copies an object within the first window and moves the copied object to a first position. Figure 2 Taking (b) as an example, when the foldable screen of the electronic device is in a folded state, it forms a first screen, a second screen, and a side screen. The first screen displays a first window of a first application. In response to a touch operation on the side screen, the electronic device copies an object within the first window and moves the copied object to a first position. Optionally, the first application can be any application in the electronic device, including system applications and third-party applications, without limitation. The objects within the first window of the first application can include at least one of the following: images, text, icons, videos, files, etc.
[0086] For ease of understanding, the following text will mainly focus on... Figure 2 Taking the mobile phone in (a) as an example, several application scenarios are provided below.
[0087] Application scenario one, the primary application is a browser application. For example, such as... Figure 3A (a) The electronic device displays the first window of a browser application, which includes a first object, such as an image. Figure 3A (b) The electronic device detects a side touch operation, and in response to the operation, the electronic device generates a second object corresponding to the first object, and moves the second object to the first position, such as... Figure 3A (c). Therefore, in this process, the user triggers the image in the browser application window to "snap" to the first position through side touch operation, which is convenient and provides a good experience.
[0088] Application Scenario 2: The first application is a photo gallery application. For example, such as... Figure 3B (a) The electronic device displays the first window of a gallery application, which includes a first object, and the first object is selected. For example... Figure 3B (b) The electronic device detects a side touch operation, and in response to the operation, the electronic device generates a second object corresponding to the first object, and moves the second object to the first position, such as... Figure 3B (c). Therefore, in this process, the user triggers the objects in the gallery application window to "snap" to the first position through side touch operation, which is convenient and provides a good experience.
[0089] Application Scenario 3: The first application is file applications. For example, ... Figure 3C (a) The electronic device displays a first window of the file application, which includes a first object, and the first object is selected. For example... Figure 3C (b) The electronic device detects a side touch operation, and in response to the operation, the electronic device generates a second object corresponding to the first object, and moves the second object to the first position, such as... Figure 3C (c). Therefore, in this process, the user triggers the file in the file application window to "snap" to the first position through side touch operation, which is convenient and provides a good experience.
[0090] The above lists three application scenarios, each corresponding to a different application. It is understood that, in addition to the three applications mentioned above, the technical solutions of the embodiments of this application can also be applied to other applications, which will not be listed one by one.
[0091] The implementation principle of the technical solution of the embodiments of this application will be described in detail below.
[0092] For example, such as Figure 4 In (a) above, the electronic device displays the first window of the first application. The first application can be any application on the electronic device, including system applications and third-party applications, without limitation. For example, the first application could be the browser application in application scenario one above, the gallery application in application scenario two, or the file application in application scenario three. Figure 4 In (a) of the example, the first window contains multiple objects, such as objects 1 to 10. Optionally, each object can be any form, such as text, symbol, icon, button, image, video, or file. For example, if the first window is the browser application's first window in application scenario one, the objects include text and images. If the first window is the photo album application's first window in application scenario two, the objects include images. If the first window is the file application's first window in application scenario three, the objects include files.
[0093] Continue with Figure 4 Taking (a) as an example, the first window of the first application includes multiple objects. The electronic device can determine the target object, which is at least one of the multiple objects. The target object can be determined in two ways: automatic determination and manual determination, which will be described below.
[0094] Taking automatic determination as an example, if the first window includes an image, the electronic device determines the image in the first window as the target object. Alternatively, if the first window includes a video, the electronic device determines the video in the first window as the target object. In one possible implementation, the electronic device includes a priority relationship between different object types, for example, video > image > text > file. The electronic device can determine the target object in the first window based on this priority relationship. For example, if the first window includes video, image, and text, the target object is determined to be video based on the priority relationship. Optionally, the priority relationship can be pre-configured in the electronic device; for example, the priority relationship is pre-configured at the factory.
[0095] Taking manual selection as an example, the electronic device determines the target object based on the user's object selection operation within the first window. In one possible implementation, when the electronic device detects an operation that triggers the first window to enter edit mode (e.g., a long press operation within the first window), it enters the edit mode of the first window, where the user can select one or more objects within the first window. For example, as... Figure 4 In (b), the user selects object 5 within the first interface. Optionally, after selecting object 5, the electronic device can output a prompt to indicate that object 5 has been selected. For example, the area containing object 5 is filled with a certain color (represented by black dots in the diagram), and / or a checkmark "√" is displayed in the area containing object 5, indicating that object 5 is selected. In this case, the object 5 selected by the user is the target object.
[0096] For ease of understanding, the following explanation primarily uses the example of a user manually identifying a target object. After the target object is identified, the electronic device responds to a side touch operation, triggering the target object to move to a first position. Optionally, triggering the target object to move to the first position may include moving an identifier used to indicate the target object to the first position. Optionally, the identifier used to indicate the target object may include an object obtained by copying the target object. For example, such as... Figure 4 In step (c), when object 5 is identified as the target object, the electronic device responds to the side touch operation by copying object 5 and moving the copied object 5 to the first position. Alternatively, the identifier used to indicate the target object may not be a copy of the target object, but rather an identifier of various forms such as icons, pictures, or symbols, as long as it can visually demonstrate that the target object has been moved. Continuing with... Figure 4Taking (c) as an example, in response to a side touch operation, the electronic device generates an identifier for object 5. For instance, this identifier might be an image, an icon, a symbol (e.g., a dot), and is not a copy of object 5. The identifier is moved to the first position. It should be noted that this identifier can locate object 5; that is, after the identifier moves to the first position, if the electronic device receives an operation targeting the identifier, it can open object 5. It is understood that if object 5 is stored locally, the identifier can be mapped to the local storage address of object 5; or, if object 5 is not stored locally (e.g., object 5 is text, an image, etc. on a webpage), the identifier can be mapped to a webpage link used to open object 5 (e.g., the URL link of object 5), or object 5 can be downloaded and stored, in which case the identifier can be mapped to the local storage address of object 5. For ease of explanation, this article uses the identifier of the target object, i.e., a copy of the target object, as an example. Continuing with... Figure 4 Taking (c) as an example, it can be understood that, in order to minimize the obstruction of the interface, the size of the copied target object should not be too large. For example, the size of the copied target object can be a default size, which can be a size pre-configured by the operating system, such as 1 / 16 or 1 / 8 of the entire screen area.
[0097] It should be noted that, Figure 4 Taking the example of a user selecting one object (i.e., object 5), it's understandable that in real-world applications, a user might select multiple objects. For example, ... Figure 5 In (a), the electronic device displays the first window of the first application. For example... Figure 5 In (b), the user selects multiple objects in the first window, such as object 5, object 7, and object 8, meaning there are three target objects. Figure 5 In step (c), the electronic device responds to a side touch operation, copies objects 5, 7, and 8, and moves the three copied target objects to the first position. Considering the large number of target objects, to minimize interface obstruction, the three target objects can be stacked after being snapped to the first position. One possible approach is to stack the three target objects in a certain order. For example, the three target objects can be stacked in the order of their selection time. Taking object 5 as the earliest selected and object 8 as the last selected, the three target objects are ordered from earliest to latest as: object 5 -> object 7 -> object 8. In this case, there are two possible stacking orders from bottom to top: the first is object 5 -> object 7 -> object 8, where the earliest selected object 5 is at the bottom, object 7 is in the middle, and the last selected object 8 is at the top; the second is object 8 -> object 7 -> object 5, where the last selected object 8 is at the bottom, object 7 is in the middle, and the earliest selected object 5 is at the top.
[0098] pass Figure 4 or Figure 5 As can be seen, the electronic device responds to the side touch operation by moving the target object within the first window to the first position. For ease of description, the side touch operation will be referred to as the "first operation" below, meaning that the electronic device responds to the first operation by moving the target object within the first window to the first position. The first operation and the first position will be explained below.
[0099] The first operation operates on the side area, which has already been described previously and will not be repeated. Furthermore, the first operation is used to snap / store the target object to the first position; therefore, the first operation can also be called: object snapping / storage operation. Optionally, the first operation can satisfy at least one of the following:
[0100] (1) The first operation is the operation of the first button in the side area. Optionally, the first button can be a physical button or a virtual button, without limitation. For example, the first button can be the power button, volume up button, volume down button, camera control button, etc. in the side area; or, the first button can also be a button specifically used for storing / attaching objects, that is, in addition to the power button, volume up button, volume down button, etc., an extra button is added to the side area, which is specifically used for storing / attaching objects.
[0101] (2) The first operation is an operation performed on a first area within the side area. The first area can be a touchable area (different from a button) on the side area, which supports touch functionality; optionally, other areas on the side area besides the first area can be non-touchable areas, i.e., do not support touch functionality. Therefore, the first operation can be an operation performed on the first area. The location of the first area is not limited in this embodiment.
[0102] Understandably, to prevent accidental touches, after detecting the first operation, the electronic device can also determine whether the first operation is a first preset operation. If so, the target object is moved to the first position; otherwise, the target object is not moved. Optionally, the first preset operation can be a system default operation or a user-specified operation, without limitation. Taking the first operation as an operation on the first button, and the first button is the power button, volume up button, volume down button, or camera control button, the first preset operation can be a double-touch operation on the first button (hereinafter referred to as a two-touch operation). It should be noted that a double-touch operation on the first button can be understood as simply touching the first button without pressing it. For example, as... Figure 5 In (c), if the electronic device detects the first operation and determines that the first operation is a two-touch operation, it will move the target object to the first position; otherwise, it will not move the target object.
[0103] The first position is the endpoint position of the target object. Optionally, a cached area may or may not exist at the first position; there is no limitation. For information on cached areas, please refer to the previous text. Figure 1 In some embodiments, the first position is a fixed position. Optionally, the fixed position can be a system default position or a user-specified position, without limitation. In this case, regardless of where the first operation is applied in the side area, the target object will be attracted to the fixed position. For example, the fixed position can be the upper right position of the display screen. In other embodiments, the first position is a non-fixed position. For example, the first position is determined by the first operation and is a position on the display screen close to the first operation. Assuming the first operation is applied to position 1 in the side area, the first position is close to position 1; assuming the first operation is applied to position 2 in the side area, the first position is close to position 2. In this way, the target object can be attracted to a position close to the finger, making it convenient for the user to operate.
[0104] The above embodiments illustrate the process of the target object being snapped to the first position. Optionally, after the target object is snapped to the first position, it can remain displayed in the first position, or it can be hidden.
[0105] Let's take the example of the target object being snapped to the first position and remaining displayed in the first position. For example, Figure 5 In (c) of the diagram, after the electronic device detects the end / release of a double-touch operation (i.e., the user releases their finger from the side area), the target object remains displayed in the first position. In this case, when the electronic device switches interfaces (e.g., returns to the desktop), the target object is always displayed on top.
[0106] Taking the hiding of a target object after it has been attracted to the first position as an example, the hiding method can optionally include automatic hiding and manual hiding. For example, with automatic hiding, the electronic device automatically hides the target object if it detects that the target object has been displayed in the first position for a preset duration. With manual hiding, the electronic device hides the target object in response to a hiding operation. For example, if the first operation is a double-touch operation in the side area, the electronic device hides the target object in response to the end / release of the double-touch operation (i.e., the user releases their finger from the side). For example, as... Figure 6 In (a), the electronic device, in response to a double-touch operation in the side area, magnetically attaches the target object to a first position. For example... Figure 6 In (b) of the diagram, the electronic device hides the target object in response to the end / release of the double-touch operation. Optionally, the target object can be completely hidden or partially hidden. For example, to partially hide it... Figure 6In (b) of the diagram, a marker is displayed in the first position to indicate that an object has been hidden, preventing the user from forgetting it. The marker can take various forms and is not limited to any one of these forms. After the target object is hidden, the user can still recall it. For example, the electronic device recalls the target object in response to a recall operation. For example, as... Figure 6 In (c), the electronic device responds to a user's continuous touch operation in the side area, activating the target object. For example... Figure 6 In (d), the electronic device responds to the end of the continuous contact operation (i.e., the user releases their finger from the side), and the target object is hidden again.
[0107] pass Figure 6 It is understood that when a user's finger touches the side area, the target object is brought up; when the user's finger leaves the side area, the target object is hidden. Considering that the user may want the target object to remain displayed (referred to herein as target object locking / pinning), in some embodiments, the electronic device locks the target object in response to a target object locking operation, meaning the target object remains displayed in the first position and is not hidden. For example, as... Figure 7 In (a), the user touches the side area with their finger to bring up the target object. For example... Figure 7 In (b), the electronic device responds to the user's finger sliding backward to lock the target object, meaning the target object will always be displayed in the first position. For example... Figure 7 In (c), because the target object is locked, it remains visible and not hidden even after the user's finger leaves the side area. It is understandable that once a target object is locked, its locked state can be unlocked. For example, the electronic device unlocks the target object in response to an unlocking operation. For example, as... Figure 7 In (d), the electronic device unlocks the target object in response to the user's finger touching the side area and sliding it forward. For example... Figure 7 In (e), the target object is hidden after the user's finger leaves the side area because the target object is unlocked.
[0108] As mentioned above, a target object may include one or more objects. If there are multiple target objects, they are displayed stacked. Considering that when multiple target objects are displayed stacked, users may want to view the obscured target objects, this application provides two methods: Method 1, unfolding the stacked target objects for display; Method 2, switching the display of the stacked target objects.
[0109] Method 1: Expanding multiple stacked target objects for display. For example, in response to an operation to expand a target object, the electronic device expands multiple stacked target objects for display. For example, as... Figure 8A(a) When a user touches the side area with their finger to bring up the target object, multiple target objects are displayed stacked. For example... Figure 8A (b) The electronic device expands and displays multiple stacked target objects in response to a user's finger swiping down. Optionally, after the expansion of multiple target objects is triggered by swiping down, the multiple target objects may not be hidden when the user's finger leaves the side area; that is, they enter a locked state by default after being expanded. Alternatively, after the expansion of multiple target objects is triggered by swiping down, the target objects are hidden again when the user's finger leaves the side area. Optionally, if the user's finger swipes down and then slides to the back, the target objects expand and are displayed in response to the swiping down, and enter a locked state in response to the sliding to the back. Afterward, the target objects are not hidden when the user's finger leaves the side area. In the embodiments of this application, after the multiple target objects are expanded and displayed, the stacked display can also be restored. For example, the electronic device displays the expanded multiple target objects stacked in response to the stacking operation of multiple target objects. For example, as... Figure 8A (c) The electronic device responds to the user's finger swiping up and displays multiple target objects stacked together.
[0110] Method 2: Switching display of multiple stacked target objects. For example, in response to a target object switching operation, the electronic device switches the display of the target object stacked on top. For example, as... Figure 8B (a) The user touches the side area with their finger to bring up the target object, at which point object 8 is on top. For example... Figure 8B (b) In response to the user's finger swiping down, the electronic device switches the topmost object 8 to object 5, which was originally located in the lower layer and was an obscured object. For example, as Figure 8B (c) In response to the user's finger continuing to slide down, the electronic device switches the topmost object 5 to object 7, which was originally located in the lower layer and was obscured. As mentioned earlier, multiple target objects are displayed in a stacked order, so each time a target object is switched, the target object that was originally at the bottom layer can be moved to the top layer. Optionally, Figure 8B In (c), if the user continues to swipe down or up, the topmost target object can be switched again. Optionally, after the target object is switched by swiping down, the target object may not be hidden when the user's finger leaves the side area; that is, it enters a locked state by default after the switch. Alternatively, after the target object is switched by swiping down, the target object is hidden again when the user's finger leaves the side area. Optionally, if the user swipes down and then slides backward, the topmost target object switches in response to the swipe down, and the target object enters a locked state in response to the slide backward. Afterward, the target object is not hidden when the user's finger leaves the side area.
[0111] The above embodiments illustrate the process of the target object being snapped to the first position. The following describes the process of using the target object. Using the target object may include: opening the target object and / or sharing the target object. Taking opening the target object as an example, for instance, the electronic device opens the target object in response to an operation to open the target object. Optionally, opening the target object may include: displaying the target object in full screen or entering split-screen mode, displaying the target object in a certain area of the split-screen mode. Taking the target object as an example, opening the target object means displaying the image, text, or video in full screen. Taking the target object as an example, opening the target object may include: opening the document content. Taking sharing the target object as an example, it includes, but is not limited to, the following two sharing methods.
[0112] In the first sharing method, the electronic device responds to the sharing request from the target object by displaying a quick sharing interface, which is used to share the target object. For example, ... Figure 9A (a) The electronic device responds to the user's finger touching the side area and sliding upwards, displaying as shown in the image. Figure 9A (b) A quick share interface, which includes the target object, an identifier for the share object, and / or an identifier for the share method. Share methods include various sharing methods such as Huawei Share, Inter-Transfer, and Face-to-Face Quick Transfer. Share objects include at least one of the following: sharing applications, sharing contacts, and sharing devices. Taking sharing applications as an example, such as... Figure 9A (b) The sharing application includes application A and application B. Optionally, the sharing application may be the default application, or a specified application, or an application that is frequently used on the electronic device, or an application that fits the current scenario. The current scenario may include the current time and / or the current geographical location. For example, the sharing application is an application that has been used in the past at the current time and / or the current geographical location.
[0113] Figure 9A In (b), taking the stacked display of multiple target objects in the quick sharing interface as an example, multiple target objects can be shared together. For instance, when the electronic device detects a user clicking the icon of application A, it switches to the interface of application A. Taking application A as an instant messaging application as an example, the user can select contacts within the interface of application A and then send multiple target objects to the selected contacts. It is understandable that in practical applications, users may want to select one or more target objects from multiple target objects for sharing; therefore, in some embodiments, Figure 9A In (b), when the electronic device detects an operation to deploy multiple target objects, it displays as shown below. Figure 9A (c) is an interface that displays multiple target objects for the user to select. If the user selects object 5, then only object 5 will be shared.
[0114] The second sharing method involves the electronic device responding to the opening of a second window of a second application by displaying that second window, within which the target object is shared. For example, ... Figure 9B (a) The electronic device displays a first window of a first application, and the target objects are stacked and displayed in a first position. For example... Figure 9B (b) The electronic device switches to the second window of the second application. For example... Figure 9B (c) The electronic device detects that the user's finger touches the side area and swipes down, expanding multiple target objects. The user can then extract the target objects into a second window. For example, such as... Figure 9B (d) In response to a drag operation on object 8, the electronic device moves object 8 as the drag operation proceeds, for example, moving (or filling) it into the second window. It should be noted that... Figure 9B In this method, the user drags one target object from among multiple target objects into the second window. Users can select and drag target objects to the second window according to their needs. Optionally, a one-click operation can move (or fill) all target objects at the first location into the second window. For example, the one-click operation could be a long press on the first location or other operations, etc., without limitation. Therefore, this method transfers objects from the first application to the second application, i.e., cross-application information transfer. Optionally, the second application and the first application can be the same application or different applications, without limitation.
[0115] The above embodiments illustrate the process of a target object within the first window snapping to a position near the edge (i.e., the first position). In other embodiments, the first window itself may also snap to a position near the edge. For example, as... Figure 10A (a) The electronic device displays the first window of the first application. For example... Figure 10A (b) In response to a second operation (an operation acting on the side area), the electronic device moves the first window to the second position. Optionally, moving the first window to the second position may include: the first window exiting full-screen mode and switching to a floating window, with the floating window moving to the second position. Optionally, after the first window of the first application switches to a floating window, the second window of the second application is displayed in the foreground, such as... Figure 10A (b) Optionally, the second application may be the same as or a different application from the first application, without limitation. For example, the second window may be the desktop or a window that was opened before the first window.
[0116] For ease of understanding, the following text will continue to use... Figure 10A Using this as an example, several application scenarios are provided below.
[0117] Application Scenario 1: The primary application is a video playback application. For example, such as... Figure 10B(a) The electronic device displays a first window of a video playback application, which includes the video currently being played. For example... Figure 10B (b) In response to the second operation (an operation acting on the side area), the electronic device switches the first window to a floating window. For example... Figure 10B (c) The floating window gradually shrinks and moves to the second position. Therefore, during this process, the user triggers the video playback application's full-screen window to switch to a floating window through side touch operation, and the floating window snaps to the second position.
[0118] Application Scenario Two: The first application is instant messaging applications. For example, such as... Figure 10C (a) The electronic device displays the first window of an instant messaging application, which is a chat window with a contact. For example... Figure 10C (b) In response to the second operation (an operation acting on the side area), the electronic device switches the first window to a floating window. For example... Figure 10C (c) The floating window gradually shrinks and moves to the second position. Therefore, during this process, the user triggers the instant messaging application's full-screen window to switch to a floating window through a side touch operation, and the floating window snaps to the second position.
[0119] The following section provides a detailed explanation of the implementation principle of the above-mentioned window adsorption process.
[0120] For example, such as Figure 11 In (a), the electronic device displays the first window of the first application. The first application can be any application on the electronic device, including system applications and third-party applications, without limitation. For example, the first application could be the video playback application in application scenario one above, or the instant messaging application in application scenario two. Figure 11 In (b), the electronic device, in response to the second operation (an operation acting on the side area), switches the first window to a floating window, such as... Figure 11 In step (c), the floating window gradually shrinks and moves to the second position. The second operation and the second position are explained below.
[0121] The second operation applies to the side area, which has already been described previously and will not be repeated. Furthermore, this second operation is used to snap / fold the foreground window to a second position; therefore, it can also be called a window snapping / folding operation. Optionally, the second operation can satisfy at least one of the following:
[0122] (1) The second operation is an operation on the second button in the side area. Optionally, the second button can be a physical button or a virtual button, without limitation. For example, the second button can be the power button, volume up button, volume down button, camera control button, etc. in the side area; or, the second button can also be a button specifically used to store / attach the foreground window, that is, in addition to the power button, volume up button, volume down button, etc., an extra button is added to the side area, which is specifically used to store / attach the foreground object. Optionally, the second button and the first button mentioned above can be the same button or different buttons.
[0123] (2) The second operation is an operation performed within a second area on the side area. The second area can be a touchable area on the side area (different from a button), which supports touch functionality; optionally, other areas on the side area besides the second area can be non-touchable areas, i.e., do not support touch functionality. Therefore, the second operation can be an operation performed within the second area. The location of the second area is not limited in this embodiment. Optionally, the second area and the first area mentioned above can be the same area or different areas.
[0124] Understandably, to prevent accidental touches, after detecting a second operation, the electronic device can determine whether the second operation is a second preset operation. If so, the foreground window is switched to a floating window and moved to the second position; otherwise, the foreground window is not switched to a floating window. Optionally, the second preset operation can be a system default operation or a user-specified operation, without limitation. Taking the second operation as an operation on a second button, and the second button being the power button, volume up button, volume down button, or camera control button, the second preset operation can be a three-touch operation on the second button (hereinafter referred to as a three-touch operation). For example, as shown... Figure 11 In (b), if the electronic device detects the second operation and determines that the second operation is a three-touch operation, it will switch the foreground window (i.e. the first window of the first application) to a floating window and move the floating window to the second position; otherwise, it will not switch the foreground window to a floating window.
[0125] As can be seen from the above embodiments, the second operation is a snap-in operation targeting the window itself, while the first operation is a snap-in operation targeting a target object within the window. Optionally, the second operation and the first operation can be the same operation or different operations. For example, if the second operation is a two-touch operation in the side area, the first operation is a three-touch operation in the side area. If the second operation is the same, both the first and second operations are two-touch operations. In this case, when the electronic device detects a two-touch operation in the side area, it needs to determine whether the two-touch operation is a snap-in operation targeting an object within the first window or a snap-in operation targeting the first window itself. If it is a snap-in operation targeting an object within the first window, the object within the first window is moved to a first position. If it is a snap-in operation targeting the first window itself, the first window is switched to a floating window, and the floating window is moved to the first position. In this process, the electronic device determines whether the double-touch operation is a snap-on operation targeting an object within the first window or a snap-on operation targeting the first window itself. One possible approach is to determine that if the user has already selected a target object within the first window, the double-touch operation is a snap-on operation targeting an object within the first window; if the user has not selected any object within the first window, the double-touch operation is a snap-on operation targeting the first window itself.
[0126] The second position is the endpoint of the floating window. Optionally, a cached area may or may not exist at the second position; there is no limitation. For information on cached areas, please refer to the previous text. Figure 1 In some embodiments, the second position is a fixed position. For example, the second position may be the same fixed position as the first position mentioned above, or a different fixed position. In other embodiments, the second position is a non-fixed position. For instance, the second position is determined by a second operation and is a position on the display screen closer to the second operation. Assuming the second operation acts on position 1 in the side area, the second position is closer to position 1; assuming the second operation acts on position 2 in the side area, the second position is closer to position 2. In this way, the floating window can be snapped to a position close to the finger, facilitating user operation.
[0127] It should be noted that, Figure 11Taking an electronic device displaying only one window in the foreground—the first window of the first application—as an example, the user can switch the first window to a floating window via side touch, and then move the floating window to the first position. It's understandable that the electronic device can also display multiple windows simultaneously (e.g., in split-screen mode). In this case, the user can trigger all foreground windows to switch to floating windows via side touch, and then move all floating windows to the first position, for example, stacking multiple floating windows in the first position. This method can clear the foreground windows. Alternatively, the electronic device can also identify a target window among multiple windows, responding to a side touch by switching the target window to a floating window and moving it to the first position. The electronic device can automatically or manually identify the target window among multiple windows. Automatic identification, for example, might use the focused window or the topmost window among the multiple windows as the target window. Manual identification, for example, allows the user to select a target window from among the multiple windows. It's understandable that there could be one or more target windows; if there are multiple, all target windows will switch to floating windows and move them to the first position, for example, stacking them in the first position. Understandably, after the floating window is moved to the first position, it can be hidden, shown, locked, or unlocked. This part is the same as the implementation principle mentioned earlier and will not be repeated. Furthermore, when multiple floating windows are stacked, users can switch or expand them using side touch operations. This part is related to the following... Figure 16A and Figure 16B The principle is the same.
[0128] It should be noted that, Figure 11 The example given is an electronic device snapping a foreground window to a side position (i.e., the second position). In other embodiments, the electronic device can also snap a background window to a side position. For example, as... Figure 12 In (a) of the diagram, the electronic device displays a multitasking interface, which includes one or more background windows. The electronic device can determine a target window, which is at least one window in the multitasking interface. The target window can be determined automatically or manually.
[0129] Taking automatic determination as an example, the electronic device determines the target window in a multitasking interface based on the priority relationship of different applications. For example, if the priority relationship is application A > application B > application C, then in a multitasking interface including windows of application A, application B, and application C, application A's window is determined as the target window because it has the highest priority. Optionally, the priority relationship can be pre-configured in the electronic device; for example, the priority relationship is pre-configured when the electronic device leaves the factory.
[0130] Taking manual selection as an example, the electronic device determines the target window based on the user's window selection operation within the multitasking interface. In one possible implementation, when the electronic device detects an operation that triggers the multitasking interface to enter edit mode (e.g., a long press operation within the multitasking interface), it enters the edit mode of the multitasking interface, where the user can select one or more windows within the multitasking interface. For example, as... Figure 12 In (b) of the diagram, the user selects the window of application A. Optionally, after selecting the window of application A, the electronic device can output a prompt to indicate that the window has been selected. For example, the area containing the window is filled with a certain color (represented by black dots in the diagram), and / or, a checkmark "√" is displayed in the area containing the window to indicate that the window is selected. In this case, the window of application A selected by the user is the target window.
[0131] For ease of understanding, the following explanation primarily uses the example of a user manually defining a target window. After the target window is defined, the electronic device responds to a third operation, triggering the target window to snap to a third position. Optionally, triggering the target window to snap to the third position may include: generating a floating window of the target window and moving the floating window to the third position. For example, as... Figure 12 In step (c), when the window of application A is determined to be the target window, the electronic device responds to the third operation by generating a floating window for application A and moving the floating window to the third position. It is understood that the size of the floating window should not be too large in order to minimize interface obstruction. For example, the size of the floating window can be a default size, which can be a size pre-configured by the operating system, such as 1 / 16, 1 / 8, etc., of the entire display area.
[0132] It should be noted that, Figure 12 Taking the example of a user selecting one window (i.e., the window of application A), it's understandable that in real-world applications, a user might select multiple windows. For example, ... Figure 13 In (a), the electronic device displays a multitasking interface, which includes background windows. For example... Figure 13 In (b), the user selects multiple windows within the multitasking interface, such as the window of application A, the window of application B, and the window of application C; that is, there are three target windows. Figure 13 In step (c), the electronic device responds to the third operation by generating floating windows for application A, application B, and application C, and moves these three floating windows to the third position. Considering the large number of target windows, to minimize interface obstruction, the three floating windows can be stacked after being snapped to the third position. One possible approach is to stack the three floating windows in a specific order, such as according to the order of selection time; this is described previously and will not be repeated here.
[0133] It should be noted that, Figure 13 In (c) of the example, when three floating windows are stacked, the user cannot determine which application's window is in the third position. One possible solution is, for example... Figure 14A Three floating windows are displayed stacked, along with identifiers for application A, application B, and application C, to indicate to the user that the three floating windows in the third position are for applications A, B, and C, respectively. For example, the identifiers could be application icons and / or package names. Continuing as... Figure 14A If application A's floating window is stacked on top, then the logo of application A is displayed differently from the logos of application B and application C (for example, the logo of application A is filled with a specific color) to indicate to the user that the currently topmost floating window is application A's floating window.
[0134] pass Figure 12 or Figure 13 As can be seen, the electronic device responds to the third operation by snapping the target window to the third position. The third operation and the third position are explained below. Optionally, the third operation can be the same as or different from the first operation mentioned earlier. It should be understood that assuming the third operation is the same as the first operation, for example, both being double-touch operations in the side area, then the user does not need to memorize too many operations, reducing the difficulty of memorization. The following explanation mainly uses a double-touch operation in the side area as an example for the third operation. The third position is the endpoint position of the floating window corresponding to the target window, which can be a fixed position or a non-fixed position. The principle is the same as that of the first position and will not be repeated.
[0135] The above embodiments illustrate the process of the target window snapping to the third position. Optionally, after the target window snaps to the third position, it can remain displayed in the third position, or it can be hidden.
[0136] Let's take the example of a target window snapping to the third position and remaining displayed in the third position. For example, Figure 14A In this scenario, after the electronic device detects the end / release of a double-touch operation, the target window remains displayed in the third position. In this case, if the electronic device switches interfaces (e.g., returns to the desktop), the target window always appears on top.
[0137] Taking the hiding of a target window after it has snapped to a third position as an example, the hiding method can optionally include automatic hiding and manual hiding. For example, with automatic hiding, the electronic device automatically hides the target window if it detects that the target window has been displayed in the third position for a preset duration. With manual hiding, the electronic device hides the target window in response to a hiding operation. For example, if the third operation is a double-touch operation in the side area, the electronic device hides the target window in response to the end / release of the double-touch operation. For example, as... Figure 14B (a) The electronic device responds to a double-touch operation in the side area, snapping the target window to a third position. For example... Figure 14B (b) In response to the end / release of the double-touch operation, the target window is hidden. Optionally, the target window can be completely hidden or partially hidden. For example, to partially hide it... Figure 14B In (b), the identifiers for applications A, B, and C are not hidden to prevent users from forgetting them. Even after the target window is hidden, the user can still bring it up. For example, the electronic device brings up the target window in response to a call-up operation. For example, as... Figure 14B (c) The electronic device, in response to a user's continuous touch operation in the side area, brings up the target window. For example... Figure 14B (d) The electronic device responds to the end of the continuous contact operation (i.e., the user releases their finger from the side) and the target window is hidden again.
[0138] pass Figure 14B It is understood that when a user's finger touches the side area, the target window is brought up, and when the user's finger leaves the side area, the target window is hidden. Considering that the user may want the target window to remain displayed (referred to herein as target window locking / pinning), in some embodiments, the electronic device locks the target window in response to a locking operation, meaning the target window remains displayed in a third position and is not hidden. For example, as... Figure 15 In (a), the user touches the side area with their finger to bring up the target window. For example... Figure 15 In (b), the electronic device locks the target window in response to the user's finger sliding backward, meaning the target window remains displayed in the third position. For example... Figure 15 In (c), because the target window is locked, it remains displayed and not hidden even when the user's finger leaves the side area. It is understandable that the target window can be unlocked after being locked. For example, the electronic device unlocks the target window in response to an unlocking operation. For example, as... Figure 15 In (d), the electronic device unlocks the target window in response to the user's finger touching the side area and sliding it forward. For example... Figure 15 In (e), the target window is hidden after the user's finger leaves the side area because the target window is unlocked.
[0139] As mentioned above, a target window may include one or more, and if there are multiple target windows, they are displayed stacked. Considering that when multiple target windows are displayed stacked, users may want to view the target windows that are obscured, this application provides two methods: Method 1, expanding the stacked target windows for display; Method 2, switching the display of the stacked target windows.
[0140] Method 1: Expanding and displaying multiple stacked target windows. For example, in response to an expand operation of a target window, the electronic device expands and displays multiple stacked target windows. For example, as... Figure 16A (a) When a user touches the side area with their finger to bring up a target window, multiple target windows are displayed stacked. For example... Figure 16A (b) In response to a user's swipe down, the electronic device expands and displays multiple stacked target windows, i.e., expands and displays the floating windows of applications A, B, and C. Optionally, after the expansion of multiple target windows is triggered by swiping down, the multiple target windows may not be hidden when the user's finger leaves the side area, i.e., they enter a locked state by default after being expanded. Alternatively, after the expansion of multiple target windows is triggered by swiping down, the target windows are hidden again when the user's finger leaves the side area. Optionally, if the user's finger swipes down and then slides backward, the target windows expand and display in response to the swipe down, and enter a locked state in response to the backward slide. Afterward, the target windows are not hidden when the user's finger leaves the side area. In the embodiments of this application, after the multiple target windows are expanded and displayed, the stacked display can also be restored. For example, the electronic device displays the expanded multiple target windows stacked in response to the stacking operation of multiple target windows. For example, as Figure 16A (c) The electronic device responds to the user's finger swiping up by stacking multiple target windows.
[0141] Method 2 involves switching between multiple stacked target windows. For example, in response to a target window switching operation, the electronic device switches the topmost stacked target window. For example, as... Figure 16B (a) When a user touches the side area with their finger to bring up the target window, the floating window of application A is on top, while the floating windows of applications B and C are covered. Furthermore, the logo of application A is displayed differently from the logos of applications B and C to indicate that the topmost window is the window of application A. Figure 16B (b) In response to the user's swipe down, the electronic device switches the topmost floating window of application A to the floating window of application B. The floating window of application B was originally obscured, and the icon for application B is displayed differently from the icons for applications A and C to indicate that the topmost window has been switched to application B. Figure 16B (c) In response to the user's finger continuing to swipe down, the electronic device switches the floating window of application B at the top to the floating window of application C. The floating window of application C was originally an obscured window, and the logo of application C is displayed differently from the logos of applications A and B to indicate that the top window has been switched to the window of application C. Optional, Figure 16BIn (c), if the user continues to swipe down or up, the topmost target window can continue to switch. Optionally, after the target window switch is triggered by swiping down, the target window may not be hidden when the user's finger leaves the side area; that is, it enters a locked state by default after switching. Alternatively, after the target window switch is triggered by swiping down, the target window may be hidden again when the user's finger leaves the side area. Optionally, if the user swipes down and then slides backward, the topmost target window switches in response to the swipe down, and the target window enters a locked state in response to the slide backward. Afterward, the target window is not hidden when the user's finger leaves the side area.
[0142] The above examples illustrate the process of the target window snapping to a third position. The following describes the process of using the target window.
[0143] In one possible implementation, the electronic device, in response to an operation on the target window, can display the target window in full screen or enter split-screen mode, displaying the target window in a first area of the split-screen mode. For example, as... Figure 17A (a) The electronic device displays the window of application D and a floating window of application A in a third position. In response to an operation on the floating window of application A, the electronic device displays the window of application A in full screen, as shown below. Figure 17A (b); or, enter split-screen mode, such as Figure 17A (c) In split-screen mode, the window of application A is displayed in the first area, and the window of application D is displayed in the second area. It should be noted that... Figure 17A Since application A's window is already displayed in full-screen mode or in split-screen mode, the floating window of application A and the logo of application A no longer need to be displayed in the third position.
[0144] In another possible implementation, the electronic device retrieves information from the target window in response to an information retrieval operation targeting that window. For example, such as Figure 17B (a) The electronic device displays a window of application D, and in a third position displays a floating window of application A, which includes objects such as images. Figure 17B (b) In response to an object extraction operation (e.g., long press and drag) within a floating window of application A, the electronic device copies the object, and the copied object moves with the drag operation, for example, moving into a window of application D. Figure 17B (c). This method enables cross-application information transfer.
[0145] The above example uses the technical solution provided in the embodiments of this application to a single-device scenario. It should be noted that the technical solution in the embodiments of this application can also be applied to multi-device scenarios, such as cross-device information transmission between multiple devices. The following describes this scenario.
[0146] Therefore, the technical solutions provided in the embodiments of this application can be applied to communication systems. For example, such as Figure 18 This is a schematic diagram of a communication system provided in an embodiment of this application. Figure 18 The communication system includes a first device and a second device. Figure 18 Taking a mobile phone as the first device and a tablet computer as the second device as an example, it can be understood that the first device can also be any device other than a mobile phone, and the second device can also be any device other than a tablet computer. The first device and the second device can be the same type of device or different types of devices. In short, the embodiments of this application do not limit the device types of the first device and the second device. For ease of understanding, the following will continue to use... Figure 18 The following explanation will be based on a communication system.
[0147] For example, such as Figure 19 In (a) of the above, the electronic device, in response to a side touch operation (e.g., the first, second, or third operation described above), snaps a target object on the display screen of the first device to a side position (e.g., the first, second, or third position described above). The target object can be a target object within a window as described above, the foreground window itself, or a target window within a multitasking interface. In response to the target object snapping to the side position, the first device sends information about the target object to the second device, causing the second device to display the target object, such as... Figure 19 (b) The display position of the target object on the second device is not limited; for example, it can be located near the side area. Optionally, the size of the target object on the second device can be the same as or different from the size of the target object on the first device, without limitation.
[0148] The target object on the second device can be displayed continuously or hidden, based on the same principle as described above. Furthermore, when there are many target objects, the user can expand / switch between them on the second device, again based on the same principle, which will not be repeated here. In addition, the second device can also use the target object, such as opening or sharing it. Taking opening a target object as an example, if the second device detects an open operation for the target object, it will open it. Optionally, opening a target object can include: displaying the target object in full screen or entering split-screen mode, displaying the target object in a specific area within the split-screen mode. For example, if the target object is an image, text, or video, opening the target object means displaying the image, text, or video in full screen. If the target object is a document, opening the target object can include: opening the document content. Taking sharing a target object as an example, there are two sharing methods, based on the same principle as the two sharing methods described above, which will not be repeated here.
[0149] Please see Figure 20This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device can be a mobile terminal listed above, such as a mobile phone or a tablet computer. Figure 20 As shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0150] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, memory, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the nerve center and command center of the electronic device. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has just used or is recurring. If processor 110 needs to reuse an instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 110, and thus improves system efficiency.
[0151] In some embodiments, the processor 110 may execute the object control method provided in the embodiments of this application.
[0152] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0153] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0154] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.
[0155] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0156] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.
[0157] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.
[0158] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0159] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0160] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0161] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in conjunction with a tuning switch.
[0162] The mobile communication module 150 can provide solutions for wireless communication applications including 2G / 3G / 4G / 5G in electronic devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0163] The wireless communication module 160 can provide solutions for wireless communication applications in electronic devices, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0164] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the electronic device to communicate with networks and other devices via wireless communication technology.
[0165] The display screen 194 is used to display the application's interface, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include one or N display screens 194, where N is a positive integer greater than 1.
[0166] The electronic device 100 can perform shooting functions through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor. The ISP is used to process the data fed back by the camera 193.
[0167] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code for at least one application program. The data storage area may store data generated during the use of the electronic device (e.g., images, videos, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, general-purpose flash memory, etc.
[0168] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.
[0169] Electronic devices can implement audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, headphone jacks 170D, and application processors.
[0170] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.
[0171] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls and other external playback scenarios through one or more speakers 170A.
[0172] The receiver 170B, also known as a "handpiece," can be one or more, and is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.
[0173] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.
[0174] The 170D headphone jack is used to connect wired headphones.
[0175] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.
[0176] The gyroscope sensor 180B can be used to determine the motion attitude of an electronic device. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization.
[0177] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.
[0178] The magnetic sensor 180D includes a Hall effect sensor. Electronic devices can use the magnetic sensor 180D to detect the opening and closing of a flip cover.
[0179] The 180E accelerometer can detect the magnitude of acceleration in various directions (typically three axes) of electronic devices. When the electronic device is stationary, it can detect the magnitude and direction of gravity.
[0180] The 180F distance sensor is used to measure distance. Electronic devices can measure distance using infrared or laser.
[0181] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device emits infrared light outward through the LED. The electronic device uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near the electronic device. When insufficient reflected light is detected, the electronic device can determine that no object is near the electronic device.
[0182] An ambient light sensor 180L is used to detect ambient light levels. Electronic devices can adaptively adjust the brightness of the display screen 194 based on the detected ambient light levels.
[0183] The fingerprint sensor 180H is used to collect fingerprints.
[0184] The 180J temperature sensor is used to detect temperature.
[0185] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K is used to detect touch operations applied to or near it. The touch sensor can then transmit the detected touch operation to the application processor to determine the type of touch event.
[0186] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords.
[0187] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. The electronic device can receive button inputs and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device.
[0188] Understandable Figure 20 The components shown do not constitute a specific limitation on the electronic device. The electronic device in the embodiments of the present invention may include, but is not limited to, components that are more advanced than those shown. Figure 20 More or fewer parts. Furthermore, Figure 20 The combination / connection relationships between the components can also be adjusted and modified.
[0189] Figure 21 This is a schematic diagram of the structure of the electronic device 2100 provided in an embodiment of this application. The electronic device 2100 can be a mobile terminal (e.g., a mobile phone or a tablet computer) as listed above. Figure 21 As shown, electronic device 2100 may include: one or more processors 2101; one or more memories 2102; a communication interface 2103; and one or more computer programs 2104. These devices can be connected via one or more communication buses 2105. The one or more computer programs 2104 are stored in the memory 2102 and configured to be executed by the one or more processors 2101. The one or more computer programs 2104 include instructions. For example, when electronic device 2200 is an electronic device as described above (e.g., a mobile phone), the instructions can be used to perform relevant steps of the electronic device (e.g., a mobile phone) as described in the corresponding embodiments above, such as executing... Figures 1 to 19 The relevant steps for electronic devices (e.g., mobile phones). Communication interface 2103 is used to enable communication between electronic device 2100 and other devices, such as a transceiver.
[0190] In the embodiments provided above, the methods provided by the embodiments of this application are described from the perspective of an electronic device (e.g., a mobile phone) as the executing entity. To implement the functions of the methods provided in the embodiments of this application, the electronic device may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is implemented in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.
[0191] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (SSD)). Where there is no conflict, the solutions in the above embodiments can be combined.
[0192] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0193] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0194] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0195] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0196] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope and intent of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and variations.
Claims
1. An object control method, characterized in that, Applied to electronic devices, the method includes: Display N objects, wherein the N objects are N windows, or the N objects are located in the same window, wherein when the N objects are located in the same window, the N objects include at least one of images, text, videos or documents, and N is a positive integer; In response to a first operation, a target object among the N objects is moved to a first position, wherein the first operation is an operation performed on the side area of the electronic device, the first position is a position on the display screen of the electronic device close to the first operation, and the target object is at least one of the N objects.
2. The method according to claim 1, characterized in that, The N objects are located within the same window, and the step of moving the target object among the N objects to a first position in response to the first operation includes: In response to the first operation, the target object among the N objects is copied, and the copied object is moved to the first position.
3. The method according to claim 1, characterized in that, The N objects are located within the same window, and the step of moving the target object among the N objects to a first position in response to the first operation includes: In response to the first operation, the identifier indicating the target object is moved to the first position, while the target object remains in its original position.
4. The method according to any one of claims 1-3, characterized in that, The method further includes: In response to the second operation, M identifiers are displayed, each of which indicates a sharing method or a sharing object. The second operation is an operation performed on the side area, where M is a positive integer. In response to the selection operation for the first identifier among the M identifiers, the target object is shared using the sharing method corresponding to the first identifier, or the target object is shared with the sharing object corresponding to the first identifier.
5. The method according to any one of claims 1-3, characterized in that, The method further includes: The N objects are located within the first window. Display a second window; In response to a drag operation on the target object at the first position, the target object is moved into the second window.
6. The method according to claim 1, characterized in that, The N objects represent N windows. The step of responding to the first operation by moving the target object among the N objects to a first position includes: In response to the first operation, a floating window corresponding to the target window is obtained based on the target window in the N windows, and the floating window is moved to the first position.
7. The method according to claim 6, characterized in that, The method further includes: In response to an operation on the floating window, the floating window is switched to a full-screen window, or, in split-screen mode, the floating window is switched to a window within the first area of the split-screen mode.
8. The method according to any one of claims 1-7, characterized in that, The target object is the object selected by the user.
9. The method according to any one of claims 1-8, characterized in that, After the target object moves to the first position, the method further includes: Hide the target object.
10. The method according to claim 9, characterized in that, The hidden target object includes: If the display duration of the target object at the first position reaches a preset duration, the target object is hidden; or... In response to a hiding operation on the target object, the target object is hidden, and the hiding operation is applied to the side area.
11. The method according to claim 9 or 10, characterized in that, After hiding the target object, the method further includes: Display a first marker, which indicates that a target object is hidden.
12. The method according to any one of claims 9-11, characterized in that, After hiding the target object, the method further includes: In response to a call-up operation of the target object, the target object is displayed, and the call-up operation is performed on the side area.
13. The method according to any one of claims 1-12, characterized in that, The method further includes: In response to the locking operation of the target object, the target object enters a locked state. In the locked state, the target object is continuously displayed on the top layer of the display screen, and the locking operation is applied to the side area.
14. The method according to claim 13, characterized in that, The method further includes: In response to the unlocking operation of the target object, the target object exits the locked state, and the unlocking operation is applied to the side area.
15. The method according to any one of claims 1-14, characterized in that, The target object includes multiple objects, and after the target object is moved to the first position, the multiple objects are stacked and displayed.
16. The method according to claim 15, characterized in that, The method further includes: In response to an expand operation on the target object, the stacked objects are expanded and displayed, the expand operation acting on the side area; or... In response to a target object switching operation, the topmost object in the stacked array of objects is switched to a lower-level object, and the switching operation is applied to the side area.
17. The method according to any one of claims 1-16, characterized in that, The method further includes: In response to moving the target object to a first position, the electronic device sends information about the target object to another electronic device so that the other electronic device displays the target object.
18. The method according to any one of claims 1-17, characterized in that, The side area is the side frame of the electronic device; or, The side area is the side screen formed when the foldable screen of the electronic device is in the folded state.
19. The method according to any one of claims 1-18, characterized in that, The side area includes a first button, and the first operation is an operation on the first button.
20. The method according to any one of claims 1-19, characterized in that, The first operation is two consecutive light touches at the same location within the side area.
21. An electronic device, characterized in that, include: Processor, memory, and one or more programs; The one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the steps of the method as described in any one of claims 1-20.
22. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 20.
23. A computer program product, characterized in that, Includes a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 20.