Material processing method and related equipment thereof

Abstract

The invention provides a material processing method and related equipment thereof, and relates to the technical field of terminals. The method comprises the steps of displaying a first interface of a first application in a full-screen mode, wherein the first interface comprises a first initial material; in response to the first target operation, the display screen is in a partition display state, the partition display state means that the display screen is divided into an original application display area, a material display area and an operation area for display, the original application display area comprises a first interface, the operation area comprises a first option, and the material display area comprises a first material icon; in response to a first operation for the first option, the first initial material is collected into the target application, a second material icon is newly added in the material display area, and the second material icon corresponds to the first initial material. Through the display area and the operation area which are combined into one, collection scenes and types are expanded, the collection efficiency and the user experience are improved, and the materials can be previewed after collection.

Description

[0001] This application claims priority to Chinese patent application filed on November 3, 2023, with application number 202311466466.6 and entitled "Method for Material Processing", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a material processing method and related equipment. Background Technology

[0003] With the continuous development of terminal technology, electronic devices can support the collection of different types of materials in different ways. For example, taking mobile phones as an example, users can copy and save text, capture images, record audio and video, and also use a three-finger swipe to bookmark web pages obtained from some applications (such as news applications).

[0004] In practice, material collection involves not only diverse collection methods and material types, but also multiple applications. Currently, the available material collection methods are inconsistent and varied, with each method corresponding to different material types, making them difficult for users to remember and impacting the user experience. Therefore, improving the convenience of material collection is a pressing issue that needs to be addressed. Summary of the Invention

[0005] This application provides a method for processing materials and related equipment. By unifying the collection method and combining the interface display area and operation area, it expands the collection scenarios and types, and improves collection efficiency and user experience.

[0006] In a first aspect, this application provides a material processing method. Applied to an electronic device including a display screen, the method includes: displaying a first interface of a first application in full screen, the first interface including first initial material; in response to a first target operation, the display screen is in a partitioned display state, the partitioned display state meaning the display screen is divided into an original application display area, a material display area, and an operation area, the original application display area including the first interface, the operation area including a first option, and the material display area including a first material icon, the first material icon indicating material that has been collected into the target application; in response to a first operation on the first option, the first initial material is collected into the target application, and a second material icon is added to the material display area, the second material icon corresponding to the first initial material; after exiting the partitioned display state, a second application is displayed in full screen. The second interface includes a second initial material, the type of which is different from that of the first initial material. In response to a second target operation, the display screen is in a partitioned display state, wherein the original application display area includes the second interface, the material display area includes a first material icon and a second material icon, the first option in the operation area is switched to the second option, and the first option is different from the second option. In response to a second operation on the second option, the second initial material is collected into the target application, and a third material icon is added to the material display area, the third material icon corresponding to the second initial material. In response to a third operation on any material icon, the display is switched from the partitioned display state to a material preview interface, the material preview interface corresponding to the material indicated by the material icon.

[0007] When the first interface of the first application is displayed in full screen, the first interface may not include a status bar. When the second interface of the second application is displayed in full screen, the second interface may also not include a status bar.

[0008] The target application is the global collection application in this application embodiment, and the first target operation is the same as the second target operation.

[0009] The first, second, and third operations can be clickable. The first option corresponds to the type of the first initial material, and the second option corresponds to the type of the second initial material.

[0010] The partition display status can indicate Figure 6 The interface shown in (b) is Figure 11 The interface shown in (b) is Figure 9 The interface shown in (b) is Figure 13 The interface shown in (b) is Figure 22 The interfaces shown in (c) and (d) are Figure 23 The interface shown in (b) above, etc.

[0011] It should be understood that for the first screen excluding the status bar, after the display enters the partitioned display state, the content of the first screen remains unchanged, only the display area is reduced, changing from full screen to a smaller area of ​​the original application display. Optionally, for the first screen including the status bar, after the display enters the partitioned display state, the original application display area can be used to display the content of the first screen excluding the status bar.

[0012] Similarly, for a second interface that does not include a status bar, after the display enters the partitioned display state, the content of the second interface remains unchanged, and only the display area is reduced, changing from full screen to a smaller area of ​​the original application display. Optionally, for a second interface that includes a status bar, after the display enters the partitioned display state, the original application display area can be used to display the content of the second interface other than the status bar.

[0013] The process of collecting the first and second initial materials can indicate... Figure 8 , Figure 24 The process of saving web pages shown Figure 12 The document collection process shown Figure 14 Any two of the following image collection processes are shown.

[0014] In this embodiment, a unified target operation can trigger the display screen to display in a partitioned state, indicating entry into the global collection mode. This operation is simple and efficient, allowing for the collection of materials from different sources and of different types. Furthermore, upon entering the partitioned display state, the system can accurately determine the user's desired content retention method and provide corresponding operation options to support material retention. In the partitioned display state, the original application display area before entering the global collection mode, the new operation area, and the material display area are combined into one display, facilitating user viewing and operation and expanding operational functionality. Additionally, all materials are collected into the global collection application.

[0015] The material preview process can indicate Figure 29 The preview process shown.

[0016] In this embodiment of the application, for the collected materials, a preview can also be directly triggered by the material icon shown in the material display area in the partitioned display state.

[0017] In conjunction with the first aspect, in one possible implementation, after exiting the partitioned display state, displaying the second interface of the second application in full screen includes: in response to a fourth operation, the display screen exits the partitioned display state and displays a third interface in full screen, the third interface including at least an application icon indicating the second application; in response to a fifth operation on the application icon indicating the second application, displaying the second interface of the second application in full screen.

[0018] The fourth operation can be an interface switching operation, such as a swipe operation; the fifth operation can be a click operation.

[0019] The third interface can be the desktop.

[0020] The switching process can indicate Figure 26 The switching process is shown.

[0021] In this embodiment of the application, when the electronic device enters the global collection mode and is in a partitioned display state, the fourth operation can be used to exit the partitioned display state and switch from the partitioned display state to the second application to continue collecting other materials.

[0022] In conjunction with the first aspect, in one possible implementation, the operation area further includes a close button. When exiting the partitioned display state, a second interface of the second application is displayed in full screen, including: in response to a sixth operation on the close button, the display screen exits the partitioned display state and displays the first interface of the first application in full screen; in response to a seventh operation, the display switches from the first interface to a third interface, the third interface including at least an application icon indicating the second application; and in response to an eighth operation on the application icon indicating the second application, the second interface of the second application is displayed in full screen.

[0023] The sixth and eighth operations are click operations, while the seventh operation can be an interface switching operation, such as a swipe operation.

[0024] The third interface can be the desktop.

[0025] The switching process can indicate Figure 27 The switching process is shown.

[0026] In this embodiment of the application, when the electronic device enters the global collection mode and is in a partitioned display state, the user can exit the partitioned display state by operating the close button, switch back to the display interface before entering the partitioned display state, and then switch the interface to the second application to continue collecting other materials.

[0027] Optionally, in this embodiment, without exiting the partition display state, the interface in the original application display area can be switched directly in the partition display state to switch to the second interface of the second application to continue collecting other materials.

[0028] In conjunction with the first aspect, in one possible implementation, the method further includes: prior to responding to the second target operation, the method further includes: a first stage in response to a ninth operation on a sub-material included in the first initial material, wherein the sub-material is suspended on the first initial material, the type of the first initial material and the type of the sub-material are different; a second stage in response to the ninth operation on the sub-material, wherein the sub-material is collected into the target application, the first stage and the second stage being consecutive; and a fourth material icon is added to the material display area, the fourth material icon corresponding to the sub-material.

[0029] Optionally, the type of the first initial material is a webpage, and the type of the sub-materials is an image, etc.

[0030] Optionally, the first stage of the ninth operation is a long press operation, and the second stage of the ninth operation is a drag or throw operation.

[0031] The process of collecting sub-materials can indicate Figure 25 The image collection process is shown.

[0032] In this embodiment of the application, when the electronic device enters the global collection mode and is displayed in a partitioned state, the ninth operation can be performed directly in the original application display area without triggering the operation options, so as to collect materials and expand the material collection method.

[0033] In conjunction with the first aspect, in one possible implementation, the method further includes: displaying a fourth interface of a third application in full screen; in response to a third target operation, the display screen is in the partitioned display state, wherein the original application display area includes the fourth interface, and the material display area includes at least the first material icon, the second material icon, and the third material icon; in response to a tenth operation on a target material icon in the material display area, the target material icon is selected, and the target material icon is any one of the plurality of material icons; in response to an eleventh operation on the target material icon, the material indicated by the target material icon is distributed to the fourth interface.

[0034] The third objective operation can be the same as the first objective operation and the second objective operation.

[0035] The tenth action can be a long press or a click, and the eleventh action can be a drag or a throw.

[0036] When the fourth interface of a third application is displayed in full screen, the status bar may not be included.

[0037] It should be understood that for a fourth interface excluding the status bar, after the display enters the partitioned display state, the content of the fourth interface remains unchanged, only the display area is reduced, changing from full screen to a smaller area of ​​the original application display. Optionally, for a fourth interface including the status bar, after the display enters the partitioned display state, the original application display area can be used to display the content of the fourth interface excluding the status bar.

[0038] The distribution process of materials can be instructed Figure 28 The image distribution process is shown.

[0039] Optionally, the process of selecting the target material icon can be executed multiple times. After executing it multiple times, it is equivalent to selecting multiple materials for distribution.

[0040] In this embodiment of the application, operations can be performed directly between the material display area and the original application display area in the partitioned display state to achieve material distribution.

[0041] In conjunction with the first aspect, in one possible implementation, the media preview interface includes a share button, and the method further includes: in response to a twelfth operation on the share button, displaying a share card on the media preview interface, the share card including multiple options indicating different formats, different devices, different applications, saving, and printing; in response to a thirteenth operation on the share card, the media indicated by the target media icon is shared based on the selected option.

[0042] The twelfth and thirteenth operations can be clicked.

[0043] The process of sharing materials can be instructed Figure 30 The image sharing process is shown.

[0044] In this embodiment of the application, material sharing can be achieved directly while the material preview interface is displayed.

[0045] In conjunction with the first aspect, in one possible implementation, the types of the first initial material and the second initial material include any two of the following: webpage, document, and image.

[0046] In conjunction with the first aspect, in one possible implementation, the first option corresponds to the type of the first initial material, and the second option corresponds to the type of the second initial material; when the type of the first initial material is a webpage, the first option is a webpage bookmarking option; when the type of the first initial material is a document, the first option is a document bookmarking option; when the type of the first initial material is an image, the first option is an image bookmarking option; when the type of the second initial material is a webpage, the second option is the webpage bookmarking option; when the type of the second initial material is a document, the second option is the document bookmarking option; when the type of the second initial material is an image, the second option is the image bookmarking option.

[0047] In the embodiments of this application, when collecting different types of materials or for different scenarios, the corresponding first option or special option can be displayed based on the type of material.

[0048] In conjunction with the first aspect, in one possible implementation, after responding to a first operation on the first option, the method further includes: displaying a collection state icon, the collection state icon being hovered over the original application display area; in response to a fourteenth operation on a first control included in the collection state icon, acquiring a first material based on the first initial material; in response to a fifteenth operation on a second control included in the collection state icon, the first material being collected into the target application via the collection state icon; and adding a fifth material icon to the material display area, the fifth material icon corresponding to the first material.

[0049] The collection status icon can be Figure 10 As shown in (b) of 403a, the first control can be a recording control, and the second control can be a completion control. The fourteenth and fifteenth operations can be click operations.

[0050] In this embodiment of the application, the collection of some materials can be carried out based on the triggered collection status icon, which expands the collection scenarios.

[0051] In conjunction with the first aspect, in one possible implementation, the method further includes: the type of the first initial material is video, and the first option is a video excerpt option.

[0052] In this embodiment, different first options, or dedicated options, can be displayed for different types of materials. For video, a video extraction option can be displayed, thereby enabling the collection of video extractions.

[0053] In conjunction with the first aspect, in one possible implementation, the operation area further includes a screenshot option. Before responding to the second target operation, the method further includes: in response to a sixteenth operation on the screenshot option, a second material obtained based on the first initial material is collected into the target application, the type of the second material being an image; a sixth material icon is added to the material display area, the sixth material icon corresponding to the second material.

[0054] The sixteenth operation is a click operation.

[0055] In this embodiment of the application, screenshots can be collected in a simple way.

[0056] In conjunction with the first aspect, in one possible implementation, the method further includes: in response to a seventeenth operation on the screenshot option, an operation option submenu is displayed floating on the screenshot option, the operation option submenu including the screenshot option and a long screenshot option; in response to an eighteenth operation on the long screenshot option and a nineteenth operation on the original application display area, a third material obtained based on the first initial material is collected into the target application, the type of the third material being a long image; a seventh material icon is added to the material display area, the seventh material icon corresponding to the third material.

[0057] The eighteenth operation can be a click operation.

[0058] The nineteenth action can indicate a swipe action targeting the original application display area, such as a swipe from bottom to top.

[0059] The operation options submenu can indicate Figure 16 Menu card 702d shown in (c) of the document.

[0060] Alternatively, the long screenshot can be started only in response to the eighteenth operation for the long screenshot option, and the long screenshot can be automatically ended after the displayed content scrolls, and the third material obtained based on the first initial material can be collected into the target application.

[0061] In this embodiment, the content displayed in the original application display area can move upwards or scroll automatically as you slide, with the content in the upper area gradually disappearing and new content gradually appearing in the lower area, so as to facilitate being captured as a long screen.

[0062] In conjunction with the first aspect, in one possible implementation, the operation area further includes a content recognition option. Prior to responding to the second target operation, the method further includes: in response to a twentieth operation on the content recognition option, displaying content in the original application display area in a target format and displaying a favorite button, the favorite button hovering over the display content; in response to a twentieth operation, partially displaying content is selected; in response to a twentieth operation on the favorite button, the selected partially displaying content is collected into the target application; and an eighth material icon is added to the material display area, the eighth material icon corresponding to the selected partially displaying content.

[0063] The twentieth and twenty-second operations can be click operations; the twenty-first operation can be a click operation or a drag operation.

[0064] In this embodiment, in response to the twentieth operation for the content recognition option, the system's screen recognition capability can be triggered to extract text, images, and other functions from the displayed content in the original application display area. Then, in response to the selection of content and the operation of the favorite button, the selected part of the displayed content can be collected into the target application, thus expanding the scenarios and types of material collection.

[0065] In conjunction with the first aspect, in one possible implementation, the target form includes at least one of the following: a highlighted form, a word segmentation block form, or a form that is sequentially tiled and floated in the original application display area.

[0066] In conjunction with the first aspect, in one possible implementation, the first target operation, the second target operation, and the third target operation are all three-finger swipe operations.

[0067] Optionally, the target operation can also be a uniform knuckle C-shaped swipe operation, or a uniform other gesture operation, which can be in contact with the display screen or suspended in the air without contact.

[0068] In this embodiment, regardless of the number of times, the target operation is a uniform gesture operation, which eliminates the memory burden, makes it easy for users to learn and use, and improves the user experience.

[0069] In conjunction with the first aspect, in one possible implementation, the material display area is located in the left or right hot zone of the display screen, and the operation area is located in the top area of ​​the display screen.

[0070] In this embodiment, the material display area is located in the left or right hot zone, which facilitates the collection and distribution of materials. The operation options in the operation area are used less frequently. Therefore, the operation area can be located in the top area of ​​the display screen. This facilitates operation on the content of the original application display area below and prevents accidental touches on operation options.

[0071] In a second aspect, this application provides an electronic device comprising: one or more processors and one or more memories; the one or more memories being coupled to the one or more processors, the memories being used to store computer program code including computer instructions, the one or more processors calling the computer instructions to cause the electronic device to perform the method described in the first aspect or any implementation thereof.

[0072] Thirdly, this application provides a computer storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect or any implementation thereof.

[0073] Fourthly, embodiments of this application provide a chip system that can be applied to an electronic device. The chip includes one or more processors that invoke computer instructions to cause the electronic device to perform the method described in the first aspect or any implementation thereof.

[0074] Fifthly, embodiments of this application provide a computer program product containing instructions that, when run on an electronic device, cause the electronic device to perform the method described in the first aspect or any implementation thereof.

[0075] It is understood that the electronic device provided in the second aspect, the computer storage medium provided in the third aspect, the chip system provided in the fourth aspect, and the computer program product provided in the fifth aspect are all used to execute the method described in the first aspect or any implementation thereof. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects of any possible implementation of the first aspect, which will not be repeated here. Attached Figure Description

[0076] Figure 1 This is a settings interface corresponding to a collection method provided in an embodiment of this application;

[0077] Figure 2 for Figure 1 A set of user interface diagrams related to the provided collection methods;

[0078] Figure 3Examples of global collections in different forms provided for embodiments of this application;

[0079] Figure 4 Examples of floating icons provided in embodiments of this application;

[0080] Figure 5 This is a schematic diagram illustrating the switching between floating and hidden icons and full-screen mode, provided in an embodiment of this application.

[0081] Figure 6 A schematic diagram of the interface for triggering webpage bookmarking by swiping down with three fingers, provided in an embodiment of this application;

[0082] Figure 7 A schematic diagram illustrating various operation options provided in embodiments of this application;

[0083] Figure 8 A schematic diagram of a webpage bookmarking interface provided for an embodiment of this application;

[0084] Figure 9 A schematic diagram of the interface for triggering video extraction by swiping down with three fingers, provided in an embodiment of this application;

[0085] Figure 10 A schematic diagram of a video extraction interface provided for an embodiment of this application;

[0086] Figure 11 A schematic diagram of the interface for triggering document collection by swiping down with three fingers, provided in an embodiment of this application;

[0087] Figure 12 A schematic diagram of a document collection interface provided for an embodiment of this application;

[0088] Figure 13 This is a schematic diagram of the interface for triggering image collection by swiping down with three fingers, provided in an embodiment of this application.

[0089] Figure 14 A schematic diagram of an image collection interface provided for an embodiment of this application;

[0090] Figure 15 A schematic diagram of a screenshot collection interface provided in an embodiment of this application;

[0091] Figure 16 A schematic diagram of the interface for triggering a long screenshot collection by swiping down with three fingers, provided in an embodiment of this application;

[0092] Figure 17 A schematic diagram of a screenshot collection interface provided in this application embodiment;

[0093] Figure 18A schematic diagram of the interface for triggering the extraction of content collection by swiping down with three fingers, provided in an embodiment of this application;

[0094] Figure 19 and Figure 20 A schematic diagram of an interface for retrieving and collecting content is provided as an embodiment of this application;

[0095] Figure 21 This is a schematic diagram illustrating another content extraction method provided in an embodiment of this application;

[0096] Figure 22 A schematic diagram of the target interface provided in the embodiments of this application;

[0097] Figure 23 This is another schematic diagram of an interface for triggering favorites by swiping down with three fingers, provided as an embodiment of this application;

[0098] Figure 24 A schematic diagram of the interface for one of the collection methods provided in this application embodiment;

[0099] Figure 25 A schematic diagram of the interface for the second collection method provided in this application embodiment;

[0100] Figure 26 A schematic diagram of a secondary collection interface provided for an embodiment of this application;

[0101] Figure 27 A schematic diagram of another secondary collection interface provided in an embodiment of this application;

[0102] Figure 28 A schematic diagram of an interface for distributing materials provided in an embodiment of this application;

[0103] Figure 29 A schematic diagram of a preview material provided for an embodiment of this application;

[0104] Figure 30 A schematic diagram of an interface for sharing materials provided in an embodiment of this application;

[0105] Figure 31 An exemplary flowchart of a material processing method provided in an embodiment of this application;

[0106] Figure 32 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0107] Figure 33 This is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0108] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0109] It should be understood that the terms "first," "second," etc., in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0110] In this application, the reference to "embodiment" means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a mutually exclusive, independent, or alternative embodiment. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described in this application can be combined with other embodiments.

[0111] To facilitate understanding, the terms used in the embodiments of this application will be explained first.

[0112] 1. System applications and third-party applications. System applications refer to applications directly provided by the operating system of an electronic device to achieve specific functions. Third-party applications refer to applications provided by other developers and obtained by the electronic device through the Internet to achieve specific functions. In the embodiments of this application, the application providing the user interface can be either a system application or a third-party application.

[0113] 2. A hot zone refers to a touch area on the screen with a fixed shape and size.

[0114] For example, Figure 22 In diagram (b), 302d is a schematic representation of a "hot zone". (See also...) Figure 22 In (b), the hot zone may include a right-side hot zone and / or a left-side hot zone. The right-side hot zone refers to a rectangular touch area extending from the right edge of the screen to the left, and the left-side hot zone refers to a rectangular touch area extending from the left edge of the screen to the right. Figure 22 Example (b) is given using the left side hot zone as an example.

[0115] Electronic devices can determine whether a control is close to the right or left side of the screen by determining the distance between the current finger's touch point on the screen and the right or left edge hot zone. In this embodiment, when the current touch point is detected to be within the right or left edge hot zone, the electronic device can determine to trigger the service corresponding to the hot zone, such as triggering the selection of materials.

[0116] 3. Materials may include various types of information such as text, graphics, images, videos, files, audio, web pages, and tables in this application; among them, images may be static or dynamic images, and files may be in various formats such as PDF, Word, and Excel, and this application does not limit them.

[0117] 4. Annotations (or doodles), in this application, refer to content drawn by the user on the display screen with a pen or fingertip. The information contained in the annotation content may include the trajectory formed from the starting position to the ending position during annotation. The starting position refers to the position where the user presses down the pen when making annotations on the display screen, and the ending position refers to the position where the user lifts the pen after making the annotation on the display screen.

[0118] The above is a brief introduction to the terms used in the embodiments of this application, and will not be repeated below.

[0119] Electronic devices can support the collection of different types of materials in different ways. In this way, users can use electronic devices to achieve their purpose of collecting materials.

[0120] However, in practice, taking file management apps on a mobile phone as an example, these apps can only be used to collect materials such as pictures, videos, audio, and files. The types of materials are limited, and the collection methods (such as copying and dragging) are also correspondingly limited. Taking note-taking apps on a mobile phone as an example, in addition to collecting text, pictures, videos, and audio, note-taking apps can also collect web pages and videos obtained from news apps.

[0121] In the two examples above, although note-taking apps can collect slightly more types of materials compared to file management apps, users still need to frequently switch between different apps to collect multiple types of materials into a single note, resulting in low collection efficiency. Furthermore, users need to use different methods to collect materials from different apps. For example, for web pages and videos, users need to swipe down with three fingers to save them to the note-taking app; for other types of content, users need to use various methods such as copying, dragging, and knuckle C-shaped swipes to save them to the note-taking app.

[0122] For example, Figure 1 This is a settings interface corresponding to a collection method provided in an embodiment of this application; Figure 2 This is a set of user interface diagrams related to this collection method. For example... Figure 1 As shown in (a), the main interface 101 of the settings application of the electronic device may include accessibility options; in response to user actions on the accessibility options, the electronic device may display, as shown in (a). Figure 1 The accessibility interface 102 is shown in (b) above. This accessibility interface 102 may include a three-finger swipe gesture and a corresponding switch. The switch being on indicates that the three-finger swipe gesture is enabled, and being off indicates that it is disabled. When the three-finger swipe gesture is enabled, the user can use the three-finger swipe gesture to collect corresponding material types (such as web pages and video excerpts) into the note-taking application.

[0123] For example, see Figure 2 The display interface 201 shown in (a) is a display interface corresponding to the content of a certain webpage. When the electronic device detects a three-finger swipe down operation by the user on the display interface 201, in response to the three-finger swipe down operation, the electronic device can display as shown in (a). Figure 2 The display interface 202 is shown in (b) above. Compared to display interface 201, display interface 202 retains the same content, but a card 202a is overlaid in the lower half of the display interface 202. This card 202a indicates that a three-finger swipe down has triggered a webpage to be saved, and the saved webpage content originates from the application indicated by the icon, such as the WeChat app. As the webpage is saved to the note-taking application, card 202a gradually moves towards the bottom edge of the electronic device and disappears; after the webpage is successfully saved, as shown in (b), the card 202a disappears. Figure 2 As shown in (c), card 202a disappears, and card 202b can be displayed on the display interface 202. Card 202b is used to indicate that the webpage has been successfully saved and that the webpage content has been saved to the note-taking application. Next, if the user performs a user operation on the text "Notes" on card 202b, in response to the user operation, the electronic device can display the interface of the note-taking application, such as... Figure 2 The display interface 203 shown in (d) is provided to the user to view the web page content currently saved to the notes.

[0124] Based on the above, in order to shorten the user's collection path, unify the collection space, and improve collection efficiency, this application provides a new third-party application, namely a global collection application. Based on this global collection application, the purpose of shortening the collection path can be achieved. However, there are still problems such as diverse and inconsistent collection methods, with each collection method corresponding to different material types; the system cannot accurately determine how the user wants the content to be retained; and it is not easy for the user to remember, affecting the user experience.

[0125] In view of this, this application provides a new material processing method based on a global collection application. This material processing method can collect materials from different sources and of different types, unify the collection method, expand the collection scenarios and types, and improve collection efficiency. This method can also accurately determine how users want content to be retained, and it requires no learning cost for users. It can efficiently and conveniently collect, organize, and distribute materials in any scenario, thereby improving the user experience.

[0126] To facilitate understanding of the methods provided in the embodiments of this application, the following will first be combined with... Figures 3 to 5 This application provides a brief overview of the global collection application and its various forms.

[0127] Global Collection is a management application that allows users to collect, organize, and share materials. Users can use Global Collection to fulfill their needs for collecting, organizing, and sharing materials. Furthermore, Global Collection can be developed into a personal learning or working space. Data retention rules within Global Collection can be set for permanent storage.

[0128] Global favorites can present various forms during use to distinguish different processing stages or different processes the electronic device is undergoing. For example, global favorites can appear as a hidden state (also called a hidden icon), a collected state (also called a collected icon), a floating state (also called a floating icon), and a full-screen state (also called a full-screen interface); these are merely illustrative names, for example, a hidden state can also be called a minimized state, and a floating state can also be called a distributed state; this application does not limit this. Each form of global favorites can also include one or more styles, and these styles can be toggled in response to user triggering. See also Figure 3 These are examples of global collections in different forms provided in the embodiments of this application.

[0129] The Global Collection app has several modes: a hidden state indicates that it has been invoked in the foreground or is running in the background; a collection state indicates the entry point for collecting materials or that Global Collection is in the process of collecting materials; a floating state displays materials collected in Global Collection in a portion of the current display screen; and a full-screen state displays materials collected in Global Collection across the entire display area. Essentially, the floating state is equivalent to the display window of the Global Collection application, and the full-screen state is equivalent to the main interface of the Global Collection application. Both floating and full-screen states allow users to organize their materials.

[0130] Optionally, the hidden icon for global favorites can be a sphere or a hemisphere, and can be opaque or semi-transparent. For example, when global favorites are hidden, the hidden icon can be presented as a semi-transparent, hemispherical effect that snaps to the inside edge of the screen, such as... Figure 3 The hidden icon 'a' is shown in the image. When hidden icon 'a' is positioned inside the screen edge, it does not obstruct the user's normal viewing of the displayed content. Furthermore, its semi-transparent state prevents it from attracting the user's attention and does not interfere with normal use.

[0131] It should be noted that the position of the inner edge of the screen described in the embodiments of this application can be located on the upper side, lower side, left side or right side of the inner edge, and this application does not limit it in this regard.

[0132] Optionally, the global collection icon can switch between different styles depending on the collection scenario. For example, when collecting video clips, the collection style can be switched to something like... Figure 3 The collection state icon b11 shown; when collecting global annotations, the collection state style can be switched to, as shown below. Figure 3 The collection state icon b21 or b22 shown. The style of the collection state can be set according to the type of material being collected, and this application does not limit this.

[0133] Optionally, the floating state of global favorites can move its position within the display area based on user dragging operations, and can also change its size based on user dragging operations. For example, the floating state of global favorites can specifically include two styles: one is a long strip, such as... Figure 3 The first suspended state c1 is shown in the image; another is card-shaped, such as... Figure 3 The second floating state c2 shown in the diagram; the elongated first floating state c1 and the card-shaped second floating state c2 have different positions and sizes. The first floating state c1 of global collection can be displayed with an effect of adhering to the inner edge of the screen to avoid interfering with the currently displayed content. The second floating state c2 of global collection can be displayed in the center area of ​​the display screen for easy viewing by the user.

[0134] Optionally, as one possible implementation, in response to a drag operation on the edge of the first floating state c1, the first floating state c1 can switch to the second floating state c2; conversely, in response to a drag operation on the edge of the second floating state c2, the second floating state c2 can also switch to the first floating state c1. As another possible implementation, in response to a two-finger reverse swipe operation on the first floating state c1, the first floating state c1 can switch to the second floating state c2; conversely, in response to a two-finger pinch operation on the second floating state c2, the second floating state c2 can also switch to the first floating state c1. Furthermore, the first floating state c1 can display icons corresponding to one or two columns of materials, with a minimum of displaying icons corresponding to one material. The second floating state c2 can display icons corresponding to two or more columns of materials, but the number of columns and rows is less than in the full-screen state; the specific number can be set as needed, and this application does not impose any limitations on this.

[0135] Optionally, the global favorites floating state may also include a top bar control and / or a bottom bar control. In response to a click on the top bar control, such as... Figure 4 As shown in (a), the first suspended state c1 can be switched to the following state: Figure 4 The floating style with a toolbar shown in (b) is as follows: the toolbar of this style can include three controls: a zoom-in control, a zoom-out control, and a close control. The zoom-in control is used to trigger the switch from the first floating state c1 to the full-screen state; the zoom-out control is used to trigger the switch from the first floating state c1 to the hidden state icon a; and the close control is used to trigger the exit from global favorites.

[0136] Optionally, such as Figure 5 (a) and Figure 5 As shown in (b), in response to a swipe operation on the top horizontal bar control of the first floating state c1, the global favorites can switch from the first floating state c1 to the hidden state icon a. The direction of this swipe operation can be left or right. Figure 5 (a) in the diagram only indicates a swipe to the right. Additionally, in response to a click on the hidden icon 'a', the global favorites can switch from the hidden icon 'a' to the first floating icon 'c1'.

[0137] Optionally, such as Figure 5 (c) and Figure 5 As shown in (d), in response to a swipe operation on the bottom horizontal bar control of the first floating state c1, the global favorites can switch from the first floating state c1 to the full-screen state icon d. The direction of this swipe operation can be left or right. Figure 5 (c) in the diagram only indicates sliding to the right.

[0138] Similarly, the second floating state c2 can also be switched to a floating state style with a toolbar; the second floating state c2 can also include a top horizontal bar control and a bottom horizontal bar control, and the top horizontal bar control and bottom horizontal bar control of the second floating state c2 can also be swiped to switch to a hidden state icon a or a full-screen state d; for a description of the function of the second floating state c2, please refer to the above description, which will not be repeated here.

[0139] It should also be noted that while users may switch between various modes when using global favorites, the global favorites application in each mode is always on top (or pinned to the top) of the multiple display layers included in the display interface, and is not covered or affected by the content displayed below.

[0140] In combination with the various forms of global collection and use described above, when implementing the material processing method provided in this application, the electronic device can perform one or more of the following scenarios.

[0141] It is understandable that the materials include various types. The various types of materials mentioned here can include fragmented materials such as text, graphics, images, tables, and annotations, as well as non-fragmented materials such as web pages, videos, and documents. Graphics can indicate a partial image captured using the lasso tool, etc.

[0142] It should be understood that the materials involved in this application include, but are not limited to, text, graphics, images, videos, audio, web pages, tables, annotations, etc. The collection of materials involved in this application may include acquiring materials, processing the acquired materials, and using the processed results as the collected content. For example, collecting materials may include: converting acquired web page materials into text materials, converting acquired text materials into image materials, editing or marking input text or images, etc.

[0143] Part One:

[0144] To standardize the collection method for the various types of materials described above, this application provides a unified gesture, such as a three-finger swipe down. Therefore, this application allows access to the global collection mode via a three-finger swipe down. For example:

[0145] Scenario 1. In response to a three-finger swipe down operation, enter global favorites mode. Electronic devices can support saving web pages to the global favorites application.

[0146] Scenario 2. In response to a three-finger swipe down operation, entering global favorites mode, the electronic device can record video while playing video and save the recorded video to the global favorites application. For ease of description, this application refers to the recorded video as an excerpt video.

[0147] Optionally, the electronic device can support continuous recording during video recording. Continuous recording here refers to pausing and then resuming recording of a video segment. It should be noted that the electronic device can switch applications before resuming recording after pausing; that is, the two recording segments can involve different applications. However, after recording is complete, the two recording segments will be stitched together into a single excerpt (also known as a video clip) and collected in the global favorites.

[0148] Optionally, after recording a video, the electronic device can also support adding excerpts to the videos already collected in the global collection. It should be noted that adding excerpts here can refer to non-continuous recording or multi-stage recording; each newly added video is stored in the same folder location within the global collection as the previously recorded videos, and within this folder, different recorded videos correspond to different video segments; furthermore, this folder containing multiple video segments is still displayed as a single material icon in the global collection.

[0149] Scenario 3. In response to a three-finger swipe down operation, entering global favorites mode, electronic devices can support saving documents to the global favorites application.

[0150] Scenario 4. In response to a three-finger swipe down operation, entering the global favorites mode, electronic devices can support saving images to the global favorites application.

[0151] Scenario 5. In response to a three-finger swipe down operation, entering global favorites mode, electronic devices can support saving screenshots to the global favorites application.

[0152] Scenario 6. In response to a three-finger swipe down operation, entering global favorites mode, electronic devices can support saving screenshots to the global favorites application.

[0153] Scenario 7. In response to a three-finger swipe down operation, entering global favorites mode, electronic devices can support saving content recognized from the display interface to the global favorites application.

[0154] Scenario 8. In response to a three-finger swipe down operation, entering global favorites mode, the electronic device can also support annotation on any interface, and save the original interface and annotation traces together to the global favorites application. For ease of description, this application refers to the original interface and annotation traces together as global annotations.

[0155] Optionally, during the annotation process, the electronic device can support continuous annotation. Continuous annotation here can indicate pausing and then resuming annotation. It should be noted that before resuming annotation, the electronic device can support switching between interfaces or applications; that is, the two annotation segments can involve different interfaces or applications displaying different content. However, after annotation is completed, the two annotation segments will be combined into a single global annotation (also known as a snapshot) and collected in the global favorites.

[0156] Optionally, after annotation is completed, the electronic device can also support appending annotations to the global annotations already collected in the global collection. It should be noted that appending annotations here can indicate non-continuous annotations or annotations in stages; each newly added annotation and the content of the previous one or more annotations are equivalent to being saved in the same folder location in the global collection, and in this folder, the content of different annotations corresponds to different snapshots; it should also be added that this folder containing multiple snapshots is still displayed as an individual material icon in the global collection.

[0157] Optionally, after annotation is completed, the electronic device can also support repeated annotation for global annotations that have been collected into the global collection, that is, to edit the annotation content that already carries annotation traces again, including but not limited to adding annotation traces.

[0158] The above only illustrates eight collection scenarios, and other scenarios are also possible. This application does not limit the scenarios for the collection stage. The collection method provided in this application, by combining with a global collection application, can collect materials from different sources and of different types, unify the collection method, expand collection scenarios, and improve collection efficiency. This method can accurately determine how users want content to be retained, and it requires no learning cost for users, allowing them to efficiently collect materials in any scenario.

[0159] It is understood that the electronic device in this application can be a mobile phone, tablet computer or other terminal device, as well as a desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, cellular phone, personal digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, artificial intelligence (AI) device, wearable device, in-vehicle device, smart home device and / or smart city device. The embodiments of this application do not impose any special restrictions on the specific type of electronic device.

[0160] The following is a detailed introduction to entering the global collection mode using a unified three-finger swipe gesture and the process of collecting different types of materials.

[0161] Example 1: Webpage bookmarking (e.g.) Figure 6 - Figure 8 (As shown)

[0162] Taking WeChat as an example, electronic devices can detect a three-finger swipe down on the display screen corresponding to a specific article. In response to this three-finger swipe down, the electronic device can trigger entry into global favorites mode, and save the displayed content in global favorites mode.

[0163] like Figure 6 The display interface 301 shown in (a) is the display interface corresponding to a certain webpage. For example... Figure 6 As shown in (a), the electronic device can detect a three-finger swipe down operation on the display interface 301. In response to the three-finger swipe down operation, the electronic device can enter a global favorites mode and display as shown in (a). Figure 6 The display interface 302 shown in (b) is shown in the figure.

[0164] Compared to display interface 301, display interface 302 comprises three areas. The first area 302a, located at the top, is a status bar displaying basic status information of the electronic device, such as network status, battery level, and time. The second area 302b, located in the middle, may include thumbnails indicating the corresponding display interface 301 when a three-finger swipe gesture is triggered. The thumbnails contain the same content as display interface 301 but are smaller in size. The third area 302c, located at the bottom, displays multiple operation options, which may include dedicated options (also known as vertical options), content retrieval options, and general options.

[0165] Alternatively, in one possible implementation, the thumbnail can be in the form of a rectangle (e.g., Figure 6 The shape can be displayed in various ways, such as the shape shown in (b) above, which is wider at the top and narrower at the bottom, or the shape that is wider on the left and narrower on the right. The specific display format can be set as needed, and this application embodiment does not impose any restrictions on it.

[0166] Alternatively, in another possible implementation, when switching from display interface 301 to display interface 302, an "opening door animation" can be displayed. This opening door animation indicates the process of the displayed content gradually shrinking and transforming from a full-screen display style (i.e., display interface 301) to a thumbnail style. The reverse process can be called a "closing door animation." The specific animation form can be set as needed, and this application embodiment does not impose any restrictions on it.

[0167] The dedicated options are used to indicate the options corresponding to the content storage format triggered by the three-finger swipe gesture. When the scenario corresponding to the three-finger swipe gesture is triggered is different, the dedicated options displayed in the third part will be different. In other words, global favorites can provide corresponding options for specific scenarios. Figure 7 This is a schematic diagram illustrating various operational options provided in embodiments of this application. For example... Figure 7 As shown, for webpage saving scenarios, the dedicated option can be displayed as webpage saving options; for video excerpt scenarios, the dedicated option can be displayed as video excerpt options; for document saving scenarios, the dedicated option can be displayed as document saving options; for image saving scenarios, the dedicated option can be displayed as image saving options, and so on. The scenarios and their corresponding dedicated options can be set as needed, and this application embodiment does not impose any restrictions on this.

[0168] The content extraction option indicates the option to extract partial content from the displayed interface based on the system's screen recognition capabilities. System screen recognition capabilities refer to the electronic device's abilities, including text extraction, product recognition, and similar image recognition.

[0169] The general options are options for multiple special functions, allowing the same operation to be performed for different types of displayed content. For example... Figure 7 As shown, general options may include screenshot collection options, long screenshot collection options, annotation collection options, and screen recording collection options, etc., and this application embodiment does not limit these options in any way.

[0170] Optionally, in one possible implementation, the third section area typically provides three or fewer options for each scenario; alternatively, it displays a combination of three options by selecting one option from each of the three categories. Alternatively, in another possible implementation, the third section area may provide one option for dedicated options, one option for content extraction options, and two options for general options.

[0171] Optionally, when displaying, the options can be arranged from left to right in the order of dedicated options, content extraction options, and general options.

[0172] For example, in the case of webpage bookmarking, when the option to bookmark a webpage cannot be provided, the third area can display options such as content extraction, screenshot bookmarking, long screenshot bookmarking, and annotation bookmarking.

[0173] For example, in a video excerpting scenario, when the video excerpting option is not provided, the third area can display options such as screen recording collection, content extraction, screenshot collection, and annotation collection.

[0174] For example, in a document collection scenario, when document collection is not available, the third area can display options such as content extraction, screenshot collection, long screenshot collection, and annotation collection.

[0175] It should be noted that the lack of corresponding dedicated options in the above three scenarios refers to the situation where certain niche third-party applications do not allow the use of or are not compatible with the system's dedicated collection function. In this case, when triggered by a three-finger swipe down, the display interface 302 can selectively hide the dedicated options.

[0176] For example, in scenarios where no dedicated options are available, such as WeChat chat, shopping, or reading, the third area can display options for content extraction, screenshot saving, long screenshot saving, and annotation saving.

[0177] The display of options in the third area can be configured as needed, and this application does not impose any restrictions on this.

[0178] It should be noted that, Figure 6 The display interface 302 shown in (b) is only one display interface style provided in this application embodiment. This application also provides a variety of display interface styles, which will be introduced later and will not be repeated here.

[0179] All of the above embodiments 1 to the following embodiments 7 are triggered by a three-finger swipe down to enter the global favorites mode, and the interface displayed after triggering is as follows: Figure 6 The style shown in (b) is used as an example for introduction.

[0180] refer to Figure 8 In the display interface 302 shown in (a), the electronic device can detect a click operation on the webpage favorites option in the display interface 302; in response to the click operation, the displayed content corresponding to the thumbnail (i.e., the webpage displayed in the display interface 301) will be collected into the global favorites application. During this collection process, such as Figure 8 As shown in (b), the electronic device can first display a closing animation, switch from display interface 302 back to the original webpage display interface, and display card 303a on this interface. Card 303a may include information such as the title, publisher, publishing address, and time of the webpage being collected. Optionally, a close button may also be included in the upper left corner of card 303a. A click on the close button can terminate the collection of the webpage, after which card 303a disappears from display.

[0181] If, during the webpage collection process, no click is received on the close button in the upper left corner of card 303a within a preset time period, such as... Figure 8As shown in (c), card 303a can be switched to card 303b, while other content remains unchanged; card 303b is used to indicate the source of the webpage bookmark, such as from WeChat, and displays the WeChat icon. Optionally, as... Figure 8 As shown in (d), the card 303b can move toward the bottom edge of the display interface 303 and gradually disappear.

[0182] Optionally, after card 303b disappears, such as Figure 8 As shown in (e), the electronic device can also display card 303c, with all other content remaining unchanged. Card 303c is used to inform the user that the webpage has been successfully bookmarked and provides a link to access the global bookmarking application.

[0183] In this embodiment, global collection is the default collection method for web page collection; of course, web page content can also be collected in other applications, and the specific settings can be configured as needed. This embodiment does not limit this.

[0184] For example, the card 303c can display text links such as "Go to global favorites"; in response to a click on the text link, the electronic device can display a floating icon c1 for global favorites, such as... Figure 8 As shown in (f), the floating icon c1 of the global collection includes an icon indicating the web page content that was just collected.

[0185] Optionally, if no operation is received within a preset time period, card 303c can automatically disappear and not be displayed.

[0186] Optionally, after card 303b disappears, such as Figure 8 As shown in (e), a hidden hemispherical icon 'a' for global collections can be displayed on the inner edge of the right side of the screen of the electronic device, providing an entry point to the global collections application. Optionally, upon first triggering the display of the hidden icon 'a', the electronic device can also display a prompt card near the hidden icon 'a', indicating to the user that clicking the hidden icon 'a' will allow access to the global collections application and viewing the content collected by the global collections application, such as... Figure 8 As shown in (f); the prompt card may also include a close button, which can trigger the closing of the prompt card in response to a user's click.

[0187] The above is just one example of how to bookmark web pages.

[0188] Example 2: Video excerpt collection (e.g.) Figure 9 - Figure 10 (As shown)

[0189] Taking video applications as an example, electronic devices can detect a three-finger swipe down on a video playback screen. In response to this three-finger swipe down, the electronic device can trigger a global favorites mode, where selected video clips can be saved.

[0190] like Figure 9 The display interface 401 shown in (a) is the display interface corresponding to a certain video playback interface. For example... Figure 9 As shown in (a), the electronic device detects a three-finger swipe down on the display interface 401. In response to the three-finger swipe down, the electronic device can enter a global favorites mode and display as shown in (a). Figure 9 The display interface 402 is shown in (b) of the diagram.

[0191] Optionally, when switching from display interface 401 to display interface 402, an "opening door animation" can be displayed.

[0192] Compared to display interface 401, display interface 402, like display interface 302 in Embodiment 1, can include three areas. The first part 402a in the upper area is a status bar, which will not be described further here. The second part 402b in the middle area includes a thumbnail indicating the display interface 401 displayed when a three-finger swipe gesture is triggered; the content of the thumbnail is the same as that of display interface 401, but its size is smaller than that of display interface 401. The third part 402c in the bottom area displays multiple operation options; a detailed description of these operation options can be found in Embodiment 1, and will not be repeated here.

[0193] In addition, since the display interface 401 corresponds to the video excerpting scenario, the dedicated options displayed in the third part area are the video excerpting options; the third part area can also display content extraction options, screenshot collection options and annotation collection options in the general options, etc.

[0194] It should be noted that, Figure 9 The display interface 402 shown in (b) is only one display interface style provided in this application embodiment. This application also provides a variety of display interface styles, which will be introduced later and will not be repeated here.

[0195] refer to Figure 10 As shown in (a) of the display interface 402, the electronic device can detect a click operation on the video extraction option in the display interface 402; in response to the click operation, such as Figure 10 As shown in (b) of the display interface 403, the electronic device can enter the video clipping mode and perform multiple functions such as video recording, marking, screenshotting, and saving in the video clipping mode.

[0196] Compared to display interface 401, display interface 403 still includes a video playback interface. The difference is that display interface 403 also includes a first collection state 403a. It should be noted that the first collection state 403a is a style of collection state corresponding to the global collection application in a video extraction scenario, such as... Figure 3 The collection state icon b11 is shown in the diagram. The first collection state 403a may include a video content area, a recording control, a marking control, a screenshot control, and a completion control. When not extracting video, the video content area can display the text "Video content will be extracted here" to indicate the location of the extracted content. During video extraction, it can display the text "Recording in progress" to indicate that recording is in progress. When recording is paused, the extracted content can be automatically saved to the video content area and displayed. The recording control can be used to start video recording, and can be switched to a pause control to pause video recording. The marking control can be used to mark video frames corresponding to a specific time point during video recording; the marking can also be called a time marker. The screenshot control can be used to capture video frames. The completion control can be used to exit the video extraction mode and trigger the collection of extracted videos already saved to the video content area.

[0197] Optionally, when switching from display interface 402 to display interface 403, a door closing animation can be displayed.

[0198] Understandably, a user can drag the first collection state 403a to change its position. The electronic device can detect the dragging operation applied to the first collection state 403a, and in response to the dragging operation, the electronic device can move the position of the first collection state 403a.

[0199] Optionally, the display interface 502 may also display a prompt card near the bottom of the screen, which may display the text "Entered video extraction mode" to inform the user that the current electronic device has entered video extraction mode and can perform operations related to video extraction. Subsequently, after a preset time or in response to an operation on a control on the first collection state 403a, the prompt card may disappear.

[0200] refer to Figure 10 (b) and Figure 10As shown in (c), when the electronic device detects a click operation on the recording control included in the first collection state 403a, in response to the click operation, the first collection state 403a can switch to form 403b for display, and the electronic device can start recording the video playing in the display interface 403. Compared to the first collection state 403a, form 403b remains unchanged except that the recording control is switched to a pause control, and the recording control name "Recording" is changed to a recording duration starting from "00:00". Optionally, the text displayed in the video content area of ​​form 403b can also be changed to "Recording in progress" to indicate to the user that recording has started. As the video plays and recording proceeds, assuming 18 seconds of recording have elapsed, the electronic device detects a click operation on the pause control, and in response to the click operation, recording stops. The video content extracted during those 18 seconds can be temporarily stored in the video content area of ​​form 403c.

[0201] After the extracted content is temporarily saved, the electronic device can display it as follows: Figure 10 As shown in (d), form 403b can be switched to form 403c. Compared to form 403b, the video content area of ​​form 403c can include the name of the extracted video (which can default to the text "Video Extract" and the recording time), as well as the last frame of the recorded video clip. A playback control can also be overlaid on the last frame of the first recorded clip, which can trigger the playback of the temporarily stored extracted video clip in the video content area. Additionally, compared to form 403c, the pause control in form 5028 switches back to the recording control, and the recording duration also switches back to the name of the recording control, "Record," while other controls remain unchanged.

[0202] Understandable, based on Figure 10 The display interface 403 shown in (d) can be recorded multiple times or continuously. The recording process is similar to that described above and will not be repeated here.

[0203] After the above-mentioned extraction stops, based on form 403c, the electronic device can detect a click operation on the completion control in form 403c; in response to this click operation, the video extraction is completed, and the extracted content temporarily stored in the video content area can be collected into the global collection application. During this collection process, such as Figure 10 As shown in (e), form 403c can be switched to card 403d, while other content remains unchanged. Card 403d is used to indicate the source of the video excerpt, such as from TikTok, and displays the TikTok icon. Optionally, card 403d can move towards the bottom edge of the display interface 403 and gradually disappear.

[0204] Optionally, after card 403d disappears, such as Figure 10As shown in (f), the electronic device can display card 403e, with other content remaining unchanged. Card 403e is used to indicate that the video extracted by the user has been successfully saved, and provides a link to the global collection application, prompting the user to go to the global collection application to view the saved materials.

[0205] In this embodiment, global collection is the default collection method for excerpted videos; of course, excerpted videos can also be collected in other applications, and the specific settings can be configured as needed. This embodiment does not limit this.

[0206] For example, the card 403e can display a text link such as "Go to global collection"; in response to a click on the text link, the electronic device can display a floating icon c1 for global collection, which includes an icon indicating the video excerpt that was just collected.

[0207] Optionally, after card 403d disappears, such as Figure 10 As shown in (f), a hidden hemispherical icon 'a' for global collections can be displayed on the inner edge of the right side of the screen of the electronic device, providing an entry point to the global collections application. Optionally, when the hidden icon 'a' is first displayed, the electronic device can also display a prompt card near the hidden icon 'a', which prompts the user to enter the global collections application and view the content collected by the global collections application by clicking the hidden icon 'a'; the prompt card may also include a close button, which can close the prompt card in response to the user's click operation.

[0208] Optionally, if no operation is received within a preset time period, card 403e can automatically disappear and not be displayed.

[0209] Optionally, after the above video excerpt is successfully collected, the global collection application can continue to be displayed on its interface as a hidden icon 'a', to indicate to the user that the global collection application is still running and can collect any material to the global collection at any time.

[0210] The above is just one example of how to collect videos.

[0211] Example 3, Document Collection (e.g.) Figure 11 - Figure 12 (As shown)

[0212] Taking WeChat as an example, an electronic device can display the chat interface within WeChat. This chat interface can include thumbnails of multiple files received by the device. These thumbnails can trigger the device to display the specific content of each file. For instance, the device can detect a click on the thumbnail of the file "What are the customs of the Minor Snow solar term?"; in response to this click, the device displays a preview of the corresponding file; the device can also detect a three-finger swipe down on this preview; in response to this three-finger swipe down, the device can trigger entry into global favorites mode, allowing the document to be saved.

[0213] like Figure 11 The display interface 501 shown in (a) is the same as the display interface of the aforementioned document. Figure 11 As shown in (a), the electronic device can detect a three-finger swipe down operation on the display interface 501. In response to the three-finger swipe down operation, the electronic device can enter a global favorites mode and display as shown in (a). Figure 11 The display interface 502 shown in (b) is shown in the figure.

[0214] Optionally, when switching from display interface 501 to display interface 502, an "opening door animation" can be displayed.

[0215] Compared to display interface 501, display interface 502, like display interface 302 in Embodiment 1, can include three areas. The first part 502a in the upper area is a status bar, as described in Embodiment 1, and will not be repeated here. The second part 502b in the middle area includes a thumbnail indicating the display interface 501 displayed when a three-finger swipe gesture is triggered; the content of the thumbnail is the same as that of display interface 501, but its size is smaller than that of display interface 501. The third part 502c in the bottom area displays multiple operation options; a detailed description of these operation options can be found in Embodiment 1, and will not be repeated here.

[0216] In addition, since the display interface 501 corresponds to the document collection scenario, the dedicated options displayed in the third part area are document collection options; the third part area can also display content extraction options, screenshot collection options and annotation options in the general options, etc.

[0217] It should be noted that, Figure 11 The display interface 502 shown in (b) is only one display interface style provided in this application embodiment. This application also provides a variety of display interface styles, which will be introduced later and will not be repeated here.

[0218] refer to Figure 12In the display interface 502 shown in (a), the electronic device can detect a click operation on the document collection option in the display interface 502; in response to the click operation, the display content corresponding to the thumbnail (i.e., the document displayed in the preview interface) will be collected into the global collection application. During this collection process, such as Figure 12 As shown in (b), the electronic device can first display a closing animation, switch from display interface 502 to the original preview interface of the displayed file, and display card 503a on this interface. Card 503a may include information such as the title of the file being collected. Optionally, a close button may also be included in the upper left corner of card 503a. In response to a click on the close button, the electronic device can terminate the document collection, and then card 503a disappears from display.

[0219] If, during the document collection process, no click is received on the close button in the upper left corner of card 503a within the preset time period, such as... Figure 12 As shown in (c), card 503a can be switched to card 503b, while other content remains unchanged; card 503b is used to indicate the type and size of the document collection, etc. Optionally, card 503b may include an icon corresponding to the document. Optionally, as... Figure 12 As shown in (d), the card 503b can also move toward the bottom edge of the display interface 503 and gradually disappear.

[0220] Optionally, after card 503b disappears, such as Figure 12 As shown in (e), the electronic device can also display card 503c, with all other content remaining unchanged. Card 503c is used to inform the user that the document has been successfully saved and provides a link to the global collection application, prompting the user to view the saved materials within the global collection application.

[0221] In this embodiment, global collection is the default collection method for documents; of course, documents can also be collected in other applications, and the specific settings can be made as needed. This embodiment does not limit this.

[0222] For example, the card 503c can display a text link such as "Go to global collection"; in response to a click on the text link, the electronic device can display a floating icon c1 for global collection; the floating icon c1 for global collection includes an icon indicating the document that was just collected.

[0223] Optionally, if no operation is received within a preset time period, card 503c can automatically disappear and not be displayed.

[0224] Optionally, after card 503b disappears, such as Figure 12As shown in (e), the electronic device may also display a prompt card near the hidden icon a, which prompts the user to enter the global collection application and view the content collected by the global collection application by clicking the hidden icon a; the prompt card may also include a close button, which can trigger the closing of the prompt card in response to the user's click operation.

[0225] The above is just one example of document collection.

[0226] Example 4: Image collection (e.g.) Figure 13 - Figure 14 (As shown)

[0227] Taking a photo gallery app as an example, the electronic device can detect a click on the app. In response to this click, the device can launch the app and display its main interface (the default interface displayed upon launch). This main interface can include thumbnails of several images. The electronic device can detect a click on any one of these thumbnails and, in response, display the corresponding image in full-screen mode.

[0228] like Figure 13 The display interface 601 shown in (a) is the same as the display interface in the above image. Figure 13 As shown in (a), the electronic device can detect a three-finger swipe down operation on the display interface 601. In response to the three-finger swipe down operation, the electronic device can enter a global favorites mode and display as shown in (a). Figure 13 The display interface 602 shown in (b) is shown in the figure.

[0229] Optionally, when switching from display interface 601 to display interface 602, an "opening door animation" can be displayed.

[0230] Compared to display interface 601, display interface 602, like display interface 602 in Embodiment 1, can include three areas. The first part 602a in the upper area is a status bar, as described in Embodiment 1, and will not be repeated here. The second part 602b in the middle area includes a thumbnail indicating the display interface 601 displayed when a three-finger swipe gesture is triggered; the content of the thumbnail is the same as that of display interface 601, but its size is smaller than that of display interface 601. The third part 602c in the bottom area displays multiple operation options; a detailed description of these operation options can be found in Embodiment 1, and will not be repeated here.

[0231] In addition, since the display interface 601 corresponds to the image collection scenario, the dedicated options displayed in the third part area are image collection options; the third part area can also display content extraction options, screenshot collection options in the general options, and annotation options, etc.

[0232] It should be noted that, Figure 13 The display interface 602 shown in (b) is only one display interface style provided by this application embodiment. This application also provides a variety of display interface styles, which will be introduced later and will not be repeated here.

[0233] refer to Figure 14 In the display interface 502 shown in (a), the electronic device can detect a click operation on the image collection option in the display interface 602; in response to the click operation, the display content corresponding to the thumbnail (i.e., the displayed image) will be collected into the global collection application. During this collection process, such as Figure 14 As shown in (b), the electronic device can first display a closing animation, switch from display interface 602 back to the original image display interface, and display card 603a on this interface. Card 603a may include a thumbnail of the image being collected. Optionally, a close button may also be included in the upper left corner of card 603a. In response to a click on the close button, the electronic device can terminate the document collection, and then card 603a disappears from display.

[0234] If, during the image collection process, no click is received on the close button in the upper left corner of card 603a within the preset time period, such as... Figure 14 As shown in (c) and (d) in the diagram, the card 603b can also move toward the bottom edge of the display interface 603 and gradually disappear.

[0235] Optionally, after card 603a disappears, such as Figure 14 As shown in (e), the electronic device can also display card 603b, with other content remaining unchanged. Card 603b serves to inform the user that the image has been successfully saved and provides a link to the global collection application, prompting the user to view the saved material within the global collection application.

[0236] In this embodiment, global collection is the default collection method for images; of course, images can also be collected in other applications, and the specific settings can be configured as needed. This embodiment does not limit this.

[0237] For example, the card 603b can display a text link such as "Go to global collection"; in response to a click on the text link, the electronic device can display a floating icon c1 for global collection; the floating icon c1 for global collection includes an icon indicating the document that was just collected.

[0238] Optionally, if no operation is received within a preset time period, card 603b may automatically disappear and not be displayed.

[0239] Optionally, after card 603a disappears, such as Figure 14 As shown in (e), the electronic device may also display a prompt card near the hidden icon a, which prompts the user to enter the global collection application and view the content collected by the global collection application by clicking the hidden icon a; the prompt card may also include a close button, which can trigger the closing of the prompt card in response to the user's click operation.

[0240] The above is just one example of image collection.

[0241] Example 5: Screenshot collection (e.g.) Figure 15 (As shown)

[0242] When a three-finger swipe gesture is received, the electronic device enters global favorites mode. Figure 6 Taking the display interface 302 shown in (b) as an example, if the electronic device detects a click operation on the screenshot favorites option, such as Figure 15 As shown in (a); in response to the click operation, the content displayed corresponding to the thumbnail (i.e., the webpage displayed on display interface 301) will be collected into the global collection application as a screenshot. During this collection process, as... Figure 15 As shown in (b), the electronic device can first display a door closing animation, then switch from display interface 302 back to the original webpage display interface, and display card 304a on this interface. Card 304a may include the screenshot being collected, which indicates a screenshot generated from the content displayed before the door opening animation. Optionally, a close button may also be included in the upper left corner of the screenshot. A click on the close button can terminate the collection of the screenshot, after which card 304a disappears from display.

[0243] If, during the screenshot collection process, no click is received on the close button in the upper left corner of card 304a within a preset time period, such as... Figure 15 As shown in (c) and (d), card 304a can move toward the bottom edge of display interface 303 and gradually disappear.

[0244] Optionally, after card 304a disappears, such as Figure 15 As shown in (e), the electronic device can also display card 304b, with all other content remaining unchanged. Card 304b is used to indicate that the screenshot has been successfully saved and provides a link to access the global favorites application.

[0245] In this embodiment, global collection is the default collection method for screenshots; of course, screenshots can also be collected in other applications, and the specific settings can be configured as needed. This embodiment does not limit this.

[0246] For example, the card 304b can display a text link such as "Go to global collection"; in response to a click on the text link, the electronic device can display a floating icon c1 for global collection; the floating icon c1 for global collection includes an icon indicating the screenshot content that was just collected.

[0247] Optionally, card 304b may automatically disappear and not be displayed if no operation is received within a preset time period.

[0248] Optionally, after card 304a disappears, such as Figure 15 As shown in (e), a hidden hemispherical icon 'a' for global collections can be displayed on the inner edge of the right side of the screen of the electronic device to provide an entry point to the global collections application. Optionally, when the hidden icon 'a' is first triggered to appear, the electronic device can also display a prompt card near the hidden icon 'a'. This prompt card prompts the user to enter the global collections application by clicking the hidden icon 'a' to view the content collected by the global collections application. The prompt card may also include a close button, which can close the prompt card in response to the user's click.

[0249] The above is just one example of how to save a screenshot.

[0250] Example 6: Long screenshot collection (e.g.) Figure 16 - Figure 17 (As shown)

[0251] Taking WeChat as an example, electronic devices can display the chat interface within WeChat. This chat interface can include thumbnails of multiple files received by the current electronic device. When the chat interface is swiped upwards, it can also display text, images, and other content.

[0252] like Figure 16 The display interface 701 shown in (a) is the chat interface described above. Figure 16 As shown in (a), the electronic device can detect a three-finger swipe down operation on the display interface 701. In response to the three-finger swipe down operation, the electronic device can enter a global favorites mode and display as shown in (a). Figure 16 The display interface 702 is shown in (b) of the diagram.

[0253] Optionally, when switching from display interface 701 to display interface 702, an "opening door animation" can be displayed.

[0254] Compared to display interface 701, display interface 702, like display interface 302 in Embodiment 1, can include three areas. The first part 702a in the upper area is a status bar, as described in Embodiment 1, and will not be repeated here. The second part 702b in the middle area includes a thumbnail indicating the display interface 701 displayed when a three-finger swipe gesture is triggered; the content of the thumbnail is the same as that of display interface 701, but its size is smaller than that of display interface 701. The third part 702c in the bottom area displays multiple operation options; a detailed description of these operation options can be found in Embodiment 1, and will not be repeated here.

[0255] Here, a triangle is displayed in the lower right corner of the Screenshot & Favorites option in the General options. This triangle can be used to switch between General options, such as switching the Screenshot & Favorites option to the Long Screenshot & Favorites option; or, this triangle can be used to trigger the display of a menu card that includes multiple General options. Figure 16 As shown in (b), the electronic device can detect a click on the triangle in the lower right corner of the screenshot favorites option; Figure 16 As shown in (c), in response to the click operation, a menu card 702d can be displayed in the display interface 702, which may include two menu options: "Screenshot Collection" and "Long Screenshot Collection".

[0256] Alternatively, as one possible implementation, such as Figure 17 As shown in (a), the electronic device can detect a click operation on the "Screenshot Collection" option in the menu card 702d; in response to the click operation, the screenshot collection option displayed in the third part area can be switched to the screenshot collection option, while other content remains unchanged; subsequently, in response to a click operation on the screenshot collection option, the electronic device can perform the screenshot function.

[0257] Alternatively, as another possible implementation, such as Figure 17 As shown in (a), the electronic device can detect a click operation on "Screenshot Collection" in menu card 702d; in response to this click operation, as... Figure 17 As shown in (b), the electronic device can directly begin capturing long images.

[0258] See Figure 17In the display interface 703 shown in (b), when taking a long screenshot, the electronic device can first display a closing door animation, switch from display interface 702 to the original chat interface, and display a prompt bar 703a at the top area of ​​the chat interface. This prompt bar 703a can include prompt text, such as "Taking a long screenshot, click the scrolling area to complete the screenshot"; the scrolling area can indicate the area of ​​the chat interface displayed other than the prompt bar. Figure 17 As shown in (c), the electronic device can detect a click operation on the scrolling area; in response to the click operation, a screenshot is taken.

[0259] After completing the long screenshot, as follows Figure 17 As shown in (d), the prompt bar 703a can be switched to a thumbnail 703b, while other content remains unchanged. The thumbnail 703b may include a thumbnail of the long image being collected. Optionally, a close button may also be included in the upper left corner of the card 703b. In response to a click on the close button, the electronic device can terminate the collection of the long image, and then the card 703b disappears from display.

[0260] If, during the long image collection process, no click is received on the close button in the upper left corner of card 703b within the preset time period, such as Figure 17 As shown in (e), the card 703b can also move toward the bottom edge of the display interface 703 and gradually disappear.

[0261] Optionally, after card 703b disappears, such as Figure 17 As shown in (f), the electronic device can also display card 703c, with other content remaining unchanged. Card 703c is used to inform the user that the long image has been successfully saved and provides a link to the global collection application, prompting the user to view the saved material in the global collection application.

[0262] In this embodiment, global collection is the default collection method for long screenshots; of course, long screenshots can also be collected in other applications, and the specific settings can be configured as needed. This embodiment does not limit this.

[0263] For example, the card 703c can display a text link such as "Go to global collection"; in response to a click on the text link, the electronic device can display a floating icon c1 for global collection; the floating icon c1 for global collection includes an icon indicating the document that was just collected.

[0264] Optionally, if no operation is received within a preset time period, the card 703c can automatically disappear and not be displayed.

[0265] Optionally, after card 703b disappears, such as Figure 17As shown in (e), the electronic device may also display a prompt card near the hidden icon a, which prompts the user to enter the global collection application and view the content collected by the global collection application by clicking the hidden icon a; the prompt card may also include a close button, which can trigger the closing of the prompt card in response to the user's click operation.

[0266] The above is just one example of how to save a long screenshot.

[0267] Example 7: Content extraction and collection (e.g.) Figure 18 - Figure 20 (As shown)

[0268] Taking news apps as an example, electronic devices can detect a three-finger swipe down on the display screen corresponding to a specific news item. In response to this three-finger swipe down, the electronic device can trigger a global favorites mode, where the displayed content can be saved.

[0269] like Figure 18 The display interface 801 shown in (a) is a webpage of a news article in a news application. Figure 18 As shown in (a), the electronic device can detect a three-finger swipe down operation on the display interface 801. In response to the three-finger swipe down operation, the electronic device can enter a global favorites mode and display as shown in (a). Figure 18 The display interface 802 is shown in (b) of the diagram.

[0270] Optionally, when switching from display interface 801 to display interface 802, an "opening door animation" can be displayed.

[0271] Compared to display interface 801, display interface 802, like display interface 302 in Embodiment 1, can include three areas. The first part 802a in the upper area is a status bar, as described in Embodiment 1, and will not be repeated here. The second part 802b in the middle area includes a thumbnail indicating the display interface 801 displayed when a three-finger swipe gesture is triggered; the content of the thumbnail is the same as that of display interface 801, but its size is smaller than that of display interface 801. The third part 802c in the bottom area displays multiple operation options; a detailed description of these operation options can be found in Embodiment 1, and will not be repeated here.

[0272] In addition, since the web page collection scenario corresponds to the display interface 801, the dedicated options displayed in the third part area are web page collection options; the third part area can also display content extraction options, screenshot collection options and annotation options in the general options, etc.

[0273] It should be noted that, Figure 18 The display interface 802 shown in (b) is only one display interface style provided in this application embodiment. This application also provides a variety of display interface styles, which will be introduced later and will not be repeated here.

[0274] See Figure 19 In the display interface 802 shown in (a), the electronic device can detect a click operation on the content extraction option in the display interface 802; in response to the click operation, the display content corresponding to the thumbnail (i.e. the content in the display interface 801) will be extracted and highlighted.

[0275] For example, such as Figure 19 The display interface 803 shown in (b) highlights content compared to display interface 801, such as adding a white background around text and images. Based on the highlighted content, users can subsequently select the content they want to collect. Additionally, display interface 803 may include two buttons: a favorite button 803a and an exit button 803b. The favorite button 803a is used to collect the user's selected content; the exit button 803b is used to trigger an exit from the global favorites mode.

[0276] Optionally, when switching from display interface 802 to display interface 803, a door closing animation can be displayed.

[0277] It should be understood that, Figure 19 In the display interface 803 shown in (b), since the user has not made any selection for the displayed content, the favorite button 803a is grayed out and unavailable, and cannot respond to the user's click operation; however, the exit button 803b is available and can receive click operations; in response to the click operation, the favorite can be terminated and the global favorite mode can be exited.

[0278] based on Figure 19 As shown in (c) of the display interface 803, the electronic device can detect a selection operation on a segment of content in the display interface 804 (such as a long press followed by a swipe to the left or right on the left or right handlebar); Figure 19 As shown in (c), in response to the selection operation, part of the highlighted content can be selected. For ease of description, this application may record the selected part of the content as target content 803c (e.g., Figure 19 (The content with a gray background in (c)).

[0279] Optionally, the content included in the target content 803c may include text and / or images.

[0280] Optionally, the target content 803c includes content arranged continuously between the left and right handles; or, the target content 803c includes text content arranged continuously between the left and right handles, without supporting skipping selection; for images, users need to click to select.

[0281] It should be understood that, Figure 19 In the display interface 803 shown in (c), since the user has selected the display content, the favorite button 803 switches from an unavailable state to an available state.

[0282] After selecting a portion of the highlighted content, the electronic device can detect a click on the favorite button 803a; such as Figure 19 As shown in (d), in response to this click, the target content 803c will be collected into the global collection application. During this collection process, as... Figure 19 As shown in (e), the target content 803c can be switched back to its original highlighted state, the favorite button 803a and the exit button 803b are removed, and a card 803d is displayed on the interface. The card 803d may include a thumbnail of the target content being collected.

[0283] Optionally, a close button may also be included in the upper left corner of card 803d. In response to a click on the close button, the bookmarking of the webpage can be terminated, and then card 803d disappears from display.

[0284] Optionally, the card 803d can move toward the bottom edge of the display interface 803 and gradually disappear.

[0285] If, during the collection of target content 803c, no click is received on the close button in the upper left corner of card 803d within the preset time period, then... Figure 19 As shown in (f), card 803d can be switched between displaying as a favorite button 803a and an exit button 803b, while other content remains unchanged. At this time, the favorite button 803a is grayed out. Figure 19 The state shown in (b) is the same.

[0286] based on Figure 19 The display interface 803 shown in (f) can also be accessed by the user according to the above method if they need to save other content. Figure 19 (c) to Figure 19 The process shown in (e) continues to collect, that is, after entering the content extraction function, the user can select target content multiple times, and each time the collect button 803a is clicked, the selected target content will be collected into the global collection application, and multiple target contents can be collected in a continuous manner. This application embodiment does not limit this in any way.

[0287] In this embodiment, global collection is the default collection method for extracted content; of course, extracted content can also be collected in other applications, and the specific settings can be configured as needed. This embodiment does not limit this.

[0288] based on Figure 19 As shown in (f) of the display interface 803, if the collection is complete, the electronic device can detect a click operation on the exit button, such as... Figure 20 As shown in (a); in response to a click on the exit button 803b, the global favorites mode exits, and the interface can switch back to the original webpage display interface (i.e., display interface 801), as shown in (a). Figure 20 As shown in (b) of the diagram.

[0289] Optionally, such as Figure 20 As shown in (b), the electronic device can display card 803e on display interface 801, while other content remains unchanged. Card 803e is used to indicate that the content retrieved by the user has been successfully collected, and provides a link to the global collection application to prompt the user to view the collected materials in the global collection application.

[0290] For example, the card 803e can display a text link such as "Go to global collection"; in response to a click on the text link, the electronic device can display a floating icon c1 for global collection, which includes an icon indicating the video excerpt that was just collected.

[0291] Optionally, after the favorite button 803a and the exit button 803b disappear, such as Figure 20 As shown in (b), a hidden hemispherical icon 'a' for global collections can also be displayed on the inner edge of the right side of the screen of the electronic device, providing an entry point to the global collections application. Optionally, when the hidden icon 'a' is first triggered to appear, the electronic device can also display a prompt card near the hidden icon 'a', which prompts the user to enter the global collections application and view the content collected by the global collections application by clicking the hidden icon 'a'; the prompt card may also include a close button, which can trigger the closing of the prompt card in response to the user's click operation.

[0292] Optionally, if no operation is received within a preset time period, card 803e can automatically disappear and not be displayed.

[0293] Optionally, after the content is successfully extracted and collected, the global collection application can continue to be displayed on its interface as a hidden icon 'a', indicating to the user that the global collection application is still running and can collect any material to the global collection at any time.

[0294] The above is just one example of extracting content for collection.

[0295] Alternatively, as one possible implementation, such as Figure 19 In the display interface 802 shown in (a), the electronic device can detect a click operation on the content extraction option in the display interface 802; in response to the click operation, the display content corresponding to the thumbnail (i.e., the content in the display interface 801) will be extracted, exploded into word segments, and then displayed. For example, a white background is added independently to the bottom of each text and the bottom of each image. Based on the content displayed in the form of word segments, the user can subsequently select the content to be collected. For example, by smearing and / or clicking on the desired block content. Other content is similar to the example above and will not be described again here.

[0296] Alternatively, as another possible implementation, such as Figure 19 In the display interface 802 shown in (a), the electronic device can detect a click operation on the content extraction option in the display interface 802; in response to the click operation, the display content corresponding to the thumbnail (i.e., the content in the display interface 801) will be extracted and then structured and tiled on a new layer. Figure 21 As shown in the example. Based on the structured, tiled content extraction, users can subsequently select the content they want to collect, or save all selected content with a single click. Other aspects are similar to the example above and will not be repeated here.

[0297] The above content is a description of the seven collection scenarios provided in the embodiments of this application.

[0298] In this embodiment, by combining with a global collection application, materials from different sources and of different types can be collected, expanding the collection scenarios and unifying the collection method to a three-finger swipe down. When triggered, the collection method provided by this application can accurately determine how the user wants the content to be retained and provide corresponding operation options to support the retention of materials. In addition, this unified collection method has no learning cost for users, making it convenient for users to efficiently collect materials in any scenario and collect all materials into the global collection application.

[0299] Part Two:

[0300] by Figure 6 Taking the display interface 301 shown in (a) as an example, this interface is the display interface corresponding to a certain webpage. Figure 6 As shown in (a), the electronic device can detect a three-finger swipe down operation on the display interface 301. In response to the three-finger swipe down operation, the electronic device can enter a global favorites mode, and the displayed interface can be as follows: Figure 22 Any one of them.

[0301] Example 1, such as Figure 22 As shown in (a), the display interface 302 includes three areas: the first part 302a in the upper area is the status bar; the second part 302b in the middle area may include thumbnails; and the third part 302c in the bottom area is used to display multiple operation options. For a detailed description of the status bar, thumbnails, and operation options, please refer to Embodiment 1, which will not be repeated here.

[0302] Optionally, when displayed, the operation options in Part 302c are displayed from left to right in the order of dedicated options, content retrieval options, and general options.

[0303] Compared to Figure 6 Regarding the third part shown in (b), Figure 22 The third part shown in (a) may also include a collection space icon and icon name to indicate all materials collected in the global collection application, for example, the collection space icon is Figure 22 The icon M shown in (a) is an example. Optionally, the collection space icon M can be composed of multiple individual icons of collected materials. Optionally, the icon name can be, for example, "My Collection" by default.

[0304] Optionally, the collection space icon, dedicated options, content extraction options, and general options can be displayed in order from left to right or from right to left.

[0305] Example 2, such as Figure 22 As shown in (b), the display interface 302 includes three areas: the first part 302a in the upper area is the status bar; the second part 302b in the middle area may include thumbnails; and the third part 302c in the bottom area is used to display multiple operation options. For a detailed description of the status bar, thumbnails, and operation options, please refer to Embodiment 1; further details will not be provided here.

[0306] Compared to Figure 6 Regarding the third part shown in (b), Figure 22 The third part shown in (b) can be divided into two halves. The left half can display multiple operation options, and the right half can display the collection space and its name. This collection space can include multiple material icons, which indicate the materials collected by the global collection application. By default, the material icons corresponding to the three most recently collected materials can be displayed. The space name can be, for example, "Magic Collection Space". Optionally, the three material icons can be displayed flat, or they can be displayed in a semi-overlapping manner; this embodiment of the application does not limit this.

[0307] Optionally, when displayed, the operation options in the left half area are displayed from left to right in the order of dedicated options and content extraction options.

[0308] Optionally, the left and right halves of the region can be swapped.

[0309] Example 3, such as Figure 22 As shown in (c), the display interface 302 may include four areas. The first part 302a, located in the upper area, is the status bar; the second part 302b, located in the middle area, may include thumbnails; and the third part 302c is used to display multiple operation options. For a detailed description of the status bar, thumbnails, and operation options, please refer to Embodiment 1, which will not be repeated here.

[0310] Compared to Figure 6 Regarding the interface shown in (b), Figure 22 Part 302d, shown in (c), can display a collection space and its name. This collection space can include thumbnails of multiple materials collected by the global collection application. For example, by default, it can display the thumbnails corresponding to the four most recently collected materials, and these four thumbnails are tiled. The name of this space can be, for example, "Magic Collection Space".

[0311] Optionally, the third part 302c is located at the bottom, and the fourth part 302d can be located between the first part 302a and the second part 302b, as shown below. Figure 22 As shown in (c), or, the fourth part 302d is located at the bottom, while the third part 302c can be located between the first part 302a and the second part 302b, as shown in (c). Figure 22 As shown in (d) in the figure.

[0312] Optionally, when displayed, the operation options in Part 302c are displayed from left to right in the order of dedicated options, content retrieval options, and general options.

[0313] Example 4, Figure 23 (a) and Figure 6 As in (a), in response to the three-finger swipe operation, the electronic device can display as shown in the image. Figure 23 The display interface 302 shown in (b) may include four areas: the first part 302a in the upper area is the status bar; the third part 302c in the middle area is used to display multiple operation options; and the second part 302b in the bottom area may include thumbnails. For a detailed description of the status bar, thumbnails, and operation options, please refer to Embodiment 1, which will not be repeated here.

[0314] Compared to Figure 6 Regarding the interface shown in (b), Figure 23 Part 302d, shown in (b) above, can display a collection space, a close button, and a settings button, etc. The collection space can include thumbnails of multiple materials that have been collected into the global collection application. For example, by default, it can display thumbnails corresponding to the 6 most recently collected materials, and these 6 thumbnails are tiled.

[0315] Optionally, the fourth part can be displayed in the hot zone on the left, such as... Figure 23 As shown in (b) above, or, alternatively, in the hot zone on the right.

[0316] Optionally, when displayed, the operation options in Part 302c are displayed from left to right in the order of dedicated options, content retrieval options, and general options.

[0317] It should be understood that the collection space is equivalent to the floating state of the global collection, and the content included in the floating state is the same.

[0318] Alternatively, the thumbnails in the four examples above can be displayed in a tiled format.

[0319] Optionally, the second part 302b in the four examples above can also be referred to as the original application display area, used to display the content displayed before the three-finger swipe operation triggers the display interface 302, and the content displayed in the second part 302b can be switched under the user's operation. For example, in response to the up and down swipe operation on the original display content of the second part 302b, the display content can be switched.

[0320] It should be understood that, such as Figure 22 As shown in (c) and (d), the third part 302c is the operation area, and the fourth part 302d is the material display area.

[0321] 1. Collection Method One

[0322] Referring to Example 4 above, Figure 24 In the display interface 302 shown in (a), the electronic device can detect a click operation on the web page favorites option in the display interface 302; in response to the click operation, the display content corresponding to the thumbnail (i.e. the web page displayed in the display interface 301) will be collected into the global favorites application.

[0323] During this collection process, such as Figure 24 As shown in (b), the webpage content corresponding to the thumbnail will gradually shrink and dynamically move from the display area on the right to the bookmark space on the left.

[0324] After collection is complete, such as Figure 24As shown in (c), the collection space on the left will include icons of the web page content that was just collected. The icons corresponding to the previously collected materials will move towards the bottom edge of the electronic device in sequence.

[0325] It should be noted that the above example only uses bookmarking web pages as an example, based on... Figure 23 The display style shown in (b) in this embodiment can also collect and extract videos, documents, pictures, screenshots, long screenshots, and extracted content, as described in the previous embodiments 2 to 7, and will not be repeated here.

[0326] 2. Collection Method Two

[0327] Referring to Example 4 above, Figure 25 In the display interface 302 shown in (a), the electronic device can detect user operations on images included in the interface display area of ​​the display interface 302, and in response to the user operations, the images will be collected into the global collection application.

[0328] Optionally, the above user operation may include long press and drag operations, or the user operation may be a throwing operation.

[0329] It should be understood that long press and drag are continuous operations. During long press and drag, the user's finger will not be lifted.

[0330] Taking user actions, including long press and drag, as an example, during the data collection process, such as... Figure 25 As shown in (b), in response to a long press operation, the image is selected, and the electronic device can display a thumbnail of the image at the location where the user performed the long press operation; next, the user can move the image by dragging the thumbnail; in response to the drag operation on the image thumbnail, the image thumbnail can be moved from the display area on the right to the collection space on the left. Optionally, as... Figure 25 As shown in (b) and (c), the image thumbnails gradually shrink as the user moves from the display area on the right to the collection space on the left.

[0331] After collection is complete, such as Figure 25 As shown in (d), the collection space on the left includes icons of the images that have just been collected. The icons corresponding to the previously collected materials will move sequentially toward the bottom edge of the electronic device.

[0332] Optionally, the above example only illustrates the case where the interface display area includes images. Optionally, the interface display area may also include documents, videos, screenshots, long-screen images, etc.

[0333] 3. Method 1 and Method 2 for saving an app once and then switching applications to save it again.

[0334] Optionally, as a possible approach, after a user has saved an item once, if they wish to switch applications to save other materials again, in... Figure 26 Based on the display interface 302 shown in (a), the user can slide from the bottom edge of the electronic device toward the center of the display screen; in response to this sliding operation, the electronic device can switch from the display interface 302 to the desktop 1001, as shown in (a). Figure 26 As shown in (b) of the diagram.

[0335] Optionally, the sliding operation may also include sliding from the left edge of the electronic device toward the center, or sliding from the right edge of the electronic device toward the center; this application embodiment is not limited to this.

[0336] When switched to desktop 1001, the electronic device can detect user actions on the gallery application. For example, if a click is detected on the gallery app, the electronic device can display the gallery application's main interface in response. If a click is detected on any image thumbnail on the main interface, the electronic device can display the corresponding image in full-screen mode. Figure 26 The display interface 1002 is shown in (c) in the figure.

[0337] When an electronic device displays an image, if a user wants to save the image, they can use a three-finger swipe down to re-enter the global save mode.

[0338] For example, such as Figure 26 As shown in (c), the electronic device can detect a three-finger swipe down operation on the display interface 1002. In response to this three-finger swipe down operation, the electronic device can enter a global favorites mode and display as shown in (c). Figure 26 The display interface 1003 is shown in (d) in the figure.

[0339] The style of the display interface 1003 can be referred to the description in the aforementioned Exemplary Example 4, and will not be repeated here.

[0340] In addition, since the display interface 1003 corresponds to the image collection scenario, the dedicated options displayed in the third part are image collection options; the third part can also display content extraction options, screenshot collection options in the general options, etc.

[0341] The electronic device can detect a click on the image collection option in the display interface 1003; in response to the click, the image will be collected into the global collection application. This collection process can be referred to the previous description of collection method one, and will not be repeated here.

[0342] Alternatively, as another possible approach, after a user has made a collection, if the user wishes to switch applications to collect other materials again, the user can operate on the interface displayed in the original application display area within a local area of ​​the screen, i.e., the original application display area, to switch applications within the original application display area.

[0343] For example, in Figure 26 Based on the display interface 302 shown in (a), the user clicks the close button included in the upper left corner of the interface in the original application display area, or slides the interface from the bottom edge to the center in the original application display area; in response to the click or slide operation, the interface in the original application display area can be switched to the desktop.

[0344] When the interface in the original application display area switches to the desktop, the electronic device can detect the user's click operation on the Gallery application; in response to the click operation, the electronic device can display the main interface of the Gallery application in the original application display area; when a click operation is detected on any image thumbnail in the main interface, in response to the click operation, the electronic device can display the image corresponding to the thumbnail in the original application display area.

[0345] When an electronic device switches to display a certain image in the original application display area, since the type of content displayed in the original application display area has changed, the electronic device can indicate in real time that the options displayed in the operation area should also change accordingly, such as switching the dedicated option from web page collection option to image collection option.

[0346] Then, as Figure 26 As shown in (d), in response to a click on the image collection option, the images displayed in the original application display area can be collected into the global collection application.

[0347] It should be understood that in this collection method, after the three-finger swipe operation triggers the display to switch to a partitioned display state, the electronic device is essentially in a global collection mode. Without exiting the partitioned display state, it can respond to multiple user operations in the original application display area to switch applications and collect materials a second time.

[0348] For both methods described above, after the second collection is completed, if the user wishes to switch applications to collect other materials, they can do so using either of the methods described above. If the user wishes to exit the global collection mode, they can click the close button in the upper left corner of the display interface 1003; in response to clicking the close button, the electronic device can exit the global collection mode and switch back to the display interface before entering the global collection mode.

[0349] For example, after the second image collection, if the user wants to exit the global collection mode, they can click the close button in the upper left corner of the display interface 1003. Figure 26 As shown in (e); in response to a click on the close button, the electronic device can exit global favorites mode and switch back to the display interface 1002 before entering global favorites mode, as shown in Figure (e). Figure 26 As shown in (f) in the figure.

[0350] 4. Method three: Save to favorites once, then switch applications and save again.

[0351] After a user has saved an item once, if they wish to switch applications to save other items again, they need to exit the global save mode first. For example, the user can click the close button. In response to the click of the close button, the electronic device exits the global save mode and switches back to the display interface before entering the global save mode.

[0352] For example, after the first time a webpage is bookmarked, in Figure 27 Based on the display interface 302 shown in (a), the electronic device can detect the user's click operation on the close button; in response to the click operation on the close button, the electronic device can exit the global favorites mode and switch back to the display interface 301 before entering the global favorites mode.

[0353] Next, the electronic device can respond to the user's actions and continue to save the item a second time. For example, in Figure 27 Based on the display interface 301 shown in (b), the user can slide from the bottom edge towards the center in the bottom display area of ​​the electronic device; in response to this sliding operation, the electronic device can switch from the display interface 301 to the desktop 1001, as shown in (b). Figure 27 As shown in (c) in the figure.

[0354] Optionally, the sliding operation may also include sliding from the left edge of the electronic device toward the center, or sliding from the right edge of the electronic device toward the center; this application embodiment is not limited to this.

[0355] When switched to desktop 1001, the electronic device can detect user actions on the gallery application. For example, if a click is detected on the gallery app, the electronic device can display the gallery application's main interface in response; if a click is detected on any image thumbnail on the main interface, the electronic device can display the image corresponding to that thumbnail in full-screen mode in response to that click. Figure 27 The display interface 1002 is shown in (d) in the figure.

[0356] When an electronic device displays an image, if a user wants to save the image, they can use a three-finger swipe down to re-enter the global save mode.

[0357] For example, such as Figure 27 As shown in (d), the electronic device can detect a three-finger swipe down operation on the display interface 1002. In response to this three-finger swipe down operation, the electronic device can enter a global favorites mode and display as shown in (d). Figure 27 The display interface 1003 is shown in (e) in the figure.

[0358] The style of the display interface 1003 can be referred to the description in the aforementioned Exemplary Example 4, and will not be repeated here.

[0359] In addition, since the display interface 1003 corresponds to the image collection scenario, the dedicated options displayed in the third area are image collection options; the third area can also display content extraction options, screenshot collection options in the general options, etc.

[0360] The electronic device can detect a click on the image collection option in the display interface 1003; in response to the click, the image will be collected into the global collection application. This collection process can be referred to the previous description of collection method one, and will not be repeated here.

[0361] After the second collection, if the user wishes to switch applications to collect other materials, they can do so in the same way described above. If the user wishes to exit global collection mode, they can click the close button in the upper left corner of the display interface 1003; in response to clicking the close button, the electronic device can exit global collection mode and switch back to the display interface before entering global collection mode.

[0362] For example, after the second image collection, if the user wants to exit the global collection mode, they can click the close button in the upper left corner of the display interface 1003; in response to the click operation of the close button, the electronic device can exit the global collection mode and switch back to the display interface 1002 before entering the global collection mode.

[0363] 5. Distribute saved materials

[0364] Taking note-taking apps as an example, when an electronic device displays a note-taking app, if a user needs to add saved materials to the notes, they can use a three-finger swipe down to trigger the global save mode, and then distribute the materials in the global save mode.

[0365] For example, such as Figure 28The display interface 1101 shown in (a) is the display interface corresponding to the note-taking application. The electronic device can detect a three-finger swipe down on the display interface 1101; in response to this three-finger swipe down, the electronic device can enter the global favorites mode, displaying, as shown in (a). Figure 28 The display interface 1102 shown in (b) is the same as the display interface after the image is collected a second time. Figure 26 (e) or Figure 27 The display interface shown in (f) is the same as that in 1003.

[0366] based on Figure 28 In the display interface 1102 shown in (b), the electronic device can detect long press and drag operations on the image icon in the collection space in the hot zone on the left side of the display interface 1102; in response to the long press and drag operation, the image will be distributed to the note application indicated by the thumbnail on the right.

[0367] It should be understood that the long press and drag operations here are non-continuous operations; during the long press and drag operation, the user's pressed finger can be lifted.

[0368] Optionally, after a long press and before a drag operation, multiple clicks can be made on the materials in the collection space to select multiple materials; subsequently, multiple materials can be distributed at once when dragging.

[0369] For example, such as Figure 28 As shown in (b), in response to a long press on an image icon in the collection space, the image icon is selected. The selected state indicates that a semi-transparent layer and a selection mark have been added above the icon. The selection mark includes, for example, a circular area and a checkmark within the circular area.

[0370] based on Figure 28 In the display interface 1102 shown in (c), if the user also wants to distribute the 6th image at the bottom of the collection space, they can select the icon by clicking it. Figure 28 As shown in (c), the electronic device can detect a click on the sixth image icon located at the bottom of the collection space, and in response to the click, the image icon can be selected.

[0371] Next, users can drag and move the two selected icons to distribute the materials; in response to dragging the image icon, the image icon can be moved from the collection space on the left to the display area on the right. Optionally, as... Figure 28As shown in (d), during the movement from the left-hand collection area to the right-hand display area, multiple individual image icons can switch from a tiled arrangement to a cascading arrangement. Additionally, the number of icons and addable markers (such as plus signs) can be displayed above the cascading icons. These markers provide feedback on where additional material can be added during the dragging process.

[0372] Optionally, as the icons move from the left-hand collection space to the right-hand display area, the stacked icons gradually increase in size.

[0373] After moving to a position in the right-hand display area where content can be added, the user can lift their finger to release the content; in response to lifting the finger, the electronic device can add the dragged content to the right-hand display area, such as... Figure 28 As shown in (e) in the diagram.

[0374] After distribution is complete, such as Figure 28 As shown in (e), the material that was just dragged and dropped still exists in the collection space, just like it did before distribution.

[0375] After distribution is complete, if a user wants to exit the global collection mode, they can click the close button in the upper left corner of the display interface 1102, such as... Figure 28 As shown in (e); in response to a click on the close button, the electronic device can exit global favorites mode and switch back to the display interface 1101 before entering global favorites mode, i.e., the interface corresponding to the note-taking application, as shown in Figure (e). Figure 28 As shown in (f) in the figure.

[0376] It should be understood that since image materials were distributed to this note in global favorites mode, the content displayed on the note application interface after returning to the note application interface should include the distributed image materials and should be consistent with... Figure 28 The content of the right-hand display area corresponding to (e) is the same.

[0377] 6. Preview

[0378] by Figure 25 Taking the display interface 1003 shown in (d) as an example, after entering the global collection mode and completing the image collection, if the user wants to preview the images they just collected, they can directly click the image icon displayed in the left area, such as... Figure 29 As shown in (a); in response to a click on an image icon, the electronic device can display a preview interface of the material corresponding to that image icon, such as... Figure 29 As shown in (b) of the diagram.

[0379] 7. Share

[0380] Optionally, with Figure 29For example, in (b) of the above, when displaying the preview interface of the image, the preview interface may also include a share button and a delete button. The share button is used to trigger the sharing of the material to other devices or applications, and the delete button is used to trigger the deletion of the material in the global collection.

[0381] See Figure 30 As shown in (a), the electronic device can detect a click on the share button; in response to the click, the electronic device can display a share card on the preview screen, as shown in (a). Figure 30 As shown in (b) of the diagram.

[0382] Optionally, such as Figure 30 As shown in (b), the preview interface includes a sharing card that can be divided into four display areas from top to bottom, namely the first display area 30a, the second display area 30b, the third display area 30c, and the fourth display area 30d.

[0383] The first display area 30a can show the icon of the shared material, the name of the material, the size of the material, and the format of the material. Here, a small triangle can also be displayed next to the material format, which can be called a drop-down menu control. This is used to respond to user triggers, displaying a drop-down menu and providing more image format options for the user to choose from. In other words, the format of the material can be switched by the user's selection.

[0384] The second display area 30b may include device icons for multiple devices that have established a trusted connection with this device; the connection method is not limited in this application. These multiple device icons can be used to trigger the sending of media to the corresponding device. For example, these multiple device icons may include "User 1's X30," and subsequently, in response to a click operation on this device icon, the electronic device can send media to the device indicated by "User 1's X30."

[0385] The third display area 30c may include multiple application icons, which can be used to trigger sharing of materials to the corresponding applications. For example, these application icons may include browsers, contacts, email, notes, and photo galleries. Subsequently, in response to a click on the notes application icon, the electronic device can send the materials to the notes application.

[0386] The fourth display area 30d can include two options: "Save" and "Print". "Save" allows you to store the footage on this device without sharing it. "Print" sends the footage to a connected printer for printing.

[0387] The above is just one example of a sharing method.

[0388] In this embodiment, after entering the global collection mode via a unified gesture operation, the display area and operation area for collected materials can be combined into one on the display interface. This interface layout differs from existing technologies and is more convenient for users. The combined display and operation areas enable not only material collection but also distribution and previewing, providing more functionality. Furthermore, when a user triggers entry into the global collection mode, the operation area can accurately provide corresponding operation options based on the user's desired content retention method to support material retention.

[0389] Compared to existing technologies, the three-finger swipe gesture in existing technologies typically only corresponds to web pages and video clips, and only collects the material to the note-taking application when it is determined to be either of these two types of material, with each three-finger swipe gesture collecting the material only once. In contrast, the three-finger swipe gesture in this application is essentially a trigger gesture for entering a global collection mode. Entering global collection mode allows for the collection of materials from multiple sources and of multiple types, as well as the collection of multiple materials from the same application or different applications. Furthermore, it enables functions such as material distribution, preview, and sharing. The definition of the three-finger swipe gesture in the embodiments of this application is broader.

[0390] Furthermore, the global collection provided in this application is completely different from the processing logic of the prior art. The prior art is equivalent to processing on the side of the application where the collected materials are located, while this application can judge the displayed content when the user triggers global collection and provide corresponding retention methods and auxiliary operation options, providing users with more operation possibilities and more processing possibilities for the materials in the collection process. It is equivalent to switching from the side of the application where the collected materials are located to the side of the global collection application used to collect materials for operation and processing.

[0391] Figure 31 This is an exemplary flowchart of a material processing method provided in an embodiment of this application.

[0392] In some possible cases, exemplary processes involved in the processing of materials by electronic devices may be referred to in the following description of steps S3101-S3107.

[0393] S3101, Full-screen display of the first interface of the first application, the first interface including the first initial material.

[0394] It is understandable that when the first interface of the first application is displayed in full screen, the first interface may not include the status bar.

[0395] S3102. In response to the first target operation, the display screen is in a partitioned display state. The partitioned display state means that the display screen is divided into an original application display area, a material display area, and an operation area. The original application display area includes a first interface, the operation area includes a first option, and the material display area includes a first material icon. The first material icon is used to indicate the material that has been collected into the target application.

[0396] It is understandable that the target application is the global collection application mentioned above.

[0397] It is understandable that the first objective operation is the same as the second objective operation.

[0398] For example, the first target operation and the second target operation can be the three-finger swipe operation mentioned above.

[0399] It is understandable that the first, second, and third operations can be click operations.

[0400] In one possible implementation, the first interface can indicate Figure 23 The display interface 301 shown in (a) indicates the partition display status. Figure 22 As shown in (c) and (d), Figure 23 The display interface 302 shown in (b) is divided into the second part 602b (original application display area), the third part 302c (operation area), and the fourth part 302d (material display area).

[0401] In one possible implementation, the first interface can indicate Figure 6 The display interface 301 shown in (a) indicates the partition display status. Figure 6 The display interface 302 shown in (b) has the original application display area as the second part 302b and the operation area as the third part 302c. The first initial material is a webpage, so the corresponding first option is the webpage favorites option.

[0402] In one possible implementation, the first interface can indicate Figure 11 The display interface 501 shown in (a) indicates the partition display status. Figure 11 The display interface 502 shown in (b) has the original application display area as the second part 502b and the operation area as the third part 502c. The first initial material is a document type, so the corresponding first option is the document collection option.

[0403] In one possible implementation, the first interface can indicate Figure 13 The display interface 601 shown in (a) can indicate the partition display status. Figure 13The display interface 602 shown in (b) has the original application display area as the second part 602b and the operation area as the third part 602c. The first initial material is an image, so the corresponding first option is the image collection option.

[0404] S3103. In response to the first operation for the first option, the first initial material is collected into the target application, and a second material icon is added to the material display area, the second material icon corresponding to the first initial material.

[0405] S3104. After exiting the partition display state, the second interface of the second application is displayed in full screen. The second interface includes the second initial material, and the type of the second initial material is different from that of the first initial material.

[0406] It is understandable that when the second interface of the second application is displayed in full screen, the second interface may not include the status bar.

[0407] S3105. In response to the second target operation, the display screen is in a partitioned display state, wherein the original application display area includes the second interface, the material display area includes the first material icon and the second material icon, and the first option in the operation area is switched to the second option, and the first option is different from the second option.

[0408] As you can understand, the first option corresponds to the type of the first initial material, and the second option corresponds to the type of the second initial material. When the types of materials are different, the first option will be different.

[0409] S3106. In response to the second operation for the second option, the second initial material is collected into the target application, and a third material icon is added to the material display area, the third material icon corresponding to the second initial material.

[0410] The process of collecting the first and second initial materials can indicate... Figure 8 , Figure 24 The process of saving web pages shown Figure 12 The document collection process shown Figure 14 Any two of the following image collection processes are shown.

[0411] S3107. In response to a third operation on any material icon, switch from partition display state to material preview interface, the material preview interface corresponding to the material indicated by the material icon.

[0412] The material preview process can indicate Figure 29 The preview process shown.

[0413] In this embodiment of the application, for the collected materials, a preview can also be directly triggered by the material icon shown in the material display area in the partitioned display state.

[0414] In this embodiment, a unified target operation can trigger the display screen to display in a partitioned state, indicating entry into the global collection mode. This operation is simple and efficient, allowing for the collection of materials from different sources and of different types. Furthermore, upon entering the partitioned display state, the system can accurately determine the user's desired content retention method and provide corresponding operation options to support material retention. In the partitioned display state, the original application display area before entering the global collection mode, the new operation area, and the material display area are combined into one display, facilitating user viewing and operation and expanding operational functionality. Additionally, all materials are collected into the global collection application.

[0415] The apparatus involved in the embodiments of this application is described below.

[0416] Figure 32 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0417] The electronic device may include a processor 110, an external memory interface 120, an internal memory 121, an audio module 130, a speaker 130A, a receiver 130B, a microphone 130C, a headphone jack 130D, a display screen 140, a camera 150, and a touch sensor 160.

[0418] The structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. The interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a limitation on the structure of the electronic device.

[0419] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Processor 110 may also include memory for storing instructions and data.

[0420] Electronic devices utilize GPUs, displays 140, and application processors to achieve display functions.

[0421] The GPU is a microprocessor for image processing, connected to the display screen 140 and the application processor. The GPU performs mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information. The display screen 140 is used to display images, videos, etc. In some embodiments, the electronic device may include one or N displays 140, where N is a positive integer greater than 1.

[0422] In this embodiment of the application, the electronic device displays the aforementioned... Figure 3 - Figure 31 The capabilities of the user interface shown depend on the aforementioned GPU, display 140, and display functions provided by the application processor.

[0423] Camera 150 is used to capture still images or videos. The ISP (Image Signal Processor) is used to process the data fed back by camera 150. Light is transmitted through the lens to the camera's photosensitive element, the light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The electronic device may include one or N cameras 150, where N is a positive integer greater than 1. A video codec is used to compress or decompress digital video. The electronic device may support one or more video codecs. Thus, the electronic device can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0424] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM). The RAM can be directly read and written by the processor 110 and can be used to store executable programs (e.g., machine instructions) of the operating system or other running programs, as well as user and application data. The NVM can also store executable programs and user and application data, and can be pre-loaded into the RAM for direct read and write operations by the processor 110.

[0425] In this embodiment, the code implementing the information processing method described in this embodiment can be stored in non-volatile memory. When running a camera application, the electronic device can load the executable code stored in the non-volatile memory into random access memory.

[0426] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of electronic devices.

[0427] Electronic devices can implement audio functions through audio modules 130, speakers 130A, receivers 130B, microphones 130C, headphone jacks 130D, and application processors.

[0428] Audio module 130 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. Speaker 130A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. Receiver 130B, also called a "handpiece," is used to convert audio electrical signals into sound signals. Microphone 130C, also called a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. Headphone jack 130D is used to connect wired headphones.

[0429] In this embodiment of the application, when the electronic device has the voice-to-text function enabled, it can enable the microphone 130C to collect sound signals and convert the sound signals into corresponding text.

[0430] Touch sensor 160, also known as a "touch device," can be disposed on display screen 140. The touch sensor 160 and display screen 140 together form a touchscreen, also known as a "touchscreen." Touch sensor 160 is used to detect touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 140. In other embodiments, touch sensor 160 may also be disposed on the surface of the electronic device, in a different location than display screen 140.

[0431] In this embodiment, the electronic device can use the touch sensor 160 to detect user actions such as clicking and swiping on the display screen 140, in order to achieve... Figure 3 - Figure 31 The material processing method shown.

[0432] Figure 33 This is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application.

[0433] The software system of an electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application uses the layered architecture Android system as an example to illustrate the software structure of an electronic device.

[0434] It should be understood that a layered architecture can divide software into several layers, each with a clear role and division of labor; the layers can communicate with each other through software interfaces.

[0435] like Figure 33 As shown, the Android system can be divided into four layers: from top to bottom, the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer can include a series of application packages.

[0436] like Figure 33 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0437] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0438] like Figure 33 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0439] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0440] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0441] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0442] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).

[0443] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0444] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating the device, and flashing indicator lights.

[0445] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0446] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0447] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0448] The system library can include multiple functional modules, such as: surface manager, media libraries, 3D graphics processing libraries such as Open Graphics Library for Embedded Systems (OpenGL ES), and 2D graphics engines (such as Skia Graphics Library (SGL)).

[0449] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0450] The media library supports playback and recording of various audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, Moving Picture Experts Group Audio Layer III (MP3), Advanced Audio Coding (AAC), Adaptive Multi-rate (AMR), Joint Photographic Experts Group (JPG), and Portable Network Graphics (PNG).

[0451] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0452] A 2D graphics engine is a graphics engine for 2D drawing.

[0453] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0454] In this embodiment of the application, the electronic device can utilize the aforementioned software system to display the aforementioned... Figure 3 - Figure 31 The material processing method shown.

[0455] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A material processing method, characterized in that: Applied to an electronic device including a display screen, the method comprises: Displaying a first interface of a first application in full screen, wherein the first interface includes a first initial material; In response to the first target operation, the display screen is in a partitioned display state, wherein the partitioned display state means that the display screen is divided into an original application display area, a material display area, and an operation area for display, wherein the original application display area includes the first interface, the operation area includes a first option, and the material display area includes a first material icon, wherein the first material icon is used to indicate the material that has been collected into the target application; In response to a first operation on the first option, the first initial material is collected into the target application, and a second material icon is added to the material display area, where the second material icon corresponds to the first initial material; After exiting the partition display state, displaying a second interface of the second application in full screen, the second interface including a second initial material, the type of the second initial material being different from the type of the first initial material; In response to the second target operation, the display screen is in the partitioned display state, wherein the original application display area includes the second interface, the material display area includes the first material icon and the second material icon, and the first option in the operation area is switched to the second option, and the first option is different from the second option; In response to a second operation on the second option, the second initial material is collected into the target application, and a third material icon is added to the material display area, the third material icon corresponding to the second initial material; In response to a third operation on any one of the material icons, the display is switched from the partition display state to a material preview interface, and the material preview interface corresponds to the material indicated by the material icon.

2. The method according to claim 1, characterized in that After exiting the partition display state, the second interface of the second application is displayed in full screen, including: In response to a fourth operation, exiting the partition display state, and displaying a third interface in full screen, wherein the third interface at least includes an application icon indicating a second application; In response to a fifth operation on the application icon indicating the second application, a second interface of the second application is displayed in full screen.

3. The method according to claim 1, characterized in that The operation area also includes a close button. After exiting the partition display state, the second interface of the second application is displayed in full screen, including: In response to a sixth operation on the close button, exiting the partition display state and displaying the first interface of the first application in full screen; In response to a seventh operation, the first interface is switched to a third interface, wherein the third interface at least includes an application icon indicating a second application; In response to an eighth operation on the application icon indicating the second application, a second interface of the second application is displayed in full screen.

4. The method according to any one of claims 1 to 3, characterized in that Before responding to the second target operation, the method further includes: In response to a first stage of a ninth operation on a sub-material included in the first initial material, the sub-material is displayed in a floating manner on the first initial material, and the type of the first initial material is different from the type of the sub-material; In response to a second stage of a ninth operation on the sub-material, the sub-material is collected into the target application, the first stage and the second stage being consecutive; A fourth material icon is newly added to the material display area, and the fourth material icon corresponds to the sub-material.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: Displaying the fourth interface of the third application in full screen; In response to the third target operation, the display screen is in the partitioned display state, wherein the original application display area includes the fourth interface, and the material display area includes at least the first material icon, the second material icon, and the third material icon; In response to a tenth operation on a target material icon in the material display area, the target material icon is in a selected state, and the target material icon is any one of the multiple material icons; In response to an eleventh operation on the target material icon, the material indicated by the target material icon is distributed to the fourth interface.

6. The method according to any one of claims 1 to 5, characterized in that The material preview interface includes a share button, and the method further includes: In response to a twelfth operation on the share button, a share card is displayed on the material preview interface, the share card including a plurality of options indicating different formats, different devices, different applications, saving, and printing; In response to a thirteenth operation on the share card, the material indicated by the target material icon is shared based on the selected option.

7. The method according to any one of claims 1 to 6, characterized in that The type of the first initial material and the type of the second initial material include any two of a web page, a document, and a picture.

8. The method according to claim 7, characterized in that The first option corresponds to the type of the first initial material, and the second option corresponds to the type of the second initial material; When the type of the first initial material is a web page, the first option is a web page collection option; when the type of the first initial material is a document, the first option is a document collection option; when the type of the first initial material is a picture, the first option is a picture collection option; When the type of the second initial material is a web page, the second option is the web page collection option; when the type of the second initial material is a document, the second option is the document collection option; when the type of the second initial material is a picture, the second option is the picture collection option.

9. The method according to any one of claims 1 to 8, characterized in that After responding to a first operation on the first option, the method further includes: Displaying a collection state icon, wherein the collection state icon is displayed in a floating manner in the original application display area; In response to a fourteenth operation on the first control included in the collection state icon, acquiring a first material based on the first initial material; In response to a fifteenth operation on the second control included in the collection state icon, the first material is collected into the target application through the collection state icon; A fifth material icon is added to the material display area, and the fifth material icon corresponds to the first material.

10. The method according to claim 9, characterized in that The type of the first initial material is video, and the first option is a video excerpt option.

11. The method according to any one of claims 1 to 10, characterized in that The operation area further includes a screenshot option. Before responding to the second target operation, the method further includes: In response to a sixteenth operation on the screenshot option, a second material obtained based on the first initial material is collected into the target application, and a type of the second material is a picture; A sixth material icon is added to the material display area, and the sixth material icon corresponds to the second material.

12. The method according to claim 11, characterized in that The method further comprises: In response to the seventeenth operation on the screenshot option, an operation option submenu is displayed floating on the screenshot option, wherein the operation option submenu includes the screenshot option and the long screenshot option; In response to an eighteenth operation on the long screenshot option and a nineteenth operation on the original application display area, a third material obtained based on the first initial material is collected into the target application, and the type of the third material is a long image; The material display area is newly used for a seventh material icon, and the seventh material icon corresponds to the third material.

13. The method according to any one of claims 1 to 12, characterized in that The operation area further includes a content identification option. Before responding to the second target operation, the method further includes: In response to the twentieth operation on the content identification option, the displayed content in the original application display area is displayed in a target form, and a favorite button is displayed, and the favorite button is displayed in a floating manner on the displayed content; In response to the twenty-first operation, part of the displayed content is in a selected state; In response to a twenty-second operation on the favorite button, the selected portion of the displayed content is collected into the target application; The material display area is newly used for an eighth material icon, and the eighth material icon corresponds to the part of the displayed content in the selected state.

14. The method according to claim 13, characterized in that The target form includes at least a highlight form, a word segmentation block form, and any one of sequentially tiled and suspended display in the original application display area.

15. The method according to claim 6, characterized in that The first target operation, the second target operation, and the third target operation are all three-finger sliding operations.

16. The method according to claim 5, characterized in that The first stage of the ninth operation is a long press operation, and the second stage of the ninth operation is dragging or throwing.

17. The method according to any one of claims 1 to 16, characterized in that The material display area is located in a left hot zone or a right hot zone of the display screen, and the operation area is located in a top area of ​​the display screen.

18. An electronic device, characterized in that: include: one or more processors and memory; The memory is coupled to the one or more processors, and the memory is used to store computer program codes, wherein the computer program codes include computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method as claimed in any one of claims 1 to 17.

19. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by an electronic device, the electronic device executes the method according to any one of claims 1 to 17.

Images