Material processing method and related device thereof

Abstract

The present application relates to the technical field of terminals. Provided are a material processing method and a related device thereof. The method comprises: displaying a first interface of a first application in full screen, the first interface comprising a first initial material; in response to a first target operation, a display screen being in a partitioned display state, the partitioned display state referring to the display screen being partitioned into an original application display area, a material display area and an operation area for display, the original application display area comprising the first interface, the operation area comprising a first option, and the material display area comprising a first material icon; and, in response to a first operation for the first option, collecting the first initial material into a target application, and newly adding in the material display area a second material icon, the second material icon corresponding to the first initial material. By integrating a display area and an operation area into one, the present application expands collection scenarios and types, improves the collection efficiency and user experience, and allows for previewing materials after collection.

Description

Material processing methods and related equipment

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on November 3, 2023, with application number 202311466466.6 and application name “Material Processing Method”, and claims priority to the Chinese patent application filed with the State Intellectual Property Office on February 1, 2024, with application number 202410154292.8 and application name “Material Processing Method and Related Equipment”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to a material processing method and related equipment. Background Art

[0003] With the continuous development of terminal technology, electronic devices can support the collection of different types of materials in different ways. For example, taking mobile phones as an example, users can copy and save text, capture images, record audio and video, etc., and can also use three-finger swipe to collect web pages obtained from some applications (such as news apps).

[0004] In practice, material collection involves not only a variety of collection methods and types, but also multiple applications. Currently, the various methods for collecting materials are inconsistent, and each method corresponds to a different material type, making it difficult for users to remember and impacting the user experience. Therefore, improving the convenience of collecting materials is a pressing issue.

[0005] Summary of the Invention

[0006] This application provides a material processing method and related equipment. Through a unified collection method, the interface display area and operation area are combined into one, expanding the collection scenarios and types, improving collection efficiency and user experience.

[0007] In the first aspect, the present application provides a material processing method. Applicable to an electronic device including a display screen, the method includes: displaying the first interface of the first application in full screen, the first interface including the first initial material; in response to the first target operation, the display screen is in a partitioned display state, the partitioned display state means that the display screen is divided into the original application display area, the material display area and the operation area for display, the original application display area includes the first interface, the operation area includes the first option, the material display area includes the first material icon, the first material icon is used to indicate the material that has been collected into the target application; in response to the first operation for the first option, the first initial material is collected into the target application, and a second material icon is added to the material display area, the second material icon corresponds to the first initial material; after exiting the partitioned display state, the second application is displayed in full screen The second interface includes a second initial material, and the type of the second initial material is different from that of the first initial material; in response to the second target operation, the display screen is in a partitioned display state, wherein the original application display area includes the second interface, the material display area includes a first material icon and a second material icon, and the first option in the operation area is switched to the second option, and the first option is different from the second option; in response to the second operation on the second option, the second initial material is collected into the target application, and a third material icon is added to the material display area, and the third material icon corresponds to the second initial material; in response to the third operation on any one of the material icons, the display is switched from the partitioned display state to the material preview interface, and the material preview interface corresponds to the material indicated by the material icon.

[0008] When the first interface of the first application is displayed in full screen, the first interface may not include a status bar. When the second interface of the second application is displayed in full screen, the second interface may not include a status bar.

[0009] The target application is the global favorite application in the embodiment of the present application, and the first target operation is the same as the second target operation.

[0010] The first operation, the second operation, and the third operation may be click operations. The first option corresponds to the type of the first initial material, and the second option corresponds to the type of the second initial material.

[0011] The partition display status can indicate the interface shown in (b) in Figure 6, the interface shown in (b) in Figure 11, the interface shown in (b) in Figure 9, the interface shown in (b) in Figure 13, the interfaces shown in (c) and (d) in Figure 22, the interface shown in (b) in Figure 23, etc.

[0012] It should be understood that for a first interface that does not include a status bar, after the display screen enters the partitioned display state, the content of the first interface remains unchanged, with only the displayed area being reduced, from full screen to a smaller original application display area. Alternatively, for a first interface that includes a status bar, after the display screen enters the partitioned display state, the original application display area can be used to display the content of the first interface excluding the status bar.

[0013] Similarly, for a second interface that does not include a status bar, after the display screen enters the partitioned display state, the content of the second interface remains unchanged, and only the display area is reduced, from full screen to a smaller original application display area. Optionally, for a second interface that includes a status bar, after the display screen enters the partitioned display state, the original application display area can be used to display the content of the second interface excluding the status bar.

[0014] The process of collecting the first initial material and the second initial material may indicate any two of the web page collection process shown in FIG. 8 and FIG. 24 , the document collection process shown in FIG. 12 , the picture collection process shown in FIG. 14 , and the like.

[0015] In an embodiment of the present application, a unified target operation can be used to trigger the display screen to enter a partitioned display state, indicating that a global collection mode has been entered. The operation is simple and efficient, and the collection of materials from different sources and types can be achieved. Moreover, when entering the partitioned display state, it can accurately determine how the user wants to retain the content, and provide corresponding operation options to support the retention of the material. In the partitioned display state, the original application display area before entering the global collection mode and the new operation area and material display area are combined into one display, which is convenient for users to view and operate, and expands the operation function. In addition, all materials are collected into the global collection application.

[0016] The material preview process may indicate the preview process shown in FIG. 29 .

[0017] In the embodiment of the present application, for the collected materials, a preview can also be directly triggered through the material icon shown in the material display area in the partition display state.

[0018] In combination with the first aspect, in one possible implementation, after exiting the partition display state, the second interface of the second application is displayed in full screen, including: in response to a fourth operation, the display screen exits the partition display state and displays the third interface in full screen, and the third interface includes at least an application icon indicating the second application; in response to a fifth operation on the application icon indicating the second application, the second interface of the second application is displayed in full screen.

[0019] The fourth operation may be an interface switching operation, such as a sliding operation; the fifth operation may be a clicking operation.

[0020] The third interface may be a desktop.

[0021] The switching process may indicate the switching process shown in FIG. 26 .

[0022] In an embodiment of the present application, when the electronic device enters the global collection mode and is in a partition display state, the partition display state can be exited through the fourth operation, and the partition display state can be switched to the second application to continue collecting other materials.

[0023] In combination with the first aspect, in a possible implementation, the operation area also includes a close button, and after exiting the partition display state, the second interface of the second application is displayed in full screen, including: in response to the sixth operation on the close button, the display screen exits the partition display state and displays the first interface of the first application in full screen; in response to the seventh operation, the display switches from the first interface to the third interface, and the third interface includes at least an application icon indicating the second application; in response to the eighth operation on the application icon indicating the second application, the second interface of the second application is displayed in full screen.

[0024] The sixth operation and the eighth operation are click operations, and the seventh operation can be an interface switching operation, such as a sliding operation.

[0025] The third interface may be a desktop.

[0026] The switching process may indicate the switching process shown in FIG. 27 .

[0027] In an embodiment of the present application, when the electronic device enters the global collection mode and is in a partition display state, you can operate the close button to first exit the partition display state, switch to the display interface before entering the partition display state, and then switch the interface to switch to the second application to continue collecting other materials.

[0028] Optionally, in an embodiment of the present application, you can switch the interface in the original application display area directly in the partition display state without exiting the partition display state, so as to switch to the second interface of the second application to continue collecting other materials.

[0029] In combination with the first aspect, in a possible implementation, the method further includes: before responding to the second target operation, the method further includes: in response to the first stage of the ninth operation on the sub-material included in the first initial material, the sub-material is displayed in a floating manner on the first initial material, and the type of the first initial material and the type of the sub-material are different; in response to the second stage of the ninth operation on the sub-material, the sub-material is collected into the target application, and the first stage and the second stage are continuous; a fourth material icon is added to the material display area, and the fourth material icon corresponds to the sub-material.

[0030] Optionally, the type of the first initial material is a web page, and the type of the sub-material is a picture, etc.

[0031] Optionally, the first stage of the ninth operation is a long press operation, and the second stage of the ninth operation is a drag or a throw.

[0032] The sub-material collection process may refer to the picture collection process shown in FIG. 25 .

[0033] In an embodiment of the present application, when the electronic device enters the global collection mode and is in a partitioned display state, the operation option may not be triggered, and the ninth operation may be performed directly in the original application display area to collect materials, thereby expanding the material collection method.

[0034] In combination with the first aspect, in a possible implementation, the method also includes: displaying the fourth interface of the third application in full screen; in response to the third target operation, the display screen is in the partitioned display state, wherein the original application display area includes the fourth interface, and the material display area includes at least the first material icon, the second material icon and the third material icon; in response to the tenth operation on the target material icon in the material display area, the target material icon is in a selected state, and the target material icon is any one of the multiple material icons; in response to the eleventh operation on the target material icon, the material indicated by the target material icon is distributed to the fourth interface.

[0035] The third target operation may be the same as the first target operation and the second target operation.

[0036] The tenth operation may be a long press or click operation, and the eleventh operation may be a drag or throw operation.

[0037] When the fourth interface of the third application is displayed in full screen, the status bar may not be included.

[0038] It should be understood that for a fourth interface that does not include a status bar, after the display screen enters the partitioned display state, the content of the fourth interface remains unchanged, with only the displayed area being reduced, from full screen to a smaller original application display area. Alternatively, for a fourth interface that includes a status bar, after the display screen enters the partitioned display state, the original application display area can be used to display the content of the fourth interface excluding the status bar.

[0039] The distribution process of the material may indicate the picture distribution process shown in FIG. 28 .

[0040] Optionally, the process of selecting the target material icon may be performed multiple times. After being performed multiple times, it is equivalent to selecting multiple materials for distribution.

[0041] In the embodiment of the present application, in the partition display state, operations can be performed directly between the material display area and the original application display area to achieve material distribution.

[0042] In combination with the first aspect, in a possible implementation, the material preview interface includes a share button, and the method further includes: in response to a twelfth operation on the share button, displaying a share card on the material preview interface, the share card including multiple options indicating different formats, different devices, different applications, saving and printing; in response to a thirteenth operation on the share card, the material indicated by the target material icon is shared based on the selected option.

[0043] The twelfth operation and the thirteenth operation may be click operations.

[0044] The material sharing process may refer to the picture sharing process shown in FIG30 .

[0045] In the embodiment of the present application, the material can be directly shared while the material preview interface is displayed.

[0046] In combination with the first aspect, in a possible implementation manner, the type of the first initial material and the type of the second initial material include any two of a web page, a document, and a picture.

[0047] In combination with the first aspect, in a possible implementation, the first option corresponds to the type of the first initial material, and the second option corresponds to the type of the second initial material; when the type of the first initial material is a web page, the first option is a web page collection option; when the type of the first initial material is a document, the first option is a document collection option; when the type of the first initial material is a picture, the first option is a picture collection option; when the type of the second initial material is a web page, the second option is the web page collection option; when the type of the second initial material is a document, the second option is the document collection option; when the type of the second initial material is a picture, the second option is the picture collection option.

[0048] In an embodiment of the present application, when collecting different types of materials or for different scenes, the corresponding first option, or dedicated option, can be displayed based on the type of material.

[0049] In combination with the first aspect, in a possible implementation, after responding to the first operation on the first option, the method also includes: displaying a collection state icon, which is displayed floating in the original application display area; in response to the fourteenth operation on the first control included in the collection state icon, obtaining the first material based on the first initial material; in response to the fifteenth operation on the second control included in the collection state icon, the first material is collected into the target application through the collection state icon; and a fifth material icon is added to the material display area, and the fifth material icon corresponds to the first material.

[0050] The collection state icon may be 403a shown in (b) of Figure 10, the first control may be a record control, and the second control may be a completion control. The fourteenth operation and the fifteenth operation may be click operations.

[0051] In the embodiment of the present application, partial materials can be collected based on the triggered collection state icon, which expands the collection scenario.

[0052] In combination with the first aspect, in a possible implementation manner, the method further includes: the type of the first initial material is video, and the first option is a video excerpt option.

[0053] In the embodiment of the present application, different first options, i.e., dedicated options, may be displayed for different material types. For videos, an extract video option may be displayed, thereby allowing the collection of extract videos.

[0054] In combination with the first aspect, in a possible implementation, the operation area also includes a screenshot option. Before responding to the second target operation, the method also includes: in response to a sixteenth operation for the screenshot option, the second material obtained based on the first initial material is collected into the target application, and the type of the second material is a picture; a sixth material icon is added to the material display area, and the sixth material icon corresponds to the second material.

[0055] The sixteenth operation is a click operation.

[0056] In the embodiment of the present application, the collection of screenshots can be achieved in a simple manner.

[0057] In combination with the first aspect, in a possible implementation, the method also includes: in response to the seventeenth operation on the screenshot option, an operation option submenu is displayed floating on the screenshot option, and the operation option submenu includes the screenshot option and the long screenshot option; in response to the eighteenth operation on the long screenshot option and the nineteenth operation on the original application display area, a third material obtained based on the first initial material is collected into the target application, and the type of the third material is a long picture; a seventh material icon is added to the material display area, and the seventh material icon corresponds to the third material.

[0058] The eighteenth operation may be a click operation.

[0059] The nineteenth operation may indicate a sliding operation on the original application display area, such as a sliding operation from bottom to top.

[0060] The operation option submenu may indicate a menu card 702d shown in (c) of FIG. 16 .

[0061] Optionally, the long screen capture may be started only in response to the eighteenth operation on the long screen capture option, and the long screen capture may be automatically ended after the displayed content is scrolled, and the third material obtained based on the first initial material may be collected into the target application.

[0062] In an embodiment of the present application, the display content of the original application display area can move upward or automatically scroll as you slide, the content in the upper area gradually disappears, and the lower area gradually displays new content, so that it can be captured in a long screen.

[0063] In combination with the first aspect, in a possible implementation, the operation area also includes a content identification option. Before responding to the second target operation, the method also includes: in response to the twentieth operation for the content identification option, the displayed content in the original application display area is displayed in a target form, and a favorite button is displayed, and the favorite button is displayed floating on the displayed content; in response to the twenty-first operation, part of the displayed content is selected; in response to the twenty-second operation for the favorite button, the part of the displayed content in the selected state is collected into the target application; the material display area is newly added for an eighth material icon, and the eighth material icon corresponds to the part of the displayed content in the selected state.

[0064] The twentieth operation and the twenty-second operation may be click operations; the twenty-first operation may be a click operation or a drag operation.

[0065] In an embodiment of the present application, in response to the twentieth operation on the content recognition option, the system screen recognition capability can be triggered to realize functions such as text and picture extraction of the displayed content in the original application display area. Then, in response to the selection of content and the operation of the favorite button, the selected part of the displayed content can be collected into the target application, expanding the scenarios and types of material collection.

[0066] In combination with the first aspect, in a possible implementation, the target form includes at least any one of a highlighted form, a word segmentation block form, and a sequentially tiled and suspended display in the original application display area.

[0067] With reference to the first aspect, in a possible implementation manner, the first target operation, the second target operation, and the third target operation are all three-finger swipe operations.

[0068] Optionally, the target operation may also be a unified knuckle C-shaped sliding operation, or other unified gesture operations, and the gesture operation may be in contact with the display screen, or may be suspended in the air without contact.

[0069] In the embodiment of the present application, no matter how many times the target operation is performed, the target operation is a unified gesture operation, which has no memory burden, is convenient for users to learn and use, and improves the user experience.

[0070] In combination with the first aspect, in a possible implementation, the material display area is located in a left hot zone or a right hot zone of the display screen, and the operation area is located in a top area of ​​the display screen.

[0071] In an embodiment of the present application, the material display area is located in the left hot zone or the right hot zone, which can be conveniently used for operations such as material collection and distribution; the operation options in the operation area are used less frequently, so the operation area can be located in the top area of ​​the display screen, which is convenient for operating the content of the original application display area below without accidentally touching the operation options.

[0072] In a second aspect, the present application provides an electronic device, comprising: one or more processors, and one or more memories; the one or more memories are coupled to the one or more processors, the memory being used to store computer program code, the computer program code comprising computer instructions, the one or more processors calling the computer instructions to enable the electronic device to perform the method described in the first aspect or any one of the implementations of the first aspect.

[0073] In a third aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the first aspect or any one of the implementations of the first aspect.

[0074] In a fourth aspect, an embodiment of the present application provides a chip system, which can be applied to an electronic device. The chip includes one or more processors, which are used to call computer instructions to enable the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0075] In a fifth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0076] It is understood that the electronic device provided in the second aspect, the computer storage medium provided in the third aspect, the chip system provided in the fourth aspect, and the computer program product provided in the fifth aspect are all used to perform the method described in the first aspect or any one of the implementations of the first aspect. Therefore, the beneficial effects that can be achieved can be referenced to the beneficial effects of any possible implementation of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0077] FIG1 is a setting interface corresponding to a collection method provided in an embodiment of the present application;

[0078] FIG2 is a schematic diagram of a set of user interfaces involved in the collection method provided in FIG1 ;

[0079] FIG3 is an example of global collections in different forms provided by an embodiment of the present application;

[0080] FIG4 is an example of a floating icon provided in an embodiment of the present application;

[0081] FIG5 is a schematic diagram of switching between a floating state icon, a hidden state icon, and a full-screen state according to an embodiment of the present application;

[0082] FIG6 is a schematic diagram of an interface for triggering web page collection by swiping down with three fingers according to an embodiment of the present application;

[0083] FIG7 is a schematic diagram of various operation options provided in an embodiment of the present application;

[0084] FIG8 is a schematic diagram of an interface for adding web pages to favorites according to an embodiment of the present application;

[0085] FIG9 is a schematic diagram of an interface for triggering video excerpts by sliding down with three fingers according to an embodiment of the present application;

[0086] FIG10 is a schematic diagram of an interface for video excerpting provided in an embodiment of the present application;

[0087] FIG11 is a schematic diagram of an interface for triggering document collection by swiping down with three fingers according to an embodiment of the present application;

[0088] FIG12 is a schematic diagram of an interface for document collection provided in an embodiment of the present application;

[0089] FIG13 is a schematic diagram of an interface for triggering image collection by swiping down with three fingers according to an embodiment of the present application;

[0090] FIG14 is a schematic diagram of an interface for collecting pictures provided in an embodiment of the present application;

[0091] FIG15 is a schematic diagram of an interface for collecting screenshots provided in an embodiment of the present application;

[0092] FIG16 is a schematic diagram of an interface for triggering long screenshot collection by swiping down with three fingers, provided in an embodiment of the present application;

[0093] FIG17 is a schematic diagram of an interface for collecting long screenshots provided in an embodiment of the present application;

[0094] FIG18 is a schematic diagram of an interface for triggering the extraction of content collections by swiping down with three fingers, provided in an embodiment of the present application;

[0095] Figures 19 and 20 are schematic diagrams of an interface for extracting content collections provided in an embodiment of the present application;

[0096] FIG21 is a schematic diagram of another content extraction method provided in an embodiment of the present application;

[0097] FIG22 is a schematic diagram of a target interface provided in an embodiment of the present application;

[0098] FIG23 is another schematic diagram of an interface for triggering a collection by swiping down with three fingers, provided in an embodiment of the present application;

[0099] FIG24 is a schematic diagram of an interface for a first collection method according to an embodiment of the present application;

[0100] FIG25 is a schematic diagram of the interface of the second collection method provided in an embodiment of the present application;

[0101] FIG26 is a schematic diagram of a secondary collection interface provided by an embodiment of the present application;

[0102] FIG27 is a schematic diagram of another secondary collection interface provided by an embodiment of the present application;

[0103] FIG28 is a schematic diagram of an interface for distributing materials provided in an embodiment of the present application;

[0104] FIG29 is a schematic diagram of an interface for previewing materials provided in an embodiment of the present application;

[0105] FIG30 is a schematic diagram of an interface for sharing materials provided in an embodiment of the present application;

[0106] FIG31 is an exemplary flow chart of a material processing method provided in an embodiment of the present application;

[0107] FIG32 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0108] Figure 33 is a schematic diagram of the software structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0109] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0110] It should be understood that the terms "first," "second," and the like in the specification, claims, and drawings of this application are used to distinguish between different objects, rather than to describe a particular order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0111] References to "embodiments" in this application mean that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described in this application may be combined with other embodiments.

[0112] To facilitate understanding, the nouns involved in the embodiments of this application are first explained.

[0113] 1. System applications and third-party applications. System applications refer to applications directly provided by the operating system of an electronic device to implement specific functions. Third-party applications refer to applications provided by other developers and accessed by the electronic device via the internet to implement specific functions. In the embodiments of this application, the application that provides the user interface can be either a system application or a third-party application.

[0114] 2. Hot zone refers to a touch area of ​​fixed shape and size on the screen.

[0115] For example, 302d shown in FIG22(b) is a schematic diagram of a "hot zone". Referring to FIG22(b), a hot zone may include a right edge hot zone and / or a left edge hot zone. The right edge hot zone refers to a rectangular touch area extending from the right edge of the screen to the left, and the left edge hot zone refers to a rectangular touch area extending from the left edge of the screen to the right. FIG22(b) uses the left edge hot zone as an example.

[0116] The electronic device can determine whether the control is close to the right or left side of the screen by determining the distance between the current finger touch point and the right edge hot zone or the left edge hot zone. In the embodiment of the present application, when it is recognized that the current touch point is within the right edge hot zone or the left edge hot zone, the electronic device can determine to trigger the service corresponding to the hot zone, for example, it can trigger the selection of material.

[0117] 3. Materials in this application may include various types of information such as text, graphics, images, videos, files, audio, web pages, tables, etc.; among them, images can be static images or dynamic images, and files can be in various formats such as PDF format, Word format, Excel format, etc., which are not limited in this application.

[0118] 4. Annotations (or graffiti), as used in this application, refer to content drawn on a display screen with a pen tip or fingertip. The information contained in the annotations may include the trajectory formed from the start position to the end position of the annotation. The start position refers to the point where the user places the pen when making an annotation on the display screen, and the end position refers to the point where the user lifts the pen after making an annotation on the display screen.

[0119] The above is a brief introduction to the nouns involved in the embodiments of this application, and no further details will be given below.

[0120] Electronic devices can support collecting different types of materials in different ways, so that users can use electronic devices to achieve the purpose of collecting materials.

[0121] However, in practice, for example, file management apps on mobile phones can only collect images, videos, audio, and documents. The types of these materials are limited, and the methods for collecting them (such as copying and dragging) are also limited. For example, note-taking apps on mobile phones can not only collect text, images, videos, and audio, but also web pages and videos obtained from news apps.

[0122] In the above two examples, although the note-taking application can collect slightly more types of materials than the file management application, if multiple types of materials need to be collected into a note, the user needs to frequently switch between different applications during the collection process, which is inefficient for the user. At the same time, the user also needs to use different collection methods to collect materials in different applications. For example, for web pages and videos, the user needs to collect them into the note-taking application by swiping down with three fingers. For other types of content, the user needs to collect them into the note-taking application by copying, dragging, sliding the knuckles in a C shape, and other methods.

[0123] Exemplarily, Figure 1 is a setting interface corresponding to a collection method provided in an embodiment of the present application; Figure 2 is a schematic diagram of a set of user interfaces involved in the collection method. As shown in (a) in Figure 1, the main interface 101 in the setting application of the electronic device may include auxiliary function options; in response to user operations on the auxiliary function options, the electronic device may display an auxiliary function interface 102 as shown in (b) in Figure 1. The auxiliary function interface 102 may include a three-finger swipe down function and a corresponding switch, wherein the switch is turned on to indicate that the three-finger swipe down function is turned on, and the switch is turned off to indicate that the three-finger swipe down function is turned off. When the three-finger swipe down function is turned on, the user can collect the corresponding material types (such as web pages and excerpted videos) into the note application through the three-finger swipe down collection method.

[0124] For example, referring to the display interface 201 shown in (a) of FIG2 , the display interface 201 is a display interface corresponding to a web page content. When the electronic device detects a user's three-finger swipe operation on the display interface 201, in response to the three-finger swipe operation, the electronic device can display the display interface 202 shown in (b) of FIG2 . The other contents of the display interface 202 remain unchanged relative to the display interface 201, but a card 202a is superimposed on the lower half of the display interface 202. The card 202a is used to prompt that the three-finger swipe operation has triggered the web page collection, and the collected web page content comes from the application indicated by the icon, such as the WeChat APP. During the process of the web page being collected in the note application, the card 202a gradually moves toward the bottom frame of the electronic device and disappears; after the web page is successfully collected, as shown in (c) of FIG2 , the card 202a disappears, and the display interface 202 can display a card 202b. The card 202b is used to prompt that the web page has been successfully collected and the web page content has been collected in the note application. Next, if the user performs a user operation on the text "Note" on card 202b, in response to the user operation, the electronic device can display an interface in the note application, such as the display interface 203 shown in (d) in Figure 2, to provide the user with the opportunity to view the web page content currently collected in the note.

[0125] On the basis of the above, in order to shorten the user's collection path, unify the collection space, and improve the collection efficiency, the embodiment of the present application provides a new third-party application, namely a global collection application; based on the global collection application, the purpose of shortening the collection path can be achieved. However, there are still various and inconsistent collection methods, and each collection method corresponds to a different type of material; the system cannot accurately judge how the user wants to retain the content; it is not easy for the user to remember, which affects the user experience and other problems.

[0126] In light of this, the embodiments of this application provide a new material processing method based on a global collection application. This material processing method can collect materials from different sources and different types of materials, unify the collection method, expand the collection scenarios and types, and improve collection efficiency. This method can also accurately determine how users want to retain content, and there is no learning cost for users. It can efficiently and conveniently collect, organize, and distribute materials in any scenario, achieving the goal of improving user experience.

[0127] In order to facilitate understanding of the method provided in the embodiment of the present application, the global collection application and multiple forms of the global collection application involved in the present application are briefly introduced below with reference to Figures 3 to 5.

[0128] Global Collections is a management app that allows users to collect, organize, and share materials. Users can use Global Collections to collect, organize, and share materials. Furthermore, Global Collections can be used as a personal learning or workspace. Data in Global Collections can be retained permanently.

[0129] The global collection can be presented in a variety of forms during use to distinguish and indicate that the electronic device is in different processing stages or performing different processing. For example, the forms of the global collection may include a hidden state (also called a hidden state icon), a collection state (also called a collection state icon), a suspended state (also called a suspended state icon) and a full-screen state (also called a full-screen interface), etc.; the naming here is only schematic, for example, the hidden state can also be called a minimized state, and the suspended state can also be called a distributed state, which is not limited in this application. Each form of the global collection can also include one or more styles, and the styles can be switched with each other in response to user triggers. See Figure 3, which is an example of a global collection in different forms provided in an embodiment of the present application.

[0130] The hidden state of the global collection is used to indicate that the global collection has been called up by the foreground or is running in the background; the collecting state is used to indicate the location of the material collection entrance or to indicate that the global collection is in the process of collecting materials; the floating state is used to display the materials collected in the global collection in a part of the current display interface; the full-screen state is used to display the materials collected in the global collection in the entire display area. It can be understood that the floating state is equivalent to the display window of the global collection application, and the full-screen state is equivalent to the main interface of the global collection application. The floating state and full-screen state can support users to organize materials.

[0131] Optionally, the hidden icon for a global favorite can be shaped like a sphere or hemisphere, and can be either non-transparent or translucent. For example, when a global favorite is hidden, the hidden icon can appear as a translucent, hemispherical shape adsorbed to the inside edge of the screen, as shown in Figure 3 for hidden icon a. In this case, the location of hidden icon a inside the screen edge does not affect the user's normal viewing of the displayed content, and its translucent state does not visually attract the user's attention, nor interfere with the user's normal use.

[0132] It should be noted that the position of the inner side of the screen edge described in the embodiment of the present application can be specifically located on the upper side, lower side, left side or right side of the inner side of the edge, and the present application does not limit this.

[0133] Optionally, the collection icon for a global collection can change styles based on the collection scenario. For example, when collecting video excerpts, the collection icon style can be switched to collection icon b11 as shown in Figure 3; when collecting global annotations, the collection icon style can be switched to collection icon b21 or collection icon b22 as shown in Figure 3. The collection icon style can be set specifically based on the type of material being collected, and this application does not limit this.

[0134] Optionally, the floating state of the global collection can be moved in the display area based on the user's drag operation, and can also change size based on the user's drag operation. For example, the floating state of the global collection can specifically include two styles, one is a long strip, such as the first floating state c1 shown in Figure 3; the other is a card-shaped, such as the second floating state c2 shown in Figure 3; the positions and sizes of the long strip-shaped first floating state c1 and the card-shaped second floating state c2 are different. The first floating state c1 of the global collection can be presented with the effect of being adsorbed on the inner side of the screen edge when displayed to avoid interfering with the currently displayed content. The second floating state c2 of the global collection can be displayed in the center area of ​​the display screen when displayed to facilitate user viewing.

[0135] Optionally, as a possible implementation method, in response to a drag operation on the edge of the first floating state c1, the first floating state c1 can be switched to the second floating state c2; conversely, in response to a drag operation on the edge of the second floating state c2, the second floating state c2 can also be switched to the first floating state c1. As another possible implementation method, in response to a two-finger reverse sliding operation on the first floating state c1, the first floating state c1 can be switched to the second floating state c2; conversely, in response to a two-finger pinching operation on the second floating state c2, the second floating state c2 can also be switched to the first floating state c1. In addition, the first floating state c1 can display icons corresponding to one or two columns of materials, and can display at least one icon corresponding to one material. The second floating state c2 can display icons corresponding to two or more columns of materials, but the number of columns and rows is less than that of the full-screen state. It can be set according to needs, and this application does not limit this.

[0136] Optionally, the floating state of the global collection may further include a top bar control and / or a bottom bar control. In response to a click operation on the top bar control, as shown in FIG4 (a), the first floating state c1 may be switched to a floating state style with a toolbar as shown in FIG4 (b); the toolbar of this style may include three controls, namely, a zoom-in control, a zoom-out control, and a close control. The zoom-in control is used to trigger the switch from the first floating state c1 to the full-screen state; the zoom-out control is used to trigger the switch from the first floating state c1 to the hidden state icon a; and the close control is used to trigger the exit from the global collection.

[0137] Optionally, as shown in Figures 5(a) and 5(b), in response to a swipe operation on the top horizontal bar control in the first suspended state c1, the global collection can be switched from the first suspended state c1 to the hidden state icon a. The direction of the swipe operation can be left or right, and Figure 5(a) only illustrates a right swipe. In addition, in response to a click operation on the hidden state a, the global collection can be switched from the hidden state icon a to the first suspended state c1.

[0138] Alternatively, as shown in Figures 5(c) and 5(d), in response to a sliding operation on the bottom horizontal bar control in the first floating state c1, the global collection can be switched from the first floating state c1 to the full-screen state icon d. The sliding operation can be in the left or right direction, and Figure 5(c) only illustrates a rightward sliding operation.

[0139] Similarly, the second floating state c2 can also be switched to a floating state style with a toolbar; the second floating state c2 can also include a top horizontal bar control and a bottom horizontal bar control, and the top horizontal bar control and the bottom horizontal bar control of the second floating state c2 can also be slid to switch to the hidden state icon a or the full-screen state d accordingly; for the functional introduction of the second floating state c2, please refer to the above description and will not be repeated here.

[0140] It should also be noted that although users will switch between multiple forms when using global collections, the global collection application in each form is at the top of the multiple display layers included in the display interface (or called top), and is not covered or affected by the content displayed below.

[0141] In combination with the global collection and multiple forms of use introduced above, when implementing the material processing method provided by this application, the electronic device can execute one or more of the following scenarios.

[0142] It is understood that materials include various types, and the various types of materials mentioned here can include fragmented materials such as text, graphics, images, tables, annotations, etc., and can also include non-fragmented materials such as web pages, videos, and files. Graphics can indicate a partial image captured using a lasso tool, etc.

[0143] It should be understood that the materials involved in this application include, but are not limited to, text, graphics, images, videos, audio, web pages, tables, annotations, etc. The collection of materials involved in this application may include acquiring materials, processing the acquired materials, and using the processed results as the collected content. For example, collecting materials may include: converting acquired web page materials into text materials, converting acquired text materials into image materials, editing or marking input text or images, etc.

[0144] Part 1:

[0145] For the various types of materials introduced above, in order to unify the collection method, this application provides a unified gesture, such as a three-finger swipe down method, so that this application can trigger the entry into the global collection mode by swiping down with three fingers. For example:

[0146] Scenario 1. In response to a three-finger swipe down operation, the electronic device enters the global collection mode and supports saving the web page to the global collection application.

[0147] Scenario 2. In response to a three-finger swipe down operation, the global collection mode is entered. The electronic device can support recording videos while playing videos and save the recorded videos to the global collection application. For the sake of description, this application will record the recorded videos as excerpt videos.

[0148] Optionally, during the video recording process, the electronic device may support continuous recording. Continuous recording here may indicate pausing the recording and then starting to record a video. It should be noted that after pausing the recording and before starting the recording again, the electronic device may support switching applications, that is, the two recording contents may involve different applications. However, after the recording is completed, the two recording contents will be spliced ​​into an excerpt video (also called a video clip) and collected in the global collection.

[0149] Optionally, after recording a video, the electronic device can also support adding excerpts to the excerpts already collected in the global collection. It should be noted that the additional excerpts here can indicate non-continuous recording or recording in installments; each newly added video and the previously recorded videos are stored in the same folder in the global collection, and within that folder, different recordings correspond to different video clips. It should also be noted that the folder containing multiple video clips is still displayed as an individual material icon in the global collection.

[0150] Scenario 3. In response to a three-finger swipe down operation, the electronic device enters the global collection mode and supports saving documents to the global collection application.

[0151] Scenario 4. In response to a three-finger swipe down operation, the electronic device enters the global collection mode and supports saving images to the global collection application.

[0152] Scenario 5. In response to a three-finger swipe down operation, the electronic device enters the global collection mode and supports saving the screenshot content to the global collection application.

[0153] Scenario 6. In response to a three-finger swipe down operation, the electronic device enters the global collection mode and supports saving the long screenshot content to the global collection application.

[0154] Scenario 7. In response to a three-finger swipe down operation, the electronic device enters the global collection mode, and can support saving the content identified from the display interface to the global collection application.

[0155] Scenario 8. In response to a three-finger swipe down operation, entering global collection mode, the electronic device can also support annotation on any interface and save the original interface and annotation traces to the global collection application. For ease of description, this application will refer to the original interface and annotation traces as global annotations.

[0156] Optionally, during the annotation process, the electronic device may support continuous annotation. The continuous annotation here may indicate pausing the annotation and then starting the annotation again. It should be noted that before starting the annotation again after pausing the annotation, the electronic device may support switching interfaces or applications, that is, the two sections of annotation content may involve different display contents of different interfaces and different applications. However, after the annotation is completed, the two sections of annotation content will be spliced ​​into a global annotation (also called a snapshot) and collected in the global collection.

[0157] Optionally, after the annotation is completed, the electronic device can also support additional annotations for the global annotations collected in the global collection. It should be noted that the additional annotations here can indicate non-continuous annotations or annotations in batches; each newly added annotation is equivalent to the content of the previous one or more annotations saved in the same folder location in the global collection, and the content of different annotations in the folder corresponds to different snapshots; it should also be added that the folder containing multiple snapshots is still displayed as an individual material icon in the global collection.

[0158] Optionally, after the annotation is completed, the electronic device can also support repeated annotation for the global annotations that have been collected into the global collection, that is, editing the annotation content that already carries the annotation traces again, including but not limited to adding annotation traces.

[0159] The above only schematically illustrates eight collection scenarios. Of course, other scenarios are also possible. This application does not limit the scenarios in the collection stage. The collection method provided by this application can realize the collection of materials from different sources and different types of materials by combining with the global collection application, unify the collection method, expand the collection scenarios, and improve the collection efficiency. This method can accurately determine how users want to retain content, and there is no learning cost for users, which can facilitate users to efficiently collect materials in any scenario.

[0160] It is understandable that the electronic device in the present application can be a terminal device such as a mobile phone, a tablet computer, or a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device and / or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.

[0161] The following is a detailed introduction to the process of entering the global collection mode and collecting different types of materials using the unified three-finger swipe gesture.

[0162] Example 1: Webpage Collection (as shown in Figures 6 to 8)

[0163] Taking WeChat as an example, the electronic device can detect a three-finger swipe down operation on the display interface corresponding to a certain article. In response to the three-finger swipe down operation, the electronic device can trigger the entry into the global collection mode and realize the collection of the displayed content in the global collection mode.

[0164] As shown in FIG6(a), display interface 301 is a display interface corresponding to a webpage. As shown in FIG6(a), the electronic device can detect a three-finger swipe down operation on display interface 301. In response to the three-finger swipe down operation, the electronic device can enter a global favorites mode and display display interface 302 as shown in FIG6(b).

[0165] Relative to the display interface 301, the display interface 302 includes three areas, among which the first part 302a located in the upper area is the status bar, which is used to display basic status information of the electronic device, such as network, power, time and other information. The second part 302b located in the middle area may include a thumbnail, which is used to indicate the display interface 301 displayed by the electronic device when the three-finger sliding gesture is triggered. The content included in the thumbnail is the same as the content of the display interface 301, and the size is smaller than the size of the display interface 301. The third part 302c located in the bottom area is used to display multiple operation options. The types of the operation options may include special options (also called vertical options), content extraction options and general options, etc.

[0166] Optionally, in one possible implementation, the thumbnail may be displayed in a rectangular shape (as shown in (b) of FIG6 ), a shape that is wide at the top and narrow at the bottom, or a shape that is wide at the left and narrow at the right. The specific display form may be set as needed, and the present embodiment does not impose any limitation on this.

[0167] Alternatively, in another possible implementation, when switching from display interface 301 to display interface 302, a "door opening animation" may be displayed. This door opening animation is used to indicate the process of the displayed content gradually shrinking and transforming from a full-screen display style (i.e., display interface 301) to a thumbnail style. The reverse process may be referred to as a "door closing animation." The specific form of the animation can be set as needed, and this embodiment of the application does not impose any restrictions on this.

[0168] The dedicated options are used to indicate the options corresponding to the content storage format when the three-finger swipe gesture is triggered. When the corresponding scenes when the three-finger swipe gesture is triggered are different, the dedicated options displayed in the third part are different. In other words, the global collection can provide corresponding options for specific scenes. Figure 7 is a schematic diagram of various operation options provided in an embodiment of the present application. As shown in Figure 7, for the web page collection scene, the dedicated options can be displayed as web page collection options; for the video excerpt scene, the dedicated options can be displayed as video excerpt options; for the document collection scene, the dedicated options can be displayed as document collection options; for the picture collection scene, the dedicated options can be displayed as picture collection options, etc. The scenes and the dedicated options corresponding to the scenes can be set as needed, and the embodiment of the present application does not impose any restrictions on this.

[0169] The content extraction option is used to indicate the option to extract local content from the display interface based on the system's screen recognition capabilities. The system's screen recognition capabilities are used to indicate the electronic device's ability to extract text, identify products, and identify similar images.

[0170] The general options are options for multiple special functions. The general options can perform the same operations for different types of display content. As shown in Figure 7, the general options may include screenshot collection options, long screenshot collection options, annotation collection options, and screen recording collection options, etc. This embodiment of the application does not impose any restrictions on this.

[0171] Alternatively, in one possible implementation, in the third area, generally, each scenario may provide less than or equal to three options. In other words, one option may be selected from each of the three categories of options, forming a combination of three options for display. Alternatively, in another possible implementation, in the third area, the dedicated options may provide one option, the content extraction options may provide one option, and the general options may provide two options.

[0172] Optionally, when displayed, the dedicated options, content extraction options, and general options may be displayed from left to right in the order of the dedicated options, content extraction options, and general options.

[0173] For example, for a web page collection scenario, when the web page collection option is not provided, the third area may display a content extraction option, a screenshot collection option, a long screenshot collection option, an annotation collection option, and the like.

[0174] For example, for a video excerpt scenario, when the video excerpt option is not provided, the third area may display screen recording collection, content extraction options, screenshot collection options, annotation collection options, and the like.

[0175] For example, for the document collection scenario, when document collection is not available, the third area may display content extraction options, screenshot collection options, long screenshot collection options, annotation collection options, and the like.

[0176] It should be noted that the corresponding dedicated options cannot be provided in the above three scenarios. This refers to some relatively niche third-party applications that are not allowed to be used or are not compatible with the system's dedicated collection function. At this time, when triggered by a three-finger swipe down, the display interface 302 can selectively not display the dedicated options.

[0177] For example, for scenarios where no dedicated options can be provided, such as WeChat chat, shopping scenarios, and reading scenarios, the third area can display content extraction options, screenshot collection options, long screenshot collection options, annotation collection options, etc.

[0178] The display of the options in the third area can be set as needed, and this application does not impose any restrictions on this.

[0179] It should be noted that the display interface 302 shown in (b) of Figure 6 is only one display interface style provided in the embodiment of the present application. The present application also provides multiple display interface styles, which will be introduced later and will not be repeated here.

[0180] The above embodiment 1 to the following embodiment 7 are all described as an example of triggering the global collection mode by sliding down with three fingers, and the interface displayed after triggering is as shown in (b) of Figure 6.

[0181] Referring to the display interface 302 shown in (a) of Figure 8, the electronic device can detect a click operation on the web page collection option in the display interface 302; in response to the click operation, the display content corresponding to the thumbnail (i.e., the web page displayed on the display interface 301) will be collected into the global collection application. During this collection process, as shown in (b) of Figure 8, the electronic device can first display a door closing effect, switch from the display interface 302 to the interface of the original web page display, and display a card 303a on the interface. The card 303a may include information such as the title, publisher, publishing address and time of the web page being collected. Optionally, a close button may also be included in the upper left corner of the card 303a. In response to a click operation on the close button, the collection of the web page can be terminated, and then the card 303a disappears and is not displayed.

[0182] During the webpage collection process, if the close button in the upper left corner of card 303a is not clicked within a preset time, as shown in Figure 8 (c), card 303a may be switched to card 303b, with the other contents remaining unchanged. Card 303b indicates the source of the webpage collection, such as WeChat, and displays the WeChat icon. Alternatively, as shown in Figure 8 (d), card 303b may move toward the bottom edge of display interface 303 and gradually disappear.

[0183] Optionally, after card 303b disappears, as shown in (e) of FIG8 , the electronic device may further display card 303c with other contents unchanged. Card 303c is used to feedback to the user that the webpage has been successfully bookmarked and provides a link to enter the global bookmark application.

[0184] In the embodiment of the present application, global collection is the default collection method for web page collection; of course, web page content can also be collected in other applications, which can be set according to needs, and the embodiment of the present application does not limit this.

[0185] For example, the card 303c may display a text link such as "Go to global collection to view"; in response to a click operation on the text link, the electronic device may display a floating icon c1 of the global collection, as shown in (f) in FIG8 , in which the floating icon c1 of the global collection includes an icon indicating the web page content that has just been collected.

[0186] Optionally, when no operation is received within a preset time period, the card 303c may automatically disappear and not be displayed.

[0187] Optionally, after card 303b disappears, as shown in (e) in FIG8 , a hidden icon a in the shape of a hemisphere of global favorites may be displayed on the inner side of the right screen edge of the electronic device to provide an entry to the global favorites application. Optionally, when the hidden icon a is first triggered to be displayed, the electronic device may also display a prompt card near the hidden icon a, which prompts the user to enter the global favorites application and view the content collected by the global favorites application by clicking on the hidden icon a, as shown in (f) in FIG8 ; the prompt card may also include a close button, which, in response to the user's click operation, may trigger the closing of the prompt card.

[0188] The above is just one example of web page collection.

[0189] Example 2: Collecting Video Excerpts (as shown in Figures 9 and 10)

[0190] Taking a video application as an example, the electronic device can detect a three-finger swipe down operation on a video playback interface. In response to the three-finger swipe down operation, the electronic device can trigger the entry into the global collection mode and realize the collection of the video excerpt in the global collection mode.

[0191] As shown in FIG9(a), display interface 401 is a display interface corresponding to a video playback interface. As shown in FIG9(a), the electronic device detects a three-finger swipe down operation on display interface 401. In response to the three-finger swipe down operation, the electronic device may enter a global collection mode and display display interface 402 as shown in FIG9(b).

[0192] Optionally, when switching from display interface 401 to display interface 402, a "door opening animation" may be displayed.

[0193] Relative to the display interface 401, the display interface 402, like the display interface 302 in Example 1, may include three areas, wherein the first part 402a located in the upper area is the status bar, which will not be described in detail here. The second part 402b located in the middle area includes a thumbnail, which is used to indicate the display interface 401 displayed by the electronic device when the three-finger downward gesture is triggered; the content included in the thumbnail is the same as the content of the display interface 401, and the size is smaller than the size of the display interface 401. The third part 402c located in the bottom area is used to display multiple operation options. For a specific introduction to the operation options, please refer to the introduction in Example 1 and will not be described in detail here.

[0194] In addition, since the display interface 401 corresponds to the video excerpt scene, the dedicated option displayed in the third area is the video excerpt option; the third area can also display content extraction options, screenshot collection options in general options, and annotation collection options, etc.

[0195] It should be noted that the display interface 402 shown in (b) of Figure 9 is only one display interface style provided in the embodiment of the present application. The present application also provides multiple display interface styles, which will be introduced later and will not be repeated here.

[0196] Referring to the display interface 402 shown in (a) of Figure 10, the electronic device can detect a click operation on the video excerpt option in the display interface 402; in response to the click operation, as shown in the display interface 403 in (b) of Figure 10, the electronic device can enter the video excerpt mode and implement multiple functions such as video recording, marking, screenshot, and saving in the video excerpt mode.

[0197] Display interface 403, like display interface 401, still includes the video playback interface. However, it also includes a first collection state 403a. It should be noted that first collection state 403a corresponds to a collection state used by the global collection app in a video excerpting scenario, as shown in the collection state icon b11 in Figure 3. First collection state 403a may include a video content area, a recording control, a tagging control, a screenshot control, and a completion control. When the video is not being excerpted, the video content area can display the text "Video content will be excerpted here" to prompt the user where the excerpted content will be displayed. During the video excerpting process, the text "Recording" can be displayed to prompt the user that recording is in progress. When the recording is paused, the excerpted content can be automatically saved to the video content area and displayed. The recording control can be used to start video recording, and the recording control can be switched to a pause control, which can be used to pause video recording. The mark control can be used to mark the video frame corresponding to a certain time point during the video recording process. The mark can also be called a time mark. The screenshot control can be used to capture the video screen. The completion control can be used to exit the video excerpt mode and trigger the collection of the excerpted video saved to the video content area.

[0198] Optionally, when switching from display interface 402 to display interface 403, a door closing animation effect may be displayed.

[0199] It is understood that the user can drag the first collection state 403a to change its position. The electronic device can detect the drag operation acting on the first collection state 403a, and in response to the drag operation, the electronic device can move the position of the first collection state 403a.

[0200] Optionally, the display interface 502 may also display a prompt card near the bottom of the screen. The prompt card may display the text "Entered video excerpt mode" to prompt the user that the current electronic device has entered video excerpt mode and can perform operations related to video excerpting. Subsequently, after a preset period of time or in response to an operation on a control in the first collection state 403a, the prompt card may disappear.

[0201] As shown in Figures 10(b) and 10(c), when the electronic device detects a click on the recording control included in the first collection state 403a, in response to the click, the first collection state 403a can be switched to display window 403b, and the electronic device can begin recording the video playing on display interface 403. Window 403b is different from the first collection state 403a, except that the recording control switches to a pause control and the recording control name "Recording" switches to a recording duration starting at "00:00." Optionally, the text displayed in the video content area of ​​window 403b can be changed to "Recording" to prompt the user that recording has begun. As the video plays and is recorded accordingly, suppose that after 18 seconds of recording, the electronic device detects a click on the pause control. In response to this click, recording stops, and the video content corresponding to the 18 seconds is temporarily stored in the video content area of ​​window 403c.

[0202] After the excerpt content is temporarily stored, the electronic device can display the form shown in (d) in Figure 10, and window 403b can be switched to window 403c. Compared with window 403b, the video content area of ​​window 403c can include the name of the excerpt video (which can be composed of the text "Video Excerpt" and the recording time by default), as well as the last frame of video image in the recorded video clip. A play control can also be superimposed on the last frame of video image in the first recording segment, and the play control can trigger the playback of the temporarily stored excerpt video clip in the video content area. In addition, compared with window 403c, the pause control of window 5028 is switched back to the recording control, and the recording duration is also switched back to the name of the recording control "Recording", while other controls remain unchanged.

[0203] It is understandable that, based on the display interface 403 shown in (d) in FIG10 , multiple recordings or continuous recordings may be performed subsequently. The recording process is similar to that described above and will not be described in detail here.

[0204] After the above-mentioned excerpt stops, based on form 403c, the electronic device can detect a click operation on the completion control in form 403c; in response to the click operation, the video excerpt is completed, and the excerpt content temporarily stored in the video content area can be collected into the global collection application. During this collection process, as shown in (e) in Figure 10, form 403c can be switched to card 403d, and other contents remain unchanged. The card 403d is used to prompt the source of the video excerpt, such as from vibrato, and display the vibrato icon. Optionally, the card 403d can move toward the bottom edge of the display interface 403 and gradually disappear.

[0205] Optionally, after card 403d disappears, as shown in (f) of FIG10 , the electronic device may display card 403e , with other contents remaining unchanged. Card 403e is used to provide feedback to the user that the excerpted video has been successfully saved, and provides a link to the global saved application, prompting the user to go to the global saved application to view the saved material.

[0206] In the embodiment of the present application, global collection is the default collection method for excerpted videos; of course, excerpted videos can also be collected in other applications, which can be set specifically as needed, and the embodiment of the present application does not limit this.

[0207] For example, the card 403e may display a text link such as "Go to global collection to view"; in response to a click operation on the text link, the electronic device may display a floating icon c1 of the global collection, and the floating icon c1 of the global collection includes an icon indicating the video excerpt content that has just been collected.

[0208] Optionally, after card 403d disappears, as shown in (f) in FIG10 , a hidden icon a in the shape of a hemisphere of global favorites may be displayed on the inner side of the right screen edge of the electronic device to provide an entry to the global favorites application. Optionally, when the hidden icon a is first triggered to be displayed, the electronic device may further display a prompt card near the hidden icon a, prompting the user to enter the global favorites application and view the content collected by the global favorites application by clicking the hidden icon a; the prompt card may also include a close button, which, in response to a click operation by the user, may trigger the closing of the prompt card.

[0209] Optionally, when no operation is received within a preset time period, the card 403e may automatically disappear and not be displayed.

[0210] Optionally, after the above video excerpts are successfully collected, the global collection application can continue to display the hidden icon a on its interface to indicate to the user that the global collection application is still running and any material can be collected into the global collection at any time.

[0211] The above is just one example of a collection of excerpted videos.

[0212] Example 3: Document Collection (as shown in Figures 11 and 12)

[0213] Taking WeChat as an example, an electronic device can display a chat interface in WeChat. In the chat interface, file thumbnails corresponding to multiple files currently received by the electronic device can be included. The thumbnails of the multiple files can be used to trigger the electronic device to display the specific content of the file. For example, the electronic device can detect a click operation on the file thumbnail corresponding to the file "What are the customs of the Minor Snow solar term?"; in response to the click operation, the electronic device displays a preview interface corresponding to the corresponding file, and the electronic device can detect a three-finger swipe operation on the preview interface; in response to the three-finger swipe operation, the electronic device can trigger the entry into the global collection mode and implement the collection of documents in the global collection mode.

[0214] As shown in (a) of FIG11 , the display interface 501 is the display interface corresponding to the aforementioned file. As shown in (a) of FIG11 , the electronic device can detect a three-finger swipe down operation on the display interface 501. In response to the three-finger swipe down operation, the electronic device can enter a global collection mode and display the display interface 502 shown in (b) of FIG11 .

[0215] Optionally, when switching from display interface 501 to display interface 502, a "door opening animation" may be displayed.

[0216] Relative to display interface 501, display interface 502, like display interface 302 in Example 1, may include three areas. The first area 502a located in the upper area is the status bar, which can be described in Example 1 and will not be repeated here. The second area 502b located in the middle area includes a thumbnail, which indicates the display interface 501 displayed by the electronic device when the three-finger swipe gesture is triggered. The content included in the thumbnail is the same as the content of display interface 501, but is smaller in size than the display interface 501. The third area 502c located in the bottom area is used to display multiple operation options. For a detailed description of these operation options, please refer to the description in Example 1 and will not be repeated here.

[0217] In addition, since the display interface 501 corresponds to the document collection scenario, the dedicated options displayed in the third area are document collection options; the third area can also display content extraction options, screenshot collection options in general options, and annotation options, etc.

[0218] It should be noted that the display interface 502 shown in (b) of Figure 11 is only one display interface style provided in the embodiment of the present application. The present application also provides multiple display interface styles, which will be introduced later and will not be repeated here.

[0219] Referring to the display interface 502 shown in (a) of Figure 12, the electronic device can detect a click operation on the document collection option in the display interface 502; in response to the click operation, the display content corresponding to the thumbnail (i.e., the document displayed in the preview interface) will be collected into the global collection application. During this collection process, as shown in (b) of Figure 12, the electronic device can first display a door closing animation, switch from the display interface 502 to the preview interface of the original display file, and display a card 503a on the interface. The card 503a may include information such as the title of the file being collected. Optionally, a close button may also be included in the upper left corner of the card 503a. In response to a click operation on the close button, the electronic device may terminate the collection of the document, and then the card 503a disappears and is not displayed.

[0220] During the document collection process, if no click operation is received on the close button in the upper left corner of card 503a within a preset time period, as shown in Figure 12 (c), card 503a can be switched to card 503b, with other contents remaining unchanged; card 503b is used to indicate the type and size of the document collection. Optionally, card 503b can include an icon corresponding to the document. Optionally, as shown in Figure 12 (d), card 503b can also move toward the bottom edge of display interface 503 and gradually disappear.

[0221] Optionally, after card 503b disappears, as shown in (e) of FIG12 , the electronic device may also display card 503c, with other contents remaining unchanged. Card 503c is used to notify the user that the document has been successfully saved and provides a link to the global saved application, prompting the user to view the saved material in the global saved application.

[0222] In the embodiment of the present application, global collection is the default collection method for documents; of course, documents can also be collected in other applications, which can be set specifically according to needs, and the embodiment of the present application does not limit this.

[0223] For example, the card 503c may display a text link such as "Go to global collection to view"; in response to a click operation on the text link, the electronic device may display a floating icon c1 of the global collection; the floating icon c1 of the global collection includes an icon indicating the document that has just been collected.

[0224] Optionally, when no operation is received within a preset time period, card 503c may automatically disappear and not be displayed.

[0225] Optionally, after card 503b disappears, as shown in (e) in Figure 12, the electronic device may also display a prompt card near the hidden icon a, and the prompt card is used to prompt the user to enter the global collection application and view the content collected by the global collection application by clicking the hidden icon a; the prompt card may also include a close button, which can trigger the closing of the prompt card after responding to the user's click operation.

[0226] The above is just one example of document collection.

[0227] Example 4: Picture Collection (as shown in Figures 13 and 14)

[0228] Taking a gallery application as an example, the electronic device can detect a click operation on the gallery application. In response to the click operation, the electronic device can launch the gallery application and display the main interface of the gallery application (i.e., the default interface displayed after launch). The main interface of the gallery application can include thumbnails of multiple images. The electronic device can detect a click operation on any thumbnail. In response to the click operation, the electronic device can display the image corresponding to the thumbnail in full screen.

[0229] As shown in FIG13(a) , the display interface 601 is the display interface corresponding to the above image. As shown in FIG13(a) , the electronic device can detect a three-finger swipe down operation on the display interface 601. In response to the three-finger swipe down operation, the electronic device can enter the global collection mode and display the display interface 602 shown in FIG13(b) .

[0230] Optionally, when switching from display interface 601 to display interface 602, a "door opening animation" may be displayed.

[0231] Relative to the display interface 601, the display interface 602, like the display interface 602 in Example 1, may include three areas, wherein the first part 602a located in the upper area is the status bar, which may be referred to the introduction in Example 1 and will not be described in detail here. The second part 602b located in the middle area includes a thumbnail, which is used to indicate the display interface 601 displayed by the electronic device when the three-finger downward gesture is triggered; the content included in the thumbnail is the same as the content of the display interface 601, and the size is smaller than the size of the display interface 601. The third part 602c located in the bottom area is used to display multiple operation options. For the specific introduction of the operation options, please refer to the introduction in Example 1 and will not be described in detail here.

[0232] In addition, since the display interface 601 corresponds to the picture collection scene, the dedicated option displayed in the third area is the picture collection option; the third area can also display content extraction options, screenshot collection options in general options, and annotation options, etc.

[0233] It should be noted that the display interface 602 shown in (b) of Figure 13 is only one display interface style provided in the embodiment of the present application. The present application also provides multiple display interface styles, which will be introduced later and will not be repeated here.

[0234] Referring to the display interface 502 shown in (a) in Figure 14, the electronic device can detect a click operation on the picture collection option in the display interface 602; in response to the click operation, the display content corresponding to the thumbnail (i.e., the displayed picture) will be collected into the global collection application. During this collection process, as shown in (b) in Figure 14, the electronic device can first display a door closing effect, switch from the display interface 602 to the interface of the original picture display, and display a card 603a on the interface. The card 603a may include a thumbnail of the picture being collected. Optionally, a close button may also be included in the upper left corner of the card 603a. In response to a click operation on the close button, the electronic device may terminate the collection of the document, and then the card 603a disappears and is not displayed.

[0235] During the process of collecting pictures, if no click operation is received on the close button in the upper left corner of card 603a within the preset time, as shown in (c) and (d) in Figure 14, the card 603b can also move toward the bottom edge of the display interface 603 and gradually disappear.

[0236] Optionally, after card 603a disappears, as shown in (e) of FIG14 , the electronic device may also display card 603b, with other contents remaining unchanged. Card 603b is used to notify the user that the image has been successfully saved and provides a link to the global saved application, prompting the user to view the saved material in the global saved application.

[0237] In the embodiment of the present application, global collection is the default collection method for pictures; of course, pictures can also be collected in other applications, which can be set specifically as needed, and the embodiment of the present application does not limit this.

[0238] For example, the card 603b may display a text link such as "Go to global collection to view"; in response to a click operation on the text link, the electronic device may display a floating icon c1 of the global collection; the floating icon c1 of the global collection includes an icon indicating the document that has just been collected.

[0239] Optionally, when no operation is received within a preset time period, card 603b may automatically disappear and not be displayed.

[0240] Optionally, after card 603a disappears, as shown in (e) in Figure 14, the electronic device may also display a prompt card near the hidden icon a, and the prompt card is used to prompt the user to enter the global collection application and view the content collected by the global collection application by clicking the hidden icon a; the prompt card may also include a close button, which can trigger the closing of the prompt card after responding to the user's click operation.

[0241] The above is just one example of a picture collection.

[0242] Example 5: Screenshot Collection (as shown in Figure 15)

[0243] When the electronic device enters global collection mode in response to a three-finger swipe down operation, taking the display interface 302 shown in (b) of Figure 6 as an example, at this time, if the electronic device detects a click operation on the screenshot collection option, as shown in (a) of Figure 15; in response to the click operation, the display content corresponding to the thumbnail (i.e., the web page displayed on the display interface 301) will be collected into the global collection application in the form of a screenshot generated image. During this collection process, as shown in (b) of Figure 15, the electronic device can first display a door closing animation, switch from the display interface 302 to the interface originally displaying the web page, and display a card 304a on this interface. The card 304a can include the screenshot image being collected, and the screenshot image indicates the screenshot image generated by the display content before the door opening animation is executed. Optionally, a close button can also be included in the upper left corner of the screenshot image. In response to the click operation on the close button, the collection of the screenshot image can be terminated, and then the card 304a disappears and is not displayed.

[0244] During the process of collecting screenshots, if no click operation is received on the close button in the upper left corner of card 304a within the preset time, as shown in (c) and (d) in Figure 15, card 304a can move toward the bottom edge of the display interface 303 and gradually disappear.

[0245] Optionally, after card 304a disappears, as shown in (e) of Figure 15, the electronic device may further display card 304b, with other contents remaining unchanged. Card 304b is used to provide feedback that the screenshot image has been successfully saved and to provide a link to the global saved application.

[0246] In the embodiment of the present application, global collection is the default collection method for screenshots; of course, screenshots can also be collected in other applications, which can be set specifically as needed, and the embodiment of the present application does not limit this.

[0247] For example, the card 304b may display a text link such as "Go to global collection to view"; in response to a click operation on the text link, the electronic device may display a floating icon c1 of the global collection; the floating icon c1 of the global collection includes an icon indicating the screenshot content that has just been collected.

[0248] Optionally, when no operation is received within a preset time period, the card 304b may automatically disappear and not be displayed.

[0249] Optionally, after card 304a disappears, as shown in (e) in FIG15 , a hidden icon a in the shape of a hemisphere of global favorites may be displayed on the inner side of the right screen edge of the electronic device to provide an entry to the global favorites application. Optionally, when the hidden icon a is first triggered to be displayed, the electronic device may further display a prompt card near the hidden icon a, prompting the user to enter the global favorites application and view the content collected by the global favorites application by clicking the hidden icon a; the prompt card may also include a close button, which, in response to a click operation by the user, may trigger the closing of the prompt card.

[0250] The above is just an example of screenshot collection.

[0251] Example 6: Screen capture and collection (as shown in Figures 16 and 17)

[0252] Taking WeChat as an example, an electronic device can display a chat interface in WeChat. In the chat interface, file thumbnails corresponding to multiple files currently received by the electronic device can be included. When the chat interface is slid upward, the interface can also include text, pictures and other content.

[0253] As shown in FIG16(a) , the display interface 701 is the chat interface. As shown in FIG16(a) , the electronic device can detect a three-finger swipe down operation on the display interface 701. In response to the three-finger swipe down operation, the electronic device can enter a global favorites mode and display the display interface 702 shown in FIG16(b) .

[0254] Optionally, when switching from display interface 701 to display interface 702, a "door opening animation" may be displayed.

[0255] Relative to the display interface 701, the display interface 702, like the display interface 302 in Example 1, may include three areas, wherein the first part 702a located in the upper area is the status bar, which may be referred to the introduction in Example 1 and will not be described again here. The second part 702b located in the middle area includes a thumbnail, which is used to indicate the display interface 701 displayed by the electronic device when the three-finger sliding gesture is triggered; the content included in the thumbnail is the same as the content of the display interface 701, and the size is smaller than the size of the display interface 701. The third part 702c located in the bottom area is used to display multiple operation options. For the specific introduction of the operation options, please refer to the introduction in Example 1 and will not be described again here.

[0256] Here, a triangle is also displayed in the lower right corner of the screenshot collection option in the general options. This triangle can be used to trigger switching of general options, such as switching the screenshot collection option to the long screenshot collection option; or, this triangle can be used to trigger the display of a menu card including multiple general options. As shown in Figure 16 (b), the electronic device can detect a click operation on the triangle in the lower right corner of the screenshot collection option; as shown in Figure 16 (c), in response to the click operation, a menu card 702d can be displayed in the display interface 702, and the menu card can include two menu options: "Screenshot Collection" and "Long Screenshot Collection".

[0257] Optionally, as a possible implementation method, as shown in (a) in Figure 17, the electronic device can detect a click operation on the "Screenshot Collection" in the menu card 702d; in response to the click operation, the screenshot collection option displayed in the third part area can be switched to the screenshot collection option, and other contents remain unchanged; subsequently, in response to the click operation on the screenshot collection option, the electronic device can implement the screenshot function.

[0258] Optionally, as another possible implementation method, as shown in (a) in Figure 17, the electronic device can detect a click operation on the "Long Screen Collection" in the menu card 702d; in response to the click operation, as shown in (b) in Figure 17, the electronic device can directly start capturing the long picture.

[0259] Referring to the display interface 703 shown in (b) of FIG17 , when taking a long screenshot, the electronic device may first display a door-closing animation, switch from the display interface 702 to the original chat interface, and display a prompt bar 703a in the top area of ​​the chat interface. The prompt bar 703a may include prompt text, such as "Taking a long screenshot, click the scrolling area to complete the screenshot"; the scrolling area may indicate the area of ​​the chat interface displayed outside the prompt bar. As shown in (c) of FIG17 , the electronic device may detect a click operation on the scrolling area; in response to the click operation, the screenshot is completed.

[0260] After the long screenshot is completed, as shown in (d) in Figure 17, the prompt bar 703a can be switched to a thumbnail 703b, and the other content remains unchanged. Thumbnail 703b can include a thumbnail of the long image being collected. Optionally, a close button can also be included in the upper left corner of card 703b. In response to a click operation on the close button, the electronic device can terminate the collection of the long image, and then card 703b disappears and is not displayed.

[0261] During the process of collecting long images, if no click operation is received on the close button in the upper left corner of card 703b within the preset time, as shown in (e) in Figure 17, the card 703b can also move toward the bottom edge of the display interface 703 and gradually disappear.

[0262] Optionally, after card 703b disappears, as shown in (f) of FIG17 , the electronic device may also display card 703c, with other contents remaining unchanged. Card 703c is used to notify the user that the long image has been successfully saved and provides a link to the global saved application, prompting the user to view the saved material in the global saved application.

[0263] In the embodiment of the present application, global collection is the default collection method for long screenshots; of course, long screenshots can also be collected in other applications, which can be set specifically as needed, and the embodiment of the present application does not limit this.

[0264] For example, the card 703c may display a text link such as "Go to global collection to view"; in response to a click operation on the text link, the electronic device may display a floating icon c1 of the global collection; the floating icon c1 of the global collection includes an icon indicating the document that has just been collected.

[0265] Optionally, when no operation is received within a preset time period, card 703c may automatically disappear and not be displayed.

[0266] Optionally, after card 703b disappears, as shown in (e) in Figure 17, the electronic device may also display a prompt card near the hidden icon a, and the prompt card is used to prompt the user to enter the global collection application and view the content collected by the global collection application by clicking the hidden icon a; the prompt card may also include a close button, which can trigger the closing of the prompt card after responding to the user's click operation.

[0267] The above is just an example of long screenshot collection.

[0268] Example 7: Content Extraction and Collection (as shown in Figures 18 to 20)

[0269] Taking a news app as an example, the electronic device can detect a three-finger swipe down on the display interface corresponding to a news message. In response to the three-finger swipe down, the electronic device can trigger the entry into the global collection mode and add the displayed content to the collection in the global collection mode.

[0270] As shown in FIG18(a), display interface 801 is a webpage of a news message in a news application. As shown in FIG18(a), the electronic device can detect a three-finger swipe down operation on display interface 801. In response to the three-finger swipe down operation, the electronic device can enter a global favorites mode and display display interface 802 as shown in FIG18(b).

[0271] Optionally, when switching from display interface 801 to display interface 802, a "door opening animation" may be displayed.

[0272] Relative to the display interface 801, the display interface 802, like the display interface 302 in Example 1, may include three areas, wherein the first part 802a located in the upper area is the status bar, for which reference may be made to the introduction in Example 1 and will not be described in detail here. The second part 802b located in the middle area includes a thumbnail, which is used to indicate the display interface 801 displayed by the electronic device when the three-finger downward gesture is triggered; the content included in the thumbnail is the same as the content of the display interface 801, and its size is smaller than that of the display interface 801. The third part 802c located in the bottom area is used to display multiple operation options. For the specific introduction of the operation options, reference may be made to the introduction in Example 1 and will not be described in detail here.

[0273] In addition, since the display interface 801 corresponds to the web page collection scene, the dedicated option displayed in the third area is the web page collection option; the third area can also display content extraction options, screenshot collection options in general options, and annotation options, etc.

[0274] It should be noted that the display interface 802 shown in (b) of Figure 18 is only one display interface style provided in the embodiment of the present application. The present application also provides multiple display interface styles, which will be introduced later and will not be repeated here.

[0275] Referring to the display interface 802 shown in (a) of Figure 19, the electronic device can detect a click operation on the content extraction option in the display interface 802; in response to the click operation, the display content corresponding to the thumbnail (ie, the content in the display interface 801) will be extracted and highlighted.

[0276] For example, as shown in display interface 803 in Figure 19(b), compared to display interface 801, this interface highlights the content, such as adding a white background to the bottom of the text and around the image. Based on the highlighted content, the user can subsequently select the content to be collected. In addition, display interface 803 may also include two buttons, namely, a favorites button 803a and an exit button 803b. The favorites button 803a is used to collect the content selected by the user; the exit button 803b is used to trigger the exit of the global favorites mode.

[0277] Optionally, when switching from display interface 802 to display interface 803, a door closing animation can be displayed.

[0278] It should be understood that in the display interface 803 shown in (b) of Figure 19, since the user has not made any selection for the displayed content, the collection button 803a is grayed out and is unavailable, and cannot respond to the user's click operation; however, the exit button 803b is available and can receive click operations; in response to the click operation, the collection can be terminated and the global collection mode can be exited.

[0279] Based on the display interface 803 shown in (c) of Figure 19, the electronic device can detect a selection operation on a section of content in the display interface 804 (such as a long press followed by a left or right sliding operation on the left or right handle); as shown in (c) of Figure 19, in response to the selection operation, a portion of the highlighted content can be selected. For ease of description, this application may record the selected portion of content as target content 803c (such as the content with a gray background in (c) of Figure 19).

[0280] Optionally, the target content 803c may include text and / or pictures.

[0281] Optionally, the target content 803c includes content continuously arranged between the left handle and the right handle; or, the target content 803c includes text content continuously arranged between the left handle and the right handle, and does not support jump selection; for pictures, the user is required to click to select.

[0282] It should be understood that in the display interface 803 shown in (c) of FIG. 19 , since the user has made a selection with respect to the displayed content, the favorites button 803 is switched from an unavailable state to an available state.

[0283] After selecting a portion of the highlighted content, the electronic device can detect a click on the favorites button 803a; as shown in Figure 19 (d), in response to this click, the target content 803c will be collected into the global favorites application. During this collection process, as shown in Figure 19 (e), the target content 803c can be switched to its original highlighted state, the favorites button 803a and the exit button 803b are removed, and a card 803d is displayed on the interface. The card 803d may include a thumbnail of the target content being collected.

[0284] Optionally, a close button may be included in the upper left corner of the card 803d. In response to a click operation on the close button, the collection of the web page may be terminated, and then the card 803d disappears and is not displayed.

[0285] Optionally, the card 803d may move toward the bottom edge of the display interface 803 and gradually disappear.

[0286] During the process of collecting the target content 803c, if no click operation is received on the close button in the upper left corner of the card 803d within the preset time period, as shown in (f) in Figure 19, the card 803d can be switched to display as a collection button 803a and an exit button 803b, and other contents remain unchanged. At this time, the collection button 803a is grayed out, which is the same as the state shown in (b) in Figure 19.

[0287] Based on the display interface 803 shown in (f) of Figure 19, if the user needs to collect other content, he or she can continue to collect according to the process shown in (c) to (e) of Figure 19 above. That is, after entering the content extraction function, the user can select the target content multiple times, and each click of the collection button 803a will collect the selected target content into the global collection application, and the collection of multiple target contents can be realized multiple times in a row. The embodiment of the present application does not impose any restrictions on this.

[0288] In the embodiment of the present application, global collection is the default collection method for extracted content; of course, the extracted content can also be collected in other applications, which can be set specifically as needed, and the embodiment of the present application does not limit this.

[0289] Based on the display interface 803 shown in (f) in Figure 19, if the collection is completed, the electronic device can detect a click operation on the exit button, as shown in (a) in Figure 20; in response to the click operation on the exit button 803b, the global collection mode is exited, and the interface can be switched to the interface of the original web page display (i.e., display interface 801), as shown in (b) in Figure 20.

[0290] Alternatively, as shown in FIG20( b ), the electronic device may display a card 803e on the display interface 801, with other contents remaining unchanged. The card 803e is used to notify the user that the extracted content has been successfully saved and provides a link to the global saved application, prompting the user to view the saved content in the global saved application.

[0291] For example, the card 803e may display a text link such as "Go to global collection to view"; in response to a click operation on the text link, the electronic device may display a floating icon c1 of the global collection, and the floating icon c1 of the global collection includes an icon indicating the video excerpt content that has just been collected.

[0292] Optionally, after the favorites button 803a and the exit button 803b disappear, as shown in (b) of FIG20 , a hidden icon a in the shape of a hemisphere of global favorites may be displayed on the inner side of the right screen edge of the electronic device to provide an entry to the global favorites application. Optionally, when the hidden icon a is first triggered to be displayed, the electronic device may also display a prompt card near the hidden icon a, which prompts the user to enter the global favorites application and view the content collected by the global favorites application by clicking the hidden icon a; the prompt card may also include a close button, which, in response to the user's click operation, may trigger the closing of the prompt card.

[0293] Optionally, when no operation is received within a preset time period, the card 803e may automatically disappear and not be displayed.

[0294] Optionally, after the above-mentioned extracted content is successfully collected, the global collection application can continue to display the hidden icon a on its interface to indicate to the user that the global collection application is still running and any material can be collected into the global collection at any time.

[0295] The above is just an example of extracting content for collection.

[0296] Optionally, as a possible implementation method, as shown in the display interface 802 in (a) of Figure 19, the electronic device can detect a click operation on the content extraction option in the display interface 802; in response to the click operation, the display content corresponding to the thumbnail (i.e., the content in the display interface 801) will be extracted, and the word segmentation blocks will be blown out for display. For example, a white background is added to the bottom of each text and the bottom of the picture independently. Based on the content displayed in the form of word segmentation blocks, subsequent users can select the content to be collected. For example, smear and / or click on the required block content. Other content is similar to the above examples and will not be repeated here.

[0297] Optionally, as another possible implementation method, as shown in the display interface 802 in (a) of Figure 19, the electronic device can detect a click operation on the content extraction option in the display interface 802; in response to the click operation, the display content corresponding to the thumbnail (i.e., the content in the display interface 801) will be extracted and structured on a new layer. As shown in Figure 21. Based on the structured tiling of the extracted content, the user can subsequently check the content to be collected, or collect all checked content with one click. Other content is similar to the above example and will not be repeated here.

[0298] The above content is an introduction to the seven collection scenarios provided in the embodiments of this application.

[0299] In an embodiment of the present application, by combining with a global collection application, it is possible to collect materials from different sources and different types of materials, expand the collection scenarios, and unify the collection method into a three-finger swipe method; when the collection method provided by the present application is triggered, it can accurately determine how the user wants to retain the content, and provide corresponding operation options to support the retention of the material; in addition, this unified collection method has no learning cost for the user, and can facilitate users to efficiently collect materials in any scenario, and all materials are collected into the global collection application.

[0300] Part II:

[0301] Taking the display interface 301 shown in FIG6(a) as an example, which is the display interface corresponding to a webpage, as shown in FIG6(a), the electronic device can detect a three-finger swipe down operation on the display interface 301. In response to the three-finger swipe down operation, the electronic device can enter the global collection mode, and the displayed interface can be any of the interfaces shown in FIG22.

[0302] In Example 1, as shown in (a) of FIG22 , the display interface 302 includes three areas. A first area 302a located at the top is a status bar, a second area 302b located in the middle may include thumbnails, and a third area 302c located at the bottom is used to display multiple operation options. For a detailed introduction to the status bar, thumbnails, and operation options, please refer to Example 1 and will not be repeated here.

[0303] Optionally, when displayed, the operation options in the third part 302c are displayed from left to right in the order of dedicated options, content extraction options and general options.

[0304] Compared to the third section shown in (b) of Figure 6 , the third section shown in (a) of Figure 22 may also include a collection space icon and icon name indicating all materials collected in the global collection application. For example, the collection space icon is icon M shown in (a) of Figure 22 . Optionally, the collection space icon M may be composed of multiple independent icons for the collected materials. Optionally, the icon name may be, for example, "My Collection" by default.

[0305] Optionally, the favorites space icon, the dedicated options, the content extraction options, and the general options may be displayed in sequence from left to right or from right to left.

[0306] In Example 2, as shown in (b) of Figure 22, the display interface 302 includes three areas. A first area 302a located at the top is a status bar, a second area 302b located in the middle may include thumbnails, and a third area 302c located at the bottom is used to display multiple operation options. For details on the status bar, thumbnails, and operation options, please refer to Example 1 and will not be repeated here.

[0307] Relative to the third part shown in (b) in Figure 6, the third part shown in (b) in Figure 22 can be divided into two halves, the left half can display multiple operation options, and the right half can display the collection space and the space name. The collection space can include multiple material icons, and the material icons are used to indicate the materials that have been collected into the global collection application. By default, the material icons corresponding to the three most recently collected materials can be displayed. The name of the space can be, for example, "Magic Collection Space". Optionally, the three material icons are displayed tiled, or they can be displayed semi-overlappingly, which is not limited in the embodiments of the present application.

[0308] Optionally, when displayed, the operation options in the left half area are displayed from left to right in the order of dedicated options and content extraction options.

[0309] Optionally, the left half area and the right half area may be swapped.

[0310] In Example 3, as shown in (c) of Figure 22, the display interface 302 may include four areas, wherein the first area 302a located in the upper area is the status bar, the second area 302b located in the middle area may include thumbnails, and the third area 302c is used to display multiple operation options. For an introduction to the status bar, thumbnails, and operation options, please refer to Example 1 for details and will not be repeated here.

[0311] Compared to the interface shown in FIG6(b), the fourth portion 302d shown in FIG22(c) can display a favorites space and its name. The favorites space can include multiple thumbnails of materials collected in the global favorites application. For example, by default, the thumbnails corresponding to the four most recently collected materials can be displayed, and these four thumbnails can be displayed in a tiled manner. The space name can be, for example, "Magic Favorites Space."

[0312] Optionally, the third part 302c is located at the bottom and the fourth part 302d can be located between the first part 302a and the second part 302b, as shown in (c) in Figure 22, or the fourth part 302d is located at the bottom and the third part 302c can be located between the first part 302a and the second part 302b, as shown in (d) in Figure 22.

[0313] Optionally, when displayed, the operation options in the third part 302c are displayed from left to right in the order of dedicated options, content extraction options, and general options.

[0314] In example four, (a) in FIG23 is the same as (a) in FIG6 . In response to the three-finger swipe operation, the electronic device may display a display interface 302 as shown in (b) in FIG23 . The display interface 302 may include four areas, wherein the first part 302a located in the upper area is the status bar, the third part 302c located in the middle area is used to display multiple operation options, and the second part 302b located in the bottom area may include thumbnails. For the introduction of the status bar, thumbnails, and operation options, please refer to Example 1 for details, which will not be repeated here.

[0315] Compared to the interface shown in FIG6(b), the fourth portion 302d shown in FIG23(b) may display a favorites space, a close button, a settings button, etc. The favorites space may include thumbnails of multiple materials collected in the global favorites application. For example, by default, thumbnails corresponding to the six most recently collected materials may be displayed, and these six thumbnails may be displayed in a tiled manner.

[0316] Optionally, the fourth part may be displayed in the hot zone on the left, as shown in (b) of FIG. 23 , or may be displayed in the hot zone on the right.

[0317] Optionally, when displayed, the operation options in the third part 302c are displayed from left to right in the order of dedicated options, content extraction options, and general options.

[0318] It should be understood that the collection space is equivalent to the suspended state of the global collection, and includes the same content as the suspended state.

[0319] Optionally, the thumbnails in the above four examples may be displayed in a tiled format.

[0320] Optionally, the second portion 302b in the four examples above can also be referred to as the original application display area, which is used to display the content displayed before the three-finger swipe operation triggered the display interface 302, and the content displayed in the second portion 302b can be switched by user operation. For example, in response to an up or down swipe operation on the original display content of the second portion 302b, the displayed content can be switched.

[0321] It should be understood that, as shown in (c) and (d) in FIG. 22 , the third portion 302c is the operation area, and the fourth portion 302d is the material display area.

[0322] 1. Collection method 1

[0323] In combination with the above-mentioned example four, referring to the display interface 1002 shown in (a) in Figure 24, the electronic device can detect a click operation on the web page collection option in the display interface 1002; in response to the click operation, the display content corresponding to the thumbnail (i.e., the web page displayed on the display interface 301) will be collected into the global collection application.

[0324] During this collection process, as shown in (b) in FIG24 , the web page content corresponding to the thumbnail will gradually shrink and dynamically move from the display area on the right to the collection space on the left.

[0325] After the collection is completed, as shown in the display interface 1003 in (c) of Figure 24, the collection space on the left will include icons of the web page content just collected, and the icons corresponding to the previously collected materials will move toward the bottom edge of the electronic device in sequence.

[0326] It should be noted that the above only takes the collection of web pages as an example. Based on the display style shown in (b) in Figure 23, in the embodiment of the present application, you can also collect excerpted videos, documents, pictures, screenshots, long screenshots and extracted content, etc. The specific details can be found in the above-mentioned embodiments 2 to 7, which will not be repeated here.

[0327] 2. Collection method 2

[0328] In combination with the above example four, referring to the display interface 1002 shown in (a) in Figure 25, the electronic device can detect user operations on the pictures included in the interface display area in the display interface 1002. In response to the user operations, the pictures will be collected into the global collection application.

[0329] Optionally, the above user operation may include a long press and drag operation, or the user operation may be a throwing operation.

[0330] It should be understood that the long press and drag operation is a continuous operation. During the long press and drag period, the finger pressed by the user will not be lifted.

[0331] Taking the user operation including long press and drag operation as an example, during the collection process, as shown in (b) of Figure 25, in response to the long press operation, the picture is selected, and the electronic device can display the thumbnail corresponding to the picture at the position where the user performs the long press operation; next, the user can move the position of the picture thumbnail by dragging to move the picture; in response to the drag operation on the picture thumbnail, the picture thumbnail can be moved from the display area on the right to the collection space on the left. Optionally, as shown in (b) and (c) of Figure 25, in the process of entering the collection space from the display area on the right, the picture thumbnail gradually shrinks.

[0332] After the collection is completed, as shown in the display interface 1003 in (d) of FIG25 , the collection space on the left includes icons of the pictures just collected, and the icons corresponding to the previously collected materials will move toward the bottom edge of the electronic device in sequence.

[0333] Optionally, the above is only illustrated by taking the example of including pictures in the interface display area. Optionally, the interface display area may also include documents, videos, screenshots, long-screen pictures, etc.

[0334] 3. After adding a collection once, switch to the second collection method 1 and method 2

[0335] Optionally, as a feasible method, after collecting once, if the user desires to switch the application to collect other materials a second time, based on the display interface 302 shown in (a) in Figure 26, the user can slide from the bottom edge of the electronic device toward the center of the display screen; in response to the sliding operation, the electronic device can switch from the display interface 302 to the desktop 1001, as shown in (b) in Figure 26.

[0336] Optionally, the sliding operation may also include sliding from the left edge of the electronic device toward the middle, or sliding from the right edge of the electronic device toward the middle, which is not limited in this embodiment of the present application.

[0337] After switching to desktop 1001, the electronic device can detect user operations performed by the user on the gallery application, such as: detecting a click operation on the gallery APP, and in response to the click operation, the electronic device can display the main interface of the gallery application; when a click operation on any picture thumbnail in the main interface is detected, in response to the click operation, the electronic device can display the picture corresponding to the thumbnail in full screen mode, such as the display interface 1002 shown in (c) in Figure 26.

[0338] When an electronic device displays a picture, if the user wants to collect the picture, he or she can use three fingers to swipe down to trigger the global collection mode again.

[0339] For example, as shown in (c) in Figure 26, the electronic device can detect a three-finger swipe down operation on the display interface 1002. In response to the three-finger swipe down operation, the electronic device can enter the global collection mode and display the display interface 1003 as shown in (d) in Figure 26.

[0340] The style of the display interface 1003 can refer to the introduction in the aforementioned exemplary embodiment 4, which will not be repeated here.

[0341] In addition, since the display interface 1003 corresponds to the picture collection scene, the dedicated option displayed in the third part is the picture collection option; the third part can also display content extraction options, screenshot collection options in general options, etc.

[0342] The electronic device can detect a click operation on the picture collection option in the display interface 1003; in response to the click operation, the picture will be collected into the global collection application. The collection process can refer to the introduction of the collection method 1 above, which will not be repeated here.

[0343] Optionally, as another feasible method, after collecting once, if the user desires to switch applications to collect other materials a second time, in a local area of ​​the display screen, that is, in the original application display area, the user can operate the interface displayed in the original application display area to switch applications in the original application display area.

[0344] For example, based on the display interface 302 shown in (a) in Figure 26, the user clicks on the close button included in the upper left corner of the interface in the original application display area, or slides from the bottom edge to the center of the original application display area; in response to the click operation or the slide operation, the interface in the original application display area can be switched to display as the desktop.

[0345] When the interface in the original application display area is switched to the desktop, the electronic device can detect the user's click operation on the gallery application; in response to the click operation, the electronic device can display the main interface of the gallery application in the original application display area; when a click operation on any picture thumbnail of the main interface is detected, in response to the click operation, the electronic device can display the picture corresponding to the thumbnail in the original application display area.

[0346] When the electronic device switches to display a certain picture in the original application display area, since the type of content displayed in the original application display area has changed, the electronic device can indicate in real time that the options displayed in the operation area also change accordingly, such as switching the dedicated option from a web page collection option to a picture collection option.

[0347] Then, as shown in (d) of FIG. 26 , in response to a click operation on the picture collection option, the picture displayed in the original application display area may be collected into the global collection application.

[0348] It should be understood that in this collection method, after the three-finger swipe down operation triggers the display screen to display in a partitioned state, the electronic device is equivalent to being in a global collection mode all the time. Without exiting the partitioned display state, it can respond to multiple user operations in the original application display area to switch applications and perform secondary collection of materials.

[0349] For the above two methods, after the second collection is completed, if the user wishes to switch applications to collect other materials, the user can switch applications and collect materials in any of the above methods. If the user wishes to exit the global collection mode, the user can click the close button in the upper left corner of the display interface 1003; in response to the click of the close button, the electronic device can exit the global collection mode and switch back to the display interface before entering the global collection mode.

[0350] For example, after the second collection of pictures is completed, if the user wants to exit the global collection mode, the user can click the close button in the upper left corner of the display interface 1003, as shown in (e) in Figure 26; in response to the click operation on the close button, the electronic device can exit the global collection mode and switch back to the display interface 1002 before entering the global collection mode, as shown in (f) in Figure 26.

[0351] 4. Method 3 of switching apps to add to favorites again after adding to favorites once

[0352] After collecting once, if the user wants to switch the application to collect other materials for the second time, he needs to exit the global collection mode first. For example, the user can click the close button; in response to the click operation on the close button, the electronic device exits the global collection mode and switches back to the display interface before entering the global collection mode.

[0353] For example, after the web page is collected for the first time, based on the display interface 302 shown in (a) in Figure 27, the electronic device can detect the user's click operation on the close button; in response to the click operation on the close button, the electronic device can exit the global collection mode and switch back to the display interface 301 before entering the global collection mode.

[0354] Next, the electronic device can continue to add the second collection in response to the user's operation. For example, based on the display interface 301 shown in Figure 27 (b), the user can slide from the bottom edge to the middle of the bottom display area of ​​the electronic device; in response to the sliding operation, the electronic device can switch from the display interface 301 to the desktop 1001, as shown in Figure 27 (c).

[0355] Optionally, the sliding operation may also include sliding from the left edge of the electronic device toward the middle, or sliding from the right edge of the electronic device toward the middle, which is not limited in this embodiment of the present application.

[0356] After switching to desktop 1001, the electronic device can detect user operations performed by the user on the gallery application, such as: detecting a click operation on the gallery APP, and in response to the click operation, the electronic device can display the main interface of the gallery application; detecting a click operation on any picture thumbnail in the main interface, and in response to the click operation, the electronic device can display the picture corresponding to the thumbnail in full screen mode, as shown in the display interface 1002 in (d) of Figure 27.

[0357] When an electronic device displays a picture, if the user wants to collect the picture, he or she can use three fingers to swipe down to trigger the global collection mode again.

[0358] For example, as shown in (d) in Figure 27, the electronic device can detect a three-finger swipe down operation on the display interface 1002. In response to the three-finger swipe down operation, the electronic device can enter the global collection mode and display the display interface 1003 as shown in (e) in Figure 27.

[0359] The style of the display interface 1003 can refer to the introduction in the aforementioned exemplary embodiment 4, which will not be repeated here.

[0360] In addition, since the display interface 1003 corresponds to the picture collection scene, the dedicated option displayed in the third area is the picture collection option; the third area can also display content extraction options, screenshot collection options in general options, etc.

[0361] The electronic device can detect a click operation on the picture collection option in the display interface 1003; in response to the click operation, the picture will be collected into the global collection application. The collection process can refer to the introduction of the collection method 1 above, which will not be repeated here.

[0362] After the second collection is completed, if the user wishes to switch applications to collect other materials, the application can be switched and the materials can be collected in the same manner as described above. If the user wishes to exit the global collection mode, the user can click the close button in the upper left corner of the display interface 1003; in response to the click of the close button, the electronic device can exit the global collection mode and switch back to the display interface before entering the global collection mode.

[0363] For example, after the second collection of pictures is completed, if the user exits the global collection mode, the user can click the close button in the upper left corner of the display interface 1003; in response to the click operation on the close button, the electronic device can exit the global collection mode and switch back to the display interface 1002 before entering the global collection mode.

[0364] 5. Distribute collected materials

[0365] Taking the note application as an example, when the electronic device displays the note application, if the user needs to add favorite materials to the notes, he or she can use three fingers to swipe down to trigger the global collection mode, and then distribute the materials in the global collection mode.

[0366] For example, the display interface 1101 shown in Figure 28 (a) is the display interface corresponding to the note-taking application. The electronic device can detect a three-finger swipe down operation on display interface 1101; in response to this three-finger swipe down operation, the electronic device can enter global collection mode and display display interface 1102 as shown in Figure 28 (b). This display interface is the same as the display interface 1003 shown in Figure 26 (e) or Figure 27 (f) after the image is added to the collection twice.

[0367] Based on the display interface 1102 shown in (b) in Figure 28, the electronic device can detect a long press and drag operation on the picture icon in the collection space in the hot zone on the left side of the display interface 1102; in response to the long press and drag operation, the picture will be distributed to the note application indicated by the thumbnail on the right.

[0368] It should be understood that the long press and drag operation here is a discontinuous operation, and during the long press and drag operation, the user's pressing finger can be lifted.

[0369] Optionally, after performing a long press operation and before a drag operation, you can also perform multiple click operations on the materials in the collection space to select multiple materials; subsequently, when performing a drag operation, multiple materials can be distributed at one time.

[0370] For example, as shown in (b) in Figure 28, in response to a long press operation on the picture icon in the collection space, the picture icon is in a selected state, and the selected state is used to indicate that a semi-transparent layer and a selection mark are added above the icon. The selection mark includes, for example, a circular area and a check mark located in the circular area.

[0371] Based on the display interface 1102 shown in FIG28(c), if the user also wants to share the sixth picture at the bottom of the favorites space, the user can select the icon by clicking on it. As shown in FIG28(c), the electronic device can detect the click operation on the sixth picture icon at the bottom of the favorites space, and in response to the click operation, the picture icon can be selected.

[0372] Next, the user can drag and move the positions of the two selected icons to distribute the materials; in response to the drag operation on the picture icon, the picture icon can be moved from the collection space on the left to the display area on the right. Optionally, as shown in (d) in Figure 28, in the process of moving from the collection space on the left to the display area on the right, multiple individual picture icons can be switched from a separate tiled arrangement to a stacked arrangement. In addition, the number of icons and an addable mark (such as a plus sign) can be displayed above the stacked icons. The addable mark is used to feedback the position where the material can be added in the display area during the dragging process.

[0373] Optionally, in the process of moving from the collection space on the left to the display area on the right, the stacked icons gradually become larger.

[0374] After moving to the position where the material can be added in the right display area, the user can lift the finger to release the material; in response to lifting the finger, the electronic device can add the dragged material to the right display area, as shown in (e) in Figure 28.

[0375] After the distribution is completed, as shown in (e) in FIG. 28 , the material just dragged still exists in the collection space, and the display status is the same as that in the collection space before the distribution.

[0376] After the distribution is completed, if the user wants to exit the global collection mode, he can click the close button in the upper left corner of the display interface 1102, as shown in (e) in Figure 28; in response to the click operation on the close button, the electronic device can exit the global collection mode and switch back to the display interface 1101 before entering the global collection mode, that is, the interface corresponding to the note application, as shown in (f) in Figure 28.

[0377] It should be understood that since picture materials are distributed for the note in the global collection mode, after returning to the interface of the note application, the display content in the interface should include the distributed picture materials, which should be the same as the content of the right display area corresponding to (e) in Figure 28.

[0378] 6. Preview

[0379] Taking the display interface 1003 shown in (d) in Figure 25 as an example, after entering the global collection mode and completing the picture collection, if the user wants to preview the pictures just collected, at this time, he can directly click the picture icon displayed in the left area, as shown in (a) in Figure 29; in response to the click operation on the picture icon, the electronic device can display the material preview interface corresponding to the picture icon, as shown in (b) in Figure 29.

[0380] 7. Sharing

[0381] Optionally, taking (b) in Figure 29 as an example, when displaying the preview interface of the picture, the preview interface may also include a share button and a delete button. The share button is used to trigger sharing of the material to other devices or applications, and the delete button is used to trigger deletion of the material in the global collection.

[0382] Referring to (a) in FIG. 30 , the electronic device may detect a click operation on the share button; in response to the click operation, the electronic device may display a share card on the preview interface, as shown in (b) in FIG. 30 .

[0383] Optionally, as shown in (b) of FIG30 , the sharing card included in the preview interface may include four display areas from top to bottom, such as a first display area 30a, a second display area 30b, a third display area 30c and a fourth display area 30d.

[0384] The first display area 30a can display the icon, name, data size, and format of the shared material. A small triangle, called a drop-down menu control, can also be displayed next to the material format. This control, when triggered by the user, displays a drop-down menu and provides more image format options for the user to choose from. In other words, the user can switch the material format by making a selection.

[0385] The second display area 30b may include device icons for multiple devices that have established a trusted device connection with the device. This application does not limit the connection method. The multiple device icons can be used to trigger the sending of materials to the corresponding devices. For example, the multiple device icons may include "User 1's X30". Subsequently, in response to a click operation on the device icon, the electronic device may send the material to the device indicated by "User 1's X30".

[0386] The third display area 30c may include multiple application icons that can be used to trigger sharing of content to corresponding applications. For example, the multiple application icons may include a browser, contacts, email, notes, and gallery. Subsequently, in response to a click on the note application icon, the electronic device may send the content to the note application.

[0387] The fourth display area 30d may include two options: "Save" and "Print". "Save" can store the material on the device without sharing it. "Print" can send the material to a connected printer for printing.

[0388] The above is just an example of one sharing method.

[0389] In the embodiment of the present application, after entering the global collection mode through a unified gesture operation, the display interface can combine the display area and the operation area containing the collected materials into one. The interface layout is different from the existing technology and is more convenient for users to use. Combining the two display areas and operation areas, it can not only realize the collection of materials, but also realize the distribution and preview of materials, etc., realizing more functions. At the same time, when the user triggers to enter the global collection mode, the operation area can also provide corresponding operation options to support the retention of materials based on the user's desired content retention method.

[0390] Compared with the existing technology, the three-finger swipe operation in the existing technology usually only corresponds to two types of materials: web pages and video excerpts. When it is determined to be any of these two types of materials, the material is collected into the note application, and each three-finger swipe operation only collects the material once. The three-finger swipe operation in this application is equivalent to the trigger gesture for entering the global collection mode. After entering the global collection mode, it can realize the collection of materials from multiple sources and multiple types, and it can also realize the collection of multiple materials from the same application or different applications. In addition, it can also realize functions such as material distribution, preview and sharing. The definition of the three-finger swipe operation in the embodiment of this application is more extensive.

[0391] Furthermore, the global collection provided by the embodiment of the present application is completely different from the processing logic of the prior art. The prior art is equivalent to processing performed on the application side where the collected material is located, while the present application can judge the displayed content when the user triggers the global collection, and provide corresponding retention methods and auxiliary operation options, providing users with more operation possibilities and more processing possibilities for the materials in the collection process, which is equivalent to switching from the application side where the collected material is located to the operation and processing on the global collection application side used to collect the material.

[0392] FIG31 is an exemplary flowchart of a material processing method provided in an embodiment of the present application.

[0393] In some possible cases, the exemplary process involved in the electronic device processing the material can refer to the following description of steps S3101 to S3107.

[0394] S3101: Display a first interface of a first application in full screen, where the first interface includes a first initial material.

[0395] It is understandable that when the first interface of the first application is displayed in full screen, the first interface may not include a status bar.

[0396] S3102. In response to the first target operation, the display screen is in a partitioned display state. The partitioned display state means that the display screen is divided into an original application display area, a material display area, and an operation area for display. The original application display area includes a first interface, the operation area includes a first option, and the material display area includes a first material icon. The first material icon is used to indicate the material that has been collected into the target application.

[0397] It can be understood that the target application is the global favorite application mentioned above.

[0398] It can be understood that the first target operation is the same as the second target operation.

[0399] For example, the first target operation and the second target operation may be the aforementioned three-finger swiping operation.

[0400] It can be understood that the first operation, the second operation, and the third operation can be click operations.

[0401] In one possible implementation, the first interface may indicate the display interface 301 shown in (a) of Figure 23, the partitioned display state may indicate the display interface 302 shown in (c) and (d) of Figure 22 and shown in (b) of Figure 23, the original application display area is the second part area 602b, the operation area is the third part area 302c, and the material display area is the fourth part 302d.

[0402] In one possible implementation, the first interface may be the display interface 301 shown in FIG6(a), the partitioned display state may be the display interface 302 shown in FIG6(b), the original application display area is the second portion 302b, and the operation area is the third portion 302c. The first initial material is a webpage type, so the corresponding first option is a webpage collection option.

[0403] In one possible implementation, the first interface may be display interface 501 shown in FIG11(a), the partitioned display state may be display interface 502 shown in FIG11(b), the original application display area may be second portion 502b, and the operation area may be third portion 502c. The first initial material is a document type, so the corresponding first option is a document collection option.

[0404] In one possible implementation, the first interface may be the display interface 601 shown in FIG13(a), the partitioned display state may be the display interface 602 shown in FIG13(b), the original application display area is the second portion 602b, and the operation area is the third portion 602c. The first initial material is a picture type, so the corresponding first option is the picture collection option.

[0405] S3103: In response to the first operation on the first option, the first initial material is collected into the target application, and a second material icon is added to the material display area, where the second material icon corresponds to the first initial material.

[0406] S3104: After exiting the partition display state, displaying a second interface of the second application in full screen, the second interface including a second initial material, the type of the second initial material being different from the type of the first initial material.

[0407] It is understandable that when the second interface of the second application is displayed in full screen, the second interface may not include a status bar.

[0408] S3105. In response to the second target operation, the display screen is in a partitioned display state, wherein the original application display area includes the second interface, the material display area includes the first material icon and the second material icon, and the first option in the operation area is switched to the second option, and the first option is different from the second option.

[0409] It can be understood that the first option corresponds to the type of the first initial material, and the second option corresponds to the type of the second initial material. When the types of the materials are different, the first option will be different.

[0410] S3106: In response to the second operation on the second option, the second initial material is collected into the target application, and a third material icon is added to the material display area, where the third material icon corresponds to the second initial material.

[0411] The process of collecting the first initial material and the second initial material may indicate any two of the web page collection process shown in FIG. 8 and FIG. 24 , the document collection process shown in FIG. 12 , the picture collection process shown in FIG. 14 , and the like.

[0412] S3107: In response to a third operation on any material icon, the display is switched from the partition display state to a material preview interface, where the material preview interface corresponds to the material indicated by the material icon.

[0413] The material preview process may indicate the preview process shown in FIG. 29 .

[0414] In the embodiment of the present application, for the collected materials, a preview can also be directly triggered through the material icon shown in the material display area in the partition display state.

[0415] In an embodiment of the present application, a unified target operation can be used to trigger the display screen to enter a partitioned display state, indicating that a global collection mode has been entered. The operation is simple and efficient, and the collection of materials from different sources and types can be achieved. Moreover, when entering the partitioned display state, it can accurately determine how the user wants to retain the content, and provide corresponding operation options to support the retention of the material. In the partitioned display state, the original application display area before entering the global collection mode and the new operation area and material display area are combined into one display, which is convenient for users to view and operate, and expands the operation function. In addition, all materials are collected into the global collection application.

[0416] The following describes the device involved in the embodiments of the present application.

[0417] Figure 32 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0418] The electronic device may include a processor 110 , an external memory interface 120 , an internal memory 121 , an audio module 130 , a speaker 130A, a receiver 130B, a microphone 130C, an earphone interface 130D, a display 140 , a camera 150 , and a touch sensor 160 .

[0419] The structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware. The interface connection relationship between the modules illustrated in the embodiments of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device.

[0420] The processor 110 may include one or more processing units, for example, an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The processor 110 may also include a memory for storing instructions and data.

[0421] The electronic device implements display functions through a GPU, a display screen 140 , and an application processor.

[0422] The GPU is a microprocessor for image processing that connects the display screen 140 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information. Display screen 140 is used to display images, videos, and the like. In some embodiments, the electronic device may include one or N display screens 140, where N is a positive integer greater than one.

[0423] In the embodiment of the present application, the ability of the electronic device to display the user interfaces shown in the aforementioned FIG. 3 to FIG. 31 depends on the display functions provided by the aforementioned GPU, display screen 140 , and application processor.

[0424] The camera 150 is used to capture still images or videos. The ISP is used to process data fed back by the camera 150. Light is transmitted to the camera's photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera's photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The electronic device may include 1 or N cameras 150, where N is a positive integer greater than 1. The video codec is used to compress or decompress digital video. The electronic device may support one or more video codecs. In this way, the electronic device can play or record videos in multiple encoding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0425] The internal memory 121 may include one or more random access memories (RAMs) and one or more non-volatile memories (NVMs). The RAM can be directly read and written by the processor 110 and can be used to store executable programs (e.g., machine instructions) of the operating system or other running programs, as well as user and application data. The NVM can also store executable programs and user and application data, and can be pre-loaded into the RAM for direct reading and writing by the processor 110.

[0426] In the embodiment of the present application, the code for implementing the information processing method described in the embodiment of the present application may be stored in a non-volatile memory. When running the camera application, the electronic device may load the executable code stored in the non-volatile memory into the random access memory.

[0427] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device.

[0428] The electronic device can implement audio functions through the audio module 130, the speaker 130A, the receiver 130B, the microphone 130C, the headphone jack 130D, and the application processor.

[0429] The audio module 130 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The speaker 130A, also known as a "speaker," is used to convert audio electrical signals into sound signals. The receiver 130B, also known as a "handset," is used to convert audio electrical signals into sound signals. The microphone 130C, also known as a "microphone," is used to convert sound signals into electrical signals. The headphone jack 130D is used to connect a wired headset.

[0430] In the embodiment of the present application, when the speech-to-text function is turned on, the electronic device can enable the microphone 130C to collect sound signals and convert the sound signals into corresponding text.

[0431] Touch sensor 160, also known as a "touch device," can be disposed on display screen 140. The touch sensor 160 and display screen 140 form a touch screen, also known as a "touch screen." Touch sensor 160 is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via display screen 140. In other embodiments, touch sensor 160 can also be disposed on the surface of the electronic device, at a location different from that of display screen 140.

[0432] In the embodiment of the present application, the electronic device may utilize the touch sensor 160 to detect operations such as clicks and slides performed by the user on the display screen 140 to implement the material processing method shown in FIG. 3 to FIG. 31 .

[0433] Figure 33 is a schematic diagram of the software structure of an electronic device provided in an embodiment of the present application.

[0434] The software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device.

[0435] It should be understood that the layered architecture can divide the software into several layers, each with a clear role and division of labor; the layers can communicate with each other through software interfaces.

[0436] As shown in Figure 33, the Android system can be divided into four layers: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer. The application layer can include a series of application packages.

[0437] As shown in FIG33 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

[0438] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0439] As shown in FIG33 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0440] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0441] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0442] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0443] The phone manager is used to provide communication functions for electronic devices, such as call status management (including answering, hanging up, etc.).

[0444] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0445] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically, without requiring user interaction. For example, the Notification Manager can be used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include displaying text messages in the status bar, emitting alert sounds, vibrating the device, or flashing indicator lights.

[0446] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.

[0447] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0448] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0449] The system library can include multiple functional modules, such as a surface manager, media libraries, 3D graphics processing libraries such as the open graphics library for embedded systems (OpenGL ES), and 2D graphics engines (such as the skia graphics library (SGL)).

[0450] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0451] The media library supports playback and recording of multiple audio and video formats, as well as still image files. It supports a variety of audio and video codecs, such as MPEG4, H.264, Moving Picture Experts Group Audio Layer III (MP3), Advanced Audio Coding (AAC), Adaptive Multi-Rate (AMR), Joint Photographic Experts Group (JPG), and Portable Network Graphics (PNG).

[0452] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0453] A 2D graphics engine is a drawing engine for 2D drawings.

[0454] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0455] In the embodiment of the present application, the electronic device can utilize the above software system to implement and display the material processing method shown in the aforementioned Figures 3 to 31.

[0456] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A material processing method, characterized in that: Applied to an electronic device including a display screen, the method comprises: Displaying a first interface of a first application in full screen, wherein the first interface includes a first initial material; In response to the first target operation, the display screen is in a partitioned display state, wherein the partitioned display state means that the display screen is divided into an original application display area, a material display area, and an operation area for display, wherein the original application display area includes the first interface, the operation area includes a first option, and the material display area includes a first material icon, wherein the first material icon is used to indicate the material that has been collected into the target application; In response to a first operation on the first option, the first initial material is collected into the target application, and a second material icon is added to the material display area, where the second material icon corresponds to the first initial material; After exiting the partition display state, displaying a second interface of the second application in full screen, the second interface including a second initial material, the type of the second initial material being different from the type of the first initial material; In response to the second target operation, the display screen is in the partitioned display state, wherein the original application display area includes the second interface, the material display area includes the first material icon and the second material icon, and the first option in the operation area is switched to the second option, and the first option is different from the second option; In response to a second operation on the second option, the second initial material is collected into the target application, and a third material icon is added to the material display area, the third material icon corresponding to the second initial material; In response to a third operation on any one of the material icons, the display is switched from the partition display state to a material preview interface, and the material preview interface corresponds to the material indicated by the material icon.

2. The method according to claim 1, characterized in that After exiting the partition display state, the second interface of the second application is displayed in full screen, including: In response to a fourth operation, exiting the partition display state, and displaying a third interface in full screen, wherein the third interface at least includes an application icon indicating a second application; In response to a fifth operation on the application icon indicating the second application, a second interface of the second application is displayed in full screen.

3. The method according to claim 1, characterized in that The operation area also includes a close button. After exiting the partition display state, the second interface of the second application is displayed in full screen, including: In response to a sixth operation on the close button, exiting the partition display state and displaying the first interface of the first application in full screen; In response to a seventh operation, the first interface is switched to a third interface, wherein the third interface at least includes an application icon indicating a second application; In response to an eighth operation on the application icon indicating the second application, a second interface of the second application is displayed in full screen.

4. The method according to any one of claims 1 to 3, characterized in that Before responding to the second target operation, the method further includes: In response to a first stage of a ninth operation on a sub-material included in the first initial material, the sub-material is displayed in a floating manner on the first initial material, and the type of the first initial material is different from the type of the sub-material; In response to a second stage of a ninth operation on the sub-material, the sub-material is collected into the target application, the first stage and the second stage being consecutive; A fourth material icon is newly added to the material display area, and the fourth material icon corresponds to the sub-material.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: Displaying the fourth interface of the third application in full screen; In response to the third target operation, the display screen is in the partitioned display state, wherein the original application display area includes the fourth interface, and the material display area includes at least the first material icon, the second material icon, and the third material icon; In response to a tenth operation on a target material icon in the material display area, the target material icon is in a selected state, and the target material icon is any one of the multiple material icons; In response to an eleventh operation on the target material icon, the material indicated by the target material icon is distributed to the fourth interface.

6. The method according to any one of claims 1 to 5, characterized in that The material preview interface includes a share button, and the method further includes: In response to a twelfth operation on the share button, a share card is displayed on the material preview interface, the share card including a plurality of options indicating different formats, different devices, different applications, saving, and printing; In response to a thirteenth operation on the share card, the material indicated by the target material icon is shared based on the selected option.

7. The method according to any one of claims 1 to 6, characterized in that The type of the first initial material and the type of the second initial material include any two of a web page, a document, and a picture.

8. The method according to claim 7, characterized in that The first option corresponds to the type of the first initial material, and the second option corresponds to the type of the second initial material; When the type of the first initial material is a web page, the first option is a web page collection option; when the type of the first initial material is a document, the first option is a document collection option; when the type of the first initial material is a picture, the first option is a picture collection option; When the type of the second initial material is a web page, the second option is the web page collection option; when the type of the second initial material is a document, the second option is the document collection option; when the type of the second initial material is a picture, the second option is the picture collection option.

9. The method according to any one of claims 1 to 8, characterized in that After responding to a first operation on the first option, the method further includes: Displaying a collection state icon, wherein the collection state icon is displayed in a floating manner in the original application display area; In response to a fourteenth operation on the first control included in the collection state icon, acquiring a first material based on the first initial material; In response to a fifteenth operation on the second control included in the collection state icon, the first material is collected into the target application through the collection state icon; A fifth material icon is added to the material display area, and the fifth material icon corresponds to the first material.

10. The method according to claim 9, characterized in that The type of the first initial material is video, and the first option is a video excerpt option.

11. The method according to any one of claims 1 to 10, characterized in that The operation area further includes a screenshot option. Before responding to the second target operation, the method further includes: In response to a sixteenth operation on the screenshot option, a second material obtained based on the first initial material is collected into the target application, and a type of the second material is a picture; A sixth material icon is added to the material display area, and the sixth material icon corresponds to the second material.

12. The method according to claim 11, characterized in that The method further comprises: In response to the seventeenth operation on the screenshot option, an operation option submenu is displayed floating on the screenshot option, wherein the operation option submenu includes the screenshot option and the long screenshot option; In response to an eighteenth operation on the long screenshot option and a nineteenth operation on the original application display area, a third material obtained based on the first initial material is collected into the target application, and the type of the third material is a long image; The material display area is newly used for a seventh material icon, and the seventh material icon corresponds to the third material.

13. The method according to any one of claims 1 to 12, characterized in that The operation area further includes a content identification option. Before responding to the second target operation, the method further includes: In response to the twentieth operation on the content identification option, the displayed content in the original application display area is displayed in a target form, and a favorite button is displayed, and the favorite button is displayed in a floating manner on the displayed content; In response to the twenty-first operation, part of the displayed content is in a selected state; In response to a twenty-second operation on the favorite button, the selected portion of the displayed content is collected into the target application; The material display area is newly used for an eighth material icon, and the eighth material icon corresponds to the part of the displayed content in the selected state.

14. The method according to claim 13, characterized in that The target form includes at least a highlight form, a word segmentation block form, and any one of sequentially tiled and suspended display in the original application display area.

15. The method according to claim 6, characterized in that The first target operation, the second target operation, and the third target operation are all three-finger sliding operations.

16. The method according to claim 5, characterized in that The first stage of the ninth operation is a long press operation, and the second stage of the ninth operation is dragging or throwing.

17. The method according to any one of claims 1 to 16, characterized in that The material display area is located in a left hot zone or a right hot zone of the display screen, and the operation area is located in a top area of ​​the display screen.

18. An electronic device, characterized in that: include: one or more processors and memory; The memory is coupled to the one or more processors, and the memory is used to store computer program codes, wherein the computer program codes include computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method as claimed in any one of claims 1 to 17.

19. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by an electronic device, the electronic device executes the method according to any one of claims 1 to 17.

Images