Material collection method and related equipment thereof

Abstract

The embodiment of the invention provides a material collection method and related equipment thereof, and relates to the technical field of terminals. According to the method, when the electronic equipment displays a first initial material, a target application can be started and a first collection state icon can be displayed through a first operation; the method comprises the following steps: acquiring a first material based on a first initial material through an operation for a first control and a second control included in a first collection state icon, and collecting the first material into a target application through the first collection state icon; after the first material is collected, the first collection state icon is switched into a hidden state icon, and the size of the hidden state icon is smaller than that of the first collection state icon. According to the method, the materials can be quickly acquired and collected into the target application, and the icons corresponding to the target application can be switched in the collection process and after collection, so that the sight of a user is prevented from being obstructed, and the user can conveniently carry out subsequent collection operation at any time.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a material collection method and related equipment. Background Art

[0002] With the continuous development of terminal technology, electronic devices can support the collection of different types of materials in different forms. For example, taking mobile phones as an example, users can copy and save text, capture pictures, record audio and video, etc. through mobile phones, and can also use them to collect web pages and videos obtained from some applications (such as news applications, etc.).

[0003] In actual processing, the process of collecting materials not only involves a variety of collection forms and material types, but also involves multiple applications and multiple collections. In this regard, the corresponding material collection methods of the current file management applications, note applications, etc. are scattered, limited, and not convenient enough, which seriously affects the user experience.

[0004] Therefore, how to improve the efficiency of material collection through electronic devices is a problem that needs to be solved urgently. Summary of the invention

[0005] The present application provides a material collection method and related devices. According to the method, electronic devices can collect different types of materials in a variety of scenarios into a global collection application. This approach can greatly improve the efficiency of collecting materials through electronic devices and user experience.

[0006] In a first aspect, the present application provides a material collection method. The method may include:

[0007] Displaying a first interface, wherein the first interface includes a first initial material;

[0008] In response to a first operation on the first interface, a target application is started, and a first collection state icon corresponding to the target application is suspended and displayed on the first interface;

[0009] In response to a second operation on a first control included in the first collection state icon, acquiring a first material based on the first initial material;

[0010] In response to a third operation on a second control included in the first collection state icon, the first material is collected into the target application through the first collection state icon;

[0011] After the first material is collected, the first collection state icon is switched to the hidden state icon, and the size of the hidden state icon is smaller than the size of the first collection state icon.

[0012] The target application is the global collection application in the embodiment of the present application.

[0013] In some embodiments of the present application, the first interface may be Figure 5A In the display interface 501 shown, the first initial material is the video content played in the display interface 501. The first collection state icon can be the first collection state 5021, the first control can be a recording control, and the second operation can be a click operation. The second control can be a completion control, and the third operation can be a click operation. The type of the first material is video. The collection process of the first material can indicate Figure 5A-Figure 5B , Figure 7A-7F The process of collecting and extracting videos is shown.

[0014] It can be understood that after the first material is collected, the hidden icon is displayed in a floating state on the first interface.

[0015] In the solution provided by the present application, when the first initial material is displayed, the target application can be started and the first collection state icon can be displayed through the first operation; through the operation of the first control and the second control included in the first collection state icon, the first material can be obtained based on the first initial material, and the first material can be collected into the target application through the first collection state icon; after the first material is collected, the first collection state icon will switch to a hidden state icon, and the size of the hidden state icon is smaller than the size of the first collection state icon. In this way, the present application can quickly obtain materials and collect them into the target application, and during and after the collection process, the icon corresponding to the target application will switch, which avoids obstructing the user's sight while facilitating the user to perform subsequent collection operations at any time.

[0016] In conjunction with the first aspect, in a possible implementation, starting a target application and floatingly displaying a first collection state icon corresponding to the target application on the first interface includes:

[0017] Starting the target application and floatingly displaying the hidden icon on the first interface;

[0018] The hidden state icon switches to a capsule-shaped icon, and the first collection state icon stretches out from the edge of the hidden state icon until it is fully displayed; or, the hidden state icon switches to the capsule-shaped icon, and the first collection state icon appears from the edge of the capsule-shaped icon, and the size changes from small to large;

[0019] The capsule icon disappears.

[0020] In some embodiments of the present application, the dynamic process of triggering the display of the first collection state icon may indicate Figure 5C-5F , Figure 5G-Figure 5H The first collection state shows the first and second animation effects.

[0021] According to this implementation, in response to the first operation on the first interface, after the target application is started, the hidden state icon corresponding to the target application can be displayed first, and then the hidden state icon can be automatically switched to the first collection state icon.

[0022] In combination with the first aspect, in a possible implementation manner, in response to a second operation on a first control included in the first collection state icon, obtaining a first material based on the first initial material includes:

[0023] In response to a second operation on the first control, the first control is switched to a third control, and the first material is acquired based on the first initial material;

[0024] In response to a fourth operation on the third control, the acquisition is stopped and the obtained first material is saved in a fourth control included in the first collection state icon, and the third control is switched to the first control;

[0025] In the fourth control, a first thumbnail indicating the first material is displayed.

[0026] In some embodiments of the present application, the second operation may be a click operation, and the third control may be a pause control. The fourth operation may be a click operation, and the fourth control may be a video content area. After the first material is saved to the fourth control, the process of the fourth control displaying the first thumbnail corresponding to the first material may indicate Figure 5K-Figure 5N Illustration of the process of recording an excerpt video for the first time.

[0027] According to this implementation, in response to the fourth operation on the third control, a recorded excerpt video can be saved to the video content area, and the video content area can display the first thumbnail corresponding to the excerpt video to prompt the user that it has been temporarily stored.

[0028] In combination with the first aspect, in a possible implementation manner, after displaying a first thumbnail indicating the first material, the method further includes:

[0029] In response to the first interface switching operation, displaying a second interface, wherein the second interface includes a second initial material and the first collection state icon;

[0030] In response to a fifth operation on the first control, the first control is switched to the third control, and starts to acquire a second material based on the second initial material; the second material is of the same type as the first material;

[0031] In response to a sixth operation on the third control, the acquisition is stopped and the obtained second material is saved in the fourth control, and the third control is switched to the first control;

[0032] In the fourth control, a second thumbnail is displayed, where the second thumbnail indicates a third material generated by splicing the first material and the second material; the third material serves as the first material.

[0033] In some embodiments of the present application, the first interface switching operation may indicate Fig.5O The second interface can indicate the operation shown Figure 5P In the display interface 514 shown in FIG. 5 , the second initial material may indicate the video content played in the display interface 514. The fifth operation and the sixth operation may be click operations. After the second material is saved to the fourth control, the process of splicing it with the first material to generate the third material may indicate Figure 5P-5S The process of recording the excerpt video for the second time is shown.

[0034] It can be understood that after the first material is collected, the first collection state icon is switched to a hidden state icon, and the hidden state icon is equivalent to being displayed in suspension on the second interface.

[0035] According to this implementation method, in response to the sixth operation on the third control, the excerpt video recorded for the second time can be saved to the video content area. At the same time, when saving, it is saved in a manner of splicing with the excerpt video recorded once. In this way, it is equivalent to synthesizing the first and second recorded videos into a continuous excerpt video.

[0036] In combination with the first aspect, in a possible implementation manner, the first collection state icon further includes a fifth control, and the method further includes:

[0037] In response to a seventh operation on the fifth control, the first collection state icon is switched to the hidden state icon;

[0038] In response to an eighth operation on the hidden state icon, the hidden state icon is switched to the first collection state icon.

[0039] In some embodiments of the present application, the process of switching the first collection state icon to the hidden state icon or the hidden state icon back to the first collection state icon before switching can indicate Figure 6A-6G The illustrated first collection state 5021 or other process that can be called again after the window is reduced in use.

[0040] In some embodiments of the present application, the fifth control may be a zoom-out control; and the seventh operation and the eighth operation may be click operations.

[0041] According to this implementation, when a video is being extracted, the corresponding collection state icon can be reduced in size during use, and can also be switched to the collection state icon after being reduced. In this way, after being reduced, it can avoid hindering user operations and blocking the content displayed in the interface; returning to the collection state icon can facilitate users to continue extracting.

[0042] In combination with the first aspect, in a possible implementation manner, in response to a third operation on a second control included in the first collection state icon, collecting the first material into the target application through the first collection state icon includes:

[0043] In response to a third operation on the second control, displaying a first card, wherein the first card includes an option indicating the target application;

[0044] In response to a ninth operation on the option indicating the target application, the first material is collected into the target application through the first collection-state icon.

[0045] In some embodiments of the present application, the first card may indicate Fig. 7A The ninth operation may be a click operation. The process of displaying the first card and selecting the target application option may indicate Figure 7A-7C After the excerpt is completed, the user needs to select the global collection option and then the electronic device collects the material into the global collection application.

[0046] According to this implementation, multiple saving options can be set in the first card, including a target application option, thereby providing the user with more choices of where to collect. When the user selects the global collection option, the material is saved in the global collection application.

[0047] In combination with the first aspect, in a possible implementation manner, after the first material is collected, the first collection state icon is switched to the hidden state icon, including:

[0048] After the first material is collected, the first card disappears, and the first collection state icon switches to a second collection state icon corresponding to the target application, where the second collection state icon is used to prompt that the first material is being collected;

[0049] The second collection state icon is switched to a feedback state icon corresponding to the target application, and the feedback state icon is used to prompt that the collection is successful;

[0050] The feedback state icon is switched to the hidden state icon.

[0051] In some embodiments of the present application, the first card disappears and the icon switching process can indicate Figure 7D-7F The switching process is shown.

[0052] It is understandable that the second collection state icon can indicate Fig.7D The collection status icon c shown; the feedback status icon can indicate Fig. 7E The feedback icon d is shown; the hidden icon can indicate Figure 7F The hidden icon b is shown.

[0053] According to this implementation method, the collected dynamics can be fed back in real time to improve the user experience.

[0054] In combination with the first aspect, in a possible implementation manner, the first collection state icon is switched to a second collection state icon corresponding to the target application, including:

[0055] The second collection state icon is displayed, and the first collection state icon shrinks toward the edge of the second collection state icon until it disappears; or, the second collection state icon is displayed, and the first collection state icon moves toward the edge of the second collection state icon, and its size decreases from large to small until it disappears.

[0056] In some embodiments of the present application, the dynamic process of triggering the cancellation of the first collection state icon and displaying the second collection state icon may indicate Figure 7G-Figure 7N The first collection state disappears in the form of animation mode 1 and animation mode 2 shown.

[0057] According to this implementation method, the first collection state icon can be dynamically switched to the second collection state icon.

[0058] In combination with the first aspect, in a possible implementation manner, the method further includes:

[0059] In response to the tenth operation on the hidden icon displayed after collection, the hidden icon is switched to a floating icon corresponding to the target application, and the floating icon is displayed in the first interface or the second interface; the floating icon includes a first icon indicating the first material.

[0060] In some embodiments of the present application, the tenth operation may be a click operation. The process of viewing the first icon may indicate Figure 7Q-Figure 7R The illustrated excerpts are collected and then reviewed in the video.

[0061] Further, in response to a click operation on the first icon, the electronic device may display the first material.

[0062] According to this implementation method, the collected excerpted videos can be viewed.

[0063] In combination with the first aspect, in a possible implementation manner, the method further includes:

[0064] Displaying a third interface, wherein the third interface includes a third initial material;

[0065] In response to an eleventh operation on the third interface, starting the target application, and floatingly displaying a third collection state icon corresponding to the target application on the third interface;

[0066] Based on the third initial material, obtaining a fourth material; the fourth material is different from the first material and the second material in type;

[0067] In response to a twelfth operation on a sixth control included in the third collection state icon, the fourth material is collected into the target application through the third collection state icon;

[0068] After the fourth material is collected, the third collection state icon is switched to the hidden state icon, and the size of the hidden state icon is smaller than the size of the third collection state icon.

[0069] In some embodiments of the present application, the third interface can be Fig. 8A In the display interface 801 shown, the third initial material may be the display content in the display interface 801. The third collection state icon may be the second collection state 8021, and the sixth control may be a completion control. The type of the fourth material is annotation. The collection process of the fourth material may indicate Figure 8A-8B , Figures 10A-10F Illustrated process of collecting global annotations.

[0070] It can be understood that after the fourth material is collected, the hidden icon is displayed in a floating manner on the third interface.

[0071] According to this implementation, when the third initial material is displayed, the target application can be started and the third collection state icon can be displayed through the eleventh operation; after acquiring the fourth material, the fourth material can be collected into the target application through the third collection state icon by operating the sixth control included in the third collection state icon; after the fourth material is collected, the third collection state icon will switch to a hidden state icon, and the size of the hidden state icon is smaller than that of the third collection state icon. In this way, the present application can quickly acquire materials and collect them into the target application, and during and after the collection process, the icon corresponding to the target application will switch, which avoids obstructing the user's sight while facilitating the user to perform subsequent collection operations at any time.

[0072] In combination with the first aspect, in a possible implementation manner, floatingly displaying a third collection state icon corresponding to the target application on the third interface includes:

[0073] Starting the target application and floatingly displaying the hidden icon on the third interface;

[0074] The hidden state is switched to a capsule-shaped icon, and the third collection state icon stretches out from the edge of the hidden state until it is fully displayed, or the hidden state icon is switched to the capsule-shaped icon, and the third collection state icon appears from the edge of the capsule-shaped icon and changes in size from small to large;

[0075] The capsule icon disappears.

[0076] In some embodiments of the present application, the dynamic process of triggering the display of the first collection state icon may indicate Figure 8C-8F , Figure 8G-Figure 8H The third collection state shown has two animation modes: animation mode 1 and animation mode 2.

[0077] According to this implementation, in response to the eleventh operation on the third interface, after the target application is started, the hidden state icon corresponding to the target application can be displayed first, and then the hidden state icon can be automatically switched to the third collection state icon.

[0078] In combination with the first aspect, in a possible implementation manner, obtaining a fourth material based on the third initial material includes:

[0079] Starting to acquire a fourth material based on the third initial material;

[0080] In response to a thirteenth operation on the seventh control included in the third collection state icon, the acquisition is stopped and the obtained fourth material is saved in a ninth control included in the third collection state icon, and the seventh control is switched to an eighth control;

[0081] In the ninth control, a third thumbnail indicating the fourth material is displayed.

[0082] In some embodiments of the present application, the seventh control is a pause annotation control, the eighth control is a start annotation control, and the ninth control may be an annotation content area. After the fourth material is saved to the ninth control, the process of the ninth control displaying the third thumbnail corresponding to the fourth material may indicate Figure 8K-Figure 8N The diagram shows the process of the first global annotation.

[0083] According to this implementation, in response to the thirteenth operation on the seventh control, the annotation content of an annotation can be saved to the annotation content area, and the annotation content area can display the third thumbnail corresponding to this global annotation to prompt the user that it has been temporarily saved.

[0084] In combination with the first aspect, in a possible implementation manner, after displaying a third thumbnail indicating the fourth material, the method further includes:

[0085] In response to the second interface switching operation, displaying a fourth interface, the fourth interface including a fourth initial material and the third collection state icon;

[0086] In response to a fourteenth operation on the eighth control, the eighth control is switched to the seventh control, and starts to acquire a fifth material based on the fourth initial material; the fifth material is of the same type as the fourth material;

[0087] In response to the fifteenth operation on the seventh control, the acquisition is stopped and the obtained fifth material is saved in the ninth control, and the seventh control is switched to the eighth control;

[0088] In the ninth control, a fourth thumbnail indicating the fifth material is displayed, or a third thumbnail indicating the fourth material and the fourth thumbnail indicating the fifth material are displayed, and the fourth material and the fifth material are collectively regarded as the fourth material.

[0089] In some embodiments of the present application, the second interface switching operation may indicate Fig.8O The fourth interface can indicate the operation shown Figure 8P In the display interface 813 shown, the fourth initial material can indicate the display content in the display interface 813. The fourteenth operation and the fifteenth operation can be click operations. After the fifth material is saved to the ninth control, the third thumbnail corresponding to the fourth material can be replaced for display (the fifth material and the fourth material are still saved in the ninth control). This process can indicate Figure 8P-Figure 8T Alternatively, the fourth thumbnail corresponding to the fifth material and the third thumbnail corresponding to the fourth material can be displayed in parallel at the same time.

[0090] It can be understood that after the fourth material is collected, the third collection state icon is switched to a hidden state icon, and the hidden state icon is displayed in a floating manner on the fourth interface.

[0091] According to this implementation method, in response to the fifteenth operation on the seventh control, the global annotation of the secondary annotation can be saved to the annotation content area. After saving, only the fourth thumbnail corresponding to the fifth material can be displayed, or the fourth thumbnail corresponding to the fifth material and the third thumbnail corresponding to the fourth material can also be displayed side by side.

[0092] In combination with the first aspect, in a possible implementation manner, the third collection state icon further includes a tenth control, and the method further includes:

[0093] In response to a sixteenth operation on the tenth control, the third collection state icon is switched to the hidden state icon;

[0094] In response to the seventeenth operation on the hidden state icon, the hidden state is switched to the third collection state icon.

[0095] In some embodiments of the present application, the process of switching the third collection state icon to the hidden state icon or the hidden state icon back to the third collection state icon before switching can indicate Figure 9A-9D The second collection state 8021 or other process shown can be called again after the window is reduced in use.

[0096] In combination with the first aspect, in a possible implementation manner, in response to a twelfth operation on a sixth control included in the third collection state icon, collecting the fourth material into the target application through the third collection state icon includes:

[0097] In response to a twelfth operation on the sixth control, displaying a second card, wherein the second card includes an option indicating the target application;

[0098] In response to an eighteenth operation on the option indicating the target application, the fourth material is collected into the target application through the third collection-state icon.

[0099] In some embodiments of the present application, the second card may indicate Fig. 10A The twelfth operation may be a click operation. The process of displaying the second card and selecting the target application option may indicate Figure 10A-10C After the annotation is completed, the user needs to select the global collection option and then the electronic device collects the materials into the global collection application.

[0100] In combination with the first aspect, in a possible implementation manner, after the fourth material is collected, the third collection state icon is switched to the hidden state icon, including:

[0101] After the fourth material is collected, the second card disappears, and the third collection state icon is switched to a fourth collection state icon corresponding to the target application, and the fourth collection state icon is used to prompt that the fourth material is being collected;

[0102] The fourth collection state icon is switched to a feedback state icon;

[0103] The feedback state icon switches the hidden state icon.

[0104] In some embodiments of the present application, the second card disappears and the icon switching process can indicate Figure 10D-10F The switching process is shown.

[0105] It is understandable that the fourth collection state icon can indicate Fig. 10D The collection status icon c shown; the feedback status icon can indicate Fig.10E The feedback icon d is shown; the hidden icon can indicate Fig.10F The hidden icon b is shown.

[0106] According to this implementation method, the collected dynamics can be fed back in real time to improve the user experience.

[0107] In combination with the first aspect, in a possible implementation manner, the third collection state icon is switched to a fourth collection state icon corresponding to the target application, including:

[0108] The fourth collection state icon is displayed, and the third collection state icon shrinks toward the edge of the fourth collection state icon until it disappears; or, the fourth collection state icon is displayed, and the third collection state icon moves toward the edge of the fourth collection state icon, and its size changes from large to small until it disappears.

[0109] In some embodiments of the present application, the dynamic process of triggering the cancellation of the third collection state icon and displaying the fourth collection state icon may indicate Figure 10G-Figure 10N The third collection state disappears in the illustrated animation mode 1 and animation mode 2.

[0110] According to this implementation method, the third collection state icon can be dynamically switched to the fourth collection state icon.

[0111] In combination with the first aspect, in a possible implementation manner, the method further includes:

[0112] In response to the nineteenth operation on the hidden state icon displayed after collection, the hidden state icon is switched to the floating state icon, and the floating state icon is displayed in a floating manner on the third interface or the fourth interface; the floating state icon includes a second icon indicating the fourth material.

[0113] In some embodiments of the present application, the nineteenth operation may be a click operation. The process of viewing the second icon may indicate Figure 10O-Figure 10P The process of collecting and reviewing global annotations is shown.

[0114] Further, in response to a click operation on the second icon, the electronic device may display a fourth material.

[0115] According to this implementation method, the collected global annotations can be viewed.

[0116] In combination with the first aspect, in a possible implementation manner, the method further includes:

[0117] Displaying a fifth interface, wherein the fifth interface includes a fifth initial material;

[0118] In response to the twentieth operation on the fifth interface, starting the target application, and floatingly displaying a fifth collection state icon corresponding to the target application on the fifth interface;

[0119] Based on the fifth initial material, a sixth material is obtained; the sixth material is of the same type as the fourth material and the fifth material;

[0120] In response to a twenty-first operation on the eleventh control included in the fifth collection state icon, the acquisition is stopped and the obtained sixth material is saved in the twelfth control included in the fifth collection state icon, and the eleventh control is switched to the thirteenth control.

[0121] In some embodiments of the present application, the fifth interface may be Fig.11A In the display interface 1101 shown, the fifth initial material may be the display content in the display interface 1101. The fifth collection state icon may be the third collection state 11021, the eleventh control may be a pause annotation control, the twelfth control may be a save control, and the thirteenth control may be a start annotation control. The type of the sixth material is annotation. The collection process of the sixth material may indicate Figures 11A-11G The process of temporarily storing the annotation process is shown.

[0122] It is understandable that the sixth material is only temporarily stored in the save control, not collected.

[0123] The size of the fifth collection state icon is smaller than the size of the third collection state icon.

[0124] In combination with the first aspect, in a possible implementation manner, saving the obtained sixth material to a twelfth control included in the fifth collection state icon includes:

[0125] generating a fifth thumbnail based on the sixth material;

[0126] The fifth thumbnail moves toward the twelfth control, and its size decreases from large to small until it disappears;

[0127] The obtained sixth material is saved in the twelfth control included in the fifth collection state icon, and a digital subscript is added to the twelfth control or the digital subscript is increased by 1.

[0128] In some embodiments of the present application, the process of temporarily storing the sixth material to the twelfth control may indicate Figure 11C-11G The temporary storage process is shown.

[0129] In combination with the first aspect, in a possible implementation manner, the method further includes:

[0130] In response to a twenty-second operation on the twelfth control, displaying a third card, the third card including the fifth thumbnail and a save button;

[0131] In response to a twenty-third operation on the save button, the third card is switched to a fourth card, and the fourth card includes an option indicating the target application;

[0132] In response to a twenty-fourth operation on the option indicating the target application, the sixth material is collected into the target application through the fifth collection state icon;

[0133] After the sixth material is collected, the fifth collection state icon is switched to the hidden state icon.

[0134] In some embodiments of the present application, the third card may indicate Fig.11I Card 11027 in; the fourth card can indicate Figure 11K The card 11028 in the figure. The twenty-third operation and the twenty-fourth operation can be click operations. The process of triggering the save control to save can indicate Figure 11H-Figure 11O The process shown.

[0135] According to this implementation method, more options for saving content and saving destinations can be provided to users.

[0136] In combination with the first aspect, in a possible implementation manner, after the sixth material is collected, the fifth collection state icon is switched to the hidden state icon, including:

[0137] After the sixth material is collected, the fourth card disappears, and the fifth collection state icon switches to the fourth collection state icon corresponding to the target application;

[0138] The fourth collection state icon is switched to a feedback state icon;

[0139] The feedback state icon is switched to the hidden state icon.

[0140] In some embodiments of the present application, the fourth card disappears and the icon switching process may indicate Figure 11L-Figure 11O The switching process is shown.

[0141] It is understandable that the fourth collection state icon can indicate Fig.11M The collection status icon c shown; the feedback status icon can indicate Fig.11N The feedback icon d is shown; the hidden icon can indicate Fig.11O The hidden icon b is shown.

[0142] According to this implementation method, the collected dynamics can be fed back in real time to improve the user experience.

[0143] In combination with the first aspect, in a possible implementation manner, the fifth collection state further includes a fourteenth control, and before responding to a twenty-third operation on the save button, the method further includes:

[0144] In response to a twenty-fifth operation on the fourteenth control, displaying a fifth card, the fifth card including prompt information and a save option, the prompt information being used to prompt saving of the sixth material saved in the twelfth control;

[0145] In response to a twenty-sixth operation on the save option, the third card is displayed.

[0146] In some embodiments of the present application, the fifth card may indicate Figure 11Q The card 11028 shown. The process of icon switching can indicate Figure 11P-Figure 11Q , Figure 11L-Figure 11O The switching process is shown.

[0147] According to this implementation, before exiting the global collection, the user can be reminded to collect or not collect the global annotation content, so as to avoid the situation where the content is not collected due to direct exit.

[0148] In combination with the first aspect, in a possible implementation manner, types of the first material, the second material, and the third material include at least video, and the first operation is a three-finger sliding operation.

[0149] According to this implementation, videos can be collected.

[0150] In combination with the first aspect, in a possible implementation manner, the types of the fourth material, the fifth material, and the sixth material include at least annotations, and the eleventh operation and the twentieth operation are C-shaped sliding operations.

[0151] According to this implementation, annotations can be collected.

[0152] In combination with the first aspect, in a possible implementation manner, the hidden state icon is a semi-transparent semicircle; the first collection state icon and the third collection state icon are in a window shape.

[0153] According to this implementation, interference with the user's vision and hindrance to the user's operation can be avoided.

[0154] In combination with the first aspect, in a possible implementation manner, the second collection state icon, the fourth collection state icon and the fifth collection state icon are in a capsule shape.

[0155] According to this implementation, multiple recordings or multiple annotations can be achieved, and other operations can be performed during the process of extracting videos or annotating, thereby improving user experience.

[0156] In a second aspect, the present application provides an electronic device, comprising: one or more processors, and one or more memories; the one or more memories are coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method described in the first aspect or any one of the implementations of the first aspect.

[0157] In a third aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the first aspect or any one of the implementations of the first aspect.

[0158] In a fourth aspect, an embodiment of the present application provides a chip system, which can be applied to an electronic device. The chip includes one or more processors, and the processor is used to call computer instructions so that the electronic device executes the method described in the first aspect or any one of the implementations of the first aspect.

[0159] In a fifth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0160] It is understandable that the electronic device provided in the second aspect, the computer storage medium provided in the third aspect, the chip system provided in the fourth aspect, and the computer program product provided in the fifth aspect are all used to execute the method described in the first aspect or any one of the implementations of the first aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of any possible implementation of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0161] Figure 1A-1E A set of exemplary user interfaces involved in any door;

[0162] Figure 2A-2H Schematic diagram of various states of global collection application;

[0163] Figure 3A-Figure 3F A set of exemplary user interfaces involved in collecting text;

[0164] Figure 4A-Figure 4I Another set of exemplary user interfaces for collecting text;

[0165] Figure 5A-5S An exemplary set of user interfaces for collecting video excerpts;

[0166] Figure 6A-6G Another set of exemplary user interfaces for collecting video excerpts;

[0167] Figure 7A-7R Another set of exemplary user interfaces for collecting video excerpts;

[0168] Figure 8A-8T A set of exemplary user interfaces for collecting global annotations;

[0169] Figure 9A-9D Another set of exemplary user interfaces for collecting global annotations;

[0170] Figure 10A-Figure 10P Another set of exemplary user interfaces for collecting global annotations;

[0171] Figure 11A-Figure 11Q A set of exemplary user interfaces involved in the second method for collecting global annotations;

[0172] Figures 12A-12D A set of exemplary user interfaces for setting up an application;

[0173] Figures 13A-13D A set of exemplary user interfaces involved in triggering a global favorite application;

[0174] Figure 14A-14F Another set of exemplary user interfaces involved in triggering a global favorite application;

[0175] Fig.15 An exemplary flow chart of a material collection method provided in an embodiment of the present application;

[0176] Fig.16 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0177] Fig.17 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0178] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0179] It should be understood that the terms "first", "second", etc. in the specification, claims and drawings of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0180] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments.

[0181] To facilitate understanding, the nouns involved in the embodiments of the present application are first explained.

[0182] 1. System applications and third-party applications. System applications refer to applications directly provided by the operating system of an electronic device for implementing specific functions. Third-party applications refer to applications provided by other developers and obtained by the electronic device through the Internet for implementing specific functions. In the embodiment of the present application, the application that provides the user interface can be a system application or a third-party application.

[0183] 2. Any Door: To achieve the purpose of quick application switching and shortening the path to enable functions, you can trigger the appearance and hiding of controls on the screen through specified operations, that is, you can switch from the current display interface (excluding the desktop) to Any Door, or you can switch Any Door back to the current display interface. When switching from the current display interface to the Any Door open state, the Any Door in the open state consists of at least three parts, namely the background layer, the foreground layer stacked on the background layer, and the side application layer.

[0184] Among them, the background layer is the same size as the screen, and the content can be set as needed, such as landscape photos, etc.; the foreground layer can be located on the left side of the screen in a right perspective graphic or on the right side in a left perspective graphic, and the content is the same as the current display interface content; the side application layer is opposite to the foreground layer and can include multiple service icons arranged in a row. The multiple service icons can be used to trigger the launch of related applications, call a certain function, or call a function involved in a certain application.

[0185] It should be noted that the service icon involved in any door is related to the elements involved in triggering the opening of any door. For example, if a text element is involved in opening any door, the electronic device identifies the content of the text element, filters and displays the receivable text elements and / or service icons related to the identified content from all installed applications and achievable functions, and then, when the service icon is triggered, a corresponding service can be called.

[0186] For example, Figure 1A-1E A set of exemplary user interfaces involved in the “Any Door”. Figure 1A As shown in FIG. , it is the current display interface displayed by the electronic device. Figure 1B As shown, when any door is opened, the electronic device can display the background layer, the foreground layer with the same content as the current display interface, and the side application layer. Since the foreground layer is located on the left side of the screen and is displayed in a right perspective state, it visually forms an "open door" state.

[0187] Combination Figure 1A and Figure 1B ,from Figure 1A Switch to Figure 1B , the background layer is displayed; at the same time, the left edge of the current display interface remains unchanged, and the right edge gradually shrinks from the right border of the screen to the left; the side application layer gradually stretches from the right edge of the screen to the left, and the interaction between the two presents the effect of pushing open a door on the screen. The embodiment of the present application refers to this display process as the "any door opening process"; conversely, Figure 1B Switch to Figure 1A In this embodiment of the present application, the display process is referred to as the "arbitrary door" closing process.

[0188] In the embodiment of the present application, the Any Door function can be enabled and disabled through the system application. When the Any Door function is enabled, it can be triggered by a specified operation on the screen, otherwise it cannot be triggered. Figure 1D As shown, the main interface of the setting application of the electronic device may include an auxiliary function option; in response to a user operation on the auxiliary function option, the electronic device may display Figure 1E The auxiliary function interface shown may include an arbitrary door option and a corresponding switch, and the switch is used to turn on or off the arbitrary door function.

[0189] 3. Hot zone refers to a touch area of ​​fixed shape and size on the screen.

[0190] For example, Figure 1C For a schematic diagram of the “hot zone”, see Figure 1C, the hot zone may include a right-side hot zone and / or a left-side hot zone. The right-side hot zone refers to a rectangular touch area extending from the right edge of the screen to the left, and the left-side hot zone refers to a rectangular touch area extending from the left edge of the screen to the right. The electronic device can determine whether the control is close to the right or left side of the screen by determining the distance between the position of the touch point of the current finger and the screen and the right-side hot zone or the left-side hot zone. In an embodiment of the present application, when it is recognized that the current touch point is in the right-side hot zone or the left-side hot zone, the electronic device can determine the service corresponding to the trigger hot zone, for example, it can trigger the opening of any door.

[0191] 4. Materials in this application may include various types of information such as text, graphics, images, videos, files, audio, web pages, tables, etc.; among which images may be static images or dynamic images, and files may be in various formats such as PDF format, word format, excel format, etc., which are not limited in this application.

[0192] 5. Annotation (or graffiti) in this application refers to the content drawn by the user with a pen tip or fingertip on the display screen. The information contained in the annotation content may include the starting position and ending position of the annotation. The starting position refers to the position where the user puts down the pen when annotating on the display screen, and the ending position refers to the position where the user lifts the pen after annotating on the display screen.

[0193] The above is a brief introduction to the terms involved in the embodiments of the present application, which will not be repeated below.

[0194] The electronic device can support the collection of different types of materials in different forms, so that the user can achieve the purpose of collecting materials by using the electronic device.

[0195] However, in actual processing, taking the file management application in the mobile phone as an example, the file management application can only be used to collect materials such as pictures, videos, audio, and files. The types of materials are limited, and the forms of collection are also limited accordingly. Taking the note application in the mobile phone as an example, in addition to collecting text, pictures, videos, audio, etc., the note application can also be used to collect web pages obtained from news applications, annotations obtained from reading applications, etc. Among them, web pages can be collected in the note application by sliding down with three fingers; the annotation content can be collected in the note application when receiving the user's save instruction.

[0196] In the above two examples, although note-taking applications can collect slightly more types of materials than file management applications, if multiple types of materials need to be collected into one note, users need to frequently switch between different applications during the collection process. At the same time, they also need to collect materials in different applications in different collection methods. For users, the learning cost is high and the collection efficiency is low. The materials collected between different electronic devices are also isolated from each other, which is troublesome to view.

[0197] In view of this, an embodiment of the present application provides a material collection method. The material collection method can be used to realize the collection of materials from different sources, different types of materials, and multiple times, shorten the user's collection path, unify the collection method, and improve the collection efficiency; and the method has clear feedback and avoids excessive interruption to the user, so that the user can interact intuitively, efficiently and conveniently.

[0198] It should be understood that the materials involved in this application include but are not limited to text, graphics, images, videos, audio, web pages, tables, etc. The material collection involved in this application may include acquiring materials, and processing the acquired materials and using the processed results as the collected content. For example, collecting materials may include: converting the acquired audio materials into text materials, converting the acquired text materials into audio materials, editing or marking the input text or pictures, etc.

[0199] Let's first combine Figure 2A The global collection mode provided in this application and multiple forms of the global collection mode are introduced.

[0200] Global Collection is a management application APP that can collect, organize and share materials. That is, users can use the Global Collection application to collect, organize and share materials. Furthermore, the Global Collection application can be built into a personal learning space, work space, etc. The data retention rule in the Global Collection can be permanent retention.

[0201] When using global collections, users can present multiple forms to distinguish and indicate that the electronic device is in different processing stages or performing different processes. For example, the forms of global collections may include hidden state (also called hidden state icon), collection state (also called collection state icon), feedback state (also called feedback state icon), floating state (also called floating state icon) and full-screen state (also called full-screen interface), etc.; the names here are only schematic, for example, the hidden state can also be called minimized state, and the floating state can also be called distributed state, which is not limited in this application. Each form of global collection can also include one or more styles, and the styles can be switched between each other in response to user triggers. See. Figure 2A , which is an example of a global collection in different forms provided in an embodiment of the present application.

[0202] Among them, the hidden state of the global collection is used to indicate that the global collection has been called by the foreground or is running in the background; the collection state is used to indicate the location of the material collection entrance or to indicate that the global collection is in the process of collecting materials; the feedback state is used to indicate the feedback given to the user when collecting materials, telling the user whether the collection is successful; the floating state is used to display the materials collected in the global collection in part of the current display interface; the full-screen state is used to display the materials collected in the global collection in the entire display area. It can be understood that the floating state is equivalent to the display window of the global collection application, and the full-screen state is equivalent to the main interface of the global collection application. The floating state and full-screen state can support users to organize materials.

[0203] Optionally, the shape of the hidden icon of the global favorite can be a sphere or a hemisphere, and can be non-transparent or semi-transparent. For example, when the global favorite is in the hidden state, the hidden icon can be presented in a semi-transparent or hemisphere effect adsorbed on the inner side of the screen edge, such as Figure 2A In this case, when icon b is located inside the edge of the screen, it will not affect the user's normal viewing of the displayed content. Icon b is in a semi-transparent state and will not visually attract the user's attention, and will not interfere with the user's normal use.

[0204] It should be noted that the position of the inner side of the screen edge described in the embodiment of the present application can be specifically located on the upper side, lower side, left side or right side of the inner side of the edge, and the present application does not limit this.

[0205] Optionally, the collection state icon of the global collection can be switched to different styles based on different collection scenarios. For example, when collecting text, images and other materials, the collection state style can be switched to Figure 2A When collecting web page content, the collection state style can be switched to Figure 2A The collection state icon c2 shown in FIG. 2; when collecting excerpted videos, the collection state style can be switched to the following Figure 2A The collection state icon c31 and collection state icon c32 shown in FIG; when collecting global annotations, the collection state style can be switched to Figure 2A The collection state icon c41 or the collection state icon c43 and the collection state icon c42 are shown in FIG. The style of the collection state can be specifically set according to the type of collected material, and this application does not limit this.

[0206] It should be noted that the global collection can be switched from the hidden state to the collected state, and vice versa. Different styles between the collected states can also be switched. Optionally, the switching can be an animation effect such as scrolling, telescoping, etc. For example, Figure 2BAs shown in the figure, the hidden state of the global collection can be switched from the leftmost figure to the rightmost collection state with a gradually extending animation effect; during the extension process, the hidden state icon b can first switch to a sphere, then stretch from the sphere to a capsule shape, and gradually display all the texts. This is only an example, and this application is not limited to this.

[0207] Optionally, after the material is collected, the global collection can be switched from the collection state to the feedback state. Figure 2A As shown, the feedback state can be consistent with the style of icons c1, c2, c32, c42, c43, etc. in the collection state, and display the text "Successfully collected" to give feedback to the user in text form that the current material has been successfully collected. Optionally, the graphic in the feedback state can also be switched to a check mark to give feedback in animation form that the current material has been successfully collected.

[0208] Optionally, the floating state of the global collection can move in the display area based on the user's drag operation, and can also change the size based on the user's drag operation. For example, the floating state of the global collection can specifically include two styles, one is a long strip, such as Figure 2A The first suspension state e1 shown in FIG; the other is a card-shaped, such as Figure 2A The second suspended state e2 shown in the figure is different in position and size from the first suspended state e1 in the shape of a strip to the second suspended state e2 in the shape of a card. The first suspended state e1 of the global collection can be displayed with the effect of being adsorbed on the inner side of the edge of the screen to avoid interfering with the currently displayed content. The second suspended state e2 of the global collection can be displayed in the center area of ​​the display screen to facilitate user viewing.

[0209] Optionally, as a possible implementation method, in response to a drag operation on the edge of the first suspended state e1, the first suspended state e1 can be switched to the second suspended state e2; conversely, in response to a drag operation on the edge of the second suspended state e2, the second suspended state e2 can also be switched to the first suspended state e1. As another possible implementation method, in response to a two-finger reverse sliding operation on the first suspended state e1, the first suspended state e1 can be switched to the second suspended state e2; conversely, in response to a two-finger pinching operation on the second suspended state e2, the second suspended state e2 can also be switched to the first suspended state e1. In addition, the first suspended state e1 can display icons corresponding to one or two columns of materials, and can display at least one icon corresponding to a material. The second suspended state e2 can display icons corresponding to two or more columns of materials, but the number of columns and rows is less than that of the full-screen state, and can be set specifically as needed, and this application does not limit this.

[0210] Optionally, the floating state of the global collection may also include a top bar control and / or a bottom bar control. In response to a click operation on the top bar control, such as Figure 2C As shown, the first suspension state e1 can be switched to Figure 2D The suspended state style with a toolbar is shown; the toolbar of this style may include three controls, namely, a zoom-in control, a zoom-out control, and a close control. The zoom-in control is used to trigger switching from the first suspended state e1 to the full screen state; the zoom-out control is used to trigger switching from the first suspended state e1 to the hidden state; and the close control is used to trigger exiting the global collection.

[0211] Alternatively, if Figure 2E and Figure 2F As shown, in response to a sliding operation on the top horizontal bar control in the first suspended state e1, the global collection can be switched from the first suspended state e1 to the hidden state b. The direction of the sliding operation can be left or right. Figure 2E Only a swipe to the right is indicated.

[0212] Alternatively, if Figure 2G and Figure 2H As shown, in response to a sliding operation on the bottom horizontal bar control of the first floating state e1, the global collection can be switched from the first floating state e1 to the full screen state f. The direction of the sliding operation can be left or right. Figure 2G Only a swipe to the right is indicated.

[0213] Similarly, the second floating state e2 can also be switched to a floating state style with a toolbar; the second floating state e2 can also include a top horizontal bar control and a bottom horizontal bar control, and the top horizontal bar control and the bottom horizontal bar control of the second floating state e2 can also be slid to switch to a hidden state or a full-screen state accordingly; for the functional introduction of the second floating state e2, please refer to the above description and will not be repeated here.

[0214] It should also be noted that although users will switch between multiple forms when using global collections, the global collection application in each form is at the top of the multiple display layers included in the display interface (or called top), and is not covered or affected by the content displayed below.

[0215] In combination with the above-mentioned global collection and the multiple forms of users in the process of using the global collection, the material collection method provided in this application is implemented, and the electronic device can execute one or more of the following scenarios.

[0216] It is understandable that the materials include various types, and the various types of materials mentioned here may include fragmented materials such as text, graphics, images, tables, annotations, etc., and may also include non-fragmented materials such as web pages, videos, files, etc. The graphics may indicate a partial image captured using a lasso tool, etc.

[0217] Scenario 1. When collecting materials, the electronic device can support the selection of text, images, etc., and save the selected text, images, etc. to a global collection application.

[0218] It should be noted that, in this scenario 1, the electronic device can also support collecting materials through any door method.

[0219] When the Anydoor function is turned off and the global collection is not started, in response to a user operation, the electronic device starts the global collection, so that the global collection is switched from a hidden state to a collection state after it is started. Then, when the electronic device detects that the material has moved to the global collection collection state position or when the collection is triggered, the material can be collected.

[0220] When the Any Door function is turned off and the global collection runs in the background and is displayed in a hidden state in the foreground, in response to user operations, the global collection can be switched from a hidden state to a collection state. Then, when the electronic device detects that the material has moved to the global collection collection state position or when the collection is triggered, the material can be collected.

[0221] When the Any Door function is turned on, the global collection is not started, or the global collection is running in the background and displayed in a hidden state in the foreground, since the preset Any Door processing priority is higher than the global collection priority, the electronic device can open the Any Door in response to the user operation, and then, when it is detected that the material is moved to the global collection icon in the side application bar, the global collection application can be started to collect the material.

[0222] Scenario 2. When collecting materials, the electronic device can support recording videos while playing videos, and save the recorded videos to the global collection application. For the convenience of description, this application records the recorded videos as excerpt videos.

[0223] Optionally, during the process of recording a video, the electronic device may support continuous recording. Continuous recording here may indicate pausing the recording and then starting to record a video. It should be noted that after pausing the recording and before starting the recording again, the electronic device may support switching applications, that is, the two recording contents may involve different applications, but after the recording is completed, the two recording contents will be spliced ​​into an excerpt video (also called a video clip) and collected in the global collection.

[0224] Optionally, after recording a video, the electronic device can also support additional excerpts for the excerpted videos that have been collected in the global collection. It should be noted that the additional excerpts here can indicate non-continuous recording or recording in batches; each newly added video is equivalent to the previously recorded videos being saved in the same folder location in the global collection, and in this folder, videos recorded at different times correspond to different video clips; it should also be added that the folder including multiple video clips is still displayed as an individual material icon in the global collection.

[0225] Scenario 3. When collecting materials, the electronic device can support annotation on any interface, and save the original interface and the annotation traces together to the global collection application. For the convenience of description, this application records the original interface and the annotation traces together as global annotations.

[0226] Optionally, during the annotation process, the electronic device may support continuous annotation. The continuous annotation here may indicate pausing the annotation and then restarting it. It should be noted that before restarting the annotation after pausing the annotation, the electronic device may support switching interfaces or applications, that is, the two sections of annotation content may involve different display contents of different interfaces and different applications. However, after the annotation is completed, the two sections of annotation content will be spliced ​​into a global annotation (also called a snapshot) and collected in the global collection.

[0227] Optionally, after the annotation is completed, the electronic device can also support additional annotations for the global annotations that have been collected in the global collection. It should be noted that the additional annotations here can indicate non-continuous annotations or annotations in batches; each newly added annotation is equivalent to the content of the previous one or more annotations saved in the same folder location in the global collection, and in this folder, the content of different annotations corresponds to different snapshots; it should also be added that the folder including multiple snapshots is still displayed as an individual material icon in the global collection.

[0228] Optionally, after the annotation is completed, the electronic device can also support repeated annotation for the global annotations that have been collected into the global collection, that is, editing the annotation content that already carries the annotation traces again, including but not limited to adding annotation traces.

[0229] The above only schematically shows three collection scenarios, of course, other scenarios are also possible, and this application does not limit the scenarios in the collection stage. The collection method provided by this application can realize materials from different sources, different types of materials, and multiple collections by combining the global collection application, unify the collection method, shorten the user's collection path, and improve the collection efficiency. In addition, the method has clear feedback and avoids excessive interruption to the user, so that the user can interact intuitively, efficiently and conveniently.

[0230] It should be noted that collecting materials mainly involves switching between the hidden state, collection state and feedback state of the global collection application. The switching can be animation effects such as scrolling, stretching, flipping, bouncing, fading or appearing, and this application does not limit this.

[0231] It can be understood that the electronic device in the present application can be a terminal device such as a mobile phone, a tablet computer, or a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, and a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device and / or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.

[0232] The following is a detailed introduction to the collection of materials.

[0233] 1. Collect text (such as Figure 3A-Figure 3F As shown, Figure 4A-Figure 4I (shown)

[0234] Taking a news application as an example, the electronic device can detect a user operation on the news application. In response to the user operation, the electronic device can start the news application and display the main interface of the news application (i.e., the interface displayed by default after startup). The main interface of the news application can include thumbnails of multiple news messages. The thumbnails of the multiple news messages can be used to trigger the electronic device to display the specific content of the news message. The electronic device can detect a user operation on any thumbnail. In response to the user operation, the electronic device displays the display interface of the news message corresponding to the corresponding thumbnail.

[0235] Optionally, the electronic device may detect a user operation on a section of text in the display interface, and in response to the user operation, a portion of the text may be in a text selected state; then, the electronic device may detect a user operation on the portion of text in the text selected state. In response to the user operation, when the Any Door function is turned off, the electronic device may enter a global collection mode; when the Any Door function is turned on, regardless of whether the global collection is running, the electronic device should open the Any Door because the preset Any Door processing priority is higher than the global collection priority.

[0236] Optionally, when part of the text is in a text selected state or a non-text selected state, the text background color may be different colors to distinguish. For example, when part of the text is in a non-text selected state, the text background color may be white, and when it is in a text selected state, the text background color may be gray.

[0237] It can be understood that the user operations mentioned in the embodiments of the present application may include but are not limited to touch (for example, click, long press, etc.), voice control, gestures and other operations, and the present application does not limit this.

[0238] The following examples respectively describe the first process in which the Anydoor function is turned off, the global collection is not started, and the electronic device enters the global collection mode to collect text (Example 1); the second process in which the Anydoor function is turned on, and the electronic device collects text through the Anydoor (Example 2); and the third process in which the Anydoor function is turned on, the global collection is displayed in a hidden state in the foreground, and the electronic device still collects text through the Anydoor (Example 3).

[0239] Example 1 (such as Figure 3A-Figure 3F (shown)

[0240] See also Figure 3A The display interface 301 shown is a web page of a news message in a news application. The electronic device can detect a selection operation for a text in the display interface 301 (such as a long press for Figure 3A In response to the selection operation, part of the text may be in a text selected state. For ease of description, the present application may record the part of the text in the text selected state as text a1 (e.g. Figure 3A Text with a gray background).

[0241] The electronic device may detect a long press operation on the text a1, and in response to the long press operation, the electronic device may display the following Figure 3B The display interface 302 shown. Compared with the display interface 301, the display interface 302 displays a hidden icon b of the global collection on the right side of the interface; the icon b is used to prompt the user that the electronic device has entered the global collection mode triggered by the long press operation on the text a1, and the text a1 in the selected state can be collected by the global collection application.

[0242] Optionally, when the electronic device detects a long press operation on a portion of text in a selected state, a move icon a2 (such as FIG. 3B to FIG. 3D The moving icon a2 is used to prompt the user that the part of the text in the selected state can be moved in any direction in response to the user's dragging operation in a plane parallel to the display interface.

[0243] See also Figure 3C In the display interface 303 shown, the electronic device can detect a drag operation on the text a1. In response to the drag operation, the text a1 in the selected state can be split and displayed as two texts (for the convenience of description, they can be called foreground text and background text). The foreground text is the same as the original text a1 in the selected state, or the font is relatively reduced, or the font is relatively reduced and a border, background color, etc. are added; the background text is the same as the original text a1, or the background text can be switched to a gray font. In addition, the foreground text can move in the display interface 303 with the user's drag operation, and the background text does not move with the user's drag operation.

[0244] At the same time, if Figure 3C As shown in , in response to the drag operation, the global favorite application is called in the foreground, and the hidden state icon b of the global favorite gradually stretches from the right side to the left side of the display interface and switches to the collection state icon c of the global favorite.

[0245] See also Figure 3D In the display interface 304 shown, the electronic device can also detect a user operation on the foreground text corresponding to the text a1. In response to the user operation, the foreground text can move to the position of the collection icon c of the global favorite along with the user operation and then disappear.

[0246] Optionally, the user operations mentioned in this embodiment may include but are not limited to operations such as dragging and throwing, which are not limited in this application. The dragging direction and the throwing direction are both toward the location of the collection state icon c of the global collection on the display interface. In addition, the position where the drag stops overlaps with the position of the collection state icon c of the global collection. If there is no overlap, its content may not be collected into the global collection application.

[0247] Here, it is necessary to add that Figure 3B As shown in the figure, after the user performs a long press operation on the selected text, the following Figure 3C-Figure 3D During the dragging operation shown in FIG. 1 , the user does not release the hand until the foreground text is dragged to the position of the global collection state icon c; or Figure 3C In the dragging operation shown, the user will not let go until the foreground text is thrown to the position of the collection icon c of the global favorites, and then lift the hand as the throwing operation proceeds.

[0248] Optionally, in response to a user operation, when the foreground text moves to the location of the collection state icon c of the global collection with the user operation, since the text belongs to the type of material that can be collected in the global collection, a feedback badge can also be displayed in the upper right corner of the foreground text. Figure 3DAs shown, a circle containing a "+" may be displayed in the upper right corner of the foreground text to indicate to the user that the foreground text is allowed to be collected into the global favorites app at this time. It is understandable that if it is not collectible, another feedback badge may be displayed in the upper right corner, for example, a circle containing a "\" may be displayed in the upper right corner of the foreground text to indicate to the user that it is not allowed to be collected into the global favorites app at this time.

[0249] Optionally, in response to user operations, the size of the foreground text can also change from large to small in the process of moving to the location of the global favorite collection icon c, forming a gradually disappearing visual effect. Correspondingly, the global favorite collection icon c can show dynamic feedback of enlarging and then shrinking in this process, and the interaction between the two forms a visual effect that the collection icon c absorbs the foreground text.

[0250] Optionally, as a possible implementation, combining Figure 3D The display interface 304 and Figure 3F In the display interface 306 shown in the figure, after the electronic device collects the text a1 into the global collection application, the collection is completed, the background text is switched to black font, and the collection state icon c of the global collection can be switched to the hidden state icon b; as another possible implementation method, combined with Figure 3D The display interface 304 shown, Figure 3E The display interface 305 and Figure 3F In the display interface 306 shown, after the electronic device collects the text a1 into the global collection application, the collection is completed, the background text is switched to black font, and the collection state icon c of the global collection can be switched to the feedback state icon d first, and then switched from the feedback state icon d to the hidden state icon b. The basic form of the feedback state icon d can remain unchanged compared to the collection state icon c, and the text on the icon can be displayed as "Collected successfully", and a check mark can also be displayed on the icon to feedback to the user that the text a1 has been collected into the global collection.

[0251] Optionally, after the collection is successful, the global collection application can continue to be displayed on the screen in a hidden state b to indicate to the user that the global collection application is still running in the background, and the user can collect any material into the global collection at any time.

[0252] It can be understood that the above is an example of enabling global collection to realize text collection when the Any Door function is closed and global collection is not enabled.

[0253] It should be noted that when the Any Door function is turned off, the global collection is used in the background and displayed in the foreground in a hidden state, in response to user operation, the global collection can be switched from the hidden state to the collection state, and then, when the electronic device detects that the material has moved to the global collection collection state position, the material can be collected. Figure 3B-Figure 3FThe introduction of , I will not go into details here.

[0254] Example 2 (such as Figure 4A-4F (shown)

[0255] Figure 4A The display interface 401 shown is Figure 3A The display interface 301 shown is the same as that shown in the figure, and reference may be made to the above description, which will not be repeated here.

[0256] On this basis, the electronic device can detect a long press operation on the text a1, and in response to the long press operation, the electronic device can display the following Figure 4B The display interface 402 shown. The display interface 402 may also include a moving icon a2, and the description of the moving icon a2 may refer to the description in the embodiment 1, which will not be repeated here.

[0257] See also Figure 4C In the display interface 403 shown, the electronic device can detect a drag operation on the text a1. In response to the drag operation, the text a1 in the text selection state can be split and displayed as two texts (foreground text and background text). The description of the foreground text and the background text can refer to the description in Example 1, which will not be repeated here.

[0258] Next, when the electronic device detects that the position of the text a1 is dragged to the right edge hot zone of the screen, in response to this operation, the electronic device can start the arbitrary door function and present the process of opening the arbitrary door, such as Figure 4D The display interface 404 shown. The display interface 404 may include foreground text, a mobile icon a2, and an arbitrary door in an open state, wherein the arbitrary door in an open state may include a background layer, a foreground layer stacked on the background layer, and a side application layer. The content of the foreground layer is consistent with the content of the display interface 403 except for the foreground text, and is in a right perspective state; the side application layer includes a plurality of application icons and / or function icons, and the plurality of application icons and / or function icons are application icons and function icons that can receive text and are screened from all applications and achievable functions installed in the electronic device. Among them, the global favorite application icon can be arranged in the first icon position by default.

[0259] like Figure 4D As shown, when the electronic device further detects that the foreground text follows the user's dragging operation and moves to the corresponding position of the global collection icon included in the side application layer, the electronic device can start the global collection application to collect the text.

[0260] Optionally, in response to the drag operation, the size of the foreground text can also change from large to small during the process of moving to the position of the global favorites icon, forming a gradually disappearing visual effect. Accordingly, the global favorites icon can show dynamic feedback of enlarging and then shrinking during this process, and the interaction between the two forms a visual effect of the global favorites icon absorbing the foreground text.

[0261] It should be noted that, since the applications selected in the side application layer have been determined to be icons that can receive text, unlike Example 1, the feedback badge may not be displayed in the upper right corner during the movement of the foreground text.

[0262] Optionally, as a possible implementation, combining Figure 4D The display interface 404 and Figure 4F After the electronic device collects the text a1 into the global collection application, the collection ends, the arbitrary door closes, the background text switches to black font, and the global collection continues to be displayed on the screen in a hidden state. Figure 4D The display interface 404 shown, Figure 4E The display interface 405 and Figure 4F In the display interface 406 shown, after the electronic device collects the text a1 into the global collection application, the collection is completed, the arbitrary door is closed, the background text is switched to black font, and the global collection can first display the feedback state icon d, and then switch from the feedback state icon d to the hidden state icon b. The text on the feedback state icon d can be displayed as "Collected successfully", and a check mark can also be displayed on the icon to feedback to the user that the text a1 has been collected into the global collection.

[0263] Optionally, after the collection is successful, the global collection application can continue to be displayed on the screen in a hidden state b to indicate to the user that the global collection application is still running in the background, and the user can collect any material into the global collection at any time.

[0264] It can be understood that since in this embodiment, the Anygate function has been turned on, the preset Anygate processing priority is higher than the priority of the global collection. Therefore, in response to the user's long press operation on the text a1, the electronic device will not display the hidden icon of the global collection, and in response to the user's drag operation on the foreground text, the electronic device will not display the collection icon of the global collection, but will open the Anygate.

[0265] It can be understood that the above is an example of triggering global collection to realize text collection after opening any door when the any door function is turned on and global collection is not started.

[0266] Example 3 (such as Figure 4G-Figure 4I (shown)

[0267] After the above-mentioned embodiment 2, when the global collection is displayed in the form of a hidden icon b in the foreground, the electronic device can detect the selection operation on the text a3, so that the text a3 is in the text selected state; then, the electronic device can also detect the long press operation on the text a3 in the text selected state; in response to the long press operation, the electronic device can display the following Figure 4G The display interface 407 shown may further include a moving icon a2. For the moving icon a2, reference may be made to the description in Embodiment 1, which will not be repeated here.

[0268] See also Figure 4H In the display interface 408 shown, the electronic device can also detect a drag operation on the text a3. In response to the drag operation, the text a3 in the text selection state can be split and displayed as two texts (foreground text and background text). The description of the foreground text and the background text can refer to the description in Example 1, which will not be repeated here. Here, the global favorite hidden state icon b is still included in the display interface 408.

[0269] Next, when the electronic device detects that the position of the text a3 is dragged to the right edge hot zone of the screen, in response to this operation, the electronic device can start the Any Door function and present the animation process of the Any Door opening. At the same time, the hidden state icon b of the global favorite disappears, and the electronic device can display the following Fig. 4I The display interface 409 shown. For the introduction of the display interface 409, please refer to the description of the display interface 409 in Example 2. Figure 4D The introduction of the display interface 404 shown is not repeated here.

[0270] Further, the electronic device can detect that the foreground text follows the user's dragging operation and moves to the corresponding position of the global collection icon included in the side application layer, and then enable the global collection to collect text. For the subsequent reference, see Example 2 for Figure 4E and Figure 4F The description will not be repeated here.

[0271] It can be understood that the above is an example of triggering global collection to realize text collection after opening any door when the Any Door function is turned on and the global collection is running in the background and displayed in a hidden state in the foreground.

[0272] It is understandable that the collection process for other materials besides the excerpted video and global annotations, such as graphics, images, documents and other materials, is similar to the above. Please refer to the above description for details, and will not be repeated here.

[0273] It should be noted that the collection method provided by this application can shorten the user's collection path and improve collection efficiency by collecting materials through a global collection application; moreover, this method has clear feedback and avoids disturbing the user too much, so that users can interact intuitively and efficiently.

[0274] When the Any Door function is enabled on an electronic device and the global favorites are not enabled, multiple services can be provided to the user by opening the Any Door, which may include the global favorites.

[0275] When the Any Door function is turned on in the electronic device and the global collection is running in the background, since the triggering methods of the two conflict (for example, both are dragging operations on text in Example 3), the user's intention is unclear and the electronic device cannot directly determine whether the user needs to collect. Therefore, the Any Door can be set to have a higher priority, and more service options can be provided to the user by opening the Any Door, guiding the user to trigger related functions; among them, the global collection can be sorted in the first position.

[0276] 2. Video Excerpts (such as Figure 5A-5S As shown, Figure 6A-6G Shown and Figure 7A-7R (shown)

[0277] 1. Gesture trigger to enter video excerpt mode (such as Figure 5A-5J (shown)

[0278] Taking video applications as an example, the electronic device can detect a user operation on a certain video playback interface. In response to the user operation, the electronic device can enter a video excerpt mode and implement multiple functions such as video recording, marking, screenshot, and saving in the video excerpt mode.

[0279] like Figure 5A The display interface 501 shown is a playback interface corresponding to a certain video. In a possible implementation, Figure 5A As shown, the electronic device can detect a three-finger swipe operation on the playback interface, and in response to the three-finger swipe operation, the electronic device can enter a video excerpt mode and display the following Figure 5B Display interface 502 is shown. It should be noted that the user can also trigger the electronic device to enter the video excerpt mode in other ways (for example, other gestures, etc.), and this application does not limit this.

[0280] Compared with the display interface 501, the display interface 502 still includes a video playback interface, but the difference is that the display interface 502 also includes a first collection state 5021. It should be noted that the first collection state 5021 is a style of the collection state corresponding to the global collection application in the video excerpt scenario, such as Figure 2AThe collection state icon c31 shown in . Among them, the first collection state 5021 may include a video content area, a recording control, a marking control, a screenshot control and a completion control. When the video is not excerpted, the video content area may display the text "the video content will be excerpted here" to prompt the user of the display location of the excerpted content. During the video excerpting process, the text "recording" may be displayed to prompt the user that it is recording, and when the recording is paused, the excerpted content may be automatically saved to the video content area and displayed; the recording control may be used to start video recording, the recording control may be switched to a pause control, and the pause control may be used to pause video recording; the marking control may be used to mark the video frame corresponding to a certain time point during the video recording process, and the mark may also be called a time mark; the screenshot control may be used to capture the video screen; the completion control may be used to exit the video excerpting mode and trigger the collection of the excerpted video saved to the video content area.

[0281] It is understandable that the user can drag the first collection state 5021 to change its position. The electronic device can detect the drag operation acting on the first collection state 5021, and in response to the drag operation, the electronic device can move the position of the first collection state 5021.

[0282] Optionally, the display interface 502 may also display a card 5025 near the bottom of the screen, and the text "entered video excerpt mode" may be displayed on the card 5025 to prompt the user that the current electronic device has entered the video excerpt mode and can perform operations related to video excerpting. Subsequently, after staying for a preset period of time or in response to an operation on a control on the first collection state 5021, the card 5025 may disappear, and only the first collection state 5021 remains on the screen.

[0283] Taking the above three-finger sliding operation to trigger the electronic device to enter the video excerpt mode as an example, the dynamic effect process of the electronic device displaying the first collection state 5021 may include the following two:

[0284] Optionally, as a possible implementation method, in response to a three-finger swipe operation, the global collection may form a dynamic effect process in which the hidden state icon b is switched to a capsule-shaped icon and a first collection state 5021 grows below the capsule-shaped icon.

[0285] For example, see Figure 5C-5F , the electronic device can first display Figure 5C The display interface 503 shown in the figure, compared with the display interface 501, also includes a hidden icon b of global favorites on the right edge of the screen. Then, the hidden icon b gradually expands from right to left, and may appear as a capsule icon near the center of the screen, and display the text "global favorites"; at the same time, during the icon transformation process, see Figure 5D The display interface 504 and Figure 5E In the display interface 505 shown in FIG. 1 , a first collection state 5021 appears below the capsule icon, and the first collection state 5021 can be gradually extended downward until it is fully displayed, and then the capsule icon disappears, and only the first collection state 5021 remains on the screen. Fig. 5F Display interface 506 is shown, and display interface 506 is the same as display interface 502 without card 5025.

[0286] Optionally, as another possible implementation, in response to a three-finger swipe operation, the global collection may form a dynamic effect process in which the hidden state icon b is switched to a capsule-shaped icon and the first collection state 5021 is ejected from the capsule-shaped icon.

[0287] For example, see Figure 5G-5J , the electronic device can first display Figure 5G The display interface 507 shown is the same as the display interface 503, and also includes a hidden icon b of global favorites on the right edge of the screen. Then, the hidden icon b gradually expands from right to left, and may appear as a capsule icon near the center of the screen, and display the text "global favorites"; at the same time, during the icon transformation process, see Figure 5H The display interface 508 and Fig.5I In the display interface 509 shown, the first collection state 5021 appears at the lower left position of the capsule icon, and the size of the first collection state 5021 can be changed from small to large until it is displayed normally, the capsule icon disappears, and only the first collection state 5021 is retained on the screen, as shown in FIG. Figure 5J Display interface 510 is shown, and display interface 510 is the same as display interface 502 without card 5025.

[0288] 2. Multiple recordings (such as Figure 5K-5S (shown)

[0289] This application is explained using two consecutive recordings as an example, which is described in detail below.

[0290] First recording:

[0291] Based on the display interface 510, the electronic device can detect a click operation on the recording control included in the first collection state 5021, such as Figure 5K In response to the click operation, see Figure 5L In the display interface 511 shown, the first collection state 5021 can be switched to a window 5026 for display, and the electronic device can start recording the video played in the display interface 511 (eg, Figure 5L1. The video is played in the area indicated by 5111 in the window.) Compared with the first collection state 5021, the window 5026 has the following contents: the recording control is switched to a pause control, the recording control name "recording" is switched to a recording duration starting from "00:00", and the other contents remain unchanged.

[0292] Optionally, the text displayed in the video content area of ​​window 5026 may also be changed to "Recording" to prompt the user that recording has started.

[0293] As the video plays and the corresponding recording is performed, Figure 5M In the display interface 512 shown, it is assumed that after recording for 18 seconds, the window 5026 can be changed to the window 5027; relative to the window 5026, only the recording time is changed to "00:18", and other contents remain unchanged; at this time, the electronic device can detect the click operation on the pause control, such as Figure 5M As shown; in response to the click operation, the first recording stops, and the video content corresponding to the 18 seconds of excerpt can be temporarily stored in the video content area of ​​window 5027.

[0294] After the first temporary storage, the electronic device can display Figure 5N The display interface 513 shown in the figure may include a window 5028. Compared with the window 5027, the video content area of ​​the window 5028 may include the name of the excerpt video (which may be composed of the text "video excerpt" and the recording time by default) and the last frame of the video image in the recorded video segment. A play control may also be superimposed on the last frame of the video image in the first recording segment, and the play control may trigger the playback of the temporarily stored excerpt video segment in the video content area.

[0295] In addition, compared with form 5027, the pause control of form 5028 is switched back to the recording control, and the recording duration is also switched back to the name of the recording control "recording", and other controls remain unchanged.

[0296] It can be understood that the above is an example of the first recording process.

[0297] Optionally, after a recording is completed, the electronic device continues to display the window 5028 unchanged. At this time, the user can drag the progress bar corresponding to the video in the playback interface to change its playback content; the electronic device can detect the drag operation, such as Fig.5O Display interface 514 is shown; in response to the dragging operation, the video content played in the area indicated by 5151 in the display interface 514 changes relative to 5111.

[0298] Second recording:

[0299] Based on the display interface 514, the electronic device can detect a click operation on the recording control included in the window 5028, such as Figure 5P In response to the click operation, see Figure 5Q In the display interface 515 shown, the window 5028 can be switched to the window 5029 for display, and the electronic device can start recording the video played in the display interface 514 (eg, Figure 5Q 5151 in the figure). Compared with the form 5028, the form 5029 has the following contents, including the contents of the video content area, which remain unchanged, except that the record control is switched to a pause control and the name of the record control "record" is switched to a recording duration starting from "00:00".

[0300] As the video plays and the corresponding recording is performed, Figure 5R In the display interface 516 shown, assuming that after recording for 10 seconds, the window 5029 can be changed to the window 5030. Compared with the window 5029, the window 5030 only changes the recording time to "00:10", and the other contents remain unchanged, including the contents of the video content area. At this time, the electronic device can detect the click operation on the pause control again, such as Figure 5R As shown; in response to the click operation, the second recording stops, and the 10-second excerpted video content can be temporarily stored in the video content area of ​​window 5030.

[0301] After the second temporary storage, the electronic device can display Figure 5S The display interface 517 shown may include a window 5031. Compared with the window 5030, the video content area of ​​the window 5031 may continue to display the name corresponding to the first recording, but the image may be replaced by the last frame of the video image in the second recorded video segment. Play controls may also be superimposed on the last frame of the video image in the second recorded segment.

[0302] In addition, compared with window 5030, the pause control of window 5031 switches back to the recording control, and the recording duration switches back to the name of the recording control "recording", while other controls remain unchanged.

[0303] It can be understood that the above is an example of the second recording process.

[0304] It is understandable that, based on the display interface 517, multiple recordings or continuous recordings may be performed subsequently, and the recording process is similar to that described above and will not be described in detail here.

[0305] Understandable, Fig.5ODragging the video progress bar to change the playback content is only an example. The user can also switch applications or interfaces to change the playback content. That is, each recording in multiple recordings can record the playback videos of different applications, different playback videos in the same application, or different video clips in the same playback video, etc.

[0306] It is understandable that after one recording is completed, the video content area displays the last frame of the video image in the video clip recorded for the first time, and after the second recording is completed, the video content area is replaced with the last frame of the video image in the video clip recorded for the second time. This is only an example and is only used to feedback to the user through the change of the image that the recorded content has changed, and to inform the user that the recorded video has been temporarily stored in the video content area each time the recording stops. Of course, the image in the video content area can also be displayed according to other rules, which is not limited in this application. The height of the video content area and the window can be adjusted automatically according to the temporarily stored excerpt content.

[0307] It should be noted that after the above-mentioned second recording is completed, the two recorded video clips are automatically spliced ​​into a longer video clip and temporarily stored in the video content area, rather than temporarily storing two video clips. For example, after the second recording is completed, the first 18-second video clip and the second 10-second video clip will be spliced ​​into a 28-second video clip and temporarily stored in the video content area, and in the recording order, the first video clip is in front and the second video clip is in the back, not two video clips (one 18 seconds and the other 10 seconds). On this basis, if the third recording is performed continuously, the third video clip will be spliced ​​after the second video clip, and the three video clips will be spliced ​​into one video clip, and the rest is similar, which will not be repeated here.

[0308] 3. The first collection state or form can be minimized or re-called during use (such as Figure 6A-6G (shown)

[0309] For example, Fig. 6A As shown, the first collection state 5021 may also include a zoom-out control and a close control, wherein, optionally, the zoom-out control may be located at the upper left corner of the first collection state 5021, and the close control may be located at the upper right corner of the first collection state 5021. The zoom-out control is used to switch the first collection state 5021 to the hidden state icon b of the global collection, to indicate to the user that the global collection application continues to run in the background and can be called at any time; the close control is used to close the first collection state 5021 and exit the video excerpt mode (or exit the global collection).

[0310] After triggering entry into the video excerpt mode, the electronic device may detect a user operation on a zoom-out control, and in response to the user operation, the electronic device may switch from the first collection state 5021 to display a hidden state icon b of a global collection.

[0311] Correspondingly, the electronic device can also detect user operations on the global collection hidden state icon b. In response to the user operation, the electronic device can switch from the global collection hidden state icon b to the first collection state 5021 for display, and the user can continue to operate on the first collection state 5021 to perform video excerpts.

[0312] Optionally, in response to a user operation, when the first collection state 5021 is switched to the hidden state icon b of the global collection, the size can be changed from large to small, forming a dynamic visual effect of gradually disappearing. Correspondingly, when the hidden state icon b of the global collection is switched to the first collection state 5021, the size of the first collection state 5021 can be changed from small to large, and the shape can be gradually appeared. Dynamic visual effect.

[0313] Combination Figure 6B , Figure 6C , Fig.6D , Fig. 6E , Fig. 6F , Figure 6G As shown, during the recording process, various windows may include a zoom-out control and a close control, and the control functions may refer to the above examples. It can be understood that windows 5026 to 5031 have the same functions as the first collection state 5021, but the forms are different. Windows 5026 to 5031 are also some styles of the collection states corresponding to the global collection application in the video excerpt scenario.

[0314] For each form, the electronic device can detect the user operation on the reduction control, and then switch the corresponding form to the global collection hidden icon b for display; then, when the user operation on the hidden icon b is detected, it can also switch from the hidden icon b back to the corresponding form before reduction. The specific process is similar to the above example and will not be repeated here.

[0315] The present application sets the first collection state and various windows to be reduced at any time after the video excerpt mode is triggered, thereby reducing the display content of the playback interface and avoiding hindering the user's operations on the playback interface; at the same time, by setting the window recovery, the user can return to the window at any time to perform related operations, thereby improving the user experience.

[0316] 4. When you finish recording, you can save the excerpt video (such as Figure 7A-7R (shown)

[0317] After the second excerpt above stops, as Fig. 7AIn the display interface 701 shown, the electronic device can detect the user operation on the completion control in the window 5031. The display interface 701 is the same as the display interface 517 and will not be introduced here. In response to the user operation, the video excerpt is completed, and the excerpt content temporarily stored in the video content area can be collected into the global collection application.

[0318] As a possible implementation, during the collection process, the electronic device can be switched to Fig.7D In the display interface 703 shown, the electronic device may display a collection state icon c of the global collection to indicate that the video extracted by the user is being collected into the global collection. It can be understood that at this time, the global collection is the default collection mode of the extracted video.

[0319] Optionally, the collection state icon c of the global collection can display text such as "Video excerpt collection" in addition to the shape change compared to the hidden state icon b to prompt the user that the excerpted video is being collected, such as Figure 2A The collection state icon c32 shown in .

[0320] Optionally, in response to the user operation on the completion control, during the process of collecting the excerpted video into the global collection, the entire excerpted content can be reduced from large to small, forming a gradually disappearing visual effect. Accordingly, the collection state icon c of the global collection can present dynamic feedback of enlarging and then reducing, forming a visual effect of sucking in the excerpted video.

[0321] Alternatively, as a possible implementation, Fig.7D and Figure 7F As shown, after the electronic device collects the excerpted video into the global collection application, the collection ends, and the collection state icon c of the global collection can be switched back to the hidden state icon b. As another possible implementation, Fig.7D The display interface 703 shown, Fig. 7E The display interface 704 and Figure 7F In the display interface 705 shown, after the electronic device collects the excerpted video into the global collection application, the collection is completed, and the collection state icon c of the global collection can first be switched to the feedback state icon d, and then switched from the feedback state icon d to the hidden state icon b. The feedback state icon d can remain unchanged in form compared to the collection state icon c, and the text on the icon can be changed to "Collected successfully", and a check mark can also be displayed on the icon to feedback to the user that the excerpted video has been collected into the global collection.

[0322] Optionally, after the collection is successful, such as Figure 7F As shown, the global collection application can continue to be displayed in a hidden state on its interface to indicate to the user that the global collection application is still running and any material can be collected into the global collection at any time.

[0323] As another possible implementation, since the electronic device provided by the related art also includes a note application, the note application can also collect excerpted videos. Therefore, the embodiment of the present application can also combine the collection function of the note application during the collection process to pull together the usage scenarios and facilitate user use. In response to the user operation on the completion control in the form 5031, the electronic device can display the following information: Figure 7B The display interface 702 shown in the figure has the same other contents as the display interface 701, but a card 5022 is also displayed below the window 5031 displayed on the interface. By displaying the card 5022, the electronic device can provide the user with a variety of collection options.

[0324] Optionally, the card 5022 can be used to prompt the user that the electronic device can enable notes or global collections at this time, triggered by the user operation on the completion control, and the extracted video can be collected into the notes or global collection application, and the user can make a selection here. Figure 7B As shown, the card 5022 may include but is not limited to two options: "Save to Notes" and "Save to Global Collection". When the electronic device detects a user operation for "Save to Notes", the video excerpt may be collected into the note application; Figure 7C As shown, when the electronic device detects a user operation of "save to global collection", the excerpted video can be collected into the global collection application.

[0325] Optionally, later, if the excerpted video is saved in a note application, such as Fig.7O As shown, the electronic device can switch to display card 5023 to prompt the user that the excerpt video has been collected in the note. The electronic device can also display a text link such as "Go to note to view" on card 5023; in response to the user's operation on the text link, the electronic device displays the display content corresponding to the excerpt video collected in the note application. FIG. 7D to FIG. 7F Alternatively, the electronic device may also switch to display card 5024, such as Figure 7P As shown, the user is prompted in the form of card 5024 that the excerpt video has been collected in the global collection application. Here, the electronic device can also display text links such as "Go to global collection to view" on card 5024. In response to the user's operation on the text link, the electronic device can display the display content corresponding to the excerpt video collected in the global collection application.

[0326] For example, combining the above two recording examples, such as Fig. 7AAs shown, after the second recording stops, in response to a click operation on the completion control included in the form 5031, the excerpted video will be collected into the global collection; then, the global collection can be displayed with a hidden state icon b. Figure 7F The display interface 705 shown; Figure 7Q As shown, the electronic device can also detect a click operation on the hidden icon b. Figure 7Q and Figure 7F The interface shown is the same; Figure 7R As shown, in response to a click operation on the hidden state icon b, the electronic device can switch from the hidden state icon of the global collection to the suspended state for display. In the suspended state, since the video material is newly collected, the last material icon in the suspended state can indicate the newly collected video material, named "Video Excerpt 2305161602".

[0327] Taking the above-mentioned triggering of saving the excerpted video by displaying "Save to Global Collection" in the card 5022 as an example, the electronic device removes the window 5031 and switches to the collection state icon c32, and the dynamic effect process may include the following two:

[0328] Optionally, as a possible implementation method, in response to the user operation on the "Save to Global Favorites" option in the display card 5022, the electronic device may form an animation process of removing the card 5022, switching the window 5031 to the collection state icon c32 and gradually retracting the window 5031 under the collection state icon c32.

[0329] For example, see Figure 7G-7J In response to a user operation on the "Save to Global Favorites" option, the electronic device may first display the following Figure 7G The display interface 706 shown in FIG. 7 includes a window 5031 and a card 5022. Then, the card 5022 gradually disappears. During the disappearance of the card 5022, the collection state icon c32 gradually stretches from right to left on the screen. Figure 7H The display interface 707 and Fig.7I In the display interface 708 shown, the window 5031 gradually shrinks upward toward the collection state icon c32 until it completely disappears, and only the collection state icon c32 remains on the screen, as shown in FIG. Figure 7J The display interface 709 shown is the same as the display interface 703 and will not be described in detail here.

[0330] Optionally, as another possible implementation method, in response to the user operation on the "Save to Global Favorites" option in the display card 5022, the global favorites can form a process of removing the card 5022, switching from the window 5031 to the collection state icon c32 and forming a dynamic effect of the collection state icon c32 absorbing the window 5031.

[0331] For example, see Figure 7K-7N , the electronic device can first display Figure 7K The display interface 710 shown in FIG. 7 is the same as the display interface 706 and may include a window 5031 and a card 5022. Then, the card 5022 gradually disappears. During the disappearance of the card 5022, the collection state icon c32 gradually stretches from right to left on the screen. Figure 7L The display interface 711 and Figure 7M In the display interface 712 shown, the size of the window 5031 decreases from large to small until it disappears, and only the collection state icon c32 remains on the screen, such as Figure 7N The display interface 713 shown is the same as the display interface 703 .

[0332] It should be noted that the toolbars and the like involved in the video excerpting methods provided in the related art are all provided by the note application, and the functions implemented when excerpting videos are also related to the note application. The method provided in this application can decouple the video excerpting process from the note application, and couple it with the global collection application, which provides and calls the first collection state, cards, forms, etc. related to the video excerpt. In addition, the method provided in this application for collecting excerpted videos into the global collection application can be consistent with the collection logic of other types of materials, which is convenient for users to use, reduces the learning threshold, and improves the user experience.

[0333] It should be noted that after the above two recording stops, for windows 5028 to 5031 that have temporarily stored excerpts, if the electronic device does not detect a click operation on the completion control, but detects a click operation on the close control, then the electronic device will exit the video excerpt mode or exit the global collection, and the corresponding temporarily stored excerpt content will be cleared and will not be collected in the global collection.

[0334] 3. Method 1 for collecting global annotations (such as Figure 8A-8T As shown, Figure 9A-9D Shown and Figure 10A-Figure 10P (shown)

[0335] 1. Gesture trigger to enter global annotation mode (such as Figure 8A-8J (shown)

[0336] Taking WeChat as an example, the electronic device can detect a user operation on a display interface corresponding to a certain article. In response to the user operation, the electronic device can enter a global annotation mode and implement multiple functions such as annotating, sharing, and saving displayed content in the global annotation mode.

[0337] like Fig. 8AThe display interface 801 shown is a display interface corresponding to a certain article. In a possible implementation, Fig. 8A As shown, the electronic device can detect a knuckle C-shaped sliding operation on the display interface, and in response to the knuckle C-shaped sliding operation, the electronic device can enter a global annotation mode and display the following Figure 8B Display interface 802 is shown. It should be noted that the user can also trigger the electronic device to enter the global annotation mode in other ways (for example, other gestures, etc.), and this application does not limit this.

[0338] Compared with the display interface 801, the display interface 802 also includes a second collection state 8021 and an annotation toolbar 8022, and other contents are the same. It should be noted that the second collection state 8021 is a style of the collection state corresponding to the global collection application in the global annotation scenario, such as Figure 2A The collection state icon c41 shown in . Among them, the second collection state 8021 may include an annotation content area, an annotation control (also called a handwriting control), a sharing control and a saving control. The annotation content area can display the text "global annotation" to prompt the user of the display position of the annotation content when there is no annotation. During the annotation process, the text "annotating" can be displayed to prompt the user that the annotation is being annotated, and when the annotation is paused, the annotation content can be automatically temporarily saved to the annotation content area and displayed; the annotation control can be used to start annotation and pause annotation (here, since the C-shaped sliding operation of the knuckles has triggered the annotation, the annotation control has switched to black and the name is also displayed as "pause annotation" to prompt the user that the annotation can be started); the sharing control can be used to share the annotation content with other applications or other devices; the saving control can be used to save the annotation content that has been temporarily saved to the annotation content area; the annotation toolbar 8022 can be used to replace the annotation tool to present different annotation effects. The annotation toolbar 8022 may include various pens, erasers, color palettes, previous controls, next controls, etc. The tools included in the annotation toolbar 8022 can be adjusted and arranged according to personal needs. The size and position of the annotation toolbar 8022 can be changed based on the user's dragging operation. The embodiment of the present application does not impose any restrictions on this.

[0339] It is understandable that the electronic device can detect a drag operation on the second collection state 8021 , and in response to the drag operation, the electronic device can move the position of the second collection state 8021 .

[0340] Optionally, the display interface 802 may also display a card 8024 near the bottom, and the text "entered global annotation mode" may be displayed on the card 8024 to prompt the user that the current electronic device has entered the global annotation mode and can perform operations related to annotation. Subsequently, after staying for a preset period of time or in response to an operation on a control on the second collection state 8021, the card 8024 may disappear, and only the second collection state 8021 and the annotation toolbar 8022 are retained on the screen.

[0341] Taking the above-mentioned knuckle C-shaped sliding operation to trigger the electronic device to enter the global annotation as an example, the dynamic effect process of the electronic device displaying the second collection state 8021 may include the following two:

[0342] Optionally, as a possible implementation method, in response to a C-shaped sliding operation of the knuckles, the global collection may form a dynamic effect process in which the hidden state icon switches to a capsule-shaped icon and a second collection state 8021 grows below the capsule-shaped icon.

[0343] For example, see Figure 8C-8F , the electronic device can first display Figure 8C The display interface 803 shown in the figure, compared with the display interface 801, also includes a hidden icon b of global favorites on the right side of the screen. Then, the hidden icon b gradually expands from right to left, and may appear as a capsule icon near the center of the screen, and display the text "global favorites"; at the same time, during the icon transformation process, see Fig.8D The display interface 804 and Fig. 8E In the display interface 805 shown, a second collection state 8021 appears below the capsule icon, and the second collection state 8021 can be gradually extended downward. At the same time, the annotation toolbar 8022 can be gradually extended upward from the bottom edge of the screen until it is fully displayed. The capsule icon disappears, and only the second collection state 8021 and the annotation toolbar 8022 remain on the screen. Fig.8F Display interface 806 is shown, and display interface 806 is the same as display interface 802 without card 8024.

[0344] Optionally, as another possible implementation, in response to a knuckle C-shaped sliding operation, the global collection may form a dynamic effect process in which a hidden state icon is switched to a capsule-shaped icon and a second collection state 8021 is spit out from the capsule-shaped icon.

[0345] For example, see Figure 8G-8J , the electronic device can first display Figure 8GThe display interface 807 shown is the same as the display interface 803, and also includes a hidden icon b of global favorites on the right edge of the screen. Then, the hidden icon b gradually expands from right to left, and may appear as a capsule icon near the center of the screen, and display the text "global favorites"; at the same time, during the icon transformation process, see Figure 8H The display interface 808 and Figure 8I In the display interface 809 shown, a second collection state 8021 appears at the lower left position of the capsule icon, and the size of the second collection state 8021 can be changed from small to large. At the same time, the annotation toolbar 8022 can gradually stretch upward from the bottom edge of the screen until it is displayed normally. The capsule icon disappears, and only the second collection state 8021 and the annotation toolbar 8022 remain on the screen. Figure 8J Display interface 810 is shown, and display interface 810 is the same as display interface 802 without card 8024.

[0346] 2. Multiple annotations (such as Figure 8K-8T (shown)

[0347] This application is explained using two consecutive annotations as an example, which is described in detail below.

[0348] First comment:

[0349] Based on the display interface 810, the user starts to make annotations, and the electronic device can detect that the user presses his finger, such as Figure 8K As shown; as the user's finger slides until the finger is lifted, the electronic device can display corresponding annotation traces based on the sliding path of the finger. Here, Figure 8L In the display interface 811 shown in FIG. 1 , the user can cycle through the operations of pressing the finger, sliding, and then lifting the finger three times to select an area (such as an area where articles are displayed) for display. Figure 8L Draw the annotation trace of "yes" in the area indicated by 8111 in the figure.

[0350] Optionally, during the annotation process, the text displayed on the annotation content of the second collection state 8021 may be changed to "annotation in progress" to remind the user that the annotation has begun. The annotation toolbar 8022 may remain unchanged.

[0351] After the user lifts his finger for the third time to stop annotating, the electronic device can also detect a click operation on the annotation control included in the second collection state 8021, such as Figure 8M In response to the click operation, the electronic device may display Figure 8NThe display interface 812 shown. Compared with the display interface 811, the second collection state 8021 of the display interface 812 can be changed to a form 8025, and the annotation toolbar 8022 at the bottom disappears; compared with the second collection state 8021, the annotation control of the form 8025 is switched from black to white, and the name of the annotation control is switched from "pause annotation" to "start annotation"; at the same time, in response to the click operation on the annotation control included in the second collection state 8021, the electronic device can also generate a first snapshot of the display interface 811 with annotation traces, excluding the second collection state 8021 and the annotation toolbar 8022, and temporarily save the first snapshot to the annotation content area in the form 8025. The annotation content area can display the partial content of the first snapshot. In addition, since the first snapshot including the annotation traces is temporarily saved, the annotation traces in the article disappear.

[0352] Optionally, the first snapshot of the annotation content area can be used to trigger a full-screen preview. For example, in response to a user clicking on the first snapshot of the annotation content, the electronic device can switch to display a full-screen preview interface corresponding to the first snapshot; the upper left corner of the full-screen preview interface can include a return control, which can trigger a switch back to the display interface 812.

[0353] It can be understood that the above is an example of the first annotation process.

[0354] Optionally, after one annotation is completed, the electronic device may continue to display the window 8025 unchanged. At this time, the user may slide the display interface to change its display content; the electronic device may detect the sliding operation from bottom to top, such as Fig.8O The display interface 813 shown; in response to the sliding operation, the display content in the area indicated by 8131 in the display interface 813 changes relative to 8111.

[0355] Second comment:

[0356] Based on the display interface 813, the electronic device can detect a click operation on the annotation control included in the window 8025, such as Figure 8P In response to the click operation, the electronic device may display Figure 8Q As shown in the display interface 814, relative to the display interface 813, the window 8025 can be changed to the window 8026, and the annotation toolbar 8022 reappears at the bottom; relative to the window 8025, the annotation control of the window 8026 is switched from white to black, and the name of the annotation control is also switched from "start annotation" to "pause annotation", and other contents remain unchanged.

[0357] Based on the display interface 814, Figure 8QAs shown, the user starts to annotate, and the electronic device can detect that the user presses the finger; then, as the user slides the finger until the finger is lifted, the electronic device can display the corresponding annotation trace based on the sliding path of the finger, such as Figure 8R Display interface 815 is shown. Compared with display interface 814, display interface 815 has the addition of annotation traces, while other contents remain unchanged.

[0358] After the user lifts his finger to stop annotating, the electronic device can also detect a click operation on the annotation control included in the form 8026, such as Figure 8S In response to the click operation, the electronic device may display Figure 8T The display interface 816 shown. Compared with the display interface 815, the display interface 816 has a window 8026 that can be changed to a window 8027, and the annotation toolbar 8022 at the bottom disappears; compared with the window 8026, the annotation control of the window 8027 is switched from black to white, and the name of the annotation control is switched from "pause annotation" to "start annotation"; at the same time, in response to a click operation on the annotation control included in the window 8026, the electronic device can also generate a second snapshot of the display interface 815 with annotation traces but not including the window 8026, and temporarily save the second snapshot to the annotation content area in the window 8027. The annotation content area can display the partial content of the second snapshot. In addition, since the second snapshot including the annotation traces is temporarily saved, the annotation traces in the article disappear.

[0359] Optionally, the second snapshot of the annotation content area can also be used to trigger a full-screen preview. That is, in response to the user's click operation on the second snapshot of the annotation content, the electronic device can switch to display the full-screen preview interface corresponding to the second snapshot; the upper left corner of the full-screen preview interface can include a return control, and the return control can trigger the electronic device to switch back to the display interface 816.

[0360] Optionally, the electronic device detects a rightward sliding operation on the full-screen preview interface corresponding to the second snapshot and may switch the display to the full-screen preview interface corresponding to the first snapshot.

[0361] It can be understood that the above is an example of the second annotation process.

[0362] Optionally, based on the display interface 816, multiple annotations or continuous annotations may be performed subsequently. The annotation process is similar to that described above and will not be described in detail here.

[0363] Understandable, Fig.8OThe sliding interface shown to change the display content is only an example. The user can also switch applications or interfaces to change their display content. That is, each annotation in multiple annotations can annotate the display interface of a different application, different display interfaces of the same application, or different areas in the same display interface, etc.

[0364] It is understandable that after one annotation is completed, the annotation content area displays the partial content of the first snapshot generated by the first annotation, and after the second annotation is completed, the annotation content area is replaced with the partial content of the second snapshot generated by the second annotation. This is only an example and is only used to feedback to the user through the change of the snapshot that the annotation content has changed. The snapshot generated each time the annotation stops has been temporarily stored in the annotation content area. The snapshot of the annotation content area can also be displayed in full, or multiple snapshots can also be displayed side by side left and right or up and down. This application does not limit this. The height of the annotation content area and the window can be adjusted automatically according to the amount of temporarily stored annotation content.

[0365] Optionally, when multiple snapshots temporarily stored in the annotation content area are displayed in parallel, a delete control may be displayed in the upper right corner of each snapshot, and the delete control is used to trigger the deletion of the corresponding snapshot. Multiple snapshots temporarily stored in the annotation content area may also support dragging and sorting.

[0366] 3. The second collection state or form can be minimized or re-called during use (such as Figure 9A-9D (shown)

[0367] For example, Fig. 9A As shown, the second collection state 8021 may also include a zoom-out control and a close control, wherein, optionally, the zoom-out control may be located at the upper left corner of the second collection state 8021, and the close control may be located at the upper right corner of the second collection state 8021. The zoom-out control is used to switch the second collection state 8021 to the hidden state icon b of the global collection, to indicate to the user that the global collection application continues to run in the background and can be called at any time; the close control is used to close the second collection state 8021 and exit the global annotation mode (or exit the global collection).

[0368] After triggering to enter the global annotation mode, the electronic device can detect the user operation on the zoom-out control. In response to the user operation, the electronic device can switch from the second collection state 8021 to the hidden state icon b of the global collection. However, the annotation toolbar 8022 at the bottom of the interface continues to be displayed.

[0369] Accordingly, the electronic device can also detect a user operation on the global favorite hidden state icon b. In response to the user operation, the electronic device can switch from the global favorite hidden state icon b to the second collection state 8021 for display. The user can continue to operate on the second collection state 8021 to make global annotations. The annotation toolbar 8022 at the bottom continues to be displayed.

[0370] Optionally, in response to a user operation, when the second collection state 8021 is switched to the hidden state icon b of the global collection, the size can be changed from large to small, forming a dynamic visual effect of gradually disappearing. Correspondingly, when the hidden state icon b of the global collection is switched to the second collection state 8021, the size of the second collection state 8021 can be changed from small to large, and the shape can be gradually appeared. Dynamic visual effect.

[0371] Combination Fig. 9B , Fig. 9C , Fig.9D As shown, during the annotation process, various windows can include a zoom-out control and a close control, and the control functions can refer to the above examples. It can be understood that windows 8025 to 8027 have the same functions as the second collection state 8021, but the forms are different. Windows 8025 to 8027 are also some styles of the collection states corresponding to the global collection application in the global annotation scenario.

[0372] For each form, the electronic device can detect the user operation on the reduction control, and then switch the form to the hidden state icon b of the global collection for display; then, when the user operation on the hidden state icon b is detected, it can also switch from the hidden state icon b back to the corresponding form when it was reduced. The specific process is similar to the above example and will not be repeated here.

[0373] The present application is set to shrink the second collection state and various windows at any time after triggering the global annotation mode, thereby reducing the display content of the display interface and avoiding hindering the user's operations on the display interface; at the same time, by setting the window recovery, the user can return to the window at any time to perform related operations, thereby improving the user experience.

[0374] 4. When you finish annotating, you can save the annotation (such as Figure 10A-Figure 10P (shown)

[0375] After the second annotation above stops, if Fig. 10A In the display interface 1001 shown, the electronic device can detect the user operation on the completion control in the form 8027. The display interface 1001 is the same as the display interface 816 and will not be introduced here. In response to the user operation, the global annotation is completed, and the annotation content temporarily stored in the annotation content area can be collected into the global collection application.

[0376] As a possible implementation, during the collection process, the electronic device can be switched to Fig. 10D In the display interface 1003 shown, the electronic device may display a collection state icon c of the global collection to indicate that the content annotated by the user is being collected into the global collection. It can be understood that at this time, the global collection is the default collection mode of the global annotation.

[0377] Optionally, the collection state icon c of the global collection can display text such as "global annotation collection" in addition to the shape change compared to the hidden state icon b to prompt the user that the content of the global annotation is being collected. Figure 2A The collection state icon c42 shown in .

[0378] Optionally, in response to a user operation on the save control, during the process of collecting the global annotation into the global collection, the entire annotation content may be reduced from large to small, forming a gradually disappearing visual effect. Accordingly, the collection state icon c of the global collection may present dynamic feedback of enlarging and then reducing, forming a visual effect of absorbing the annotation content.

[0379] Alternatively, as a possible implementation, Fig. 10D and Fig.10E As shown, after the electronic device collects the annotation content into the global collection application, a collection is completed, and the collection state icon c of the global collection can be switched back to the hidden state icon b. As another possible implementation, Fig. 10D The display interface 1003 shown, Fig.10E The display interface 1004 and Fig.10F In the display interface 1005 shown, after the electronic device collects the annotation content into the global collection application, the collection is completed, and the collection state icon c of the global collection can be switched to the feedback state icon d first, and then switched from the feedback state icon d to the hidden state icon b. The feedback state icon d can remain unchanged in form compared to the collection state icon c, and the text on the icon can be changed to "Collected successfully", and a check mark can also be displayed on the icon to feedback to the user that the global annotation has been collected into the global collection.

[0380] Optionally, after the collection is successful, such as Fig.10F As shown, the global collection application can continue to be displayed in a hidden state on its interface to indicate to the user that the global collection application is still running and any material can be collected into the global collection at any time.

[0381] As another possible implementation, since the electronic device provided by the related art also includes a note application, the note application can also collect global annotations. Therefore, the embodiment of the present application can also combine the collection function of the note application during the collection process to pull together the usage scenarios and facilitate user use. In response to the user operation on the completion control in the form 8027, the electronic device can display the following Fig. 10B The display interface 1002 shown in the figure has the same other contents as the display interface 1001, but a card 8023 is also displayed below the window 8027 displayed on the interface. By displaying the card 8023, the electronic device can provide the user with a variety of collection options.

[0382] Optionally, the card 8023 is used to prompt the user that the electronic device can enable the gallery, notes or global collection, etc., triggered by the user operation on the save control, and the global annotation can be collected into the gallery, notes, global collection and other applications, and the user can make a selection here. Fig. 10B As shown, the card 8023 may include but is not limited to four saving options: "Save as Image", "Save as PDF", "Save to Notes", and "Save to Global Collection". When the electronic device detects a user operation for "Save to Notes", the global annotation is collected into the note application; Fig. 10C As shown, when the electronic device detects a user operation of "save to global favorites", the global annotations are collected into the global favorites application. Other operations are similar and will not be described in detail here.

[0383] Optionally, after the global annotation is saved in the note application, the electronic device can also switch to display card 5023 to prompt the user that the global annotation has been saved in the note. Fig.7O After the global annotation is collected in the global collection application, the collection process shown in 10D to 10F can also be displayed; or the electronic device can also switch to display card 5024 to prompt the user that the global annotation has been collected in the global collection application in the form of card 5024. Figure 7P The introduction of , I will not go into details here.

[0384] For example, in combination with the above two annotation examples, when the second annotation stops, in response to a click operation on the completion control included in the form 8027, the annotation content will be collected into the global collection, and then the global collection can be displayed with the hidden state icon b. Fig.10F The electronic device can also detect a click operation on the hidden icon b, such as Fig.10OAs shown; in response to a click operation on the hidden state icon b, the electronic device can switch from the hidden state icon b of the global collection to the suspended state for display. In the suspended state, since the annotation material is newly collected, the last material icon in the suspended state can indicate the annotation material just collected, and the name is "Global Annotation 2305171130".

[0385] Taking the above-mentioned triggering of saving global annotations by displaying "Save to global collection" in card 8023 as an example, the electronic device removes window 8027 and switches to collection state icon c42, and the dynamic effect process may include the following two:

[0386] Optionally, as a possible implementation method, in response to the user operation on the "Save to Global Favorites" option in the display card 8023, the global collection can form an animation process of removing the card 8023, switching from the window 8027 to the collection state icon c42 and gradually retracting the window 8027 under the collection state icon c42.

[0387] For example, see Figure 10G-10J In response to a user operation on the "Save to Global Favorites" option, the electronic device may first display the following Figure 10G The display interface 1006 shown in FIG. 1 includes a window 8027 and a card 8023. Then, the card 8023 gradually disappears. During the disappearance of the card 8023, the collection state icon c42 gradually stretches from right to left on the screen. Fig. 10H The display interface 1007 and Fig.10I In the display interface 1008 shown in FIG. 1008 , the window 8027 gradually shrinks upward toward the collection state icon c42 until it completely disappears, and only the collection state icon c42 remains on the screen. Fig.10J The display interface 1009 shown is the same as the display interface 1003 .

[0388] Optionally, as another possible implementation method, in response to the user operation on the "Save to Global Favorites" option in the display card 8023, the global favorites can form a process of removing the card 8023, switching from the window 8027 to the collection state icon c42 and forming a dynamic effect of the collection state icon c42 absorbing the window 8027.

[0389] For example, see Figure 10K-Figure 10N , the electronic device can first display Figure 10K The display interface 1010 shown in FIG. 1006 is the same as the display interface 1010 and may include a window 8027 and a card 8023. Then, the card 8023 gradually disappears. During the disappearance of the card 8023, the collection state icon c42 gradually stretches from right to left on the screen. Fig.10LThe display interface 1011 and Figure 10M In the display interface 1012 shown, the size of the window 8027 decreases from large to small until it disappears, and only the collection state icon c42 remains on the screen, such as Fig.10N The display interface 1013 shown is the same as the display interface 1003 .

[0390] It should be noted that the method provided by this application is coupled with the global collection application, and the global collection application provides and calls the second collection state, annotation toolbar, card, form, etc. related to the global annotation. In addition, the method provided by this application for collecting global annotations into the global collection application can be consistent with the collection logic of the above-mentioned excerpted video, which is convenient for users to use, reduces the learning threshold, and improves the user experience.

[0391] It should be noted that after the above two annotations are stopped, for windows 8025 to 8027 that have temporarily stored the annotation content, if the electronic device does not detect a click operation on the completion control, but detects a click operation on the close control, then the electronic device will exit the global annotation mode or exit the global collection, and the temporarily stored annotation content will be cleared and will not be collected in the global collection.

[0392] 4. Method 2 for collecting global annotations (such as Figure 11A-Figure 11Q (shown)

[0393] 1. Gesture trigger to enter global annotation mode (such as Figure 11A-11B (shown)

[0394] Fig.11A The display interface 1101 shown is Fig. 8A The display interface 801 shown is the same, and reference may be made to the description of the display interface 801 , which will not be repeated here.

[0395] like Fig.11A As shown, the electronic device can detect a knuckle C-shaped sliding operation on the display interface 1101, and in response to the knuckle C-shaped sliding operation, the electronic device can enter a global annotation mode and display the following information: Fig. 11B Display interface 1102 is shown.

[0396] Compared with the display interface 1101, the display interface 1102 also includes a third collection state 11021 and an annotation toolbar 11022, and other contents are the same. It should be noted that the third collection state 11021 is another style of the collection state corresponding to the global collection application in the global annotation scenario, such as Figure 2AThe collection state icon c42 shown in . Among them, the third collection state 11021 may include annotation controls, sharing controls, save controls and close controls from left to right. The annotation control can be used to start or pause annotation (here, since the C-shaped sliding operation of the knuckles has triggered the annotation, the annotation control has switched to black to prompt the user that the annotation can be started); the sharing control can be used to share the content of the annotation with other applications or other devices; the save control can be used to temporarily store annotations, select the saved content, save order and save method, and then save; the close control can be used to exit the global annotation; the annotation toolbar 11022 is the same as the annotation toolbar 8022. Please refer to the above introduction to the annotation toolbar 8022, which will not be repeated here.

[0397] Compared with the second collection state 8021, the third collection state 11021 does not include the annotation content area, is smaller in size, and obstructs less the underlying display content.

[0398] It is understandable that the electronic device can detect a drag operation on the third collection state 11021. In response to the drag operation, the electronic device can move the position of the third collection state 11021. In addition, in order to reduce the obstruction of the displayed content, the third collection state 11021 can be displayed near the top of the screen by default.

[0399] Optionally, the display interface 1102 may also display a card 11023 near the bottom, and the text "Entered global annotation mode" may be displayed on the card 11023 to prompt the user that the current electronic device has entered the global annotation mode and can perform operations related to annotation. Subsequently, after staying for a preset period of time or in response to an operation on a control on the third collection state 11021, the card 11023 may disappear. Only the third collection state 11021 and the annotation toolbar 11022 are retained on the screen.

[0400] Optionally, the display interface 1102 may also display a card 11024 below the annotation control included in the third collection state 11021, and the card 11024 has the text "Click to pause and temporarily save the annotation", which is used to prompt the user that clicking the annotation control can pause the annotation and temporarily save the annotated content. Optionally, the card 11024 may also include another close control for triggering the hiding of the card 11024.

[0401] 2. Pause and save the annotations during the annotation process (such as Figure 11C-11G (shown)

[0402] See also Fig. 11CThe display interface 1103 shown in the figure includes a third collection state 11021 and an annotation toolbar 11022, wherein the annotation control in the third collection state 11021 may be black, indicating that annotation is possible. Fig. 11C As shown, after the user annotates the display interface, such as drawing an annotation trace of "yes", the electronic device can detect the user operation on the annotation control in the third collection state 11021; in response to the user operation, the electronic device can display Fig.11D Display interface 1104 is shown; compared with display interface 1103, the annotation control of display interface 1104 can be switched to white to prompt the user that the annotation has been paused. At the same time, the annotation toolbar at the bottom disappears, and the annotation traces also disappear.

[0403] At the same time, in response to the user operation on the annotation control in the third collection state 11021, the electronic device can generate a snapshot 11025 of the display interface 1103 currently having the annotation trace, excluding the third collection state 11021 and the annotation toolbar 11022, and reduce the snapshot and superimpose it on the screen for display, such as Fig.11D shown.

[0404] Optionally, combined Fig.11D The display interface 1104 shown, Fig.11E The display interface 1105 shown, Fig.11F In the display interface 1106 shown, after the snapshot is generated, the snapshot 11025 can gradually move on the screen to the location of the save control in the third collection state 11021, and the size gradually decreases during the movement. Accordingly, the size of the save control can first increase and then decrease, and the interaction between the two forms an animation effect of the snapshot 11025 flying into the save control or the save control absorbing the snapshot 11025.

[0405] Optionally, combined Fig.11F The display interface 1106 and Fig.11G In the display interface 1107 shown, the snapshot 11025 disappears after moving on the screen to the position of the save control in the third collection state 11021. At the same time, a badge can be displayed in the upper right corner of the save control. The size of the badge number can increase by 1 each time a snapshot is temporarily stored. The badge is used to feedback to the user that the snapshot has been successfully stored.

[0406] Alternatively, if Fig.11GIn the display interface 1107 shown, when the snapshot 11025 is successfully temporarily stored, a card 11026 with the text "Click to continue annotating" can also be displayed below the annotation control in the third collection state 11021. The card 11026 can be used to prompt the user to trigger the annotation control to continue annotating (i.e., continuous annotation). It can be understood that the card 11026 can automatically disappear after being displayed for a preset time or in response to an operation on a control on the third collection state 11021.

[0407] In order to avoid interfering with the user's operations on other applications or interfaces outside the global collection, the present application can use the annotation control in conjunction with the save control. For example, after operating the annotation control once, the electronic device can implement the function of pausing and temporarily saving the annotation during the annotation process. Then, the user can switch interfaces or applications, and the electronic device can detect the corresponding switching operations, as well as operations on other applications, etc.; and then, after operating the annotation control again, the electronic device can implement the continuous annotation function.

[0408] For example, after the electronic device detects a click operation on the annotation control in the display interface 1107, it can switch to the display interface 1102 without the card 11023. Based on the display interface 1102 without the card 11023, the user can make a second annotation; the process of temporarily storing the annotation after stopping is the same as the above FIG. 11C to FIG. 11G Similar, no further elaboration is required here.

[0409] 3. When you finish annotating, you can save the annotation (such as Figure 11H-Figure 11O (shown)

[0410] See also Fig.11H In the display interface 1108 shown, it is assumed that after two annotations are stopped, the annotation control switches to white, indicating that the user's annotation has been paused; the corner mark in the upper right corner of the save control in the third collection state 11021 can display 2 to indicate that two snapshots are temporarily stored; Fig.11H As shown, the electronic device can detect a user operation on a save control; in response to the user operation, the electronic device can display Fig.11I The display interface 1109 shown. Compared with the display interface 1108, the display interface 1109 covers a mask layer on the original display interface, and the bottom area above the mask layer may also include a card 11027.

[0411] Optionally, the card 11027 may include a title "Global Annotation", a save button, and a snapshot icon, which may indicate a temporarily stored snapshot. Here, since two snapshots are temporarily stored, two snapshot icons may be displayed; in addition, the card 11027 may also include a select all control for triggering the selection of all snapshot icons with one click, saving user time and improving operation efficiency.

[0412] Optionally, the lower right corner of each snapshot icon may also include a serial number to indicate the corresponding order; the card 11027 may also include a prompt "Long press to drag to adjust the order" to prompt the user to drag the snapshot icon to change its position after long pressing to change the order of the snapshot icons, thereby changing the order of multiple snapshots when they are saved. Thus, in response to the operation of long pressing and dragging the snapshot icon, the snapshot icon can change its position following the user's dragging.

[0413] Optionally, after long pressing, the upper right corner of each snapshot icon may also include a delete control, and the delete control is used to trigger deletion of the corresponding snapshot.

[0414] like Fig.11J As shown, the electronic device can detect a user operation on the save button on the card 11027; in response to the user operation, the electronic device can display Figure 11K Display interface 1110 is shown. In display interface 1110, card 11027 is switched to card 11028 relative to display interface 1109. Card 11028 may include, but is not limited to, options such as "Save as Picture", "Save as PDF", "Save as Notes", and "Save as Global Favorites". In response to a user operation on any of the options, the electronic device may save the selected temporarily stored annotation in the selected manner.

[0415] like Fig.11L As shown, the electronic device can detect a user operation on the "Save as Global Favorites" option on card 11028; in response to the user operation, the electronic device can save the selected temporarily stored annotation to the global favorites application.

[0416] Optionally, during the saving process, the electronic device may display Fig.11M The display interface 1111 shown, in which the electronic device can display the collection state icon c of the global collection to prompt the user that the temporarily stored annotations are being collected into the global collection.

[0417] Optionally, the collection state icon of the global collection can also display text such as "global annotation collection" to prompt the user that the content of the global annotation is being collected, that is, Figure 2A The collection state icon c42 shown in .

[0418] Alternatively, as a possible implementation, Fig.11M and Fig.11O As shown, after the electronic device collects the annotation content into the global collection application, a collection is completed, and the collection state icon c of the global collection can be switched back to the hidden state icon b. As another possible implementation, Fig.11MThe display interface 1111 shown, Fig.11N The display interface 1112 and Fig.11O In the display interface 1113 shown, after the electronic device collects the annotation content into the global collection application, the collection is completed, and the collection state icon c of the global collection can be switched to the feedback state icon d first, and then switched from the feedback state icon d to the hidden state icon b. The form of the feedback state icon d can remain unchanged compared to the collection state icon c, and the text on the icon can be changed to "Collected successfully", and the icon can also include a check mark to feedback to the user that the global annotation has been collected into the global collection.

[0419] Optionally, after the collection is successful, such as Fig.11O As shown, the global collection application can continue to be displayed in a hidden state on its interface to indicate to the user that the global collection application is still running and any material can be collected into the global collection at any time.

[0420] Optionally, based on the display interface 1110 , the electronic device may also detect a click operation on a “cancel” control; in response to the click operation, the electronic device may switch from the display interface 1110 back to the display interface 1108 .

[0421] It can be understood that the above is an example of a saving process performed when two annotations are stopped and temporarily saved.

[0422] Optionally, assuming that during the third annotation process, the user has drawn on the display interface, but has not triggered the annotation control for temporary storage; at this time, if the electronic device detects a click operation on the save control included in the third collection state 11021, the electronic device may also overlay a mask and card 11027 on the current display interface. It should be noted that, although the content drawn by the third annotation is not temporarily stored at this time, since the save control is triggered, the content of the third annotation may also be temporarily stored after generating a snapshot (without animation), so the card 11027 displayed here includes not only the two snapshots generated by the first two annotations, but also the snapshot generated by the third annotation.

[0423] Optionally, in response to a click operation on an area other than card 11027 , the electronic device may cancel the mask and card 11027 , and return to the display interface before displaying the mask and card 11027 .

[0424] 4. When exiting the annotation, you can choose not to save or save the temporarily saved annotation (such as Figure 11P-Figure 11Q (shown)

[0425] See also Figure 11P The display interface 1114 shown is the same as the display interface 1108 and is in a paused state after the second annotation. For details, please refer to the description of the display interface 1108, which will not be repeated here.

[0426] like Figure 11P As shown, the electronic device can detect a user operation for closing a control in the third collection state 11021; in response to the user operation, the electronic device can display Figure 11Q The display interface 1115 shown. Compared with the display interface 1114, the display interface 1115 covers the original interface with a mask layer, and the bottom area above the mask layer may also include a card 11028.

[0427] Optionally, the card 11028 may include a prompt "Do you want to save this annotation?", as well as a do not save button (or cancel button) and a save button; the do not save button may trigger exiting the global annotation mode (or exiting the global collection); the save button may trigger saving of the temporarily stored annotation content; the electronic device may detect a click operation on the save control; in response to a click operation on the save button, the electronic device may display a Figure 11I-Figure 11O The saving process shown is not described in detail here. In response to the click operation on the non-save control, the two temporarily stored snapshot data are deleted, and the electronic device exits the global annotation mode.

[0428] It can be understood that the above is an example of a closing process performed when two annotations have been stopped and temporarily saved.

[0429] Optionally, assuming that during the third annotation process, the user has drawn on the display interface, but has not triggered the annotation control for temporary storage; at this time, if the electronic device detects a click operation on the close control included in the third collection state 11021, the electronic device can also superimpose a mask and card 11028 on the current display interface. It should be noted that although the content drawn by the third annotation is not temporarily stored at this time, since the close control is triggered, the content of the third annotation can also be temporarily stored after generating a snapshot (without animation). Therefore, if the click operation on the save button included in card 11028 is then responded, the electronic device can switch from card 11028 to card 11027 for display, and the card 11027 displayed here includes not only the two snapshots generated by the first two annotations, but also the snapshot generated by the third annotation. If the click operation on the do not save button included in card 11028 is then responded, the three temporarily stored snapshot data are all deleted, and the electronic device exits the global annotation mode.

[0430] Optionally, in response to a click operation on an area other than card 11028 , the electronic device may cancel the mask and card 11028 and return to the display interface before displaying the mask and card 11028 .

[0431] It should be noted that, similar to the global annotation method 1, the global annotation method 2 provided in this application is coupled with the global collection application, and the global collection application provides and calls the collection state, annotation toolbar, cards, etc. related to the global annotation.

[0432] Different from global annotation method 1, the global collection state involved in global annotation method 2 occupies a smaller area on the display interface and interferes less with the displayed content; the dynamic effect and superscript changes involved in the save button can more intuitively feedback that the user's annotation content is automatically temporarily stored without the user actively performing the save operation. In addition, the newly added cards 11207 and 11208 can provide users with more options, such as saving content, saving order and saving method, etc., which improves the user experience.

[0433] The above content is an introduction to several collection scenarios provided in the embodiments of this application.

[0434] Optionally, for the above-mentioned three-finger sliding operation and knuckle C-shaped sliding operation, this application can be enabled and disabled through the system application. Fig. 12A In the display interface 1201 shown in FIG. 1 , the main interface of the setting application of the electronic device may include auxiliary function options; in response to user operations on the auxiliary function options, the electronic device may display the following Fig. 12B The auxiliary function interface 1202 shown in the figure may include quick start and gesture options; Fig. 12C As shown, the electronic device can detect the user operation for the quick start and gesture options; in response to the user operation, the electronic device can display Fig.12D The quick launch and gesture options interface 1203 shown; the quick launch and gesture options interface 1203 may include a three-finger swipe down option and a corresponding first switch, as well as a knuckle C-shaped slide option and a corresponding second switch, the first switch is used to turn on or off the three-finger swipe down operation applicable to global collections, and the second switch is used to turn on or off the knuckle C-shaped slide operation applicable to global collections.

[0435] Alternatively, as a possible implementation, Fig.13A As shown, the electronic device can detect a sliding operation from right to left on the screen; in response to the sliding operation, the electronic device can display the following on the original interface: Fig. 13B The sidebar shown in FIG. 1 may include multiple application icons, wherein the multiple application icons may include icons corresponding to global collections; then, as shown in FIG. Fig. 13C As shown, the electronic device can detect a click operation on the icon corresponding to the global favorite; in response to the click operation, the electronic device can display Fig.13DThe display interface shown in FIG. 1 may include a suspended state of a global collection, such as Figure 2A The suspended state e1 is shown.

[0436] Alternatively, as another possible implementation, Fig.14A The display interface 1401 shown is a full-screen state of global collections. In the upper right corner of the full-screen state, three dots may be included to indicate a "more" control. The "more" control is used to indicate that more functions are included. The electronic device may detect a user operation on the "more" control; in response to the user operation, such as Fig. 14B In the display interface 1402 shown, the electronic device may display a card 14021 below the "More" control; the card 14021 includes but is not limited to "Create Desktop Shortcut", "Clipboard" and "Settings" options. Fig. 14C As shown, the electronic device can detect a user operation for the "create desktop shortcut" option; in response to the user operation, such as Fig.14D As shown, the electronic device can display the desktop and add an icon corresponding to the global collection on the desktop. Fig.14E As shown, the electronic device can also detect a user operation on the global favorites icon on the desktop, and respond to the user operation, such as Fig.14F As shown, the electronic device can display the global collection in full screen.

[0437] Similarly, when the electronic device displays the floating state of the global collection, the electronic device can also display card 14021 after detecting the user operation on the "More" control; then, in response to the user operation of "Create desktop shortcut", it triggers the creation of a global collection application icon on the desktop. For details, please refer to the above description and will not be repeated here.

[0438] It should be supplemented that, optionally, when the electronic device establishes a Bluetooth connection with the stylus, the electronic device can also display a stylus shortcut control. In one possible implementation, the electronic device can detect an operation on the stylus shortcut control, and in response to the operation, the electronic device can directly perform text collection, video excerpts, global annotation collection, etc. The shortcut control is used to trigger the electronic device to perform text collection, video excerpts, global annotation collection, etc. In another possible implementation, the electronic device can detect an operation on the stylus shortcut control, and in response to the operation, the electronic device can display multiple shortcut options, including a text collection shortcut option, a video excerpt shortcut option, a global annotation collection shortcut option, etc. The electronic device can detect a user operation on a certain shortcut option, and in response to the user operation, the electronic device can collect the corresponding material.

[0439] Optionally, all of the above materials can be collected into the global collection by copying and pasting. For example, for text materials, in response to a click operation on the copy option corresponding to the text, the text is copied, and then in response to a user operation, the global collection application is opened, and the electronic device displays the main interface corresponding to the global collection. Then, in response to the paste operation, the copied text can be pasted into the main interface of the global collection and displayed in the form of an icon corresponding to the text. The collection process of other types of materials is similar and will not be repeated here.

[0440] Optionally, in the above-mentioned multiple collection processes, after the above-mentioned collected texts, images, web pages, video excerpts, global annotations and other materials are successfully collected, when the feedback state of the global collection is displayed on the display interface, the electronic device can also detect a user operation on the feedback state icon d; in response to the user operation, the electronic device can display the full-screen state of the global collection, such as Figure 2A The full screen state f shown in . When the global collection is in the full screen state, icons of multiple collected materials can be displayed in the display interface.

[0441] Fig.15 An exemplary flow chart of a material collection method provided in an embodiment of the present application.

[0442] In some possible cases, the exemplary process involved in the electronic device processing the material can refer to the following description of steps S1501 to S1505.

[0443] S1501: The electronic device displays a first interface, where the first interface includes a first initial material.

[0444] It is understandable that the first interface may be a playback interface corresponding to a video involved in the aforementioned content (eg, a video playback interface of a video application).

[0445] In a possible implementation, the first interface may be Figure 5A In the display interface 501 shown, the first initial material is the video content played in the display interface 501. At this time, the first initial material is a video type.

[0446] S1502: In response to a first operation on the first interface, start a target application, and display a first collection-state icon corresponding to the target application in a floating manner on the first interface.

[0447] It can be understood that the target application is the global favorite application mentioned above.

[0448] It can be understood that the first collection state icon is the first collection state 5021 mentioned above.

[0449] It can be understood that the first interface displaying the first collection state icon corresponding to the target application can be the first interface of the aforementioned content. Figure 5B Display interface 502 is shown.

[0450] S1503: In response to a second operation on a first control included in the first collection-state icon, obtain a first material based on the first initial material.

[0451] It can be understood that the first control is the recording control in the first collection state 5021 mentioned above, and the second operation can be a click operation. The type of the first material is video.

[0452] S1504: In response to a third operation on a second control included in the first collection state icon, the first material is collected into a target application through the first collection state icon.

[0453] It can be understood that the second control is the completion control in the first collection state 5021 mentioned above, and the third operation can be a click operation.

[0454] S1505: After the first material is collected, the first collection state icon is switched to a hidden state icon corresponding to the target application.

[0455] It can be understood that after the first collection state icon is switched to the hidden state icon, the hidden state icon continues to be suspended and displayed on the first interface. Figure 7A-7F The described process is similar and will not be repeated here.

[0456] The relevant contents involved in step S1501 to step S1505 can refer to the description of the relevant contents of the video excerpt in the previous text, and will not be repeated here. The exemplary interface involved in step S1501 and step S1505 can refer to the previous description of the video excerpt. Figure 5A-Figure 5B ,as well as Figure 7A-7F The description of the relevant contents will not be repeated here.

[0457] The following is an introduction to the device involved in the embodiments of the present application.

[0458] Fig.16 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0459] The electronic device may include a processor 110 , an external memory interface 120 , an internal memory 121 , an audio module 130 , a speaker 130A, a receiver 130B, a microphone 130C, an earphone interface 130D, a display screen 140 , a camera 150 , and a touch sensor 160 .

[0460] The structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. The interface connection relationship between the modules illustrated in the embodiments of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device.

[0461] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. A memory may also be provided in the processor 110 for storing instructions and data.

[0462] The electronic device implements the display function through the GPU, the display screen 140, and the application processor.

[0463] The GPU is a microprocessor for image processing, which is connected to the display screen 140 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information. The display screen 140 is used to display images, videos, etc. In some embodiments, the electronic device may include 1 or N display screens 140, where N is a positive integer greater than 1.

[0464] In the embodiment of the present application, the electronic device displays the aforementioned Figure 2A-2H , Figure 3A-Figure 3F , Figure 4A-Figure 4I , Figure 5A-5S , Figure 6A-6G , Figure 7A-7R , Figure 8A-8T , Figure 9A-9D , Figure 10A-Figure 10P , Figure 11A-Figure 11Q , Figures 12A-12D , Figures 13A-13D , Figure 14A-14F The capabilities of the user interface shown rely on the display functions provided by the GPU, display screen 140, and application processor described above.

[0465] The camera 150 is used to capture still images or videos. The ISP is used to process the data fed back by the camera 150. Light is transmitted to the camera photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The electronic device may include 1 or N cameras 150, where N is a positive integer greater than 1. The video codec is used to compress or decompress digital video. The electronic device may support one or more video codecs. In this way, the electronic device can play or record videos in multiple encoding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0466] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM). The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data. The non-volatile memory can also store executable programs and store user and application data, etc., and can be loaded into the random access memory in advance for direct reading and writing by the processor 110.

[0467] In the embodiment of the present application, the code for implementing the information processing method described in the embodiment of the present application may be stored in a non-volatile memory. When running the camera application, the electronic device may load the executable code stored in the non-volatile memory into the random access memory.

[0468] The external memory interface 120 may be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device.

[0469] The electronic device can implement audio functions through the audio module 130, the speaker 130A, the receiver 130B, the microphone 130C, the headphone interface 130D, and the application processor.

[0470] The audio module 130 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The speaker 130A, also called "speaker", is used to convert audio electrical signals into sound signals. The receiver 130B, also called "earpiece", is used to convert audio electrical signals into sound signals. The microphone 130C, also called "microphone", "microphone", is used to convert sound signals into electrical signals. The headphone interface 130D is used to connect wired headphones.

[0471] In the embodiment of the present application, when the speech-to-text function is turned on, the electronic device can enable the microphone 130C to collect sound signals and convert the sound signals into corresponding text.

[0472] The touch sensor 160 is also called a "touch control device". The touch sensor 160 can be arranged on the display screen 140. The touch sensor 160 and the display screen 140 form a touch screen, also called a "touch control screen". The touch sensor 160 is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 140. In other embodiments, the touch sensor 160 can also be arranged on the surface of the electronic device, which is different from the position of the display screen 140.

[0473] In the embodiment of the present application, the electronic device can use the touch sensor 160 to detect the user's click, slide and other operations on the display screen 140 to achieve Figure 2A-2H , Figure 3A-Figure 3F , Figure 4A-Figure 4I , Figure 5A-5S , Figure 6A-6G , Figure 7A-7R , Figure 8A-8T , Figure 9A-9D , Figure 10A-Figure 10P , Figure 11A-Figure 11Q , Figures 12A-12D , Figures 13A-13D , Figure 14A-14F The material processing method shown.

[0474] Fig.17 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application.

[0475] The software system of the electronic device may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to illustrate the software structure of the electronic device.

[0476] It should be understood that the layered architecture can divide the software into several layers, each layer has a clear role and division of labor; the layers can communicate with each other through software interfaces.

[0477] like Fig.17 As shown, the Android system can be divided into four layers: from top to bottom, they are application layer, application framework layer, Android runtime and system library, and kernel layer. The application layer can include a series of application packages.

[0478] like Fig.17As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0479] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0480] like Fig.17 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0481] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0482] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0483] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0484] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including answering, hanging up, etc.).

[0485] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0486] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.

[0487] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0488] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0489] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0490] The system library may include multiple functional modules, such as: surface manager, media library, 3D graphics processing library (such as open graphics library for embedded systems (OpenGL ES)) and 2D graphics engine (such as skia graphics library (SGL)).

[0491] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0492] The media library supports playback and recording of multiple audio formats, playback and recording of multiple video formats, and still image files. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, moving picture experts group audio layer III (MP3), advanced audio coding (AAC), adaptive multi-rate (AMR), joint photographic experts group (JPG) and portable network graphics (PNG).

[0493] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0494] A 2D graphics engine is a drawing engine for 2D drawings.

[0495] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0496] In the embodiment of the present application, the electronic device can use the above software system to realize the display of the above Figure 2A-2H , Figure 3A-Figure 3F , Figure 4A-Figure 4I , Figure 5A-5S , Figure 6A-6G , Figure 7A-7R , Figure 8A-8T , Figure 9A-9D , Figure 10A-Figure 10P , Figure 11A-Figure 11Q , Figures 12A-12D , Figures 13A-13D , Figure 14A-14F The material processing method shown.

[0497] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A material collection method, characterized in that: The method comprises: Displaying a first interface, wherein the first interface includes a first initial material; In response to a first operation on the first interface, a target application is started, and a first collection state icon corresponding to the target application is suspended and displayed on the first interface; In response to a second operation on a first control included in the first collection state icon, acquiring a first material based on the first initial material; In response to a third operation on a second control included in the first collection state icon, the first material is collected into the target application through the first collection state icon; After the first material is collected, the first collection state icon is switched to a hidden state icon corresponding to the target application, and the size of the hidden state icon is smaller than the size of the first collection state icon.

2. The method according to claim 1, characterized in that Starting the target application and floatingly displaying the first collection state icon corresponding to the target application on the first interface includes: Starting the target application and floatingly displaying the hidden icon on the first interface; The hidden state icon switches to a capsule-shaped icon, and the first collection state icon stretches out from the edge of the hidden state icon until it is fully displayed; or, the hidden state icon switches to the capsule-shaped icon, and the first collection state icon appears from the edge of the capsule-shaped icon, and the size changes from small to large; The capsule icon disappears.

3. The method according to claim 1 or 2, characterized in that: In response to a second operation on a first control included in the first collection state icon, obtaining a first material based on the first initial material includes: In response to a second operation on the first control, the first control is switched to a third control, and first material is acquired based on the first initial material; In response to a fourth operation on the third control, the acquisition is stopped and the obtained first material is saved in a fourth control included in the first collection state icon, and the third control is switched to the first control; In the fourth control, a first thumbnail indicating the first material is displayed.

4. The method according to claim 3, characterized in that After displaying a first thumbnail indicating the first material, the method further includes: In response to the first interface switching operation, displaying a second interface, wherein the second interface includes a second initial material and the first collection state icon; In response to a fifth operation on the first control, the first control is switched to the third control, and starts to acquire a second material based on the second initial material; the second material is of the same type as the first material; In response to a sixth operation on the third control, the acquisition is stopped and the obtained second material is saved in the fourth control, and the third control is switched to the first control; In the fourth control, a second thumbnail is displayed, where the second thumbnail indicates a third material generated by splicing the first material and the second material; the third material serves as the first material.

5. The method according to any one of claims 1 to 4, characterized in that The first collection state icon further includes a fifth control, and the method further includes: In response to a seventh operation on the fifth control, the first collection state icon is switched to the hidden state icon; In response to an eighth operation on the hidden state icon, the hidden state icon is switched to the first collection state icon.

6. The method according to any one of claims 1 to 5, characterized in that In response to a third operation on a second control included in the first collection state icon, collecting the first material into the target application through the first collection state icon includes: In response to a third operation on the second control, displaying a first card, wherein the first card includes an option indicating the target application; In response to a ninth operation on the option indicating the target application, the first material is collected into the target application through the first collection-state icon.

7. The method according to claim 6, characterized in that After the first material is collected, the first collection state icon is switched to the hidden state icon, including: After the first material is collected, the first card disappears, and the first collection state icon switches to a second collection state icon corresponding to the target application, where the second collection state icon is used to prompt that the first material is being collected; The second collection state icon is switched to a feedback state icon corresponding to the target application, and the feedback state icon is used to prompt that the collection is successful; The feedback state icon is switched to the hidden state icon.

8. The method according to claim 7, characterized in that The first collection state icon is switched to the second collection state icon corresponding to the target application, including: The second collection state icon is displayed, and the first collection state icon shrinks toward the edge of the second collection state icon until it disappears; or, the second collection state icon is displayed, and the first collection state icon moves toward the edge of the second collection state icon, and its size decreases from large to small until it disappears.

9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: In response to the tenth operation on the hidden icon displayed after collection, the hidden icon is switched to a floating icon corresponding to the target application, and the floating icon is displayed in the first interface or the second interface; the floating icon includes a first icon indicating the first material.

10. The method according to any one of claims 4 to 9, characterized in that The method further comprises: Displaying a third interface, wherein the third interface includes a third initial material; In response to an eleventh operation on the third interface, starting the target application, and floatingly displaying a third collection state icon corresponding to the target application on the third interface; Based on the third initial material, obtaining a fourth material; the fourth material is different from the first material and the second material in type; In response to a twelfth operation on a sixth control included in the third collection state icon, the fourth material is collected into the target application through the third collection state icon; After the fourth material is collected, the third collection state icon is switched to the hidden state icon, and the size of the hidden state icon is smaller than the size of the third collection state icon.

11. The method according to claim 10, characterized in that The third collection state icon corresponding to the target application is displayed in a suspended manner on the third interface, including: Starting the target application and floatingly displaying the hidden icon on the third interface; The hidden state is switched to a capsule-shaped icon, and the third collection state icon stretches out from the edge of the hidden state until it is fully displayed, or the hidden state icon is switched to the capsule-shaped icon, and the third collection state icon appears from the edge of the capsule-shaped icon and changes in size from small to large; The capsule icon disappears.

12. The method according to claim 10 or 11, characterized in that: Based on the third initial material, obtaining a fourth material includes: Starting to acquire a fourth material based on the third initial material; In response to a thirteenth operation on the seventh control included in the third collection state icon, the acquisition is stopped and the obtained fourth material is saved in a ninth control included in the third collection state icon, and the seventh control is switched to an eighth control; In the ninth control, a third thumbnail image indicating the fourth material is displayed.

13. The method according to claim 12, characterized in that After displaying the third thumbnail indicating the fourth material, the method further includes: In response to the second interface switching operation, displaying a fourth interface, the fourth interface including a fourth initial material and the third collection state icon; In response to a fourteenth operation on the eighth control, the eighth control is switched to the seventh control, and starts to acquire a fifth material based on the fourth initial material; the fifth material is of the same type as the fourth material; In response to the fifteenth operation on the seventh control, the acquisition is stopped and the obtained fifth material is saved in the ninth control, and the seventh control is switched to the eighth control; In the ninth control, a fourth thumbnail indicating the fifth material is displayed, or a third thumbnail indicating the fourth material and the fourth thumbnail indicating the fifth material are displayed, and the fourth material and the fifth material are collectively regarded as the fourth material.

14. The method according to any one of claims 10 to 13, characterized in that The third collection state icon further includes a tenth control, and the method further includes: In response to a sixteenth operation on the tenth control, the third collection state icon is switched to the hidden state icon; In response to the seventeenth operation on the hidden state icon, the hidden state is switched to the third collection state icon.

15. The method according to any one of claims 10 to 14, characterized in that In response to a twelfth operation on the sixth control included in the third collection state icon, the fourth material is collected into the target application through the third collection state icon, including: In response to a twelfth operation on the sixth control, displaying a second card, the second card including an option indicating the target application; In response to an eighteenth operation on the option indicating the target application, the fourth material is collected into the target application through the third collection-state icon.

16. The method according to claim 15, characterized in that After the fourth material is collected, the third collection state icon is switched to the hidden state icon, including: After the fourth material is collected, the second card disappears, and the third collection state icon is switched to a fourth collection state icon corresponding to the target application, and the fourth collection state icon is used to prompt that the fourth material is being collected; The fourth collection state icon is switched to a feedback state icon; The feedback state icon switches the hidden state icon.

17. The method according to claim 16, characterized in that The third collection state icon is switched to a fourth collection state icon corresponding to the target application, including: The fourth collection state icon is displayed, and the third collection state icon shrinks toward the edge of the fourth collection state icon until it disappears; or, the fourth collection state icon is displayed, and the third collection state icon moves toward the edge of the fourth collection state icon, and its size changes from large to small until it disappears.

18. The method according to any one of claims 10 to 17, characterized in that The method further comprises: In response to the nineteenth operation on the hidden state icon displayed after collection, the hidden state icon is switched to the floating state icon, and the floating state icon is displayed in a floating manner on the third interface or the fourth interface; the floating state icon includes a second icon indicating the fourth material.

19. The method according to any one of claims 10 to 18, characterized in that The method further comprises: Displaying a fifth interface, wherein the fifth interface includes a fifth initial material; In response to the twentieth operation on the fifth interface, starting the target application, and floatingly displaying a fifth collection state icon corresponding to the target application on the fifth interface; Based on the fifth initial material, a sixth material is obtained; the sixth material is of the same type as the fourth material and the fifth material; In response to a twenty-first operation on the eleventh control included in the fifth collection state icon, the acquisition is stopped and the obtained sixth material is saved in the twelfth control included in the fifth collection state icon, and the eleventh control is switched to the thirteenth control.

20. The method according to claim 19, characterized in that Saving the obtained sixth material to the twelfth control included in the fifth collection state icon includes: generating a fifth thumbnail based on the sixth material; The fifth thumbnail moves toward the twelfth control, and its size decreases from large to small until it disappears; The obtained sixth material is saved in the twelfth control included in the fifth collection state icon, and a digital subscript is added to the twelfth control or the digital subscript is increased by 1.

21. The method according to claim 20, characterized in that The method further comprises: In response to a twenty-second operation on the twelfth control, displaying a third card, the third card including the fifth thumbnail and a save button; In response to a twenty-third operation on the save button, the third card is switched to a fourth card, and the fourth card includes an option indicating the target application; In response to a twenty-fourth operation on the option indicating the target application, the sixth material is collected into the target application through the fifth collection state icon; After the sixth material is collected, the fifth collection state icon is switched to the hidden state icon.

22. The method according to claim 21, characterized in that After the sixth material is collected, the fifth collection state icon is switched to the hidden state icon, including: After the sixth material is collected, the fourth card disappears, and the fifth collection state icon switches to the fourth collection state icon corresponding to the target application; The fourth collection state icon is switched to a feedback state icon; The feedback state icon is switched to the hidden state icon.

23. The method according to claim 21, characterized in that The fifth collection state further includes a fourteenth control, and before responding to a twenty-third operation on the save button, the method further includes: In response to a twenty-fifth operation on the fourteenth control, displaying a fifth card, the fifth card including prompt information and a save option, the prompt information being used to prompt saving of the sixth material saved in the twelfth control; In response to a twenty-sixth operation on the save option, the third card is displayed.

24. The method according to claim 4, characterized in that The types of the first material, the second material and the third material include at least video, and the first operation is a three-finger sliding operation.

25. The method according to claim 19, characterized in that The types of the fourth material, the fifth material, and the sixth material include at least annotations, and the eleventh operation and the twentieth operation are C-shaped sliding operations.

26. The method according to claim 10, characterized in that The hidden state icon is in a semi-transparent semicircle; the first collection state icon and the third collection state icon are in a window shape.

27. The method according to claim 22, characterized in that The second collection state icon, the fourth collection state icon and the fifth collection state icon are in capsule shape.

28. An electronic device, characterized in that: include: one or more processors and memory; The memory is coupled to the one or more processors, and the memory is used to store computer program codes, wherein the computer program codes include computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method as described in any one of claims 1 to 27.

29. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by an electronic device, the electronic device executes the method according to any one of claims 1 to 27.

Images