Cross-end interaction method and related device thereof

Abstract

The application provides a cross-terminal interaction method and a related device, and relates to the technical field of terminals. According to the method, when a first electronic device displays a first material, the target application is started and a hidden state icon is displayed through a first stage of a first operation; the first material is collected into the target application through a second stage of the first operation, and the hidden state icon is switched to a collected state icon; after the first material is collected, the collected state icon is switched to the hidden state icon again; before the first material is collected, a second electronic device displays the hidden state icon; after the first material is collected, the hidden state icon on the second electronic device is switched to a floating state icon through a third operation; at this time, the floating state icon comprises a first icon indicating the first material and a first superscript indicating that the first material comes from an electronic device other than the second electronic device. The application can improve the efficiency of cross-terminal interaction by collecting materials on one device and automatically synchronizing the icons of the materials on other devices.

Description

[0001] This application is a divisional application of Chinese patent application filed on July 12, 2023, with application number 202310863214.0 and title "Cross-end Interaction Method and Related Device". Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a cross-platform interaction method and related devices. Background Technology

[0003] With the continuous development of terminal technology, electronic devices can support the collection of different types of materials in various forms. For example, taking mobile phones as an example, users can copy and save text, capture images, record audio and video, and also collect web pages and videos obtained from some applications (such as news apps). In addition, electronic devices can also support the organization of materials. For example, users can copy, edit, and delete collected materials through their mobile phones.

[0004] In practice, the process of collecting and organizing materials involves not only diverse collection methods and material types, but also multiple applications and multiple collection and organization processes. Moreover, with the increasing variety of terminals and the widespread use of multi-device collaboration, cross-platform processing is even more likely. Currently available file management and note-taking applications offer solutions that are functionally fragmented, limited, and inconvenient, severely impacting the user experience.

[0005] Therefore, improving the efficiency of cross-platform material processing via electronic devices is an urgent problem to be solved. Summary of the Invention

[0006] This application provides a cross-platform interaction method and related device. According to this method, electronic devices can collect and synchronize different types of materials to a global collection application across platforms. Furthermore, collected materials can be reorganized and used centrally for a single purpose. This approach significantly improves the efficiency of collecting, organizing, and sharing materials, thereby enhancing the user experience.

[0007] In a first aspect, this application provides a cross-platform interaction method, which can be applied to a cross-platform interaction system including a first electronic device and a second electronic device. The method may include: The first electronic device displays a first interface, which includes first materials; In the first electronic device, in response to the first stage of the first operation on the first material, the target application is launched and a hidden icon corresponding to the target application is displayed floating on the first interface; In the first electronic device, in response to the second stage of the first operation on the first material, the hidden icon is switched to the collection icon corresponding to the target application, and the first material is collected into the target application through the collection icon; the size of the hidden icon is smaller than the size of the collection icon, and the collection icon is displayed floating on the first interface; the first stage and the second stage are continuous. In the first electronic device, after the first material is collected, the collected state icon switches to the hidden state icon; In the first electronic device, in response to a second operation on the collected hidden icon, the hidden icon is switched to a floating icon corresponding to the target application, the floating icon is displayed floatingly on the first interface, and the floating icon includes a first icon indicating the first material; Before the first material is collected, the second electronic device displays a second interface, wherein the hidden icon corresponding to the target application is displayed floating on the second interface; After the first material is collected, the second electronic device detects a third operation targeting the hidden icon in the second interface; In the second electronic device, in response to the third operation, the hidden icon is switched to the floating icon, which is displayed floatingly on the second interface. The floating icon includes a first icon indicating the first material and a first badge, the first badge indicating that the first material comes from another electronic device besides the second electronic device.

[0008] In some embodiments of this application, the first electronic device is a mobile phone, and the second electronic device is a tablet computer or a desktop computer.

[0009] The target application is the global favorites application in this embodiment. A hidden icon is displayed on the second electronic device to indicate that the target application has been launched.

[0010] In some embodiments of this application, the process of collecting the first material can be instructed Figures 3A-3F The text collection process is as shown.

[0011] In some embodiments of this application, the process of viewing the first icon on the first electronic device can indicate Figure 3G-Figure 3H The process that is shown.

[0012] In some embodiments of this application, the process of viewing the first icon on the second electronic device can indicate Figures 3I-3J The process that is shown.

[0013] In the solution provided in this application, when the first electronic device displays the first material, it launches the target application and displays the hidden icon through the first stage of the first operation; through the second stage of the first operation, it collects the first material into the target application, and the hidden icon switches to the collected icon; after the first material is collected, the collected icon switches back to the hidden icon; by performing the second operation on the hidden icon, the first icon corresponding to the first material can be seen in the switched floating icon.

[0014] Meanwhile, before the first material is collected, the second electronic device displays a hidden icon; after the first material is collected, through a third operation, the hidden icon on the second electronic device switches to a floating icon. At this time, the floating icon includes a first icon indicating the first material and a first badge indicating that the first material originated from another electronic device besides the second electronic device. This application enables the collection of material on the first electronic device and the automatic synchronization of the material's icon on other devices in the loop (such as the second electronic device). This achieves synchronization without manual interaction, improving the efficiency of cross-device interaction. Furthermore, the material icon displayed on the collecting device does not have a badge, while the material icon displayed on the synchronizing device has a badge. This distinction allows users to intuitively see the source of the material, improving the user experience.

[0015] In conjunction with the first aspect, in one possible implementation, the floating icon in the second electronic device includes a first control, and after the floating icon is displayed floatingly on the second interface, the method further includes: In the second electronic device, in response to a fourth operation on the first control, the second interface displays a first card, the first card including at least a plurality of callable service options corresponding to the first electronic device, the callable service options including a shooting option; In the second electronic device, in response to a fifth operation on the shooting option, the second electronic device sends a first instruction to the first electronic device, the first instruction being used to instruct the camera application of the first electronic device to be launched; After receiving the first instruction, the first electronic device launches the camera application and displays the shooting interface; In the second electronic device, the first card switches to a multi-screen collaboration interface, which is displayed floatingly on the second interface. The multi-screen collaboration interface includes the shooting interface corresponding to the first electronic device.

[0016] In some embodiments of this application, the first control indicates a "more" control.

[0017] In some embodiments of this application, the shooting options may include photo shooting options and video recording options.

[0018] In conjunction with the first aspect, in one possible implementation, the shooting interface includes shooting controls, and the method further includes: In the second electronic device, in response to a sixth operation on the shooting control included in the multi-screen collaboration interface, a second instruction is sent to the first electronic device, the second instruction being used to instruct shooting; After receiving the second instruction, the first electronic device takes a picture and collects the captured second material into the target application of the first electronic device; After the second material is collected, the floating icon of the first electronic device includes a second icon indicating the second material; The first electronic device sends the second icon and the second badge to the second electronic device, the second badge being used to indicate that the second material comes from another electronic device besides the second electronic device.

[0019] In some embodiments of this application, the shooting control may include a photo control and a video recording control.

[0020] In some embodiments of this application, the second electronic device triggers the shooting option across devices; it invokes the shooting function on the first electronic device to capture second material; the second material is an image or video. This process can instruct... Figures 4A-4B , Figures 4C-4F The process shown illustrates how to access the camera service on a mobile phone from the desktop computer to take a picture.

[0021] According to this implementation method, the second electronic device can call the camera service on the first electronic device to take pictures and collect images or videos. Then, the first electronic device displays the second icon and sends it to the second electronic device.

[0022] It is understandable that when the screen of the first electronic device is locked, it can be taken by the second electronic device by accessing the camera service without unlocking it.

[0023] It is understandable that the first electronic device can simply send the second icon to the second electronic device, and the second electronic device can add a second badge to mark it when it receives the second icon.

[0024] In conjunction with the first aspect, in one possible implementation, the callable service option further includes a recording option, and the method further includes: In the second electronic device, in response to a seventh operation for the recording option, the second electronic device sends a third instruction to the first electronic device, the third instruction being used to instruct the first electronic device to launch a recording application; After receiving the third instruction, the first electronic device starts the recording application and displays the recording interface; In the second electronic device, the first card is switched to the multi-screen collaboration interface, which is displayed floatingly on the second interface. The multi-screen collaboration interface includes the recording interface corresponding to the first electronic device.

[0025] In conjunction with the first aspect, in one possible implementation, after receiving the third instruction, the first electronic device launches the recording application and displays the recording interface, including: The first electronic device displays a lock screen interface; In the first electronic device, in response to an unlocking operation on the lock screen interface, the recording application is launched and the recording interface is displayed; In the second electronic device, the multi-screen collaboration interface includes the recording interface corresponding to the first electronic device, which includes: When the first electronic device displays the lock screen interface, the multi-screen collaboration interface in the second electronic device displays a lock screen prompt interface, which is used to prompt the first electronic device to lock. When the first electronic device launches the recording application and displays the recording interface, in the second electronic device, the lock screen prompt interface included in the multi-screen collaboration interface is switched to the recording interface corresponding to the first electronic device.

[0026] In conjunction with the first aspect, in one possible implementation, the recording interface includes recording controls, and the method further includes: In the second electronic device, in response to an eighth operation on the recording control included in the multi-screen collaboration interface, a fourth instruction is sent to the first electronic device, the fourth instruction being used to instruct recording; After receiving the fourth instruction, the first electronic device records the audio and collects the third material obtained from the recording into the target application of the first electronic device; After the third material is collected, the floating icon of the first electronic device includes a third icon indicating the third material; The first electronic device sends the third icon and the third badge to the second electronic device, wherein the third badge is used to indicate that the third material comes from another electronic device other than the second electronic device.

[0027] In some embodiments of this application, the second electronic device triggers the recording option across devices; it then invokes the recording function on the first electronic device to capture third material; the third material is audio. This process can instruct... Figures 5A-5HThe process of recording audio by calling the audio service on the mobile phone from the desktop computer.

[0028] According to this implementation method, the second electronic device can call the audio service on the first electronic device to record audio, thereby collecting audio. Then, the first electronic device displays a third icon and sends it to the second electronic device.

[0029] Understandably, when the screen of the first electronic device is locked, it needs to be unlocked on the first electronic device; only after unlocking can the second electronic device call the audio service to record audio.

[0030] Understandably, the first electronic device can simply send the third icon to the second electronic device, and the second electronic device can add a third superscript to mark it upon receiving the third icon.

[0031] In conjunction with the first aspect, in one possible implementation, the callable service information further includes a handwritten option, and the method further includes: In the second electronic device, in response to a ninth operation for the handwriting option, the second electronic device sends a fifth instruction to the first electronic device, the fifth instruction being used to instruct the first electronic device to launch a note-taking application; After receiving the fifth instruction, the first electronic device launches the note-taking application and displays the handwriting input interface; In the second electronic device, the first card is switched to the multi-screen collaboration interface, which is displayed floatingly on the second interface. The multi-screen collaboration interface includes the handwriting input interface corresponding to the first electronic device.

[0032] In conjunction with the first aspect, in one possible implementation, after receiving the fifth instruction, the first electronic device launches the note-taking application and displays a handwriting input interface, including: The first electronic device displays a lock screen interface; In the first electronic device, in response to an unlocking operation on the lock screen interface, the first electronic device launches the note-taking application and displays the handwriting input interface; In the second electronic device, the multi-screen collaboration interface includes the handwriting input interface corresponding to the first electronic device, comprising: When the first electronic device displays the lock screen interface, the multi-screen collaboration interface in the second electronic device displays a lock screen prompt interface, which is used to prompt the first electronic device to lock. When the first electronic device launches the note-taking application and displays the handwriting input interface, in the second electronic device, the lock screen prompt interface included in the multi-screen collaboration interface is switched to the handwriting input interface corresponding to the first electronic device.

[0033] In conjunction with the first aspect, in one possible implementation, the handwriting input interface includes a handwriting input area and a completion control, and the method further includes: In the second electronic device, in response to an input operation on the handwriting input area included in the multi-screen collaboration interface, handwriting input content is sent to the first electronic device; In response to a tenth operation on the completion control, a sixth instruction is sent to the first electronic device, the sixth instruction indicating that the handwriting input is complete; After receiving the sixth instruction, the first electronic device will collect the fourth material obtained from the received handwritten input content into the target application of the first electronic device; After the fourth material is collected, the floating icon of the first electronic device includes a fourth icon indicating the fourth material; The first electronic device sends the fourth icon and the fourth corner mark to the second electronic device, wherein the fourth corner mark is used to indicate that the fourth material comes from another electronic device other than the second electronic device.

[0034] In some embodiments of this application, a second electronic device triggers the handwriting option across devices; it then invokes the handwriting function on the first electronic device to collect a fourth piece of material; the fourth piece of material is a note. This process can instruct... Figures 6A-6D The diagram illustrates the process of cross-platform access to the handwriting input service on the mobile phone side from the desktop computer side for handwriting input.

[0035] According to this implementation method, the second electronic device can call the handwriting input service on the first electronic device to perform handwriting and collect notes. Then, the first electronic device displays the fourth icon and sends it to the second electronic device.

[0036] Understandably, when the screen of the first electronic device is locked, it needs to be unlocked on the first electronic device; only after unlocking can the second electronic device call the handwriting input service to record audio.

[0037] It is understandable that the first electronic device can simply send the fourth icon to the second electronic device, and the second electronic device can add a fourth sub-mark to mark it when it receives the fourth icon.

[0038] In conjunction with the first aspect, in one possible implementation, the multi-screen collaboration interface further includes an exit control, and the method further includes: In the second electronic device, in response to the eleventh operation on the exit control, the multi-screen collaboration interface is closed and switched to the floating icon, which is displayed floatingly on the second interface; The floating icon of the second electronic device may include a second icon and a second sub-icon, or a third icon and a third sub-icon; or a fourth icon and a fourth sub-icon.

[0039] After the second electronic device exits the multi-screen collaboration interface, a second icon and a second badge, a third icon and a third badge, and a fourth icon and a fourth badge can be displayed on the second electronic device to distinguish the device source of the material.

[0040] In conjunction with the first aspect, in one possible implementation, the method further includes: Before the first material is collected, the second electronic device displays a second interface, which includes a floating sidebar and an application icon corresponding to the target application. After the first material is collected, the second electronic device detects the twelfth operation targeting the application icon; In the second electronic device, in response to the twelfth operation, the target application is launched, the sidebar is switched to the floating icon, the floating icon is displayed floatingly on the second interface, and the floating icon includes the first icon and the first badge; When the second electronic device launches the target application for the first time, the floating icon also includes a prompt card, which is used to indicate that the first material comes from an electronic device other than the second electronic device; In the second electronic device, in response to a thirteenth operation on the top bar control included in the floating icon, the floating icon is switched to the hidden icon, and the hidden icon is displayed floatingly on the second interface.

[0041] It is understandable that the target application on the second electronic device may not be launched before the first electronic device collects the first material. In this case, the second electronic device can display a sidebar, which includes an application icon indicating the target application.

[0042] In some embodiments of this application, the process of a first electronic device collecting first materials, a second electronic device launching the target application for the first time, and viewing a first icon from the first electronic device can indicate... Figures 7G-7I The process that is shown.

[0043] Based on this implementation, a prompt card can be used to guide the user on how to synchronize the icon when the target application on the second electronic device is opened for the first time.

[0044] In conjunction with the first aspect, in one possible implementation, the method further includes: The second electronic device displays a third interface, which includes a floating icon, comprising the first icon, the first badge, the second icon, and the second badge. In the second electronic device, in response to the fourteenth operation, after the first icon moves to the position of the second icon or after the second icon moves to the position of the first icon, the first icon and the second icon are switched to the first group of icons; In the first electronic device, the first icon and the second icon are synchronously switched to the first set of icons.

[0045] In some embodiments of this application, the fourteenth operation can be a drag operation, and the process of switching the first icon and the second icon to the first group of icons can be indicated. Figures 8A-8F The process of dragging and grouping as shown.

[0046] Based on this implementation, multiple materials can be dragged and grouped together, and the grouped results can be synchronized to other devices.

[0047] In conjunction with the first aspect, in one possible implementation, the method further includes: The second electronic device displays a fourth interface, which includes a floating icon, comprising the first icon, the first badge, the second icon, and the second badge. In the second electronic device, in response to the fifteenth operation, the first icon or the second icon moves its position within the floating icon; In the first electronic device, the first icon or the second icon moves its position synchronously.

[0048] In some embodiments of this application, the fifteenth operation can be a drag operation, and the movement of the first icon or the second icon can indicate... Figures 9A-9E The indicated movement process.

[0049] Based on this implementation, the position of each icon can be moved, and the moving result can be synchronized to other devices.

[0050] In conjunction with the first aspect, in one possible implementation, the method further includes: The second electronic device displays a full-screen interface corresponding to the target application; the first icon in the full-screen interface is in an icon selected state, and the full-screen interface also includes a rename control; In the second electronic device, in response to a sixteenth operation on the renaming control, a fifth interface is displayed, the fifth interface including an input field; In the second electronic device, in response to an input operation on the input field, the first icon is named the target name; In the second electronic device, after naming, the full-screen interface includes the first icon named the target name; In the first electronic device, the name of the first icon is synchronized with the target name.

[0051] In some embodiments of this application, the sixteenth operation can be a click operation, and the process of renaming the first icon can be instructed. Figures 10A-10H The renaming process is shown.

[0052] Based on this implementation, each icon can be renamed, and the renaming results can be synchronized to other devices.

[0053] In conjunction with the first aspect, in one possible implementation, the method further includes: The second electronic device displays a full-screen interface; the first icon and the second icon in the full-screen interface are selected, and the full-screen interface also includes a delete control; In the second electronic device, in response to the seventeenth operation on the delete control, the first material and the second material are deleted; In the second electronic device, after deletion, the full-screen interface does not include the first icon and the second icon; In the first electronic device, the first material and the second material are deleted simultaneously, and after deletion, the first icon and the second icon are not included.

[0054] In some embodiments of this application, the seventeenth operation can be a click operation, and the process of deleting the first icon and the second icon can be instructed. Figures 11A-11F The deletion process is shown.

[0055] Based on this implementation, multiple icons can be deleted, and the deletion results can be synchronized to other devices.

[0056] This is understandable; when deleting, both the icon and the corresponding material are deleted.

[0057] In conjunction with the first aspect, in one possible implementation, the floating icon includes a first icon indicating the first material and the first badge, and the method further includes: In the second electronic device, in response to an interface switching operation for the second electronic device, the second electronic device displays a sixth interface, and the floating icon is displayed floatingly on the sixth interface; In the second electronic device, in response to the eighteenth operation for the first icon, the second electronic device downloads the first material indicated by the first icon and displays a seventh interface, the seventh interface including the first material, and the floating icon is displayed floating on the seventh interface, the floating icon not including the first icon and the first badge.

[0058] In some embodiments of this application, the eighteenth operation can be a drag-and-drop operation, which can instruct the process of downloading and using the first material. Figures 12A-12F The process that is shown.

[0059] According to this implementation method, by dragging the first icon to an application interface, the first material corresponding to the first icon can be downloaded and used. After use, the second electronic device will not include the first icon and the first badge. This result can be synchronized to other devices.

[0060] In conjunction with the first aspect, in one possible implementation, the method further includes: The second electronic device displays a full-screen interface; the first icon and the fifth icon in the full-screen interface are selected, and the full-screen interface also includes a sharing control; the fifth icon is used to indicate the fifth material collected through the target application in the second electronic device; In the second electronic device, in response to the nineteenth operation of the sharing control, a second card is displayed, the second card including multiple options indicating different formats, different devices, different applications, saving, and printing; In the second electronic device, in response to a twentieth operation on the second card, the first material and the fifth material are shared based on the selected option.

[0061] In some embodiments of this application, the above-described sharing process can instruct Figures 13A-13E The process of sharing materials is shown.

[0062] Based on this implementation, different sharing options can be made based on the options on the second card.

[0063] In conjunction with the first aspect, in one possible implementation, after responding to the nineteenth operation on the sharing control and before displaying the third card, the method further includes: Display a third card, which includes a merge option; In response to the twenty-first operation for the merge option, the first material and the fifth material are merged; The first material and the fifth material are shared based on the selected options, including: The merged first and fifth materials are shared based on the selected option.

[0064] In some embodiments of this application, the above-described sharing process can instruct Figures 13A-13E The process of sharing materials is shown.

[0065] Based on this implementation method, the materials can be merged first and then shared.

[0066] In conjunction with the first aspect, in one possible implementation, the method further includes: In the second electronic device, in response to a twenty-second operation targeting the first icon, the first material is downloaded and displayed.

[0067] In some embodiments of this application, a full-screen preview interface corresponding to the first material can be downloaded and displayed, or the first material can be downloaded and displayed as a floating window. The process of triggering the display of other materials is similar and will not be described in detail here.

[0068] In conjunction with the first aspect, in one possible implementation, in the first electronic device, switching the collected state icon to the hidden state icon includes: The collection status icon is switched to the feedback status icon corresponding to the target application, and the feedback icon is used to indicate that the collection has been successful; The feedback icon is switched to the hidden icon.

[0069] This implementation method allows for real-time feedback of collected data, improving the user experience.

[0070] In conjunction with the first aspect, in one possible implementation, the type of the first material includes at least: text, graphics, images, audio, and tables; the first stage of the first operation is a long press operation, and the second stage of the first operation is a drag or throw operation.

[0071] Based on this implementation method, different types of materials can be collected using the same operating method, reducing the learning difficulty for users.

[0072] In conjunction with the first aspect, in one possible implementation, the hidden state icon is a semi-transparent semi-circle, and the collected state icon is capsule-shaped or window-shaped.

[0073] This implementation method avoids interfering with the user's view and hindering user operation.

[0074] In conjunction with the first aspect, in one possible implementation, the first, second, third, and fourth subscripts are the same.

[0075] This implementation method simplifies the display effect, distinguishing only whether the device originates from the local device.

[0076] In a second aspect, this application provides an electronic device comprising: one or more processors and a memory; the memory being coupled to one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, wherein the one or more processors invoke the computer instructions to cause the electronic device to perform the methods involved in the first electronic device or the second electronic device as described in the first aspect or any implementation thereof.

[0077] Thirdly, this application provides a cross-platform interactive system, which includes a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device perform the methods involved in the first aspect or any implementation thereof.

[0078] Fourthly, this application provides a computer storage medium that stores a computer program, which, when executed by an electronic device, causes the electronic device to perform the methods involved in the first aspect or any implementation thereof.

[0079] Fifthly, embodiments of this application provide a chip system that can be applied to an electronic device. The chip system includes one or more processors that invoke computer instructions to cause the electronic device to perform the method described in the first aspect or any implementation thereof.

[0080] In a sixth aspect, embodiments of this application provide a computer program product containing instructions that, when run on an electronic device, cause the electronic device to perform the method described in the first aspect or any implementation thereof.

[0081] It is understood that the electronic devices in the fourth, fifth and sixth aspects can refer to the electronic devices provided in the second aspect, that is, they can refer to the first electronic device or the second electronic device in the first aspect.

[0082] It is understood that the electronic device provided in the second aspect, the cross-platform interactive system provided in the third aspect, the computer storage medium provided in the fourth aspect, the chip system provided in the fifth aspect, and the computer program product provided in the sixth aspect are all used to execute the method described in the first aspect or any implementation thereof. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects of any possible implementation of the first aspect, which will not be repeated here. Attached Figure Description

[0083] Figure 1 A schematic diagram of multiple devices under the same trust ring; Figures 2A-2I A diagram illustrating the various states of the global collection application; Figures 3A-3H A set of exemplary user interfaces for collecting and viewing text on this device; Figures 3I-3J A set of exemplary user interfaces involved in viewing synchronized text on trusted devices; Figures 4A-4B A set of exemplary user interfaces involved in the entry point for cross-platform invocation of services related to trusted devices; Figures 4C-4F A set of exemplary user interfaces involved in cross-platform invocation of trusted device camera services; Figures 4G-4H A set of exemplary user interfaces for exiting cross-platform calls to trusted device-related services; Figure 4I An illustration of the materials being downloaded and synchronized; Figures 5A-5D A set of exemplary user interfaces involved in cross-platform invocation of trusted device audio services; Figures 5E-5H Another set of exemplary user interfaces involved in cross-platform invocation of trusted device audio services; Figures 6A-6D A set of exemplary user interfaces involved in cross-platform invocation of trusted device handwriting services; Figures 7A-7I A set of exemplary user interfaces involved in the successful collection of cross-platform notifications for the first time; Figures 8A-8F This is a set of exemplary user interfaces involved in dragging groups in a floating state; Figures 9A-9E Another set of exemplary user interfaces involved in dragging and moving in a floating state; Figures 10A-10H Another set of exemplary user interfaces involved in renaming assets in full-screen mode; Figures 11A-11F A set of exemplary user interfaces involved in deleting content in full-screen mode; Figures 12A-12F A set of exemplary user interfaces used in connection with the materials; Figures 13A-13E This refers to a set of exemplary user interfaces involved in sharing materials in full-screen mode. Figure 14 An exemplary flowchart of a cross-platform interaction method provided in an embodiment of this application; Figure 15 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application; Figure 16 This is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0084] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0085] It should be understood that the terms "first," "second," etc., in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0086] In this application, the reference to "embodiment" means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a mutually exclusive, independent, or alternative embodiment. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described in this application can be combined with other embodiments.

[0087] To facilitate understanding, the terms used in the embodiments of this application will be explained first.

[0088] 1. Materials may include various types of information such as text, graphics, images, videos, files, audio, web pages, and tables in this application; among them, images may be static or dynamic images, and files may be in various formats such as PDF, Word, and Excel, and this application does not limit them.

[0089] 2. Annotations (or doodles), in this application, refer to content drawn by a user on a display screen using a pen or fingertip. The annotation content may include information such as the starting position and ending position of the annotation. The starting position refers to the position where the user presses the pen down on the display screen when making the annotation, and the ending position refers to the position where the user lifts the pen after making the annotation on the display screen.

[0090] 3. Trust ring and trusted devices: In this application, a trust ring refers to multiple electronic devices that have passed trusted authentication and are connected to the same local area network or directly (e.g., establishing a Wi-Fi Direct connection or a Bluetooth connection), possessing the ability to communicate with each other. These electronic devices form a trust ring. Electronic devices within this trust ring can be collaboratively managed and share resources. In this application, electronic devices within this trust ring can perform functions such as cross-platform service invocation to collect materials, synchronize materials, organize materials, and synchronize the organized results.

[0091] Electronic devices can establish trust relationships and form trust loops through trusted authentication using any of the following methods: 1) Logging into the same account on two or more electronic devices, with the electronic devices under the same account performing trusted authentication through the account, thus establishing a trust relationship and forming a trust loop. 2) Two or more electronic devices performing trusted authentication through a proprietary protocol, thus establishing a trust relationship and forming a trust loop. 3) Two or more electronic devices performing trusted authentication by logging into the cloud, thus establishing a trust relationship and forming a trust loop. The above methods are merely examples, and this application does not limit the scope of the application.

[0092] It is understood that the electronic device in this application can be a mobile phone, tablet computer, or other electronic device, as well as a desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, cellular phone, personal digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, artificial intelligence (AI) device, wearable device (such as smartwatch, smart bracelet, etc.), in-vehicle device, smart home device (such as smart TV, large screen, etc.) and / or smart city device. The embodiments of this application do not impose any special restrictions on the specific type of electronic device.

[0093] For example, such as Figure 1 As shown, devices such as mobile phones, tablets, desktop computers, laptops, and smart TVs can log in to the same account and connect to the same local area network, forming a trust ring. Within this trust ring, devices that are already working together can continue their current tasks on the mobile phone, such as continuing to watch videos on the smart screen, or easily browse and edit files on the mobile phone on the computer.

[0094] Within a trust ring, a terminal device can be considered a trusted device of other devices. In other words, a terminal device with a trust relationship established through trusted authentication is called a trusted device. For example, a mobile phone and a tablet within the same trust ring can be considered trusted devices of each other; that is, the tablet is a trusted device of the mobile phone, and the mobile phone is also a trusted device of the tablet.

[0095] The above is a brief introduction to the terms used in the embodiments of this application, and will not be repeated below.

[0096] Electronic devices can support the collection of different types of materials in various formats, and can also support the organization and sharing of collected materials. In this way, users can use electronic devices to achieve the goals of collecting, organizing, and sharing materials.

[0097] However, in practice, taking file management apps on a mobile phone as an example, these apps can only collect materials such as pictures, videos, audio, and files. The types of materials are limited, and the collection methods are correspondingly limited as well. Materials in file management apps are usually categorized by name, time, size, or material type. The organization method is relatively traditional and simple, and consequently, it is not very convenient for users to find the specific materials they need. Taking note-taking apps on a mobile phone as an example, in addition to collecting text, pictures, videos, and audio, note-taking apps can also be used to save web pages obtained from news apps and annotations obtained from reading apps. Web pages can be saved to note-taking apps by swiping down with three fingers; annotations can be saved to note-taking apps when the user saves them.

[0098] In the two examples above, although note-taking apps can collect slightly more types of materials compared to file management apps, the process of organizing multiple types of materials into a single note requires users to frequently switch between different apps and use different collection methods to save materials from different apps. This results in a high learning curve and low collection efficiency for users. Materials collected across different electronic devices are also isolated, making transfer cumbersome. This is extremely inconvenient when users need to use different materials across multiple electronic devices.

[0099] In view of this, embodiments of this application provide a cross-platform interaction method. This cross-platform interaction method can be used to enable users to collect materials from different sources, of different types, and multiple times across different platforms, shortening the user's collection path, unifying the collection method, and improving collection efficiency; furthermore, it can also quickly classify collected materials according to the user's personal needs, and perform secondary organization, sharing, multi-platform synchronization, and retrieval.

[0100] Furthermore, the existing technologies provide individual, independent tools that are not closed-loop in terms of application scenarios. In contrast, this application provides a closed-loop tool that connects various scenarios, is easy to operate, has a low learning curve, and can meet individual user needs and habits, thereby improving the user experience.

[0101] It should be understood that the materials involved in this application include, but are not limited to, text, graphics, images, videos, audio, web pages, tables, etc. Material collection in this application may include acquiring materials, processing the acquired materials, and using the processed results as collected content. For example, material collection may include: converting acquired audio materials into text materials, converting acquired text materials into audio materials, editing or marking input text or images, etc. Material organization may include: grouping, moving, renaming, deleting, etc., materials of different types. Material sharing may include: sharing content in different formats, printing, or sharing to third-party applications, etc.

[0102] The following is a combination of... Figures 2A-2I This application introduces the global collection mode and its various forms.

[0103] Global Collection is a management application that allows users to collect, organize, and share materials. Users can use Global Collection to fulfill their needs for collecting, organizing, and sharing materials. Furthermore, Global Collection can be developed into a personal learning or working space. Data retention in Global Collection is permanent.

[0104] The global collection feature can exhibit various states during use to differentiate between different processing stages or stages of an electronic device. For example, the states of a global collection can include a hidden state (also known as a hidden icon), a collected state (also known as a collected icon), a feedback state (also known as a feedback icon), a floating state (also known as a floating icon), and a full-screen state (also known as a full-screen interface); these are merely illustrative names, for example, a hidden state can also be called a minimized state, and a floating state can also be called a distributed state; this application does not impose any limitations. Each state of a global collection can also include one or more styles, and these styles can toggle in response to user triggering. See also... Figure 2A These are examples of global collections in different forms provided in the embodiments of this application.

[0105] The Global Collection app has several modes: a hidden state indicates it's in the foreground or running in the background; a collection state indicates the entry point for collecting materials or that it's in the process of collecting materials; a feedback state provides feedback to the user during material collection, informing them of success or failure; a floating state displays collected materials in a portion of the current screen; and a full-screen state displays collected materials across the entire screen. Essentially, the floating state acts as the Global Collection application's display window, while the full-screen state is the main interface. Both states allow users to organize their materials.

[0106] Optionally, the hidden icon for global favorites can be circular or semi-circular in shape, and can be opaque or semi-transparent. For example, when global favorites are hidden, the hidden icon can be presented as a semi-transparent, semi-circular effect that snaps to the inside edge of the screen, such as... Figure 2A The hidden icon b is shown in the image. When icon b is positioned inside the screen edge, it does not obstruct the user's normal viewing of the displayed content. Furthermore, the semi-transparent state of icon b does not visually attract the user's attention and does not interfere with normal use.

[0107] It should be noted that the position of the inner edge of the screen described in the embodiments of this application can be located on the upper side, lower side, left side or right side of the inner edge, and this application does not limit it in this regard.

[0108] Optionally, the global collection icon can switch styles based on different collection scenarios. For example, when collecting text, images, or other materials, the collection style can be switched to something like... Figure 2A The collection state icon c1 shown; when collecting webpage content, the collection state style can be switched to, as shown below. Figure 2A The collection state icon c2 shown; when collecting video clips, the collection state style can be switched to, as shown below. Figure 2A The collection state icons c31 and c32 are shown below; when collecting global annotations, the collection state style can be switched to the following: Figure 2A The collection state icons c41, c43, and c42 shown are examples. The style of the collection state can be set according to the type of material being collected, and this application does not limit this.

[0109] It should be noted that global collection can switch from hidden to collected state, and vice versa. Different styles can also be toggled between collection states. Optionally, this switching can include animation effects such as scrolling or scaling. For example, ... Figure 2B As shown in the diagram, the hidden state of the global collection can switch from the leftmost graphic to the rightmost collection state with a gradually expanding animation effect; during the expansion, the hidden icon 'b' can first switch to a circle, then expand from a circle into a capsule shape, and gradually reveal all the text. This is only an example, and this application does not limit it.

[0110] Optionally, once materials are collected, the global collection can switch from a collection state to a feedback state. For example... Figure 2A As shown, the feedback state can maintain the same style as the icons c1, c2, c32, c42, c43, etc. in the collection state, and display the text "Successfully collected," providing textual feedback to the user that the current material has been successfully collected. Optionally, the graphic in the feedback state can also be switched to a checkmark, providing animated feedback that the current material has been successfully collected.

[0111] Optionally, the floating state of global favorites can move its position within the display area based on user dragging operations, and can also change its size based on user dragging operations. For example, the floating state of global favorites can specifically include two styles: one is a long strip, such as... Figure 2A The first suspended state e1 is shown in the image; another is card-shaped, such as... Figure 2A The second floating state e2 shown in the diagram; the elongated first floating state e1 and the card-shaped second floating state e2 have different positions and sizes. The first floating state e1 of global collection can be displayed with an effect of being attached to the inner edge of the display screen to avoid interfering with the currently displayed content. The second floating state e2 of global collection can be displayed in the center area of ​​the display screen for easy viewing by the user.

[0112] Optionally, as one possible implementation, in response to a drag operation on the edge of the first floating state e1, the first floating state e1 can switch to the second floating state e2; conversely, in response to a drag operation on the edge of the second floating state e2, the second floating state e2 can also switch to the first floating state e1. As another possible implementation, in response to a two-finger reverse swipe operation on the first floating state e1, the first floating state e1 can switch to the second floating state e2; conversely, in response to a two-finger pinch operation on the second floating state e2, the second floating state e2 can also switch to the first floating state e1. Furthermore, the first floating state e1 can display icons corresponding to one or two columns of materials, with a minimum of displaying icons corresponding to one material. The second floating state e2 can display icons corresponding to two or more columns of materials, but the number of columns and rows is less than in the full-screen state; the specific number can be set as needed, and this application does not impose any limitations on this.

[0113] Optionally, the global favorites floating state may also include a top bar control and / or a bottom bar control. In response to a click on the top bar control, such as... Figure 2C As shown, the first suspended state e1 can be switched to the following state: Figure 2D The example shown is a floating style with a toolbar. This toolbar can include three controls: a zoom-in control, a zoom-out control, and a close control. The zoom-in control triggers a switch from the first floating state (e1) to full-screen mode; the zoom-out control triggers a switch from the first floating state (e1) to a hidden state (b); and the close control triggers an exit from global favorites.

[0114] Optionally, such as Figure 2E and Figure 2F As shown, in response to a swipe operation on the top horizontal bar control of the first floating state e1, the global favorites can switch from the first floating state e1 to the hidden state b. The direction of this swipe operation can be left or right. Figure 2E It only shows swiping to the right.

[0115] Optionally, such as Figure 2G and Figure 2H As shown, in response to a swipe operation on the bottom horizontal bar control of the first floating state e1, the global favorites can switch from the first floating state e1 to the full-screen state f. The direction of this swipe operation can be left or right. Figure 2G It only shows swiping to the right.

[0116] Similarly, the second floating state e2 can also be switched to a floating state style with a toolbar; the second floating state e2 can also include a top horizontal bar control and a bottom horizontal bar control, and the top horizontal bar control and the bottom horizontal bar control of the second floating state e2 can also be swiped to switch to a hidden state or a full-screen state respectively; for a description of the functions of the second floating state e2, please refer to the above description, which will not be repeated here.

[0117] It should also be noted that although the global collection will switch between multiple modes during use, the global collection application in each mode is always on top (or pinned to the top) of the multiple display layers included in the display interface, and is not covered or affected by the content displayed below.

[0118] Combining the aforementioned global collection and its various forms during use, the cross-platform interaction method provided in this application can be implemented. Based on multiple electronic devices in the same trust ring, one or more of the following three processing stages (collection, organization, and sharing) can be performed, and are not limited to the following processes and their order.

[0119] The following explanation uses the first device as an example. The first device can be any electronic device in the same trust ring.

[0120] It is understandable that the materials include various types. The various types of materials mentioned here can include fragmented materials such as text, graphics, images, tables, annotations, etc., as well as non-fragmented materials such as web pages, videos, and documents. Graphics can indicate a partial image captured using the lasso tool, etc.

[0121] The first processing stage involves collecting and synchronizing materials.

[0122] Function 1. The first device can support the collection of materials through global collection on the local device.

[0123] Function 2. The first device can also support the cross-platform synchronization of the corresponding icon and device source information of the collected materials to the global collection of trusted devices for display and use after the materials are successfully collected locally. There can be one or more trusted devices.

[0124] Optionally, a badge can be displayed in any corner of the cross-device synchronized media icon. This badge indicates that the media was collected from other devices synchronized through the trust ring, rather than being collected on the local device. It can be understood that, based on the same trust ring, if any device in the ring successfully collects media, all other devices in the ring can synchronize the icon corresponding to that media.

[0125] Here, the badge can be set to any one of the top left, bottom left, top right, or bottom right corners of the cross-platform synchronized material icon; this application does not impose any restrictions on this.

[0126] For example, the badge may include a device icon indicating the device's origin. For instance, consider a mobile phone... Figure 2H As shown, for the icons of the materials included in the full-screen mode, the badge displayed in the upper right corner can include a tablet icon 21, used to indicate that the device source of the material is a tablet; this badge can also include a desktop computer icon 22, used to indicate that the device source of the material is a tablet, and so on. Additionally, the third icon is a group icon, including two materials. Therefore, this group icon can include two badges, each indicating the device source of the two materials respectively.

[0127] For example, the badge may also include a trust ring icon, which indicates that the content was synced across platforms via a trust ring. For instance, as... Figure 2I As shown, the top right corner of the cross-device synchronized media icons all include a trust ring icon 23; and / or, the device source can also be displayed in text below the name of each media icon. Additionally, as... Figure 2I As shown, for group icons of materials that include cross-device synchronization, a badge including a trust ring icon can be displayed in the upper right corner, but the device origin can be hidden below the name. Of course, this is just an example, and it can be displayed in other forms, which this application does not limit.

[0128] For example, taking the inclusion of a device icon in the badge of cross-platform synchronized content icons as an example, after a mobile phone successfully collects text content, the corresponding content icon can be synchronized to the global collection on the tablet for display. Users can see the content icon corresponding to the text by viewing the global collection application on the tablet; moreover, the upper right corner of the icon can also display a badge including the mobile phone icon to indicate that the content is synchronized to the mobile phone.

[0129] Function 3. The first device can support cross-platform invocation of relevant services of trusted devices and collect materials through trusted devices. There can be one or more trusted devices.

[0130] Function 4. After a trusted device collects materials, it can also synchronize the corresponding icons and device source information of the materials to the global collections of the first device and other trusted devices for display.

[0131] For example, the first device can launch the camera application of the second device in response to a user's operation on the photo or video recording option in the first device's global collection (the photo and video recording options can also be combined into a single shooting option), invoke the camera service, and then use the second device's camera to take a photo or record a video, generating image or video footage and collecting it in the second device's global collection application. It is understood that the generated image or video is also simultaneously saved in the second device's gallery application.

[0132] For example, the first device can launch the recording application on the second device in response to a user's action on the recording option in the first device's global favorites, invoke the audio service, and then use the second device's audio service to record audio, generate an audio file, and collect it in the second device's global favorites application. It is understood that the generated audio file is also simultaneously stored in the second device's recording application.

[0133] For example, the first device can also support launching the second device's note-taking application in response to a user's action on the handwriting option in the first device's global favorites. This involves calling the handwriting service within the note-taking application, enabling handwriting input via the second device's handwriting service, generating a note file, and adding it to the second device's global favorites application. Understandably, the generated note file is also simultaneously saved within the note-taking application.

[0134] In the three examples above, after the second device successfully collects the materials, the icons and device source information (in this case, from the second device) corresponding to the generated images, videos, audio, and notes can be synchronized to the global collection of the first device for display. Furthermore, when the same trust ring also includes a third device, the material icons and device source information collected by the first device through cross-device calls to the second device's service can also be synchronized to the global collection of the third device for display.

[0135] Function 5. After the first device successfully collects materials for the first time, a notification will pop up on the trusted device to remind the user on the trusted device that the first device has collected new materials through global collection.

[0136] The second processing stage involves organizing the materials and simultaneously compiling the results.

[0137] Function 1. When organizing materials, the first device can support multiple materials grouped together.

[0138] This application supports grouping multiple materials of the same type, as well as grouping multiple materials of different types. It also supports grouping multiple individual materials, grouping one or more individual materials with one or more groups of materials, and grouping multiple groups of materials into new groups. It should be noted that grouping materials can be understood as placing multiple materials in a folder; when organizing already grouped materials into new groups, the new group will include the individual materials from the original group.

[0139] Function 2. When organizing materials, the first device can support moving one or more materials at a time.

[0140] Understandably, this movement can indicate movement within a plane or movement along a display path. For example, it can indicate the translation of a single element's position within the display interface, from top to bottom, from left to right, etc.; alternatively, it can indicate the movement of one or more elements into a group of elements, or vice versa. Both methods involve moving from a primary interface to a secondary interface. The primary interface can indicate the full-screen or floating state of globally favorited items, while the secondary interface can indicate the interface corresponding to a specific group of elements, or, in other words, the interface corresponding to opening a folder.

[0141] Function 3. When organizing materials, the first device can rename a single material or a group of materials at a time.

[0142] Function 4. When organizing materials, the first device can support deleting one or a group of materials.

[0143] It should be noted that for functions 1-4 above, the first device, in response to user operations, will synchronize the sorting actions (grouping, moving, renaming, and deleting) performed on the collected materials to the trusted devices after sorting. For example, if materials are grouped on the first device, all trusted devices based on the same trust ring will synchronize the grouping results; if materials are deleted on the first device, all trusted devices based on the same trust ring will synchronize the deletion of the materials.

[0144] For functions 1-4 mentioned above, the materials on the first device may include materials collected by the first device itself and / or materials synchronized to trusted devices.

[0145] The above only illustratively illustrates four functions for organizing materials. Other functions, such as material filtering, may also be included. This application does not limit the functions of the organization stage. The organization method provided in this application, by combining with a global collection application, can quickly classify and reorganize collected materials, making the display of collected materials meet the user's personal needs and improving the user experience.

[0146] It should be noted that since the Global Collection can display some or all of the collected materials when it is in floating or full-screen mode, organizing the collected materials mainly involves the floating and full-screen modes of the Global Collection application.

[0147] The third processing stage involves sharing the materials.

[0148] Optionally, the sharing mentioned here may include material transfer or cross-application use of materials, as well as material sharing, etc.

[0149] When using content, the first device can respond to the user's drag operation, dragging content from the global collection to a specific application. Then, in response to the release operation, the content is imported into the application on the first device. Content can include local content or content synchronized across different devices.

[0150] If the synchronized material has already been downloaded to the first device, it can be directly imported into the application on the first device; if the synchronized material has not yet been downloaded, it can be downloaded first during the import process into the application on the first device, and then imported.

[0151] It is understandable that the sharing functions mentioned above are implemented on each device; based on devices within the same trust ring, new materials included in the global collection have been automatically synchronized, so there is no need to manually share across devices.

[0152] It should be noted that, in addition to the first to third processing stages, electronic devices can also perform other processing. Based on the first to third processing stages, electronic devices can more conveniently collect, organize, and share materials. For details regarding the scenarios of collecting, organizing, and sharing materials, please refer to the descriptions below; they will not be elaborated upon here.

[0153] The first processing stage (collecting materials) will be described in detail below.

[0154] I. The first device collects local and synchronous materials (such as...) Figures 3A-3J (As shown) Taking a news application as an example, the first device can detect user actions on the news application. In response to these actions, the first device can launch the news application and display its main interface (the default interface displayed upon launch). The main interface of the news application can include thumbnails of multiple news messages. These thumbnails can be used to trigger the first device to display the specific content of the news message. The first device can detect user actions on any thumbnail, and in response to these actions, the first device displays the display interface of the news message corresponding to that thumbnail.

[0155] Optionally, the first device can detect user actions on a section of text displayed on the screen. In response to the user actions, a portion of the text can be selected. Then, the first device can detect user actions on the selected portion of the text. In response to the user actions, the first device can enter a global favorites mode.

[0156] Optionally, the background color of the text can be different when some text is selected or not selected, to distinguish them. For example, the background color can be white when some text is not selected, and gray when it is selected.

[0157] It is understood that the user operations mentioned in the embodiments of this application may include, but are not limited to, touch (e.g., click, long press, etc.), voice control, gestures, etc., and this application does not limit them.

[0158] Taking a mobile phone as the first device as an example, see Figure 3A The display interface 301 shown is a webpage containing a news article from a news application. The mobile phone can detect a selection operation on a section of text in the display interface 301 (such as a long press followed by a left or right swipe). In response to this selection operation, a portion of the text can be selected. For ease of description, this application can denote the selected portion of the text as text a1 (e.g., ...). Figure 3A Text with a gray background.

[0159] The phone can detect a long press on the text 'a1', and in response to this long press, the phone can display something like this: Figure 3B The display interface 302 is shown. Compared with the display interface 301, the display interface 302 displays a hidden icon b for global favorites on the right side of the interface; this icon b is used to indicate to the user that the phone has entered global favorites mode when triggered by a long press operation on the text a1, and the text a1 that is in the text selection state can be collected by the global favorites application.

[0160] Optionally, when the phone detects a long press operation on a portion of the text that is selected, a moving icon a2 (e.g., ...) can also be displayed on the screen. Figures 3B to 3D (as shown by the arrow); the moving icon a2 is used to prompt the user that, in a plane parallel to the display interface, the selected text can be moved in any direction in response to the user's drag operation.

[0161] See Figure 3CAs shown in the display interface 303, the mobile phone can detect a drag operation on text a1. In response to this drag operation, the selected text a1 can be split into two texts (for ease of description, they can be called foreground text and background text). The foreground text is the same as the original selected text a1, or the font is relatively smaller, or the font is relatively smaller while adding a border, background color, etc.; the background text is the same as the original text a1, or the background text can be switched to gray font. In addition, the foreground text can move in the display interface 303 with the user's drag operation, while the background text does not move with the user's drag operation.

[0162] At the same time, such as Figure 3C As shown, in response to the drag operation, the global collection application is invoked in the foreground, and the hidden icon b of the global collection will gradually extend from the right side of the display interface to the left side, switching to the collection icon c of the global collection.

[0163] See Figure 3D As shown in the display interface 304, the mobile phone can also detect user operations on the foreground text corresponding to text a1. In response to the user operation, the foreground text can move to the position of the collection status icon c of the global collection and then disappear.

[0164] Optionally, the user operations mentioned in this embodiment may include, but are not limited to, dragging, throwing, etc., and this application does not limit them. The dragging direction and the throwing direction are both towards the location of the globally collected icon c on the display interface. In addition, the position where the drag stops overlaps with the position of the globally collected icon c. If there is no overlap, its content may not be collected into the globally collected application.

[0165] Optionally, in response to user actions, as the foreground text moves to the location of the global collection icon c, a feedback badge can be displayed in the upper right corner of the foreground text, since the text belongs to a type of material that can be collected in the global collection. For example, as... Figure 3D As shown, a circle containing a "+" can be displayed in the upper right corner of the foreground text to indicate to the user that the foreground text is allowed to be added to the global favorites application. Understandably, if it cannot be added, another feedback icon can be displayed in the upper right corner; for example, a circle containing a "\" can be displayed in the upper right corner of the foreground text to indicate to the user that it is not allowed to be added to the global favorites application.

[0166] Optionally, in response to user actions, the size of the foreground text can decrease as it moves to the location of the global favorites collection icon c, creating a gradually disappearing visual effect. Correspondingly, the global favorites collection icon c can dynamically zoom in and out during this process, and the interaction between the two creates the visual effect of the collection icon c absorbing the foreground text.

[0167] Alternatively, as one possible implementation, combining Figure 3D The display interface shown is 304 and Figure 3F As shown in the display interface 306, after the phone collects text a1 into the global favorites application, the collection ends, the background text switches to black font, and the global favorites collection state icon c can switch to the hidden state icon b; as another possible implementation method, combined with Figure 3D The displayed interface 304 is shown. Figure 3E The display interface 305 shown is Figure 3F As shown in display interface 306, after the phone collects text a1 into the global favorites application, the collection process ends, the background text switches to black font, and the global favorites collection state icon c can first switch to the feedback state icon d, and then switch from the feedback state icon d to the hidden state icon b. The feedback state icon d can maintain the same basic form as the collection state icon c, and the text on the icon can display "Collection successful" and a checkmark to inform the user that text a1 has been collected into the global favorites.

[0168] Optionally, after a successful collection, the global collection application can continue to be displayed on the screen in a hidden state to indicate to the user that the global collection application is still running in the background and that the user can collect any material to the global collection at any time.

[0169] As is understandable, the above is an example of using a mobile phone as the primary device to initiate global collection for local text gathering.

[0170] Once the collection is successful, the global collection application will be displayed on the screen in a hidden state, such as... Figure 3G As shown in display interface 306, the phone can detect user actions on the hidden icons; in response to this user action, the global favorites application can switch from a hidden state to a floating state for display, such as... Figure 3H The display interface 307 shown can include icons 3071 corresponding to newly collected materials in the above example, such as "Text 01", in the global collection floating state. Here, since the material collection is performed on the mobile phone on the local device, there is no badge indicating the device source in the upper right corner of icon 3071.

[0171] Building upon the example above, the first device can support the synchronization of the corresponding icon of the collected materials to the global collection of trusted devices for display across different devices after successful local material collection. There can be one or more trusted devices. It is understood that when there are multiple trusted devices based on the same trust ring, the materials can be synchronized to the global collections of multiple devices for display.

[0172] For example, after a mobile phone collects the material "text01" on its own device into its global collection, it can send the corresponding icon and device source information of the material to other devices in the same ring, such as a tablet, based on the same trust ring. After receiving the data, the tablet can synchronously display the corresponding icon and device source (in the form of a badge) of the new material in the tablet's global collection.

[0173] For tablets that are trusted devices, the following can be displayed: Figure 3I The display interface 308 shown below; when the tablet detects a user action targeting the globally hidden favorites displayed on the desktop, it can display as follows: Figure 3J The display interface 309 shown includes a floating icon 3091 for newly synchronized material, which indicates the text "01" collected from the mobile device. Unlike icon 3071, icon 3091 also displays a badge in its upper right corner indicating that it originated from the mobile device. Icons synchronized from other trusted devices are identical to icon 3091 and will not be described further.

[0174] As can be understood, the above is an example of a first device collecting materials on its own end and synchronizing the icons of successfully collected materials to the global collection of trusted devices.

[0175] It should be noted that when using a tablet, laptop, or similar device as the primary device, the process of initiating global collection to gather text locally, and the process of viewing the collected text, are similar to those described above. For details, please refer to the above guidelines. Figures 3A-3H The details of its introduction will not be repeated here.

[0176] For example, such as Figure 3J The floating icon 3092 in the display interface 309 shown is used to indicate the materials collected by the tablet; therefore, it has no badge when displayed on the tablet. However, when synchronized to the mobile phone, which is a trusted device of the tablet, as shown... Figure 3H The display interface 307 shown will display the same icon in a floating state, with a badge indicating that it originated from the tablet device superimposed on the icon, such as... Figure 3H The icon shown is 3072.

[0177] Understandable, combined Figure 3HAs shown by icon 3071, a subsequent click operation on icon 3071 can be detected by a first device (such as a mobile phone). In response to this click operation, the first device can display the text material indicated by icon 3071. Optionally, as one implementation, in response to the click operation on icon 3071, the first device can display a full-screen preview interface corresponding to the text material; or, as another implementation, the first device can also display the text material as a floating window. Thus, users can view the text materials collected in the global favorites application by clicking icon 3071. Here, the floating window is at the top.

[0178] Similarly, combining Figure 3J As shown by icon 3091, the tablet computer can subsequently detect clicks on icon 3091. In response to this click, the tablet computer can download and display the text material indicated by icon 3091. Optionally, as one implementation, in response to a click on icon 3091, the tablet computer can display a full-screen preview of the text material; or, as another implementation, the tablet computer can display the text material as a floating window. Thus, by clicking icon 3091, the user can download and view text materials collected from the first device and added to the global collection application.

[0179] It should be noted that the above refers to displaying the relevant introduction of the material collected in the global collection in response to the trigger on the icon, either in a full-screen preview interface or a floating window. Of course, it can also be displayed in other ways. For example, when the first device (such as a foldable phone) is in a multi-screen display state, in response to the trigger on the icon, the floating icon can continue to be displayed on one screen of the multi-screen display, while the text material can be displayed in full screen on another screen.

[0180] Understandably, the full-screen preview interface or floating window also includes a back control. When the first device or trusted device detects a click operation on the back control, it can close the full-screen preview interface or floating window and then return to the display interface when the trigger icon was displayed.

[0181] II. The first device calls a trusted device to collect materials across platforms (such as...) Figures 4A-4I As shown, as Figures 5A-5H As shown and as Figures 6A-6D (As shown) 1. Trigger entry point on the first device.

[0182] Taking a desktop computer as the first device as an example, see Figure 4A and Figure 4B As shown, the first device runs the global favorites application, and the global favorites can be displayed in a floating state on the display interface 401, such as... Figure 2A The suspended state e1 is shown.

[0183] Optionally, such as Figure 4A As shown, the upper right corner of the global favorites floating state can include three dots to indicate the "More" control. The first device can detect user interaction with the "More" control, which then enables more functions. In response to this user interaction, such as... Figure 4B The display interface 402 shown allows the first device to display a card 4021 below the "More" control; the card 4021 includes, but is not limited to, "Create Desktop Shortcut", "Clipboard" and "Settings" options.

[0184] Optionally, such as Figure 4B As shown, when the first device forms a trust ring with the second device (such as a mobile phone) and the third device (such as a tablet), the card 4021 may also include multiple callable service options related to the second device, such as "taking a photo," "recording a video," "recording audio," and "handwriting." Similarly, the card 4021 may also include multiple callable service options related to the third device, and the service options callable by the third device are the same as those of the second device. It is understood that when the first device forms a trust ring with multiple devices, the card 4021 can display the service options related to each of the multiple devices, and the service options corresponding to different devices may be the same or different; this application does not limit this.

[0185] Optionally, the first device may also display a full-screen view of global favorites. The upper right corner of the full-screen view of global favorites may include three dots to indicate a "more" control, which can enable more functions. The first device may detect user operations on the "more" control. In response to the user operation, the first device may also display the aforementioned card 4021. For details, please refer to the above description, which will not be repeated here.

[0186] 2. Cross-device calls to services of the second device and service exit from the first device.

[0187] Based on the aforementioned card 4021, the first device can detect user operations on a specific option related to the second or third device on the card 4021. In response to this user operation, the first device can launch an application on the second or third device across devices. Simultaneously, a multi-screen collaboration interface can be displayed on the first device, including the display interface related to the application. In response to user operations on the display interface related to the application, the first device controls the second or third device to collect materials. Furthermore, the multi-screen collaboration interface includes an exit control; in response to user operations on the exit control, the first device can exit control of the second or third device.

[0188] The following three examples illustrate how a first device can cross-device call the photo, audio, and handwriting services of a second device.

[0189] Example 1 - Cross-device photo or video recording like Figure 4C As shown, taking a mobile phone as the second device as an example, the first device can detect user operations on the camera option corresponding to the mobile phone in card 4021; in response to the user operation, the first device can send a command to launch the camera application on the mobile phone, instructing to call the camera service on the mobile phone to take a picture. At the same time, in response to the user operation, the first device can activate the smart interconnection function of the trust ring, switching from card 4021 to a multi-screen collaborative interface for display.

[0190] like Figure 4D As shown, when the mobile phone receives a command from the first device to launch the camera application to take a picture, it can launch the camera application and switch from the desktop or other display interface to the photo-taking interface within the camera application, such as... Figure 4E As shown, the camera interface may include a preview display area, a camera control, a thumbnail control, a lens flip control, and multiple shooting mode options. The preview display area is used to display the real-time shooting scene captured by the phone's camera; the camera control is used to trigger taking a picture; the thumbnail control is used to trigger displaying the image generated by the last photo; the lens flip control is used to trigger switching between the front and rear cameras; and the multiple shooting modes are used to trigger the generation of images or videos using different algorithms.

[0191] like Figure 4F As shown, for the first device, in response to a user operation on the camera option corresponding to the mobile phone in card 4021, the first device can switch from card 4021 to a multi-screen collaboration interface 4022 for display. This multi-screen collaboration interface 4022 may include the camera interface of the mobile phone's camera application. Based on this multi-screen collaboration interface 4022, the user can perform operations on the first device (such as clicking the camera control) to control the mobile phone to take a picture across devices. The image generated by this photo will be automatically collected into the phone's global favorites application after the image is taken. It is understood that the image generated by the photo will also be saved to the phone's gallery at the same time.

[0192] Optionally, when the mobile phone receives a command from the first device to launch the camera application to take a picture, it can launch the camera application and switch from the lock screen to the photo-taking interface in the camera application, even if the mobile phone is in a locked screen state.

[0193] Optionally, the first device can continue to detect user operations on the camera controls in the camera interface included in the multi-screen collaboration interface 4022. In response to the user operation, the first device can control the phone to take multiple photos. Each photo will automatically collect the generated image into the phone's global collection application after the image is generated, and will also be saved to the phone's gallery.

[0194] Optionally, when switching from card 4021 to multi-screen collaboration interface 4022 on the first device, the global collection floating state on the first device can be collapsed and hidden; or, it can continue to be displayed.

[0195] Optionally, such as Figure 4G As shown, the multi-screen collaboration interface displayed on the first device also includes an exit control in the upper right corner. The first device can detect user operations on the exit control; in response to this user operation, the first device exits control of the phone, and the multi-screen collaboration interface 4022 closes. Accordingly, after the phone is released from control, it can continue to display the interface it was in before being controlled.

[0196] Optionally, such as Figure 4H As shown, in response to a user action on the exit control, the first device can also display a prompt card 4023, which can display the text "The camera function has been exited from [phone name]", to inform the user that the first device has exited control of the phone.

[0197] Optionally, after taking a photo, in response to a user action on the exit control, while the multi-screen collaboration interface closes, the first device can display the global favorites in a hidden or floating state. In response to an action on the hidden state, when switching from the hidden state to the floating state, or when the first device displays the global favorites in a floating state, such as... Figure 4H As shown, the floating state may include image icons collected from the mobile device during synchronization, such as icon 4024. Since this material originates from the mobile device, when displayed on the first device, the upper right corner of the icon may include a badge indicating that the device source is a mobile phone. It is understood that the global favorites on the mobile phone also include this image icon but not the upper right badge.

[0198] Optionally, to indicate that the materials collected by the cross-device mobile phone have been synchronized to the first device, the first device can also display a card next to the synchronized material icon to indicate the location of the new material or the entry point for viewing it. For example... Figure 4H As shown, the first device can display a card 4025 next to the synchronized image icon 4024, including the text "Cross-device photo capture successful, click here to view new material". Subsequently, in response to a click on icon 4024, the first device can display a full-screen preview interface corresponding to the image in its global collection; or, it can display the image as a floating window, which is not limited in this application.

[0199] As you can understand, the above is an example of a first device calling the camera service on a mobile phone to take a picture, realizing image collection, exiting the cross-platform call, and displaying the synchronized icon on the first device. The process of the first device controlling other trusted devices to take pictures can be referred to the above description, and will not be repeated here.

[0200] In addition, the process of the first device calling the camera service on the mobile phone to record video is similar to that described above. Please refer to the above description for details, which will not be repeated here.

[0201] Example 2 - Cross-end recording like Figure 5A As shown, taking a mobile phone as the second device as an example, the first device can detect user operations on the recording option corresponding to the mobile phone in card 4021; in response to the user operation, the first device can send a command to start the recording application on the mobile phone, instructing to call the audio service on the mobile phone to record. At the same time, in response to the user operation, the first device can activate the smart interconnection function of the trust ring, switching from card 4021 to the multi-screen collaboration interface for display.

[0202] like Figure 5B As shown, when the mobile phone receives a command from the first device to start a recording application, it can launch the recording application and switch from the desktop or other display interface to the recording interface within the recording application, such as... Figure 5C As shown, the recording interface may include a recording area, recording controls, marking controls, pause controls, etc. The recording area is used to display the waveform and timeline of the phone's recording application recording sound in real time; the recording controls are used to trigger recording; the marking controls are used to trigger marking of audio information at a certain moment; the pause controls are used to trigger pausing recording, and after pausing, the pause controls can be switched to the continue controls, which are used to trigger resuming recording.

[0203] like Figure 5D As shown, in response to a user operation on the recording option corresponding to the mobile phone in card 4021, the displayed content on the first device can switch from card 4021 to a multi-screen collaboration interface 4024. This multi-screen collaboration interface 4024 may include the recording interface involved in the recording application on the mobile phone. Based on this multi-screen collaboration interface 4024, the user can perform operations on the first device (such as clicking on the recording control), thereby controlling the mobile phone to record across devices. The audio file generated by this recording will be automatically collected into the mobile phone's global favorites application after recording is completed. It can be understood that the audio file generated by the recording will also be saved to the recording application at the same time.

[0204] Optionally, when the mobile phone receives the instruction from the first device to start the recording application for recording, if the mobile phone is in a locked screen state, when the display content on the first device switches from card 4021 to the multi-screen collaboration interface, the multi-screen collaboration interface can first display a lock screen prompt interface including a prompt message, reminding the user that the mobile phone is in a locked screen state and needs to be unlocked on the mobile phone; after the mobile phone is unlocked, the display content on the first device then switches from the lock screen prompt interface to the recording interface.

[0205] For example, such as Figure 5E As shown, if the phone is locked, the multi-screen collaboration interface displayed on the first device can show a lock screen prompt interface 4025 including the message "Locked, unlocking requires the phone," to prompt the user to unlock the phone. Meanwhile, as... Figure 5F As shown, even when a mobile phone is locked, a prompt message can be displayed, such as "This computer is using the recording function. Please unlock if you agree," to prompt the user to unlock. Combined with... Figure 5G and Figure 5H As shown, when the phone successfully unlocks in response to the user's unlocking operation, the recording application can be launched and the recording interface can be displayed. The first device will also respond to the unlocking operation by switching from the lock screen prompt interface 4025 to the interface shown below. Figure 5D The image shows a multi-screen collaborative interface, including a recording interface.

[0206] Optionally, the first device can continue to detect user operations on the recording controls in the recording interface included in the multi-screen collaboration interface 4024. In response to the user operation, the first device can control the mobile phone to record multiple times. The audio files generated by each recording will be automatically collected into the mobile phone's global favorites application after the recording is completed, and will also be saved to the mobile phone's recording application.

[0207] Optionally, when switching from card 4021 to multi-screen collaboration interface 4024 on the first device, the global collection floating state on the first device can be collapsed and hidden; or, it can continue to be displayed.

[0208] Optionally, such as Figure 5D As shown, the multi-screen collaboration interface 4024 displayed on the first device also includes an exit control in the upper right corner. The first device can detect user operations on the exit control; in response to the user operation, the first device exits control of the mobile phone, and the multi-screen collaboration interface 4024 closes. Accordingly, after the mobile phone is released from control, it can continue to display the display interface before it was controlled.

[0209] Optionally, in response to a user action on the exit control, the first device may also display a prompt card that displays the text "Recording function has been exited from [phone name]" to inform the user that the first device has exited control of the phone.

[0210] Optionally, after recording, in response to a user action on the exit control, while the multi-screen collaboration interface closes, the first device can display either a hidden or floating state of the global favorites. In response to an action on the hidden state, when switching from the hidden state to the floating state, or when the first device displays the floating state of the global favorites, the floating state may include the audio icon collected from the synchronized mobile device. Since the material originates from the mobile device, when displayed on the first device, the upper right corner of the icon may include a badge indicating that the device source information is a mobile phone. It is understood that the global favorites on the mobile phone also include the audio icon but not the badge in the upper right corner.

[0211] Optionally, to indicate that the materials collected by the cross-platform accessing mobile phone have been synchronized to the first device, the first device can also display a card next to the synchronized material icon to indicate the location or viewing entry of the new material. For example, the first device can display a card next to the synchronized audio icon with the text "Cross-platform recording successful, click here to view the new material". Subsequently, in response to a click on the icon, the first device can display the full-screen playback interface corresponding to that audio in its global collection.

[0212] As you can understand, the above is an example of a first device calling the audio service on a mobile phone to record audio, achieving audio collection, exiting the cross-device call, and displaying the synchronized icon on the first device. The process of the first device controlling other trusted devices to record audio can be referred to the above description and will not be repeated here.

[0213] Example 3 - Cross-platform handwriting like Figure 6A As shown, taking a mobile phone as the second device as an example, the first device can detect user operations on the handwriting option corresponding to the mobile phone in card 4021. In response to the user operation, the first device can send a command to launch the note-taking application on the mobile phone, instructing it to call the handwriting service on the mobile phone for handwriting input. At the same time, in response to the user operation, the first device can activate the smart interconnection function of the trust ring, switching from card 4021 to a multi-screen collaborative interface for display.

[0214] like Figure 6B As shown, when the mobile phone receives a command from the first device to launch the note-taking application for handwriting input, it can launch the note-taking application and switch from the desktop or other display interface to the handwriting input interface within the note-taking application, such as... Figure 6C As shown, the handwriting input interface may include a title, current time, handwriting input area, handwriting toolbar, etc. The handwriting input area is used to display the handwriting traces collected by the mobile phone in real time, and the handwriting toolbar is used to trigger the selection of handwriting tools, colors, etc.

[0215] like Figure 6DAs shown, in response to a user operation on the handwriting option corresponding to the mobile phone in card 4021, the displayed content on the first device can switch from card 4021 to a multi-screen collaboration interface 4026. This multi-screen collaboration interface 4026 can include the handwriting input interface of the note-taking application on the mobile phone. Based on this multi-screen collaboration interface 4026, the user can perform input operations on the first device (such as writing in the handwriting input area), thus enabling cross-device control of the mobile phone for handwriting input. After completing handwriting input on the first device, the user can click the completion control in the upper right corner of the handwriting input interface; in response to this click, the handwriting input is completed. The notes generated from this handwriting input will be automatically collected in the mobile phone's global favorites application after input. It can be understood that the notes generated from handwriting input will also be saved to the note-taking application simultaneously.

[0216] Optionally, when the mobile phone receives the instruction from the first device to launch the note-taking application for handwriting input, if the mobile phone is in a locked screen state, when the display content of the first device switches from card 4021 to the multi-screen collaboration interface, the multi-screen collaboration interface can first display a lock screen prompt interface including a prompt message, reminding the user that the mobile phone is in a locked screen state and needs to be unlocked on the mobile phone; after the mobile phone is unlocked, the display content on the first device then switches from the lock screen prompt interface to the handwriting input interface.

[0217] This section provides an introduction to the lock screen notification interface and the unlocking process. Figures 5E to 5H The introduction is similar, and you can refer to the above content for details, so I will not repeat it here.

[0218] Optionally, the first device can control the phone to perform multiple handwriting inputs; each time the handwriting input is completed, the generated notes will be automatically collected into the phone's global collection application after the input is completed, and will also be saved to the phone's note application.

[0219] Optionally, when switching from card 4021 to multi-screen collaboration interface 4026 on the first device, the global collection floating state on the first device can be collapsed and hidden; or, it can continue to be displayed.

[0220] Optionally, such as Figure 6D As shown, the multi-screen collaboration interface 4026 displayed on the first device also includes an exit control in the upper right corner. The first device can detect user operations on the exit control; in response to the user operation, the first device exits control of the mobile phone, and the multi-screen collaboration interface 4026 closes. Accordingly, after the mobile phone is released from control, it can continue to display the display interface before it was controlled.

[0221] Optionally, in response to a user action on the exit control, the first device may also display a prompt card that displays the text "Handwriting function has been exited from [phone name]" to inform the user that the first device has exited control of the phone.

[0222] Optionally, after handwriting input is completed, in response to a user action on the exit control, while the multi-screen collaboration interface closes, the first device can display the global favorites in either a hidden or floating state. In response to an action on the hidden state, when switching from the hidden state to the floating state, or when the first device displays the global favorites in a floating state, the floating state may include the icon of the notes collected from the synchronized mobile device. Since this material originates from the mobile device, when displayed on the first device, the upper right corner of the icon may include a badge indicating that the device source information is a mobile phone. It is understood that the global favorites on the mobile phone also include this note icon but not the badge in the upper right corner.

[0223] Optionally, to indicate that materials collected from the cross-platform mobile phone have been synced to the first device, the first device can also display a card next to the synced material icon to indicate the location or viewing entry point of the new material. For example, the first device can display a card next to the synced note icon with the text "Cross-platform handwriting successful, click here to view new material". Subsequently, in response to a click on the icon, the first device can display the full-screen interface corresponding to that note in its global collection.

[0224] As you can understand, the above is an example of a first device calling the handwriting service on a mobile phone to perform handwriting input, thereby enabling note collection, exiting the cross-device call, and displaying synced icons on the first device. The process of the first device controlling other trusted devices to perform handwriting can be referred to the above description and will not be repeated here.

[0225] Understandable, for Figure 3J Icon 3091 is shown. Figure 4H The icon 4024 shown is a resource icon synchronized in this application. Therefore, when a user needs to view or use it on the current device, this icon will respond to the user's operation by first downloading the resource to the current device before displaying it. Optionally, during the download process, if the resource data is small, there will be no feedback, and the user will not notice it; if the resource data is large, the download progress can be displayed, indicating the download start time and download completion time to the user.

[0226] For example, targeting Figure 4H The icon 4024 shown is as follows: Figure 4IAs shown, if the image data is large, after detecting a click on icon 4024, the first device can trigger the download of the image data to the first device first, and then display the full-screen preview interface corresponding to that image in the global collection. Here, an overlay can be added to icon 4024 when the download begins, and the overlay can be removed to restore the original display state after the download is completed. Thus, this feedback can indicate to the user the download start time and download completion time. It is understood that feedback during the download process can also be provided in other ways, such as including a download progress bar, etc., and this application does not limit this.

[0227] It should be noted that the method provided in this application can combine the global collection function with the trust ring. Based on the same trust ring, two devices can realize cross-terminal service calls, thereby realizing cross-terminal collection of materials and material synchronization, expanding the scenarios for material collection, facilitating cross-terminal operation when users cannot directly operate a certain device, and improving the user experience.

[0228] In this embodiment, whether the first device collects materials locally and synchronizes the icons of the successfully collected materials to the global collection of the trusted device, or calls services on the trusted device across devices to collect and synchronize materials across devices, for the successfully collected materials, in addition to saving them on the source device, the icons are synchronized first when synchronizing on other devices, and the amount of data transmitted is small, which can improve the efficiency of synchronization and thus improve the user experience.

[0229] 3. Send cross-platform notifications after the initial collection of materials.

[0230] Optionally, the first device can support a notification popping up on a trusted device across different devices after the first device successfully collects materials locally, to remind the user that new materials have been collected in the global collection on the first device.

[0231] For example, combined Figures 3A-3H As shown, when a mobile phone is used as the primary device, the Global Collection feature is launched to collect text materials on the local device for the first time. After successful collection, the Global Collection can include icons corresponding to the collected text materials. Figure 3H As shown, the floating state of the global collection can include an icon 3071 named "Text 01".

[0232] Using this example, if the tablet is a trusted device of the mobile phone, after the text is successfully collected on the mobile phone, the mobile phone can send a notification prompt to the tablet; after receiving the notification prompt, the tablet can pop up a notification card to remind the user that a new material "text 01" has been collected in the global collection on the mobile phone.

[0233] If the global collection is not enabled on the tablet, it can launch the global collection application after receiving a notification prompt. Figure 7A and Figure 7B As shown, the global favorites feature is initially hidden, then slides out from right to left, gradually revealing a capsule-like icon; during this process, as... Figure 7C As shown, a notification card 701 can appear below the capsule status icon. This card 701 can display the message "New materials have been collected on the mobile app. Click here to view and use them."

[0234] After the card 701 appears, it can automatically disappear after a preset time. Alternatively, the card 701 can also display a button with the text "OK". Then, as... Figure 7D As shown, the tablet can detect user actions on the buttons; such as Figure 7E and Figure 7F As shown, in response to the user's action, the card 701 can disappear, and the content displayed on the tablet can switch back from the globally favorited capsule status icon to the hidden status icon.

[0235] If global favorites are enabled on the tablet, they can be displayed in a hidden, floating, or full-screen state. When hidden, the icon can switch to a capsule-like state before displaying a notification card. See the above for details. Figures 7A-7F The details will not be described here; when in floating or full-screen mode, notification cards can be overlaid within or alongside the full-screen display area, the floating display area, or the area next to it. It can be understood that after the notification card disappears, the tablet continues to display the interface that was in front of it.

[0236] Optionally, the first device can also support a notification popping up on other trusted devices after the first successful collection of materials using a trusted device, to remind the user that new materials have been collected in the global collection on that trusted device.

[0237] For example, combined Figures 4A-4H As shown, when a desktop computer is used as the first device and a mobile phone as a trusted device (second device), the desktop computer takes a photo using the mobile phone. After the image is successfully collected on the mobile phone, the image named "Moon.jpg" is collected in the mobile phone's global favorites for the first time. At this time, the desktop computer can also synchronize the icon corresponding to this image, such as... Figure 4H The icon shown is 4024.

[0238] Using this example, if the tablet is another trusted device (a third device) of the desktop computer, after the image material is successfully collected on the mobile phone, the mobile phone can send a message to the desktop computer indicating successful collection. Based on this message, the desktop computer can send a notification prompt to the tablet. Alternatively, the mobile phone can directly send a notification prompt to the tablet. After receiving the notification prompt, the tablet can pop up a notification card to remind the user that a new material "Moon.jpg" has been collected in the global collection on the mobile phone.

[0239] Understandably, whether the first device calls the service to collect materials on its own end or across ends, as long as the materials are successfully collected for the first time, it can send a notification prompt to trusted devices under the same trust ring or other trusted devices other than the called service. The device that receives the notification prompt can pop up a notification card to inform the user that new materials have been collected on the first device or the trusted device of the called service.

[0240] Understandably, the above is an example of sending a cross-platform notification after the initial collection of materials.

[0241] It should be noted that the method provided in this application can provide a cross-platform notification only after the first successful material collection, or it can provide a notification after each successful material collection, or it can never provide a notification. The specific settings can be configured as needed, and this application does not impose any limitations on this. When providing a cross-platform notification only after the first successful material collection, the main purpose is to help users learn about the function of the globally favorited application, which can synchronize materials across platforms based on the same trust ring.

[0242] 4. Prompt when opening Global Favorites for the first time on a trusted device.

[0243] Optionally, after the first device supports the local collection of materials function, when the user opens the global collection application for the first time on a trusted device, the materials collected by the first device can be synchronized, and the user can be prompted after synchronization that the materials come from the first device or from other devices.

[0244] For example, combined Figures 3A-3H As shown, when a mobile phone is used as the primary device, global collection is initiated to collect text materials on the local device; after successful collection, global collection can include icons corresponding to the collected text materials. For example... Figure 3H As shown, the floating state of the global collection can include an icon 3071 named "Text 01".

[0245] Collect this example, such as Figures 7G-7IAs shown, if the tablet is a trusted device for the phone, when the user first launches the Global Collections application on the tablet, in order to remind the user that Global Collections has the function of cross-platform material synchronization, the tablet will first perform cross-platform material synchronization when responding to the user's trigger and displaying Global Collections in floating or full-screen mode. Then, a prompt card can be displayed below the icon of the material synchronized across platforms. The prompt card may include the text "Content from your other devices" to remind the user that the material is synchronized to the phone.

[0246] Optionally, such as Figure 7H As shown, when synchronizing materials across platforms, the text "Synchronizing" can be displayed before the synchronization result appears to inform the user that cross-platform synchronization is in progress.

[0247] Understandably, the above is an example of a prompt that appears when the global collection is opened for the first time on a trusted device after the material has been collected by this client.

[0248] It should be noted that the method provided in this application can prompt for only one cross-platform synchronized material when the global collection is first opened on a trusted device in floating or full-screen mode, or it can prompt for multiple cross-platform synchronized materials separately. Alternatively, it can prompt for each newly synchronized cross-platform material each time the trusted device is opened. The specific settings can be configured as needed, and this application does not limit this.

[0249] The second processing stage (i.e., organizing materials) will be described in detail below.

[0250] When the Global Collection app is in full-screen mode, it displays the materials collected in the Global Collection. At this time, the main interface can include multiple individual icons and / or multiple group icons. Individual icons indicate a single material and can trigger the first device to display the specific content of the material corresponding to that individual icon. Group icons indicate multiple materials grouped together and can trigger the first device to display the secondary interface corresponding to that group icon. This secondary interface can include multiple individual icons within the group, and each individual icon can also trigger the first device to display the specific content of the material corresponding to that individual icon.

[0251] In addition, in the main interface and secondary interfaces, besides displaying individual icons and group icons, the name of the material or the group of materials will also be displayed below each individual icon and group icon.

[0252] Optionally, since individual icons and group icons indicate different content, they can be displayed differently to visually distinguish them. For example, an individual icon can be represented as a rounded square pattern, while a group icon can be represented as multiple overlapping rounded square patterns, offset from each other at a certain angle. Alternatively, a group icon can also be in the form of stacked cards. In addition, a number can be displayed in the upper right corner of the group icon, with the number indicating the number of individual elements included in the group. This is just one example and is not a limitation of this application.

[0253] Optionally, since the collected materials include various types, the individual icons corresponding to different types of materials can be displayed differently to make them visually distinguishable. For example, when the material type is a document, the corresponding individual icon can use the first character of the document's format as the pattern in the icon; when the material type is a video, the corresponding individual icon can be overlaid with a video icon, and so on.

[0254] It is understandable that the collected materials are of various types. Users may need to use multiple materials of the same or different types. To facilitate user use, the materials collected in the global collection can be organized according to the user's needs. For example, multiple materials of the same type can be grouped together, or multiple materials of different types can be grouped together. Alternatively, materials from a specific device can be grouped together. This application does not limit this.

[0255] I. Grouping materials (e.g.) Figures 8A-8F (As shown) The following example illustrates how to group different types of materials by dragging them together, using the floating state of the global collection as an example.

[0256] Taking a mobile phone as the primary device as an example, such as Figure 8A The display interface 801 shown includes content, taking WeChat official account articles as an example. Within a portion of the display area, there is also a floating icon for global favorites, located inside the right edge of the display interface. This floating icon contains multiple individual icons, each with its own name displayed below it and a badge in the upper right corner indicating the device's origin. Figure 8A As shown, the floating state of this global collection application includes an individual icon corresponding to a video material, namely the first individual icon tb1. "Video Excerpt 02" is the name of the material corresponding to this individual icon, and a badge indicating that the device source is a laptop is displayed in the upper right corner.

[0257] The phone can detect user actions targeting the first icon tb1, and in response to that user action, the phone can display something like... Figure 8BThe display interface 802 shown can switch from a floating state to an organization window for the global favorites application, where the first volume icon tb1 can be selected. In this organization window, the selected volume icon can be split into two individual icons (a foreground icon and a background icon). The foreground icon is identical to the original first volume icon tb1 and can be moved within the display interface 802 by the user's dragging action. The background icon is identical to the original first volume icon tb1 except for its color; the background icon does not move with the user's dragging action, or rather, it remains stationary in the original display position of the first volume icon tb1.

[0258] Optionally, such as Figure 8B As shown, while the first individual icon tb1 splits into two individual icons, a circular checkbox containing blank content can be displayed in the lower right corner of the other icons. This circular checkbox indicates that the icon is not selected. A circular checkbox containing a checkmark can also be displayed in the lower right corner of the background icon split from the first individual icon tb1. This circular checkbox indicates that the current individual icon is selected by the user. Additionally, when the first individual icon tb1 is selected by the user, as shown... Figure 8B As shown, a close control can also be displayed in the upper left corner of the organization window. This close control is used to trigger the exit of the floating organization function.

[0259] After that, as Figure 8C The display interface 803 shown responds to the user's dragging operation on the foreground icon in the organization window. This foreground icon can be moved above another individual icon, such as the second individual icon tb2. The second individual icon tb2 is the individual icon corresponding to an image-type material; "fff.jpg" is the name of the material corresponding to this individual icon. There is no badge in the upper right corner indicating that the device originated from the mobile phone. When the mobile phone detects that the projection of the foreground icon corresponding to the first individual icon tb1 overlaps with the projection of the second individual icon tb2, the mobile phone can automatically combine the first individual icon tb1 and the second individual icon tb2 together and switch to displaying the group icon tb3. See also... Figure 8D The display interface 804 shown shows that in this sorting window, the group icon tb3 is the group icon corresponding to the first body icon tb1 and the second body icon tb2 after they are grouped together. "Video Excerpt 02" is the name that the mobile phone automatically gives to the group icon tb3.

[0260] Optionally, such as Figure 8CAs shown, when the electronic device detects that the foreground icon corresponding to the first body icon tb1 overlaps with the projection of the second body icon tb2, a gray block can be added to the background of the second body icon tb2 to prompt the user that the second body icon can be used together with the first body icon tb1 to form a group.

[0261] Alternatively, as one possible implementation, the group icon can be formed directly by overlapping the included individual icons. Another possible implementation is that the group icon can also be formed by piecing together scaled-down individual icons, or it can be in the form of stacked cards. For example, as... Figure 8D As shown, when the first body icon tb1 and the second body icon tb2 are grouped together, the corresponding group icon tb3 is formed by the overlap of the first body icon tb1 and the second body icon tb2; or, the group icon tb is formed by combining the first body icon tb1 and the second body icon tb1. The above are just two examples. The style and color of the group icon can be set as needed, as long as it is easily distinguishable from the individual icons.

[0262] Afterwards, the phone can detect user actions on the close control in the upper left corner of the organization window, such as... Figure 8E As shown, in response to this user action, the electronic device can exit the organization function and switch from the organization window to a floating state of global favorites, as... Figure 8F The display interface 805 is shown. Compared to the global favorites floating state in display interface 801, display interface 805 groups the two individual icons below. Therefore, the two individual icons that were displayed separately in display interface 801 are displayed as a group icon in display interface 805. Apart from this, the other display content in the two display interfaces is the same.

[0263] As you can understand, the above is an example of grouping materials by dragging them while the global collection is in a floating state.

[0264] Optionally, based on Figure 8F As shown in the display interface 805, the mobile phone can also detect a click operation on the group icon tb3. In response to the click operation, the mobile phone can display the secondary interface corresponding to the group icon tb3. Here, the group icon tb3 is a group consisting of the first body icon tb1 and the second body icon tb2. Therefore, the first body icon tb1 and the second body icon tb2 can be displayed in the secondary interface.

[0265] As is understandable, since the global collection is in a floating state, the process of grouping materials by dragging and dropping is similar to the above, whether it is an individual material or a group of materials, or two groups of materials, and will not be repeated here.

[0266] It is understandable that when the global collection is in full-screen mode, the process of grouping materials by dragging is similar to the above, and will not be repeated here.

[0267] Additionally, regardless of whether the global collection is in floating or full-screen mode, a card with a "Create New Group" option can be triggered to create a group.

[0268] In this embodiment of the application, grouping can be performed regardless of whether the materials from the synchronized trusted device have been downloaded to the local end.

[0269] It should also be noted that after grouping, the grouping results of the materials included in the above floating state will be synchronized to the global collection of trusted devices, that is, the grouping of materials displayed on other trusted devices will be the same as that on the first device.

[0270] II. Material movement (e.g.) Figures 9A-9E (As shown) The following example illustrates the process of moving materials, using the floating state of global collection as an example.

[0271] Taking mobile phones as the primary device as an example, Figure 9A The display interface 901 shown is Figure 8A The display interface shown is the same as 801. Figure 9B The display interface 902 shown is Figure 8B The same applies to the display interface 802 shown. When the global collection is in a floating state, the process of selecting the first icon can be referred to the above descriptions of display interfaces 801 and 802, and will not be repeated here.

[0272] After the phone detects that the first body icon tb1 is selected, see [link / reference]. Figure 9C The display interface 903 shown responds to a user's dragging operation on a foreground icon split from the first volume icon tb1. This foreground icon can be moved to a position overlapping with either the third volume icon tb3 or the fourth volume icon tb4. When the electronic device detects that the foreground icon displayed as a split from the first volume icon tb1 overlaps with the lower half projection of the third volume icon tb3, and / or the upper half projection of the fourth volume icon tb4, see [reference needed]. Figure 9D As shown in display interface 904, the phone can move the fourth individual icon tb4, and all icons below it, sequentially downwards to the positions of the next adjacent icons. Here, the background icon split from the first individual icon tb1 moves along with the other icons.

[0273] Then, the phone can detect when the user lifts their finger, releasing the foreground icon. At this point, see... Figure 9EIn the displayed interface 905, the background icon that split from the first body icon tb1 disappears and is no longer displayed. The first body icon tb is located in the icon position between the third body icon tb3 and the fourth body icon tb4. In addition, if there are other icons below the background icon before it disappears, these other icons will move upwards in sequence to the icon position of the adjacent previous icon when the background icon disappears.

[0274] Optionally, combined Figure 9C and Figure 9D As shown, when the fourth individual icon tb4 and all the icons below it move together to the position of the next adjacent icon, they can create an animation effect of being pushed aside by the first individual icon tb1.

[0275] Based on the above drag operation. Figure 9E The display interface 905 shown is relative to Figure 9A In the display interface 901 shown, the position of the first volume icon tb1 has been moved.

[0276] It should be further explained that when the phone detects a foreground icon that splits from the first body icon tb1, and that the user drags it upwards to a certain position without releasing the foreground icon, it can be assumed that the icon position currently displayed in the organizing window is not the position the user intended to move it to. Therefore, combined with... Figure 9C As shown, the currently displayed icons in the sorting window can automatically scroll down and gradually disappear, while previously undisplayed icons above can automatically scroll down and gradually become fully visible; scrolling stops only when the phone fully displays the first icon or the phone detects that the user's finger has been lifted and released from the foreground icon. After stopping, the process of the released foreground icon pushing aside other icons is similar to the above and will not be described further here.

[0277] As you can understand, the above is an example of moving materials by dragging them while the collection is in a floating state globally.

[0278] It is understandable that when the global collection is in full-screen mode, the process of moving materials by dragging is similar to the above, so it will not be repeated here.

[0279] In addition, regardless of whether the global collection is in floating or full-screen mode, the movement control can be triggered to move the materials.

[0280] In this embodiment of the application, the materials from the synchronized trusted device can be moved regardless of whether they have been downloaded to the local device.

[0281] It should also be noted that after the movement, the movement results of the materials included in the above floating state will be synchronized to the global collection of trusted devices, that is, the material movement situation displayed on other trusted devices is the same as that on the first device.

[0282] III. Renaming materials (e.g.) Figures 10A-10H (As shown) The following example illustrates the process of renaming materials using the full-screen mode of global favorites.

[0283] Taking a mobile phone as the primary device as an example, see Figure 10A The display interface 1001 shown is the main interface for global favorites. Display interface 1001 includes multiple individual icons, each with its own name displayed below it, and a badge in the upper right corner indicating the device's origin. For example... Figure 10A As shown, the display interface 1001 includes a first body icon tb1, which includes a badge indicating that the material is synchronized with the laptop.

[0284] like Figure 10B As shown, the phone can detect a long press operation on the first body icon tb1; in response to this long press operation, as follows: Figure 10C The display interface 1002 shown here has the first volume icon tb1 in a selected state (for ease of description, it can be referred to as the first volume icon tb1'). This display interface 1002 can also be called the sorting interface.

[0285] Optionally, the icon can be displayed in different colors or have its overlay added or removed to differentiate between selected and unselected states. For example, when the icon is selected, it can be switched to gray or have an overlay added, while when it is unselected, it can be switched to white or have its overlay removed. Figure 10B and Figure 10C As shown, the first body icon tb1', which is currently selected, has been switched to gray compared to the first body icon tb1.

[0286] Optionally, a circular checkmark box can be displayed in the lower right corner of the first individual icon tb1' that is selected. This circular checkmark box also indicates that the current individual icon is selected. Other icons can also display circular checkmark boxes with blank content in the lower right corner of their respective icons. These circular checkmark boxes with blank content indicate that the icon is not selected. Other than this, everything else remains unchanged.

[0287] Alternatively, after the phone detects that the first body icon tb1 is selected, as one possible implementation, see [link to relevant documentation]. Figure 10CThe display interface 1002 shown can also display a card kp1 with multiple options, such as "Create Group" and "Rename". Since only one individual icon is currently selected, and an individual icon cannot be grouped, the "Create Group" option on card kp1 needs to be restricted and can be set to gray to indicate that the user cannot create a new group for a selected individual icon. Alternatively, since the phone detects that only one icon is selected, it can receive user input to rename that icon. In this case, the "Rename" option on card kp1 does not need to be restricted and can be set to white to indicate that the user can rename an individual icon. As another possible implementation, the phone can display a card that only includes the "Rename" option.

[0288] See Figure 10D As shown, the mobile phone can detect a click on the "Rename" option on card kp1; in response to this click, the electronic device can display as shown below. Figure 10E The display interface 1003 shown is composed of four parts, such as a display interface 1002, a mask, a soft keyboard, and a card kp5. The mask covers the display interface 1002 to indicate to the user that operations on the display interface 1002 are restricted. The soft keyboard and card kp5 cover the mask. The soft keyboard can be displayed in the lower half of the display interface 1003 for easy reception of user input. The card kp5 can be displayed in the middle of the display interface 1004 for easy viewing by the user.

[0289] Optionally, the card kp5 may include a title "Rename", an input field, a cursor, a cancel button, and an confirm button. The input field responds to user input and displays the user's input; the cursor indicates the position of the input text; the cancel button responds to user input and triggers an exit from the renaming function; the confirm button responds to user input and triggers the renaming of the selected icon based on the text entered by the user in the input field.

[0290] Understandably, since the original name of the first icon was "Video Excerpt 02", when card kp5 is displayed in the display interface 1003, the input field of card kp5 will display the original name "Video Excerpt 02" by default.

[0291] After that, as Figure 10F The display interface 1004 shown indicates that the electronic device can detect user input and display the user's input content, "promotional materials," in the input field; for example... Figure 10G As shown, the electronic device can also detect user interaction with the OK button; in response to this user interaction, such as... Figure 10HAs shown, the electronic device can switch to display interface 1005, in which the name corresponding to the first body icon tb1 is the renamed "Promotional Video".

[0292] Based on the above renaming operation. Figure 10H The display interface 1005 shown is relative to Figure 10A In the display interface 1001 shown, the name corresponding to the second to last icon has been changed from "Video Excerpt 02" to "Promotional Video".

[0293] As you can understand, the above is an example of renaming materials when the global collection is in full-screen mode.

[0294] As is understandable, since the global collection is in a floating state, the process of renaming materials is similar to that described above, and will not be repeated here.

[0295] When the global collection is in full-screen or floating mode, the first device can also display a card with a "Rename" option on the interface when it detects a long press operation on a group icon. Based on this, the first device can also detect the user operation of "Rename" on the card. In response to the user operation, the group icon can be renamed. For details, please refer to the process of renaming individual icons described above, which will not be repeated here.

[0296] In this embodiment of the application, the materials from the synchronized trusted device can be renamed regardless of whether they are downloaded to the local device.

[0297] It should also be noted that after renaming, the naming results of the materials included in the above floating state will be synchronized to the global collection of trusted devices, that is, the naming of materials displayed on other trusted devices will be the same as that on the first device.

[0298] IV. Deletion of materials (e.g.) Figures 11A-11F (As shown) The following example illustrates the process of deleting materials, using the full-screen mode of global favorites.

[0299] Taking a mobile phone as the primary device as an example, see Figure 11AThe display interface 1101 shown is the main interface for global favorites. Display interface 1101 includes multiple individual icons, each with its own name displayed below it and a badge in the upper right corner indicating the device source. Display interface 1101 includes a first individual icon tb1' in a selected state (the badge on this icon indicates that the material is synchronized with the laptop), and multiple individual icons and multiple group icons in a non-selected state. The non-selected individual icons may include a second individual icon tb2 (this icon does not include a badge indicating that the material originated from the mobile device). Additionally, the lower right corner of the first individual icon tb1' in the selected state can display a circular checkbox containing a checkmark, while the lower right corners of the other icons can display circular checkboxes containing blank content.

[0300] like Figure 11A As shown, the first device can detect a click operation on the second body icon tb2; as Figure 11B The display interface 1102 shown responds to the click operation, and the second body icon tb2 can be selected (for ease of description, it can be referred to as the second body icon tb2'). The second body icon tb2' in the selected state can display a circular checkbox including a checkmark.

[0301] At this time, the bottom of the display interface 1102 may also include a bottom status bar, which may include: share, select all, move, delete and more controls. The share control is used to trigger the export or sharing of the material corresponding to the icon that is already in the icon selection state to other applications in a certain format; the select all control is used to trigger all icons to be in the icon selection state; the move control is used to trigger the movement of material; the delete control is used to trigger the deletion of material; and the more controls can trigger more other functions, which are not limited in this application.

[0302] After the first device detects that the first body icon tb1 and the second body icon tb2 are selected, such as Figure 11C As shown, the first device can detect user actions on the delete control; in response to the user action, the first device can display as shown in the image. Figure 11D The display interface 1103 shown is composed of four parts, such as a display interface 1102, a mask, a soft keyboard, and a card kp6. The mask covers the display interface 1102 to indicate to the user that operations on the display interface 1102 are restricted. The soft keyboard and card kp6 cover the mask. The soft keyboard can be displayed in the lower half of the display interface 1103 for easy reception of user input. The card kp6 can be displayed in the middle of the display interface 1103 for easy viewing by the user.

[0303] Optionally, the card kp6 may include a prompt "Delete these 2 favorites?", a cancel button, and an confirm button. The number of prompts can be determined based on the number of icons that are selected; the cancel button is used to trigger the exit from the delete function; the confirm button is used to trigger the deletion of the material corresponding to the icons that are selected.

[0304] Understandably, to avoid user misoperation, after detecting the operation on the delete control, it is necessary to prompt the user once more to confirm whether the user's intention is genuine.

[0305] After that, as Figure 11E As shown, the first device can detect user interaction with the OK button and, in response to that interaction, see [reference needed]. Figure 11F In the displayed interface 1104, the first body icon tb1 and the second body icon tb2 have disappeared, and their corresponding materials have been deleted.

[0306] Alternatively, in the display interface 1104, the first device may also display a card kp6 including a prompt, such as "2 materials have been deleted" to prompt the user that the deletion operation has been completed.

[0307] Based on the above deletion operation, Figure 11F The display interface 1104 shown is relative to Figure 11A In the display interface 1101 shown, the last two icons and the second to last icon have been removed.

[0308] As you can understand, the above is an example of deleting content while the entire collection is in full-screen mode.

[0309] As is understandable, since the global collection is in a floating state, the process of deleting materials is similar to that described above, and will not be repeated here.

[0310] When the global collection is in full-screen or floating mode, the first device detects a deletion operation on a group icon that is selected. It can also display a card on the interface to prompt the user whether to delete the group of materials. In response to the click operation on the confirmation control on the card, the first device can delete the group of materials corresponding to the group icon. For details, please refer to the above process of deleting materials, which will not be repeated here.

[0311] In this embodiment of the application, deletion can be performed regardless of whether the materials from the synchronized trusted device have been downloaded to the local end.

[0312] It should be noted that after deletion, the remaining materials included in the above floating state will be synchronized to the global collection of trusted devices. That is, the same material will also be deleted on other trusted devices, and the remaining materials displayed will be the same as those on the first device.

[0313] Optionally, since the deletion operation will remove the same material from all devices within the same trust ring, the user can be prompted with "Do you want to delete these two favorites? After deletion, all devices within the same trust ring will be deleted." After deletion, the user can also be prompted with "This material has been deleted from all devices within the same trust ring." The specific text can be changed, and this application does not limit this.

[0314] Finally, the third processing stage (material usage and sharing) will be described in detail. (e.g.) Figures 12A-12F As shown, as Figures 13A-13E (As shown).

[0315] I. Use of materials (e.g.) Figures 12A-12F (As shown) Taking a mobile phone as the primary device as an example, such as Figure 12A The display interface 1201 shown may include a note-editing interface in a note-taking application and a floating state for global favorites. The floating state may include multiple icons (including individual icons and group icons), each with its own name displayed below it and a badge in the upper right corner indicating the device's origin. For example, Figure 12A The floating state shown includes a group icon tb8, below which is the corresponding name "building.jpg", and in the upper right corner is a badge indicating that the device originates from a desktop computer.

[0316] The phone can detect user actions targeting the group icon tb8, and in response to those actions, the phone can display something like... Figure 12B The display interface 1202 shown can switch the global favorites application from its floating state to an organization window, where the group icon tb8 can be selected. In this organization window, the selected group icon tb8 can be split into two group icons (foreground icon and background icon). For detailed descriptions of the foreground and background icons, and the selected and unselected group icons, please refer to the preceding content; they will not be repeated here. Figure 12B As shown, a close control can also be displayed in the upper left corner of the organization window. This close control is used to trigger the exit of the floating organization function.

[0317] Subsequently, the electronic device can also detect user actions on the group icon tb8. In response to this user action, when the electronic device detects that the group icon has moved to the edge of the global favorites floating state, it can display something like this. Figure 12CThe display interface 1203 is shown below. Compared to display interface 1202, in display interface 1203, the foreground icon corresponding to group icon tb8 moves to the edge of the global collection floating state following user interaction. At this time, the background icon corresponding to group icon tb8 disappears, and the positions of other icons in the floating state are automatically rearranged. Additionally, a "+" mark can be displayed in the upper left corner of the foreground icon corresponding to group icon tb8 to indicate to the user that the material corresponding to group icon tb8 can be added to the notes included in display interface 1203. It should be understood that adding the mark is only for indication and cannot be triggered.

[0318] Then, when the electronic device detects that the foreground icon corresponding to group icon tb8 has moved out of the global favorites floating state, it can display something like this: Figure 12D The display interface 1204 is shown. Compared to display interface 1203, the foreground icon corresponding to group icon tb8 in display interface 1204 moves out of the global collection floating state and to a certain position in the notes content included in the display interface, following the user's operation. At this time, the global collection floating state is hidden and not displayed.

[0319] Optionally, during the transition from display interface 1203 to display interface 1204, the global favorites floating state can disappear with an animation effect of shrinking back from left to right.

[0320] Optionally, when the image has been downloaded to the phone, and the phone detects that the user's finger has been lifted to release the foreground icon corresponding to group icon tb8, such as... Figure 12F As shown in display interface 1206, the two images indicated by group icon tb8 can be added sequentially to the release positions within the note content, displayed at a size suitable for the note content. If the images are not yet downloaded to the phone, the phone can download them first and then import them when it detects the user's finger being lifted to release the foreground icon corresponding to group icon tb8. During the download process, the following can be displayed: Figure 12E The display interface 1205 shown is different from display interface 1204. In display interface 1205, the group icon tb8 is hidden, a display overlay is superimposed on the note content, and a display card kp7 is superimposed on the overlay. The card kp7 can display the text "Downloading and importing materials" and a download progress bar. After the download is completed, the interface switches from display interface 1205 to display interface 1206.

[0321] Optionally, after importing the materials, the floating state of the global collection can be redisplayed in display interface 1206. It is understood that since the materials corresponding to group icon tb8 have already been added to the note content, the floating state in display interface 1206, compared to the floating state in display interface 1201, no longer includes group icon tb8; the content of other icons remains the same.

[0322] As is understandable, the above is an example of using cross-platform synchronized materials when the global collection is in a floating state.

[0323] II. Material Sharing (e.g.) Figures 13A-13E (As shown) Figure 13A The display interface 1301 shown is Figure 11B The display interface shown in 1102 is similar and will not be described again here. When the global collection is in full-screen mode, the process of selecting individual icons tb3 and tb4 can be referred to the above description. Figures 11A-11B The description will not be repeated here. Among them, the badge included by individual icon tb3 indicates that the material is synchronized with the laptop, while individual icon tb4 does not include a badge indicating that the material originated from the mobile device.

[0324] After the electronic device detects that individual icons tb3 and tb4 are selected (for ease of description, they can be referred to as individual icons tb3' and tb4'), as follows: Figure 13B As shown, the electronic device can detect user actions on the sharing control; in response to this user action, since the materials indicated by individual icons tb1' and tb2' are both image types, the electronic device can switch the display when sharing multiple image types, as shown below. Figure 13B The display interface 1302 shown is a composite of three parts, such as the original display interface 1302, a mask, and card KP8. The mask covers the display interface 1302 to indicate to the user that operations on the display interface 1302 are restricted. Card KP8 covers the mask and is displayed in the lower half of the display interface 1303 to facilitate receiving user input.

[0325] Optionally, the card KP8 may include, but is not limited to, two options: "Merge into a long image for sharing" and "Share separately." These two options provide users with choices based on the number of images that can be shared. "Merge into a long image for sharing" combines the image materials corresponding to multiple selected icons into a single long image for sharing. "Share separately" allows users to share the image materials corresponding to multiple selected icons without combining them.

[0326] like Figure 13C As shown, the electronic device can detect a click on the "Merge into Long Image for Sharing" option; alternatively, as a possible implementation, in response to this click, the electronic device can display as shown in the image. Figure 13E The display interface shown is 1304. Compared with the display interface 1302, the only difference in display interface 1304 is that card KP8 is changed to card KP10, while all other content remains unchanged.

[0327] As another possible implementation, in response to a click on the "Merge into a long image for sharing" option, the electronic device can first display something like... Figure 13D The display interface 1303 shown below will then display as follows: Figure 13E The display interface 1304 is shown. Compared to display interface 1302, display interface 1303 only changes card KP8 to card KP9; all other content remains unchanged. Card KP9 may include the text "Loading," used to inform the user that the long image merging process is in progress. Understandably, since image materials are typically large in size, merging them into a long image takes a relatively long time. Therefore, to avoid the user mistakenly believing that the electronic device is not processing the image, this feedback can be added as a notification.

[0328] After successfully merging long images on electronic devices, they can be displayed as follows: Figure 13E The display interface 1304 shown is included in the card kp10. It can include four display areas from top to bottom, such as the first display area 131, the second display area 132, the third display area 133 and the fourth display area 134.

[0329] Optionally, the first display area 131 can display the icon, the text "long image," the name of the long image, the data size of the long image, and the format of the long image corresponding to the merged long image. A small triangle, which can be called a drop-down menu control, can also be displayed next to the long image format to display a drop-down menu and provide more image format options for the user to choose from. In other words, the image format of the long image can be switched by the user's selection.

[0330] Optionally, the second display area 132 may include device icons for multiple devices that have established a trusted connection with this device. This application does not limit the connection method. These multiple device icons can be used to trigger the sending of the merged long image to the corresponding device. For example, the multiple device icons may include "User 1's X30". Subsequently, in response to a click operation on this device icon, the electronic device can send the merged long image to the device indicated by "User 1's X30".

[0331] Optionally, the third display area 133 may include multiple application icons, which can be used to trigger the sharing of the merged long image to the corresponding application. For example, the multiple application icons may include browser, contacts, email, notes, and gallery, etc. Subsequently, in response to a click on the notes application icon, the electronic device can send the merged long image to the notes application.

[0332] Optionally, the fourth display area 134 may include two options: "Save" and "Print". "Save" can store the merged long image on this device without sharing it. "Print" can send the merged long image to a connected printer for printing.

[0333] As is understandable, the above is an example of sharing materials of the same type from two devices with different source information, while the global collection is in full-screen mode.

[0334] It is understandable that the process of sharing multiple materials with the same or different source information from multiple devices, or with the same or different types of materials, is similar to the above and will not be repeated here.

[0335] As is understandable, the global collection is in a floating state, and the process of sharing multiple materials is similar to that described above, so it will not be repeated here.

[0336] It should be further explained that if two or more document types are selected for sharing, and the document format is PDF, the electronic device can display card KP8 in response to a click on the share control. Card KP8 may include, but is not limited to, two options: "Merge as PDF and Share" and "Share Separately." These two options provide the user with choices based on the number of documents to share. Correspondingly, the first display area in card KP10 can show the icon corresponding to the merged PDF, the text "Merge," the name of the merged PDF (the default choice is the name of the first document to be merged), the data size of the merged PDF, and the format of the merged document, such as PDF. A small triangle can also be displayed next to the document format, which can be called a drop-down menu control, used to display a drop-down menu and provide more document format options for the user to choose from. In other words, the user can switch the format of the merged document through selection.

[0337] It should also be noted that if only one source material is selected (regardless of type), the electronic device can skip displaying the card kp8 and directly select from... Figure 13A The display interface 1301 shown has been switched to Figure 13E The display interface 1302 shown may not include the content of the first display area 131.

[0338] Optionally, Figure 13A The bottom status bar in the display interface 1301 shown may also include a merge control; when the icon corresponding to a material is selected, the merge control can be grayed out and its use restricted; when the icons corresponding to multiple materials are selected, the merge control can be restored to use. Thus, in response to the click operation on the merge control, multiple materials with selected icons can be merged, and the merged material can be automatically collected into the global collection by default.

[0339] The sharing method provided in this application combines various sharing needs such as quantity, format, device, application, saving, and printing. It provides users with choices from the dimensions of quantity, format, device, and application to meet various user needs and improve user experience.

[0340] Figure 14 This is an exemplary flowchart of a material processing method provided in an embodiment of this application.

[0341] In some possible cases, exemplary processes involved in the processing of materials by electronic devices may be referred to in the following description of steps S1401-S1407.

[0342] S1401, The electronic device displays a first interface, which includes first material.

[0343] It is understood that the first interface can be an interface displaying text content as mentioned above (such as the main interface of a news application), or the first interface can also be an interface displaying images as mentioned above (such as the main interface of a news application).

[0344] In one possible implementation, the first interface can be as described above. Figure 3A The display interface 301 shown here has text a1 as the first source material. At this time, the first source material is of text type.

[0345] S1402. In response to the first stage of the first operation on the first material, launch the target application and display the hidden icon corresponding to the target application on the first interface.

[0346] It is understandable that the target application is the global collection application mentioned above.

[0347] It is understandable that the first interface for displaying the hidden icon corresponding to the target application can be an interface where the text involved in the aforementioned content is selected and a globally saved hidden icon appears, or the first interface for displaying the hidden icon corresponding to the target application can be an interface where the image involved in the aforementioned content is selected and a globally saved hidden icon appears.

[0348] In one possible implementation, the first phase of the first operation can be... Figure 3B The long press operation shown can lead to a second interface. Figure 3B The display interface shown is 302.

[0349] S1403, in response to the second phase of the first operation on the first material, the hidden state icon is switched to the collection state icon corresponding to the target application, and the first material is collected into the target application through the collection state icon.

[0350] In one possible implementation, the second phase of the first operation can be... Figure 3C , Figure 3D The dragging or throwing action shown.

[0351] S1404. After the first material is collected, the collection status icon switches to the hidden status icon.

[0352] S1405, in response to a second operation on the collected hidden icon, the hidden icon is switched to a floating icon corresponding to the target application, the floating icon is displayed floatingly on the first interface, the floating icon includes a first icon indicating the first material.

[0353] In one possible implementation, the second operation can be... Figure 3G The click operation shown can be represented by the first icon. Figure 3H The icon shown is 3071.

[0354] S1406. Before the first material is collected, the second electronic device displays a second interface, and the hidden icon corresponding to the target application is displayed floating on the second interface.

[0355] Understandably, the global favorites application has already started at this point, and the hidden icon remains displayed.

[0356] In one possible implementation, the second interface can be... Figure 3I The display interface shown is 308.

[0357] S1407. After the first material is collected, the second electronic device detects a third operation targeting the hidden icon in the second interface.

[0358] In one possible implementation, the third operation can be... Figure 3I The click operation shown.

[0359] S1408 In the second electronic device, in response to the third operation, the hidden icon is switched to a floating icon, and the floating icon is displayed floatingly on the second interface. The floating icon includes a first icon indicating the first material and a first badge.

[0360] In one possible implementation, the first icon and the first sub-sign could be the icon 3091 shown in 3J and the sub-sign in the upper right corner of the icon 3091. The relevant content of steps S1401 to S1408 can be referred to the description of the text collection phase and its synchronous display on the floating icon of the tablet in the previous section, and will not be repeated here. The exemplary interfaces involved in steps S1401 and S1408 can be referred to the previous section... Figures 3A-3J ,as well as Figures 3A-3JThe relevant content will not be described in detail here.

[0361] The apparatus involved in the embodiments of this application is described below.

[0362] Figure 15 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0363] The electronic device may include a processor 110, an external memory interface 120, an internal memory 121, an audio module 130, a speaker 130A, a receiver 130B, a microphone 130C, a headphone jack 130D, a display screen 140, a camera 150, and a touch sensor 160.

[0364] The structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. The interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a limitation on the structure of the electronic device.

[0365] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Processor 110 may also include memory for storing instructions and data.

[0366] Electronic devices achieve display functions through GPUs, displays 140, and application processors.

[0367] The GPU is a microprocessor for image processing, connected to the display screen 140 and the application processor. The GPU performs mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information. The display screen 140 is used to display images, videos, etc. In some embodiments, the electronic device may include one or N displays 140, where N is a positive integer greater than 1.

[0368] In this embodiment of the application, the electronic device displays the aforementioned... Figures 3A-3J , Figures 4A-4I , Figures 5A-5H , Figures 6A-6D , Figures 7A-7I , Figures 8A-8F , Figures 9A-9E , Figures 10A-10H , Figures 11A-11F , Figures 12A-12F , Figures 13A-13E The capabilities of the user interface shown depend on the aforementioned GPU, display 140, and display functions provided by the application processor.

[0369] Camera 150 is used to capture still images or videos. The ISP (Image Signal Processor) processes the data fed back from camera 150. Light is transmitted through the lens to the camera's photosensitive element, where the light signal is converted into an electrical signal. The camera's photosensitive element then transmits the electrical signal to the ISP for processing, transforming it into a visible image. The electronic device may include one or N cameras 150, where N is a positive integer greater than 1. A video codec is used to compress or decompress digital video. The electronic device may support one or more video codecs. Thus, the electronic device can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0370] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM). The RAM can be directly read and written by the processor 110 and can be used to store executable programs (e.g., machine instructions) of the operating system or other running programs, as well as user and application data. The NVM can also store executable programs and user and application data, and can be pre-loaded into the RAM for direct read and write operations by the processor 110.

[0371] In this embodiment, the code implementing the information processing method described in this embodiment can be stored in non-volatile memory. When running a camera application, the electronic device can load the executable code stored in the non-volatile memory into random access memory.

[0372] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of electronic devices.

[0373] Electronic devices can implement audio functions through audio modules 130, speakers 130A, receivers 130B, microphones 130C, headphone jacks 130D, and application processors.

[0374] Audio module 130 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. Speaker 130A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. Receiver 130B, also called a "handpiece," is used to convert audio electrical signals into sound signals. Microphone 130C, also called a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. Headphone jack 130D is used to connect wired headphones.

[0375] In this embodiment of the application, when the electronic device has the voice-to-text function enabled, it can enable the microphone 130C to collect sound signals and convert the sound signals into corresponding text.

[0376] Touch sensor 160, also known as a "touch device," can be disposed on display screen 140. The touch sensor 160 and display screen 140 together form a touchscreen, also known as a "touchscreen." Touch sensor 160 is used to detect touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 140. In other embodiments, touch sensor 160 may also be disposed on the surface of the electronic device, in a different location than display screen 140.

[0377] In this embodiment, the electronic device can use the touch sensor 160 to detect user actions such as clicking and swiping on the display screen 140, in order to achieve... Figures 3A-3J , Figures 4A-4I , Figures 5A-5H , Figures 6A-6D , Figures 7A-7I , Figures 8A-8F , Figures 9A-9E , Figures 10A-10H , Figures 11A-11F , Figures 12A-12F , Figures 13A-13E The cross-platform interaction method shown.

[0378] Figure 16 This is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application.

[0379] The software system of an electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application uses the layered architecture of the Android system as an example to illustrate the software structure of an electronic device.

[0380] It should be understood that a layered architecture can divide software into several layers, each with a clear role and division of labor; the layers can communicate with each other through software interfaces.

[0381] like Figure 16 As shown, the Android system can be divided into four layers: from top to bottom, the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer can include a series of application packages.

[0382] like Figure 16 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0383] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0384] like Figure 16 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0385] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0386] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0387] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0388] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).

[0389] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0390] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating the device, and flashing indicator lights.

[0391] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0392] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0393] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0394] The system library may include multiple functional modules, such as: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES for embedded systems) and 2D graphics engines (e.g., Skia graphics library (SGL)).

[0395] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0396] The media library supports playback and recording of various audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, Moving Picture Experts Group Audio Layer III (MP3), Advanced Audio Coding (AAC), Adaptive Multi-rate (AMR), Joint Photographic Experts Group (JPG), and Portable Network Graphics (PNG).

[0397] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0398] A 2D graphics engine is a graphics engine for 2D drawing.

[0399] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0400] In this embodiment of the application, the electronic device can utilize the aforementioned software system to display the aforementioned... Figures 3A-3J , Figures 4A-4I , Figures 5A-5H , Figures 6A-6D , Figures 7A-7I , Figures 8A-8F , Figures 9A-9E , Figures 10A-10H , Figures 11A-11F , Figures 12A-12F , Figures 13A-13E The cross-platform interaction method shown.

[0401] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A material display system, characterized in that, The system includes a first electronic device and a second electronic device, both of which are equipped with a target application. The first electronic device is used to perform: Display a first interface, the first interface including a first material; In response to a first operation on the first material, a first foreground material and the collection mode of the target application are displayed on the first interface. The first foreground material corresponds to the first material, and the collection mode of the target application is used to indicate the entry point for material collection. When the first foreground material is moved to the entry point, in response to a second operation in which the first foreground material is released, the first material is saved to the target application of the first electronic device; When the first material is saved to the target application of the first electronic device, the hidden form of the target application is displayed on the first interface and the collected form of the target application is not displayed; wherein, the hidden form of the target application is displayed at the edge of the screen of the first electronic device; The second electronic device is used to perform: When the first material is saved to the target application of the first electronic device, the hidden form of the target application is displayed on the second interface, wherein the hidden form of the target application is displayed at the edge of the screen of the second electronic device; When a third operation is received that acts on the target application, the first floating form of the target application is displayed on the second interface and the hidden form of the target application is not displayed. The first material is then synchronized to the target application of the second electronic device. A first prompt is displayed under the first floating form of the target application, and the first prompt is used to indicate that the first material is being synchronized. When the first material is synchronized to the target application of the second electronic device, the second floating form of the target application is displayed on the second interface and the first floating form of the target application is not displayed. A thumbnail of the first material is displayed under the second floating form of the target application. In response to a fourth operation on the thumbnail of the first material, a foreground icon of the first material is displayed on the second interface; in response to a fifth operation, the first material is added to the second interface without displaying the foreground icon, the fifth operation including the foreground icon being moved to a first position in the second interface and released.

2. The system according to claim 1, characterized in that, The first operation is to select the first material and drag it; and / or, the first foreground material is the icon of the first material after it has been scaled down.

3. The system according to claim 1, characterized in that, Based on the target application where the first material is saved to the first electronic device, the first electronic device is triggered to execute: synchronize the first material to a third electronic device, which is different from the second electronic device.

4. The system according to claim 1, characterized in that, The first electronic device displays the collection mode of the target application on the first interface, specifically including: The first electronic device switches the target application from its hidden state to its collected state on the first interface.

5. The system according to claim 1, characterized in that, Before the first material is saved to the target application of the first electronic device, the first electronic device is also configured to perform: In response to the sixth operation of the hidden form of the target application, the hidden form of the target application is switched to the third floating form of the target application on the first interface, and the thumbnail of the first material is not displayed in the third floating form of the target application. After the first material is saved to the target application of the first electronic device, the first electronic device is further configured to perform: In response to a seventh operation on the hidden form of the target application, the hidden form of the target application is switched to the fourth floating form of the target application on the first interface, and a thumbnail of the first material is displayed under the fourth floating form of the target application.

6. The system according to claim 5, characterized in that, The thumbnails of one or more materials displayed in the fourth floating mode of the target application are the same as the thumbnails of one or more materials displayed in the second floating mode of the target application.

7. The system according to claim 1, characterized in that, As the foreground icon is moved to the second position in the second interface, the second floating form of the target application is set to gradually disappear.

8. The system according to claim 1, characterized in that, A second prompt is displayed in the collection mode of the target application, prompting the user to drag the first foreground material to the location of the collection mode of the target application.

9. The system according to claim 1, characterized in that, The first electronic device is also used to perform: Synchronize the material saved in the target application from the second electronic device.

10. The system according to claim 1, characterized in that, The first electronic device and the second electronic device are logged into the same account.

11. A method for displaying materials, characterized in that, include: The second electronic device displays the hidden form of the target application on the second interface, wherein the hidden form of the target application is displayed at the edge of the screen of the second electronic device; When a third operation is received that is applied to the target application, the second electronic device displays the first floating form of the target application on the second interface and does not display the hidden form of the target application, and begins to synchronize the first material to the target application of the second electronic device. A first prompt is displayed under the first floating form of the target application. The first prompt is used to indicate that the first material is being synchronized. The first material includes one or more of the following from the first electronic device: text, graphics, images, videos, audio, web pages, and tables. When the first material is synchronized to the target application of the second electronic device, the second electronic device displays the second floating form of the target application on the second interface and does not display the first floating form of the target application, and displays a thumbnail of the first material under the second floating form of the target application; In response to a fourth operation on the thumbnail of the first material, the second electronic device displays a foreground icon of the first material on the second interface; In response to the fifth operation, the second electronic device adds the first material to the second interface and stops displaying the foreground icon. The fifth operation includes moving the foreground icon to a first position in the second interface and releasing it.

12. The method according to claim 11, characterized in that, After the second floating form of the target application is displayed on the second interface, the following is also included: When the thumbnail of the first material is selected, the second electronic device displays a delete control in the second floating state of the target application; When the delete control is clicked, the second electronic device deletes the first material from the target application, thereby deleting the first material saved by the target application in the first electronic device.

13. The method according to claim 11, characterized in that, The material stored in the target application in the second electronic device is the same as the material stored in the target application in the first electronic device.

14. The method according to claim 11, characterized in that, After the second floating form of the target application is displayed on the second interface, the method further includes: The second electronic device switches the target application from the second floating state to the hidden state on the second interface; In response to the eighth operation on the second material in the second interface, the second electronic device switches the target application from the hidden mode to the collection mode and displays the second foreground material, which corresponds to the second material. The collection mode of the target application is used to indicate the entry point for material collection. When the second foreground material is moved to the entry point, in response to the release of the second foreground material, the second electronic device saves the second material to the target application.

15. The method according to claim 11, characterized in that, After the second floating form of the target application is displayed on the second interface, the following is also included: In response to the thumbnail of the first material being clicked, the second electronic device displays a floating window in the second interface, the floating window including the first material.

16. The method according to claim 15, characterized in that, The floating window further includes a first control and a second control; the method further includes: In response to the first control being clicked, the second electronic device displays the first material in full-screen mode; or, In response to the second control being clicked, the second electronic device closes the floating window.

17. The method according to claim 11, characterized in that, After the second floating form of the target application is displayed on the second interface, the following is also included: When the thumbnail of the first material is selected, the second electronic device displays a share control in the second floating state of the target application; When the sharing control is clicked, the second electronic device exports or shares the first material to other applications.

18. The method according to claim 11, characterized in that, The icon of the target application is displayed in the sidebar of the second electronic device; the method further includes: In response to the target application's icon being clicked, the second electronic device displays either a first floating mode or a second floating mode of the target application.

19. An electronic device, characterized in that, The electronic device includes a processor for invoking a computer program in memory to cause the electronic device to perform the method as described in any one of claims 11 to 18.

20. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by an electronic device, causes the electronic device to perform the method of any one of claims 11 to 18.

Images