Information recording method and electronic device

Abstract

The present application relates to the technical field of terminals. Provided are an information recording method and an electronic device. The method comprises: acquiring first memory information, wherein the first memory information is information extracted on the basis of display content of a first interface and matching a preset memory type, and the memory type corresponds to at least one attribute item; and displaying the first memory information on an intelligent assistant. According to the solution, users do not need to memorize large amounts of information themselves, and desired information can be acquired by means of the intelligent assistant at any time according to requirements, thereby reducing the operation complexity of information acquisition and improving the user experience.

Description

Information recording methods and electronic devices

[0001] This application claims priority to Chinese Patent Application No. 202410808527.0, filed on June 20, 2024, entitled "Method and Electronic Device for Acquiring Memory Information", and to Chinese Patent Application No. 202411163290.1, filed on August 22, 2024, entitled "Information Recording Method and Electronic Device", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and more specifically, to an information recording method and an electronic device. Background Technology

[0003] As the functionalities of terminal applications continue to increase, the information they carry is also becoming richer, such as train ticket information, hotel booking information, movie ticket booking information, and related card information. This information is often used multiple times in other scenarios or applications. In order to reuse this information, users need to record it in advance, which is a significant burden for users and often results in incomplete records. Alternatively, users can search for this information in the application where it originated when they need it again; however, this is very inconvenient and sometimes the desired information cannot be found. Summary of the Invention

[0004] To address the aforementioned technical problems, this application provides an information recording method and an electronic device that can reduce the operational complexity for users to repeatedly use information in terminal applications and improve user experience.

[0005] Firstly, an information recording method is provided, which can be executed by an electronic device, or by a component of the electronic device (such as a processor, chip, or chip system), or by a logic module or software that can implement all or part of the functions of the electronic device.

[0006] The method includes: acquiring first memory information, which is extracted based on the content displayed on a first interface, and the first memory information matches a preset memory type, which corresponds to at least one attribute item; and displaying the first memory information on a smart assistant.

[0007] According to the information recording method provided in this application, electronic devices can record information based on the content displayed on the terminal and retrieve the remembered information through a smart assistant. This method eliminates the need for users to manually record large amounts of information and allows them to retrieve the required information at any time via a smart assistant, thereby reducing the operational complexity of reusing information from terminal applications and improving the user experience.

[0008] In one possible implementation, before displaying the first memory information on the smart assistant, the method further includes: obtaining a first user operation, which is used to instruct the saving of the first memory information, or the first user operation is used to instruct the display content.

[0009] Based on this scheme, the electronic device can save the first memory information based on the first user's operation. Alternatively, the electronic device can determine the display content based on the first user's operation and retrieve the first memory information based on the display content.

[0010] In one possible implementation, the first user operation is used to instruct the saving of first memory information; wherein, before acquiring the first user operation, the method further includes: displaying a prompt message, the prompt message being used to indicate that there is currently memory information to be saved.

[0011] Based on this scheme, the electronic device can display a prompt after acquiring the initial memory information. The user can then perform a first user operation based on the prompt, and the electronic device can save the initial memory information based on the first user operation. This method can actively acquire the initial memory information without user intervention.

[0012] In one possible implementation, the first user operation is used to instruct the display content, which is one of the following: the interface content of the first interface of the first application, the display content in the first area of ​​the first interface, the first text in the first interface, and the first image in the first interface.

[0013] In one possible implementation, the display of the prompt message includes: if the display interface is not switched out from the first interface, the prompt message is displayed in the dialog window of the smart assistant, and the dialog window is floating on the first interface; wherein, the display of the first memory information on the smart assistant includes: in response to the first user operation on the dialog window, the first memory information is displayed in the dialog window.

[0014] For example, the first user action can be a voice or text command entered by the user in the dialog window, or an action such as clicking on the prompt information.

[0015] This solution can support users to retrieve memory information in both voice interaction and non-voice interaction scenarios, and can also guide users to save memory information by prompting them with information when the user has not switched the display interface.

[0016] In one possible implementation, the display of the prompt information includes: if the display interface switches from the first interface to the second interface, displaying the prompt information on the second interface; wherein, the display of the first memory information on the smart assistant includes: in response to the first user operation on the prompt information or in response to the first user operation on the application corresponding to the prompt information, displaying the first memory information on a third interface of the smart assistant, the third interface including the memory information to be saved.

[0017] For example, the prompt message could be a push notification.

[0018] This solution supports guiding users to save memory information via push notifications even after the user has switched display interfaces. This allows users to be aware in real-time that the electronic device has retrieved memory information and to save that information whenever needed.

[0019] In one possible implementation, the third interface includes a confirmation control corresponding to the first memory information, and the method further includes: in response to an operation on the confirmation control, saving the first memory information on the smart assistant.

[0020] In one possible implementation, obtaining the first memory information includes: scanning the display interface of the first application; and obtaining the first memory information based on the currently scanned first interface, wherein the first interface is a display interface of the first application.

[0021] In one possible implementation, the first application is a target application, wherein the electronic device is able to acquire memory information based on a scan of the display interface of the target application.

[0022] In one possible implementation, the displayed content is the interface content of the first interface of the first application; wherein, obtaining the first memory information includes: in response to the first user operation on the dialogue window of the smart assistant, obtaining the first memory information according to the interface content of the first interface, the dialogue window being displayed floating on the first interface, and the first interface being a display interface of the first application.

[0023] Based on this solution, users can retrieve memory information by waking up a smart assistant when they have a memory need.

[0024] In one possible implementation, the displayed content is the content of a first area of ​​the first interface; wherein, before acquiring the first memory information, the method further includes: determining the first area in response to the first user operation on the first interface.

[0025] In one possible implementation, before determining the first region in response to the first user operation on the first interface, the method further includes: in response to an operation on the fourth interface, performing intelligent screen recognition on the fourth interface to obtain the first interface, the first interface including a first control; and in response to an operation on the first control, activating a selection function.

[0026] Based on this scheme, users can indicate the content to be displayed by circling or drawing lines, and the electronic device can obtain the memory information based on the content indicated by the user.

[0027] In one possible implementation, the first interface further includes a second control; wherein, acquiring the first memory information includes: in response to an operation on the second control, waking up the smart assistant and displaying an image corresponding to the first area in the smart assistant's dialog box; and acquiring the first memory information based on the content in the image.

[0028] In one possible implementation, the displayed content is the first text; wherein, before acquiring the first memory information, the method further includes: copying the first text in response to the first user operation on the first interface.

[0029] Based on this scheme, electronic devices can obtain memory information from copied text.

[0030] In one possible implementation, obtaining the first memory information includes: in response to an operation on a third control in a fifth interface of the smart assistant, displaying a first window on the fifth interface, the first window including a fourth control, the fifth interface displaying saved memory information, the third control being used to add new memory information; in response to an operation on the fourth control, displaying the first text in the first window; and extracting the first text from the first window to obtain the first memory information.

[0031] This solution allows users to access memory information whenever they need it by setting up an entry point for adding new memory information.

[0032] In one possible implementation, the displayed content is the first image; wherein, before acquiring the first memory information, the method further includes: displaying the first interface, which includes the first image, in response to the first user operation on a thumbnail of the first image in the sixth interface.

[0033] Based on this scheme, electronic devices can obtain memory information from images.

[0034] In one possible implementation, acquiring the first memory information includes: performing text recognition on the first image to obtain recognized text; displaying a seventh interface of the smart assistant in response to an operation on a fifth control in the first interface, the seventh interface of the smart assistant displaying a second window, the second window including the recognized text; and acquiring the first memory information based on the recognized text in response to an operation on a sixth control in the second window.

[0035] In one possible implementation, acquiring the first memory information includes: in response to the first user operation on the seventh control in the first interface, acquiring the first memory information based on the first image, wherein the seventh control is located in a third window of the first interface and the first image is displayed in the third window.

[0036] In one possible implementation, prior to the first user operation in response to a thumbnail of the first image in the second interface, the method further includes: in response to an operation on an eighth control in an eighth interface of the smart assistant, displaying a fourth window on the eighth interface, the fourth window including a ninth control, the eighth interface displaying saved memory information, the eighth control being used to add new memory information; in response to an operation on the ninth control, displaying a first option and a second option in the fourth window, the first option being used to select an image from the gallery, the second option being used to take a photo; and in response to an operation on the first option, displaying a sixth interface, the sixth interface including a thumbnail of at least one image from the gallery.

[0037] In one possible implementation, before displaying the first memory information on the smart assistant, the method further includes: displaying on the smart assistant a memory type that matches the display content of the first interface and at least one attribute item corresponding to the memory type.

[0038] In one possible implementation, some or all of the attribute items in the at least one attribute item are editable.

[0039] Based on this solution, users can edit attribute items according to their needs.

[0040] In one possible implementation, the smart assistant includes a tenth control, and the method further includes: displaying a first menu bar in response to an operation on the tenth control, the first menu bar including a plurality of memory type options; and displaying on the smart assistant, in response to an operation on a first memory type option among the plurality of memory type options, the first memory type matching the display content of the first interface and at least one attribute item corresponding to the first memory type.

[0041] Based on this solution, users can select the memory type according to their needs to obtain the information they need to remember.

[0042] In a second aspect, embodiments of this application provide an electronic device comprising: one or more processors and a memory; the memory being coupled to the one or more processors; the memory being used to store computer program code, the computer program code including computer instructions, wherein the one or more processors invoke the computer instructions to cause the electronic device to perform the method shown in the first aspect above.

[0043] Thirdly, embodiments of this application provide a chip applied to an electronic device. The chip includes one or more processors, which are used to invoke computer instructions to cause the electronic device to perform the methods shown in the first aspect above.

[0044] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method shown in the first aspect above.

[0045] Fifthly, embodiments of this application provide a computer program product, which includes a computer program that, when run by an electronic device, causes the electronic device to implement the method shown in the first aspect above.

[0046] It is understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0047] Figures 1 to 12 are user interface diagrams for obtaining memory information provided in the embodiments of this application.

[0048] Figure 13 is an exemplary flowchart of an information recording method provided in an embodiment of this application;

[0049] Figures 14 to 17 are schematic diagrams of the interface for displaying memory types and corresponding attribute items provided in the embodiments of this application;

[0050] Figure 18 is an exemplary flowchart of an information recording method provided in an embodiment of this application;

[0051] Figure 19 is a schematic diagram of a system architecture provided in an embodiment of this application;

[0052] Figure 20 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0053] Figure 21 is a schematic diagram of the chip structure provided in an embodiment of this application. Detailed Implementation

[0054] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0055] This application relates to electronic devices equipped with a display screen. For example, the electronic device may be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, cellular phone, personal digital assistant (PDA), artificial intelligence (AI) device, wearable device, in-vehicle device (such as a car infotainment system), smart home device, or smart city device, etc. This application does not impose any special limitations on the specific type of electronic device.

[0056] One technology allows users to save screen information, such as train ticket information, hotel booking information, movie ticket booking information, and relevant card information, as images through screenshots. However, this method does not help users understand and remember the content of the images. Furthermore, users need to manually browse through numerous images to find the information they need, which is a cumbersome process.

[0057] To address the current problem of inconvenience for users in obtaining and searching for information, this application provides an information recording method. Electronic devices can actively or based on user triggers acquire information suitable for memorization, such as images, text, and application interfaces, and display and save the acquired information on a smart assistant, thereby reducing the operational complexity of information acquisition and improving user experience.

[0058] In this application, the intelligent assistant may also be referred to as a voice assistant, smart assistant, artificial intelligence (AI) assistant, intelligent voice, digital assistant, virtual assistant, etc. It can be understood as an information processing system that can recognize natural language input in the form of speech and / or text to infer the user's intent and perform corresponding actions based on the inferred user intent. Furthermore, the system can respond to the user's input through audible (e.g., voice) or visual (e.g., text, cards) output formats.

[0059] In this embodiment, the memory information can be displayed and stored on the smart assistant in the form of a card. It should be understood that this application does not limit the form in which the memory information is displayed and stored; for example, the memory information can also be displayed and stored on the smart assistant in the form of text or images.

[0060] For example, the stored information can be address information, card information, or order information. Order information could include train ticket orders, movie ticket orders, hotel orders, attraction ticket orders, etc. Card information could include ID card information, passport information, business card information, etc. It should be understood that this application does not limit the specific type of stored information.

[0061] The following illustrations, with reference to the accompanying diagrams, use the smart assistant "Xiaoyi" as an example to illustrate the interactions between the user and the electronic device involved in acquiring memory information in different scenarios. It should be understood that "Xiaoyi" is an application (APP), and it is only one specific example of a smart assistant; a smart assistant can also be other APPs or mini-programs, etc.

[0062] Scenario 1: Obtain memory information based on the application's display interface.

[0063] Figure 1 is a schematic diagram of a user interface for actively acquiring memory information according to an embodiment of this application. Referring to Figure 1(a), interface 10 is a ticket order information interface, and interface 10 is the current display interface of a certain application of the electronic device. The electronic device actively acquires the memory information in interface 10. If the user does not switch the display interface, the electronic device wakes up (or pulls up or calls up) Xiaoyi after acquiring the memory information. Referring to Figure 1(b), after Xiaoyi is woken up, its window 11 is displayed floating on interface 10. The window 11 displays a prompt message 12, which is used to prompt the user that the electronic device has acquired the memory information. If the user wants to save the memory information acquired from interface 10, in one way, the user can input the same or basically the same instruction as the prompt message in the window 11 by voice or text. For example, the user can issue voice instructions such as "Remember the screen information", "Help me remember the screen information", "Record the screen information", or "Remember the ticket information on the picture" according to the prompt message 12. In another approach, the user can click on prompt 12. In response to this click, the electronic device simulates the user issuing a "Note down the screen information" command. Referring to Figure 1(c), the user can input the "Note down the screen information" command via voice or text input or by clicking on prompt 12. The electronic device executes the "Note down the screen information" command and displays the execution result, namely, "Okay, I've noted it down for you" and card 13. The content of card 13 is the memorized information obtained from the content displayed on interface 10. For example, the electronic device can also verbally announce "Okay, I've noted it down for you" and / or the content of card 13. It should be noted that, similarly, for any of the figures or embodiments described below, the content in the dialog box and / or the content in the card displayed in Xiaoyi can also be verbally announced; this will not be elaborated upon further below.

[0064] In one example, card 13 can also be (d) in Figure 1. Referring to (d) in Figure 1, card 13 can also include image 14, which is a partial screenshot of interface 10, indicating that the time, location and other information in card 13 comes from interface 10.

[0065] Figure 2 is a schematic diagram of another user interface for actively acquiring memory information provided in an embodiment of this application. Referring to Figure 2(a), interface 20 is a movie ticket order information interface, and interface 20 is the current display interface of the electronic device. The electronic device actively acquires memory information in interface 20. If the user does not switch interfaces, the electronic device wakes up Xiaoyi after acquiring the memory information. Referring to Figure 2(b), after Xiaoyi is woken up, its window 21 is displayed floating on interface 20. Window 21 can display prompt information 22, which is the same as prompt information 12 in Figure 1. For example, if the user clicks on prompt information 22, in response to the user's click on prompt information 22, the electronic device simulates the user issuing and executing the "remember the screen information" command, displaying "Okay, I've remembered it for you" and card 23. The content of card 23 is the memory information obtained based on the content displayed on interface 20.

[0066] In one example, card 23 can also be (d) in Figure 2. Referring to (d) in Figure 2, card 23 can also include image 24, which is the movie ticket collection QR code in interface 20.

[0067] Figure 3 is a schematic diagram of another user interface for actively acquiring memory information provided in an embodiment of this application. Referring to Figure 3(a), interface 30 is the current display interface of the electronic device. The electronic device actively acquires memory information in interface 30. If, before acquiring the memory information on interface 30, the user switches the electronic device interface from interface 30 to interface 31 shown in Figure 3(b), referring to Figure 3(c), the electronic device displays a push notification 32 on interface 31. Notification 32 is used to prompt the user that there is currently memory information to be confirmed. Referring to Figure 3(d), the user can enter interface 33 by clicking notification 32 or through the relevant path of the application corresponding to notification 32. Interface 33 is the interface for memory information to be confirmed. Interface 33 includes the memory information to be confirmed, i.e., card 34, and controls 35 and 36 for the user to save and delete the memory information to be confirmed. For example, if the user clicks control 35, the electronic device will save card 34 in response to the user's click operation. Or, if the user clicks control 36, the electronic device will delete card 34 in response to the user's click operation. It should be understood that interface 30 is the same as interface 10 shown in Figure 1, and card 34 is the same as card 13 shown in Figure 1.

[0068] It should be noted that interface 33 may include one or more pieces of memory information awaiting confirmation. For example, after the electronic device displays notification 32, the user does not enter interface 33 but instead browses interface 20 as shown in Figure 2. Furthermore, the electronic device acquires the memory information from interface 20, and before the electronic device acquires the memory information, the user switches the electronic device interface from interface 20 to another interface, such as interface 31 shown in Figure 3(b). Then, there will be two pieces of memory information awaiting confirmation, and interface 33 will include card 23 awaiting confirmation (as shown in Figure 2(c) or Figure 2(d)) and card 34 awaiting confirmation. Similarly, the user can save or delete card 23 using the "save" and "delete" controls corresponding to card 23.

[0069] Figure 4 is a schematic diagram of a memory information management interface provided in an embodiment of this application. Referring to Figure 4, interface 40 is a memory information management interface. Interface 40 may include at least one card, the content of which is memory information acquired by the electronic device. For example, the at least one card is card 41 and card 42. Card 41 may be card 13 as shown in Figure 1. In the example shown in Figure 1, when the electronic device displays card 13 in window 11, interface 40 can save card 13. Alternatively, card 41 may be card 34 as shown in Figure 3. In the example shown in Figure 3, after the user clicks control 35, card 34 can be saved in interface 40. Card 42 may be card 23 as shown in Figure 2. In the example shown in Figure 2, when the electronic device displays card 23 in window 21, interface 40 can save card 23.

[0070] Figure 4 shows "Important Dates," "Frequently Used Addresses," and "Cards / IDs" as memory type labels. In one example, users can swipe left and right on the memory type labels to view memory information belonging to different memory types. In one example, cards 41 and 42 could be memory information for the "Important Dates" type; however, it should be understood that cards 41 and 42 could also be memory information for other memory types (such as orders). Memory types will be explained in detail below and will not be discussed here.

[0071] It should be understood that Figure 4 only illustrates the case where interface 40 currently stores cards 41 and 42. It should be understood that if the electronic device also stores other memory information, it will also be stored on interface 40. Users can view all cards by swiping up and down on the screen.

[0072] In one example, interface 40 and interface 33 shown in Figure 3(d) are different pages in Xiaoyi, and they can be switched between each other.

[0073] Figure 5 is a schematic diagram of a user interface for obtaining memory information based on the display content of an application's display interface, provided by an embodiment of this application. Referring to Figure 5(a), interface 50 is a movie ticket order information interface, and interface 50 is the current display interface of the electronic device. When the user wants to obtain the memory information in interface 50, they can wake up Xiaoyi. For example, the user can wake up Xiaoyi by voice inputting "Xiaoyi, Xiaoyi, write down the screen information". Referring to Figure 5(b), after Xiaoyi is woken up by the user, its window 51 is displayed floating on interface 50. After Xiaoyi executes the user's "write down the screen information" command and obtains the memory information in interface 50, it displays "Okay, I've written it down for you" and card 52. The content of card 52 is the memory information obtained based on the display content of interface 50. It should be understood that interface 50 is the same as interface 20 shown in Figure 2, and card 52 is the same as card 23 shown in Figure 2.

[0074] In one example, card 42 shown in Figure 4 can be card 52. When the electronic device displays card 52 in window 51, interface 40 shown in Figure 4 can save card 52.

[0075] Figure 6 is a schematic diagram of the user interface of another electronic device provided in this application embodiment, which retrieves memory information based on the display content of the application's display interface according to user triggering. Referring to Figure 6(a), interface 60 is a chat interface, which is the current display interface of the electronic device. When the user wants to retrieve the memory information in interface 60, they can wake up Xiaoyi. For example, the user can wake up Xiaoyi by voice inputting "Xiaoyi, Xiaoyi, remember the screen information". Referring to Figure 6(b), after Xiaoyi is woken up, its window 61 is displayed floating on interface 60. After Xiaoyi executes the user's "remember the screen information" command and retrieves the memory information in interface 60, it displays "Okay, I've remembered it for you", card 62 and card 63. The content in card 62 and card 63 is the memory information in interface 60 retrieved by the electronic device.

[0076] In one example, cards 62 and 63 can also be saved on interface 40 as shown in Figure 4.

[0077] As another example, if an electronic device acquires multiple pieces of memory information, it can also support users in selectively saving those memories.

[0078] For example, referring to Figure 6(b), Xiaoyi can ask the user, "Multiple pieces of memory information have been identified. Which ones do you want to remember?" and display the "Remember All" and "Remember Selected" controls. If the user wants to save all the memory information, they can click the "Remember All" control. Referring to Figure 6(c), in response to the user clicking the "Remember All" control, the electronic device can display "Okay, all have been remembered" and re-display cards 62 and 63, indicating that cards 62 and 63 have been saved. Further, at this time, cards 62 and 63 can be displayed on the interface 40 shown in Figure 4. If the user only wants to save one piece of memory information, they can click the memory information they want to save, such as clicking card 62, and then click the "Remember Selected" control. In response to the user clicking the "Remember Selected" control, the electronic device can display "Okay, the selected has been remembered" and re-display card 62, indicating that card 62 has been saved. Further, at this time, card 62 can be displayed on the interface 40 shown in Figure 4. In addition, users can also instruct the electronic device to save cards 62 and / or 63 via voice or text. For example, if a user voice-inputs "Write down all", the electronic device will save cards 62 and 63. For example, if a user voice-inputs "Write down the first piece of information", the electronic device will save card 62.

[0079] In some embodiments, if Xiaoyi is only woken up on the current display interface without being commanded to retrieve the memory information of the current display interface, Xiaoyi can automatically retrieve the memory information from the current display interface and display a prompt message on the Xiaoyi window after retrieving the memory information, informing the user that the electronic device has retrieved the memory information. For example, this prompt message can be prompt message 12 in Figure 1. Afterwards, the interaction between the user and the electronic device can be performed with reference to the description of Figure 1 or Figure 2.

[0080] Scenario 2: Obtain memory information based on the selected image.

[0081] Figure 7 is a schematic diagram of a user interface for obtaining memory information based on a user's selection operation, as provided in this application. Referring to Figure 7(a), interface 70 is the current display interface of the electronic device. Interface 70 can be a picture in the gallery or an application interface. The user can enter the smart screen recognition by pressing the screen with two fingers or by other triggering methods. By performing smart screen recognition on interface 70, interface 70 becomes interface 71 as shown in Figure 7(b). Referring to Figure 7(b), the user clicks the "picture selection" control 72 and then selects content on the screen. For example, referring to Figure 7(c), based on the user's selection operation, the electronic device draws corresponding lines 73, and the area enclosed by the lines 73 is the selected area. Based on the content in the selected area, the electronic device can obtain memory information.

[0082] For example, in one instance, the user clicks the "Memory Generation" control 74. In response to the user's click, the electronic device wakes up Xiaoyi. Referring to Figure 7(d), after waking up Xiaoyi, the electronic device displays Xiaoyi's window 75, which can, for example, float on the interface 71. The user's dialog box 76 is displayed in window 75, and the electronic device simulates the user issuing the command "Remember the content in the picture." The image 77 in the dialog box 76 corresponds to the selected area in the interface 71. The electronic device executes the "Remember the content in the picture" command, retrieves the memory information based on image 77, and then displays the execution result "Okay, I've remembered it for you" and a card 78. The content of card 78 is the memory information retrieved based on image 77.

[0083] In another example, when a user clicks the "Memory Generation" control 74, the electronic device can retrieve memory information based on the content in the selected area. After retrieving the memory information, the electronic device can prompt the user on interface 71 that there is currently memory information to be confirmed, for example, by pushing a notification to the user. The user can then save the memory information based on this notification. For instance, this notification is similar to notification 32 shown in Figure 3(c), and the user can save the memory information on an interface similar to that shown in Figure 3(d).

[0084] Scenario 3: Obtaining memory information from text.

[0085] Figure 8 is a schematic diagram of an interface for adding memory information via text provided in this application. Referring to Figure 8(b), interface 81 adds a control 84 for adding memory information to interface 40 shown in Figure 4. Cards 82 and 83 in interface 81 can be cards 41 and 42 in interface 41, respectively.

[0086] Referring to Figure 8(a), the user copies the information "I need to buy books for my daughter tomorrow" from interface 80 to the clipboard. Referring to Figure 8(b), the user enters interface 81 and clicks control 84 in interface 81. In response to the user's click on control 84, referring to Figure 8(c), window 85 is displayed in interface 81. Window 85 is the smart memory retrieval window. The user can trigger the electronic device to automatically paste the text "I need to buy books for my daughter tomorrow" copied to the clipboard by clicking control 86 in window 85.

[0087] In one example, a user clicking control 86 can also trigger the electronic device to retrieve memory information based on "I need to buy a book for my daughter tomorrow". For example, in response to the user clicking control 86, see Figure 8(d), a dialog box 87 and a card 88 appear in window 85. The content of dialog box 87 is the text "I need to buy a book for my daughter tomorrow" copied by the user to the clipboard, and card 88 is the memory information retrieved based on the text "I need to buy a book for my daughter tomorrow". If the user wants to save the memory information, they click control 89 in window 85. In response to the user clicking control 89, the electronic device will save card 88. For example, in response to the user clicking control 89, window 85 is no longer displayed, and interface 80 will change to interface 100 as shown in Figure 10, that is, the electronic device saves card 88 in the memory information management interface. Optionally, interface 100 may also include a prompt box 101, with the message "New memory information created successfully" to remind the user that the memory information was successfully added.

[0088] In another example, after the electronic device automatically pastes the text "Buy books for my daughter tomorrow," it can retrieve the memory information based on "Buy books for my daughter tomorrow" based on a user trigger. For example, in response to the user clicking the control 86 in window 85, see Figure 9(a), a dialog box 87 and a control 90 for content recognition appear in window 85. After the user clicks the control 90 for content recognition, the electronic device retrieves the memory information based on the content in dialog box 87 and displays a prompt message 91 as shown in Figure 9(b). In one design, after the electronic device retrieves the memory information, it no longer displays the prompt message 91 and displays a card 88 in window 85. That is, after the electronic device retrieves the memory information, the content displayed in window 85 is as shown in Figure 8(d). Similar to the previous example, if the user wants to save the memory information, they click the control 89, and in response to the user clicking the control 89, the electronic device will save the card 88. In another design, after the electronic device retrieves the memory information, it no longer displays window 85 but displays interface 100 as shown in Figure 10.

[0089] Scenario 4: Obtaining memory information based on images.

[0090] Figure 11 is a schematic diagram of an interface for adding memory information through text in an image, as provided in this application. Referring to Figure 11(a), interface 81 is described above with reference to Figure 8(b). When the user clicks control 84, in response to the user's click on control 84, as shown in Figure 11(b), window 110 is displayed in interface 81. Window 110 is the intelligent memory retrieval window. Compared to window 85 shown in Figure 8(c), window 110 also includes a "voice recognition" control and an "image recognition" control. After the user clicks the "image recognition" control, option box 111 will be displayed in window 110. Option box 111 includes two options: "image library selection" and "take a picture". Through the "image library selection" option, the user can select an image from the image library; through the "take a picture" option, the user can take a picture. For example, if the user clicks the "image library selection" option, the electronic device will display interface 112 as shown in Figure 11(c), and the user can select an image from interface 112 for memory information retrieval. For example, after the user selects image 113 in interface 112, the electronic device displays interface 114 as shown in Figure 11(d). The electronic device then recognizes the image in interface 114 and obtains the information in the image, which is the content in the recognition box 115. In response to the user clicking control 116 in interface 114 (see Figure 11(e)), the electronic device obtains the information in the image shown in Figure 11(d), namely, "Shop transfer contact person: Ms. Zhang 130XXX". Window 110 also includes control 117, which the user can click. In response to the user clicking control 117, the electronic device obtains the memory information based on "Shop transfer contact person: Ms. Zhang 130XXX" and obtains card 118 as shown in Figure 11(f).

[0091] Figure 12 is a schematic diagram of an interface for adding memory information via an image, as provided in this application. Figures (a) to (c) in Figure 12 are the same as those (a) to (c) in Figure 11, and can be found in the description of Figure 11 above. After the user selects image 113 in interface 112, the display jumps to interface 81, where window 110 displays image 113. In response to the user clicking control 117 in window 110, as shown in Figure 12(d), the electronic device will obtain memory information based on image 113 to generate card 118 as shown in Figure 12(e).

[0092] As can be seen, unlike the example shown in Figure 11, in the example shown in Figure 12, after the user clicks on the thumbnail of image 113, the electronic device does not display the interface 114 shown in Figure 11(d), nor does it recognize image 113. Instead, it directly displays image 113 in window 110 and obtains memory information based on image 113.

[0093] It should be understood that the various operations described in the embodiments of this application, such as clicking or swiping, are merely possible operation examples to achieve the corresponding functions, and these operation examples should not constitute any limitation on this application. The names, patterns, positions, etc. of the controls in the user interface diagrams shown in the embodiments of this application, as well as the arrangement of various contents in the user interface diagrams, are all examples, and these examples should not constitute any limitation on this application.

[0094] The information recording method provided in this application will be explained below in conjunction with the user interface described above.

[0095] Figure 13 is an exemplary flowchart of an information recording method provided in this application. This method 1300 can be applied to the electronic device described above; for example, the method can be executed by an intelligent agent in the electronic device. This method 1300 may include steps S1310 and S1320. The steps of this method 1300 are described below.

[0096] S1310, acquire first memory information.

[0097] The first memory information is extracted from the content displayed on the first interface and matches a preset memory type, which corresponds to at least one attribute item. For example, the content displayed on the first interface can be all the content of the first interface, or it can be part of the content of the first interface, such as text or images in the first interface.

[0098] In the embodiments of this application, at least one memory type (also referred to as category, memory type, or identification type, etc.) can be preset. For example, the memory type can be an important date, address, card, order, or event (or matter).

[0099] A memory type can include at least one attribute item. For example, the attributes for an important day can include: name, related person, time, etc. The attributes for an event can include: time, location, name, subject, etc.

[0100] For example, some memory types can be further divided into multiple subtypes, and the attribute items corresponding to different subtypes may differ. For instance, an important date may include one or more of the following subtypes: birthday, anniversary, payment due date, exam date, payday. For instance, an order may include one or more of the following subtypes: train ticket order, plane ticket order, or movie ticket order. For instance, a card may include one or more of the following subtypes: business card, ID card, or driver's license.

[0101] For example, the attribute items for a memory type with the subtype "train ticket" can include: train number, departure station, destination station, time, gate, seat number, etc. For example, see card 13 in Figure 1. The content of card 13 is a memory information, and the memory information corresponds to the memory type "order" and the subtype "train ticket".

[0102] For example, the attribute items for the memory type of driver's license subtype can include: name, number, validity period, etc.

[0103] For example, if the first interface is a map-related application, the corresponding memory type could be an event or an address. The first memory information could include one or more of the following: time, address, name, card number, or event. The event could be, for example, taking a taxi or traveling. Similarly, if the first interface is a music-related application, the corresponding memory type could be an important day or event. The first memory information could include one or more of the following: song title, artist, or song release date.

[0104] It should be understood that the memory types and corresponding attribute items shown in the embodiments of this application are merely illustrative and should not constitute any limitation on this application.

[0105] In one implementation, the content displayed on the first interface can be matched with some or all of the memory types in at least one preset memory type; if the content displayed on the first interface is successfully matched with a certain memory type, the matching information is used as the first memory information; or, if the content displayed on the first interface is successfully matched with multiple memory types, the matching information of the memory type with the most matching information can be used as the first memory information.

[0106] In another implementation, different interfaces or different content can correspond to a memory type by default. If the content displayed on the first interface matches its corresponding default memory type, the matching information can be used as the first memory information.

[0107] In another implementation, users can choose a memory type themselves, and the content displayed on the first interface is matched with the selected memory type. If the match is successful, the matched information can be used as the first memory information.

[0108] It should be understood that the matching information refers to the information of the corresponding attribute items obtained through matching.

[0109] For example, the aforementioned matching operation can be performed using a lager language model (LLM).

[0110] In some embodiments, the electronic device can perform corresponding processing based on the displayed content of the first interface to obtain first memory information. For example, the electronic device can match the displayed content of the first interface with at least one preset memory type to obtain first memory information.

[0111] In other embodiments, the electronic device may send the displayed content of the first interface or a preprocessing result obtained by preprocessing the displayed content of the first interface to the server. The server can then perform corresponding processing based on the displayed content of the first interface or the preprocessing result to obtain the first memory information. In this case, S1310 may specifically include receiving the first memory information from the server. For example, the server may match the displayed content of the first interface with at least one preset memory type to obtain the first memory information. For example, the preprocessing may be visual analysis, interface framework analysis, and / or interface text recognition, and the corresponding preprocessing result may be an application page, text, and / or image data with descriptions. The application page may be, for example, an application name or / or a page name.

[0112] S1320, the first memory information is displayed on the smart assistant.

[0113] For example, a first card could be displayed on the smart assistant, and this first card could include first memory information. Alternatively, the first memory information could also be displayed in other forms, such as as an image.

[0114] According to the information recording method provided in this application, an electronic device can acquire initial memory information and display it on a smart assistant. This method eliminates the need for users to memorize large amounts of information themselves, allowing them to retrieve the required information at any time through the smart assistant, thereby reducing the operational complexity of information acquisition and improving the user experience.

[0115] In some embodiments, prior to S1320, the method may further include: obtaining a first user action.

[0116] In one scenario, the first user operation instructs the storage of first memory information. In this scenario, the electronic device, in response to the first user operation, may execute S1320.

[0117] In one example, before obtaining the first user action, the method 1300 may further include: displaying a prompt message. This prompt message indicates that there is currently memory information to be saved.

[0118] Specifically, after the electronic device acquires the first memory information, it can display a prompt message. Based on the prompt message, the user can perform a first user operation. In response to the first user operation, the electronic device can display the first memory information on the smart assistant.

[0119] Based on this scheme, electronic devices can actively acquire first memory information and prompt the user to save the memory information after acquiring the first memory information. The user can save the first memory information based on the prompts from the electronic device.

[0120] In another scenario, the first user operation is used to instruct the displayed content. In this case, the electronic device, in response to the first user operation, can execute S1310.

[0121] Based on this scheme, electronic devices can retrieve initial memory information based on user triggers.

[0122] For example, the displayed content is one of the following: the interface content of the first interface of the first application, the displayed content in the first area of ​​the first interface, the first text in the first interface, and the first image in the first interface.

[0123] The following section provides a detailed explanation of two scenarios: electronic devices actively acquiring first memory information and passively (i.e., based on user triggering) acquiring first memory information.

[0124] Actively acquire first memory information

[0125] In some embodiments, S1310 may specifically include: scanning the display interface of the first application; obtaining first memory information based on the display content of the currently scanned first interface, wherein the first interface is a display interface of the first application.

[0126] In other words, electronic devices can actively acquire memory information based on the application's display interface. For example, an electronic device can scan the display interface of a first application at a preset period, or scan the display interface of the first application when it switches. It should be understood that for the same application, such as the first application, the interface scanned by the electronic device at different times may be different. Memory information may be acquired from some interfaces, but not from others. Failure to acquire memory information means that the interface does not contain information matching the relevant memory type.

[0127] Based on the above solution, electronic devices can proactively acquire first-memory information without user intervention, eliminating the need for manual user intervention.

[0128] For example, for the first interface currently being scanned, visual analysis, interface framework analysis, and / or interface text recognition can be combined to extract the application page, text, and descriptive image data of the first interface. Then, the first memory information can be obtained based on the application page, text, and descriptive image data of the first interface. For instance, the memory type adapted to the first application can be determined based on the application page, text, and descriptive image data of the first interface. Then, the corresponding schema can be called to generate a prompt for obtaining memory information. The first memory information can be generated by calling the LLM through the prompt.

[0129] Optionally, the first application can be a target application. The target application can also be referred to as a memory source. The electronic device is able to acquire memory information based on scanning the display interface of the target application.

[0130] For example, if an electronic device repeatedly retrieves memory information from an application's display interface based on user triggers, the device can designate that application as a target application, or the user can mark it as a target application. For instance, if the electronic device retrieves memory information from an application's display interface more than a preset number (denoted as N times), it can display a pop-up message on the current screen prompting the user whether to mark the application as a target application. The user can then mark the application as a target application based on this prompt.

[0131] In one example, S1320 may specifically include: if the display interface has not switched from the first interface, waking up the smart assistant and displaying the first memory information in the smart assistant's dialogue window.

[0132] In other words, the electronic device obtains the first memory information based on the first interface. If the electronic device's display interface is still on the first interface when the first memory information is obtained, the electronic device can actively wake up the smart assistant and display the first memory information obtained based on the first interface on the smart assistant.

[0133] For example, the smart assistant could be Xiaoyi, the first interface could be interface 10 as shown in Figure 1, and the first memory information could be the content in card 13 as shown in Figure 1. If the user stays on interface 10, the electronic device will obtain the memory information based on interface 10, wake up Xiaoyi, display card 13 in window 11, and save card 13 on Xiaoyi, for example, in interface 40 as shown in Figure 4.

[0134] In another example, the display prompt message may specifically include: if the display interface is not switched from the first interface, the prompt message is displayed in the dialogue window of the smart assistant, and the dialogue window of the smart assistant is displayed floating on the first interface.

[0135] Accordingly, S1320 may specifically include: displaying first memory information in the dialogue window of the smart assistant in response to a first user operation on the dialogue window of the smart assistant. That is, the electronic device obtains the first memory information based on the first interface. If the display interface of the electronic device is still on the first interface when the first memory information is obtained, the electronic device can actively wake up the smart assistant and display the first prompt information in the dialogue window of the smart assistant. Then, the user can perform a first user operation on the dialogue window of the smart assistant, and in response to the first user operation, the electronic device can display the first memory information. For example, the user can input a first user command in the dialogue window of the smart assistant. The first user command can be input via voice or text, and the electronic device executes the first user command and displays the first memory information. Alternatively, the user can operate on the prompt information, and the electronic device executes the command corresponding to the operation and displays the first memory information.

[0136] The above solution can support users to obtain memory information in both voice interaction and non-voice interaction scenarios, and can also guide users to save memory information by prompting them with information when the user has not switched the display interface.

[0137] For example, the smart assistant could be Xiaoyi, the first interface could be interface 10 as shown in Figure 1, and the first memory information could be the content in card 13 as shown in Figure 1. If the user remains on interface 10, the electronic device will retrieve the memory information based on the content on interface 10, wake up Xiaoyi, and display prompt information 12 (an example of a prompt information). The user can input the first user command "remember the screen information" or click on prompt information 12, and the electronic device will display card 13 and save card 13 on Xiaoyi, for example, in interface 40 as shown in Figure 4.

[0138] For example, the smart assistant could be Xiaoyi, the first interface could be interface 20 as shown in Figure 2, and the first memory information could be card 23 as shown in Figure 2. If the user remains on interface 20, the electronic device will retrieve the memory information based on the content on interface 20, wake up Xiaoyi, and display prompt information 22 (an example of prompt information). The user can input the first user command "remember the screen information" or click on prompt information 22, and the electronic device will display card 23 and save card 23 on Xiaoyi, for example, in interface 40 as shown in Figure 4.

[0139] In yet another example, the display prompt information may include: if the display interface switches from the first interface to the second interface, the prompt information is displayed on the second interface.

[0140] Accordingly, S1320 specifically involves: in response to a first user operation on the prompt information, displaying the first memory information on the third interface of the smart assistant, the third interface including the memory information to be saved (or confirmed).

[0141] In other words, the electronic device obtains initial memory information from the first interface. If the displayed interface of the electronic device is no longer the first interface when the initial memory information is obtained, such as the second interface, the electronic device will push a prompt message to remind the user that there is currently memory information to be saved. The user can then view the memory information to be saved on the third interface of the smart assistant based on this prompt message. For example, the user can click on the prompt message, and the electronic device will display the third interface in response to the user's click. Alternatively, the user can click on the APP icon corresponding to the prompt message, enter the APP, and then switch pages to access the third interface.

[0142] The above solution supports guiding users to save memory information via push notifications even after the user has switched display interfaces. This allows users to be aware in real-time that the electronic device has performed a memory retrieval operation and to save the retrieved information whenever needed.

[0143] For example, the first interface can be interface 30 as shown in Figure 3. The electronic device obtains the first memory information based on the content of interface 30. If the electronic device displays interface 31 instead of interface 30 when the first memory information is obtained, the electronic device will display a prompt message, i.e., notification 32, on interface 31. The user can click on notification 32, click on the Xiaoyi icon, or enter the third interface, such as interface 33, through other means. The user can view the memory information to be saved, i.e., the content in card 34, on interface 33.

[0144] Furthermore, the third interface includes a confirmation control corresponding to the first memory information, and the method 1300 may further include: in response to an operation on the confirmation control, saving the first memory information on the smart assistant.

[0145] For example, in the example shown in Figure 3, the confirmation control is control 35. The user can click on control 35, and in response to the click on control 35, Xiaoyi will save card 34. For example, after Xiaoyi saves card 34, the user can view card 34 in interface 40 shown in Figure 4. Card 41 in Figure 4 is card 34.

[0146] Passively acquiring first memory information, that is, acquiring first memory information based on user triggers.

[0147] For example, electronic devices can support various interaction methods such as voice and touch operation (e.g., circle selection, line drawing, text selection, etc.) to trigger the electronic device to obtain memory information based on the entire screen information or part of the screen information, so as to meet the user's needs for obtaining memory information in different situations.

[0148] The following examples illustrate the methods of passively acquiring first memory information, based on the different displayed content.

[0149] Example 1: The displayed content is the interface content of the first interface of the first application.

[0150] In some embodiments, S1310 may specifically include: in response to a first user operation on a dialogue window of a smart assistant, obtaining first memory information based on the content of a first interface. The dialogue window of the smart assistant is displayed floating on the first interface, which is a display interface of a first application.

[0151] Based on this solution, users can retrieve memory information by waking up Xiaoyi when they have a memory need.

[0152] For example, the first application can be a non-target application. As mentioned earlier, the electronic device can acquire memory information based on scanning the display interface of the target application. Conversely, for non-target applications, the electronic device can acquire memory information based on user triggers.

[0153] For example, the first user action may take the form of voice or text.

[0154] For example, the first interface can be interface 50 as shown in Figure 5, the first memory information can be the content in card 52 as shown in Figure 5, and the first user operation can be the user's voice input command as shown in Figure 5, "Xiao Yi Xiao Yi, remember the screen information".

[0155] Example 2: The displayed content is the content in the first area of ​​the first interface.

[0156] In some embodiments, prior to S1310, the method may further include: determining a first region in response to a first user action on a first interface.

[0157] For example, the first user operation could be a selection or a line drawing. Based on this solution, users can perform selection or line drawing operations on the first interface, and the electronic device can obtain the first memory information based on the selected area or the line drawing content.

[0158] For example, the first interface can be interface 71 as shown in Figure 7, and the first area can be the area enclosed by line 73 as shown in (d) of Figure 7.

[0159] In one example, before determining the first region in response to a first user operation on the first interface, the method 1300 may further include: in response to an operation on the fourth interface, performing intelligent screen recognition on the fourth interface to obtain the first interface, the first interface including a first control; and in response to an operation on the first control, activating the selection function.

[0160] The fourth interface can be any display interface, such as an image or application page. For example, the fourth interface can be interface 70 as shown in Figure 7. Users can perform corresponding operations on the fourth interface to perform intelligent screen recognition. For instance, a user can press the screen of interface 70 with two fingers, and in response to this operation, the electronic device performs intelligent screen recognition. By performing intelligent screen recognition on interface 70, the electronic device will display the first interface, such as interface 71 as shown in Figure 7(b). It should be understood that the first interface includes the content obtained by intelligently recognizing the fourth interface. Interface 71 can include control 72 as the first control; by clicking control 72, the electronic device can activate the selection function. After activating the selection function, the user can select a first area by circling the content in interface 71; for example, the first area can be the area enclosed by line 73.

[0161] In one implementation, the first interface further includes a second control; S1310 may specifically include: responding to the operation of the second control, waking up the smart assistant, and displaying the image corresponding to the first area in the dialog box of the smart assistant; and obtaining the first memory information based on the content in the image.

[0162] Accordingly, S1320 may specifically include: displaying first memory information in the dialog box of the smart assistant.

[0163] For example, referring to Figure 7(c), the second control can be control 74, which the user can click. In response to the user clicking control 74, the electronic device will wake up Xiaoyi and display the image in the selected area in Xiaoyi's window 75 as shown in Figure 7(d), i.e., picture 77 in dialog box 76. Afterwards, the electronic device can simulate the user issuing and executing the command "Remember the content in the picture", and display the first memory information obtained based on picture 77, i.e., the content in card 78.

[0164] In another implementation, the method 1300 may further include: waking up the smart assistant after a preset time and displaying the image corresponding to the first region in the smart assistant's dialog box.

[0165] That is, in response to the user's first user operation on the first interface, the smart assistant is activated after a preset time after the first area in the first interface is determined, and the image corresponding to the first area is displayed in the smart assistant's dialog box.

[0166] For example, in the example shown in Figure 7, after the electronic device displays line 73 based on the user's first operation on interface 71, it can wake up Xiaoyi after a preset time, such as 5 seconds, and display the image in the circled area in Xiaoyi's window 75 shown in Figure 7(d), i.e., the image 77 in dialog box 76. Afterwards, the electronic device can simulate the user issuing and executing the command "remember the content in the picture", and display the first memory information obtained based on image 77, i.e., the content in card 78.

[0167] Example 3: The displayed content is the first text.

[0168] In some embodiments, prior to S1310, the method may include: in response to a first user action on a first interface, copying first text in the first interface.

[0169] For example, the first interface could be interface 80 as shown in Figure 8, the second operation could be a copy operation, and the first text could be "I need to buy books for my daughter tomorrow".

[0170] Based on the above solution, it is possible to obtain memory information from a portion of the text displayed on the screen, thus meeting the needs of users who only want to remember information from a portion of the text displayed on the screen.

[0171] In one example, S1310 may specifically include: in response to an operation on a third control in the fifth interface of the smart assistant, displaying a first window on the fifth interface, the first window including a fourth control, the fifth interface displaying saved memory information, and the third control being used to add new memory information; in response to an operation on the fourth control, displaying first text in the first window; and extracting the first text from the first window to obtain the first memory information.

[0172] For example, the fifth interface can be the memory information management interface of the smart assistant or the interface / page for the user to manage memory information. For instance, the fifth interface can be interface 81 as shown in Figure 8(b), the third control can be control 84 in interface 81, and the first window can be window 85 as shown in Figure 8(c). Control 84 is used to add memory information. The user can click on control 84, and in response to the click operation on control 84, the electronic device will display window 85 on interface 81. Window 85 includes a fourth control, such as control 86. The user can click on control 86, and in response to the click operation on control 86, the first text "I need to buy books for my daughter tomorrow" which has been copied to the clipboard will be displayed in window 85. The electronic device can extract "I need to buy books for my daughter tomorrow" and obtain the first memory information based on "I need to buy books for my daughter tomorrow". For instance, referring to Figure 8(d), in response to the click operation on control 86, not only will the first text be displayed in window 85, but the electronic device can also extract "I need to buy books for my daughter tomorrow", obtain the first memory information based on "I need to buy books for my daughter tomorrow", and then display the first memory information, i.e., the content in card 88. For example, as shown in Figure 9(a), in response to a click on control 86, the first text is displayed in window 85, and control 90 is also displayed; control 86 is no longer displayed. The user can click on control 90, and in response to the click, the electronic device can retrieve "I need to buy a book for my daughter tomorrow." Based on this, after obtaining the first memory information, card 88 is displayed. Furthermore, during the process of obtaining the first memory information, a prompt message can be displayed indicating that the first memory information is being obtained. For example, this prompt message could be prompt message 91 as shown in Figure 9(b). After the electronic device obtains the first memory information, prompt message 91 may no longer be displayed.

[0173] Example 4: The displayed content is the first image.

[0174] In some embodiments, prior to S1310, the method may further include: displaying a first interface, the first interface including the first image, in response to a first user action on a thumbnail of a first image in a sixth interface.

[0175] For example, the sixth interface could be interface 112 as shown in Figure 11(c), and the first image could be image 113. The user can click on the thumbnail of image 113. In response to the click on the thumbnail of image 113, the electronic device can display interface 114, which is an example of the first interface, and interface 114 includes image 113.

[0176] Further, S1310 may specifically include: performing text recognition on the first image in the first interface to obtain recognized text; in response to the operation of the fifth control in the first interface, displaying the seventh interface of the smart assistant, on which a second window is displayed, the second window including the recognized text; in response to the operation of the sixth control in the second window, obtaining the first memory information based on the recognized text.

[0177] For example, the first interface can be interface 114 as shown in Figure 11(d), the first image can be image 113, and the fifth control can be control 116 in interface 114. After the user clicks the thumbnail of image 113 in interface 112 as shown in Figure 11(c), the electronic device not only displays interface 114, but also performs text recognition on image 113 to obtain the text in image 113, i.e., the recognized text. Referring to Figure 11(d), the recognized text is the content in recognition box 115. After obtaining the recognized text, the user can click control 116. In response to the click operation of control 116, the electronic device will display a seventh interface, such as interface 81 as shown in Figure 11(e). Interface 81 displays a second window, such as window 110, which displays the recognized text "Shop transfer contact person: Ms. Zhang 130XXX". Window 110 may include a sixth control, such as control 117; the user can click control 117, and in response to the click operation of control 117, the electronic device will obtain first memory information based on the recognized text, such as the content of card 118 shown in (f) of Figure 11.

[0178] In some embodiments, S1310 may specifically include: in response to a first user operation on a seventh control in the first interface, obtaining first memory information based on a first image in the first interface, wherein the seventh control is located in a third window of the first interface and the first image is displayed in the third window.

[0179] For example, the first interface can be interface 81 as shown in Figure 12(d), the third window can be window 110 in interface 81 as shown in Figure 12(d), the first image can be the image in window 110, and the seventh control can be control 117 in window 110. The user can click on control 117, and in response to the click on control 117, the electronic device can obtain the first memory information based on the image in window 110. For example, the first memory information can be the content in card 118 as shown in Figure 12(e).

[0180] Optionally, before displaying the first interface in response to the first user action on a thumbnail of the first image in the second interface, the method 1300 may further include:

[0181] In response to an operation on the eighth control in the eighth interface of the smart assistant, a fourth window is displayed on the eighth interface. The fourth window includes a ninth control. The eighth interface displays saved memory information, and the eighth control is used to add new memory information. In response to an operation on the ninth control, a first option and a second option are displayed in the fourth window. The first option is used to select an image from the gallery, and the second option is used to take a photo. In response to an operation on the first option, the sixth interface is displayed.

[0182] For example, the eighth interface can be a memory information management interface or a user interface / page for managing memory information. For instance, the eighth interface can be interface 81 as shown in Figure 11(a), the eighth control can be control 84 in interface 81, and the fourth window can be window 110 as shown in Figure 11(b). The user can click control 84, and in response to the operation on control 84, the electronic device can display window 110. The ninth control can be an "image recognition" control in window 110. The user can click the "image recognition" control, and in response to the operation on the "image recognition" control, the electronic device can display a "gallery selection" option (an example of the first option) and a "take a picture" option (an example of the second option). The user can click the "gallery selection" option, and in response to the click operation on the "gallery selection" option, the electronic device can display interface 112 (an example of the sixth interface), which includes a thumbnail of at least one image in the gallery. The first image can be image 113 displayed in interface 112.

[0183] Based on the above method, memory information can be retrieved from images in the photo library. Alternatively, by clicking the second option, memory information can be retrieved from images taken by the user.

[0184] In some embodiments, the first memory information may include multiple memory information entries. The electronic device can selectively save a portion of the multiple memory information entries or save all of the memory information entries based on user instructions or operations via a smart assistant. This solution supports selective saving of memory information by the user.

[0185] For example, referring to the example shown in Figure 6, the first memory information includes cards 62 and 63. The user can click the "Remember All" control to save cards 62 and 63. Alternatively, the user can click card 62 and then click the "Remember Selected" control; in response to the user's click on the "Remember Selected" control, the electronic device will save card 62. Alternatively, window 61 may include controls such as "Remember First Memory" and / or "Remember Second Memory," and the user, for example, clicking "Remember First Memory" will save card 62.

[0186] It should be understood that although the embodiments of this application only show multiple memory information in the scenario shown in Figure 6, it should be understood that in the scenarios shown in other figures, the first memory information may also include multiple memory information.

[0187] In some embodiments, prior to S1320, the method 1300 may further include: displaying on the smart assistant a memory type that matches the display content of the first interface and attribute items corresponding to the memory type.

[0188] For example, referring to the user interface diagram shown in Figure 14, the interface shown in Figure 14 can be a diagram displayed in response to the user's operation of the control 117 shown in (e) of Figure 11, or the interface shown in Figure 14 can be a diagram displayed in response to the user's operation of the control 117 shown in (d) of Figure 12. Referring to Figure 14, window 110 includes a memory type: card. Among them, the attribute items corresponding to the card include: (1) Name: Ms. Zhang's business card; (2) Subject: Shop transfer; (3) Type: business card; (4) Number: 130XXX. It should be noted that "business card" is a subtype of card. In addition, in some figures, such as Figure 14, Figure 15 or Figure 16, "memory type" can also be described as "identification type", or a similar or analogous description.

[0189] For example, referring to the user interface diagram shown in Figure 15, the interface shown in Figure 15 can be a diagram displayed in response to the user's operation of the control 86 shown in (c) of Figure 8. Referring to Figure 15, window 85 includes a memory type: Important Day. Among them, the attribute items corresponding to Important Day include: (1) Name: Buy books for daughter; (2) Relative: daughter; (3) Type: Other; (4) Date: 12 / 10. It should be noted that "Other" is a subtype of Important Day. For example, Important Day can include one or more of the following subtypes: birthday, anniversary, repayment date, exam date, payday, or others.

[0190] For example, referring to the user interface diagram shown in Figure 16, window 161 may include multiple memory types and corresponding attribute items for each memory type. This information is obtained based on "Son's information: Wang XX; ID card: 420XXX11; Phone: 123XXX12". Memory type 1 and memory type 2 shown in window 161 are the same, both being cards / certificates. It should be understood that whether multiple memory types are the same is determined by the first content; multiple memory types may be the same or different. In the case of multiple memory types being the same, the subtypes of multiple memory types may be the same or different.

[0191] When multiple memory types are displayed, controls for viewing each memory type can also be shown. For example, referring to Figure 16, the user can view all memory types in window 161 by sliding control 163 up and down.

[0192] Optionally, at least some of the attribute items corresponding to the memory type can be edited. For example, see Figure 14, the type and number can be edited. For example, see Figure 15, the type and date can be edited.

[0193] In some embodiments, in response to user operations on memory information, the memory type and the attribute information corresponding to the memory type are displayed.

[0194] For example, regarding card 41 shown in Figure 4, the user can click on card 41. Corresponding to the user's click, the electronic device can display the memory type and the attribute information corresponding to the memory type. Furthermore, the user can also edit some or all of the attribute information.

[0195] In some embodiments, the smart assistant further includes a tenth control, and method 1300 may further include: in response to an operation on the tenth control, displaying a first menu bar, the first menu bar including a plurality of memory type options; in response to an operation on a first memory type option among the plurality of memory type options, displaying on the smart assistant a first memory type that matches the display content of the first interface and at least one attribute item corresponding to the first memory type.

[0196] In other words, electronic devices can display attribute items corresponding to the selected memory type based on the chosen memory type. It should be understood that the retrieved memory information may differ depending on the memory type.

[0197] For example, the tenth control can be control 171 as shown in Figure 17, and the first menu bar can be menu bar 172 as shown in Figure 17. Referring to the example shown in Figure 17, the memory types and corresponding attribute items in each figure shown in Figure 17 are obtained based on "Shop transfer contact person: Ms. Zhang 130XXX". The memory type shown in (a) of Figure 17 can be the default memory type of the electronic device. If the user wants to modify the memory type, they can click control 171. In response to the click operation of control 171, menu bar 172 as shown in (b) of Figure 17 is displayed. Menu bar 172 includes each memory type. For example, if the user clicks "Item", in response to the click operation of "Item", the electronic device displays the attribute corresponding to "Item" as shown in (c) of Figure 17. For example, if the user clicks "Order", in response to the click operation of "Order", the electronic device displays the attribute item corresponding to "Order" as shown in (d) of Figure 17. It can be seen that when the memory type is "Order", the electronic device does not obtain information matching the attribute item, and therefore will not obtain the first memory information.

[0198] In some embodiments, when displaying the memory type and the attribute information corresponding to the memory type, an eleventh control is also displayed; wherein, S1320 specifically involves: displaying first memory information in response to an operation on the eleventh control.

[0199] For example, referring to Figure 14, window 110 may also include control 141, which can be clicked by the user. In response to clicking control 141, the electronic device can display window 110 as shown in Figure 11(f), whereby the memory type and its corresponding attribute information are no longer displayed in window 110, but instead card 118 is displayed, which represents the first memory information. Alternatively, in response to clicking control 141, the electronic device no longer displays window 110, but instead displays card 118 on interface 81.

[0200] For example, referring to Figure 15, window 85 may also include control 151, which can be clicked by the user. In response to clicking control 151, the electronic device can display window 85 as shown in Figure 8(d), whereby the memory type and its corresponding attribute information are no longer displayed in window 85, but instead card 88 is displayed, which represents the first memory information. Alternatively, in response to clicking control 151, the electronic device no longer displays window 85, but instead displays card 88 on interface 81.

[0201] Figure 18 is an exemplary flowchart of an information recording method provided in this application. The steps of method 1800 shown in Figure 18 will be described below.

[0202] S1801, Scan application display interface.

[0203] For example, it can scan the application's display interface based on a preset cycle, or it can scan the display interface when the display interface changes.

[0204] S1802, determine whether the application to which the first interface of the currently scanned application belongs is marked as the target application.

[0205] If the application to which the first interface belongs is marked as the target application, then S1803, S1804, or S1805 can be executed; otherwise, S1801 will continue to be executed.

[0206] In one example, if an electronic device retrieves memory information multiple times based on the application's display interface based on user triggers, the electronic device can use that application as the target application, or the user can mark that application as the target application.

[0207] For example, when an electronic device retrieves memory information based on a user's trigger and the display interface of a certain application, it can also count the number of times memory information has been retrieved based on that application's display interface. This count may or may not include the current retrieval. If the count exceeds a preset number, a pop-up message can prompt the user to mark the application as a target application. Based on this pop-up message, the user can mark the application as a target application.

[0208] S1803, determine whether the first probability Ta exceeds the preset probability.

[0209] Here, the first probability is Ta, which represents the probability that a user saves the first memory information obtained from the first interface based on the target prompt. The target prompt is used to indicate whether memory information has been obtained or whether there is currently memory information awaiting confirmation. Users can save memory information based on the target prompt. For example, the target prompt could be the first prompt information or the first notification mentioned earlier. Ta = Number of times the user saves the first memory information obtained from the first interface based on the target prompt / Number of times the electronic device displays the target prompt.

[0210] For example, assuming the first interface is interface 10 as shown in Figure 1, if the electronic device actively retrieves the first memory information from interface 10 8 times, and the user saves the first memory information according to prompt 12 5 times, then Ta = 5 / 8. It should be understood that the user saving the first memory information according to prompt 12 means that the user clicked prompt 12 or entered a command similar to "remember the screen information".

[0211] If the execution result of S1803 is yes, then S1804 or S1805 can be executed. If the execution result of S1803 is no, then S1801 can be returned or S1804 can be executed.

[0212] S1804, determine whether the time interval since the last (i.e., the most recent) display of the target prompt is greater than the threshold Tt.

[0213] If the result of S1804 is yes, then S1805 can be executed; otherwise, S1801 can be returned.

[0214] S1805, extract information from the first interface to obtain the first content.

[0215] For example, visual analysis, interface framework analysis, and / or interface text recognition can be combined to extract the application page, text, and descriptive image data of the first interface. The content extracted based on the first interface is the first content.

[0216] S1806, determine whether the parsing value corresponding to the first interface is consistent with the parsing value of the application's display interface obtained most recently.

[0217] For example, the parsed value may be calculated based on the first content corresponding to the application's display interface, and the calculation may be a hash value, etc. It should be understood that the first content may be different for different display interfaces of the application.

[0218] In S1806, if it is determined that the parsed value obtained this time is consistent with the most recently obtained parsed value, then the first interface is considered to be a different display interface from the display interface of the application in the previous scan. Then S1807 can be executed, and the parsed value obtained this time can be recorded.

[0219] S1807, Obtain memory information based on the first content.

[0220] For example, the memory type that is compatible with the first application can be determined based on the application page, text and image data with descriptions of the first interface. Then, the corresponding mode is called to generate a Prompt to obtain memory information. The first memory information can be generated by calling LLM through the Prompt.

[0221] S1807 can be followed by S1808 or S1809.

[0222] S1808, determine whether the memory information obtained in S1807 is memory information that has not been saved.

[0223] Compare the information with the currently saved memory information to confirm whether the memory information obtained in S1807 is already saved memory information. If it is, S1801 can be executed; otherwise, S1809 can be executed.

[0224] S1809, determine whether the display interface is still on the first screen.

[0225] That is, determine whether the current display interface is the first interface. If it is, then S1810 can be executed; otherwise, S1811 can be executed. For ease of description, in the following text, when the current display interface is different from the first interface, the current display interface will be referred to as the second interface.

[0226] S1810 wakes up the smart assistant and displays the first prompt message in the smart assistant's dialogue window. That is, it prompts the user to save the remembered information in real time.

[0227] This step can be referred to in the description of the corresponding content above, and will not be repeated here.

[0228] S1812 can be executed after S1810.

[0229] In one example, if S1810 is executed once for a display interface of an application, the number of times the electronic device displays the target prompt can be incremented by 1. It should be understood that when S1810 is executed for the first time for a display interface of an application, the number of times the electronic device displays the target prompt is 1.

[0230] S1811, the first notification is displayed on the second application interface. That is, a non-real-time prompt for the user to save the remembered information.

[0231] This step can be referred to in the description of the corresponding content above, and will not be repeated here.

[0232] S1812 can be executed after S1811.

[0233] S1812, save memory information and / or user preference storage.

[0234] For details regarding the storage of memory information in S1810, S1811, and S1812, please refer to the descriptions of the relevant schemes above; they will not be repeated here.

[0235] As mentioned earlier, users can manually select memory types, and the user preference storage in S1812 is used for users to store their selection preferences for memory types for this application.

[0236] In one example, if S1812 is executed once for a display interface of an application, the number of times the user saves the memory information retrieved from that display interface according to the target prompt can be incremented by 1. It should be understood that when S1812 is executed for the first time for a display interface of an application, the number of times the user saves the memory information retrieved from that display interface according to the target prompt is 1.

[0237] According to the solution provided in this application, when a user is browsing certain applications, the electronic device can proactively acquire memory information, eliminating the need for the user to trigger the memory information acquisition step. Furthermore, by learning the user's habits in receiving memory information, the electronic device can develop a more automatic and intelligent memory information acquisition capability that better meets the user's expectations. Simultaneously, the memory information saving method, which supports both real-time and non-real-time prompts, is compatible with multiple user operation scenarios, ensuring that the recognized memory information is retained even after the user switches screens.

[0238] Figure 19 is a schematic diagram of a system architecture provided in an embodiment of this application. The system architecture 1900 may include one or more modules shown in the figure, and the functions of each module are described below.

[0239] The intelligent voice module 1910: uses voice to acquire the corpus of first memory information, such as "remember the screen information", and sends the corresponding instruction to the memory trigger module 1914.

[0240] Clipboard module 1911: Supports copying text within the display interface.

[0241] Screen touch module 1912: Recognizes the user's touch operations on the interface, such as two-finger pressing, clicking, etc.

[0242] Screen drawing module 1913: Receives drawing instructions and draws lines / circles on the image.

[0243] Memory trigger module 1914: Receives signals / instructions sent by the smart voice module 1910, screen touch module 1912 and screen drawing module 1913, and passively triggers the acquisition of memory information; it can also actively trigger the acquisition of memory information according to the application's display interface.

[0244] Information extraction module 1915: can combine visual analysis, interface framework analysis and / or interface text recognition technologies to extract application pages, text and / or image data with descriptions.

[0245] Memory Platform 1916: After receiving the content sent by the information extraction module 1915, it determines the memory type that matches the received content and calls the corresponding pattern to generate a Prompt for the user to retrieve memory information. The Prompt then calls the LLM to generate the memory information. Furthermore, it can filter the memory information finally returned to the user based on the user's preference for memory type selection.

[0246] For example, the memory platform can be deployed on the electronic device side or on the server side.

[0247] User memory preference recording module 1917: Records the user's preference for the memory type of the application's display interface.

[0248] Memory Source Confirmation Module 1918: When it is detected that the same application has been frequently retrieved multiple times based on user triggers, it can be considered to remind the user to mark this application as a memory source or target application, and supports electronic devices to actively retrieve memory information based on the display interface of the memory source.

[0249] Memory storage module 1919: Used to store acquired memory information.

[0250] The system architecture provided in the embodiments of this application can support the acquisition of memory information according to different scenarios.

[0251] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the system architecture. In other embodiments of this application, the system architecture may include more or fewer modules than illustrated, or combine some modules, or split some modules, or have different module arrangements. The illustrated modules may be implemented in hardware, software, or a combination of software and hardware.

[0252] Figure 20 is a schematic diagram of the structure of an electronic device provided in this application. The electronic device 2000 may include a processor 2010, an external memory interface 2020, an internal memory 2021, an antenna 1, an antenna 2, a mobile communication module 2030, a wireless communication module 2040, and a display screen 2050.

[0253] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 2000. In other embodiments of this application, the electronic device 2000 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0254] The processor 2010 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0255] The wireless communication function of the electronic device 2000 can be achieved through antenna 1, antenna 2, mobile communication module 2030, wireless communication module 2040, etc.

[0256] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. The structures of Antenna 1 and Antenna 2 in Figure 1 are only one example. Each antenna in the electronic device 2000 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization.

[0257] The mobile communication module 2030 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 2000. The mobile communication module 2030 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 2030 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation.

[0258] The wireless communication module 2040 can provide at least one of the following wireless communication solutions for use in the electronic device 2000: wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR). The wireless communication module 2040 can be one or more devices integrating at least one communication processing module. The wireless communication module 2040 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 2010.

[0259] Electronic device 2000 implements display function through display screen 2050. Display screen 2050 is used to display interactive interfaces, etc.

[0260] It should be understood that the electronic device 2000 can implement any of the technical solutions of this application.

[0261] This application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the information recording methods shown in the above embodiments.

[0262] This application also provides a chip, as shown in FIG21, which includes a processor and a memory. The memory stores a computer program, which, when executed by the processor, implements the information recording method shown in the above embodiments.

[0263] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the information recording methods shown in the above embodiments.

[0264] This application also provides a computer program product, which includes a computer program that, when run by a terminal device, enables the terminal device to implement the information recording methods shown in the above embodiments.

[0265] It should be noted that the click operation in this application is merely an example, and the click operation can be replaced by touch, voice, or other operations. The names of pages / controls / windows, etc., provided in the embodiments of this application are also merely examples and do not constitute any limitation on this application.

[0266] It should be understood that the processor mentioned in the embodiments of this application can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0267] It should also be understood that the memory mentioned in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0268] In the embodiments provided in this application, the division of each framework or module is only a logical functional division. In actual implementation, there may be other division methods. For example, multiple frameworks or modules may be combined or integrated into another system, or some features may be ignored or not executed.

[0269] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0270] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0271] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0272] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrases "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0273] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. An information recording method, characterized in that, include: First memory information is obtained, which is extracted based on the content displayed on the first interface, and the first memory information matches a preset memory type, wherein the memory type corresponds to at least one attribute item; The first memory information is displayed in the application.

2. The method as described in claim 1, characterized in that, Before displaying the first memory information on the application, the method further includes: Obtain a first user operation, which is used to instruct the saving of the first memory information, or the first user operation is used to instruct the display content.

3. The method as described in claim 2, characterized in that, The first user operation is used to instruct the saving of the first memory information; Prior to obtaining the first user action, the method further includes: A prompt message is displayed, indicating that there is currently memory information to be saved.

4. The method as described in claim 2, characterized in that, The first user operation is used to instruct the display content, which is one of the following: the interface content of the first interface of the first application, the display content in the first area of ​​the first interface, the first text in the first interface, and the first image in the first interface.

5. The method as described in claim 3, characterized in that, The displayed prompt information includes: If the display interface is not switched from the first interface, the prompt message is displayed in the dialog window of the application, and the dialog window is displayed floating on the first interface; The display of the first memory information in the application includes: In response to the first user action on the dialog window, the first memory information is displayed in the dialog window.

6. The method as described in claim 3, characterized in that, The displayed prompt information includes: If the display interface switches from the first interface to the second interface, the prompt information is displayed on the second interface; The display of the first memory information in the application includes: In response to the first user operation on the prompt information or in response to the first user operation on the application corresponding to the prompt information, the first memory information is displayed on the third interface of the application, the third interface including the memory information to be saved.

7. The method as described in claim 6, characterized in that, The third interface includes a confirmation control corresponding to the first memory information, and the method further includes: In response to an operation on the confirmation control, the first memory information is saved on the application.

8. The method according to any one of claims 2-7, characterized in that, The acquisition of the first memory information includes: Scan the display interface of the first application; The first memory information is obtained based on the first interface currently being scanned, where the first interface is a display interface of the first application.

9. The method as described in claim 8, characterized in that, The first application is the target application, wherein the electronic device is able to acquire memory information based on scanning the display interface of the target application.

10. The method as described in claim 4, characterized in that, The displayed content is the interface content of the first interface of the first application; The acquisition of the first memory information includes: In response to the first user operation on the dialog window of the application, the first memory information is obtained according to the interface content of the first interface, the dialog window is floating on the first interface, and the first interface is a display interface of the first application.

11. The method as described in claim 4, characterized in that, The displayed content is the content in the first area of ​​the first interface; Prior to acquiring the first memory information, the method further includes: In response to the first user action on the first interface, the first area is determined.

12. The method as described in claim 11, characterized in that, Before determining the first region in response to the first user action on the first interface, the method further includes: In response to an operation on the fourth interface, intelligent screen recognition is performed on the fourth interface to obtain the first interface, the first interface including a first control; In response to the operation on the first control, the selection function is activated.

13. The method as described in claim 12, characterized in that, The first interface also includes a second control; The step of obtaining the first memory information includes: In response to an operation on the second control, the application is activated, and the image corresponding to the first area is displayed in the application's dialog box; The first memory information is obtained based on the content of the image.

14. The method as described in claim 4, characterized in that, The displayed content is the first text; Prior to acquiring the first memory information, the method further includes: In response to the first user action on the first interface, the first text is copied.

15. The method as described in claim 14, characterized in that, The step of obtaining the first memory information includes: In response to an operation on a third control in the fifth interface of the application, a first window is displayed on the fifth interface, the first window including a fourth control, the fifth interface displays saved memory information, and the third control is used to add new memory information; In response to an operation on the fourth control, the first text is displayed in the first window; Extract the first text from the first window to obtain the first memory information.

16. The method as described in claim 14, characterized in that, The displayed content is the first image; Prior to acquiring the first memory information, the method further includes: In response to a first user action on a thumbnail of the first image in a sixth interface, the first interface, including the first image, is displayed.

17. The method as described in claim 16, characterized in that, The acquisition of the first memory information includes: Perform text recognition on the first image to obtain the recognized text; In response to an operation on the fifth control in the first interface, the seventh interface of the application is displayed, and a second window is displayed on the seventh interface of the application, the second window including the identified text; In response to an operation on the sixth control in the second window, the first memory information is obtained based on the recognized text.

18. The method as described in claim 16, characterized in that, The step of obtaining the first memory information includes: In response to the first user operation on the seventh control in the first interface, the first memory information is obtained based on the first image, wherein the seventh control is located in the third window of the first interface and the first image is displayed in the third window.

19. The method according to any one of claims 16-18, characterized in that, Prior to the first user action in response to a thumbnail of the first image in the second interface, the method further includes: In response to an operation on an eighth control in the eighth interface of the application, a fourth window is displayed on the eighth interface, the fourth window including a ninth control, the eighth interface displaying saved memory information, and the eighth control being used to add new memory information; In response to an operation on the ninth control, a first option and a second option are displayed in the fourth window, the first option being used to select an image from the gallery, and the second option being used to take a photo; In response to an action on the first option, the sixth interface is displayed, the sixth interface including a thumbnail of at least one image from the gallery.

20. The method according to any one of claims 1-19, characterized in that, Prior to displaying the first memory information on the application, the method further includes: The application displays a memory type that matches the content displayed on the first interface and at least one attribute item corresponding to the memory type.

21. The method as described in claim 20, characterized in that, Some or all of the at least one attribute item is editable.

22. The method as described in claim 20 or 21, characterized in that, The application includes a tenth control, and the method further includes: In response to an operation on the tenth control, a first menu bar is displayed, the first menu bar including multiple memory type options; In response to an operation on the first memory type option among the plurality of memory type options, the first memory type and at least one attribute item corresponding to the first memory type are displayed on the application, matching the display content of the first interface.

23. An electronic device, characterized in that, The electronic device includes: one or more processors and memory; The memory is coupled to the one or more processors; The memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-22.

24. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the processors being used to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-22.

25. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 1-22.

Images