Information recording method and electronic device

Abstract

The present application relates to the technical field of terminals. Provided are an information recording method and an electronic device. The method comprises: acquiring first memory information, wherein the first memory information is information extracted on the basis of display content of a first interface and matching a preset memory type, and the memory type corresponds to at least one attribute item; and displaying the first memory information on an intelligent assistant. According to the solution, users do not need to memorize large amounts of information themselves, and desired information can be acquired by means of the intelligent assistant at any time according to requirements, thereby reducing the operation complexity of information acquisition and improving the user experience.

Description

Information recording method and electronic device

[0001] The present application claims priority to the Chinese Patent Application No. 202410808527.0, filed on June 20, 2024, entitled "Method for Obtaining Memory Information and Electronic Device", and to the Chinese Patent Application No. 202411163290.1, filed on August 22, 2024, entitled "Information Recording Method and Electronic Device", both of which are incorporated herein by reference in their entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminals, and more particularly, to an information recording method and an electronic device. BACKGROUND

[0003] With the increasing number of function categories of terminal applications, the information carried by the applications is also increasingly rich, such as train ticket information, hotel order information, movie ticket order information, and related card information, etc. These information is often used in other scenarios or other applications. In order to use these information again, the user needs to record these information in advance, which is a great burden for the user, and often the information recorded is incomplete. Alternatively, the user can search in the application where the information comes from when using the information again. However, this operation is very inconvenient, and sometimes the information to be used cannot be found. SUMMARY

[0004] In view of the above technical problems, the present application provides an information recording method and an electronic device, which can reduce the operation complexity of the user to reuse the information in the terminal application, and improve the user experience.

[0005] In a first aspect, an information recording method is provided. The method can be executed by an electronic device, or by a component (e.g., a processor, a chip, or a chip system, etc.) of the electronic device, or by a logic module or software that can realize all or part of the functions of the electronic device.

[0006] The method includes: obtaining first memory information, the first memory information being extracted according to display content of a first interface, and the first memory information matching a preset memory type, the memory type corresponding to at least one attribute item; and displaying the first memory information on a smart assistant.

[0007] According to the information recording method provided in the present application, the electronic device can record information based on the content displayed by the terminal and obtain the memorized information through the intelligent assistant. The method does not require the user to record a large amount of information by himself, and the user can obtain the required information through the intelligent assistant at any time according to the needs, thereby reducing the operation complexity of repeatedly using the information in the terminal application and improving the user experience.

[0008] In a possible implementation, before displaying the first memorized information on the intelligent assistant, the method further includes: obtaining a first user operation, the first user operation being used to indicate saving the first memorized information, or the first user operation being used to indicate the display content.

[0009] Based on the scheme, the electronic device can save the first memorized information based on the first user operation. Alternatively, the electronic device can determine the display content based on the first user operation and obtain the first memorized information according to the display content.

[0010] In a possible implementation, the first user operation is used to indicate saving the first memorized information; and before obtaining the first user operation, the method further includes: displaying prompt information, the prompt information being used to indicate that there is memorized information to be saved at present.

[0011] Based on the scheme, the electronic device can display the prompt information after obtaining the first memorized information, and the user can perform the first user operation based on the prompt information. The electronic device can save the first memorized information based on the first user operation. The method can actively obtain the first memorized information without the triggering of the user.

[0012] In a possible implementation, the first user operation is used to indicate the display content, and the display content is one of the following: interface content of the first interface of the first application, display content in a first region of the first interface, a first text in the first interface, and a first picture in the first interface.

[0013] In a possible implementation, the display prompt information includes: if the display interface is not cut out from the first interface, displaying the prompt information in a conversation window of the intelligent assistant, the conversation window being displayed on the first interface in a suspended manner; and the display of the first memorized information on the intelligent assistant includes: in response to the first user operation on the conversation window, displaying the first memorized information in the conversation window.

[0014] For example, the first user operation can be a voice or text instruction input by the user in the conversation window, or can be a click operation on the prompt information.

[0015] The scheme can support a user to obtain memory information in a voice interaction scenario or a non-voice interaction scenario, and support guiding the user to save the memory information through a prompt information in a scenario where the user does not switch a display interface.

[0016] In a possible implementation, the display prompt information comprises: if the display interface is switched from the first interface to a second interface, displaying the prompt information on the second interface; and the display of the first memory information on the intelligent assistant comprises: in response to the first user operation on the prompt information or in response to the first user operation on an application corresponding to the prompt information, displaying the first memory information on a third interface of the intelligent assistant, the third interface comprising memory information to be saved.

[0017] For example, the prompt information can be a push notification.

[0018] The scheme supports guiding the user to save the memory information through a push prompt information in a scenario where the user has switched a display interface. In this way, the user can realize that the electronic device has performed the operation of obtaining the memory information in real time, and can save the obtained memory information at any time according to needs.

[0019] In a possible implementation, the third interface comprises a confirmation control corresponding to the first memory information, and the method further comprises: in response to an operation on the confirmation control, saving the first memory information on the intelligent assistant.

[0020] In a possible implementation, the obtaining of the first memory information comprises: scanning a display interface of the first application; and obtaining the first memory information according to the first interface currently scanned, the first interface being one display interface of the first application.

[0021] In a possible implementation, the first application is a target application, and the electronic device can obtain the memory information based on the scanning of a display interface of the target application.

[0022] In a possible implementation, the display content is interface content of the first interface of the first application; and the obtaining of the first memory information comprises: in response to the first user operation on a dialog window of the intelligent assistant, obtaining the first memory information according to the interface content of the first interface, the dialog window being displayed on the first interface, the first interface being one display interface of the first application.

[0023] Based on the scheme, the user can obtain the memory information through the intelligent assistant when there is a memory requirement.

[0024] In a possible implementation, the display content is content in a first region of the first interface; and before the first memory information is acquired, the method further includes: in response to the first user operation of the user on the first interface, determining the first region.

[0025] In a possible implementation, before the first region is determined in response to the first user operation of the user on the first interface, the method further includes: in response to an operation on a fourth interface, performing intelligent screen recognition on the fourth interface to obtain the first interface, the first interface including a first control; and in response to an operation on the first control, starting a circle selection function.

[0026] Based on the scheme, the user can indicate the display content by means of circle selection or line drawing, and the electronic device can acquire memory information according to the display content indicated by the user.

[0027] In a possible implementation, the first interface further includes a second control; and the first memory information is acquired by: in response to an operation on the second control, waking up the intelligent assistant, and displaying an image corresponding to the first region in a dialog box of the intelligent assistant; and acquiring the first memory information according to content in the image.

[0028] In a possible implementation, the display content is the first text; and before the first memory information is acquired, the method further includes: in response to the first user operation of the user on the first interface, copying the first text.

[0029] Based on the scheme, the electronic device can acquire memory information according to the copied text.

[0030] In a possible implementation, the first memory information is acquired by: in response to an operation on a third control in a fifth interface of the intelligent assistant, displaying a first window on the fifth interface, the first window including a fourth control, the fifth interface displaying saved memory information, and the third control being used to add memory information; in response to an operation on the fourth control, displaying the first text in the first window; and extracting the first text from the first window to obtain the first memory information.

[0031] The scheme can support the user to acquire memory information when the user has a memory requirement, by setting an entry for the user to add memory information.

[0032] In a possible implementation, the display content is the first picture; and before the first memory information is acquired, the method further includes: in response to the first user operation on a thumbnail of the first picture in a sixth interface, displaying the first interface, the first interface including the first picture.

[0033] Based on the scheme, the electronic device can obtain memory information according to the picture.

[0034] In a possible implementation, the obtaining the first memory information includes: performing text recognition on the first picture to obtain recognized text; in response to an operation on a fifth control in the first interface, displaying a seventh interface of the intelligent assistant, the seventh interface of the intelligent assistant displaying a second window, the second window including the recognized text; and in response to an operation on a sixth control in the second window, obtaining the first memory information according to the recognized text.

[0035] In a possible implementation, the obtaining the first memory information includes: in response to the first user operation on a seventh control in the first interface, obtaining the first memory information according to the first picture, the seventh control being located in a third window of the first interface, and the first picture being displayed in the third window.

[0036] In a possible implementation, before the response to the first user operation on the thumbnail of the first picture in the second interface, the method further includes: in response to an operation on an eighth control in an eighth interface of the intelligent assistant, displaying a fourth window on the eighth interface, the fourth window including a ninth control, the eighth interface displaying saved memory information, and the eighth control being used to add memory information; in response to an operation on the ninth control, displaying a first option and a second option in the fourth window, the first option being used to select a picture in a gallery, and the second option being used to take a picture; and in response to an operation on the first option, displaying the sixth interface, the sixth interface including thumbnails of at least one picture in the gallery.

[0037] In a possible implementation, before the displaying the first memory information on the intelligent assistant, the method further includes: displaying, on the intelligent assistant, a memory type matched with the display content of the first interface and at least one attribute item corresponding to the memory type.

[0038] In a possible implementation, part or all of the at least one attribute item is editable.

[0039] Based on the scheme, the user can edit the attribute item according to the requirement.

[0040] In a possible implementation, the intelligent assistant includes a tenth control, and the method further includes: in response to an operation on the tenth control, displaying a first menu bar, the first menu bar including a plurality of memory type options; and in response to an operation on a first memory type option in the plurality of memory type options, displaying, on the intelligent assistant, the first memory type matched with the display content of the first interface and at least one attribute item corresponding to the first memory type.

[0041] Based on the scheme, the user can select the memory type according to the demand option to obtain the required memory information.

[0042] In a second aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors and a memory; the memory is coupled with the one or more processors; the memory is configured to store computer program codes, the computer program codes comprising computer instructions, and the one or more processors are configured to invoke the computer instructions to enable the electronic device to perform the method shown in the first aspect.

[0043] In a third aspect, an embodiment of the present application provides a chip, which is applied to an electronic device, and the chip comprises one or more processors, and the processor is configured to invoke computer instructions to enable the electronic device to perform the method shown in the first aspect.

[0044] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the method shown in the first aspect.

[0045] In a fifth aspect, an embodiment of the present application provides a computer program product, which comprises a computer program, and when the computer program is run by an electronic device, the electronic device is enabled to implement the method shown in the first aspect.

[0046] It can be understood that the beneficial effects of the second aspect to the fifth aspect can be referred to the related description in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0047] FIGS. 1 to 12 are user interface diagrams of obtaining memory information according to an embodiment of the present application.

[0048] FIG. 13 is an exemplary flowchart of an information recording method according to an embodiment of the present application;

[0049] FIGS. 14 to 17 are interface diagrams of displaying memory types and corresponding attribute items according to an embodiment of the present application.

[0050] FIG. 18 is an exemplary flowchart of an information recording method according to an embodiment of the present application;

[0051] FIG. 19 is a schematic diagram of a system architecture according to an embodiment of the present application.

[0052] FIG. 20 is a schematic diagram of an electronic device according to an embodiment of the present application.

[0053] FIG. 21 is a schematic diagram of a chip according to an embodiment of the present application. DETAILED DESCRIPTION

[0054] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

[0055] The present application relates to an electronic device provided with a display screen. For example, the electronic device can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an artificial intelligence (AI) device, a wearable device, an in-vehicle device (such as a car machine), a smart home device, or a smart city device, etc. The embodiments of the present application do not specially limit the specific type of the electronic device.

[0056] In one technology, a user can save screen information in the form of a picture by the method of taking a screenshot, such as train ticket information, hotel order information, movie ticket order information, and related card information, etc. However, this method cannot help the user to understand and remember the content of the picture. Moreover, when the user needs to find information, the user needs to manually browse the picture and find the information the user needs from a large number of pictures, which is a relatively cumbersome process.

[0057] To solve the problem that it is inconvenient for a user to obtain and find information, the present application provides an information recording method. An electronic device can actively or based on a user's trigger obtain information suitable for memorizing in a picture, text, and application interface, etc., and display and save the obtained memorized information on a smart assistant, thereby reducing the operation complexity of information obtaining and improving user experience.

[0058] In the present application, the smart assistant can also be referred to as a voice assistant, a wisdom assistant, an artificial intelligence (AI) assistant, a wisdom voice, a digital assistant, a virtual assistant, etc. It can be understood as an information processing system that can recognize natural language input in the form of voice and / or text to infer user intent, and perform corresponding actions based on the inferred user intent. Moreover, the system can respond to the user's input through audible (such as voice), visual (such as text, card), etc. output form.

[0059] In the embodiments of the present application, the memorized information can be displayed and saved on the smart assistant in the form of a card. It should be understood that the present application does not limit the form of display and saving of the memorized information. For example, the memorized information can also be displayed and saved on the smart assistant in the form of text or a picture.

[0060] For example, the memory information can be address information, card information, or order information, etc. For example, the order information can be train ticket order information, movie ticket order information, hotel order information, scenic spot ticket order information, etc. The card information can be ID card information, passport information, business card information, etc. It should be understood that the application does not limit the specific information of the memory information.

[0061] The following will be described in combination with the drawings, taking the intelligent assistant "Xiao Yi" as an example, to illustrate the interaction between the user and the electronic device involved in obtaining memory information in different scenarios. It should be understood that "Xiao Yi" is an application (APP), which is only a specific example of an intelligent assistant, and the intelligent assistant can also be other APPs or mini programs, etc.

[0062] Scenario one: obtaining memory information according to the display interface of the application.

[0063] Fig. 1 is a user interface schematic diagram of actively obtaining memory information provided by an embodiment of the application. Referring to (a) in Fig. 1, interface 10 is a train ticket order information interface, and interface 10 is the current display interface of an application of the electronic device. The electronic device actively obtains the memory information in interface 10, and if the user has not switched the display interface all the time, the electronic device wakes up (or pulls up or calls) Xiao Yi after obtaining the memory information. Referring to (b) in Fig. 1, after Xiao Yi is woken up, its window 11 is displayed floating on interface 10. The window 11 displays prompt information 12, which is used to prompt the user that the electronic device has obtained the memory information. If the user wants to save the memory information obtained from interface 10, in one way, the user can input the same or basically the same instruction as the prompt information through voice or text in window 11. For example, the user can issue the voice instruction "remember the screen information", "help me remember the screen information", "record the screen information", or "remember the train ticket information on the picture", etc. according to prompt information 12. In another way, the user can click prompt information 12, and in response to the operation of the user clicking prompt information 12, the electronic device simulates the user to issue the "remember the screen information" instruction. Referring to (c) in Fig. 1, the user inputs the "remember the screen information" instruction through voice or text or clicks prompt information 12, the electronic device executes the "remember the screen information" instruction, and displays the execution result, that is, displays "OK, I have helped you remember" and card 13, and the content in card 13 is the memory information obtained according to the display content on interface 10. For example, the electronic device can also voice broadcast "OK, I have helped you remember" and / or the content in card 13. It should be noted that similar to this, for any one of the following figures or embodiments described below, the content in the dialog box displayed in Xiao Yi and / or the content in the card can also be voice broadcasted, which will not be described hereinafter.

[0064] In one example, the card 13 can also be (d) in FIG. 1. Referring to (d) in FIG. 1, the card 13 can further include a picture 14, which is a partial screenshot of the interface 10, indicating that the time and location information in the card 13 is derived from the interface 10.

[0065] FIG. 2 is another user interface diagram for actively obtaining memory information according to an embodiment of the present application. Referring to (a) in FIG. 2, the interface 20 is a movie ticket order information interface, which is the current display interface of the electronic device. The electronic device actively obtains memory information in the interface 20, and if the user has not switched the interface, the electronic device wakes up the Xia Yi after obtaining the memory information. Referring to (b) in FIG. 2, after the Xia Yi is woken up, a window 21 of the Xia Yi is displayed on the interface 20. The window 21 can display a prompt information 22, which is the same as the prompt information 12 in FIG. 1. For example, the user clicks the prompt information 22, and in response to the operation of the user clicking the prompt information 22, the electronic device simulates the user to issue and execute the instruction of "remember the screen information", and displays "OK, remember it for you" and a card 23. The content in the card 23 is the memory information obtained according to the display content on the interface 20.

[0066] In one example, the card 23 can also be (d) in FIG. 2. Referring to (d) in FIG. 2, the card 23 can further include a picture 24, which is a movie ticket taking QR code in the interface 20.

[0067] FIG. 3 is another user interface diagram for actively obtaining memory information according to an embodiment of the present application. Referring to (a) in FIG. 3, the interface 30 is the current display interface of the electronic device. The electronic device actively obtains memory information in the interface 30. If the user switches the interface of the electronic device from the interface 30 to an interface 31 shown in (b) in FIG. 3 before the electronic device obtains the memory information on the interface 30, referring to (c) in FIG. 3, the electronic device displays a notification 32 on the interface 31, which is used to prompt the user that there is memory information to be confirmed. Referring to (d) in FIG. 3, the user clicks the notification 32 or enters an interface 33 through a related path of an application corresponding to the notification 32. The interface 33 is a to-be-confirmed memory information interface. The interface 33 includes a card 34 of to-be-confirmed memory information, and a control 35 and a control 36 for the user to save and delete the to-be-confirmed memory information. For example, the user clicks the control 35, and in response to the operation of the user clicking the control 35, the electronic device saves the card 34. Alternatively, the user clicks the control 36, and in response to the operation of the user clicking the control 36, the electronic device deletes the card 34. It should be understood that the interface 30 is the same as the interface 10 shown in FIG. 1, and the card 34 is the same as the card 13 shown in FIG. 1.

[0068] It should be noted that the interface 33 can include one or more pieces of memory information to be confirmed. For example, after the electronic device displays the notification 32, the user does not enter the interface 33, but browses the interface 20 shown in FIG. 2. Moreover, the electronic device obtains the memory information in the interface 20, and before the electronic device obtains the memory information, the user switches the interface of the electronic device from the interface 20 to another interface, such as the interface 31 shown in (b) of FIG. 3. Then, there are two pieces of memory information to be confirmed, and the interface 33 includes the card 23 to be confirmed (as shown in (c) of FIG. 2 or (d) of FIG. 2) and the card 34 to be confirmed. Similarly, the user can save or delete the card 23 through the “save” control and the “delete” control corresponding to the card 23.

[0069] FIG. 4 is a schematic diagram of a memory information management interface provided in an embodiment of the present application. Referring to FIG. 4, the interface 40 is a memory information management interface, and the interface 40 can include at least one card, and the content in the at least one card is memory information obtained by the electronic device. For example, the at least one card is the card 41 and the card 42. The card 41 can be the card 13 shown in FIG. 1. In the example shown in FIG. 1, the interface 40 can save the card 13 when the electronic device displays the card 13 in the window 11. Alternatively, the card 41 can be the card 34 shown in FIG. 3. In the example shown in FIG. 3, the interface 40 can save the card 34 after the user clicks the control 35. The card 42 can be the card 23 shown in FIG. 2. In the example shown in FIG. 2, the interface 40 can save the card 23 when the electronic device displays the card 23 in the window 21.

[0070] The “important date”, “common address” and “card” shown in FIG. 4 are memory type tags. In an example, the user can view memory information belonging to different memory types by sliding the memory type tags left and right. In an example, the card 41 and the card 42 can be memory information of the memory type of important date, and it should be understood that the card 41 and the card 42 can also be memory information of other memory types (such as order). The memory type will be described in detail below, and will not be described here.

[0071] It should be understood that only the case that the interface 40 currently stores the card 41 and the card 42 is described in FIG. 4, and it should be understood that if the electronic device also saves other memory information, the interface 40 will also save the other memory information, and the user can view all the cards by sliding the screen up and down.

[0072] In an example, the interface 40 and the interface 33 shown in (d) of FIG. 3 belong to different pages in the small art, and the two can be switched to each other.

[0073] FIG. 5 is a user interface diagram of an embodiment of the present application, which shows the electronic device obtaining the memory information according to the display content of the display interface of the application based on the trigger of the user (i.e. passive). Referring to (a) of FIG. 5, the interface 50 is a movie ticket order information interface, and the interface 50 is the current display interface of the electronic device. When the user wants to obtain the memory information in the interface 50, the user can wake up the Xiao Yi. For example, the user can wake up the Xiao Yi by inputting "Xiao Yi, Xiao Yi, remember the screen information" by voice. Referring to (b) of FIG. 5, after the Xiao Yi is woken up by the user, the window 51 of the Xiao Yi is displayed on the interface 50. After the Xiao Yi obtains the memory information in the interface 50 according to the instruction of the user "remember the screen information", the Xiao Yi displays "OK, I have helped you to remember" and the card 52, and the content in the card 52 is the memory information obtained according to the display content of the interface 50. It should be understood that the interface 50 is the same as the interface 20 shown in FIG. 2, and the card 52 is the same as the card 23 shown in FIG. 2.

[0074] In one example, the card 42 shown in FIG. 4 can be the card 52. When the electronic device displays the card 52 in the window 51, the interface 40 shown in FIG. 4 can save the card 52.

[0075] FIG. 6 is a user interface diagram of another embodiment of the present application, which shows the electronic device obtaining the memory information according to the display content of the display interface of the application based on the trigger of the user. Referring to (a) of FIG. 6, the interface 60 is a chat interface, and the interface 60 is the current display interface of the electronic device. When the user wants to obtain the memory information in the interface 60, the user can wake up the Xiao Yi. For example, the user can wake up the Xiao Yi by inputting "Xiao Yi, Xiao Yi, remember the screen information" by voice. Referring to (b) of FIG. 6, after the Xiao Yi is woken up, the window 61 of the Xiao Yi is displayed on the interface 60. After the Xiao Yi obtains the memory information in the interface 60 according to the instruction of the user "remember the screen information", the Xiao Yi displays "OK, I have helped you to remember", the card 62 and the card 63, and the content in the card 62 and the card 63 is the memory information obtained by the electronic device in the interface 60.

[0076] In one example, the card 62 and the card 63 can also be saved on the interface 40 shown in FIG. 4.

[0077] As another example, if the electronic device obtains multiple memory information, the electronic device can also support the user to selectively save the memory information.

[0078] For example, referring to (b) of FIG. 6, Xiaoyi can ask the user "Recognize that there are multiple pieces of memory information, which do you want to remember?", and display a "remember all" control and a "remember selected" control. If the user wants to save all the memory information, the user can click the "remember all" control. Referring to (c) of FIG. 6, in response to the user's operation of clicking the "remember all" control, the electronic device can display "OK, all saved" and display the card 62 and the card 63 again, indicating that the card 62 and the card 63 have been saved. Further, at this time, the card 62 and the card 63 can be displayed on the interface 40 shown in FIG. 4. If the user only wants to save one piece of memory information, the user can click the memory information that the user wants to save, such as clicking the card 62, and then clicking the "remember selected" control. In response to the user's operation of clicking the "remember selected" control, the electronic device can display "OK, selected saved" and display the card 62 again, indicating that the card 62 has been saved. Further, at this time, the card 62 can be displayed on the interface 40 shown in FIG. 4. In addition, the user can also instruct the electronic device to save the card 62 and / or the card 63 through voice or text. For example, the user inputs "remember all" by voice, and the electronic device saves the card 62 and the card 63. For example, the user inputs "remember the first piece of memory information" by voice, and the electronic device saves the card 62.

[0079] In some embodiments, if Xiaoyi is only woken up in the current display interface without being commanded to obtain the memory information of the current display interface, Xiaoyi can also automatically obtain the memory information in the current display interface, and display a prompt information on the Xiaoyi window after obtaining the memory information, prompting the user that the electronic device has obtained the memory information. For example, the prompt information can be the prompt information 12 in FIG. 1. After that, the interaction between the user and the electronic device can be performed according to the description of FIG. 1 or FIG. 2.

[0080] Scenario two: obtaining memory information according to circled images.

[0081] FIG. 7 is a user interface diagram provided by the present application for obtaining memory information according to the user's circled operation. Referring to (a) of FIG. 7, the interface 70 is the current display interface of the electronic device, and the interface 70 can be a picture in a photo gallery or an application interface. The user can enter the intelligent screen recognition by double-finger pressing the screen or other triggering methods. By intelligent screen recognition on the interface 70, the interface 70 becomes the interface 71 shown in (b) of FIG. 7. Referring to (b) of FIG. 7, the user clicks the "picture circled" control 72, and then circles the content on the screen. For example, referring to (c) of FIG. 7, according to the user's circled operation, the electronic device draws a corresponding line 73, and the area surrounded by the line 73 is the circled area. According to the content in the circled area, the electronic device can obtain the memory information.

[0082] For example, in one example, the user clicks the "memory generation" control 74, and in response to the user's operation of clicking the control 74, the electronic device wakes up Xiaoyi. Referring to (d) in FIG. 7, after the electronic device wakes up Xiaoyi, a window 75 of Xiaoyi is displayed, such as the window 75 can be displayed on the interface 71. A dialog box 76 of the user is displayed in the window 75, and the electronic device simulates the user to issue an instruction "remember the content in the picture". The picture 77 in the dialog box 76 is the image corresponding to the circled area in the interface 71. The electronic device executes the "remember the content in the picture" instruction, obtains the memory information according to the picture 77, and then displays the execution result "OK, I have helped you to remember" and a card 78. The content in the card 78 is the memory information obtained according to the picture 77.

[0083] In another example, the user clicks the "memory generation" control 74, and in response to the user's operation of clicking the control 74, the electronic device can obtain the memory information according to the content in the circled area. After obtaining the memory information, the electronic device can prompt the user that there is currently memory information to be confirmed in the interface 71, such as by pushing a notification to prompt the user. The user can save the memory information according to the prompt. For example, the notification is similar to the notification 32 shown in (c) of FIG. 3, and the user can save the memory information in an interface similar to (d) of FIG. 3.

[0084] Scenario three: obtaining memory information according to text.

[0085] FIG. 8 is an interface for adding memory information according to text provided by the present application. Referring to (b) in FIG. 8, the interface 81 adds a control 84 for adding memory information on the basis of the interface 40 shown in FIG. 4. The card 82 and the card 83 in the interface 81 can be the card 41 and the card 42 in the interface 41 respectively.

[0086] Referring to (a) in FIG. 8, the user copies the information "I will buy a book for my daughter tomorrow" in the interface 80 to the clipboard. Referring to (b) in FIG. 8, the user enters the interface 81 and clicks the control 84 in the interface 81. In response to the user's operation of clicking the control 84, referring to (c) in FIG. 8, a window 85 is displayed in the interface 81. The window 85 is a smart extraction memory window. The user can trigger the electronic device to automatically paste the text "I will buy a book for my daughter tomorrow" copied by the user to the clipboard by clicking the control 86 in the window 85.

[0087] In one example, the operation of the user clicking the control 86 can also trigger the electronic device to acquire the memory information according to "buy a book for daughter tomorrow". For example, in response to the operation of the user clicking the control 86, see (d) in FIG. 8, the dialog box 87 and the card 88 are presented in the window 85. The content in the dialog box 87 is the text "buy a book for daughter tomorrow" copied by the user to the clipboard, and the card 88 is the memory information acquired according to the text "buy a book for daughter tomorrow". If the user wants to save the memory information, the user clicks the control 89 in the window 85. In response to the operation of the user clicking the control 89, the electronic device saves the card 88. For example, in response to the operation of the user clicking the control 89, the window 85 is no longer displayed, and the interface 80 becomes the interface 100 shown in FIG. 10, that is, the electronic device saves the card 88 in the memory information management interface. Optionally, the interface 100 can also include the prompt box 101, and the information "new memory information created successfully" in the prompt box 101 is used to remind the user that the memory information is successfully added.

[0088] In another example, after the electronic device automatically pastes the text "buy a book for daughter tomorrow", the memory information can be acquired according to "buy a book for daughter tomorrow" based on the trigger of the user. For example, in response to the operation of the user clicking the control 86 in the window 85, see (a) in FIG. 9, the dialog box 87 and the control 90 for identifying the content are presented in the window 85. After the user clicks the control 90 for identifying the content, the electronic device acquires the memory information based on the content in the dialog box 87, and displays the prompt information 91 as shown in (b) in FIG. 9. In one design, after the electronic device acquires the memory information, the prompt information 91 is no longer displayed, and the card 88 is displayed in the window 85. That is, after the electronic device acquires the memory information, the content displayed in the window 85 is as shown in (d) in FIG. 8. As in the previous example, if the user wants to save the memory information, the user clicks the control 89, and in response to the operation of the user clicking the control 89, the electronic device saves the card 88. In another design, after the electronic device acquires the memory information, the window 85 is no longer displayed, and the interface 100 shown in FIG. 10 is displayed.

[0089] Scenario Four: Acquiring Memory Information According to a Picture

[0090] Fig. 11 is a schematic diagram of an interface for adding memory information through text in a picture according to the present application. Referring to (a) of Fig. 11, the interface 81 is as described above with reference to (b) of Fig. 8. The user clicks the control 84, and in response to the user's operation of clicking the control 84, a window 110 is displayed in the interface 81, as shown in (b) of Fig. 11. The window 110 is a smart extraction memory window. In addition to the window 85 shown in (c) of Fig. 8, the window 110 further includes a "voice recognition" control and a "picture recognition" control. After the user clicks the "picture recognition" control, an option box 111 is displayed in the window 110. The option box 111 includes two options, i.e., a "gallery selection" option and a "take a photo" option. Through the "gallery selection" option, the user can select a picture from the gallery; through the "take a photo" option, the user can take a picture. For example, the user clicks the "gallery selection" option, and the electronic device presents an interface 112 shown in (c) of Fig. 11. The user can select a picture 113 from the interface 112 for memory information acquisition. For example, after the user selects the picture 113 in the interface 112, the electronic device displays an interface 114 shown in (d) of Fig. 11, and the electronic device identifies the picture in the interface 114 to obtain information in the picture, i.e., the content in a recognition box 115. In response to the user's operation of clicking a control 116 in the interface 114, the electronic device obtains the information in the picture shown in (d) of Fig. 11, i.e., "store transfer contact: Ms. Zhang 130XXX". The window 110 further includes a control 117. The user can click the control 117, and in response to the user's operation of clicking the control 117, the electronic device obtains memory information according to "store transfer contact: Ms. Zhang 130XXX" to obtain a card 118 shown in (f) of Fig. 11.

[0091] Fig. 12 is a schematic diagram of an interface for adding memory information through a picture according to the present application. (a) of Fig. 12 to (c) of Fig. 12 are the same as (a) of Fig. 11 to (c) of Fig. 11, and reference can be made to the related description of Fig. 11 above. After the user selects the picture 113 in the interface 112, the interface jumps to the interface 81, and the window 110 in the interface 81 displays the picture 113. In response to the user's operation of clicking the control 117 in the window 110, the electronic device obtains memory information according to the picture 113 to obtain the card 118 shown in (e) of Fig. 12.

[0092] It can be seen that, unlike the example shown in Fig. 11, in the example shown in Fig. 12, after the user clicks the thumbnail of the picture 113, the electronic device does not display the interface 114 shown in (d) of Fig. 11, nor does it identify the picture 113. Instead, the electronic device directly displays the picture 113 in the window 110, and obtains memory information according to the picture 113.

[0093] It should be understood that various operations described in embodiments of the present application, such as clicking or swiping, are merely examples of possible operations for achieving corresponding functions, and should not be construed as any limitation of the present application. The names, patterns, positions, and the like of the controls in the user interface diagrams shown in embodiments of the present application, and the arrangement of various contents in the user interface diagrams, are all examples, and should not be construed as any limitation of the present application.

[0094] The information recording method provided by the present application will be described below in combination with the user interface described above.

[0095] FIG. 13 is an exemplary flowchart of an information recording method provided by the present application. The method 1300 can be applied to the electronic device described above, for example, the method can be executed by an agent in the electronic device. The method 1300 can include S1310 and S1320. The steps of the method 1300 will be described below.

[0096] S1310, obtaining first memory information.

[0097] The first memory information is information extracted from the display content of the first interface and matching a preset memory type, and the memory type corresponds to at least one attribute item. For example, the display content of the first interface can be all content of the first interface, or can be part of the content in the first interface, such as text or pictures in the first interface, and the like.

[0098] In embodiments of the present application, at least one memory type (also referred to as a category or a memory category or an identification type, etc.) can be preset. For example, the memory type can be an important day, an address, a card, an order, or a matter (or event), and the like.

[0099] One memory type can include at least one attribute item. For example, the attribute items of an important day can include: name, relationship person, time, and the like. The attribute items of a matter can include: time, place, name, subject, and the like.

[0100] For example, some memory types can also be divided into multiple subtypes, and the attribute items corresponding to the memory types can be different when the subtypes are different. For example, an important day can include one or more of the following subtypes: birthday, anniversary, repayment day, exam day, and pay day. For example, an order can include one or more of the following subtypes: train ticket order, airplane ticket order, or movie ticket order. For example, a card can include one or more of the following subtypes: business card, identity card, or driver's license.

[0101] For example, the attribute items of the memory type of the sub-type of the train ticket can include train number, starting station, terminal station, time, ticket gate, seat number, etc. For example, referring to the card 13 shown in FIG. 1, the content in the card 13 is a piece of memory information, and the memory type corresponding to the memory information is an order, and the sub-type is a train ticket.

[0102] For example, the attribute items of the memory type of the sub-type of the driving license can include name, number, and validity period, etc.

[0103] For example, the first interface is an application interface related to a map, and the corresponding memory type can be an event or an address, and the first memory information can include one or more of the following: time, address, name, card number, or event, etc. The event can be, for example, taking a taxi or traveling. For example, the first interface is an application interface related to music, and the corresponding memory type can be an important day or event, and the first memory information can include one or more of the following: song name, singer, or song release time, etc.

[0104] It should be understood that the memory types and corresponding attribute items shown in the embodiments of the present application are only illustrative and should not constitute any limitation on the present application.

[0105] In an implementation, the display content of the first interface can be matched with part or all of the preset memory types, and if the display content of the first interface is successfully matched with a memory type, the matching information can be taken as the first memory information, or if the display content of the first interface is successfully matched with multiple memory types, the matching information of the memory type with the most corresponding matching information can be taken as the first memory information.

[0106] In another implementation, different interfaces or different content can correspond to a default memory type, and if the display content of the first interface is successfully matched with the default memory type corresponding thereto, the matching information can be taken as the first memory information.

[0107] In yet another implementation, the user can select a memory type by himself / herself, and the display content of the first interface is matched with the memory type selected by the user, and if the matching is successful, the matching information can be taken as the first memory information.

[0108] It should be understood that the matching information is the information of the corresponding attribute items obtained through matching.

[0109] For example, the foregoing matching operation can be performed by a large language model (LLM).

[0110] In some embodiments, the electronic device can perform corresponding processing according to the display content of the first interface to obtain the first memory information. For example, the electronic device can match the display content of the first interface with the preset at least one memory type to obtain the first memory information.

[0111] In some other embodiments, the electronic device can send the display content of the first interface or a preprocessing result obtained by preprocessing the display content of the first interface to the server, and the server can perform corresponding processing according to the display content of the first interface or the preprocessing result to obtain the first memory information. In this case, S1310 can specifically include receiving the first memory information from the server. For example, the server can match the display content of the first interface with the preset at least one memory type to obtain the first memory information. For example, the preprocessing can be visual analysis, interface framework analysis, and / or interface text recognition, and the corresponding preprocessing result can be an application page, text, and / or image data with a description.

[0112] S1320, displaying the first memory information on the intelligent assistant.

[0113] For example, a first card can be displayed on the intelligent assistant, and the first card can include the first memory information. Alternatively, the first memory information can also be displayed in other forms, such as in the form of a picture.

[0114] According to the information recording method provided in the present application, the electronic device can obtain the first memory information and display the memory information on the intelligent assistant. This method does not require the user to remember a large amount of information by himself, and the user can obtain the required information through the intelligent assistant at any time according to the needs, thereby reducing the operation complexity of information acquisition and improving the user experience.

[0115] In some embodiments, before S1320, the method can further include obtaining a first user operation.

[0116] In one case, the first user operation is used to indicate saving the first memory information. In this case, the electronic device can perform S1320 in response to the first user operation.

[0117] In one example, before obtaining the first user operation, the method 1300 can further include displaying prompt information. The prompt information is used to indicate that there is memory information to be saved at present.

[0118] Specifically, after the electronic device obtains the first memory information, the prompt information can be displayed, and the user can perform the first user operation based on the prompt information. In response to the first user operation, the electronic device can display the first memory information on the intelligent assistant.

[0119] Based on the scheme, the electronic device can actively acquire the first memory information, and after acquiring the first memory information, prompt the user to save the memory information through the prompt information, and the user can save the first memory information based on the prompt of the electronic device.

[0120] In another case, the first user operation is used to indicate the display content. In this case, the electronic device can perform S1310 in response to the first user operation.

[0121] Based on the scheme, the electronic device can acquire the first memory information based on the trigger of the user.

[0122] For example, the display content is one of the following: interface content of the first interface of the first application, display content in the first region of the first interface, first text in the first interface, and first picture in the first interface.

[0123] The following will explain in detail the two cases of the electronic device actively acquiring the first memory information and passively (i.e., based on the trigger of the user) acquiring the first memory information.

[0124] Active acquisition of the first memory information

[0125] In some embodiments, S1310 can specifically include: scanning the display interface of the first application; and acquiring the first memory information according to the display content of the currently scanned first interface, the first interface being one display interface of the first application.

[0126] That is, the electronic device can actively acquire memory information according to the display interface of the application. For example, the electronic device can scan the display interface of the first application based on a preset period, or can scan the display interface of the first application when the display interface of the first application is switched. It should be understood that for the same application, such as the first application, the interfaces scanned by the electronic device at different times can be different, and the memory information can be acquired according to some interfaces, and the memory information can not be acquired according to other interfaces. The memory information that cannot be acquired means that there is no information in the interface that matches the relevant memory type.

[0127] Based on the above scheme, the electronic device can actively acquire the first memory information without the user triggering, and eliminate the operation steps of the user actively triggering.

[0128] For example, for the first interface of the current scan, the application page, text and image data with description of the first interface can be extracted in combination with visual analysis, interface framework analysis and / or interface text recognition, and then the first memory information can be obtained according to the application page, text and image data with description of the first interface. For example, the memory type suitable for the first application can be determined according to the application page, text and image data with description of the first interface, and then the Prompt for obtaining memory information corresponding to the schema is called, and the first memory information can be generated by calling the LLM through the Prompt.

[0129] Optionally, the first application can be a target application. The target application can also be referred to as a memory source. Wherein the electronic device can obtain the memory information based on the scanning of the display interface of the target application.

[0130] For example, the electronic device obtains the memory information on the display interface of an application multiple times based on the trigger of the user, and then the electronic device can mark the application as a target application, or the user can mark the application as a target application. For example, if the number of times that the electronic device obtains the memory information on the display interface of an application based on the trigger of the user is greater than a preset number (denoted as N times), the electronic device can pop up a prompt on the current display interface to remind the user whether to mark the application as a target application. The user can mark the application as a target application based on the prompt.

[0131] In one example, S1320 can specifically include: if the display interface is not cut out from the first interface, waking up the intelligent assistant, and displaying the first memory information in the conversation window of the intelligent assistant.

[0132] That is, the electronic device obtains the first memory information according to the first interface. If the display interface of the electronic device is still on the first interface when the first memory information is obtained, the electronic device can actively wake up the intelligent assistant and display the first memory information obtained according to the first interface on the intelligent assistant.

[0133] For example, the intelligent assistant can be Xiaoyi, the first interface can be the interface 10 shown in FIG. 1, and the first memory information can be the content in the card 13 shown in FIG. 1. If the user stays on the interface 10 all the time, the electronic device wakes up Xiaoyi and displays the card 13 in the window 11 after obtaining the memory information based on the interface 10, and saves the card 13 on Xiaoyi, such as in the interface 40 shown in FIG. 4.

[0134] In another example, the display prompt information can specifically include: if the display interface is not cut out from the first interface, the prompt information is displayed in the conversation window of the intelligent assistant, and the conversation window of the intelligent assistant is displayed on the first interface.

[0135] Correspondingly, S1320 can specifically include: in response to the first user operation on the dialog window of the intelligent assistant, displaying the first memory information in the dialog window of the intelligent assistant. That is, the electronic device acquires the first memory information according to the first interface, if the display interface of the electronic device still stays at the first interface when the first memory information is acquired, the electronic device can actively wake up the intelligent assistant, and display the first prompt information in the dialog window of the intelligent assistant. Then, the user can perform the first user operation on the dialog window of the intelligent assistant, and in response to the first user operation, the electronic device can display the first memory information. For example, the user can input the first user instruction in the dialog window of the intelligent assistant, the first user instruction can be input through voice or text, the electronic device executes the first user instruction, and displays the first memory information. Or, the user can operate the prompt information, and the electronic device executes the instruction corresponding to the operation, and displays the first memory information.

[0136] The above scheme can support the user to acquire the memory information in the voice interaction scene or the non-voice interaction scene, and support the user to save the memory information in the scene where the user does not switch the display interface through the way of prompting the user by the prompt information.

[0137] For example, the intelligent assistant can be Xiaoyi, the first interface can be the interface 10 shown in FIG. 1, and the first memory information can be the content in the card 13 shown in FIG. 1. If the user stays in the interface 10 all the time, after the electronic device acquires the memory information based on the content on the interface 10, Xiaoyi is woken up, and the prompt information 12 (an example of the prompt information) is displayed. The user can input the first user instruction “remember the screen information” or click the prompt information 12, and the electronic device will display the card 13 and save the card 13 on Xiaoyi, such as in the interface 40 shown in FIG. 4.

[0138] For example, the intelligent assistant can be Xiaoyi, the first interface can be the interface 20 shown in FIG. 2, and the first memory information can be the card 23 shown in FIG. 2. If the user stays in the interface 20 all the time, after the electronic device acquires the memory information based on the content on the interface 20, Xiaoyi is woken up, and the prompt information 22 (an example of the prompt information) is displayed. The user can input the first user instruction “remember the screen information” or click the prompt information 22, and the electronic device will display the card 23 and save the card 23 on Xiaoyi, such as in the interface 40 shown in FIG. 4.

[0139] In yet another example, the display prompt information can include: if the display interface is switched from the first interface to the second interface, displaying the prompt information on the second interface.

[0140] Correspondingly, S1320 specifically is: in response to the first user operation on the prompt information, displaying the first memory information on the third interface of the intelligent assistant, and the third interface includes the memory information to be saved (or confirmed).

[0141] That is, the electronic device acquires the first memory information according to the first interface, and if the display interface of the electronic device is not the first interface but the second interface when the first memory information is acquired, the electronic device will push the prompt information to remind the user that there is memory information to be saved. The user can view the memory information to be saved on the third interface of the intelligent assistant according to the prompt information. For example, the user can click the prompt information, and in response to the operation of the user clicking the prompt information, the electronic device will display the third interface. Alternatively, the user can click the APP icon corresponding to the prompt information, enter the APP, and then the user can enter the third interface by switching pages.

[0142] The above scheme supports guiding the user to save the memory information through the way of pushing the prompt information to remind the user when the user has switched the display interface. In this way, the user can not only realize that the electronic device has acquired the memory information in real time, but also can save the acquired memory information at any time according to the needs.

[0143] For example, the first interface can be the interface 30 shown in FIG. 3. The electronic device acquires the first memory information according to the content of the interface 30, and if the display interface of the electronic device is interface 31 instead of interface 30 when the first memory information is acquired, the electronic device will display the prompt information, i.e. the notification 32, on the interface 31. The user can click the notification 32 or click the Xiaoyi icon or enter the third interface such as the interface 33 through other ways, and the user can view the memory information to be saved, i.e. the content in the card 34, in the interface 33.

[0144] Further, the third interface includes a confirmation control corresponding to the first memory information, and the method 1300 can further include: in response to the operation on the confirmation control, saving the first memory information on the intelligent assistant.

[0145] For example, in the example shown in FIG. 3, the confirmation control is the control 35, and the user can click the control 35, and in response to the operation of clicking the control 35, Xiaoyi will save the card 34. For example, after Xiaoyi saves the card 34, the user can view the card 34 in the interface 40 shown in FIG. 4, and the card 41 in FIG. 4 is the card 34.

[0146] The first memory information is acquired passively, i.e. based on the trigger of the user.

[0147] Exemplarily, the electronic device can support multiple interaction manners such as voice, touch operation (for example, circle selection, line drawing, text selection, etc.) and the like to trigger the electronic device to acquire the memory information according to the whole screen information or the partial information in the screen, so as to meet the demand of the user for acquiring the memory information in different situations.

[0148] The manner of passively acquiring the first memory information is exemplified below according to different display contents.

[0149] Example 1: the display content is the interface content of the first interface of the first application

[0150] In some embodiments, S1310 can specifically include: in response to the first user operation on the conversation window of the intelligent assistant, acquiring the first memory information according to the interface content of the first interface. Wherein, the conversation window of the intelligent assistant is displayed on the first interface in a floating manner, and the first interface is one display interface of the first application.

[0151] Based on the scheme, the user can acquire the memory information through the wake-up Xiaoyi when having the memory demand.

[0152] Exemplarily, the first application can be a non-target application. As described above, the electronic device can acquire the memory information based on the scanning of the display interface of the target application. Then, relatively, for the non-target application, the electronic device can acquire the memory information based on the trigger of the user.

[0153] Exemplarily, the form of the first user operation can be voice or text and the like.

[0154] For example, the first interface can be the interface 50 shown in FIG. 5, the first memory information can be the content in the card 52 shown in FIG. 5, and the first user operation can be the user voice input of the instruction “Xiaoyi Xiaoyi, remember the screen information” shown in FIG. 5.

[0155] Example 2: the display content is the content in the first region of the first interface

[0156] In some embodiments, before S1310, the method can further include: in response to the first user operation of the user on the first interface, determining the first region.

[0157] For example, the first user operation can be a circle selection operation or a line drawing operation and the like. Based on the scheme, the user can perform the circle selection operation or the line drawing operation and the like on the first interface, and the electronic device can acquire the first memory information according to the circle selection region or the line drawing content.

[0158] For example, the first interface can be the interface 71 shown in FIG. 7, and the first region can be the region surrounded by the line 73 shown in (d) of FIG. 7.

[0159] In one example, before the first area is determined in response to the first user operation of the user on the first interface, the method 1300 can further include: in response to an operation on a fourth interface, performing intelligent screen recognition on the fourth interface to obtain the first interface, the first interface including a first control; and in response to an operation on the first control, starting the circle selection function.

[0160] The fourth interface can be any one display interface, such as a picture or an application page, etc. For example, the fourth interface can be the interface 70 shown in FIG. 7. The user can perform intelligent screen recognition on the fourth interface by performing a corresponding operation on the fourth interface. For example, the user can perform a double-finger press on the screen on the interface 70, and in response to the operation of the user double-finger pressing on the screen, the electronic device performs intelligent screen recognition. By performing intelligent screen recognition on the interface 70, the electronic device will display the first interface, such as the interface 71 shown in (b) of FIG. 7. It should be understood that the first interface includes the content obtained by performing intelligent screen recognition on the fourth interface. The interface 71 can include a control 72 as the first control, and by clicking the control 72, the electronic device can start the circle selection function. After the electronic device starts the circle selection function, the user can obtain the first area by performing circle selection on the content in the interface 71, such as the area surrounded by the line 73.

[0161] In one implementation, the first interface further includes a second control; and S1310 can specifically include: in response to an operation on the second control, waking up the intelligent assistant and displaying an image corresponding to the first area in a dialog box of the intelligent assistant; and obtaining the first memory information according to the content in the image.

[0162] Correspondingly, S1320 can specifically include: displaying the first memory information in the dialog box of the intelligent assistant.

[0163] For example, referring to (c) of FIG. 7, the second control can be the control 74, and the user can click the control 74, and in response to the operation of the user clicking the control 74, the electronic device will wake up the intelligent assistant and display the image in the circle selected area in the window 75 of the intelligent assistant shown in (d) of FIG. 7, i.e., the picture 77 in the dialog box 76. Then, the electronic device can simulate the user issuing and executing the instruction of “remember the content in the picture”, and display the first memory information obtained according to the picture 77, i.e., the content in the card 78.

[0164] In another implementation, the method 1300 can further include: after a preset time, waking up the intelligent assistant and displaying an image corresponding to the first area in a dialog box of the intelligent assistant.

[0165] That is, after a preset time after the first area in the first interface is determined in response to the first user operation of the user on the first interface, the intelligent assistant is woken up, and an image corresponding to the first area is displayed in a dialog box of the intelligent assistant.

[0166] For example, in the example shown in FIG. 7, after the electronic device displays the line 73 based on the first operation of the user in the interface 71, it can wake up Xiaoyi after a preset time, such as 5s, and display the image in the selected area in the window 75 of Xiaoyi shown in (d) of FIG. 7, i.e. the picture 77 in the dialog box 76. Then, the electronic device can simulate the user to issue and execute the instruction of "remember the content in the picture", and display the first memory information obtained according to the picture 77, i.e. the content in the card 78.

[0167] Example 3: the displayed content is a first text

[0168] In some embodiments, before S1310, the method can include: in response to a first user operation of a user on a first interface, copying a first text in the first interface.

[0169] For example, the first interface can be the interface 80 shown in FIG. 8, the second operation can be a copy operation, and the first text can be "buy a book for the daughter tomorrow".

[0170] Based on the above scheme, memory information can be obtained according to part of the text in the display interface, meeting the scene requirement of the user who only wants to remember the information in part of the text in the display interface.

[0171] In one example, S1310 can specifically include: in response to an operation on a third control in a fifth interface of the intelligent assistant, displaying a first window on the fifth interface, the first window including a fourth control, the fifth interface displaying saved memory information, and the third control being used for adding memory information; in response to an operation on the fourth control, displaying the first text in the first window; and extracting the first text from the first window to obtain the first memory information.

[0172] For example, the fifth interface can be a memory information management interface of the intelligent assistant or an interface / page for the user to manage the memory information. For example, the fifth interface can be the interface 81 shown in (b) of FIG. 8, the third control can be the control 84 in the interface 81, and the first window can be the window 85 shown in (c) of FIG. 8. The control 84 is used to add memory information. The user can click the control 84. In response to the click operation on the control 84, the electronic device displays the window 85 on the interface 81. The window 85 includes a fourth control, for example, the fourth control is the control 86. The user can click the control 86. In response to the click operation on the control 86, the first text “Buy a book for daughter tomorrow” that has been copied to the clipboard is displayed in the window 85. The electronic device can extract “Buy a book for daughter tomorrow”, obtain the first memory information according to “Buy a book for daughter tomorrow”. For example, referring to (d) of FIG. 8, in response to the click operation on the control 86, the first text is displayed in the window 85, and the electronic device can extract “Buy a book for daughter tomorrow”, obtain the first memory information according to “Buy a book for daughter tomorrow”, and then display the first memory information, that is, the content in the card 88. For another example, referring to (a) of FIG. 9, in response to the click operation on the control 86, the first text is displayed in the window 85, and the control 90 is displayed, and the control 86 is no longer displayed. The user can click the control 90. In response to the click operation on the control 90, the electronic device can extract “Buy a book for daughter tomorrow”, obtain the first memory information according to “Buy a book for daughter tomorrow”, and then display the card 88. Further, in the process of obtaining the first memory information, a prompt information indicating that the first memory information is being obtained can also be displayed. For example, the prompt information can be the prompt information 91 shown in (b) of FIG. 9. After the electronic device obtains the first memory information, the prompt information 91 can no longer be displayed.

[0173] Example 4: The display content is a first picture

[0174] In some embodiments, before S1310, the method can further include: in response to a first user operation on a thumbnail of a first picture in a sixth interface, displaying a first interface, the first interface including the first picture.

[0175] For example, the sixth interface can be the interface 112 shown in (c) of FIG. 11, and the first picture can be the picture 113. The user can click the thumbnail of the picture 113. In response to the operation of clicking the thumbnail of the picture 113, the electronic device can display the interface 114, which is an example of the first interface, and the interface 114 includes the picture 113.

[0176] Further, S1310 can specifically include: performing text recognition on the first picture in the first interface to obtain recognized text; in response to an operation on the fifth control in the first interface, displaying a seventh interface of an intelligent assistant, the seventh interface of the intelligent assistant displaying a second window, the second window including the recognized text; and in response to an operation on the sixth control in the second window, obtaining the first memory information according to the recognized text.

[0177] For example, the first interface can be the interface 114 shown in (d) of FIG. 11, the first picture can be the picture 113, and the fifth control can be the control 116 in the interface 114. After the user clicks the thumbnail of the picture 113 in the interface 112 shown in (c) of FIG. 11, the electronic device not only displays the interface 114, but also performs text recognition on the picture 113 to obtain the text in the picture 113, i.e., the recognized text. Referring to (d) of FIG. 11, the recognized text is the content in the recognized box 115. After obtaining the recognized text, the user can click the control 116, and in response to the operation of clicking the control 116, the electronic device will display the seventh interface, such as the interface 81 shown in (e) of FIG. 11, which displays a second window, such as the window 110, which displays the recognized text “store transfer contact: Ms. Zhang 130XXX”. The window 110 can include a sixth control, such as the control 117; the user can click the control 117, and in response to the operation of clicking the control 117, the electronic device will obtain the first memory information according to the recognized text, such as the obtained first memory information being the content in the card 118 shown in (f) of FIG. 11.

[0178] In some embodiments, S1310 can specifically include: in response to a first user operation on a seventh control in the first interface, obtaining the first memory information according to the first picture in the first interface, the seventh control being located in a third window of the first interface, and the first picture being displayed in the third window.

[0179] For example, the first interface can be the interface 81 shown in (d) of FIG. 12, the third window can be the window 110 in the interface 81 shown in (d) of FIG. 12, the first picture can be the picture in the window 110, and the seventh control can be the control 117 in the window 110. The user can click the control 117, and in response to the operation of clicking the control 117, the electronic device can obtain the first memory information according to the picture in the window 110, such as the first memory information being the content in the card 118 shown in (e) of FIG. 12.

[0180] Optionally, before the first interface is displayed in response to the first user operation on the thumbnail of the first picture in the second interface, the method 1300 can further include:

[0181] In response to an operation on the eighth control in the eighth interface of the intelligent assistant, a fourth window is displayed on the eighth interface, the fourth window includes a ninth control, the eighth interface displays saved memory information, and the eighth control is used to add memory information. In response to an operation on the ninth control, a first option and a second option are displayed in the fourth window, the first option is used to select a picture in a gallery, and the second option is used to take a picture. In response to an operation on the first option, the sixth interface is displayed.

[0182] For example, the eighth interface can be a memory information management interface or an interface / page in which the user manages memory information. For example, the eighth interface can be the interface 81 shown in (a) of FIG. 11, the eighth control can be the control 84 in the interface 81, and the fourth window can be the window 110 shown in (b) of FIG. 11. The user can click the control 84, and in response to the operation on the control 84, the electronic device can display the window 110. The ninth control can be the "picture recognition" control in the window 110, and the user can click the "picture recognition" control. In response to the operation on the "picture recognition" control, the electronic device can display a "gallery selection" option (an example of the first option) and a "take a picture" option (an example of the second option). The user can click the "gallery selection" option, and in response to the click operation on the "gallery selection" option, the electronic device can display the interface 112 (an example of the sixth interface), and the interface 112 includes thumbnails of at least one picture in the gallery. The first picture can be the picture 113 in the interface 112.

[0183] Based on the above scheme, memory information can be obtained according to a picture in the gallery. In addition, memory information can also be obtained according to a picture taken by the user by clicking the second option.

[0184] In some embodiments, the first memory information can include a plurality of memory information. The electronic device can selectively save part of the plurality of memory information or save the plurality of memory information according to the user instruction or operation of the intelligent assistant. This scheme can support the user to selectively save the memory information.

[0185] For example, referring to the example shown in FIG. 6, the first memory information includes the card 62 and the card 63. The user can click the "remember all" control to save the card 62 and the card 63. Alternatively, the user can click the card 62 and then click the "remember selected" control. In response to the operation of the user clicking the "remember selected" control, the electronic device will save the card 62. Alternatively, the window 61 can include a "remember the first memory" control and / or a "remember the second memory" control, and the user can click the "remember the first memory" control, for example, to save the card 62.

[0186] It should be understood that although the embodiments of the present application only show multiple pieces of memory information in the scenario shown in FIG. 6, it should be understood that in the scenarios shown in other figures, the first piece of memory information can also include multiple pieces of memory information.

[0187] In some embodiments, before S1320, the method 1300 can further include: displaying, on the intelligent assistant, a memory type matched with the display content of the first interface and an attribute item corresponding to the memory type.

[0188] For example, referring to the user interface diagram shown in FIG. 14, the interface shown in FIG. 14 can be an interface diagram displayed in response to the user's operation on the control 117 shown in (e) of FIG. 11, or the interface shown in FIG. 14 can be an interface diagram displayed in response to the user's operation on the control 117 shown in (d) of FIG. 12. Referring to FIG. 14, the window 110 includes a memory type: card. The attribute items corresponding to the card include: (1) name: Ms. Zhang's business card; (2) subject: shop transfer; (3) type: business card; and (4) number: 130XXX. It should be noted that "business card" is a sub-type of card. In addition, in some figures, such as FIG. 14, FIG. 15, or FIG. 16, "memory type" can also be described as "identification type", or similar or similar descriptions.

[0189] For example, referring to the user interface diagram shown in FIG. 15, the interface shown in FIG. 15 can be an interface diagram displayed in response to the user's operation on the control 86 shown in (c) of FIG. 8. Referring to FIG. 15, the window 85 includes a memory type: important day. The attribute items corresponding to the important day include: (1) name: buy books for daughter; (2) related person: daughter; (3) type: other; and (4) date: 12 / 10. It should be noted that "other" is a sub-type of important day. For example, important day can include one or more of the following sub-types: birthday, anniversary, repayment day, exam day, pay day, or other.

[0190] For example, referring to the user interface diagram shown in FIG. 16, the window 161 can include multiple memory types and attribute items corresponding to each memory type, which are obtained according to "son's information: Wang XX; ID card: 420XXX11; phone: 123XXX12". The memory type 1 and the memory type 2 shown in the window 161 are the same, both of which are card. It should be understood that whether the multiple memory types are the same is determined by the first content, and the multiple memory types can be the same or different. In the case where the multiple memory types are the same, the sub-types of the multiple memory types can be the same or different.

[0191] In the case of displaying multiple memory types, a control for viewing each memory type can also be displayed. For example, referring to FIG. 16, a user can view all memory types in window 161 by sliding up and down control 163.

[0192] Optionally, at least part of the attribute items corresponding to the memory type can be edited. For example, referring to FIG. 14, the type and number can be edited. For example, referring to FIG. 15, the type and date can be edited.

[0193] In some embodiments, in response to a user operation on the memory information, the memory type and the attribute information corresponding to the memory type are displayed.

[0194] For example, for card 41 shown in FIG. 4, a user can click on card 41, and in response to the user's click operation, the electronic device can display the memory type and the attribute information corresponding to the memory type. Further, the user can also edit part or all of the attribute information.

[0195] In some embodiments, the intelligent assistant further includes a tenth control, and method 1300 can further include: in response to an operation on the tenth control, displaying a first menu bar, the first menu bar including multiple memory type options; and in response to an operation on a first memory type option in the multiple memory type options, displaying, on the intelligent assistant, a first memory type matching the display content of the first interface and at least one attribute item corresponding to the first memory type.

[0196] That is, the electronic device can display the attribute items corresponding to the selected memory type according to the selection of the memory type. It should be understood that the extracted memory information can be different when the memory type is different.

[0197] For example, the tenth control can be control 171 shown in FIG. 17, and the first menu bar can be menu bar 172 shown in FIG. 17. Referring to the example shown in FIG. 17, the memory types and the corresponding attribute items in each of the figures shown in FIG. 17 are obtained according to “Shop transfer contact: Ms. Zhang 130XXX”. The memory type shown in (a) in FIG. 17 can be the default memory type of the electronic device. If a user wants to modify the memory type, the user can click on control 171, and in response to the operation of clicking on control 171, menu bar 172 as shown in (b) in FIG. 17 is displayed, and menu bar 172 includes various memory types. For example, if the user clicks on “matter”, in response to the operation of clicking on “matter”, the electronic device displays the attribute corresponding to “matter” as shown in (c) in FIG. 17. For example, if the user clicks on “order”, in response to the operation of clicking on “order”, the electronic device displays the attribute item corresponding to “order” as shown in (d) in FIG. 17. As can be seen, when the memory type is order, the electronic device does not obtain information matching the attribute item, and therefore does not obtain the first memory information.

[0198] In some embodiments, the eleventh control is further displayed when the memory type and the attribute information corresponding to the memory type are displayed; and S1320 specifically comprises: in response to an operation on the eleventh control, the first memory information is displayed.

[0199] For example, referring to FIG. 14, the window 110 can further include a control 141, and the user can click the control 141. In response to the operation of clicking the control 141, the electronic device can display the window 110 as shown in (f) of FIG. 11, that is, the memory type and the attribute information corresponding to the memory type are no longer displayed in the window 110, and the card 118 is displayed, and the card 118 is the first memory information. Alternatively, in response to the operation of clicking the control 141, the electronic device no longer displays the window 110, and displays the card 118 on the interface 81.

[0200] For example, referring to FIG. 15, the window 85 can further include a control 151, and the user can click the control 151. In response to the operation of clicking the control 151, the electronic device can display the window 85 as shown in (d) of FIG. 8, that is, the memory type and the attribute information corresponding to the memory type are no longer displayed in the window 85, and the card 88 is displayed, and the card 88 is the first memory information. Alternatively, in response to the operation of clicking the control 151, the electronic device no longer displays the window 85, and displays the card 88 on the interface 81.

[0201] FIG. 18 is an exemplary flowchart of an information recording method provided in the present application. The steps in the method 1800 shown in FIG. 18 are described below.

[0202] S1801, scanning a display interface of an application.

[0203] For example, the display interface of the application can be scanned based on a preset period, or the display interface can be scanned when the display interface is switched.

[0204] S1802, determining whether an application to which a first interface currently scanned belongs is marked as a target application.

[0205] If the application to which the first interface belongs is marked as the target application, S1803, S1804, or S1805 can be executed, otherwise, S1801 is continuously executed.

[0206] In one example, the electronic device has obtained memory information according to the display interface of the application multiple times based on the trigger of the user, and the electronic device can take the application as the target application, or the user can mark the application as the target application.

[0207] For example, the electronic device can also count the number of times that the memory information has been acquired based on the display interface of the application according to the user's trigger, which can or can not include the current time. If the number of times is greater than a preset number of times, the electronic device can prompt the user through a pop-up box whether to mark the application as a target application. Based on the pop-up box prompt, the user can mark the application as a target application.

[0208] S1803, determining whether the first probability Ta exceeds a preset probability.

[0209] The first probability is the probability Ta that the user saves the first memory information acquired according to the first interface according to the target prompt. The target prompt is used to prompt that the memory information has been obtained or that there is currently memory information to be confirmed. The user can save the memory information based on the target prompt. For example, the target prompt can be the first prompt information or the first notification in the foregoing. Ta = the number of times that the user saves the first memory information acquired according to the first interface according to the target prompt / the number of times that the electronic device displays the target prompt.

[0210] For example, assuming that the first interface is the interface 10 shown in FIG. 1, if the number of times that the electronic device actively acquires the first memory information according to the interface 10 is 8 times, and the number of times that the user saves the first memory information according to the prompt information 12 is 5 times, then Ta = 5 / 8. It should be understood that the user saving the first memory information according to the prompt information 12 means that the user clicks the prompt information 12 according to the prompt information 12 or the user inputs an instruction such as “remember the screen information”.

[0211] If the execution result of S1803 is yes, S1804 or S1805 can be executed. If the execution result of S1803 is no, S1801 can be returned or S1804 can be executed.

[0212] S1804, determining whether the time interval from the last (i.e., the most recent) display of the target prompt is greater than a threshold Tt.

[0213] If the execution result of S1804 is yes, S1805 can be executed, otherwise S1801 can be returned.

[0214] S1805, performing information extraction on the first interface to obtain first content.

[0215] For example, the application page, text, and image data with description of the first interface can be extracted in combination with visual analysis, interface framework analysis, and / or interface text recognition, and the content extracted based on the first interface is the first content.

[0216] S1806, determining whether the analysis value corresponding to the first interface is consistent with the analysis value of the display interface of the application obtained last time.

[0217] For example, the resolution value can be calculated according to the first content corresponding to the display interface of the application, and the calculation can be a hash value calculation, etc. It should be understood that the first content corresponding to different display interfaces of the application can be different.

[0218] In S1806, if it is determined that the resolution value obtained this time is consistent with the resolution value obtained last time, it is considered that the first interface is a display interface different from the display interface of the application scanned last time, and then S1807 can be performed, and the resolution value obtained this time can be recorded.

[0219] S1807, obtaining memory information according to the first content.

[0220] For example, the memory type suitable for the first application can be determined according to the application page, text and image data with description of the first interface, and then the Prompt for obtaining the memory information can be called according to the corresponding mode generation, and the first memory information can be generated by calling the LLM through the Prompt.

[0221] S1807 can be followed by S1808 or S1809.

[0222] S1808, determining whether the memory information obtained in S1807 is memory information that has not been saved.

[0223] Compared with the memory information that has been saved, it is confirmed whether the memory information obtained in S1807 is memory information that has been saved. If yes, S1801 can be performed, otherwise S1809 can be performed.

[0224] S1809, determining whether the display interface is still at the first interface.

[0225] That is, it is determined whether the display interface at this time is the first interface. If yes, S1810 can be performed, otherwise S1811 can be performed. Hereinafter, for the convenience of description, the display interface at this time is referred to as the second interface in the case where the display interface at this time is different from the first interface.

[0226] S1810, waking up the intelligent assistant, and displaying the first prompt information in the dialogue window of the intelligent assistant. That is, prompting the user to save the memory information in real time.

[0227] This step can refer to the description of the corresponding content in the foregoing, and will not be described here.

[0228] S1810 can be followed by S1812.

[0229] In one example, for one display interface of one application, S1810 is executed once, and the number of times that the electronic device displays the target prompt can be increased by 1. It should be understood that in the case where S1810 is executed for the first time for one display interface of one application, the number of times that the electronic device displays the target prompt is 1.

[0230] S1811, displaying the first notification on the second application interface. That is, the non-real-time prompt is used to prompt the user to save the memory information.

[0231] This step can refer to the description of the corresponding content in the foregoing description, and will not be described here.

[0232] S1811 can be followed by S1812.

[0233] S1812, saving the memory information and / or user preference storage.

[0234] For saving the memory information in S1810, S1811, and S1812, reference can be made to the description of the related schemes in the foregoing description, and will not be described here.

[0235] As described above, the user can manually select the memory type, and the user preference storage in S1812 is used to store the selection preference of the user for the memory type of the application.

[0236] In one example, for one display interface of one application, S1812 is executed once, and the number of times that the user saves the memory information obtained according to the display interface according to the target prompt can be increased by 1. It should be understood that in the case where S1812 is executed for the first time for one display interface of one application, the number of times that the user saves the memory information obtained according to the display interface according to the target prompt is 1.

[0237] According to the scheme provided in the embodiments of the present application, when the user is browsing some applications, the electronic device can actively obtain the memory information, eliminating the operation step of triggering the user to obtain the memory information. Moreover, by learning the habits of the user receiving the memory information, the electronic device can make the automatic and intelligent memory information obtaining capability more in line with the user's expectations. At the same time, the memory information saving mode supporting real-time prompting and non-real-time prompting can be compatible with multiple user operation scenarios, and even after the user switches the screen, the recognized memory information can still be retained.

[0238] FIG. 19 is a schematic diagram of a system architecture provided in an embodiment of the present application. The system architecture 1900 can include one or more modules shown in the figure, and the functions of each module will be described below.

[0239] Intelligent voice module 1910: receiving the corpus used to obtain the first memory information, such as "remember the screen information", and issuing the instruction corresponding to the corpus to the memory trigger module 1914.

[0240] Cutting version module 1911: support copying text in the display interface.

[0241] Screen touch module 1912: identify user's touch operation in the interface, such as double-click, click, etc.

[0242] Screen drawing module 1913: receive drawing instructions and draw lines / circles in pictures.

[0243] Memory trigger module 1914: passively trigger the acquisition of memory information according to the signals / instructions sent by the intelligent voice module 1910, screen touch module 1912 and screen drawing module 1913; it can also actively trigger the acquisition of memory information according to the display interface of the application.

[0244] Information extraction module 1915: can extract application pages, text and / or image data with description by combining visual analysis, interface framework analysis and / or interface text recognition technology.

[0245] Memory hub 1916: after receiving the content sent by the information extraction module 1915, determine the memory type matched with the received content, and call the corresponding mode to generate the Prompt for the user to acquire memory information, and call the LLM through the Prompt to generate the memory information. Further, according to the user's selection preference for the memory type, the memory information finally returned to the user can be filtered.

[0246] Exemplarily, the memory hub can be deployed on the side of the electronic device, or on the side of the server.

[0247] User memory preference recording module 1917: record the user's selection preference for the memory type of the display interface of the application.

[0248] Memory source confirmation module 1918: when it is identified that the user has frequently acquired memory information for the same application based on the user's trigger, the user can be prompted to mark this application as a memory source or a target application, and the electronic device can actively acquire memory information according to the display interface of the memory source.

[0249] Memory storage module 1919: used to save the acquired memory information.

[0250] According to the system architecture provided by the embodiments of the present application, memory information acquisition under different scenarios can be supported.

[0251] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the system architecture. In other embodiments of the present application, the system architecture can include more or fewer modules than shown, or combine certain modules, or split certain modules, or different arrangement of modules. The modules shown can be implemented in hardware, software or a combination of software and hardware.

[0252] FIG. 20 is a structural schematic diagram of an electronic device provided by the present application. The electronic device 2000 can include a processor 2010, an external memory interface 2020, an internal memory 2021, an antenna 1, an antenna 2, a mobile communication module 2030, a wireless communication module 2040, a display screen 2050.

[0253] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 2000. In other embodiments of the present application, the electronic device 2000 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software or a combination of software and hardware.

[0254] The processor 2010 can include one or more processing units, for example: the processor 2010 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0255] The wireless communication function of the electronic device 2000 can be implemented through the antenna 1, the antenna 2, the mobile communication module 2030, the wireless communication module 2040, etc.

[0256] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. The structure of the antenna 1 and the antenna 2 in FIG. 1 is only an example. Each antenna in the electronic device 2000 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas.

[0257] The mobile communication module 2030 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 2000. The mobile communication module 2030 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 2030 can receive an electromagnetic wave by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic wave, and transfer the processed signal to the modem processor for demodulation.

[0258] The wireless communication module 2040 can provide at least one of a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 2000. The wireless communication module 2040 can be one or more devices integrated with at least one communication processing module. The wireless communication module 2040 receives an electromagnetic wave via the antenna 2, performs frequency modulation and filtering on the electromagnetic wave signal, and transmits the processed signal to the processor 2010.

[0259] The electronic device 2000 implements a display function through the display screen 2050. The display screen 2050 is used to display an interactive interface, etc.

[0260] It should be understood that the electronic device 2000 can execute any of the technical solutions of the present application.

[0261] The embodiments of the present application further provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor executes the computer program to implement the information recording method shown in each of the above embodiments.

[0262] The embodiments of the present application further provide a chip, as shown in FIG. 21, which includes a processor and a memory, and the memory stores a computer program, and the computer program is executed by the processor to implement the information recording method shown in each of the above embodiments.

[0263] The embodiments of the present application further provide a computer readable storage medium, which stores a computer program, and the computer program is executed by the processor to implement the information recording method shown in each of the above embodiments.

[0264] The embodiment of the present application further provides a computer program product, which comprises a computer program. When the computer program is run by a terminal device, the terminal device implements the information recording method shown in each of the embodiments.

[0265] It should be noted that the click operation in the present application is only an example, and the click operation can be replaced by a touch operation, a voice operation, etc. The names of pages, controls, windows, etc. provided in the embodiments of the present application are also only examples, and do not constitute any limitation on the present application.

[0266] It should be understood that the processor mentioned in the embodiments of the present application can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0267] It should also be understood that the memory mentioned in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically EPROM (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM) and direct rambus RAM (DR RAM).

[0268] In the embodiments provided in the present application, the division of each framework or module is only a logical function division, and another division mode can be used in actual implementation, for example, multiple frameworks or modules can be combined or integrated into another system, or some features can be ignored or not executed.

[0269] In addition, each functional module in each embodiment of the present application can be integrated in one processing module, or each module can exist physically alone, or two or more modules can be integrated in one module. The integrated module can be realized in the form of hardware or in the form of a software functional module.

[0270] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0271] Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in some embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment, but can refer to different embodiments. The terms "including," "comprising," "having" and variations thereof as used in this application and with respect to this application, are intended to cover the

[0272] As used in this specification and claims, the terms "if' and "when" can each be interpreted to mean "upon determination" or "in response to a determination" or "upon detection" or "in response to a detection" depending on the context. Similarly, the phrase "if determined" or "if detected [a described condition or event]" can be interpreted to mean "upon determination" or "in response to a determination" or "upon detection" or "in response to a detection" depending on the context.

[0273] The above-described embodiments are merely intended to illustrate the technical solutions of the present application, but not to limit the same; even though the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to some technical features therein; and these modifications or replacements do not make the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. An information recording method, characterized by, The method comprises: obtaining first memory information, the first memory information being extracted according to display content of a first interface, and the first memory information matching a preset memory type, the memory type corresponding to at least one attribute item; displaying the first memory information on an application.

2. The method of claim 1, wherein, Before displaying the first memory information on the application, the method further comprises: obtaining a first user operation, the first user operation being used to indicate saving the first memory information, or the first user operation being used to indicate the display content.

3. The method of claim 2, wherein, The first user operation is used to indicate saving the first memory information. Before obtaining the first user operation, the method further comprises: displaying prompt information, the prompt information being used to indicate that there is memory information to be saved at present.

4. The method of claim 2, wherein, The first user operation is used to indicate the display content, the display content being one of the following: interface content of the first interface of the first application, display content in a first region of the first interface, a first text in the first interface, and a first picture in the first interface.

5. The method of claim 3, wherein, The display prompt information comprises: if a display interface is not cut out from the first interface, displaying the prompt information in a dialog window of the application, the dialog window being displayed on the first interface in a suspended manner; The displaying of the first memory information on the application comprises: in response to the first user operation on the dialog window, displaying the first memory information in the dialog window.

6. The method of claim 3, wherein, The display prompt information comprises: if a display interface is cut out from the first interface to a second interface, displaying the prompt information on the second interface; The displaying of the first memory information on the application comprises: in response to the first user operation on the prompt information or in response to the first user operation on an application corresponding to the prompt information, displaying the first memory information on a third interface of the application, the third interface including memory information to be saved.

7. The method of claim 6, wherein, The third interface includes a confirmation control corresponding to the first memory information, and the method further comprises: in response to an operation on the confirmation control, saving the first memory information on the application.

8. The method of any one of claims 2-7, wherein, The obtaining of the first memory information comprises: scanning a display interface of the first application; obtaining the first memory information according to the first interface currently scanned, the first interface being one display interface of the first application.

9. The method of claim 8, wherein, The first application is a target application, and the electronic device can obtain memory information based on scanning of a display interface of the target application.

10. The method of claim 4, wherein, The display content is interface content of the first interface of the first application. The obtaining of the first memory information comprises: in response to the first user operation on a dialog window of the application, obtaining the first memory information according to interface content of the first interface, the dialog window being displayed on the first interface in a suspended manner, the first interface being one display interface of the first application.

11. The method of claim 4, wherein, The display content is content in a first region of the first interface. Before obtaining the first memory information, the method further comprises: In response to the first user operation of the user on the first interface, the first region is determined.

12. The method of claim 11, wherein, Before the first region is determined in response to the first user operation of the user on the first interface, the method further comprises: In response to the operation on the fourth interface, the fourth interface is intelligently recognized to obtain the first interface, and the first interface comprises a first control; In response to the operation on the first control, a circle selection function is started.

13. The method of claim 12, wherein, The first interface further comprises a second control; The first memory information is obtained according to the content in the image. The display content is the first text. Before the first memory information is obtained, the method further comprises:

14. The method of claim 4, wherein, In response to the first user operation of the user on the first interface, the first text is copied. The first memory information is obtained according to the content in the image. The display content is the first picture.

15. The method of claim 14, wherein, Before the first memory information is obtained, the method further comprises: In response to the first user operation of the user on the thumbnail of the first picture in the sixth interface, the first interface is displayed, and the first interface comprises the first picture. The first memory information is obtained according to the content in the image. Text recognition is performed on the first picture to obtain recognized text.

16. The method of claim 14, wherein, In response to the operation on the fifth control in the first interface, the seventh interface of the application is displayed, and the seventh interface of the application displays a second window, and the second window comprises the recognized text. In response to the operation on the sixth control in the second window, the first memory information is obtained according to the recognized text. The first memory information is obtained according to the content in the image.

17. The method of claim 16, wherein, In response to the first user operation of the user on the seventh control in the first interface, the first memory information is obtained according to the first picture, and the seventh control is located in a third window of the first interface, and the first picture is displayed in the third window. Before the first user operation of the user on the thumbnail of the first picture in the second interface, the method further comprises: In response to the operation on the eighth control in the eighth interface of the application, a fourth window is displayed on the eighth interface, and the fourth window comprises a ninth control, and the eighth interface displays saved memory information, and the eighth control is used to add memory information; In response to the operation on the ninth control, a first option and a second option are displayed in the fourth window, the first option is used to select a picture in a gallery, and the second option is used to take a picture; 18. The method of claim 16, wherein, ​ ​ 19. The method of any one of claims 16-18, wherein, ​ ​ ​ In response to the operation on the first option, the sixth interface is displayed, and the sixth interface includes a thumbnail of at least one picture in the photo gallery.

20. The method of any one of claims 1-19, wherein, Before displaying the first memory information on the application, the method further includes: Displaying, on the application, a memory type matching the display content of the first interface and at least one attribute item corresponding to the memory type.

21. The method of claim 20, wherein, Some or all of the at least one attribute item is editable.

22. The method of claim 20 or 21, wherein, The application includes a tenth control, and the method further includes: In response to the operation on the tenth control, a first menu bar is displayed, and the first menu bar includes a plurality of memory type options; In response to the operation on a first memory type option in the plurality of memory type options, the first memory type matching the display content of the first interface and at least one attribute item corresponding to the first memory type are displayed on the application.

23. An electronic device, comprising: The electronic device includes one or more processors and a memory; The memory is coupled to the one or more processors; The memory is configured to store computer program code including computer instructions, and the one or more processors are configured to invoke the computer instructions to cause the electronic device to perform the method according to any one of claims 1-22.

24. A chip system, characterized by The chip system is applied to an electronic device, and the chip system includes one or more processors configured to invoke computer instructions to cause the electronic device to perform the method according to any one of claims 1-22.

25. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the method according to any one of claims 1-22.

Images