Information recording method and electronic equipment

Abstract

The invention provides an information recording method and electronic equipment, and relates to the technical field of terminals. The method comprises the steps that first memory information is obtained, the first memory information is extracted according to display content of a first interface and matched with a preset memory type, and the memory type corresponds to at least one attribute item; and displaying the first memory information on the intelligent assistant. According to the scheme, the user does not need to memorize a large amount of information by himself / herself and can acquire the required information through the intelligent assistant at any time according to requirements, so that the operation complexity of information acquisition can be reduced, and the user experience is improved.

Description

[0001] This application is a divisional application. The application number of the original application is 202411163290.1, and the original application date is August 22, 2024. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of terminal technology, and more specifically, to an information recording method and an electronic device. Background Art

[0003] As the functional categories of terminal applications continue to increase, the information carried by the applications is becoming more and more abundant, such as train ticket information, hotel order information, movie ticket order information, and related card information. This information is often used multiple times in other scenarios or other applications. In order to be able to use this information again, users need to record this information in advance. For users, recording information by themselves is a great burden, and the records are often incomplete. Alternatively, users can also search in the application where this information comes from when they use it again. However, this operation is very inconvenient, and sometimes they cannot find the information they want to use. Summary of the invention

[0004] In response to the above technical problems, the present application provides an information recording method and an electronic device, which can reduce the operational complexity of users' repeated use of information in terminal applications and improve user experience.

[0005] In a first aspect, an information recording method is provided, which can be executed by an electronic device, or by a component of the electronic device (such as a processor, a chip, or a chip system, etc.), or by a logic module or software that can realize all or part of the functions of the electronic device.

[0006] The method includes: obtaining first memory information, the first memory information is extracted based on the display content of the first interface, and the first memory information matches a preset memory type, and the memory type corresponds to at least one attribute item; and displaying the first memory information on the smart assistant.

[0007] According to the information recording method provided by the present application, the electronic device can record information based on the content displayed by the terminal, and obtain the memorized information through the intelligent assistant. This method does not require the user to record a large amount of information by themselves, and the required information can be obtained through the intelligent assistant at any time according to the needs, thereby reducing the operational complexity of the information in the terminal application and improving the user experience.

[0008] In a possible implementation, before displaying the first memory information on the smart assistant, the method further includes: obtaining a first user operation, where the first user operation is used to indicate saving the first memory information, or the first user operation is used to indicate the display content.

[0009] Based on this solution, the electronic device can save the first memory information based on the first user operation. Alternatively, the electronic device can determine the display content based on the first user operation and obtain the first memory information according to the display content.

[0010] In a possible implementation, the first user operation is used to indicate saving the first memory information; wherein, before obtaining the first user operation, the method further includes: displaying prompt information, the prompt information being used to indicate that there is currently memory information to be saved.

[0011] Based on this solution, the electronic device can display prompt information after acquiring the first memory information, the user can perform a first user operation based on the prompt information, and the electronic device can save the first memory information based on the first user operation. The method can actively acquire the first memory information without the user's triggering.

[0012] In one possible implementation, the first user operation is used to indicate the display content, and the display content is one of the following: interface content of the first interface of the first application, display content in the first area of ​​the first interface, first text in the first interface, and first picture in the first interface.

[0013] In one possible implementation, the display of prompt information includes: if the display interface is not cut out from the first interface, displaying the prompt information in the dialog window of the intelligent assistant, and the dialog window is displayed floating on the first interface; wherein, displaying the first memory information on the intelligent assistant includes: in response to the first user operation on the dialog window, displaying the first memory information in the dialog window.

[0014] Exemplarily, the first user operation may be a voice or text instruction input by the user in the dialog window, or an operation such as clicking on the prompt information.

[0015] This solution can support users in obtaining memory information in voice interaction scenarios or non-voice interaction scenarios, and can support guiding users to save memory information by prompting users with prompt information in scenarios where users have not switched display interfaces.

[0016] In one possible implementation, the display of prompt information includes: if the display interface is switched from the first interface to the second interface, displaying the prompt information on the second interface; wherein, the display of the first memory information on the smart assistant includes: in response to the first user operation on the prompt information or in response to the first user operation on the application corresponding to the prompt information, displaying the first memory information on the third interface of the smart assistant, and the third interface includes the memory information to be saved.

[0017] Exemplarily, the prompt information may be a push notification.

[0018] This solution supports guiding users to save memory information by pushing prompts to the user when the user has switched the display interface. In this way, users can not only perceive in real time that the electronic device has performed the operation of obtaining memory information, but also save the obtained memory information at any time as needed.

[0019] In one possible implementation, the third interface includes a confirmation control corresponding to the first memory information, and the method further includes: in response to an operation on the confirmation control, saving the first memory information on the smart assistant.

[0020] In a possible implementation, the obtaining of the first memory information includes: scanning a display interface of the first application; and obtaining the first memory information according to the first interface currently scanned, where the first interface is a display interface of the first application.

[0021] In a possible implementation, the first application is a target application, wherein the electronic device can acquire memory information based on scanning a display interface of the target application.

[0022] In one possible implementation, the displayed content is the interface content of the first interface of the first application; wherein, obtaining the first memory information includes: in response to the first user operation on the dialog window of the intelligent assistant, obtaining the first memory information according to the interface content of the first interface, the dialog window is displayed floating on the first interface, and the first interface is a display interface of the first application.

[0023] Based on this solution, users can obtain memory information by waking up the smart assistant when they have memory needs.

[0024] In a possible implementation, the displayed content is content in a first area of ​​the first interface; wherein, before obtaining the first memory information, the method further includes: determining the first area in response to the first user operation of the user on the first interface.

[0025] In one possible implementation, before determining the first area in response to the first user operation on the first interface, the method further includes: in response to an operation on a fourth interface, performing intelligent screen recognition on the fourth interface to obtain the first interface, wherein the first interface includes a first control; and in response to the operation on the first control, starting a circle selection function.

[0026] Based on this solution, the user can indicate the display content by circling or drawing, and the electronic device can obtain memory information based on the display content indicated by the user.

[0027] In one possible implementation, the first interface also includes a second control; wherein obtaining the first memory information includes: waking up the smart assistant in response to an operation on the second control, and displaying an image corresponding to the first area in a dialog box of the smart assistant; and obtaining the first memory information based on the content in the image.

[0028] In a possible implementation, the displayed content is the first text; wherein, before acquiring the first memory information, the method further includes: in response to the first user operation of the user on the first interface, copying the first text.

[0029] Based on this scheme, the electronic device can obtain memory information based on the copied text.

[0030] In one possible implementation, obtaining the first memory information includes: in response to an operation on a third control in a fifth interface of the intelligent assistant, displaying a first window on the fifth interface, the first window including a fourth control, the fifth interface displaying saved memory information, and the third control being used to add new memory information; in response to an operation on the fourth control, displaying the first text in the first window; extracting the first text from the first window to obtain the first memory information.

[0031] This solution can support users in obtaining memory information when they have memory needs by setting up an entry for users to add new memory information.

[0032] In one possible implementation, the displayed content is the first picture; wherein, before obtaining the first memory information, the method also includes: in response to the first user operation on the thumbnail of the first picture in the sixth interface, displaying the first interface, the first interface including the first picture.

[0033] Based on this solution, electronic devices can obtain memory information based on pictures.

[0034] In one possible implementation, obtaining the first memory information includes: performing text recognition on the first picture to obtain recognition text; in response to an operation on the fifth control in the first interface, displaying the seventh interface of the smart assistant, and displaying a second window on the seventh interface of the smart assistant, the second window including the recognition text; in response to an operation on the sixth control in the second window, obtaining the first memory information according to the recognition text.

[0035] In one possible implementation, obtaining the first memory information includes: in response to the first user operation on the seventh control in the first interface, obtaining the first memory information according to the first picture, the seventh control is located in the third window of the first interface, and the first picture is displayed in the third window.

[0036] In one possible implementation, before the first user operation on the thumbnail of the first picture in the second interface is responded, the method also includes: in response to the operation of the eighth control in the eighth interface of the smart assistant, displaying a fourth window on the eighth interface, the fourth window including a ninth control, the eighth interface displays saved memory information, and the eighth control is used to add new memory information; in response to the operation of the ninth control, displaying a first option and a second option in the fourth window, the first option being used to select a picture in the gallery, and the second option being used to take a picture; in response to the operation of the first option, displaying the sixth interface, the sixth interface including a thumbnail of at least one picture in the gallery.

[0037] In one possible implementation, before displaying the first memory information on the smart assistant, the method further includes: displaying a memory type matching the display content of the first interface and at least one attribute item corresponding to the memory type on the smart assistant.

[0038] In a possible implementation manner, some or all of the at least one attribute item are editable.

[0039] Based on this solution, users can edit attribute items according to their needs.

[0040] In one possible implementation, the smart assistant includes a tenth control, and the method also includes: in response to an operation on the tenth control, displaying a first menu bar, the first menu bar including multiple memory type options; in response to an operation on a first memory type option among the multiple memory type options, displaying the first memory type matching the display content of the first interface and at least one attribute item corresponding to the first memory type on the smart assistant.

[0041] Based on this solution, users can select memory types according to their needs to obtain the required memory information.

[0042] In a second aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors and a memory; the memory is coupled to the one or more processors; the memory is used to store computer program code, the computer program code includes computer instructions, and one or more processors call the computer instructions to enable the electronic device to execute the method shown in the first aspect above.

[0043] In a third aspect, an embodiment of the present application provides a chip, which is applied to an electronic device. The chip includes one or more processors, and the processor is used to call computer instructions so that the electronic device executes the method shown in the first aspect above.

[0044] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the method shown in the first aspect above is implemented.

[0045] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed by an electronic device, the electronic device implements the method shown in the first aspect above.

[0046] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figures 1 to 12 A user interface diagram for obtaining memory information provided in an embodiment of the present application.

[0048] Fig.13 is an exemplary flow chart of an information recording method provided in an embodiment of the present application;

[0049] Figures 14 to 17 is a schematic diagram of an interface showing memory types and corresponding attribute items provided in an embodiment of the present application;

[0050] Fig.18 is an exemplary flow chart of an information recording method provided in an embodiment of the present application;

[0051] Fig.19 It is a schematic diagram of a system architecture provided by an embodiment of the present application;

[0052] Fig. 20 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0053] Fig.21 It is a schematic diagram of the structure of the chip provided in the embodiment of the present application. DETAILED DESCRIPTION

[0054] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0055] The present application relates to an electronic device, which is provided with a display screen. For example, the electronic device may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an artificial intelligence (AI) device, a wearable device, an in-vehicle device (such as a car computer), a smart home device, or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.

[0056] In one technology, users can save screen information in the form of pictures by taking screenshots, such as train ticket information, hotel order information, movie ticket order information, and related card information. However, this method cannot help users understand and remember the content of the pictures. Moreover, when users need to find information, they need to manually browse pictures and search for the information they need from many pictures, which is a cumbersome process.

[0057] In order to solve the problem that it is inconvenient for users to obtain and search for information, the present application provides an information recording method, whereby an electronic device can actively or based on user triggering obtain information suitable for memory from pictures, texts, application interfaces, etc., and display and save the obtained memory information on an intelligent assistant, thereby reducing the operational complexity of information acquisition and improving user experience.

[0058] In this application, the intelligent assistant may also be referred to as a voice assistant, a smart assistant, an artificial intelligence (AI) assistant, a smart voice, a digital assistant, a virtual assistant, etc. It can be understood as an information processing system that can recognize natural language input in the form of voice and / or text to infer user intent, and perform corresponding actions based on the inferred user intent. In addition, the system can respond to user input through audible (such as voice) and visual (such as text, cards) output forms.

[0059] In the embodiment of the present application, the memory information can be displayed and saved in the form of a card on the smart assistant. It should be understood that the present application does not limit the form of displaying and saving the memory information. For example, the memory information can also be displayed and saved in the form of text or pictures on the smart assistant.

[0060] Exemplarily, the memory information may be address information, card information, or order information, etc. For example, the order information may be train ticket order information, movie ticket order information, hotel order information, attraction ticket order information, etc. The card information may be identity card information, passport information, business card information, etc. It should be understood that the present application does not limit what kind of information the memory information is.

[0061] In conjunction with the accompanying drawings, the following uses the smart assistant "Xiaoyi" as an example to illustrate the interaction between the user and the electronic device involved in obtaining memory information in different scenarios. It should be understood that "Xiaoyi" is an application (APP), which is only a specific example of a smart assistant. The smart assistant can also be other APPs or mini-programs, etc.

[0062] Scenario 1: Obtain memory information based on the application's display interface.

[0063] Figure 1 is a user interface diagram of actively acquiring memory information provided by an embodiment of the present application. Figure 1 In (a), interface 10 is the ticket order information interface, and interface 10 is the current display interface of an application of the electronic device. The electronic device actively obtains the memory information in interface 10. If the user has not switched the display interface, the electronic device wakes up (or pulls up or calls) Xiaoyi after obtaining the memory information. Figure 1 In (b), after Xiaoyi is awakened, its window 11 is displayed floating on the interface 10. A prompt message 12 is displayed in the window 11, and the prompt message 12 is used to prompt the user that the electronic device has obtained the memory information. If the user wants to save the memory information obtained from the interface 10, in one method, the user can input the same or substantially the same instructions as the prompt message in the window 11 through voice or text. For example, according to the prompt message 12, the user can issue voice instructions such as "note the screen information", "help me remember the screen information", "record the screen information", or "note the ticket information on the map". In another method, the user can click on the prompt message 12, and in response to the user clicking on the prompt message 12, the electronic device simulates the user issuing the "note the screen information" instruction. See Figure 1In (c), the user inputs the command "Note the screen information" through voice input or text input or clicks on prompt information 12, and the electronic device executes the command "Note the screen information" and displays the execution result, that is, "OK, I've got it for you" and card 13. The content in card 13 is the memory information obtained according to the display content on interface 10. Exemplarily, the electronic device can also voice broadcast "OK, I've got it for you" and / or the content in card 13. It should be noted that, similar to here, for any of the figures or embodiments described below, the content in the dialog box displayed in Xiaoyi and / or the content in the card can also be voice broadcast, which will not be repeated below.

[0064] In one example, the card 13 may also be Figure 1 (d) in . Figure 1 In (d), the card 13 may also include a picture 14 , which is a partial screenshot of the interface 10 , indicating that the time and location information in the card 13 comes from the interface 10 .

[0065] Figure 2 is a schematic diagram of another user interface for actively acquiring memory information provided by an embodiment of the present application. Figure 2 In (a), interface 20 is the movie ticket order information interface, and interface 20 is the current display interface of the electronic device. The electronic device actively obtains the memory information in interface 20. If the user has not switched interfaces, the electronic device wakes up Xiaoyi after obtaining the memory information. Figure 2 In (b), after Xiaoyi is awakened, its window 21 is displayed floating on the interface 20. The window 21 can display a prompt message 22, and the prompt message 22 is Figure 1 For example, the user clicks on the prompt information 22. In response to the user clicking on the prompt information 22, the electronic device simulates the user issuing and executing the "remember the screen information" command, and displays "OK, I'll remember it for you" and a card 23. The content of the card 23 is the memory information obtained according to the display content on the interface 20.

[0066] In one example, the card 23 may also be Figure 2 (d) in . Figure 2 In (d), the card 23 may also include a picture 24, where the picture 24 is the movie ticket collection QR code in the interface 20.

[0067] Figure 3 is another user interface schematic diagram of actively acquiring memory information provided by an embodiment of the present application. Figure 3In (a), interface 30 is the current display interface of the electronic device. The electronic device actively obtains the memory information in interface 30. If the user switches the electronic device interface from interface 30 to Figure 3 The interface 31 shown in (b) is shown in FIG. Figure 3 In (c), the electronic device displays a push notification 32 on the interface 31, and the notification 32 is used to remind the user of the memory information that is currently to be confirmed. Figure 3 In (d), the user clicks on notification 32 or enters interface 33 through the relevant path of the application corresponding to notification 32. Interface 33 is an interface for memory information to be confirmed. Interface 33 includes memory information to be confirmed, i.e., card 34, and controls 35 and 36 for users to save and delete memory information to be confirmed. For example, the user clicks on control 35, and in response to the user clicking on control 35, the electronic device will save card 34. Alternatively, the user clicks on control 36, and in response to the user clicking on control 36, the electronic device will delete card 34. It should be understood that interface 30 and Figure 1 The interface 10 shown is the same, the cards 34 and Figure 1 The cards 13 shown are identical.

[0068] It should be noted that the interface 33 may include one or more pieces of memory information to be confirmed. For example, after the electronic device displays the notification 32, the user does not enter the interface 33, but browses Figure 2 In addition, the electronic device obtains the memory information in the interface 20 and before the electronic device obtains the memory information, the user switches the electronic device interface from the interface 20 to another interface, such as Figure 3 Then, there will be two pieces of memory information to be confirmed, and the interface 33 will include the card 23 to be confirmed (such as Figure 2 (c) or Figure 2 d) and the card to be confirmed 34. Similarly, the user can save or delete the card 23 through the "save" control and "delete" control corresponding to the card 23.

[0069] Figure 4 Schematic diagram of a memory information management interface provided by an embodiment of the present application. Figure 4 Interface 40 is a memory information management interface, and interface 40 may include at least one card, and the content of the at least one card is the memory information acquired by the electronic device. For example, the at least one card is card 41 and card 42. Card 41 may be Figure 1 Card 13 shown. Figure 1 In the example shown, when the electronic device displays card 13 in window 11, interface 40 can save card 13. Alternatively, card 41 can be Figure 3Card 34 is shown. Figure 3 In the example shown, after the user clicks control 35, card 34 can be saved in interface 40. Card 42 can be Figure 2 Card 23 is shown. Figure 2 In the example shown, when the electronic device displays the card 23 in the window 21 , the interface 40 can save the card 23 .

[0070] Figure 4 The "Important Dates", "Common Addresses" and "Cards" shown are memory type labels. In one example, the user can view memory information belonging to different memory types by sliding the memory type labels left and right. In one example, card 41 and card 42 can be memory information of the memory type of important dates. It should be understood that card 41 and card 42 can also be memory information of other memory types (for example, orders). The memory types will be described in detail below and will not be described here for the time being.

[0071] It should be understood that Figure 4 In the example, only the interface 40 currently stores the card 41 and the card 42. It should be understood that if the electronic device also stores other memory information, it will be stored on the interface 40. The user can view all the cards by sliding the screen up and down.

[0072] In one example, the interface 40 and Figure 3 The interface 33 shown in (d) belongs to different pages in Xiaoyi, and the two can be switched between each other.

[0073] Figure 5 Schematic diagram of a user interface for obtaining memory information based on the display content of the display interface of the application based on a user trigger (ie, passively) provided in an embodiment of the present application. Figure 5 In (a), interface 50 is a movie ticket order information interface, and interface 50 is the current display interface of the electronic device. When the user wants to obtain the memory information in interface 50, he can wake up Xiaoyi. For example, the user can wake up Xiaoyi by voice inputting "Xiaoyi Xiaoyi, remember the screen information". Figure 5 In (b), after Xiaoyi is awakened by the user, its window 51 is displayed floating on the interface 50. After Xiaoyi executes the user's "remember the screen information" command and obtains the memory information in the interface 50, it displays "OK, I'll remember it for you" and card 52. The content in card 52 is the memory information obtained based on the display content of the interface 50. It should be understood that the interface 50 and Figure 2 The interface 20 shown is the same, the cards 52 and Figure 2 The cards 23 shown are identical.

[0074] In one example, Figure 4The card 42 shown may be a card 52. When the electronic device displays the card 52 in the window 51, Figure 4 The interface 40 shown may save the card 52 .

[0075] Figure 6 Another user interface diagram of an electronic device provided in an embodiment of the present application for acquiring memory information based on the display content of an application display interface based on a user trigger. Figure 6 In (a), interface 60 is a chat interface, and interface 60 is the current display interface of the electronic device. When the user wants to obtain the memory information in interface 60, he can wake up Xiaoyi. For example, the user can wake up Xiaoyi by voice inputting "Xiaoyi Xiaoyi, remember the screen information". Figure 6 In (b), after Xiaoyi is awakened, its window 61 is displayed floating on the interface 60. After Xiaoyi executes the user's "remember the screen information" command and obtains the memory information in the interface 60, it displays "OK, I'll remember it for you", cards 62 and 63, and the contents of cards 62 and 63 are the memory information in the interface 60 obtained by the electronic device.

[0076] In one example, card 62 and card 63 can also be stored in Figure 4 On the interface 40 shown.

[0077] As another example, if the electronic device obtains multiple memory information, it can also support the user to selectively save the memory information.

[0078] For example, see Figure 6 In (b), Xiaoyi can ask the user "There are multiple memory information identified, which ones do you want to remember?" and display the "Remember All" control and the "Remember Selected" control. If the user wants to save all memory information, he can click the "Remember All" control. Figure 6 In (c), in response to the user clicking the "write all" control, the electronic device may display "OK, all written down" and display card 62 and card 63 again, indicating that card 62 and card 63 have been saved. Figure 4 The interface 40 shown may display card 62 and card 63. If the user only wants to save one of the memory information, the user may click on the memory information to be saved, such as card 62, and then click on the "remember selected" control. In response to the user clicking on the "remember selected" control, the electronic device may display "OK, the selected has been remembered" and display card 62 again, indicating that card 62 has been saved. Further, at this time Figure 4The interface 40 shown may display card 62. In addition, the user may also instruct the electronic device to save card 62 and / or card 63 through voice or text. For example, if the user inputs "remember all" by voice, the electronic device saves card 62 and card 63. For example, if the user inputs "remember the first memory information" by voice, the electronic device saves card 62.

[0079] In some embodiments, if Xiaoyi is only awakened in the current display interface without being commanded to obtain the memory information of the current display interface, Xiaoyi can also automatically obtain the memory information in the current display interface, and display a prompt message on the Xiaoyi window after obtaining the memory information, prompting the user that the user electronic device has obtained the memory information. For example, the prompt message can be Figure 1 The prompt information 12 in the figure. After that, the interaction between the user and the electronic device can refer to Figure 1 or Figure 2 Description execution.

[0080] Scene 2: Obtain memory information based on the circled image.

[0081] Figure 7 This is a user interface diagram for obtaining memory information based on a user's circle selection operation provided by the present application. Figure 7 In (a), interface 70 is the current display interface of the electronic device. Interface 70 can be a picture in the gallery or an application interface. The user can enter the smart screen recognition by pressing the screen with two fingers or other triggering methods. By performing smart screen recognition on interface 70, interface 70 becomes Figure 7 The interface 71 shown in (b) in FIG. Figure 7 In (b), the user clicks the "picture circle" control 72 and then circles the content on the screen. Figure 7 In (c), according to the user's circle selection operation, the electronic device draws a corresponding line 73, and the area surrounded by the line 73 is the circled area. According to the content in the circled area, the electronic device can obtain the memory information.

[0082] For example, in one example, the user clicks the "memory generation" control 74. In response to the user clicking the control 74, the electronic device wakes up Xiaoyi. Figure 7In (d), after the electronic device wakes up Xiaoyi, it displays Xiaoyi's window 75, for example, window 75 can be displayed floating on interface 71. Window 75 displays the user's dialog box 76, and the electronic device simulates the user issuing a "note the content in the picture" instruction, wherein the picture 77 in dialog box 76 is the image corresponding to the circled area in interface 71. The electronic device executes the "note the content in the picture" instruction, obtains memory information based on picture 77, and then displays the execution result "OK, I've got it for you" and card 78, the content of which is the memory information obtained based on picture 77.

[0083] In another example, the user clicks the "memory generation" control 74. In response to the user clicking the control 74, the electronic device can obtain memory information based on the content in the circled area. After obtaining the memory information, the electronic device can prompt the user in the interface 71 that there is currently memory information to be confirmed, such as by pushing a notification to the user, and the user can save the memory information according to the prompt. For example, the notification is similar to Figure 3 In the notification 32 shown in (c) of FIG. 1 , the user can Figure 3 The memory information is saved in the interface shown in (d).

[0084] Scenario 3: Obtaining memory information based on text.

[0085] Figure 8 This is a schematic diagram of an interface for adding memory information through text provided by this application. Figure 8 In (b), interface 81 is Figure 4 A control 84 for adding memory information is added on the basis of the interface 40 shown, and the card 82 and the card 83 in the interface 81 can be the card 41 and the card 42 in the interface 41 respectively.

[0086] See also Figure 8 In (a), the user copies the information "I will buy a book for my daughter tomorrow" in interface 80 to the clipboard. Figure 8 In (b), the user enters the interface 81 and clicks the control 84 in the interface 81. In response to the user clicking the control 84, see Figure 8 In (c), a window 85 is displayed in the interface 81, and the window 85 is a smart memory extraction window. The user can click a control 86 in the window 85 to trigger the electronic device to automatically paste the text "I will buy a book for my daughter tomorrow" copied by the user to the clipboard.

[0087] In one example, the user's operation of clicking on the control 86 can also trigger the electronic device to obtain memory information based on "buying a book for my daughter tomorrow". Figure 8In (d), dialog box 87 and card 88 are presented in window 85. The content in dialog box 87 is the text "I will buy a book for my daughter tomorrow" copied by the user to the clipboard, and card 88 is the memory information obtained based on the text "I will buy a book for my daughter tomorrow". If the user wants to save the memory information, he clicks control 89 in window 85. In response to the user clicking control 89, the electronic device will save card 88. For example, in response to the user clicking control 89, window 85 is no longer displayed, and interface 80 will become Fig.10 The interface 100 shown is that the electronic device saves the card 88 in the memory information management interface. Optionally, the interface 100 may also include a prompt box 101, and the message "New memory information successfully added" in the prompt box 101 is used to remind the user that the memory information is successfully added.

[0088] In another example, after the electronic device automatically pastes the text "I will buy a book for my daughter tomorrow", the memory information can be obtained based on the user's trigger according to "I will buy a book for my daughter tomorrow". Fig. 9 In (a), a dialog box 87 and a control 90 for identifying content are presented in the window 85. After the user clicks the control 90 for identifying content, the electronic device obtains memory information based on the content in the dialog box 87 and displays the following information: Fig. 9 In one design, after the electronic device obtains the memory information, the prompt information 91 is no longer displayed, and the card 88 is displayed in the window 85. That is, after the electronic device obtains the memory information, the content displayed in the window 85 is as follows: Figure 8 As shown in (d) in the previous example, if the user wants to save the memory information, he clicks control 89. In response to the user clicking control 89, the electronic device saves card 88. In another design, after the electronic device obtains the memory information, it no longer displays window 85, but displays Fig.10 Interface 100 is shown.

[0089] Scene 4: Acquiring memory information based on pictures.

[0090] Fig.11 This is a schematic diagram of an interface for adding memory information through text in an image provided by this application. Fig.11 (a) in the interface 81, refer to the above Figure 8 The user clicks on the control 84. In response to the user clicking on the control 84, see Fig.11 In (b), the interface 81 displays a window 110, which is a smart memory extraction window. Figure 8In the window 85 shown in (c) of FIG. 1 , the window 110 also includes a "speech recognition" control and a "picture recognition" control. After the user clicks the "picture recognition" control, an option box 111 will be displayed in the window 110. The option box 111 includes two options, namely, a "gallery selection" option and a "photographing" option. Through the "gallery selection" option, the user can select a picture from the gallery; through the "photographing" option, the user can take a picture. For example, when the user clicks the "gallery selection" option, the electronic device presents Fig.11 In the interface 112 shown in (c) in the figure, the user can select a picture from the interface 112 for memory information acquisition. For example, after the user selects the picture 113 in the interface 112, the electronic device displays the following Fig.11 In the interface 114 shown in (d), the electronic device recognizes the picture in the interface 114 and obtains information in the picture, which is the content in the identification box 115. In response to the user clicking the control 116 in the interface 114, see Fig.11 In (e), the electronic device will obtain Fig.11 The information in the picture shown in (d) in FIG. 110 is “Shop transfer contact person: Ms. Zhang 130XXX”. The window 110 also includes a control 117, and the user can click the control 117. In response to the user clicking the control 117, the electronic device obtains the memory information according to “Shop transfer contact person: Ms. Zhang 130XXX”, and obtains the following information: Fig.11 Card 118 shown in (f) in FIG.

[0091] Fig.12 This is a schematic diagram of an interface for adding memory information through pictures provided by this application. Fig.12 (a) to Fig.12 Figure (c) and Fig.11 (a) to Fig.11 The same as Figure (c) in the figure, please refer to the above Fig.11 After the user selects the picture 113 in the interface 112, the display interface jumps to the interface 81, and the window 110 in the interface 81 displays the picture 113. In response to the user clicking the control 117 in the window 110, see Fig.12 In (e), the electronic device will obtain the memory information according to the image 113 and obtain the following Fig.12 Card 118 shown in (e) in FIG.

[0092] It can be seen that Fig.11 The example shown differs from the Fig.12 In the example shown, after the user clicks the thumbnail of picture 113, the electronic device does not display the following Fig.11The interface 114 shown in (d) does not recognize the image 113 either, but directly displays the image 113 in the window 110 and obtains the memory information based on the image 113.

[0093] It should be understood that the various operations described in the embodiments of the present application, such as clicking or sliding, are only possible operation examples for realizing the corresponding functions, and these operation examples shall not constitute any limitation to the present application. The names, patterns, positions, etc. of the controls in the user interface diagrams shown in the embodiments of the present application, as well as the arrangement of the contents in the user interface diagrams, are all examples, and these examples shall not constitute any limitation to the present application.

[0094] The information recording method provided by the present application is described below in conjunction with the user interface described above.

[0095] Fig.13 1300 is an exemplary flow chart of an information recording method provided by the present application. The method 1300 can be applied to the electronic device described above, for example, the method can be executed by an agent in the electronic device. The method 1300 can include S1310 and S1320. The steps of the method 1300 are described below.

[0096] S1310, obtaining first memory information.

[0097] The first memory information is information extracted based on the display content of the first interface and matched with a preset memory type, and the memory type corresponds to at least one attribute item. For example, the display content of the first interface may be all the content of the first interface, or may be part of the content in the first interface, such as text or pictures in the first interface.

[0098] In the embodiment of the present application, at least one memory type (also referred to as category or memory category or identification type, etc.) may be preset. For example, the memory type may be an important date, address, card, order, or matter (or event).

[0099] A memory type may include at least one attribute item. For example, the attribute items of an important date may include: name, related person, time, etc. The attribute items of an event may include: time, location, name, subject, etc.

[0100] For example, some memory types can be divided into multiple subtypes. When the subtypes are different, the attribute items corresponding to the memory types may be different. For example, an important day can include one or more of the following subtypes: birthday, anniversary, repayment day, exam day, payday. For example, an order can include one or more of the following subtypes: train ticket order, plane ticket order, or movie ticket order. For example, a card can include one or more of the following subtypes: business card, ID card, or driver's license.

[0101] For example, the attribute items of the memory type of the subtype train ticket may include: train number, departure station, destination station, time, ticket gate, seat number, etc. For example, see Figure 1 The card 13 shown has a memory information in its content, and the memory type corresponding to the memory information is order and the subtype is train ticket.

[0102] For example, the attribute items of the memory type with the subtype of driver's license may include: name, number, validity period, etc.

[0103] For example, if the first interface is a map-related application interface, the corresponding memory type may be an event or address, and the first memory information may include one or more of the following: time, address, name, card number, or event, etc. The event may be, for example, taxi ride, travel, etc. For example, if the first interface is a music-related application interface, the corresponding memory type may be an important date or event, and the first memory information may include one or more of the following: song name, singer, or song release time, etc.

[0104] It should be understood that the memory types and corresponding attribute items shown in the embodiments of the present application are merely illustrative and should not constitute any limitation to the present application.

[0105] In one implementation, the display content of the first interface can be matched with part or all of at least one preset memory type; if the display content of the first interface successfully matches a certain memory type, the matching information is used as the first memory information; or, if the display content of the first interface successfully matches multiple memory types, the matching information of the memory type with the most corresponding matching information can be used as the first memory information.

[0106] In another implementation, different interfaces or different contents may correspond to a memory type by default. If the display content of the first interface successfully matches the corresponding default memory type, the matching information may be used as the first memory information.

[0107] In another implementation, the user can select the memory type by himself / herself, and the display content of the first interface is matched with the self-selected memory type. If the match is successful, the matching information can be used as the first memory information.

[0108] It should be understood that the matching information is information of corresponding attribute items obtained through matching.

[0109] Exemplarily, the aforementioned matching operation may be performed by a large language model (LLM).

[0110] In some embodiments, the electronic device may perform corresponding processing according to the display content of the first interface to obtain the first memory information. For example, the electronic device may match the display content of the first interface with at least one preset memory type to obtain the first memory information.

[0111] In other embodiments, the electronic device may send the display content of the first interface or the preprocessing result obtained by preprocessing the display content of the first interface to the server, and the server may perform corresponding processing according to the display content of the first interface or the preprocessing result to obtain the first memory information. In this case, S1310 may specifically include: receiving the first memory information from the server. For example, the server may match the display content of the first interface with at least one preset memory type to obtain the first memory information. For example, the preprocessing may be, for example, visual analysis, interface framework analysis, and / or interface text recognition, and the corresponding preprocessing results may be, for example, application pages, texts, and / or image data with descriptions, etc. The application page may be, for example, an application name and / or a page name, etc.

[0112] S1320: Display the first memory information on the smart assistant.

[0113] For example, the first card may be displayed on the smart assistant, and the first card may include the first memory information. Alternatively, the first memory information may also be displayed in other forms, such as a picture.

[0114] According to the information recording method provided by the present application, the electronic device can obtain the first memory information and display the memory information on the smart assistant. The method does not require the user to memorize a large amount of information by themselves, and the required information can be obtained through the smart assistant at any time according to the needs, thereby reducing the operational complexity of information acquisition and improving the user experience.

[0115] In some embodiments, before S1320, the method may further include: obtaining a first user operation.

[0116] In one case, the first user operation is used to instruct to save the first memory information. In this case, the electronic device can execute S1320 in response to the first user operation.

[0117] In one example, before acquiring the first user operation, the method 1300 may further include: displaying prompt information. The prompt information is used to indicate that there is currently memory information to be saved.

[0118] Specifically, after the electronic device acquires the first memory information, it can display prompt information, and the user can perform a first user operation based on the prompt information. In response to the first user operation, the electronic device can display the first memory information on the smart assistant.

[0119] Based on this solution, the electronic device can actively obtain the first memory information, and after obtaining the first memory information, prompt the user to save the memory information through prompt information. The user can save the first memory information based on the prompt of the electronic device.

[0120] In another case, the first user operation is used to indicate the display content. In this case, the electronic device can execute S1310 in response to the first user operation.

[0121] Based on this solution, the electronic device can obtain the first memory information based on the user's trigger.

[0122] Exemplarily, the displayed content is one of the following: interface content of the first interface of the first application, display content in the first area of ​​the first interface, first text in the first interface, and first picture in the first interface.

[0123] The following describes in detail two situations in which the electronic device actively acquires the first memory information and passively (ie, based on a user's trigger) acquires the first memory information.

[0124] Actively obtain the first memory information

[0125] In some embodiments, S1310 may specifically include: scanning a display interface of a first application; acquiring first memory information according to display content of the currently scanned first interface, where the first interface is a display interface of the first application.

[0126] That is to say, the electronic device can actively obtain memory information based on the display interface of the application. Exemplarily, the electronic device can scan the display interface of the first application based on a preset period, or can scan the display interface of the first application when the display interface of the first application switches. It should be understood that for the same application, such as the first application, the interfaces scanned by the electronic device at different times may be different, where memory information may be obtained according to some interfaces, and memory information may not be obtained according to other interfaces. Failure to obtain memory information means that there is no information matching the relevant memory type in the interface.

[0127] Based on the above solution, the electronic device can actively obtain the first memory information without the need for user triggering, thereby eliminating the need for user-initiated operation steps.

[0128] For example, for the first interface currently being scanned, the application page, text and image data with description of the first interface can be extracted by combining visual analysis, interface framework analysis and / or interface text recognition, and then the first memory information can be obtained based on the application page, text and image data with description of the first interface. For example, the memory type adapted to the first application can be determined based on the application page, text and image data with description of the first interface, and then the corresponding schema can be called to generate a prompt for obtaining memory information, and the first memory information can be generated by calling LLM through the prompt.

[0129] Optionally, the first application may be a target application. The target application may also be referred to as a memory source. The electronic device may acquire memory information based on scanning a display interface of the target application.

[0130] For example, if the electronic device obtains memory information on the display interface of an application multiple times based on the user's trigger, the electronic device can use the application as a target application, or the user can mark the application as a target application. For example, if the number of times the electronic device obtains memory information on the display interface of an application based on the user's trigger is greater than a preset number (recorded as: N times), the electronic device can prompt the user in the current display interface whether to mark the application as a target application. The user can mark the application as a target application based on the prompt.

[0131] In one example, S1320 may specifically include: if the display interface is not cut out from the first interface, waking up the smart assistant, and displaying the first memory information in the dialog window of the smart assistant.

[0132] That is, the electronic device obtains the first memory information according to the first interface. If the display interface of the electronic device remains on the first interface when the first memory information is obtained, the electronic device can actively wake up the smart assistant and display the first memory information obtained according to the first interface on the smart assistant.

[0133] For example, the smart assistant can be Xiaoyi, and the first interface can be Figure 1 As shown in the interface 10, the first memory information can be Figure 1 If the user stays on interface 10, the electronic device wakes up Xiaoyi after acquiring the memory information based on interface 10, displays card 13 in window 11, and saves card 13 on Xiaoyi, such as saving it in Figure 4 In the interface 40 shown.

[0134] In another example, the displaying of the prompt information may specifically include: if the display interface is not cut out from the first interface, the prompt information is displayed in the dialog window of the smart assistant, and the dialog window of the smart assistant is displayed floating on the first interface.

[0135] Accordingly, S1320 may specifically include: in response to a first user operation on the dialog window of the intelligent assistant, displaying the first memory information in the dialog window of the intelligent assistant. That is, the electronic device obtains the first memory information according to the first interface. If the display interface of the electronic device still stays on the first interface when the first memory information is obtained, the electronic device can actively wake up the intelligent assistant and display the first prompt information in the dialog window of the intelligent assistant. Then, the user can perform a first user operation on the dialog window of the intelligent assistant, and in response to the first user operation, the electronic device can display the first memory information. For example, the user can enter a first user instruction in the dialog window of the intelligent assistant, and the first user instruction can be input by voice or text. The electronic device executes the first user instruction and displays the first memory information. Alternatively, the user can operate the prompt information, and the electronic device executes the instruction corresponding to the operation to display the first memory information.

[0136] The above scheme can support users to obtain memory information in voice interaction scenarios or non-voice interaction scenarios, and support guiding users to save memory information by prompting users through prompt information in scenarios where users have not switched display interfaces.

[0137] For example, the smart assistant can be Xiaoyi, and the first interface can be Figure 1 As shown in the interface 10, the first memory information can be Figure 1 If the user stays on interface 10, the electronic device will wake up Xiaoyi after acquiring the memory information based on the content on interface 10, and display prompt information 12 (an example of prompt information). The user can enter the first user instruction "remember the screen information" or click prompt information 12, and the electronic device will display card 13 and save card 13 on Xiaoyi, such as saving it in Figure 4 In the interface 40 shown.

[0138] For example, the smart assistant can be Xiaoyi, and the first interface can be Figure 2 As shown in the interface 20, the first memory information can be Figure 2 If the user stays on the interface 20, the electronic device will wake up Xiaoyi after acquiring the memory information based on the content on the interface 20, and will display the prompt information 22 (an example of the prompt information). The user can input the first user instruction "remember the screen information" or click the prompt information 22, and the electronic device will display the card 23 and save the card 23 on Xiaoyi, for example, Figure 4 In the interface 40 shown.

[0139] In yet another example, the displaying of the prompt information may include: if the display interface is switched from the first interface to the second interface, displaying the prompt information on the second interface.

[0140] Correspondingly, S1320 is specifically: in response to the first user operation on the prompt information, the first memory information is displayed on the third interface of the intelligent assistant, and the third interface includes the memory information to be saved (or called to be confirmed).

[0141] That is to say, the electronic device obtains the first memory information according to the first interface. If the display interface of the electronic device is no longer the first interface when the first memory information is obtained, such as the second interface, then the electronic device will push a prompt message to remind the user that there is currently memory information to be saved. The user can view the memory information to be saved on the third interface of the smart assistant according to the prompt information. For example, the user can click on the prompt information, and in response to the user clicking on the prompt information, the electronic device will display the third interface. Alternatively, the user can click on the APP icon corresponding to the prompt information, and after entering the APP, the user can enter the third interface by switching pages.

[0142] The above solution supports guiding the user to save the memory information by pushing a prompt message to the user when the user has switched the display interface. In this way, the user can not only perceive in real time that the electronic device has performed the operation of obtaining the memory information, but also save the obtained memory information at any time as needed.

[0143] For example, the first interface can be Figure 3 Interface 30 is shown. The electronic device obtains the first memory information according to the content of interface 30. If the display interface of the electronic device is interface 31 instead of interface 30 when the first memory information is obtained, the electronic device will display prompt information on interface 31, that is, notification 32. The user can click notification 32 or click the Xiaoyi icon or enter the third interface, such as interface 33, in other ways. The user can view the memory information to be saved in interface 33, that is, the content in card 34.

[0144] Furthermore, the third interface includes a confirmation control corresponding to the first memory information, and the method 1300 may also include: in response to an operation on the confirmation control, saving the first memory information on the smart assistant.

[0145] For example, in Figure 3 In the example shown, the confirmation control is control 35, and the user can click control 35. In response to the operation of clicking control 35, Xiaoyi will save card 34. For example, after Xiaoyi saves card 34, the user can Figure 4 View card 34 in the interface 40 shown, Figure 4 The card 41 in the figure is the card 34.

[0146] Passively acquiring the first memory information means acquiring the first memory information based on a user trigger.

[0147] Exemplarily, the electronic device can support multiple interactive methods such as voice and touch operations (for example, circling, drawing, text selection, etc.) to trigger the electronic device to obtain memory information based on the entire screen information or part of the information on the screen, thereby meeting the user's needs for obtaining memory information in different situations.

[0148] The following is an example of a method of passively acquiring the first memory information according to different display contents.

[0149] Example 1: The displayed content is the interface content of the first interface of the first application

[0150] In some embodiments, S1310 may specifically include: in response to a first user operation on a dialog window of the intelligent assistant, obtaining first memory information according to the interface content of the first interface. The dialog window of the intelligent assistant is displayed in a floating manner on the first interface, and the first interface is a display interface of the first application.

[0151] Based on this solution, users can obtain memory information by waking up Xiaoyi when they have memory needs.

[0152] Exemplarily, the first application may be a non-target application. As mentioned above, the electronic device can obtain memory information based on scanning the display interface of the target application. Then, for the non-target application, the electronic device can obtain memory information based on the user's trigger.

[0153] Exemplarily, the first user operation may be in the form of voice or text.

[0154] For example, the first interface can be Figure 5 In the interface 50 shown, the first memory information may be Figure 5 The content of the card 52 shown in the figure, the first user operation can be a user voice input Figure 5 The “Xiaoyi Xiaoyi, write down the screen information” command is shown.

[0155] Example 2: The displayed content is the content in the first area of ​​the first interface

[0156] In some embodiments, before S1310, the method may further include: determining the first area in response to a first user operation of the user on the first interface.

[0157] For example, the first user operation may be a circle selection operation or a line drawing operation, etc. Based on this solution, the user can perform a circle selection operation or a line drawing operation on the first interface, and the electronic device can obtain the first memory information according to the circled area or the line drawing content.

[0158] For example, the first interface can be Figure 7 The first area of ​​the interface 71 shown may be Figure 7 The area enclosed by line 73 shown in (d).

[0159] In one example, before determining the first area in response to a first user operation on the first interface, the method 1300 may also include: in response to an operation on a fourth interface, performing intelligent screen recognition on the fourth interface to obtain a first interface, the first interface including a first control; and in response to the operation on the first control, starting a circle selection function.

[0160] The fourth interface can be any display interface, such as a picture or an application page. For example, the fourth interface can be Figure 7 The user can perform smart screen recognition on the fourth interface by performing corresponding operations on the fourth interface. For example, the user can press the screen with two fingers on the interface 70, and in response to the user's operation of pressing the screen with two fingers, the electronic device performs smart screen recognition. By performing smart screen recognition on the interface 70, the electronic device will display the first interface, for example, the first interface can be Figure 7 The interface 71 shown in (b) in FIG. 1 is a diagram showing an interface 71 in which the first interface includes content obtained by intelligently identifying the fourth interface. The interface 71 may include a control 72 as a first control, and by clicking the control 72, the electronic device may start a circle selection function. After the electronic device starts the circle selection function, the user may circle the content in the interface 71 to obtain a first area, for example, the first area may be an area surrounded by a line 73.

[0161] In one implementation, the first interface also includes a second control; S1310 may specifically include: in response to an operation on the second control, waking up the smart assistant, and displaying an image corresponding to the first area in a dialog box of the smart assistant; and obtaining the first memory information based on the content in the image.

[0162] Correspondingly, S1320 may specifically include: displaying the first memory information in a dialog box of the smart assistant.

[0163] For example, see Figure 7 In (c), the second control may be control 74, and the user may click control 74. In response to the user clicking control 74, the electronic device may wake up Xiaoyi and Figure 7 The image in the circled area, i.e., the picture 77 in the dialog box 76, is displayed in the window 75 of Xiaoyi shown in (d) in the figure. Afterwards, the electronic device can simulate the user issuing and executing the "remember the content in the picture" instruction, and display the first memory information obtained according to the picture 77, i.e., the content in the card 78.

[0164] In another implementation, the method 1300 may further include: waking up the smart assistant after a preset time, and displaying an image corresponding to the first area in a dialog box of the smart assistant.

[0165] That is, in response to a first user operation of the user on the first interface, the smart assistant is woken up after a preset time after determining the first area in the first interface, and an image corresponding to the first area is displayed in a dialog box of the smart assistant.

[0166] For example, in Figure 7 In the example shown, after the electronic device displays line 73 based on the user's first operation in interface 71, it can wake up Xiaoyi after a preset time, such as 5 seconds, and Figure 7 The image in the circled area, i.e., the picture 77 in the dialog box 76, is displayed in the window 75 of Xiaoyi shown in (d) in the figure. Afterwards, the electronic device can simulate the user issuing and executing the "remember the content in the picture" instruction, and display the first memory information obtained according to the picture 77, i.e., the content in the card 78.

[0167] Example 3: The displayed content is the first text

[0168] In some embodiments, before S1310, the method may include: in response to a first user operation of a user on the first interface, copying a first text in the first interface.

[0169] For example, the first interface can be Figure 8 In the interface 80 shown, the second operation may be a copy operation, and the first text may be “I will buy a book for my daughter tomorrow”.

[0170] Based on the above solution, it is possible to obtain memory information based on part of the text in the display interface, thereby meeting the scenario requirement that the user only wants to remember the information in part of the text in the display interface.

[0171] In one example, S1310 may specifically include: in response to an operation on a third control in a fifth interface of the smart assistant, displaying a first window on the fifth interface, the first window including a fourth control, the fifth interface displays saved memory information, and the third control is used to add new memory information; in response to an operation on the fourth control, displaying a first text in the first window; extracting the first text from the first window to obtain first memory information.

[0172] Exemplarily, the fifth interface may be a memory information management interface of the intelligent assistant or an interface / page for users to manage memory information. Figure 8 In the interface 81 shown in (b), the third control may be the control 84 in the interface 81, and the first window may be Figure 8Window 85 shown in (c) in FIG. Control 84 is used to add memory information. The user can click on control 84. In response to the click operation on control 84, the electronic device will display window 85 on interface 81. Window 85 includes a fourth control, for example, the fourth control is control 86. The user can click on control 86. In response to the click operation on control 86, the first text "I will buy a book for my daughter tomorrow" that has been copied to the clipboard will be displayed in window 85. The electronic device can extract "I will buy a book for my daughter tomorrow" and obtain the first memory information based on "I will buy a book for my daughter tomorrow". For example, see Figure 8 In (d), in response to the click operation on the control 86, the window 85 not only displays the first text, but the electronic device can also extract "I want to buy a book for my daughter tomorrow", obtain the first memory information based on "I want to buy a book for my daughter tomorrow", and then display the first memory information, that is, the content in the card 88. For another example, see Fig. 9 As shown in (a), in response to a click operation on control 86, the first text is displayed in window 85, and control 90 is displayed, and control 86 is no longer displayed. The user can click control 90, and in response to the click of control 90, the electronic device can extract "buy a book for my daughter tomorrow", and after obtaining the first memory information based on "buy a book for my daughter tomorrow", card 88 is displayed. Furthermore, in the process of obtaining the first memory information, a prompt message can also be displayed, and the prompt message indicates that the first memory information is being obtained. For example, the prompt message can be Fig. 9 After the electronic device acquires the first memory information, the prompt information 91 may no longer be displayed.

[0173] Example 4: The displayed content is the first picture

[0174] In some embodiments, before S1310, the method may further include: in response to a first user operation on a thumbnail of a first picture in the sixth interface, displaying a first interface, wherein the first interface includes the first picture.

[0175] For example, the sixth interface can be Fig.11 In the interface 112 shown in (c), the first picture may be picture 113. The user may click on the thumbnail of picture 113. In response to the operation of clicking on the thumbnail of picture 113, the electronic device may display interface 114, which is an example of the first interface, and interface 114 includes picture 113.

[0176] Furthermore, S1310 may specifically include: performing text recognition on the first picture in the first interface to obtain recognized text; in response to the operation of the fifth control in the first interface, displaying the seventh interface of the intelligent assistant, and displaying a second window on the seventh interface of the intelligent assistant, and the second window includes recognized text; in response to the operation of the sixth control in the second window, obtaining the first memory information according to the recognized text.

[0177] For example, the first interface can be Fig.11 In the interface 114 shown in (d), the first picture may be picture 113, and the fifth control may be control 116 in the interface 114. The user clicks Fig.11 After the thumbnail of the picture 113 in the interface 112 shown in (c) is displayed, the electronic device not only displays the interface 114, but also performs text recognition on the picture 113 to obtain the text in the picture 113, that is, recognizes the text. Fig.11 In (d), the recognized text is the content in the recognition box 115. After obtaining the recognized text, the user can click the control 116. In response to the operation of clicking the control 116, the electronic device will display the seventh interface, such as Fig.11 In the interface 81 shown in (e), the interface 81 displays a second window, such as window 110, and the window 110 displays the identification text "Shop transfer contact: Ms. Zhang 130XXX". The window 110 may include a sixth control, such as control 117; the user may click on the control 117, and in response to the operation of clicking on the control 117, the electronic device will obtain the first memory information according to the identification text, for example, the first memory information obtained is Fig.11 The content of card 118 shown in (f) in FIG.

[0178] In some embodiments, S1310 may specifically include: in response to a first user operation on the seventh control in the first interface, obtaining first memory information according to the first picture in the first interface, the seventh control is located in the third window of the first interface, and the first picture is displayed in the third window.

[0179] For example, the first interface can be Fig.12 In the interface 81 shown in (d), the third window may be Fig.12 In the window 110 in the interface 81 shown in (d), the first picture may be a picture in the window 110, and the seventh control may be a control 117 in the window 110. The user may click the control 117, and in response to the operation of clicking the control 117, the electronic device may obtain the first memory information according to the picture in the window 110. For example, the first memory information may be Fig.12 The content of card 118 shown in (e) in FIG.

[0180] Optionally, before displaying the first interface in response to the first user operation on the thumbnail of the first picture in the second interface, the method 1300 may further include:

[0181] In response to the operation of the eighth control in the eighth interface of the smart assistant, a fourth window is displayed on the eighth interface, the fourth window includes a ninth control, the eighth interface displays the saved memory information, and the eighth control is used to add new memory information; in response to the operation of the ninth control, a first option and a second option are displayed in the fourth window, the first option is used to select a picture in the gallery, and the second option is used to take a photo; in response to the operation of the first option, the sixth interface is displayed.

[0182] Exemplarily, the eighth interface may be a memory information management interface or an interface / page for users to manage memory information. Fig.11 In the interface 81 shown in (a), the eighth control may be the control 84 in the interface 81, and the fourth window may be Fig.11 . The user can click on the control 84, and in response to the operation on the control 84, the electronic device can display the window 110. The ninth control can be the "Picture Recognition" control in the window 110, and the user can click on the "Picture Recognition" control. In response to the operation on the "Picture Recognition" control, the electronic device can display the "Gallery Selection" option (an example of the first option) and the "Photograph" option (an example of the second option). The user can click on the "Gallery Selection" option, and in response to the click operation on the "Gallery Selection" option, the electronic device can display the interface 112 (an example of the sixth interface), and the interface 112 includes a thumbnail of at least one picture in the gallery. The first picture can be the picture 113 in the display interface 112.

[0183] Based on the above scheme, memory information can be obtained based on the pictures in the gallery. In addition, memory information can also be obtained based on the pictures taken by the user by clicking the second option.

[0184] In some embodiments, the first memory information may include multiple memory information. The electronic device may selectively save part of the multiple memory information or save the multiple memory information according to the user's instructions or operations in the intelligent assistant. This solution can support the user's selective saving of memory information.

[0185] For example, see Figure 6In the example shown, the first memory information includes card 62 and card 63. The user can click the "Record All" control to save card 62 and card 63. Alternatively, the user can click card 62 and then click the "Record Selected" control. In response to the user clicking the "Record Selected" control, the electronic device will save card 62. Alternatively, window 61 may include controls such as "Record First Memory" and / or "Record Second Memory". For example, if the user clicks "Record First Memory", card 62 can be saved.

[0186] It should be understood that although the embodiments of the present application are only Figure 6 The illustrated scenario shows multiple pieces of memory information, but it should be understood that in the scenarios shown in other figures, the first memory information may also include multiple pieces of memory information.

[0187] In some embodiments, before S1320, the method 1300 may further include: displaying a memory type matching the display content of the first interface and attribute items corresponding to the memory type on the smart assistant.

[0188] For example, see Fig.14 The user interface diagram shown is Fig.14 The interface shown can be in response to the user's Fig.11 The interface diagram of the operation display of the control 117 shown in (e), or, Fig.14 The interface shown can be in response to the user's Fig.12 The interface diagram of the operation display of the control 117 shown in (d) in FIG. Fig.14 , window 110 includes the memory type: card certificate. Among them, the attribute items corresponding to the card certificate include: (1) Name: Ms. Zhang's business card; (2) Subject: Store transfer; (3) Type: Business card; (4) Number: 130XXX. It should be noted that "business card" is a subtype of card certificate. In addition, in some drawings, such as Fig.14 , Fig.15 or Fig.16 In the text, “memory type” can also be described as “recognition type”, or a similar or analogous description.

[0189] For example, see Fig.15 The user interface diagram shown is Fig.15 The interface shown can be in response to the user's Figure 8 (c) in FIG. 8 shows an interface diagram of the operation display of the control 86. Fig.15, window 85 includes a memory type: important day. The attribute items corresponding to the important day include: (1) name: buy a book for my daughter; (2) related person: daughter; (3) type: other; (4) date: 12 / 10. It should be noted that "other" is a subtype of important day. For example, important day can include one or more of the following subtypes: birthday, anniversary, repayment day, exam day, payday, or others.

[0190] For example, see Fig.16 In the user interface schematic diagram shown, window 161 may include multiple memory types and attribute items corresponding to each memory type, and this information is obtained based on "son's information: Wang XX; ID card: 420XXX11; phone: 123XXX12". Memory type 1 and memory type 2 shown in window 161 are the same, both are card certificates. It should be understood that whether multiple memory types are the same is determined by the first content, and multiple memory types may be the same or different. In the case where multiple memory types are the same, the subtypes of the multiple memory types may be the same or different.

[0191] When multiple memory types are displayed, controls for viewing each memory type may also be displayed. For example, see Fig.16 , the user can view all memory types in window 161 by sliding control 163 up and down.

[0192] Optionally, at least some of the attributes corresponding to the memory type can be edited. For example, see Fig.14 , the type and number can be edited. For example, see Fig.15 , type and date can be edited.

[0193] In some embodiments, in response to a user operation on memory information, a memory type and attribute information corresponding to the memory type are displayed.

[0194] For example, for Figure 4 As shown in the card 41, the user can click the card 41, and corresponding to the user's click operation, the electronic device can display the memory type and the attribute information corresponding to the memory type. Further, the user can also edit part or all of the attribute information.

[0195] In some embodiments, the smart assistant also includes a tenth control, and method 1300 may also include: in response to an operation on the tenth control, displaying a first menu bar, the first menu bar including multiple memory type options; in response to an operation on a first memory type option among the multiple memory type options, displaying a first memory type matching the display content of the first interface and at least one attribute item corresponding to the first memory type on the smart assistant.

[0196] That is, the electronic device can display the attribute items corresponding to the selected memory type according to the selection of the memory type by the user. It should be understood that when the memory type is different, the extracted memory information may be different.

[0197] For example, the tenth control could be Fig.17 The control 171 shown in FIG. 171, the first menu bar may be Fig.17 The menu bar shown in 172. See Fig.17 The example shown, Fig.17 The memory types and corresponding attribute items in each figure shown are obtained based on "Store transfer contact: Ms. Zhang 130XXX". Fig.17 The memory type shown in (a) of FIG. 1 may be the default memory type of the electronic device. If the user wishes to modify the memory type, the user may click on the control 171. In response to the operation of clicking on the control 171, the following information is displayed: Fig.17 The menu bar 172 shown in (b) of FIG. 1 includes various memory types. For example, if the user clicks on "item", in response to the operation of clicking on "item", the electronic device displays the attributes corresponding to "item" such as Fig.17 For example, if the user clicks "order", in response to the operation of clicking "order", the electronic device displays the attribute items corresponding to "order" as follows: Fig.17 As shown in (d) in FIG. 1 , it can be seen that when the memory type is an order, the electronic device does not obtain information matching the attribute item, and therefore does not obtain the first memory information.

[0198] In some embodiments, when displaying the memory type and the attribute information corresponding to the memory type, an eleventh control is also displayed; wherein S1320 specifically includes: in response to the operation on the eleventh control, displaying the first memory information.

[0199] For example, see Fig.14 Window 110 may further include a control 141, and the user may click on control 141. In response to the operation of clicking on control 141, the electronic device may display the following Fig.11 In the window 110 shown in (f), the memory type and the attribute information corresponding to the memory type are no longer displayed in the window 110, but the card 118 is displayed, and the card 118 is the first memory information. Alternatively, in response to the operation of clicking the control 141, the electronic device no longer displays the window 110, but displays the card 118 on the interface 81.

[0200] For example, see Fig.15 Window 85 may also include a control 151, and the user may click on the control 151. In response to the operation of clicking on the control 151, the electronic device may display the following Figure 8In the window 85 shown in (d), the memory type and the attribute information corresponding to the memory type are no longer displayed in the window 85, but the card 88 is displayed, and the card 88 is the first memory information. Alternatively, in response to the operation of clicking the control 151, the electronic device no longer displays the window 85, but displays the card 88 on the interface 81.

[0201] Fig.18 This is an exemplary flow chart of an information recording method provided by the present application. Fig.18 The steps in the method 1800 shown are described.

[0202] S1801, scanning the display interface of the application.

[0203] For example, the display interface of the application may be scanned based on a preset period, or the display interface may be scanned when the display interface is switched.

[0204] S1802: Determine whether the application to which the first interface of the application currently being scanned belongs is marked as a target application.

[0205] If the application to which the first interface belongs is marked as the target application, S1803, S1804, or S1805 may be executed, otherwise S1801 is continued to be executed.

[0206] In one example, if the electronic device obtains memory information from the display interface of the application multiple times based on the user's trigger, the electronic device can use the application as the target application, or the user can mark the application as the target application.

[0207] For example, when the electronic device obtains memory information based on the display interface of a certain application based on the user's trigger, it can also count the number of times that the memory information has been obtained based on the display interface of the application, which may or may not include this time. If the number is greater than the preset number, a pop-up window can be used to remind the user whether to mark the application as a target application. Based on the pop-up window reminder, the user can mark the application as a target application.

[0208] S1803, determining whether the first probability Ta exceeds a preset probability.

[0209] Among them, the first probability is the probability Ta that the user saves the first memory information obtained according to the first interface according to the target prompt. Among them, the target prompt is used to prompt that the memory information has been obtained or there is currently memory information to be confirmed. The user can save the memory information based on the target prompt. For example, the target prompt can be the first prompt information or the first notification mentioned above. Ta = the number of times the user saves the first memory information obtained according to the first interface according to the target prompt / the number of times the electronic device displays the target prompt.

[0210] For example, assuming the first interface is Figure 1 In the interface 10 shown, if the electronic device actively obtains the first memory information according to the interface 10 8 times, and the user saves the first memory information 5 times according to the prompt information 12, then Ta = 5 / 8. It should be understood that the user saves the first memory information according to the prompt information 12 means that the user clicks the prompt information 12 according to the prompt information 12 or the user inputs a command such as "remember the screen information".

[0211] If the execution result of S1803 is yes, S1804 or S1805 can be executed. If the execution result of S1803 is no, it can return to S1801 or execute S1804.

[0212] S1804: Determine whether the time interval from the last time (ie, the most recent time) the target prompt was displayed is greater than a threshold value Tt.

[0213] If the execution result of S1804 is yes, S1805 can be executed, otherwise it can return to S1801.

[0214] S1805: extract information from the first interface to obtain first content.

[0215] For example, the application page, text and image data with description of the first interface can be extracted by combining visual analysis, interface framework analysis and / or interface text recognition, and the content extracted based on the first interface is the first content.

[0216] S1806, determining whether the resolution value corresponding to the first interface is consistent with the resolution value of the display interface of the application obtained most recently.

[0217] Exemplarily, the parsed value may be calculated according to the first content corresponding to the display interface of the application, and the calculation may be a hash value, etc. It should be understood that the first content corresponding to different display interfaces of the application may be different.

[0218] In S1806, if it is determined that the parsing value obtained this time is consistent with the parsing value obtained last time, it is considered that the first interface is a display interface different from the display interface of the application scanned last time, then S1807 can be executed and the parsing value obtained this time can be recorded.

[0219] S1807, obtaining memory information according to the first content.

[0220] For example, the memory type adapted to the first application can be determined based on the application page, text and descriptive image data of the first interface, and then the corresponding mode is called to generate a prompt for obtaining memory information. The first memory information can be generated by calling LLM through the prompt.

[0221] S1808 or S1809 can be executed after S1807.

[0222] S1808, determining whether the memory information obtained in S1807 is memory information that has not been saved.

[0223] Compare with the currently saved memory information to confirm whether the memory information obtained in S1807 is the saved memory information. If it is, S1801 can be executed, otherwise, S1809 can be executed.

[0224] S1809, determining whether the display interface is still on the first interface.

[0225] That is, it is determined whether the display interface at this time is the first interface. If so, S1810 can be executed, otherwise S1811 can be executed. For the convenience of description below, when the display interface at this time is different from the first interface, the display interface at this time is referred to as: the second interface.

[0226] S1810, waking up the intelligent assistant and displaying the first prompt information in the dialog window of the intelligent assistant, that is, prompting the user to save the memory information in real time.

[0227] For this step, please refer to the description of the corresponding content in the previous text, which will not be repeated here.

[0228] S1812 may be executed after S1810.

[0229] In one example, for a display interface of an application, S1810 is executed once, and the number of times the electronic device displays the target prompt can be increased by 1. It should be understood that when S1810 is executed for the first time for a display interface of an application, the number of times the electronic device displays the target prompt is 1.

[0230] S1811, displaying a first notification on the second application interface, that is, prompting the user to save the memory information in a non-real-time manner.

[0231] For this step, please refer to the description of the corresponding content in the previous text, which will not be repeated here.

[0232] S1812 may be executed after S1811.

[0233] S1812, save memory information and / or user preference storage.

[0234] For details about saving memory information in S1810, S1811 and S1812, please refer to the description of the relevant solutions in the previous text, which will not be repeated here.

[0235] As mentioned above, the user can manually select the memory type, and the user preference storage in S1812 is used by the user to store the selection preference of the memory type for the application.

[0236] In one example, for a display interface of an application, S1812 is executed once, and the number of times the user saves the memory information obtained from the display interface according to the target prompt can be increased by 1. It should be understood that when S1812 is executed for the first time for a display interface of an application, the number of times the user saves the memory information obtained from the display interface according to the target prompt is 1.

[0237] According to the solution provided by the embodiment of the present application, when the user is browsing certain applications, the electronic device can actively obtain memory information, eliminating the user's triggering operation steps to obtain memory information. In addition, by learning the user's habit of receiving memory information, the electronic device can make automatic and intelligent memory information acquisition capabilities that are more in line with the user's expectations. At the same time, the method of saving memory information that supports real-time prompts and non-real-time prompts can be compatible with multiple user operation scenarios, and the recognized memory information can still be retained even after the user switches screens.

[0238] Fig.19 1900 is a schematic diagram of a system architecture provided by an embodiment of the present application. The system architecture 1900 may include one or more modules shown in the figure, and the functions of each module are described below.

[0239] Intelligent voice module 1910: The sound is used to obtain the corpus of the first memory information, such as "remember the screen information", and send instructions corresponding to the corpus to the memory trigger module 1914.

[0240] Clipboard module 1911: supports copying text in the display interface.

[0241] Screen touch module 1912: identifies the user's touch operation on the interface, for example, the operation may be two-finger pressing, clicking, etc.

[0242] Screen drawing module 1913: receives drawing instructions and draws lines / circles in the picture.

[0243] Memory trigger module 1914: receives signals / instructions sent by the intelligent voice module 1910, the screen touch module 1912 and the screen drawing module 1913, and passively triggers the acquisition of memory information; it can also actively trigger the acquisition of memory information according to the display interface of the application.

[0244] Information extraction module 1915: can combine visual analysis, interface framework analysis and / or interface text recognition and other technologies to extract application pages, text and / or image data with descriptions.

[0245] Memory middle station 1916: After receiving the content sent by the information extraction module 1915, it determines the memory type that matches the received content, and calls the corresponding mode to generate a prompt for the user to obtain the memory information, and calls the LLM through the prompt to generate the memory information. Furthermore, the memory information that is finally returned to the user can also be screened according to the user's preference for the memory type.

[0246] Exemplarily, the memory middleware can be deployed on the electronic device side or on the server side.

[0247] User memory preference recording module 1917: records the user's selection preference for the memory type of the application display interface.

[0248] Memory source confirmation module 1918: When it is recognized that memory information has been frequently obtained for the same application based on user triggers, it can consider reminding the user to mark this application as a memory source or target application, and support the electronic device to actively obtain memory information based on the display interface of the memory source.

[0249] Memory storage module 1919: used to store acquired memory information.

[0250] According to the system architecture provided in the embodiment of the present application, it is possible to support the acquisition of memory information according to different scenarios.

[0251] It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the system architecture. In other embodiments of the present application, the system architecture may include more or fewer modules than shown in the figure, or combine certain modules, or split certain modules, or arrange modules differently. The illustrated modules may be implemented in hardware, software, or a combination of software and hardware.

[0252] Fig. 20 The electronic device 2000 may include a processor 2010 , an external memory interface 2020 , an internal memory 2021 , an antenna 1 , an antenna 2 , a mobile communication module 2030 , a wireless communication module 2040 , and a display screen 2050 .

[0253] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 2000. In other embodiments of the present application, the electronic device 2000 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0254] The processor 2010 may include one or more processing units, for example, the processor 2010 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0255] The wireless communication function of the electronic device 2000 can be implemented through the antenna 1, the antenna 2, the mobile communication module 2030, the wireless communication module 2040, and the like.

[0256] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Figure 1 The structures of antenna 1 and antenna 2 in the electronic device 2000 are only examples. Each antenna in the electronic device 2000 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas.

[0257] The mobile communication module 2030 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 2000. The mobile communication module 2030 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 2030 may receive electromagnetic waves from the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.

[0258] The wireless communication module 2040 can provide at least one of the wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., applied to the electronic device 2000. The wireless communication module 2040 can be one or more devices integrating at least one communication processing module. The wireless communication module 2040 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 2010.

[0259] The electronic device 2000 implements a display function through a display screen 2050. The display screen 2050 is used to display an interactive interface and the like.

[0260] It should be understood that the electronic device 2000 can implement any technical solution of the present application.

[0261] An embodiment of the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the information recording method shown in the above embodiments is implemented.

[0262] The present application also provides a chip, see Fig.21 As shown, the chip includes a processor and a memory, in which a computer program is stored. When the computer program is executed by the processor, the information recording method shown in the above embodiments is implemented.

[0263] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the information recording method shown in the above embodiments is implemented.

[0264] An embodiment of the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a terminal device, the terminal device implements the information recording method shown in the above embodiments.

[0265] It should be noted that the click operation in this application is only an example, and the click operation can be replaced by touch, voice, etc. The names of pages / controls / windows provided in the embodiments of this application are also only examples and do not constitute any limitation to this application.

[0266] It should be understood that the processor mentioned in the embodiments of the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0267] It should also be understood that the memory mentioned in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (doubledatarate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synchlink DRAM, SLDRAM), and direct rambus RAM (DR RAM).

[0268] In the embodiments provided in the present application, the division of each framework or module is only a logical function division. There may be other division methods in actual implementation. For example, multiple frameworks or modules can be combined or integrated into another system, or some features can be ignored or not executed.

[0269] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0270] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0271] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0272] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0273] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An information recording method, characterized in that: include: Acquire first memory information, where the first memory information is extracted according to display content of the first interface, and the first memory information matches a preset memory type, and the memory type corresponds to at least one attribute item; The first memory information is displayed on the application.

2. The method according to claim 1, characterized in that Before displaying the first memory information on the application, the method further includes: A first user operation is acquired, where the first user operation is used to instruct saving the first memory information, or the first user operation is used to instruct the display content.

3. The method according to claim 2, characterized in that The first user operation is used to instruct saving the first memory information; Before obtaining the first user operation, the method further includes: A prompt message is displayed, where the prompt message is used to indicate that there is currently memory information to be saved.

4. The method according to claim 2, characterized in that The first user operation is used to indicate the display content, and the display content is one of the following: interface content of the first interface of the first application, display content in the first area of ​​the first interface, first text in the first interface, and first picture in the first interface.

5. The method according to claim 3, characterized in that The displayed prompt information includes: If the display interface is not cut out from the first interface, display the prompt information in the dialog window of the application, and the dialog window is displayed floating on the first interface; The step of displaying the first memory information on the application includes: In response to the first user operation on the dialog window, the first memory information is displayed in the dialog window.

6. The method according to claim 3, characterized in that The displayed prompt information includes: If the display interface is switched from the first interface to the second interface, displaying the prompt information on the second interface; The step of displaying the first memory information on the application includes: In response to the first user operation on the prompt information or in response to the first user operation on the application corresponding to the prompt information, the first memory information is displayed on a third interface of the application, and the third interface includes the memory information to be saved.

7. The method according to claim 6, characterized in that The third interface includes a confirmation control corresponding to the first memory information, and the method further includes: In response to an operation on the confirmation control, the first memory information is saved on the application.

8. The method according to any one of claims 2 to 7, characterized in that The obtaining of the first memory information includes: Scanning the display interface of the first application; The first memory information is acquired according to the first interface currently scanned, where the first interface is a display interface of the first application.

9. The method according to claim 8, characterized in that The first application is a target application, wherein the electronic device can obtain memory information based on scanning a display interface of the target application.

10. The method according to claim 4, characterized in that The displayed content is the interface content of the first interface of the first application; The obtaining of the first memory information includes: In response to the first user operation on the dialog window of the application, the first memory information is obtained according to the interface content of the first interface, and the dialog window is displayed in a floating manner on the first interface, which is a display interface of the first application.

11. The method according to claim 4, characterized in that The displayed content is the content in the first area of ​​the first interface; Before acquiring the first memory information, the method further includes: In response to the first user operation performed by the user on the first interface, the first area is determined.

12. The method according to claim 11, characterized in that Before determining the first area in response to the first user operation performed by the user on the first interface, the method further includes: In response to an operation on a fourth interface, performing intelligent screen recognition on the fourth interface to obtain the first interface, wherein the first interface includes a first control; In response to the operation of the first control, a circle selection function is started.

13. The method according to claim 12, characterized in that The first interface also includes a second control; The obtaining of the first memory information includes: In response to an operation on the second control, waking up the application and displaying an image corresponding to the first area in a dialog box of the application; The first memory information is acquired according to the content in the image.

14. The method according to claim 4, characterized in that The displayed content is the first text; Before acquiring the first memory information, the method further includes: In response to the first user operation of the user on the first interface, the first text is copied.

15. The method according to claim 14, characterized in that The acquiring the first memory information includes: In response to an operation on a third control in a fifth interface of the application, a first window is displayed on the fifth interface, the first window includes a fourth control, the fifth interface displays saved memory information, and the third control is used to add new memory information; In response to an operation on the fourth control, displaying the first text in the first window; The first text is extracted from the first window to obtain the first memory information.

16. The method according to claim 14, characterized in that The displayed content is the first picture; Before acquiring the first memory information, the method further includes: In response to the first user operation on the thumbnail of the first picture in the sixth interface, the first interface is displayed, and the first interface includes the first picture.

17. The method according to claim 16, characterized in that The obtaining of the first memory information includes: Performing text recognition on the first image to obtain recognized text; In response to an operation on a fifth control in the first interface, a seventh interface of the application is displayed, wherein a second window is displayed on the seventh interface of the application, and the second window includes the recognized text; In response to an operation on a sixth control in the second window, the first memory information is acquired according to the recognized text.

18. The method according to claim 16, characterized in that The acquiring the first memory information includes: In response to the first user operation on the seventh control in the first interface, the first memory information is obtained according to the first picture, the seventh control is located in the third window of the first interface, and the first picture is displayed in the third window.

19. The method according to any one of claims 16 to 18, characterized in that Before responding to the first user operation on the thumbnail of the first picture in the second interface, the method further includes: In response to an operation on an eighth control in an eighth interface of the application, a fourth window is displayed on the eighth interface, the fourth window includes a ninth control, the eighth interface displays saved memory information, and the eighth control is used to add new memory information; In response to an operation on the ninth control, a first option and a second option are displayed in the fourth window, wherein the first option is used to select a picture in a gallery, and the second option is used to take a picture; In response to an operation on the first option, the sixth interface is displayed, and the sixth interface includes a thumbnail of at least one picture in the gallery.

20. The method according to any one of claims 1 to 19, characterized in that Before displaying the first memory information on the application, the method further includes: A memory type matching the display content of the first interface and at least one attribute item corresponding to the memory type are displayed on the application.

21. The method of claim 20, wherein: Some or all of the at least one property item are editable.

22. The method according to claim 20 or 21, characterized in that The application includes a tenth control, and the method further includes: In response to the operation of the tenth control, displaying a first menu bar, the first menu bar including a plurality of memory type options; In response to an operation on a first memory type option among the multiple memory type options, the first memory type matching the display content of the first interface and at least one attribute item corresponding to the first memory type are displayed on the application.

23. An electronic device, characterized in that: The electronic device comprises: one or more processors and a memory; The memory is coupled to the one or more processors; The memory is used to store computer program codes, where the computer program codes include computer instructions. The one or more processors call the computer instructions to enable the electronic device to execute the method according to any one of claims 1 to 22.

24. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to call computer instructions so that the electronic device executes the method as described in any one of claims 1-22.

25. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 22 is implemented.

Images