Information processing method and apparatus, and electronic device and storage medium

By acquiring visible and invisible information from the screen and extracting target information, the problem of the inability to comprehensively and quickly record screen information in existing technologies is solved, and efficient information extraction is achieved.

WO2026237614A1PCT designated stage Publication Date: 2026-11-19GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2026/089902
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-05-12
Filing Date
2026-04-10
Publication Date
2026-11-19

AI Technical Summary

Technical Problem

Current technology cannot record screen information comprehensively and quickly.

Method used

By responding to information recording instructions, visible and invisible information in the screen information is obtained, and target information is extracted and recorded using preset rules.

Benefits of technology

It enables the rapid recording of target information from the screen, improving the efficiency and comprehensiveness of information extraction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2026089902_19112026_PF_FP_ABST
    Figure CN2026089902_19112026_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed in the embodiments of the present application are an information processing method and apparatus, and an electronic device and a storage medium. The method comprises: in response to an information recording instruction, acquiring screen information of a current page, wherein the screen information comprises in-screen visible information and in-screen invisible information, and the in-screen invisible information comprises content associated with the in-screen visible information; extracting at least one type of target information from the screen information; and recording the at least one type of target information. By means of the method, target information in screen information of a current page can be quickly recorded by means of an information recording instruction.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing methods, devices, electronic equipment and storage media

[0001] Cross-reference to related applications

[0002] This application claims priority to Chinese application No. 202510607134.8, filed on May 12, 2025, the entire contents of which are incorporated herein by reference for all purposes. Technical Field

[0003] This application belongs to the field of information processing technology, and specifically relates to an information processing method, apparatus, electronic device and storage medium. Background Technology

[0004] In related technologies, it is impossible to comprehensively and quickly record screen information when extracting it. Summary of the Invention

[0005] In view of the above problems, this application proposes an information processing method, apparatus, electronic device, and storage medium to improve the above problems.

[0006] In a first aspect, embodiments of this application provide an information processing method, the method comprising: in response to an information recording instruction, acquiring screen information of the current page, the screen information including visible information and invisible information within the screen, the invisible information including content associated with the visible information within the screen; extracting at least one target information from the screen information; and recording the at least one target information.

[0007] Secondly, embodiments of this application provide an information processing apparatus, the apparatus comprising: a first acquisition unit, configured to acquire screen information of the current page in response to an information recording instruction, the screen information including visible information and invisible information within the screen, the invisible information including content associated with the visible information within the screen; a second acquisition unit, configured to acquire at least one target information from the screen information; and a recording unit, configured to record the at least one target information.

[0008] Thirdly, embodiments of this application provide an electronic device, including one or more processors and a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to perform the methods described above.

[0009] Fourthly, embodiments of this application provide a computer-readable storage medium storing program code, wherein the above-described method is executed when the program code is run.

[0010] Fifthly, embodiments of this application provide a computer program product, including a computer program / instructions, which, when executed by a processor, implement the steps of the above-described method. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 shows a schematic diagram of an application scenario of an information processing method proposed in an embodiment of this application;

[0013] Figure 2 illustrates a schematic diagram of an application scenario for an information processing method proposed in an embodiment of this application.

[0014] Figure 3 shows a flowchart of an information processing method according to an embodiment of this application;

[0015] Figure 4 shows a schematic diagram of control triggering in one embodiment of this application;

[0016] Figure 5 shows a schematic diagram of a three-finger swipe-up trigger in one embodiment of this application;

[0017] Figure 6 shows a schematic diagram of the triggering of the favorite button in one embodiment of this application;

[0018] Figure 7 shows a flowchart of an information processing method according to another embodiment of this application;

[0019] Figure 8 shows a schematic diagram of the setting of the first control and the second control in another embodiment of this application;

[0020] Figure 9 shows a schematic diagram of the setting of the first control and the second control in another embodiment of this application;

[0021] Figure 10 shows a schematic diagram of the display of prompt information in another embodiment of this application;

[0022] Figure 11 shows a schematic diagram of the display of prompt information in another embodiment of this application;

[0023] Figure 12 shows a schematic diagram of the process described in steps S210-S240 in another embodiment of this application;

[0024] Figure 13 shows a flowchart of an information processing method according to another embodiment of this application;

[0025] Figure 14 shows a schematic diagram of the process described in step S320 in another embodiment of this application;

[0026] Figure 15 shows a schematic diagram of card switching in another embodiment of this application;

[0027] Figure 16 shows a schematic diagram of card switching in another embodiment of this application;

[0028] Figure 17 shows a schematic diagram of the effect of card switching in another embodiment of this application;

[0029] Figure 18 shows a schematic diagram of card stacking display in another embodiment of this application;

[0030] Figure 19 shows a schematic diagram of card switching after card stacking display in another embodiment of this application;

[0031] Figure 20 shows a flowchart of an information processing method according to another embodiment of this application;

[0032] Figure 21 shows a schematic diagram of the fusion acquisition framework in another embodiment of this application;

[0033] Figure 22 shows a schematic diagram of the process described in steps S410-S440 in yet another embodiment of this application;

[0034] Figure 23 shows a structural block diagram of an information processing device according to an embodiment of this application;

[0035] Figure 24 shows a structural block diagram of an information processing device according to an embodiment of this application;

[0036] Figure 25 shows a structural block diagram of an electronic device or server for performing an information processing method according to an embodiment of the present application.

[0037] Figure 26 illustrates a storage unit in this application for storing or carrying program code that implements the information processing method according to an embodiment of this application. Detailed Implementation

[0038] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0039] In the context of rapid iteration of intelligent systems, efficient extraction of screen information has become a core technological requirement in fields such as industrial control, mobile application testing, and accessibility services. The inventors discovered in their research on related information processing methods that these methods are unable to quickly record screen information.

[0040] Therefore, the inventors have proposed the information processing method, apparatus, electronic device, and storage medium of this application. First, in response to an information recording instruction, the screen information of the current page is acquired. Then, at least one target piece of information is acquired from the screen information, and the at least one target piece of information is recorded. Through the above method, and via the information recording instruction, target information in the screen information of the current page can be recorded quickly.

[0041] In one embodiment, the method provided by this embodiment may further include the following steps: if the at least one type of target information contains target information belonging to a target type, determine the application corresponding to the target information belonging to the target type; add the target information belonging to the target type to their respective corresponding applications.

[0042] In one embodiment, the method provided in this embodiment may further include the following steps: displaying a prompt message to ask whether to add the target information belonging to the target type to the corresponding application; and adding the target information belonging to the target type to the corresponding application in response to the confirmation message of the prompt message.

[0043] In one implementation, the target type includes at least one of schedules, to-do lists, and personally identifiable information.

[0044] In one embodiment, the method provided by this embodiment may further include the following process: if the at least one target information contains card data, generate and display the corresponding card based on the card data.

[0045] In one embodiment, the method provided in this embodiment may further include the following process: inputting the screen information into multiple pre-trained large models respectively, obtaining the target information of the screen information output by each of the multiple large models, so as to obtain at least one target information, wherein different large models are used to extract information from different types of screen information.

[0046] In one embodiment, the method provided in this embodiment may further include the following process: in response to an information recording instruction, determining whether the current page is in the page whitelist; if it is determined that the current page is in the page whitelist, obtaining the screen information of the current page.

[0047] In one embodiment, the method provided in this embodiment may further include the following steps: obtaining the information collection rules for the current page; if it is determined that the current page is in the page whitelist, obtaining the screen information of the current page based on the information collection rules.

[0048] In one embodiment, the information recording instruction is triggered by one of the following methods: key triggering, gesture triggering, voice triggering, page switching triggering, and control triggering.

[0049] In one embodiment, the visible information on the screen includes information currently displayed on the screen, and the invisible information on the screen includes content that is not currently displayed on the screen but is associated with the visible information on the screen.

[0050] In one embodiment, the method provided by this embodiment may further include the following steps: determining the target display duration of the prompt information based on the current display impact parameters, wherein different display impact parameters correspond to different target display durations; and displaying the prompt information based on the target display duration.

[0051] In one embodiment, the display influence parameters include at least one of the following: the display size of the prompt information, the pop-up method, and the light intensity.

[0052] In one embodiment, the method provided in this embodiment may further include the following process: displaying the prompt information corresponding to the target information in different forms according to the priority of the target information.

[0053] In one embodiment, the method provided by this embodiment may further include the following process: in response to a first operation applied to the card data, generating and displaying the corresponding card, wherein the first operation is at least one of a two-finger press operation, a long press operation, a click operation, or a swipe operation.

[0054] In one implementation, different types of card data are used to generate different types of cards.

[0055] In one embodiment, the method provided in this embodiment may further include the following process: displaying the card on the desktop or negative one screen of the electronic device.

[0056] In one embodiment, the method provided by this embodiment may further include the following process: when a button is detected to switch from a first state to a second state, it is determined that an information recording instruction has been triggered, wherein the button is used to trigger the information recording function.

[0057] In this embodiment of the application, the provided information processing method can be executed by an electronic device. In this manner, all steps of the information processing method provided in this embodiment of the application can be performed by the electronic device. For example, as shown in FIG1, the information acquisition device of the electronic device 100 can, in response to an information recording instruction, acquire the screen information of the current page. The screen information includes visible information and invisible information within the screen. The invisible information within the screen includes content associated with the visible information within the screen. Then, the acquired screen information is transmitted to the processor, so that the processor can extract at least one target information from the screen information in real time and record at least one target information.

[0058] Furthermore, the information processing method provided in this application embodiment can also be executed by a server (cloud). Correspondingly, in this method executed by the server, the electronic device can respond to the information recording instruction, obtain the screen information of the current page, and synchronously send the screen information to the server. Then, the server extracts at least one target information from the screen information in real time and records the at least one target information.

[0059] Alternatively, the process can be performed collaboratively by an electronic device and a server. In this collaborative manner, some steps of the information processing method provided in the embodiments of this application are performed by the electronic device, while other steps are performed by the server.

[0060] For example, as shown in FIG2, the electronic device 100 can perform an information processing method including: in response to an information recording instruction, obtaining the screen information of the current page, then having the server 200 extract at least one target information from the screen information, and then having the electronic device 100 record the at least one target information.

[0061] It should be noted that in this method where electronic devices and servers work together, the steps performed by the electronic devices and servers are not limited to those described in the examples above. In practical applications, the steps performed by the electronic devices and servers can be dynamically adjusted according to the actual situation.

[0062] It should be noted that the electronic device 100 can be, in addition to the smartphones shown in Figures 1 and 2, in-vehicle infotainment systems, wearable devices, tablets, laptops, smart speakers, etc. The server 200 can be a standalone physical server, a server cluster consisting of multiple physical servers, or a distributed system.

[0063] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0064] Please refer to Figure 3. An information processing method provided in this application embodiment is applied to an electronic device or server as shown in Figure 1 or Figure 2. The method includes:

[0065] Step S110: In response to the information recording instruction, obtain the screen information of the current page. The screen information includes visible information and invisible information on the screen. The invisible information on the screen includes content associated with the visible information on the screen.

[0066] In this embodiment, the information recording instruction is a triggered instruction for automatically collecting, preprocessing, and recording screen information of the current page. Collection refers to acquiring screen information; preprocessing refers to extracting target information from the screen information; and recording refers to writing the extracted target information into a preset storage area. The current page refers to a page that is currently displaying at least a portion of the screen on the electronic device. A partial area means that the current page may not be fully displayed on the screen. In this embodiment, regardless of the application scenario, as long as the information recording instruction is triggered, the screen information of the current page will be automatically acquired. The application scenario can be understood as the current operating scenario of the electronic device, such as a call scenario, navigation scenario, chat scenario, information browsing scenario, etc., and is not specifically limited here.

[0067] In one approach, the visible information on the screen includes information currently displayed on the screen, and the invisible information on the screen includes content that is not currently displayed on the screen but is associated with the visible information on the screen.

[0068] Visible information on the screen includes information currently displayed on the screen, referring to the information currently displayed on the screen for the current page. This can include text, images, links, controls, screenshots, page layout information, etc., without specific limitations. Invisible information within the screen includes content not currently displayed on the screen but associated with the visible information within the screen. "Associated" means that the invisible information within the screen can be a portion of the current page not displayed on the screen, or a portion of the current page that is not visible on the screen only when page-turning or scrolling down. For example, if the current page is a long document, the visible information within the screen can be the portion of text currently displayed on the screen, and the invisible information within the screen can be the portion of text not currently displayed on the screen. Optionally, in this embodiment, the invisible information within the screen can include screenshots, text, controls, jump links, page layout information, file paths, large image paths, etc., not currently displayed on the screen, without specific limitations. Jump links can support jumps to the original text or jumps to the application / mini-program.

[0069] Furthermore, to better meet users' information recording needs, the acquired screen information can include only the types of information the user wants to record. For example, if the user only wants to record text information on the current page, then when acquiring screen information for the current page, only the visible text information and the invisible text information on the current page can be acquired. The types of screen information acquired can be pre-set in the corresponding information collection rules.

[0070] In this embodiment of the application, the triggering method of the information recording instruction includes one of key triggering, gesture triggering, voice triggering, page switching triggering, and control triggering.

[0071] Button triggering refers to an electronic device having a dedicated button (which can be a physical button) for triggering information recording. When the user switches the button from a first state to a second state, it is determined that an information recording command has been triggered. The first state is the button's initial state, i.e., a state where the information recording function cannot be triggered. The second state is the state after switching from the initial state, i.e., a state where the information recording function can be triggered. Optionally, to facilitate control of the information recording function, the button in this embodiment may only include the first and second states. For example, as shown in Figure 4, the electronic device in Figure 4 has a button 110 on the right side for controlling the information recording function. When the button 110 is detected to be pressed, it is determined that an information recording command has been triggered.

[0072] Gesture triggering refers to determining that an information recording command is triggered when a specified operation is detected on the screen of an electronic device. The specified operation is a pre-set gesture that can trigger the information recording command, such as a multi-finger swipe up (e.g., a three-finger swipe up), a multi-finger left / right swipe, etc., without specific limitations. The specified operation on the screen can refer to a finger touching the screen, or a specified operation within a preset distance above the screen without the finger touching it. For example, as shown in Figure 5, gesture triggering is set to determine that an information recording command is triggered when a three-finger swipe up is detected on the screen.

[0073] Voice triggering refers to the ability to determine whether a message recording command has been triggered when a voice control command containing preset keywords is detected. Preset keywords are keywords that are pre-defined to trigger the message recording function; for example, preset keywords could be set to "message recording," "open message recording," etc., without specific limitations.

[0074] Page switching trigger refers to the ability to determine whether a message logging instruction is triggered when a switch to a specified page is detected. The specified page can be a pre-defined page that triggers the message logging function; for example, the specified page could be a page containing private information.

[0075] Control triggering refers to the ability to determine if a message recording instruction has been triggered when an operation on a specified control displayed on the screen is detected. The specified control can be a pre-defined virtual control that can trigger the message recording function. For example, as shown in Figure 6, the specified control can be a favorites button. In Figure 6, when a click operation on this favorites button 120 is detected, it can be determined that a message recording instruction has been triggered.

[0076] In this embodiment, the triggering of the aforementioned information recording instruction can be monitored in different ways. For example, page switching and control triggering can be implemented using control instrumentation technology, accessibility, AppSwitch, and other technologies; gesture triggering can be monitored using a touch sensor installed in the electronic device; voice triggering can be monitored using a voice recognition module installed in the electronic device; button triggering can be monitored using a listener installed in the electronic device, etc., without specific limitations.

[0077] When the information recording instruction is detected to be triggered in the above manner, the screen information of the current page is obtained in response to the information recording instruction.

[0078] Among the above-mentioned methods for triggering information recording commands, page switching triggering and control triggering can be understood as automatic triggering of information recording commands; key triggering, gesture triggering and voice triggering can be understood as manual triggering of information recording commands.

[0079] Step S120: Extract at least one target information from the screen information.

[0080] In this embodiment, the target information is information obtained by extracting target fields from screen information and summarizing them according to preset rules. The extracted target information can be of various types, where "type" refers to the category to which the extracted target information belongs, such as schedule, personal information, to-do items, text summary, structured information, etc. The preset rules are pre-set rules for obtaining target fields from screen information, and the target fields are pre-set fields to which the user wants to extract information belongs.

[0081] The information on the screen, including both visible and invisible information, can take many forms, such as text, images, numbers, special symbols, and patterns, without any specific limitations here.

[0082] When extracting at least one target information from screen information using preset rules, since screen information can exist in multiple forms, different preset rules can be used to extract different forms of screen information.

[0083] Specifically, after obtaining the screen information of the current page through step S110, at least one target information can be extracted from the obtained screen information of the current page according to preset rules.

[0084] Step S130: Record the at least one target information.

[0085] In this embodiment of the application, after obtaining at least one target information, the at least one target information can be recorded, where recording refers to saving the at least one target information.

[0086] When recording at least one type of target information, it can be stored in different forms depending on the category to which the target information belongs. For example, if the target information is schedule information, it can be recorded in the form of a schedule; if the target information is personal information, it can be recorded in an encrypted form, and so on. No specific limitations are made here.

[0087] In this embodiment of the application, when the information recording instruction is triggered, the processes described in steps S110, S120 and S130 can be performed automatically, that is, the process of collecting, preprocessing and recording screen information can be performed automatically.

[0088] The information processing method provided in this application first responds to an information recording instruction by acquiring the screen information of the current page, then acquires at least one target information from the screen information, and records the at least one target information. Through the above method, the target information in the screen information of the current page can be quickly recorded by means of the information recording instruction.

[0089] Please refer to Figure 7. An information processing method provided in this application embodiment is applied to an electronic device or server as shown in Figure 1 or Figure 2. The method includes:

[0090] Step S210: In response to the information recording instruction, obtain the screen information of the current page, the screen information including visible information on the screen and invisible information on the screen, the invisible information on the screen including content associated with the visible information on the screen.

[0091] Step S220: Extract at least one target information from the screen information.

[0092] Step S230: If the at least one type of target information contains target information belonging to a target type, determine the application corresponding to the target information belonging to the target type.

[0093] In this embodiment, the target type is a pre-defined information type for which corresponding target information needs to be written to a corresponding application. There can be one or more target types, which can be customized according to actual needs. For example, the target type can be a schedule, personal information, or to-do items. Specifically, target information of one or more target types can be written to one or more corresponding applications; for example, schedules, personal information, and to-do items can all be written to one or more corresponding applications. That is, target information of one target type can be written to one application, or target information of one target type can be written to multiple applications, or target information of multiple target types can be written to one application, or target information of multiple target types can be written to multiple applications.

[0094] As one approach, the mapping between target types and applications can be preset. After extracting at least one type of target information from the screen information, the application corresponding to each of the at least one type of target information can be determined based on the preset mapping between target types and applications.

[0095] In one approach, the target type includes at least one of schedules, to-do lists, and personally identifiable information.

[0096] The schedule can be further divided into various types, such as car rental schedules, travel itineraries, flight schedules, performance / movie schedules, train schedules, hotel check-in schedules, attraction ticket schedules, conference schedules, and general schedules, etc., without specific limitations here. In this embodiment, different schedules can each contain different fields, and the application corresponding to the target information of the schedule class can be a calendar, without specific limitations here. For example, as shown in the table below, a car rental schedule may include:

[0097] To-do refers to tasks that need to be completed within a certain period of time but have not yet been processed. In this embodiment of the application, to-do items can also be divided into various types, such as cooking to-do items, performance to-do items, purchase to-do items, and movie ticket to-do items, etc., without specific limitations here; different to-do items can also contain different fields, and the application corresponding to the to-do item can be a notepad or suggestion card, without specific limitations here.

[0098] Personal identification information can be categorized into various types, such as basic identification information and encrypted identification information, without further specific limitations here. Similarly, different types of personal identification information can contain different fields, and the application corresponding to personal identification information can be a password book, without further specific limitations here.

[0099] In the embodiments of this application, since different types of target information can contain different fields, when determining whether at least one type of target information contains target information of the target type, it can be determined by the fields it contains.

[0100] After identifying target information containing target types through at least one field of each target information, the application corresponding to the target information of the target type can be further determined based on the correspondence between target types and applications.

[0101] Step S240: Add the target information belonging to the target type to their respective applications.

[0102] In this embodiment of the application, after the application corresponding to the target information of the target type is determined by the aforementioned method, the target information of the target type can be written into the corresponding application. For example, the target information of the schedule can be written into the calendar, or the personal identity information can be written into the password book, or the to-do items can be written into the notepad or suggestion card, etc., without specific limitations.

[0103] As one method, adding the target information belonging to the target type to the corresponding application includes: displaying a prompt message to ask for confirmation whether to add the target information belonging to the target type to the corresponding application; and adding the target information belonging to the target type to the corresponding application in response to the confirmation message.

[0104] The prompt information is generated based on the target information and is used to prompt whether to add target information of the target type to the corresponding application. This prompt information can be displayed in a fluid cloud manner. Fluid cloud refers to the function of dynamically displaying the real-time status of high-priority tasks in the status bar, lock screen, notification center and other locations through capsule, bubble or card forms.

[0105] In this embodiment, the prompts corresponding to target information of different priorities can be displayed in different forms. Specifically, target information can be pre-divided into multiple priorities according to service priorities, and then the prompts corresponding to the target information can be displayed in different forms according to the priority of the target information. The service priority can be pre-defined according to needs or the system default, and the service priority can also be understood as the application priority. For example, target information can be pre-divided into high-priority target information, medium-priority target information, and low-priority target information according to service priorities. The prompts corresponding to high-priority target information can be displayed in card form, the prompts corresponding to medium-priority target information can be displayed in capsule form, and the prompts corresponding to low-priority target information can be displayed in bubble form, etc. The above display forms are just examples. Of course, the prompts can also be displayed in other ways, and no specific limitation is made here.

[0106] The confirmation message in the prompt indicates that target information of the target type has been added to the corresponding application. This confirmation message can be triggered by a specified control in the display interface that displays the prompt. The specified control in the display interface can be a "Yes" control, which confirms that target information of the target type has been added to the corresponding application.

[0107] Specifically, the display interface for displaying prompt information may include two types of controls: a first control and a second control. The first control is used to determine whether target information of the target type should be added to the corresponding application, and the second control is used to determine whether target information of the target type should be added to the corresponding application. In this embodiment, the first and second controls can be placed in different locations within the display interface for displaying prompt information. As one approach, the first and second controls can be placed in any display area outside the prompt information display area. For example, as shown in Figure 8, in display interface 201, display area 2011 is the area for displaying prompt information, and display area 2012 can be understood as the area outside the prompt information display area; the first and second controls can then be placed in display area 2012. Alternatively, the first and second controls can be placed within the prompt information display area of ​​the display interface, as shown in Figure 9; the first and second controls can be placed in display area 2011.

[0108] Furthermore, in the embodiments of this application, the setting method of the first control and the second control can be determined according to the display method of the prompt information. For example, if the prompt information is displayed in the current page in a fluid cloud manner, the first control and the second control can be set in the display area of ​​the prompt information; if the prompt information is displayed in a new display page in a fluid cloud manner, then the first control and the second control can be set in an area outside the display area of ​​the prompt information. Optionally, the first control and the second control can also be set in the display area of ​​the prompt information.

[0109] In this embodiment of the application, if there are multiple target information of the determined target type, multiple prompts can be displayed simultaneously when displaying the prompts corresponding to the target information of each target type, or multiple prompts can be displayed sequentially according to service priority. No specific limitation is made here.

[0110] When displaying multiple prompts simultaneously, since these prompts may be displayed in different formats, a preset layout can be used to display these different formats at different locations on the display page. The preset layout refers to the pre-defined display areas for the different formats of prompts. Optionally, the multiple formats of prompts can be displayed in a layered manner, as shown in Figure 10, or in a tiled manner, as shown in Figure 11; no specific limitation is made here.

[0111] When displaying multiple types of prompts in a tiled manner, if there are multiple identical prompts among them, these identical prompts can be displayed in a layered manner.

[0112] After determining that at least one type of target information contains target information belonging to a target type, and the application corresponding to the target information belonging to that target type, a corresponding prompt message can be generated based on the target information belonging to that target type. When an operation on the first control is detected, it is determined that a confirmation message for the prompt message has been triggered, and the target information belonging to that target type is added to the corresponding application. Specifically, when generating the prompt message based on the target information belonging to that target type, the prompt message may contain a specified field from the target information belonging to that target type. This specified field is a field representing the type of target information or a specific event. For example, the prompt message could be "Are you sure you want to add the current travel itinerary to your calendar?"

[0113] In this embodiment of the application, when displaying a prompt message, the target display duration of the prompt message can be determined based on the current display impact parameters.

[0114] The display impact parameters are parameters that affect the display of the information to be displayed. These parameters include at least one of the following: display size, pop-up method, and light intensity of the information to be displayed. Specifically, the display impact parameters may include only the display size of the information; or only the pop-up method; or only light intensity. The second type includes any two of the following: display size, pop-up method, and light intensity; or display size and light intensity; or pop-up method and light intensity. The third type includes parameters such as display size, pop-up method, and light intensity.

[0115] The prompt message can be at least one of text or image. When the prompt message is text, the display size refers to the font size, and the font can be any font supported by the electronic device. When the prompt message is an image, the display size refers to the image size. The prompt message can appear in two ways: actively and passively. Actively appearing means that a prompt related to a specific function module appears when that module is clicked; passively appearing means that random content is displayed when the electronic device is used naturally. In other words, actively appearing means the prompt message is triggered by a preset operation, while passively appearing means the prompt message appears automatically. The preset operation can be any operation performed on a function module of the electronic device, such as a click, swipe, or long press, and is not specifically limited here. The method of displaying the prompt message can be determined based on how the prompt message is generated.

[0116] Light intensity can refer to the ambient light intensity of an electronic device; alternatively, it can refer to the screen brightness of the electronic device. No specific limitation is made here. As one approach, when light intensity refers to the ambient light intensity of the electronic device, the current light intensity can be obtained by setting a photoelectric sensor within the electronic device.

[0117] The target display duration refers to the intended duration for the prompt message to be displayed on the screen of an electronic device. Different display impact parameters can correspond to different target display durations.

[0118] One approach is to categorize different types of display impact parameters into multiple levels, and then set different target display durations for different types of display impact parameters at different levels. This establishes a correspondence between display impact parameters and target display durations. Thus, after obtaining the current display impact parameter, the target display duration corresponding to the current display impact parameter can be determined based on the correspondence between the display impact parameter and the target display duration.

[0119] When the current display impact parameter is of one type, after obtaining the current display impact parameter, the target display duration corresponding to the current display impact parameter can be determined according to the correspondence between the display impact parameter and the target display duration, that is, the target display duration of the prompt message can be determined. When the current display impact parameter includes multiple types of parameters, the target display duration corresponding to each current display impact parameter can be determined first based on the correspondence between the display impact parameter and the target display duration, and then the target display durations corresponding to each of the multiple types of display impact parameters can be weighted and summed to obtain the target display duration of the prompt message.

[0120] As another approach, determining the target display duration of the prompt message based on the current display impact parameters can mean adjusting the display duration of the prompt message based on the current display impact parameters. Here, "adjustment" refers to adjusting the display duration based on a baseline display duration. The baseline display duration can be the default setting, or it can refer to the display duration of the prompt message under a set of default display impact parameters. For example, the baseline display duration could be the display duration of the prompt message when the display size is standard font, the lighting intensity is normal, and the pop-up method is active pop-up.

[0121] By associating different display impact parameters with the display duration of prompts, the display duration of prompts can be flexibly set, thereby helping users better read, write, and understand the prompts and improving the user's cognitive experience.

[0122] Optionally, in this embodiment of the application, after adding target information belonging to the target type to the corresponding application, at least one type of target information can also be recorded. Here, recording can refer to storing at least one type of target information in a preset storage area.

[0123] For example, the process described in steps S210-S240 can be as shown in Figure 12. Screen capture is triggered by means of buttons / gestures / voice (equivalent to the response to information recording instructions in this application) to obtain the screen information of the current page. After obtaining the screen information of the current page, at least one target information is extracted from the screen information through OCR (Optical Character Recognition) / parsing, key information extraction, classification and other operations. After at least one target information is extracted, it is identified whether the at least one target information contains target information of the type such as schedule / to-do / personal identity information. If so, the user is prompted in a fluid cloud manner whether to add the target information of the type such as schedule / to-do / personal identity information to the corresponding application. If the user confirms the addition, the target information of the type such as schedule / to-do / personal identity information is added to its respective application, and at least one target information and its created status are stored in a preset storage area. If there is no target information of the type such as schedule / to-do / personal identity information, or if the user confirms not to add it, at least one target information is directly stored in the preset storage area. The created status can include target information such as schedules / to-dos / personal identification information that has been added to the corresponding application, and the time when it was added to the corresponding application.

[0124] This application provides an information processing method that, in response to an information recording instruction, first acquires the screen information of the current page, then extracts at least one type of target information from the screen information. If the at least one type of target information contains target information belonging to a target type, the application corresponding to the target information of that target type is determined, and the target information of that target type is added to its respective application. This method allows for the rapid addition of target information of a target type to its corresponding application, improving the user experience.

[0125] Please refer to Figure 13. An information processing method provided in this application embodiment is applied to an electronic device or server as shown in Figure 1 or Figure 2. The method includes:

[0126] Step S310: In response to the information recording instruction, obtain the screen information of the current page. The screen information includes visible information and invisible information on the screen. The invisible information on the screen includes content associated with the visible information on the screen.

[0127] Step S320: Input the screen information into multiple pre-trained large models respectively, and obtain the target information of the screen information output by each of the multiple large models to obtain at least one target information, wherein different large models are used to extract information from different types of screen information.

[0128] In this application embodiment, multiple pre-trained large models are used to extract target information from different types of screen information; that is, different large models have different capabilities. For example, the multiple pre-trained large models can be OCR models, NER (Named Entity Recognition) models, and image classification and summarization models, etc. Specifically, the OCR model provides the ability to extract text from images; the NER model is used to extract schedule / personal identification information; and the image classification and summarization model is used for structured extraction, such as extracting movie ticket information from an order page. Different types can refer to image or text types, or they can refer to different fields being extracted.

[0129] Furthermore, multiple pre-trained large models can be deployed on cloud servers. When it is necessary to access the capabilities of multiple pre-trained large models, different AI (Artificial Intelligence) capability interfaces can be invoked to call large models with different capabilities. Each large model corresponds to one AI capability interface.

[0130] As one approach, multiple pre-trained large models can be invoked simultaneously. After obtaining the screen information, the screen information is input into the multiple pre-trained large models respectively, and at least one target information output by the multiple pre-trained large models is obtained.

[0131] Optionally, multiple pre-trained large models can also be deployed in electronic devices. When the capabilities of multiple pre-trained large models need to be invoked, they can be invoked directly in the electronic device.

[0132] After the target information of the screen information output by various large models is obtained, it can be further determined whether the target information output by the large model meets the security and compliance requirements. If it is safe and compliant, the target information is recorded; if it is not safe and compliant, the target information is discarded.

[0133] For example, the process described in step S320 can be illustrated in Figure 14, which includes both the electronic device and the cloud. The electronic device includes a screen recognition application and an AI unit, while the cloud provides backend services and is configured with various pre-trained large models (such as OCR models, NER models, etc.). When the recognition application extracts target information from the screen information of the current page, it can call the AI ​​capability interface in the AI ​​unit to invoke large models with different functions to distribute and process the screen information. Specifically, the screen information can be given to the large model, which extracts relevant fields to obtain at least one target information.

[0134] Step S330: Record the at least one target information.

[0135] Step S340: If the at least one target information contains card data, generate and display the corresponding card based on the card data.

[0136] In this embodiment, card data refers to target information that can generate cards. A card is a form of information presented to a user by an electronic device, and may include images, text, links, controls, and other information related to the same topic. Examples include weather cards, stock cards, and news cards. In this embodiment, a pre-trained data recognition model can be used to determine whether at least one type of target information contains card data. Specifically, at least one type of target information can be input into a pre-trained data recognition model, which can then identify the at least one type of target information and output the card data within that target information.

[0137] As one approach, cards can serve as entry points to corresponding applications (apps). Users can interact with the cards to open these applications, allowing the electronic device to display the app's interface and provide more detailed information. Furthermore, after opening the app, users can perform various actions within its interface to meet their needs. For example, a weather card might correspond to a weather app. By interacting with the weather card, users can open the weather app and view its interface. Users can then customize the information displayed on the weather card, check the weather conditions for a specific city, and so on, fulfilling their individual requirements.

[0138] In another way, the card can also serve as an entry point for one or more services provided by the application corresponding to the card. Users can open the services provided by the application corresponding to the card by operating the card, so that the electronic device presents the interface of the application corresponding to the card to the user.

[0139] The application can be a native application or a third-party application on the electronic device, without specific limitations. A native application is one that comes pre-installed on the electronic device and is displayed on the device's desktop upon first power-on. A third-party application, as opposed to a native application, is an application created by a third party and requires user installation on the electronic device. Optionally, the electronic device can be any of the following: mobile phone, tablet, desktop, laptop, ultra-mobile personal computer (UMPC), handheld computer, netbook, personal digital assistant (PDA), wearable electronic device, smartwatch, etc., without specific limitations.

[0140] Furthermore, in this embodiment, the card can be displayed on the desktop or the negative one screen of the electronic device, without specific limitations. The negative one screen refers to the user interface accessed by swiping right on the main screen of the electronic device until the leftmost split screen is reached. The negative one screen can be used to display quick service functions and notification messages, such as global search, shortcuts to specific pages of applications (payment codes, WeChat, etc.), instant information and reminders (express delivery information, expenditure information, commuting traffic conditions, ride-hailing information, schedule information, etc.), and monitored activities (football stands, basketball stands, stock information, etc.).

[0141] The desktop or the negative one screen can include multiple cards. The cards included on the desktop and the cards included on the negative one screen are different. The difference here can refer to at least one of the following: different card types, different content displayed on the cards, different applications corresponding to the cards, different services corresponding to the cards, etc.

[0142] In this embodiment, a corresponding card is generated in response to a first operation applied to the card data. The first operation can be at least one of a two-finger press, a long press, a tap, or a swipe, and is not specifically limited thereto. The two-finger press and long press operations can trigger card conversion operations on the card data, the tap operation can trigger card conversion operations on one type of card data, and the swipe operation can trigger card conversion operations on at least one type of card data, and is not specifically limited thereto.

[0143] In the embodiments of this application, different types of card data can generate different types of cards.

[0144] Different cards perform different functions, therefore each card has its own display rules. These rules include rules for generating the card's graphic style and color, as well as rules for displaying the data. For example, when a card displays a user's exercise status, different card colors represent the user's current exercise intensity based on the duration of the exercise. The data displayed on the card also includes the mapped user's exercise activity; for example, a walking silhouette icon is displayed when the user is walking, and a running silhouette icon is displayed when the user is running, and so on. The main purpose of these different display rules is to display the data on the card in a prominent way, making it easy for users to identify. Therefore, in this embodiment, differentiated displays that facilitate user identification can be applied to cards that perform different functions, rather than being limited to the implementation methods listed above.

[0145] After generating different cards based on different types of card data, they can be displayed according to the card display rules corresponding to each card.

[0146] In the application embodiment, since multiple cards may be generated simultaneously when generating cards based on card data, multiple cards can be displayed by switching between them. The card switching method can be assumed to be tap-to-switch. Referring to Figure 15, if a card switching command based on an upward swipe of card 1 is detected in Figure 15, card 1 will swipe upward to switch to the next card, as shown in Figure 16. In Figure 16, card 1 continues to swipe upward, and the next card is card 2, which also swipes upward. The final technical effect of the swipe operation is shown in Figure 17: card 1 disappears after swiping upward, while card 2 is displayed on the current screen.

[0147] Optionally, multiple cards can be displayed in a stacked manner. When displaying multiple cards in a stacked manner, the top card on the current display page can be switched by swiping or clicking. Specifically, when switching the top card on the current display page by swiping or clicking, clicking or swiping the top card once will switch that card to the bottom layer of the current display page. For example, as shown in Figure 18, which includes cards 1, 2, 3, 4, and 5, cards 1, 2, 3, 4, and 5 are currently stacked on display page 101, with card 1 displayed at the top layer, and cards 2, 3, 4, and 5 displayed one layer down in sequence. When a switching operation is detected on card 1, card 1 is displayed on the layer where card 5 was originally displayed, card 2 is displayed on the layer where card 1 was originally displayed, and the layers displayed for card 2, card 3, card 4 and card 5 are moved up one layer in sequence, as shown in Figure 19. Figure 19 is a schematic diagram after switching the display of card 1.

[0148] Optionally, when displaying multiple cards, they can be divided into two parts. One part of the cards can be displayed on the desktop of the electronic device, and the other part can be displayed on the negative one screen of the electronic device.

[0149] Of course, there are other ways to display the generated multiple cards, and no specific limitations are made here.

[0150] To facilitate users' viewing of various types of information, users can set up cards corresponding to different types of information, allowing electronic devices to display information of a certain type on a card-by-card basis, making it convenient for users to view information intuitively.

[0151] This application provides an information processing method that displays target information in the form of cards, which allows users to view the information intuitively and conveniently.

[0152] Please refer to Figure 20. An information processing method provided in this application embodiment is applied to an electronic device or server as shown in Figure 1 or Figure 2. The method includes:

[0153] Step S410: In response to the information logging instruction, determine whether the current page is in the page whitelist.

[0154] In this embodiment, the page whitelist may include a variety of pre-defined legal pages that users can access. The whitelist may store page identifiers for the legal pages that users are allowed to access. Therefore, when determining whether the current page is in the whitelist, the page identifier can be used to determine if the current page is in the whitelist. Specifically, if the page identifier of the current page can be found in the whitelist, then the current page is determined to be in the whitelist; conversely, if the page identifier is not found in the whitelist, then the current page is determined not to be in the whitelist. Here, the page identifier can be understood as an identifier that uniquely identifies a page; one page can correspond to one page identifier.

[0155] Step S420: If it is determined that the current page is in the page whitelist, obtain the screen information of the current page.

[0156] In this embodiment of the application, once it is determined that the current page is in the page whitelist, the screen information of the current page can be obtained through pre-set information collection rules.

[0157] As shown in Figure 21, the fusion acquisition framework can contain a variety of information acquisition rules, and through this fusion acquisition framework, the comprehensive acquisition of the screen information of the current page can be realized.

[0158] As one approach, obtaining the screen information of the current page if it is determined that the current page is in the page whitelist includes: obtaining the information collection rules of the current page; and obtaining the screen information of the current page based on the information collection rules if it is determined that the current page is in the page whitelist.

[0159] Different pages can have different information collection rules, and a page can have at least one information collection rule to comprehensively collect the target information on that page.

[0160] In this embodiment, the correspondence between pages and information collection rules can be pre-set. Once it is determined that the current page is in the page whitelist, the information collection rules for the current page can be determined based on the correspondence between the page and the information collection rules. After determining the information collection rules for the current page, the screen information of the current page can be obtained through the information collection rules for the current page.

[0161] Step S430: Extract at least one target information from the screen information.

[0162] Step S440: Record the at least one target information.

[0163] For example, the process described in steps S410-S440 can be shown in Figure 22. In Figure 21, the target information in the screen information can be quickly recorded through several steps such as triggering the information recording instruction -> extracting screen information -> preprocessing screen information -> storing -> manually writing -> querying and deleting.

[0164] The information processing method provided in this application collects screen information of the current page only after determining that the current page is in the page whitelist, and then collects the screen information of the current page according to the corresponding information collection rules. This can ensure that the collected screen information is valid. At the same time, different pages collect screen information through different information collection rules, which can achieve comprehensive collection of screen information of the current page.

[0165] Please refer to Figure 23. An information processing device 500 provided in this application embodiment includes:

[0166] The first acquisition unit 510 is used to acquire the screen information of the current page in response to the information recording instruction. The screen information includes visible information and invisible information on the screen. The invisible information on the screen includes content associated with the visible information on the screen.

[0167] In one approach, the first acquisition unit 510 is specifically used to respond to the information recording instruction to determine whether the current page is in the page whitelist; if it is determined that the current page is in the page whitelist, it acquires the screen information of the current page.

[0168] Alternatively, the first acquisition unit 510 is specifically used to acquire the information collection rules of the current page; if it is determined that the current page is in the page whitelist, the screen information of the current page is acquired based on the information collection rules.

[0169] The information recording instruction can be triggered by one of the following methods: key press, gesture, voice, page switching, or control.

[0170] Optionally, the first acquisition unit 510 is specifically used to determine that an information recording instruction has been triggered when the button is detected to switch from the first state to the second state, wherein the button is used to trigger the information recording function.

[0171] The second acquisition unit 520 is used to acquire at least one target information from the screen information.

[0172] In one approach, the second acquisition unit 520 is specifically used to input the screen information into multiple pre-trained large models respectively, and acquire the target information of the screen information output by each of the multiple large models, so as to obtain at least one target information, wherein different large models are used to extract information from different types of screen information.

[0173] The recording unit 530 is used to record the at least one target information.

[0174] In one manner, the recording unit 530 is specifically used to determine the application corresponding to the target information belonging to the target type if the at least one type of target information contains target information belonging to the target type; and to add the target information belonging to the target type to the respective corresponding application.

[0175] Alternatively, the recording unit 530 is specifically used to display a prompt message to ask whether to add the target information belonging to the target type to the corresponding application; in response to the confirmation message of the prompt message, the target information belonging to the target type is added to the corresponding application.

[0176] The target type includes at least one of schedule, to-do list, and personal identification information.

[0177] Optionally, the recording unit 530 is specifically used to determine the target display duration of the prompt information based on the current display impact parameters, wherein different display impact parameters correspond to different target display durations; and to display the prompt information based on the target display duration.

[0178] The display impact parameters include at least one of the following: the display size of the prompt information, the pop-up method, and the light intensity.

[0179] Optionally, the recording unit 530 is specifically used to display the prompt information corresponding to the target information in different forms according to the priority of the target information.

[0180] Optionally, referring to Figure 24, the device 500 may further include:

[0181] The generation unit 540 is configured to generate and display a corresponding card based on the card data if the at least one type of target information contains card data.

[0182] In one manner, the generation unit 540 is specifically used to generate and display the corresponding card in response to a first operation applied to the card data, wherein the first operation is at least one of a two-finger press operation, a long press operation, a click operation, or a swipe operation.

[0183] Different types of card data generate different types of cards.

[0184] Optionally, the generation unit 540 is specifically used to display the card on the desktop or negative one screen of the electronic device.

[0185] It should be noted that the device embodiments in this application correspond to the aforementioned method embodiments. The specific principles in the device embodiments can be found in the content of the aforementioned method embodiments, and will not be repeated here.

[0186] The following description, with reference to Figure 25, will illustrate an electronic device or server provided in this application.

[0187] Referring to Figure 25, based on the information processing method and apparatus described above, this application embodiment also provides another electronic device or server 800 capable of executing the aforementioned information processing method. The electronic device or server 800 includes one or more (only one shown in the figure) processors 802, a memory 804, and a network module 806 coupled together. The memory 804 stores programs capable of executing the contents of the aforementioned embodiments, and the processor 802 can execute the programs stored in the memory 804.

[0188] The processor 802 may include one or more processing cores. The processor 802 connects to various parts of the server 800 using various interfaces and lines, and performs various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 804, and by calling data stored in the memory 804. Optionally, the processor 802 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 802 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the displayed content; and the modem handles wireless communication. It is understood that the modem may also not be integrated into the processor 802 and may be implemented separately using a communication chip.

[0189] The memory 804 may include random access memory (RAM) or read-only memory (ROM). The memory 804 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 804 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as touch functionality, sound playback functionality, image playback functionality, etc.), and instructions for implementing the various method embodiments described below. For example, the memory 804 may store an information processing device. This information processing device may be the aforementioned device 500. The data storage area may also store data created during the use of the electronic device or server 800 (such as phone books, audio and video data, chat log data, etc.).

[0190] The network module 806 is used to receive and transmit electromagnetic waves, realizing the mutual conversion between electromagnetic waves and electrical signals, thereby communicating with communication networks or other devices, such as audio playback devices. The network module 806 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, user identity modules (SIM cards), memory, etc. The network module 806 can communicate with various networks such as the Internet, corporate intranets, and wireless networks, or communicate with other devices through wireless networks. The aforementioned wireless networks may include cellular telephone networks, wireless local area networks (WLANs), or metropolitan area networks (MANs). For example, the network module 806 can interact with base stations.

[0191] Please refer to Figure 26, which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of this application. The computer-readable storage medium 900 stores program code that can be called by a processor to execute the methods described in the above method embodiments.

[0192] The computer-readable storage medium 900 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 900 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 900 has storage space for program code 910 that performs any of the method steps described above. This program code can be read from or written to one or more computer program products. The program code 910 may be compressed, for example, in a suitable form.

[0193] This application provides an information processing method, apparatus, electronic device, and storage medium. First, in response to an information recording instruction, the method acquires the screen information of the current page, then acquires at least one target piece of information from the screen information, and records the at least one target piece of information. Through this method, target information from the screen information of the current page can be quickly recorded via the information recording instruction.

[0194] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of the present invention.

Claims

1. An information processing method, wherein, The method includes: In response to an information recording instruction, obtain the screen information of the current page, the screen information including visible information on the screen and invisible information on the screen, the invisible information on the screen including content associated with the visible information on the screen; Extract at least one target information from the screen information; Record at least one of the target information.

2. The method of claim 1, wherein, The recording of the at least one target information includes: If the at least one type of target information contains target information belonging to a target type, determine the application corresponding to the target information belonging to the target type; Add the target information belonging to the target type to their respective applications.

3. The method of claim 2, wherein, Adding the target information belonging to the target type to the corresponding application includes: A prompt message is displayed to ask for confirmation whether the target information belonging to the target type should be added to the corresponding application; In response to the confirmation message of the prompt, the target information belonging to the target type is added to the corresponding application.

4. The method of claim 3, wherein, The displayed prompt information includes: Based on the current display impact parameters, the target display duration of the prompt information is determined, wherein different display impact parameters correspond to different target display durations; The prompt message is displayed based on the target display duration.

5. The method of claim 4, wherein, The display impact parameters include at least one of the following: the display size of the prompt information, the pop-up method, and the light intensity.

6. The method of claim 4, wherein, The displayed prompt information includes: Based on the priority of the target information, the prompts corresponding to the target information are displayed in different forms.

7. The method of claim 2 or 3, wherein, The target type includes at least one of schedules, to-do lists, and personally identifiable information.

8. The method of any one of claims 1-7, wherein, The method further includes: If the at least one type of target information contains card data, the corresponding card is generated and displayed based on the card data.

9. The method of claim 8, wherein, The process of generating and displaying the corresponding card based on the card data includes: In response to a first operation applied to the card data, a corresponding card is generated and displayed, wherein the first operation is at least one of a two-finger press operation, a long press operation, a click operation, or a swipe operation.

10. The method of claim 8 or 9, wherein, Different types of card data generate different types of cards.

11. The method of claim 8 or 9, wherein, The card to be displayed includes: The card is displayed on the desktop or negative one screen of the electronic device.

12. The method of claim 1, wherein, Extracting at least one target information from the screen information includes: The screen information is input into multiple pre-trained large models to obtain the target information of the screen information output by each of the multiple large models, so as to obtain at least one target information. The different large models are used to extract information from different types of screen information.

13. The method of claim 1, wherein, The step of responding to the information recording instruction and obtaining the screen information of the current page includes: In response to an information logging instruction, determine whether the current page is in the page whitelist; If it is determined that the current page is in the page whitelist, obtain the screen information of the current page.

14. The method of claim 13, wherein, If it is determined that the current page is in the page whitelist, obtaining the screen information of the current page includes: Get the information collection rules for the current page; If it is determined that the current page is in the page whitelist, the screen information of the current page is obtained based on the information collection rules.

15. The method of any one of claims 1-14, wherein, The triggering mode of the information recording instruction comprises one of a key triggering, a gesture triggering, a voice triggering, a page switching triggering and a control triggering.

16. The method of claim 15, wherein, The key triggering comprises: When detecting that the key switches from a first state to a second state, it is determined that the information recording instruction is triggered, and the key is a key for triggering an information recording function.

17. The method of any one of claims 1-16, wherein, The visible information in the screen comprises information currently displayed in the screen, and the invisible information in the screen comprises content associated with the visible information in the screen and currently not displayed in the screen.

18. An information processing apparatus, comprising: The device comprises: A first obtaining unit is configured to obtain screen information of a current page in response to an information recording instruction, wherein the screen information comprises visible information in a screen and invisible information in the screen, and the invisible information in the screen comprises content associated with the visible information in the screen; A second obtaining unit is configured to obtain at least one target information from the screen information; A recording unit is configured to record the at least one target information.

19. An electronic device, comprising: The one or more programs are stored in the memory and configured to cause the one or more processors to perform the method of any one of claims 1-17.

20. A computer readable storage medium, wherein, The computer readable storage medium stores program codes, and the program codes are configured to cause a processor to perform the method of any one of claims 1-17 when the program codes are run by the processor.