Information collection method and device

Abstract

The invention discloses an information collection method and device, and belongs to the field of electronic equipment. The method comprises the steps of receiving first input of a user to a first interface; in response to the first input, obtaining input position information of the first input and control position information of a control collected in the first interface; under the condition that the control position information is obtained and it is determined that the input position information is matched with the control position information, collection information of the first interface is obtained, and the collection information refers to information needing to be collected in the first interface; and storing the collection information to a specified position.

Description

Technical Field

[0001] This application belongs to the field of electronic devices, and particularly relates to a method and device for information collection. Background Art

[0002] When users use applications such as video applications, audio applications, and information applications in electronic devices, they often trigger the collection control in the application to collect some interesting information for viewing again.

[0003] In the related art, different applications usually use different methods to identify whether the collection control is triggered, and store the relevant collection information in the storage space of the application itself after identifying that the collection control is triggered. The process of finding the collection content again is cumbersome, and it is inconvenient to centrally manage the collection information of multiple applications. Summary of the Invention

[0004] The purpose of the embodiments of this application is to provide a method and device for information collection, which can identify the input to the collection control in each application interface and uniformly save the collection information of each application interface to a specified location, facilitating the management of the collection information.

[0005] In a first aspect, the embodiments of this application provide a method for information collection, including:

[0006] Receiving a first input from a user to a first interface;

[0007] In response to the first input, obtaining the input position information of the first input and the control position information of the collection control in the first interface;

[0008] When the control position information is obtained and it is determined that the input position information and the control position information match, obtaining the collection information of the first interface, where the collection information refers to the information that needs to be collected in the first interface;

[0009] Storing the collection information to a specified location.

[0010] In a second aspect, the embodiments of this application provide an information collection device, including:

[0011] A receiving module, configured to receive a first input from a user to a first interface;

[0012] A processing module, configured to, in response to the first input, obtain the input position information of the first input and the control position information of the collection control in the first interface;

[0013] The processing module is further configured to, when the control position information is obtained and it is determined that the input position information and the control position information match, obtain the collection information of the first interface, where the collection information refers to the information that needs to be collected in the first interface;

[0014] The processing module is further configured to store the first collection information at a specified location.

[0015] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory. The memory stores a program or instruction that can run on the processor. When the program or instruction is executed by the processor, the steps of the method described in the first aspect are implemented.

[0016] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0017] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the method described in the first aspect.

[0018] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0019] In an embodiment of the present application, a first input of a user to a first interface is received. In response to the first input, the input position information of the first input and the control position information of the collection control in the first interface are obtained. When the control position information is obtained and it is determined that the input position information matches the control position information, it is determined that the first input is an input to the collection control in the first interface, and the collection information of the first interface is obtained. The collection information is stored at a specified location. In this embodiment, based on the input position information input by the user and the control position information of the collection control, it is identified whether the user's input is an input to the collection control. This identification method can be applied to any application, thereby improving the accuracy of identifying the input of the collection control. Moreover, in the present application, by storing the collection information at a specified location, it is convenient to manage and search for the collection information. Description of the Drawings

[0020] Figure 1 is a flowchart of an information collection method provided by some embodiments of the present application;

[0021] Figure 2 is a schematic diagram of a collection control provided by some embodiments of the present application;

[0022] Figure 3 is a schematic diagram of a news interface provided by some embodiments of the present application;

[0023] Figure 4 is a schematic diagram of a video interface provided by some embodiments of the present application;

[0024] Figure 5 It is a schematic diagram of an audio interface provided by some embodiments of the present application;

[0025] Figure 6 It is a schematic diagram of a public account interface provided by some embodiments of the present application;

[0026] Figure 7 It is a schematic diagram of the first - layer display interface of the collection information provided by some embodiments of the present application;

[0027] Figure 8 It is a schematic diagram of the second - layer display interface of the collection information provided by some embodiments of the present application;

[0028] Figure 9 It is a schematic diagram of the third - layer display interface of the collection information provided by some embodiments of the present application;

[0029] Figure 10 It is a schematic diagram of an information collection device provided by some embodiments of the present application;

[0030] Figure 11 It is a block diagram of an electronic device provided by some embodiments of the present application;

[0031] Figure 12 It is a schematic structural diagram of an electronic device provided by some embodiments of the present application. Detailed implementation manners

[0032] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are some, rather than all, of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0033] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually of the same category, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / ", generally represents an "or" relationship between the associated objects before and after.

[0034] Next, in conjunction with the accompanying drawings, the information collection methods, devices, equipment, storage media, and program products provided by the embodiments of the present application will be described in detail through specific embodiments and their application scenarios.

[0035] The information collection method provided by this application can be applied to the information collection scenario. The following will combine Figures 1-9 to elaborate in detail on the information collection method provided by the embodiments of this application. It should be noted that for the information collection method provided by the embodiments of this application, the execution subject can be an electronic device. In the embodiments of this application, taking the electronic device executing the information collection method as an example, the information collection method provided by the embodiments of this application will be described.

[0036] Refer to Figure 1 , which is the information collection method provided by the embodiments of this application. As Figure 1 shown, this method includes the following steps 110 - step 140. The following will be specifically described.

[0037] Step 110. Receive the first input from the user on the first interface.

[0038] In some embodiments of this application, the first interface is the interface of any application displayed on the screen of the electronic device. The user can browse the first interface on the electronic device and input on the first interface during the browsing process.

[0039] In some embodiments of this application, the first input refers to a touch input that is consistent with the touch input type used to trigger the collection control. For example, if the touch input used to trigger the collection control is: the user's single - click input on the collection control in the interface through a touch device such as a finger or a stylus, then the first input is a single - click input. Another example, if the touch input used to trigger the collection control is: the user's long - press input on the collection control through a touch device such as a finger or a stylus, then the first input is a long - press input. Among them, the touch input used to trigger the collection control can be preset according to the actual situation, and this embodiment does not make specific limitations. For example, the touch input used to trigger the collection control includes, but is not limited to, the user's click input on the collection control through a touch device such as a finger or a stylus. The click input in the embodiments of this application can be a single - click input, a double - click input, or a click input of any number of times, etc., and can also be a long - press input or a short - press input.

[0040] In some embodiments of the present application, the electronic device can monitor touch events on the screen in real time. After the user makes a touch input on the first interface displayed on the electronic device through a finger or a touch device, the driver layer of the electronic device can feedback the reported point data of the touch input. After the electronic device performs calculations on the reported point data through relevant algorithms, it can obtain touch point information such as the touch point coordinates, touch state information, and touch time of the touch input. The touch state information is used to indicate whether it is a pressed state, a moved state, or a lifted state. Based on the touch point information, the type of the touch input can be determined. By comparing the determined type of the touch input with the type of the touch input used to trigger the favorite control, it is determined whether the touch input of the user on the first interface is the first input. Specifically, if the determined type of the touch input is the same as the type of the touch input used to trigger the favorite control, it is determined that the touch input of the user on the first interface of the electronic device is the first input; otherwise, it is determined that the touch input of the user on the first interface of the electronic device is not the first input. For example, the user makes a touch input on the first interface displayed on the electronic device through a finger. Based on the touch point information of the touch input, it is determined that the position coordinates of the user's finger press are P1(x1, y1), the time of the finger press is T1, the position coordinates of the finger lift are P2(x2, y2), and the time of the finger lift is T2. If there is no obvious coordinate movement between the user's finger press and lift, that is, the offset distance between P1(x1, y1) and P2(x2, y2) is less than the distance threshold, and the interval between T1 and T2 is less than the time threshold, it is determined that the type of the touch input entered by the user is a click input. At this time, if the type of the touch input pre-set for triggering the favorite control is a click input, it is determined that the touch input entered by the user is the first input; if the type of the touch input pre-set for triggering the favorite control is other types than a click input, it is determined that the touch input output by the user is not the first input. Another example is that if the offset distance between P1(x1, y1) and P2(x2, y2) is less than the distance threshold, but the interval between T1 and T2 is greater than or equal to the time threshold, it is determined that the type of the touch input entered by the user is a long press input. At this time, if the type of the touch input pre-set for triggering the favorite control is a long press input, it is determined that the touch input entered by the user is the first input; if the type of the touch input pre-set for triggering the favorite control is other types than a long press input, it is determined that the touch input entered by the user is not the first input.

[0041] Step 120. In response to the first input, obtain the input position information of the first input and the control position information of the favorite control in the first interface.

[0042] In some embodiments of the present application, when the electronic device determines that the touch input of the user in the first interface is the first input, it determines that the user may be inputting to the favorite control in the first interface at this time. At this time, in order to further determine whether the first input is an input to the favorite control in the first interface, the input position information of the first input and the control position information of the favorite control in the first interface are obtained, so as to determine whether the first input is an input to the favorite control in the first interface based on the input position information and the control position information. Among them, the input position information of the first input includes the touch point coordinates in the touch point information of the first input. The control position information is used to indicate the position of the favorite control in the current interface in the current interface.

[0043] In some embodiments of the present application, the manifestation form of the favorite control in the interface is a favorite control icon, and the favorite control icon includes but is not limited to image symbols, images, text, etc. For example, as Figure 2 shown, where the favorite control icon 210 is a star symbol. Based on this, the control position information can be the position coordinates of the favorite control icon in the interface. In this way, the regional position of the favorite control icon in the interface can be determined according to the control position information.

[0044] In some embodiments of the present application, in order to enable the control position information of the favorite control to represent the regional position of the favorite control in the interface, the control position information may include the position coordinates of at least two corner points of the favorite control icon. For example, as Figure 2 shown, the control position information may include the position coordinates I1(m1, n1) of the upper left corner point of the favorite control icon in the interface and the position coordinates I2(m2, n2) of the lower right corner point in the interface. In this way, the regional position REC1 of the favorite control in the interface can be determined according to the control position information.

[0045] In the related art, there are mainly the following two solutions for identifying whether the favorite control in the application is triggered: One solution is to take a screenshot of the area corresponding to the input position of the user in the application interface to obtain an area screenshot, and then perform a pixel-level comparison between the area screenshot and the icon of the favorite control that has been stored in the application. If the two are the same, it is determined that the favorite control is triggered. The disadvantage of this solution is that the position, color, size, etc. of the favorite control in each application may change. Therefore, the pixel-level comparison is easily invalidated. Another solution is to obtain the name of the favorite control, such as "Favorite", through the Android native accessibility service, and then determine whether the favorite control is triggered based on the text at the user input position. The disadvantage of this solution is that many favorite controls on the interface do not have text such as "Favorite". Therefore, the applicable scope of this solution is limited, and at the same time, the accessibility method consumes a large amount of performance and cannot be used universally in multiple applications.

[0046] It can be seen that the current related technologies cannot accurately identify whether the favorite controls of multiple different applications are triggered. In view of this, the embodiments of the present application provide a new solution for identifying whether a favorite control is triggered, which can determine whether the user's input is an input to the favorite control in the first interface currently displayed based on the user's input position information and the control position information of the favorite control in the interface. This solution is applicable to any application, and the recognition accuracy is significantly improved compared with the traditional pixel-level comparison, and it can also avoid the performance risks caused by relying on native services.

[0047] Step 130. When the control position information is obtained and it is determined that the input position information matches the control position information, obtain the favorite information of the first interface, where the favorite information refers to the information that needs to be favored in the first interface.

[0048] In some embodiments of the present application, when the control position information of the favorite control in the first interface is obtained, it can be determined that the favorite control is stored in the first interface. At this time, the input position information of the first input can be compared with the control position information. If the position represented by the input position information is within the position represented by the control position information, it is determined that the input position information matches the control position information, so as to determine that the first input is the user's input to the favorite control in the first interface. For example, the first input is a click input, and in the input position information of the first input, P1 = P2 are both (x1, y1), and the control position information includes the upper left corner point coordinates I1(m1, n1) and the lower right corner point coordinates I2(m2, n2) of the favorite control icon. Then, when m1 < x1 < m2 and n1 < y1 < n2 are satisfied, it is determined that the position represented by the input position information of the first input is within the position REC1 represented by the control position information, so as to determine that the first input is the user's input to the favorite control in the first interface.

[0049] In some embodiments of the present application, when the electronic device determines that the first input is the user's input to the favorite control in the first interface, it is determined that the user needs to favor the relevant information in the first interface. At this time, the favorite information of the first interface is obtained. Among them, the favorite information refers to the information that currently needs to be favored in the first interface. The favorite information includes all the information in the first interface or part of the information in the first interface. The types of favorite information include but are not limited to pictures, texts, links, etc.

[0050] In addition, in some embodiments of the present application, if the control position information of the favorite control in the first interface is not obtained, it can be determined that there is no favorite control in the first interface. Therefore, it can be determined that the first input is not an input to the favorite control in the first interface, and thus there is no need to obtain the favorite information of the first interface.

[0051] Step 140. Store the favorite information at a specified position.

[0052] In some embodiments of the present application, the designated location is a specific path or folder designated in advance for storing favorite information. The favorite information in any interface can be stored at this designated location, which facilitates centralized management and search of the favorite information.

[0053] In the related art, usually the favorite information of each application is respectively collected into the storage spaces corresponding to each application. When the user searches for the required favorite information, the user needs to open each application separately, which is cumbersome and inefficient. By storing the storage information of all interfaces at the designated location, when the user searches for the required favorite information, the user does not need to search for the favorite information separately in different applications, and can perform operations such as browsing, sorting, and deleting all the favorite information at this designated location, which greatly saves time and effort and improves the management efficiency.

[0054] The information collection method provided in this embodiment receives a first input from the user on a first interface. In response to the first input, the input position information of the first input and the control position information of the favorite control in the first interface are obtained. When the control position information is obtained and it is determined that the input position information matches the control position information, it is determined that the first input is an input to the favorite control in the first interface, and the favorite information of the first interface is obtained, and the favorite information is stored at the designated location. In this embodiment, based on the input position information input by the user and the control position information of the favorite control, it is identified whether the user's input is an input to the favorite control. This identification method can be applied to any application, thereby improving the accuracy of identifying the input of the favorite control. Moreover, in this application, by storing the favorite information at the designated location, it is convenient to manage and search for the favorite information.

[0055] In some embodiments, the positions and descriptions of the favorite controls in different applications are different. In view of this, in order to accurately identify whether there is a favorite control in the first interface and obtain the position information of the favorite control. Before the above step 120, a control recognition model for recognizing the favorite control in the interface is trained first, so that it can be determined whether there is a favorite control in the first interface based on the control recognition model, and the position information of the favorite control is obtained.

[0056] In some embodiments of the present application, multiple sets of training data can be obtained, and the initial model is trained through the multiple sets of training data to obtain the control recognition model. Each set of training data includes an interface screenshot sample and the label information of the interface screenshot sample, and the label information is used to indicate the control position information of the favorite control in the interface screenshot sample. The initial model can adopt an open-source model or a self-developed model. For example, the initial model can adopt a YOLO image model implemented by a single convolutional neural network, etc.

[0057] In some embodiments of the present application, when constructing training data, interfaces of multiple applications with a favorite control can be selected. For example, the news interface 300 of an information application as shown in Figure 3 , the video interface 400 of a video application as shown in Figure 4 , the audio interface 500 of an audio application as shown in Figure 5 , and the official account interface 600 of a social application as shown in Figure 6 etc. Screenshots are taken of the selected multiple interfaces to obtain multiple interface screenshot samples, and the control position information of the favorite control in each interface screenshot sample is respectively marked. For example, the control position information of the favorite control 310 in the news interface 300, the control position information of the favorite control 410 in the video interface 400, the control position information of the favorite control 510 in the audio interface 500, and the control position information of the favorite control 610 in the official account interface 600 are respectively marked, so as to obtain the label information of each interface screenshot sample. Each interface image sample and its label information are used as a set of training data. In this way, multiple sets of training data can be obtained.

[0058] In some embodiments of the present application, based on multiple sets of training data, the initial model is trained in a supervised training manner to obtain a control recognition model that meets the training stop condition. Among them, the training stop condition can be set according to actual needs. Exemplarily, the training stop condition includes but is not limited to that the accuracy rate of the trained model is greater than the set accuracy rate threshold, and the value range of the accuracy rate threshold can be [0.98, 1]. In this way, the finally trained control recognition model can accurately identify whether the interface screenshot input into it contains a favorite control and the control position information of the included favorite control.

[0059] In some embodiments of the present application, training data can be constructed and model training can be performed within the electronic device, and finally the trained control recognition model is deployed in the electronic device. In this way, data transmission can be reduced and data leakage can be prevented, thereby ensuring user privacy.

[0060] After the trained control recognition model is deployed in the electronic device, in step 120 above, the control position information of the favorite control in the first interface can be obtained through the following steps 1210 - 1230.

[0061] Step 1210. Obtain a screenshot of the first interface.

[0062] In some embodiments of the present application, in response to the first input, the electronic device can take a screenshot of the first interface through a screenshot tool to obtain a screenshot of the first interface.

[0063] Step 1220. Input the interface screenshot into the control recognition model to obtain a control recognition result.

[0064] In some embodiments of the present application, after inputting an interface screenshot into the control recognition model, the control recognition model can, based on the input interface screenshot, recognize whether there is a favorite control in the first interface, and determine the control position information of the favorite control existing in the interface, and finally output a control recognition result. In the case where the control recognition model recognizes that there is no favorite control in the first interface, the control recognition result includes first information for indicating that there is no favorite control in the first interface. In the case where the control recognition model recognizes that there is a favorite control in the first interface, the control recognition result includes second information for indicating that there is a favorite control in the first interface, and the control position information of the favorite control in the first interface.

[0065] Step 1230. When the control recognition result indicates that there is a favorite control in the first interface and includes the control position information of the favorite control, determine the control position information in the control recognition result as the control position information of the favorite control in the first interface.

[0066] Through the above method, the control recognition model can recognize the interfaces of different applications, effectively improving the generality and adaptability of the input recognition of the favorite control.

[0067] In some embodiments, the position of the favorite control in the same interface is usually unchanged. In view of this, in order to reduce the high-frequency screenshotting and model recognition operations caused by frequently triggering the favorite control, after the above step 1220, the following steps can also be executed:

[0068] When the control recognition result is used to indicate that there is a favorite control in the first interface and includes the control position information of the favorite control, store the interface information of the first interface and the control position information in the control recognition result in the first database in a corresponding manner.

[0069] In some embodiments of the present application, the interface information of the first interface may include information such as the interface name that can identify the interface. In addition, it may also include different-dimensional data that affect the display position of the favorite control icon in the interface, such as resolution, minimum width value, etc.

[0070] In some embodiments of the present application, the first database is a relational database for storing the control position information corresponding to each of multiple interfaces. When storing the interface information of the first interface and the control position information in the control recognition result in the first database in a corresponding manner, use the interface information of the first interface as the key value and the control position information of the first interface as the corresponding Value value, and store them in the first database together.

[0071] Correspondingly, in the case where there is a first database, before the above step 1210, the following steps can be executed:

[0072] Determine whether there is first control position information corresponding to the interface information of the first interface in the first database. If there is first control position information corresponding to the first interface in the first database, the first control position information can be determined as the control position information of the favorite control in the first interface, and there is no need to execute the above steps 1210 - 1230.

[0073] If there is no first control position information corresponding to the first interface in the first database, then execute the above step 1210.

[0074] In the above manner, the control position information recognized by the model and the interface information of the corresponding interface are stored in the first database correspondingly, so that when an input to this interface is received subsequently, the corresponding control position information can be directly obtained from the first database without taking screenshots and model recognition, thereby reducing the high-frequency screenshot and model recognition operations brought by frequent first inputs.

[0075] In the related art, after receiving an input to the favorite control in the application interface, the following two schemes are mainly used to obtain favorite information: One scheme is to take a screenshot of the application interface, and then obtain the favorite information by AI understanding of the content in the screenshot. The main disadvantage of this scheme is that the obtained favorite information is inaccurate. Limited by the screen size of the electronic device or the type of the displayed content, only part of the content may be displayed in the application interface each time, and the complete content cannot be displayed. By taking screenshots, only the content currently displayed in the interface can be captured, and the content not displayed outside the interface cannot be obtained, resulting in incomplete favorite information obtained, and the interface elements cannot be obtained differentially. For example, some worthless comment information in the screenshot may also be obtained as favorite information. Another scheme is to directly save the link of the content displayed in the interface as favorite information and reload the link to obtain the content for display when used subsequently. The disadvantage of this scheme is that there is timeliness, because the page links of many applications are time-limited and may have expired when used subsequently.

[0076] In view of the above problems, in order to obtain the favorite information desired by the user more accurately, the following steps 1310 - 1330 can be adopted in the above step 130 to obtain the favorite information of the first interface.

[0077] Step 1310. Obtain the link of the currently displayed content in the first interface.

[0078] In some embodiments of the present application, when it is determined that the first input is the user's input to the favorite control in the first interface, the link of the content currently displayed in the first interface is obtained. Herein, the link of the currently displayed content refers to the Uniform Resource Locator (URL) or other types of link addresses associated with the currently displayed content. For example, if the content currently displayed in the first interface is a video, the link of the currently displayed content refers to the Uniform Resource Locator that can uniquely identify and locate the storage location of the video on the network. For another example, if the content currently displayed in the first interface is a news report, the link of the currently displayed content refers to the Uniform Resource Locator that can uniquely identify and locate the storage location of the news report on the network.

[0079] Step 1320. Parse the link to obtain a parsing result, where the parsing result includes the node content of each attribute node in the link.

[0080] In some embodiments of the present application, the attribute nodes in the link refer to the basic elements of the object model (DOM) or similar structures that constitute the complete content corresponding to the link, and are used to describe and define the characteristics, behaviors, and related information of various elements. For example, referring to Figure 3 , the first interface is the news interface 300 of an information application, and the content currently displayed in the news interface 300 is a news report. Then, the attribute nodes in the link of the news report include a title attribute node 320, a body attribute node 330, an account attribute node 340, a comment attribute node 350, etc. The node content of the attribute node refers to the specific content contained in the attribute node, including but not limited to images, texts, links, etc. By parsing the link of the content currently displayed in the first interface, the mapping relationship between the attribute node and the node content can be obtained.

[0081] Step 1330. Determine the favorite information of the first interface based on the parsing result.

[0082] In the above manner, when obtaining the favorite information, by parsing the link of the content currently displayed in the first interface, information can be directly obtained from the source data, so that complete information can be obtained. Compared with the traditional method of obtaining favorite information by taking screenshots, more comprehensive favorite information can be obtained. Moreover, in this embodiment, the favorite information is determined based on the content obtained by parsing the link. Compared with directly using the link as the favorite information, it will not be lost due to the link failure, ensuring the integrity and accessibility of the favorite information.

[0083] In some embodiments, considering that not all the content in the link is what the user wants to focus on, therefore, in order to improve the accuracy of the finally stored favorite information, the following steps may also be performed before the above step 1330:

[0084] Receive a second input from the user to any attribute node displayed in the first interface;

[0085] In response to a second input, determine any attribute node as the target attribute node of the first interface;

[0086] Establish an association relationship between the target attribute node and the first interface.

[0087] Here, the second input is an input for selecting an attribute node that the user focuses on. Exemplarily, the second input includes, but is not limited to, a selection input or a scribbling input by the user on the attribute node to be focused on in the first interface through a touch device such as a finger or a stylus.

[0088] In some embodiments of the present application, when the user first inputs to the favorite control in the first interface, the electronic device may provide an interaction method for actively selecting an attribute node to be focused on. At this time, the user can perform a second input on the attribute node to be focused on to select the attribute node to be focused on. In response to the user's selection input or scribbling input, the electronic device determines the attribute node selected by the user as the target attribute node of the first interface and establishes an association relationship between the target attribute node and the first interface, so that the target attribute node of the first interface can be directly determined based on the association relationship subsequently, without the user performing a second input again.

[0089] For example, the user makes a selection on the title attribute node 320 and the body text attribute node 330 as shown in Figure 3 Then the electronic device determines the title attribute node 320 and the body text attribute node 330 as the target attribute nodes of the first interface.

[0090] Correspondingly, in the case where there is a target attribute node of the first interface, in step 1330 above, the node content corresponding to the target attribute node of the first interface in the parsing result is determined as the favorite information of the first interface.

[0091] Through the above method, the user can select the content to be focused on according to actual needs, and thus generate corresponding favorite information based on the user's selection. In this way, the favorite information is more in line with the user's needs and more valuable.

[0092] In some embodiments, the electronic device may further perform the following steps 150-step 160.

[0093] Step 150. Receive a third input from the user at a specified position.

[0094] In some embodiments of the present application, when a user needs to view the favorite information stored in a specified location, the third input is an input for instructing the electronic device to display the favorite information stored in the specified location. Exemplarily, the third input includes, but is not limited to: a click input by the user on the specified location through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be specifically determined according to actual usage requirements, and the embodiments of the present invention do not make limitations. The specific gesture in the embodiments of the present application can be any one of a single click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, a double click gesture; the click input in the embodiments of the present application can be a single click input, a double click input or a click input of any number of times, etc., and can also be a long press input or a short press input. For example, the above-mentioned third input can be: a click input by the user on the specified location in the electronic device through a finger. The above-mentioned third input can also be: a voice command issued by the user indicating to select and display the favorite information stored in the specified location.

[0095] Step 160. In response to the third input, display the favorite information stored in the specified location.

[0096] In some embodiments of the present application, when the electronic device receives the third input of the user on the specified location, it acquires the favorite information stored in the specified location and displays the favorite information.

[0097] Through the above solution, the specified location can be used as the user's personal knowledge base, and the user can actively view the favorite information stored in the specified location according to their own needs.

[0098] In some embodiments, before the above step 160, the electronic device may also first perform the following steps:

[0099] Determine the type and keywords of each piece of favorite information stored in the specified location.

[0100] In some embodiments of the present application, the specified location is used to store the favorite information of each interface. Therefore, there are multiple pieces of favorite information stored in the specified location. Based on this, the type of each piece of favorite information in the specified location can be determined by means of clustering.

[0101] In some other embodiments of the present application, the favorite information can also be classified based on the content type of each piece of favorite information (such as video, audio, document, etc.) or the theme of the favorite information, etc., so as to determine the type of each piece of favorite information.

[0102] In some embodiments of the present application, keywords of each piece of favorite information can be extracted through a set keyword extraction algorithm. The set keyword extraction algorithm includes, but is not limited to, rule-based methods, such as part-of-speech tagging method, syntactic structure analysis method, etc., or statistical-based methods, such as word frequency statistics method, TF-IDF algorithm, etc., or machine learning-based methods, etc. This embodiment does not make specific limitations in this regard.

[0103] Based on this, in the above step 160, the electronic device can perform hierarchical display on the favorite information stored in the specified location through the following steps 1610 - 1650:

[0104] Step 1610. In response to the third input, display the type of each piece of favorite information stored in the specified location.

[0105] In some embodiments of the present application, at least one type can be obtained by determining the type of each piece of favorite information in the specified location. The electronic device, in response to the third input, displays all the determined types.

[0106] Step 1620. Receive a fourth input for the target type.

[0107] In some embodiments of the present application, the user can, according to actual needs, select the target type corresponding to the favorite information to be viewed from the types displayed by the electronic device. At this time, the fourth input is an input for selecting the target type that the user wants to view. The electronic device, in response to the fourth input, determines the type selected by the fourth input as the type that the user wants to view, that is, the target type. Among them, the fourth input includes, but is not limited to, a click input by the user on the target type in the types displayed by the electronic device through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs. Specifically, it can be determined according to actual usage needs, and the embodiments of the present invention do not make limitations. The specific gesture in the embodiments of the present application can be any one of a click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, a double click gesture; the click input in the embodiments of the present application can be a single click input, a double click input or a click input of any number of times, etc., and can also be a long press input or a short press input. For example, the above fourth input can be: a click input by the user on the target type in the types displayed by the electronic device through a finger. The above fourth input can also be: a voice command sent by the user indicating the selection of the target type.

[0108] Step 1630. In response to the fourth input, display the keywords of each piece of favorite information under the target type.

[0109] In some embodiments of the present application, in response to a fourth input, the electronic device determines that the user wants to view the favorite information under a target type, and at this time, further displays the keywords of each favorite information under the target type, so that the user can further screen the favorite information based on the keywords.

[0110] Step 1640. Receive a fifth input for the target keyword.

[0111] In some embodiments of the present application, the user can, according to actual needs, select the target keyword corresponding to the favorite information to be viewed from the keywords displayed by the electronic device. At this time, the fifth input is an input for selecting the target keyword that the user wants to view. In response to the fifth input, the electronic device determines the keyword selected by the fifth input as the keyword of the favorite information that the user wants to view, that is, the target keyword. Among them, the fifth input includes but is not limited to a click input of the user on the target type in the type displayed by the electronic device through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be specifically determined according to actual usage needs, and the embodiments of the present invention do not make limitations. The specific gesture in the embodiments of the present application can be any one of a click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, and a double click gesture; the click input in the embodiments of the present application can be a single click input, a double click input, or a click input of any number of times, and can also be a long press input or a short press input. For example, the above fifth input can be: a click input of the user on the target keyword in the keywords displayed by the electronic device through a finger. The above fifth input can also be: a voice command sent by the user indicating the selection of the target keyword.

[0112] Step 1650. In response to the fifth input, display the favorite information corresponding to the target keyword.

[0113] In some embodiments of the present application, in response to the fifth input, the electronic device determines that the user wants to view the favorite information corresponding to the target keyword, and thus displays the favorite information corresponding to the target keyword. Exemplarily, there are multiple pieces of favorite information stored in a specified location. By clustering the multiple pieces of favorite information, the multiple pieces of favorite information are divided into four types: travel, food, movies, and music. In response to the third input, the electronic device performs a first-layer display, as Figure 7 shown, the four types of travel, food, movies, and music are displayed in the first-layer display. When the user wants to view the favorite information of the travel type, for Figure 7Perform a fourth input for the travel type shown. The electronic device responds to this fourth input to perform a second-layer display, and in the second-layer display, display the keywords of the favorite information under the travel type. Assume that the favorite information under the travel type includes travel guides for Yunnan, travel guides for Chongqing, and travel guides for Xinjiang. Among them, the keywords of the travel guide for Yunnan include Yunnan, the keywords of the travel guide for Chongqing include Chongqing, and the keywords of the travel guide for Xinjiang include Xinjiang. Then, in response to the user's fourth input for the travel type, as Figure 8 shown, further display the three keywords of Yunnan, Chongqing, and Xinjiang in the second-layer display. When the user wants to view the favorite information related to Yunnan, perform a fifth input for the keyword Yunnan. The electronic device responds to the fifth input to perform a third-layer display, as Figure 9 shown, and further display the specific content of the travel guide for Yunnan in the third-layer display.

[0114] In the above manner, the favorite information in the specified location can be displayed in a three-layer structure of type, keyword, and favorite information, so that the user can quickly filter out the favorite information they need according to their own needs and concerns. Moreover, through layering, the logical relationship between the favorite information becomes clearer, and the information at different levels is interrelated and progressive layer by layer, which helps the user better understand the inherent meaning and overall structure of the information.

[0115] In the information favorite method provided by the embodiments of this application, the execution entity can be an information favorite device. In the embodiments of this application, taking the information favorite device executing the information favorite method as an example, the information favorite device provided by the embodiments of this application is described.

[0116] Refer to Figure 10 , which is a schematic diagram of the information favorite device provided by the embodiments of this application. As Figure 10 shown, the information favorite device 1000 includes the following modules:

[0117] A receiving module 1010, configured to receive a first input from the user to the first interface;

[0118] A processing module 1020, configured to, in response to the first input, obtain the input position information of the first input and the control position information of the favorite control in the first interface;

[0119] The processing module 1020 is further configured to, when the control position information is obtained and the input position information and the control position information match, obtain the favorite information in the first interface, where the favorite information refers to the information that needs to be favored in the first interface;

[0120] The processing module 1020 is further configured to store the favorite information in a specified location.

[0121] The information collection device provided by the embodiment of the present application receives a first input from the user on the first interface. In response to the first input, it obtains the input position information of the first input and the control position information of the collection control in the first interface. When the control position information is obtained and it is determined that the input position information matches the control position information, it is determined that the first input is an input to the collection control in the first interface, and the collection information of the first interface is obtained and stored at a specified position. In this embodiment, based on the input position information input by the user and the control position information of the collection control, it is identified whether the user's input is an input to the collection control. This identification method can be applied to any application, thereby improving the accuracy of identifying the input of the collection control. Moreover, in the present application, by storing the collection information at a specified position, it is convenient to manage and search for the collection information.

[0122] In some embodiments, the processing module 1020 is specifically configured to:

[0123] Obtain a screenshot of the first interface;

[0124] Input the screenshot of the interface into the control recognition model to obtain a control recognition result;

[0125] When the control recognition result indicates that there is a collection control in the first interface and includes the control position information of the collection control, determine the control position information in the control recognition result as the control position information of the collection control in the first interface;

[0126] Wherein, the control recognition model is trained based on multiple groups of training data, and each group of training data includes an interface screenshot sample and the label information of the interface screenshot sample. The label information is used to indicate the control position information of the collection control in the interface screenshot sample.

[0127] In some embodiments, the processing module 1020 is further configured to:

[0128] After inputting the screenshot of the interface into the control recognition model to obtain a control recognition result, when the control recognition result is used to indicate that there is a collection control in the first interface and includes the control position information of the collection control, store the interface information of the first interface and the control position information in the control recognition result in the first database in a corresponding manner.

[0129] In some embodiments, the processing module 1020 is specifically configured to:

[0130] Obtain the link of the currently displayed content in the first interface;

[0131] Parse the link to obtain a parsing result, and the parsing result includes the node content of each attribute node in the link;

[0132] Determine the collection information of the first interface based on the parsing result.

[0133] In some embodiments, the receiving module 1010 is further configured to:

[0134] Before determining the favorite information of the first interface based on the parsing result, receive a second input from the user for any attribute node displayed in the first interface;

[0135] The processing module 1020 is further configured to:

[0136] In response to the second input, determine any attribute node as the target attribute node of the first interface;

[0137] Establish an association relationship between the target attribute node and the first interface;

[0138] Specifically, the processing module 1020 is configured to:

[0139] Determine the node content corresponding to the target attribute node of the first interface in the parsing result as the favorite information of the first interface.

[0140] In some embodiments, the receiving module 1010 is further configured to:

[0141] Receive a third input from the user for a specified location;

[0142] The processing module 1020 is further configured to:

[0143] In response to the third input, display the favorite information stored in the specified location.

[0144] In some embodiments, the processing module 1020 is further configured to:

[0145] The information collection device in the embodiments of the present application may be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal or other devices other than terminals. Exemplarily, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a handheld computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. It may also be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc. The embodiments of the present application do not make specific limitations.

[0146] The information collection device in the embodiments of the present application may be a device with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems. The embodiments of the present application do not make specific limitations.

[0147] The information collection device provided in the embodiments of the present application can implement Figures 1 to 9 each process implemented by the method embodiments. To avoid repetition, it will not be elaborated here.

[0148] Optionally, as Figure 11 shown, the embodiments of the present application further provide an electronic device 1100, including a processor 1101 and a memory 1102. A program or instruction that can run on the processor 1101 is stored on the memory 1102. When the program or instruction is executed by the processor 1101, it implements each step of the above-mentioned information collection method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0149] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0150] Figure 12 A schematic diagram of the hardware structure of an electronic device for implementing the embodiments of the present application.

[0151] The electronic device 1200 includes, but is not limited to, components such as a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, and a processor 1210.

[0152] Those skilled in the art can understand that the electronic device 1200 may further include a power source (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 1210 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 12 The structure of the electronic device shown does not limit the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0153] Among them, the input unit 1204 is used to receive a first input from the user to the first interface;

[0154] The processor 1210 is configured to obtain the input position information of the first input and the control position information of the favorite control in the first interface in response to the first input;

[0155] The processor 1210 is further configured to obtain the favorite information of the first interface when the control position information is obtained and it is determined that the input position information and the control position information match. The favorite information refers to the information that needs to be favorited in the first interface;

[0156] The processor 1210 is further configured to store the favorite information to a specified location.

[0157] The electronic device provided by the embodiment of the present application receives a first input from the user to the first interface, and in response to the first input, obtains the input position information of the first input and the control position information of the favorite control in the first interface. When the control position information is obtained and it is determined that the input position information matches the control position information, it is determined that the first input is an input to the favorite control in the first interface, and the favorite information of the first interface is obtained and stored to a specified location. In this embodiment, based on the input position information of the user input and the control position information of the favorite control, it is identified whether the user input is an input to the favorite control. This identification method can be applied to any application, thereby improving the accuracy of identifying the input to the favorite control. Moreover, in the present application, by storing the favorite information to a specified location, it is convenient to manage and search for the favorite information.

[0158] In some embodiments, the processor 1210 is specifically configured to:

[0159] Obtain a screenshot of the first interface;

[0160] Input the interface screenshot into the control recognition model to obtain the control recognition result;

[0161] When the control recognition result indicates that there is a favorite control on the first interface and includes the control position information of the favorite control, determine the control position information in the control recognition result as the control position information of the favorite control on the first interface;

[0162] Among them, the control recognition model is trained based on multiple sets of training data. Each set of training data includes an interface screenshot sample and the label information of the interface screenshot sample. The label information is used to indicate the control position information of the favorite control in the interface screenshot sample.

[0163] In some embodiments, the processor 1210 is further configured to:

[0164] After inputting the interface screenshot into the control recognition model to obtain the control recognition result, when the control recognition result is used to indicate that there is a favorite control on the first interface and includes the control position information of the favorite control, store the interface information of the first interface and the control position information in the control recognition result in the first database correspondingly.

[0165] In some embodiments, the processor 1210 is specifically configured to:

[0166] Obtain the link of the currently displayed content on the first interface;

[0167] Parse the link to obtain the parsing result, and the parsing result includes the node content of each attribute node in the link;

[0168] Determine the favorite information of the first interface based on the parsing result.

[0169] In some embodiments, the input unit 1204 is further configured to:

[0170] Before determining the favorite information of the first interface based on the parsing result, receive a second input from the user for any attribute node displayed on the first interface;

[0171] The processor 1210 is further configured to:

[0172] In response to the second input, determine any attribute node as the target attribute node of the first interface;

[0173] Establish an association relationship between the target attribute node and the first interface;

[0174] The processor 1210 is specifically configured to:

[0175] Determine the node content corresponding to the target attribute node of the first interface in the parsing result as the favorite information of the first interface.

[0176] It should be understood that in the embodiments of the present application, the input unit 1204 may include a Graphics Processing Unit (GPU) 12041 and a microphone 12042. The graphics processor 12041 processes the image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capture mode or an image capture mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1207 includes at least one of a touch panel 12071 and other input devices 12072. The touch panel 12071 is also referred to as a touch screen. The touch panel 12071 may include two parts: a touch detection device and a touch controller. The other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated herein.

[0177] The memory 1209 can be used to store software programs and various data. The memory 1209 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area may store an operating system, application programs or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1209 may include a volatile memory or a non-volatile memory, or the memory 1209 may include both a volatile and a non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synch link dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 1209 in the embodiments of the present application includes but is not limited to these and any other suitable types of memories.

[0178] The processor 1210 may include one or more processing units; optionally, the processor 1210 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above modem processor may not be integrated into the processor 1210 either.

[0179] The embodiments of the present application also provide a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, it implements each process of the above information collection method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0180] Among them, the processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media such as computer read-only memory ROM, random access memory RAM, magnetic disks, or optical discs, etc.

[0181] Another embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement each process of the above embodiment of the information collection method, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0182] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip, etc.

[0183] The embodiments of the present application provide a computer program product. The program product is stored in a storage medium and is executed by at least one processor to implement each process of the above embodiment of the information collection method, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0184] It should be noted that in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device. Without further limitations, an element defined by the statement "including one..." does not exclude the existence of additional identical elements in the process, method, article or device including that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, the features described with reference to certain examples may be combined in other examples.

[0185] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described example methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions for causing a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in various embodiments of the present application.

[0186] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific implementation manners. The above specific implementation manners are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them belong to the protection scope of the present application.

Claims

1. A method for collecting information, characterized in that: include: Receiving a first input from a user on a first interface; In response to the first input, acquiring input position information of the first input and control position information of a favorite control in the first interface; When the control position information is obtained and it is determined that the input position information matches the control position information, obtaining the collection information of the first interface, where the collection information refers to the information in the first interface that needs to be collected; The collection information is stored in a specified location.

2. The method according to claim 1, characterized in that The obtaining the control position information of the favorite control in the first interface includes: Obtaining a screenshot of the first interface; Inputting the interface screenshot into a control recognition model to obtain a control recognition result; When the control recognition result indicates that the first interface has a favorite control and contains control position information of the favorite control, determining the control position information in the control recognition result as the control position information of the favorite control in the first interface; The control recognition model is trained based on multiple sets of training data, each set of the training data includes an interface screenshot sample and label information of the interface screenshot sample, and the label information is used to indicate the control position information of the collection control in the interface screenshot sample.

3. The method according to claim 2, characterized in that After inputting the interface screenshot into a control recognition model to obtain a control recognition result, the method further includes: When the control identification result is used to indicate that the first interface has a collection control and contains control position information of the collection control, the interface information of the first interface and the control position information in the control identification result are stored in the first database in correspondence.

4. The method according to claim 1, characterized in that: The acquiring the first favorite information of the first interface includes: Obtaining a link to the content currently displayed in the first interface; Parsing the link to obtain a parsing result, wherein the parsing result includes the node content of each attribute node in the link; The first favorite information of the first interface is determined based on the parsing result.

5. The method according to claim 4, characterized in that Before determining the favorite information of the first interface based on the parsing result, the method further includes: Receiving a second input from a user on any attribute node displayed in the first interface; In response to the second input, determining the arbitrary attribute node as a target attribute node of the first interface; Establishing an association relationship between the target attribute node and the first interface; The determining the favorites information of the first interface based on the parsing result includes: The node content corresponding to the target attribute node of the first interface in the parsing result is determined as the collection information of the first interface.

6. An information collection device, characterized in that: include: A receiving module, used for receiving a first input of a user on a first interface; a processing module, configured to obtain, in response to the first input, input position information of the first input and control position information of a favorite control in the first interface; The processing module is further configured to obtain the collection information of the first interface when the control position information is obtained and it is determined that the input position information matches the control position information, wherein the collection information refers to the information in the first interface that needs to be collected; The processing module is further used to store the collection information in a designated location.

7. The device according to claim 6, characterized in that The processing module is specifically used for: Obtaining a screenshot of the first interface; Inputting the interface screenshot into a control recognition model to obtain a control recognition result; When the control recognition result indicates that the first interface has a favorite control and contains control position information of the favorite control, determining the control position information in the control recognition result as the control position information of the favorite control in the first interface; The control recognition model is trained based on multiple sets of training data, each set of the training data includes an interface screenshot sample and label information of the interface screenshot sample, and the label information is used to indicate the control position information of the collection control in the interface screenshot sample.

8. The device according to claim 7, characterized in that The processing module is further used for: After inputting the interface screenshot into the control recognition model and obtaining the control recognition result, if the control recognition result is used to indicate that there is a collection control in the first interface and contains the control position information of the collection control, the interface information of the first interface and the control position information in the control recognition result are stored in the first database correspondingly.

9. The device according to claim 6, characterized in that The processing module is specifically used for: Obtaining a link to the content currently displayed in the first interface; Parsing the link to obtain a parsing result, wherein the parsing result includes the node content of each attribute node in the link; The collection information of the first interface is determined based on the analysis result.

10. The device according to claim 9, characterized in that The receiving module is further used for: Before determining the first favorite information of the first interface based on the parsing result, receiving a second input from a user on any attribute node displayed in the first interface; The processing module is further used for: In response to the second input, determining the arbitrary attribute node as a target attribute node of the first interface; Establishing an association relationship between the target attribute node and the first interface; The processing module is specifically used for: The node content corresponding to the target attribute node of the first interface in the parsing result is determined as the collection information of the first interface.

Images