Information acquisition method and device, electronic equipment and computer readable storage medium

Abstract

The invention relates to an information acquisition method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: displaying a first page of a target application program; in response to a trigger operation on the first page, displaying identification information corresponding to each visual element in the first page; and determining a target visual element according to the identification information. By adopting the method, the page information can be flexibly acquired.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an information acquisition method, device, electronic device and computer-readable storage medium. Background Art

[0002] With the development of computer technology, mobile terminals have become the most commonly used electronic products in people's daily lives. Users can perform operations such as reading, communicating or sharing information through mobile terminals.

[0003] At present, when users acquire information, they often acquire the content displayed on the browsing page by taking screenshots, capturing the content of the entire mobile terminal screen and saving the captured content in the format of a picture, and then further processing the saved picture, such as sharing it. This may result in the actual shared content not being completely consistent with the content that the user really wants to share, or the captured picture needs to be processed twice before the content that the user wants to share can be obtained. However, the secondary processing process is often cumbersome. Therefore, the current information acquisition method is not flexible enough and the user experience is poor. Summary of the invention

[0004] The embodiments of the present application provide an information acquisition method, device, electronic device, and computer-readable storage medium, which can flexibly acquire information.

[0005] In a first aspect, the present application provides an information acquisition method. The method comprises:

[0006] Display the first page of the target application;

[0007] In response to a triggering operation on the first page, displaying identification information corresponding to each visual element in the first page;

[0008] A target visual element is determined according to the identification information.

[0009] In a second aspect, the present application also provides an information acquisition device. The device comprises:

[0010] A page display module, used to display the first page of the target application;

[0011] an identification display module, configured to display identification information corresponding to each visual element in the first page in response to a triggering operation on the first page;

[0012] An information determination module is used to determine a target visual element according to the identification information.

[0013] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0014] Display the first page of the target application;

[0015] In response to a triggering operation on the first page, displaying identification information corresponding to each visual element in the first page;

[0016] A target visual element is determined according to the identification information.

[0017] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0018] Display the first page of the target application;

[0019] In response to a triggering operation on the first page, displaying identification information corresponding to each visual element in the first page;

[0020] A target visual element is determined according to the identification information.

[0021] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0022] Display the first page of the target application;

[0023] In response to a triggering operation on the first page, displaying identification information corresponding to each visual element in the first page;

[0024] A target visual element is determined according to the identification information.

[0025] The above-mentioned information acquisition method, by displaying the first page of the target application, displays the identification information corresponding to each visual element in the first page in response to a trigger operation on the first page, and determines the target visual element according to the identification information. It can realize flexible determination of the target visual element according to the identification information corresponding to each visual element in the first page, thereby realizing flexible acquisition of page information. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 is a flowchart of an information acquisition method in an embodiment;

[0028] Figure 2 A schematic diagram of displaying a target visual element on a second page in an embodiment;

[0029] Figure 3 is a flowchart of an information acquisition method in another embodiment;

[0030] Figure 4 is a flowchart of an information acquisition method in another embodiment;

[0031] Figure 5 A schematic diagram of displaying a first page in an embodiment;

[0032] Figure 6 A schematic diagram of identification information corresponding to each visual element in the first page in an embodiment;

[0033] Figure 7 A schematic diagram of determining a target visual element according to identification information in an embodiment;

[0034] Figure 8 It is a schematic diagram of determining a target visual element according to identification information in another embodiment;

[0035] Fig. 9 It is a schematic diagram of determining a target visual element according to identification information in another embodiment;

[0036] Fig.10 It is a schematic diagram of determining a target visual element according to identification information in another embodiment;

[0037] Fig.11 is a structural block diagram of an information acquisition device in an embodiment;

[0038] Fig.12 The figure is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0040] The information acquisition method provided in the embodiment of the present application is described by taking an electronic device including a display screen as an example. The electronic device may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, IoT devices, and portable wearable devices. The IoT devices may be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. The portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc.

[0041] In one embodiment, Figure 1 As shown, a method for obtaining information is provided, including the following steps 102 to 106.

[0042] Step 102: Display the first page of the target application.

[0043] The electronic device display screen displays the first page of the target application, where the target application may include a third-party application or an application corresponding to a system application. For example, the target application may be an instant messaging application, a shopping application, a news application, a financial application, a navigation application, an educational application, a desktop application, a negative one screen, etc.

[0044] It is understandable that the target application can be any application on the electronic device, and the target application can be determined according to user needs. In an actual application scenario, the user opens the target application on the electronic device, and the electronic device displays the first page of the target application. The user can view the content on the first page. It is easy to understand that the user cannot directly edit or extract the content on the first page.

[0045] Step 104: in response to the triggering operation on the first page, display identification information corresponding to each visual element in the first page.

[0046] Visual elements can be understood as visual controls. The content displayed on the page is often composed of one or more visual elements, which can include text, controls, images, text boxes, and progress bars. For example, an image displayed on the page corresponds to an image visual element, a paragraph of text corresponds to a text visual element, and a control corresponds to a control visual element.

[0047] In response to the trigger operation on the first page, the identification information corresponding to each visual element in the first page is displayed, wherein the identification information corresponding to each visual element is unique, that is, the identification information corresponding to the visual element is used to uniquely determine the corresponding visual element. If the identification information corresponding to the visual element is selected, the corresponding visual element is selected. The user can select the identification information corresponding to each visual element through a preset selection operation. For example, the identification information corresponding to each visual element can be selected through a preset selection operation such as a click trigger, a preset gesture trigger, or a control trigger. In this embodiment, in response to the trigger operation on the first page, it is equivalent to triggering an information acquisition operation, thereby displaying the identification information corresponding to each visual element in the first page. Among them, the trigger operation can be an interception operation, a parsing operation, etc. If the trigger operation is an interception operation, responding to the interception operation of the first page is equivalent to triggering an information interception operation; if the trigger operation is a parsing operation, responding to the parsing operation of the first page is equivalent to triggering an information parsing operation. For example, in response to the parsing operation of the first page, identification information corresponding to each visual element in the first page is displayed, a target visual element is determined according to the identification information, and then the target visual element is parsed, wherein the parsing may be semantic parsing, image pixel parsing, etc.

[0048] Optionally, in response to a triggering operation on a target control on the first page, identification information corresponding to each visual element in the first page is displayed. For example, the target control is a "screenshot" control or a "intercept" control. In response to triggering the "screenshot" control on the first page, the screenshot operation is triggered, thereby displaying identification information corresponding to each visual element in the first page.

[0049] Optionally, in response to the triggering operation on the first page, identification information corresponding to each visual element in the first page is displayed on the first page, for example, by marking the area and boundary occupied by the visual element to obtain the identification information of the corresponding visual element. Step 106, determining the target visual element according to the identification information.

[0050] The electronic device can determine the target visual element based on the identification information, wherein the identification information can be selected, and selecting the identification information also indicates that the visual element corresponding to the identification information is selected. Optionally, the target visual element can be determined based on whether the identification information is selected, for example, the visual element corresponding to the identification information selected by the user is used as the target visual element. The visual element corresponding to the identification information that meets the target screening condition can also be used as the target visual element.

[0051] Optionally, after determining the target visual element according to the identification information, a second page corresponding to the triggering operation is displayed, and the target visual element is displayed on the second page.

[0052] In the above-mentioned information acquisition method, by displaying the first page of the target application, in response to the trigger operation of the first page, the identification information corresponding to each visual element in the first page is displayed, and the target visual element is determined according to the identification information. This allows the target visual element to be flexibly determined on the first page of the target application, thereby facilitating subsequent processing such as saving or sharing of the target visual element, thereby improving the efficiency of information acquisition.

[0053] In one embodiment, in response to a trigger operation on a first page, identification information corresponding to each visual element in the first page is displayed, including: in response to a trigger operation on the first page, a view information acquisition request is sent to an operating system; view information returned by the operating system, wherein the view information includes identification information corresponding to each visual element; and identification information corresponding to each visual element in the first page is displayed.

[0054] In this embodiment, the electronic device responds to the trigger operation on the first page and sends a view information acquisition request to the operating system. The view information acquisition request is used to obtain the view information on the first page. Then, the electronic device receives the view information returned by the operating system through the information interaction interface. The view information returned by the operating system includes the identification information corresponding to each visual element, and displays the identification information corresponding to each visual element in the first page. Among them, the view information can be understood as the position, type, size and layout relationship of each visual element on the page. The view information returned by the operating system can be obtained by the operating system from the target application. The operating system can be an Android system, an iOS system or a HarmonyOS system, etc.

[0055] Optionally, the identification information corresponding to different visual elements in the first page can be represented by wireframes of different formats or different marking symbols. For example, wireframes of different colors, wireframes of different forms or wireframes of different thicknesses can correspond to different types of visual elements, and the identification information corresponding to each visual element can be displayed, that is, the wireframe corresponding to each visual element can be displayed.

[0056] In one example, in response to a triggering operation on a screenshot control on a first page, a view information acquisition request is sent to an operating system. After receiving the view information acquisition request, the operating system returns corresponding view information based on the view information acquisition request. The electronic device receives the view information corresponding to the view information acquisition request returned by the operating system, the view information including identification information corresponding to each visual element on the first page, and the electronic device displays the identification information corresponding to each visual element in the first page.

[0057] In the above embodiment, by responding to the trigger operation on the first page, a view information acquisition request is sent to the operating system, and the view information returned by the operating system is received, wherein the view information includes identification information corresponding to each visual element, and the identification information corresponding to each visual element in the first page is displayed, so that the user can flexibly select the identification information corresponding to the visual element, thereby flexibly determining the target visual element; in addition, based on the view information returned by the operating system, that is, information such as the position corresponding to the visual element, the type of visual element, the size, and the layout relationship of the visual element, the identification information corresponding to each visual element in the first page can be quickly displayed, thereby improving the efficiency of information acquisition.

[0058] In an optional embodiment, the view information in the first page can be received through an interface for information interaction with the operating system. Optionally, the operating system can obtain the view information corresponding to the first page of the target application through a first interface with the target application, and the operating system then sends the obtained view information to the interception application through a second interface for information interaction with the interception application, wherein the view information includes identification information corresponding to each visual element in the first page, and the interception application displays the identification information corresponding to each visual element in the first page in response to a trigger operation on the first page. This embodiment receives the view information in the first page through an interface for information interaction with the operating system, and the view information includes identification information corresponding to each visual element, so that any target visual element can be obtained, and the identification information of each visual element in the first page can be quickly displayed, thereby improving the flexibility and efficiency of information acquisition.

[0059] In some embodiments, receiving the view information returned by the operating system includes: receiving the view information returned by the operating system after the target application is authenticated.

[0060] In this embodiment, in response to the trigger operation on the first page, a view information acquisition request is sent to the operating system. After receiving the view information acquisition request, the operating system authenticates the target application and obtains an authentication result. If the authentication result is authentication passed, the view information corresponding to the view information acquisition request is returned. Authentication refers to the process of verifying the allowed access rights, security performance, etc. of the target application.

[0061] Optionally, when the target application has the allowed access rights and is safe, the authentication is passed, and the operating system returns the corresponding view information based on the view information acquisition request.

[0062] In this embodiment, by receiving the view information returned by the operating system after authenticating the target application, higher-security view information corresponding to the authorized target application can be obtained, and the identification information corresponding to each visual element in the first page can be displayed. The target visual element is determined based on the identification information, thereby improving the security of information acquisition.

[0063] In some embodiments, the visual element includes text, a picture or a control. The visual element may be a text visual element, a picture visual element or a control visual element, etc. The corresponding text visual element is at least a complete text, the picture visual element is at least a complete picture, and the control display element is at least a complete control, that is, the visual element is the smallest component unit of the display page, and the corresponding page information can be displayed through each visual element at different positions on the page. In this embodiment, any visual element can be selected according to the identification information on the page, that is, any text, picture or control visual element, including a text, picture or control visual element, and the corresponding information can be obtained with the visual element as the smallest unit, which can realize the acquisition of information with smaller granularity and more flexible information acquisition.

[0064] In some embodiments, determining the target visual element according to the identification information includes: acquiring the visual element selected by the user according to the identification information, and using the selected visual element as the target visual element.

[0065] In this embodiment, the identification information corresponding to each visual element in the first page is displayed, and in response to the user's selection operation on the identification information, the visual element selected by the user according to the identification information is obtained, and the selected visual element is used as the target visual element. For example, the user selects the identification information corresponding to the target image in the first page, then the electronic device obtains the target image and uses the target image as the target visual element. It is easy to understand that, under normal circumstances, the content of the first page is not limited to the content displayed on the current screen. The first page can only display the content corresponding to the screen size area through the screen at the same time, and cannot be fully displayed. The user needs to trigger the corresponding update of the screen to update the display of the first page content. Therefore, in this embodiment, the user can simultaneously select the identification information currently displayed on the electronic device screen and the identification information that is not displayed, that is, the scope of the user's selection of identification information is in the first page, not in the area displayed on the screen. In one example, a user can update the identification information corresponding to each visual element displayed on a first page by sliding the screen. During the updating process, the user can continuously select the identification information on the first page, for example, select all the identification information on the first page, use the visual elements corresponding to all the identification information as target visual elements, display the second page corresponding to the trigger operation, and display the target visual elements on the second page, thereby achieving the acquisition of the visual elements corresponding to all the identification information on the first page.

[0066] In the above embodiment, by obtaining the visual element selected by the user according to the identification information and using the selected visual element as the target visual element, it is possible to determine the target visual element according to user needs, improve the flexibility of determining the target visual element, thereby improving the flexibility of information acquisition and improving the user experience.

[0067] In some embodiments, determining the target visual element according to the identification information includes: filtering out target identification information that meets the target filtering condition from the identification information, and using the visual element corresponding to the target identification information as the target visual element.

[0068] In this embodiment, the identification information corresponding to each visual element in the first page is displayed, and the target identification information that meets the target screening condition is screened out from the identification information of the first page, and the visual element corresponding to the target identification information is used as the target visual element. It can be understood that the target screening condition can be set according to the actual application scenario. For different types of target applications, the corresponding target screening conditions may be different. In some actual application scenarios, the target screening conditions include target type or target location, etc. It is easy to understand that the target identification information that meets the target condition is screened out from the identification information of the first page, which is not limited to the target identification information of the current screen display part, but also includes the target identification information of the undisplayed part of the first page that meets the target screening condition, that is, the screening range of the target identification information is the first page, not the area displayed on the electronic device screen.

[0069] Optionally, the target filter condition may be a filter condition set by the system or a filter condition defined by the user. It is understandable that when both the filter condition set by the system and the filter condition defined by the user exist, the filter condition confirmed by the user from the filter condition set by the system and the filter condition defined by the user is used as the target filter condition. In one example, the user may set the target filter condition in the interception application.

[0070] In the above embodiment, by filtering out target identification information that meets the target screening conditions from the identification information and using the visual element corresponding to the target identification information as the target visual element, it is possible to automatically obtain the target visual element corresponding to the target identification information that meets the target screening conditions displayed on the first page. While achieving flexible information acquisition, it is also possible to improve information acquisition efficiency and human-computer interaction efficiency.

[0071] In some embodiments, target identification information that meets the target screening conditions is filtered out from the identification information, and the visual element corresponding to the target identification information is used as the target visual element, including: target identification information of the target type is filtered out from the identification information, and the visual element corresponding to the target identification information is used as the target visual element.

[0072] In this embodiment, target identification information belonging to the target type is filtered out from the identification information, and the visual element corresponding to the target identification information is used as the target visual element. It can be understood that the target type can be set according to the actual application scenario, and the corresponding target types for target applications with different attributes may be different. For example, for a target application with shopping attributes, the corresponding target type is a picture type, and for a target application with reading attributes, the corresponding target type is a text type, etc. Alternatively, multiple types of identification information can be used as target identification information, for example, the picture type and the text type are used as target types at the same time, that is, the target identification information of the picture type and the text type are filtered out from the identification information, and the visual elements of the picture type and the text type corresponding to the target identification information are used as target visual elements.

[0073] In one example, the target application is a shopping application, and the first page is a shopping cart page of the shopping application. In response to a trigger operation on the shopping cart page, identification information corresponding to each visual element in the shopping cart page is displayed, and visual elements of the picture type are filtered out from the identification information, and all visual elements of the picture type in the shopping cart page are used as target visual elements.

[0074] In this embodiment, by filtering out target identification information belonging to the target type from the identification information and using the visual element corresponding to the target identification information as the target visual element, it is possible to automatically obtain the target visual element corresponding to the target identification information belonging to the target type displayed on the first page. While achieving flexible information acquisition, it is also possible to improve information acquisition efficiency and human-computer interaction efficiency.

[0075] In some embodiments, the target type includes a text type, a picture type, or a control type. For example, from the identification information, the target identification information belonging to the text type is filtered out, and the visual element corresponding to the target identification information is used as the target visual element; or, from the identification information, the target identification information belonging to the picture type is filtered out, and the visual element corresponding to the target identification information is used as the target visual element; or, from the identification information, the target identification information belonging to the control type is filtered out, and the visual element corresponding to the target identification information is used as the target visual element. Automatic extraction of the target visual element corresponding to the target identification information of the text type, picture type, or control type can be achieved, thereby improving information acquisition efficiency.

[0076] In some embodiments, the target type includes a geographic location type, a building type, a digital number type, a clothing type, a food type, or a transportation type. The geographic location type may include a text type geographic location, a picture type geographic location, or a control type geographic location, wherein the text type geographic location may be a geographic location expressed by text, the picture type geographic location may be an identifier of the geographic location in the corresponding picture, and the control type geographic location may be a geographic location pointed to by the control, for example, in response to triggering the geographic location control, the corresponding geographic location information may be displayed. By analogy, the building type may include a text type building, a picture type building, or a control type building, wherein the text type building may be a building expressed by text, the picture type building may be an image related to the building in the picture, and the control type building may be a building pointed to by the control, for example, in response to triggering the building control, the corresponding building information may be displayed. The digital number type may also include a text type digital number, a picture type digital number, or a control type digital number, wherein the control type digital number may be a digital number identifier, for example, in response to triggering the digital number control, the content corresponding to the digital number identifier may be displayed. Clothing types may include text type clothing, picture type clothing, or control type clothing, food types may include text type food, picture type food, or control type food, and vehicle types may include text type vehicles, picture type vehicles, or control type vehicles.

[0077] Optionally, the target type may also include a person type, an animal type, other object types, etc.

[0078] Optionally, the text type may include text of geographic location type, building type, digital number type, clothing type, food type or transportation type; the picture type may include pictures of geographic location type, building type, digital number type, clothing type, food type or transportation type; the control type may include controls of geographic location type, building type, digital number type, clothing type, food type or transportation type.

[0079] In this embodiment, target identification information of geographic location type, building type, digital number type, clothing type, food type or transportation type is filtered out from the identification information, and the visual elements of the geographic location type, building type, digital number type, clothing type, food type or transportation type corresponding to the target identification information are used as target visual elements. This can achieve flexible acquisition of target identification information of corresponding target types, acquire target visual elements of corresponding target types, and improve information acquisition efficiency.

[0080] In some embodiments, the triggering operation is a capture operation; the above method further includes: displaying the target visual element in the second page corresponding to the capture operation.

[0081] In this embodiment, the trigger operation is an interception operation, which represents intercepting the corresponding content. In response to the interception operation on the first page, the identification information corresponding to each visual element in the first page is displayed, the target visual element is determined according to the identification information, the second page corresponding to the interception operation is displayed, and the target visual element is displayed in the second page.

[0082] Optionally, a second page corresponding to the interception operation is displayed on the first page of the target application, and the target visual element is displayed in the second page.

[0083] Optionally, the second page corresponding to the capture operation is displayed on the first page at a preset ratio of the first page size, and the target visual element is displayed in the second page.

[0084] In this embodiment, the trigger operation is an interception operation, and the target visual element is displayed in the second page corresponding to the interception operation, so that the user can view the determined target visual element conveniently, which can improve the human-computer interaction efficiency between the electronic device and the user and improve the user experience.

[0085] In some embodiments, the second page is an interface of a screenshot application.

[0086] In this embodiment, information acquisition is achieved through a screenshot application, and the target visual element is displayed on the interface of the screenshot application corresponding to the capture operation.

[0087] In one example, if Figure 2As shown, the trigger operation is the capture operation of the screenshot application, the first page 202 of the target application is displayed, and in response to the trigger operation of the "capture" control 204 of the first page 202, the identification information corresponding to each visual element in the first page 202 is displayed. In this example, the identification information corresponding to the visual element is represented by the boundary identification of the area where the visual element is located. Specifically, a rectangular frame composed of lines of different formats can be used to represent the boundary of the area where different types of visual elements are located. For example, if the identification information 212 and the identification information 214 are both text-type identification information, the corresponding rectangular frame line format is the same, and the line format is both long and short line format, while the identification information 212 and the identification information 216 are different types of identification information, and the corresponding rectangular frame line format is different, wherein the identification information 212 is the text-type identification information, and the identification information 216 is the control-type identification information. Optionally, in response to the trigger operation of the "close" control on the first page 202, the current operation is stopped and the screenshot application is exited. It can be understood that the representation of identification information is not limited to the representation method described in this example. For example, the boundary of the area where the visual element is located can also be represented by an elliptical frame, a square frame or an irregularly shaped frame, and no specific limitation is made here. Similarly, the format of the frame lines is not limited to the format in this example, such as solid lines, dotted lines, long and short lines, etc., and can also be frame lines of other formats.

[0088] If the user selects the rectangular box corresponding to the visual element 206, that is, selects the identification information 210 corresponding to the visual element 206, the visual element 206 is used as the target visual element and displayed in the interface 208 of the screenshot application corresponding to the capture operation.

[0089] In some embodiments, the above method further includes: saving the content corresponding to the target visual element, and sending the saving path of the content corresponding to the target visual element to the operating system.

[0090] In this embodiment, after determining the target visual element, the content corresponding to the target visual element is saved, and the saving path of the content corresponding to the target visual element is sent to the operating system. The saving path of the content corresponding to the target visual element can be a preset storage path or a storage path specified by the operating system, and the storage location corresponding to the saving path can be in the operating system or in a local file.

[0091] Optionally, after the operating system receives the storage path of the content corresponding to the target visual element, the electronic device may obtain the content corresponding to the target visual element from the storage path.

[0092] Optionally, the content corresponding to the target visual element may be the target visual element itself, or an image drawn or mirrored based on the target visual element. For example, drawing is performed based on the target visual element to obtain an image corresponding to the target visual element. The image corresponding to the target visual element is visually identical to the target visual element, and the image corresponding to the target visual element has the same display size as the target visual element.

[0093] In this embodiment, by saving the content corresponding to the target visual element and sending the save path of the content corresponding to the target visual element to the operating system, the content corresponding to the target visual element can be quickly and conveniently obtained from the save path received by the operating system, thereby improving information acquisition efficiency.

[0094] In some embodiments, the triggering operation is an interception operation; the application corresponding to the interception operation is used to obtain the content corresponding to the target visual element from the saving path.

[0095] In this embodiment, the trigger operation is an interception operation, and in response to the interception operation on the first page, the application corresponding to the interception operation is started. Optionally, after receiving the save path of the content corresponding to the target visual element, the operating system sends the save path to the application corresponding to the interception operation, and the application corresponding to the interception operation can obtain the content corresponding to the target visual element from the save path. Optionally, after the application corresponding to the interception operation obtains the content corresponding to the target visual element from the save path, it can also share the corresponding content and perform other subsequent processing.

[0096] Optionally, the content corresponding to the target visual element may be saved in a save path in a picture format, or may be saved in a save path in a text format.

[0097] In some embodiments, obtaining content corresponding to the target visual element from the saved path includes:

[0098] If the target visual element includes a text visual element, the text information of the text visual element is obtained from the storage path; if the target visual element includes a non-text visual element, the image corresponding to the non-text visual element is obtained from the storage path.

[0099] In this embodiment, if the target visual element includes a text visual element, text information corresponding to the text visual element can be directly obtained, wherein the text information includes text content and text format, such as the font size, font size and color of the text content. The text information corresponding to the text visual element can be understood as having the same text content and text format as the text visual element, and the obtained text information of the text visual element can be edited by the user.

[0100] If the target visual element includes a non-text visual element, an image corresponding to the non-text visual element is obtained from the saved path. The image corresponding to the non-text visual element may be an image corresponding to the non-text visual element drawn based on the non-text visual element. It can be understood that the image information corresponding to the non-text visual element is visually the same as the corresponding non-text visual element, and the image corresponding to the target visual element has the same display size as the target visual element.

[0101] In this embodiment, if the target visual element includes a text visual element, the text information of the text visual element is obtained from the saved path; if the target visual element includes a non-text visual element, the image corresponding to the non-text visual element is obtained from the saved path. According to different types of target visual elements, different forms of content corresponding to the target visual elements can be obtained, which can achieve more flexible information acquisition. At the same time, the user has greater control over the content corresponding to the obtained target visual element, further improving the user experience.

[0102] In one embodiment, Figure 3 As shown, an information acquisition method is provided, including the following steps 302 to 308.

[0103] Step 302: Display the first page of the target application.

[0104] Step 304, in response to the triggering operation of the target control on the first page, displaying identification information corresponding to each visual element on the first page;

[0105] Step 306: Acquire the visual element selected by the user according to the identification information, and use the selected visual element as the target visual element.

[0106] Step 308 , displaying a second page corresponding to the triggering operation, and displaying the target visual element in the second page, wherein the second page is displayed on the first page with a size corresponding to a preset ratio of the size of the first page.

[0107] In this embodiment, the target visual element is determined by selecting the identification information corresponding to the visual element, and the target visual element is displayed on the second page, so that the user can freely select the corresponding target visual element according to the need. For example, one or more target visual elements displayed on the first page can be determined, and the corresponding target visual elements can be displayed for the user to confirm. If it is confirmed that the requirements are met, the displayed target visual element can be shared or otherwise processed, thereby improving the flexibility and quality of information acquisition.

[0108] In one embodiment, Figure 4As shown, an information acquisition method is provided, wherein an interception application is installed on the electronic device, the interception application is an application used to implement the interception operation, and the target application is an application other than the interception application, and the target application can be a system application or a third-party application other than the interception application. The interception application and the target application can implement information exchange or instruction transmission through the operating system, for example, the target application implements information exchange with the operating system through the first interface, and the interception application implements information exchange with the operating system through the second interface.

[0109] The target application starts after being triggered by the user, and displays the first page. At the same time, the target application loads and parses the controls; the interception application responds to the triggering operation of the first page and sends a view information acquisition request for the first page to the operating system; after receiving the view information acquisition request for the first page sent by the interception application, the operating system performs system service authentication, that is, identifies the permissions and security performance allowed by the target application, and after the authentication is passed, sends the view information acquisition instruction for the first page to the target application. It should be noted that the visual element in this embodiment is the view element, which is the basic unit for building the user interface and represents the visual element on the screen. The target application receives the view information acquisition instruction sent by the operating system, integrates the view elements, that is, organizes and packages the view elements of the first page, obtains the identification information corresponding to each view element, and sends the identification information corresponding to each view element to the operating system. The operating system sends the identification information corresponding to each view element to the interception application and displays the identification information corresponding to each view element in the first page; according to the identification information corresponding to each view element displayed on the first page, the target view element is determined, and the visual element selected by the user is used as the target visual element. The interception application filters out the identification information corresponding to the target view element from the identification information corresponding to each view element, and sends a request for obtaining the target view element information to the operating system. After receiving the corresponding request for obtaining the target view element information, the operating system sends an instruction for obtaining the target view element information to the target application; according to the instruction for obtaining the target view element information, the target application determines the specific target view element, that is, distributes it to the specific view, obtains the target view element information, saves the content corresponding to the target view element information, and sends the corresponding save path to the operating system. The operating system sends the save path to the interception application, and the interception application can obtain the content corresponding to the saved target view element information from the save path.

[0110] In one example, a method for obtaining information is provided, wherein the triggering operation is an interception operation. Figure 5 As shown, Figure 5FIG. 5 is a schematic diagram of a first page display, showing a first page 502 of a target application program, and in response to a triggering operation of a capture control 504 on the first page 502, displaying identification information corresponding to each visual element in the first page 502, such as Figure 6 As shown, the identification information corresponding to different types of visual elements on the first page 602 is represented by rectangular boxes composed of lines of different formats. For example, the line format of the rectangular box corresponding to the picture visual element is different from the line format of the rectangular box corresponding to the plain text visual element. Figure 6 The line formats of the rectangular boxes corresponding to the identification information 604 corresponding to the visual element of the text type, the identification information 606 corresponding to the visual element of the control type, and the identification information 608 corresponding to the visual element of the picture type are all different. The line format of the rectangular box corresponding to the identification information 604 corresponding to the visual element of the text type is long and short lines, the line format of the rectangular box corresponding to the identification information 606 corresponding to the visual element of the control type is a solid line, and the line format of the rectangular box corresponding to the identification information 608 corresponding to the visual element of the picture type is a dot-dash line. It should be noted here that Figure 6 The representation of various identification information in is only a possible example, and the protection of the embodiments of the present application is not limited to only Figure 6 The identification information representation method shown.

[0111] The visual element selected by the user according to the identification information is obtained, the selected visual element is used as the target visual element, and the target visual element is displayed in the second page corresponding to the interception operation. Figure 7 As shown, if the user selects the identification information 704 corresponding to the "hot" visual element on the first page 702, the "hot" visual element is displayed in the second page 706 corresponding to the interception operation, where "hot" is a control visual element; Figure 8 As shown, if the user selects the identification information 804 corresponding to the "Home" visual element on the first page 802, the visual element corresponding to the "Home" is displayed in the second page 806 corresponding to the interception operation, wherein the "Home" is a control visual element, but the control visual element is composed of the text visual element "Home" and the corresponding icon visual element; Fig. 9 As shown, if the user selects the identification information 906 corresponding to the image visual element 904 on the first page 902, the image visual element 904 is displayed in the second page 908 corresponding to the interception operation; Fig.10As shown, if the user selects identification information 1008 corresponding to image visual element 1006, identification information 1012 corresponding to text visual element 1010, identification information 1016 corresponding to text visual element 1014, identification information 1020 corresponding to text visual element 1018, and identification information 1024 corresponding to text visual element 1022 on the first page 1002, the corresponding image visual element 1006, text visual element 1010, text visual element 1014, text visual element 1018, and text visual element 1022 are displayed in the second page 1004 corresponding to the interception operation, and the position of each visual element displayed in the second page 1004 is the same as the position in the corresponding first page 1002, and the size corresponding to each visual element displayed in the second page 1004 is a preset proportion of the size displayed in the corresponding first page 1002.

[0112] In the above embodiment, by responding to the triggering of the interception control on the first page, the identification information corresponding to each visual element in the first page is displayed, the visual element selected by the user according to the identification information is obtained, the selected visual element is used as the target visual element, and the target visual element is displayed in the second page corresponding to the interception operation. The user can freely select the corresponding target visual element according to the need, and the corresponding target visual element is displayed for the user to confirm. If it is confirmed that the needs are met, the displayed target visual element can be shared or otherwise processed, thereby improving the flexibility and quality of information acquisition, and can also greatly improve the user experience.

[0113] It should be understood that the Figure 2 , Figures 5 to 10 The text content presented in does not represent the meaning of the text content itself, but is only used to represent different text contents.

[0114] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0115] Based on the same inventive concept, the embodiment of the present application also provides an information acquisition device for implementing the above-mentioned information acquisition method. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above-mentioned method, so the specific limitations in the one or more information acquisition device embodiments provided below can refer to the limitations on the information acquisition method above, and will not be repeated here.

[0116] In one embodiment, Fig.11 As shown, an information acquisition device is provided, including: a page display module 1102, an identification display module 1104 and an information determination module 1106, wherein:

[0117] A page display module 1102, used to display a first page of a target application;

[0118] The identification display module 1104 is used to display identification information corresponding to each visual element in the first page in response to a triggering operation on the first page;

[0119] The information determination module 1106 is configured to determine a target visual element according to the identification information.

[0120] In one embodiment, the identification display module 1104 is further used to:

[0121] In response to a triggering operation on the first page, sending a view information acquisition request to an operating system;

[0122] Receive view information returned by the operating system, where the view information includes identification information corresponding to each visual element;

[0123] Display identification information corresponding to each visual element in the first page.

[0124] In one embodiment, the identification display module 1104 is further used to: receive view information returned by the operating system after the target application is authenticated.

[0125] In one embodiment, the information determination module 1106 is further configured to:

[0126] The visual element selected by the user according to the identification information is acquired, and the selected visual element is used as the target visual element.

[0127] In one embodiment, the information determination module 1106 is further configured to:

[0128] Target identification information that meets the target screening condition is screened out from the identification information, and the visual element corresponding to the target identification information is used as the target visual element.

[0129] In one embodiment, the information determination module 1106 is further configured to:

[0130] Target identification information of a target type is screened out from the identification information, and a visual element corresponding to the target identification information is used as a target visual element.

[0131] In one embodiment, the trigger operation is a capture operation; the apparatus further comprises a visual element display module, configured to display the target visual element in a second page corresponding to the capture operation.

[0132] In one embodiment, the above device further includes a content storage module, which is used to:

[0133] The content corresponding to the target visual element is saved, and the saving path of the content corresponding to the target visual element is sent to the operating system.

[0134] In one embodiment, the saved content acquisition module is used to acquire the content corresponding to the target visual element from the saved path, including:

[0135] If the target visual element includes a text visual element, acquiring text information of the text visual element from the storage path;

[0136] If the target visual element includes a non-text visual element, an image corresponding to the non-text visual element is obtained from the storage path.

[0137] Each module in the above-mentioned information acquisition device can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0138] In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as follows: Fig.12As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, an information acquisition method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0139] Those skilled in the art will understand that Fig.12 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0140] The embodiment of the present application also provides a computer-readable storage medium, one or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, the processors execute the steps of the information acquisition method.

[0141] The embodiment of the present application also provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute the information acquisition method.

[0142] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws and regulations and standards.

[0143] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0144] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0145] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for obtaining information, characterized in that: include: Display the first page of the target application; In response to a triggering operation on the first page, displaying identification information corresponding to each visual element in the first page; A target visual element is determined according to the identification information.

2. The method according to claim 1, characterized in that The displaying, in response to the triggering operation on the first page, identification information corresponding to each visual element in the first page includes: In response to a triggering operation on the first page, sending a view information acquisition request to an operating system; Receive view information returned by the operating system, where the view information includes identification information corresponding to each visual element; Display identification information corresponding to each visual element in the first page.

3. The method according to claim 2, characterized in that The receiving the view information returned by the operating system includes: Receive the view information returned by the operating system after the target application is authenticated.

4. The method according to claim 1, characterized in that The visual elements include text, pictures or controls.

5. The method according to claim 1, characterized in that The step of determining the target visual element according to the identification information includes: The visual element selected by the user according to the identification information is acquired, and the selected visual element is used as the target visual element.

6. The method according to claim 1, characterized in that The step of determining the target visual element according to the identification information includes: Target identification information that meets the target screening condition is screened out from the identification information, and the visual element corresponding to the target identification information is used as the target visual element.

7. The method according to claim 6, characterized in that The step of filtering out target identification information that meets a target filtering condition from the identification information and using a visual element corresponding to the target identification information as a target visual element includes: Target identification information of a target type is screened out from the identification information, and a visual element corresponding to the target identification information is used as a target visual element.

8. The method according to claim 7, characterized in that The target type includes a text type, a picture type or a control type.

9. The method according to claim 7, characterized in that: The target type includes a geographical location type, a building type, a digital number type, a clothing type, a food type or a transportation type.

10. The method according to any one of claims 1 to 9, characterized in that The trigger operation is an interception operation; the method further includes: The target visual element is displayed in a second page corresponding to the interception operation.

11. The method according to claim 10, characterized in that The second page is an interface of a screenshot application.

12. The method according to any one of claims 1 to 9, characterized in that The method further comprises: The content corresponding to the target visual element is saved, and the saving path of the content corresponding to the target visual element is sent to the operating system.

13. The method according to claim 12, characterized in that The trigger operation is an interception operation; the application corresponding to the interception operation is used to obtain the content corresponding to the target visual element from the saving path.

14. The method according to claim 13, characterized in that The acquiring the content corresponding to the target visual element from the saved path includes: If the target visual element includes a text visual element, acquiring text information of the text visual element from the storage path; If the target visual element includes a non-text visual element, an image corresponding to the non-text visual element is obtained from the storage path.

15. An information acquisition device, characterized in that: include: A page display module, used to display the first page of the target application; an identification display module, configured to display identification information corresponding to each visual element in the first page in response to a triggering operation on the first page; An information determination module is used to determine a target visual element according to the identification information.

16. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, wherein: When the computer program is executed by the processor, the processor is caused to perform the steps of the method according to any one of claims 1 to 14.

17. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 14 are implemented.

18. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 14 are implemented.

Images