Buried point mapping method, device, computer equipment and storage medium

Abstract

The present application relates to a method, device, computer equipment and storage medium for mapping buried points. The method comprises: obtaining a target page, and obtaining a page snapshot corresponding to the target page based on the target page; obtaining the target buried point in the page snapshot, and the data of the first element where the target buried point is located; when it is determined based on the data of the first element that there is no buried point corresponding to the target buried point in the target page, obtaining the data of each second element in the target page; matching the data of the first element with the data of each second element respectively, and determining the similarity between each second element and the first element respectively; determining the target element from each second element based on the similarity between each second element and the first element, and mapping the target buried point to the target element in the target page. This method can be used to map the target buried point in the page snapshot to the target page.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, apparatus, computer device and storage medium for mapping buried points. Background Art

[0002] With the development of network and computer technology, more and more user information is generated. Enterprises can collect and analyze this user information to produce products that better meet user needs. Traditional information collection methods usually involve adding embedded points on web pages to collect user information through embedded points.

[0003] However, when a web page is changed to obtain a new web page, the original embedded points in the web page will also become invalid, and there is a problem that the embedded points cannot be mapped to the new web page. Summary of the Invention

[0004] Based on this, it is necessary to provide a point mapping method, device, computer equipment and storage medium that can map points to new pages to address the above technical problems.

[0005] A method for mapping buried points, the method comprising:

[0006] Obtaining a target page, and obtaining a page snapshot corresponding to the target page based on the target page;

[0007] Obtain the target embedding point in the page snapshot and the data of the first element where the target embedding point is located;

[0008] When it is determined based on the data of the first element that there is no embedding point corresponding to the target embedding point in the target page, obtaining data of each second element in the target page;

[0009] Matching the data of the first element with the data of each of the second elements, and determining the similarity between each of the second elements and the first element;

[0010] Based on the similarity between each second element and the first element, a target element is determined from each second element, and the target embedding point is mapped to the target element in the target page.

[0011] A buried point mapping device, comprising:

[0012] A target page and page snapshot acquisition module is used to acquire a target page and, based on the target page, acquire a page snapshot corresponding to the target page;

[0013] A first element data acquisition module is used to acquire a target embedding point in the page snapshot and data of the first element where the target embedding point is located;

[0014] A second element data acquisition module is configured to acquire data of each second element in the target page when it is determined based on the data of the first element that there is no embedding point corresponding to the target embedding point in the target page;

[0015] a similarity determination module, configured to match the data of the first element with the data of each of the second elements, and determine the similarity between each of the second elements and the first element;

[0016] A buried point mapping module is used to determine a target element from each second element based on the similarity between each second element and the first element, and map the target buried point to the target element in the target page.

[0017] A computer device includes a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.

[0018] A computer-readable storage medium stores a computer program, which implements the steps of the above method when executed by a processor.

[0019] The above-mentioned buried point mapping method, device, computer equipment and storage medium obtain the target page, and obtain the page snapshot corresponding to the target page based on the target page; obtain the target buried point in the page snapshot, and the data of the first element where the target buried point is located; when it is judged based on the data of the first element that there is no buried point corresponding to the target buried point in the target page, obtain the data of each second element in the target page; match the data of the first element with the data of each second element respectively, and determine the similarity between each second element and the first element respectively; through the similarity between the second element and the first element, the similarity between the second element and the first element can be obtained. Therefore, based on the similarity between each second element and the first element, the target element can be determined from each second element, and the target buried point can be mapped to the target element in the target page. Not only can the target buried point in the page snapshot be mapped to the target page, but the target buried point can also be mapped to the target element in the target page more accurately, and the buried point can be used again, thereby improving the utilization rate of the buried point. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is an application environment diagram of a point mapping method in one embodiment;

[0021] Figure 21 is a flow chart of a method for mapping buried points in one embodiment;

[0022] Figure 3 A schematic diagram of a visual tracking configuration system in one embodiment;

[0023] Figure 4 This is an architectural diagram of a visual tracking configuration system in one embodiment;

[0024] Figure 5 This is an interface diagram for creating a new web crawling task in one embodiment;

[0025] Figure 6 This is an architectural diagram of the service layer of a crawler program in one embodiment;

[0026] Figure 7 Schematic diagram of a method for mapping buried points in one embodiment;

[0027] Figure 8 A schematic flow chart of a step of determining the similarity between a text element and a first element in one embodiment;

[0028] Figure 9 Schematic diagram of a method for mapping buried points in another embodiment;

[0029] Figure 10 1 is a structural block diagram of a buried point mapping device in one embodiment;

[0030] Figure 11 FIG. 1 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0031] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0032] The buried point mapping method provided in this application can be applied to Figure 1In the application environment shown. The terminal 102 communicates with the server 104 through the network. The terminal 102 sends the target page to the server 104, and the server 104 obtains the target page, and obtains the page snapshot corresponding to the target page based on the target page; obtains the target buried point in the page snapshot, and the data of the first element where the target buried point is located; when it is judged based on the data of the first element that there is no buried point corresponding to the target buried point in the target page, obtains the data of each second element in the target page; matches the data of the first element with the data of each second element respectively, and determines the similarity between each second element and the first element respectively; determines the target element from each second element based on the similarity between each second element and the first element, and maps the target buried point to the target element in the target page. The terminal 102 can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers and portable wearable devices, and the server 104 can be implemented with an independent server or a server cluster consisting of multiple servers.

[0033] In one embodiment, Figure 2 As shown, a method for mapping buried points is provided, which is applied to a computer device, which may be a server, a terminal, or other devices, and includes the following steps:

[0034] Step 202: Acquire a target page, and based on the target page, acquire a page snapshot corresponding to the target page.

[0035] A page snapshot is a copy of a page at a specific point in time. It can include elements such as text, buttons, input boxes, navigation bars, images, links, videos, and audio. Similarly, the target page can also include elements such as text, buttons, input boxes, navigation bars, images, links, videos, and audio.

[0036] Specifically, the computer device obtains a target page and an identifier of the target page, and based on the identifier of the target page, obtains a page snapshot matching the identifier of the target page from a memory. The identifier of the target page may include at least one of a number, a character string, and a network address of the target page.

[0037] For example, a computer device obtains a target page and a network address of the target page, and matches the network address of the target page with the network addresses of each page snapshot in the memory in sequence. When there is a page snapshot that is consistent with the network address of the target page, the page snapshot is the page snapshot corresponding to the target page.

[0038] In one embodiment, the computer device may receive a target page sent by another computer device. In another embodiment, the computer device may also obtain a target page accessed by an access instruction input by a user.

[0039] Step 204, obtain the target embedding point in the page snapshot and the data of the first element where the target embedding point is located.

[0040] Tracking points are program code that captures, processes, and sends specific user behaviors or events. Target tracking points are tracking points within a page snapshot. There's no limit on the number of target tracking points in a page snapshot; it can be one or more.

[0041] The target embedding point has a specific identifier, and the computer device can obtain the target embedding point from the page snapshot based on the specific identifier. The specific identifier of the target embedding point can be set according to user needs.

[0042] The first element in the page snapshot can be at least one of text, button, input box, navigation bar, picture, link, video, audio, etc. When the first element where the target buried point is located is a button, the target buried point can collect data such as the number of times the button is clicked and the time of click. When the first element where the target buried point is located is text, the target buried point can collect data such as the number of times the text is browsed, the duration of browsing, and the frequency of browsing. When the first element where the target buried point is located is an input box, the target buried point can collect data such as the content entered in the input box and the duration of the content entered in the input box. When the first element where the target buried point is located is a video, the target buried point can collect data such as the number of times the video is viewed and the duration of viewing.

[0043] The data of the first element where the target embedding point is located refers to the data related to the first element, which may include the attributes of the first element, the label of the first element, the first element structure of the first element in the page structure of the page snapshot, etc.

[0044] The attributes (classname) of the first element include, for example, the position of the first element, the color of the first element, the size of the first element, the size of the font in the first element, the color of the font in the first element, and the like.

[0045] The label of the first element is, for example, "article" or "button". The type of the first element can be obtained through the semantics of the label. For example, if the label of the first element is "article", which semantically represents an article, it can be known that the first element is an article; if the label of the first element is "button", which semantically represents a button, it can be known that the first element is a button.

[0046] The first element structure of the first element in the page structure of the page snapshot refers to the structural relationship of the first element in the DOM (Document Object Model) tree of the page snapshot. The page snapshot includes a DOM tree, and the structural relationship of the first element in the page structure can be obtained by parsing the DOM tree. For example, the first element A is an article, the first element B is a picture in the article, and the first element C is a link in the article. Then the structural relationship between the first element A, the first element B and the first element C is: the first element B and the first element C are both child nodes of the first element A, and the first element B and the first element C are in a parallel relationship.

[0047] For example, when the first element where the target embedding point is located is text, the data of the first element may be the content of the text, the font of the text, the color of the text, the position of the text, the size of the area occupied by the text in the page snapshot, the first element structure of the text in the page structure of the page snapshot, etc. When the first element where the target embedding point is located is a button, the data of the first element may be the position of the button, the size of the button, the first element structure of the button in the page structure of the page snapshot, etc. When the first element where the target embedding point is located is an image, the data of the first element may be the size of the image, the position of the image, the address of the image, the first element structure of the image in the page structure of the page snapshot, etc.

[0048] Step 206: When it is determined based on the data of the first element that there is no embedding point corresponding to the target embedding point in the target page, the data of each second element in the target page is obtained.

[0049] It is understandable that when the page structure of the page changes, the embedded points in the page become invalid, and thus it is impossible to complete operations such as data collection, data processing and sending. For example, there is a target embedded point A in the page snapshot, and the first element where the target embedded point A is located is the text, that is, <div id＝article> , when the structure of the page corresponding to the page snapshot changes, such as <div id＝article> Adjust to <article>< / article> structure, and obtain the target page, then the target embedding point A becomes invalid, and there is no embedding point corresponding to the target embedding point A in the target page, and the data of the text cannot be collected.

[0050] The second element in the target page may be at least one of text, a button, an input box, a navigation bar, an image, a link, a video, and an audio. The data of the second element refers to data related to the second element, and may include attributes of the second element, a tag of the second element, and the second element structure of the second element in the page structure of the target page.

[0051] The attributes (classname) of the second element include, for example, the position of the second element, the color of the second element, the size of the second element, the size of the font in the second element, the color of the font in the second element, and the like.

[0052] The label of the second element is, for example, "article" or "button". The type of the second element can be obtained through the semantics of the label of the second element. For example, if the label of the second element is "article", which semantically represents an article, it can be known that the second element is an article; if the label of the second element is "button", which semantically represents a button, it can be known that the second element is a button.

[0053] The second element structure of the second element in the page structure of the target page refers to the structural relationship of the second element in the DOM tree of the target page. The target page includes a DOM tree, and the structural relationship of the second element in the page structure can be obtained by parsing the DOM tree. For example, second element A is an article, second element B is an image in the article, and second element C is a link in the article. Then the structural relationship between second element A, second element B, and second element C is: second element B and second element C are both child nodes of second element A, and second element B and second element C are in a parallel relationship.

[0054] For example, when the second element where the target embedding point is located is text, the data of the second element may include the content of the text, the font of the text, the color of the text, the position of the text, the size of the area occupied by the text in the target page, the second element structure of the text in the page structure of the target page, etc. When the second element where the target embedding point is located is a button, the data of the second element may include the position of the button, the size of the button, the second element structure of the button in the page structure of the target page, etc. When the second element where the target embedding point is located is an image, the data of the second element may include the size of the image, the position of the image, the address of the image, the second element structure of the image in the page structure of the target page, etc.

[0055] In one embodiment, the computer device can query whether there is a tracking point corresponding to the target tracking point in the target page through the puppeteer.$eval interface.

[0056] Step 208 : Match the data of the first element with the data of each second element, and determine the similarity between each second element and the first element.

[0057] The similarity between the second element and the first element refers to the degree of similarity between the second element and the first element. The higher the similarity, the more similar the second element and the first element are.

[0058] The data of the first element may include data of at least one dimension, and the data of the second element may also include data of at least one dimension. For each dimension, the data of the first element is matched with the data of the same dimension of the second element through the diff command to obtain the matching result of each dimension, and then the similarity between the second element and the first element is determined based on the matching result of each dimension.

[0059] For example, the data of the first element and the data of the second element include two dimensions, namely size and position. For the size dimension, the size of the first element is matched with the size of the second element through the diff command to obtain a matching result; for the position dimension, the position of the first element is matched with the position of the second element through the diff command to obtain a matching result, and then the similarity between the second element and the first element is determined based on the matching result obtained from the size dimension and the matching result obtained from the position dimension.

[0060] It should be noted that when the second element does not have data for a certain dimension, but the first element has data for that dimension, the matching result can be directly generated as the data for the second element not existing. Similarly, when the first element does not have data for a certain dimension, but the second element has data for that dimension, the matching result can be directly generated as the data for the first element not existing.

[0061] Step 210: determine the target element from each second element based on the similarity between each second element and the first element, and map the target embedding point to the target element in the target page.

[0062] In one embodiment, the computer device may determine the second element with the highest similarity as the target element. In another embodiment, the computer device may determine the second element with the second highest similarity as the target element. In other embodiments, the computer device may determine the second element with other similarities as the target element, without limitation.

[0063] Specifically, the computer device adds the target tracking point to the target element of the target page; and updates the tracking point information of the target page based on the target page after the target tracking point is added. The computer device's memory stores the tracking point information of the target page. The tracking point information may include information such as the second element where the tracking point is located, the event monitored by the tracking point, and the time when the tracking point was created.

[0064] In one embodiment, after the computer device adds the target embedding point in the target element in the target page, it obtains the embedding point information of the target page after the target embedding point is added, and replaces the embedding point information in the memory with the embedding point information of the target page.

[0065] In another embodiment, after the computer device adds the target buried point in the target element in the target page, it obtains the buried point information of the target buried point in the target page after the target buried point is added, and adds the buried point information of the target buried point to the memory.

[0066] The above-mentioned buried point mapping method obtains the target page, and obtains the page snapshot corresponding to the target page based on the target page; obtains the target buried point in the page snapshot, and the data of the first element where the target buried point is located; when it is judged based on the data of the first element that there is no buried point corresponding to the target buried point in the target page, obtains the data of each second element in the target page; matches the data of the first element with the data of each second element respectively, and determines the similarity between each second element and the first element respectively; through the similarity between the second element and the first element, the similarity between the second element and the first element can be obtained. Therefore, based on the similarity between each second element and the first element, the target element is determined from each second element, and the target buried point is mapped to the target element in the target page. Not only can the target buried point in the page snapshot be mapped to the target page, but the target buried point can also be mapped to the target element in the target page more accurately, and the buried point can be used again, thereby improving the utilization rate of the buried point.

[0067] In addition, there are other functions related to tracking in computer equipment, such as tracking testing, tracking configuration, tracking data reporting, etc. By mapping the target tracking to the target element through tracking mapping, the functions related to tracking in computer equipment can also be improved.

[0068] In another embodiment, when a page snapshot corresponding to the target page is not found based on the target page, it means that the target page is opened for the first time, and the target page is stored as a page snapshot in the memory of the computer device for subsequent buried point mapping.

[0069] In another embodiment, when it is determined based on the data of the first element that there is a buried point in the target page corresponding to the target buried point, the computer device can perform operations such as data collection, processing and sending through the buried point in the target page.

[0070] In one embodiment, when the similarity between each second element and the first element is lower than a preset threshold, it means that the target element corresponding to the target embedding point cannot be found in the target page. It can be confirmed that the target embedding point is permanently lost and an alarm message is generated.

[0071] In one embodiment, a computer device may obtain a tracking configuration request and configure tracking on a target page based on the tracking configuration request. The tracking configuration request may include the location of the tracking configuration, the elements of the tracking configuration, the events monitored by the tracking, the location of the data collected by the tracking, etc. The tracking configuration request may be generated by a visual tracking configuration system.

[0072] Figure 3 FIG. 1 is a schematic diagram of a visual tracking configuration system in one embodiment. Figure 3 As shown, the project list includes Project A. Users can click the button for Project A to view the tracking points configured in Project A. Users can also add a new project by clicking the Add Project button, configure tracking points in the new project, and generate a tracking point configuration request.

[0073] Figure 4 This is an architectural diagram of a visual tracking configuration system in one embodiment. Figure 4 In the embodiment, the visual tracking configuration system includes three modules, namely SDK (Software Development Kit) module 402, configuration module 404 and reporting module 406.

[0074] The SDK module 402 includes a unique ID generator that can generate a unique ID for the tracking point. The SDK module 402 also includes executing different operations according to different strategies, such as sending the tracking point configuration instruction to the configuration module 404 according to the tracking point configuration instruction input by the user, communicating with the configuration module 404, and then receiving the tracking point configuration request sent by the configuration module 404, and sending the tracking point configuration request to the computer device; for example, sending the data reporting instruction to the reporting module 406 according to the data reporting instruction input by the user, and then receiving the data pulled by the reporting module 406.

[0075] After receiving the tracking configuration instructions sent by the SDK module, the configuration module 404 can generate a tracking configuration request through operations such as configuration pull and configuration service, and send the tracking configuration request to the SDK module 402. The configuration module 404 can also provide a cache to reduce server pressure. The configuration module can also store the tracking configuration request in the ckv system. The ckv system is a key-value memory system. The configuration module 404 can also display the data of the tracking points configured in the tracking configuration request to provide a visual interface for the user.

[0076] Reporting module 406 can receive data reporting instructions from SDK module 402, pull data from the tracking points according to the data reporting instructions, perform data analysis services on the pulled data, and report the pulled data to SDK module 402. Reporting module 406 can also store the pulled data in the TDW system. The TDW system is a storage system for distributed databases.

[0077] In one embodiment, the computer device may include a crawler program, which obtains the target page through the crawler program, and obtains a page snapshot corresponding to the target page based on the target page; obtains the target embedded point in the page snapshot, and the data of the first element where the target embedded point is located; when it is determined based on the data of the first element that there is no embedded point corresponding to the target embedded point in the target page, obtains the data of each second element in the target page; matches the data of the first element with the data of each second element, and determines the similarity between each second element and the first element; determines the target element from each second element based on the similarity between each second element and the first element. A crawler program refers to a program that automatically executes preset operations according to certain rules. For example, a crawler program can crawl data, intercept interface functions called by a computer device, etc.

[0078] In one embodiment, Figure 5 As shown, a computer device can create a new web crawling task using a crawler program. Creating a new web crawling task consists of three steps: entering the URL, crawling data, and setting up the task. In the URL entry step, you need to enter the webpage address to be crawled, the task name, the project name, and whether login is required. Click the "Next" button to proceed to the data crawling step. After crawling the data, you can set up the data.

[0079] In one embodiment, Figure 6 The following is an architectural diagram of the crawler program's service layer. The crawler program can provide a scheduling service, which is distributed and supports large-scale data crawling. The scheduling service includes a scheduled scheduling function, which can periodically configure tasks and agents from the configuration module; then manage permissions and verify permissions through the permission module; once the verification is passed, the crawling module can be invoked to perform anti-crawling, browser instance management, pre-processing, content identification, and other operations to crawl data; the crawled data is sent to the cleaning module for deduplication verification, sensitive word cleaning, and general cleaning; the cleaned data is sent to the warehousing module for warehousing configuration and warehousing distribution operations. The scheduling service also includes machine monitoring and task monitoring to keep alive functions.

[0080] The crawler program also includes Web interface, external call interface, service interface, storage interface, etc. The Web interface can be used to access Web services, the external call interface can be used to call data from the outside, the service interface can be used to call various service modules of the crawler program, and the storage interface can be used to store data in the memory or obtain data from the memory.

[0081] The crawler program can be configured visually through the visual task configuration platform, and data can be analyzed and monitored through the data analysis and monitoring platform. The crawler program also includes interface services. It also includes the Redis (Remote Dictionary Server) service and the Elasticsearch service; Elasticsearch is a Lucene-based search server.

[0082] In one embodiment, the data of the first element includes the first element structure of the first element in the page structure of the page snapshot; the method of judging whether there is a buried point corresponding to the target buried point in the target page based on the data of the first element includes: comparing the first element structure with the second element structure of each second element included in the target page, and when there is a second element consistent with the first element structure, there is a buried point corresponding to the target buried point in the target page; when the second element structure of each second element included in the target page is inconsistent with the first element structure, there is no buried point corresponding to the target buried point in the target page.

[0083] The first element structure of the first element in the page structure of the page snapshot refers to the structural relationship of the first element in the DOM tree of the page snapshot. The target page includes data of the second element, and the data of the second element includes the second element structure of the second element in the page structure of the target page. The second element structure of the second element in the target page of the page snapshot refers to the structural relationship of the second element in the DOM tree of the target page.

[0084] The computer device compares the first element structure with the second element structures of each second element included in the target page. When there is a second element that is consistent with the first element structure, it means that the second element structure of the second element in the target page has not changed, and there is a buried point corresponding to the target buried point in the target page. The buried point corresponding to the second element, that is, the target buried point in the page snapshot is still valid.

[0085] When the second element structure of each second element included in the target page is inconsistent with the first element structure, it means that the second element structure of the second element in the target page has changed, there is no burying point corresponding to the target burying point in the target page, and the target burying point in the page snapshot is invalid in the target page.

[0086] In this embodiment, by comparing the first element structure with the second element structures of each second element included in the target page, it is possible to more accurately determine whether there is a buried point corresponding to the target buried point in the target page, that is, to more accurately determine whether the target buried point in the page snapshot is valid in the target page.

[0087] In one embodiment, the data of the first element includes the attributes of the first element and the label of the first element, and the data of the second element includes the attributes of the second element and the label of the second element; the data of the first element is matched with the data of each second element, and the similarity between each second element and the first element is determined, including: matching the attributes of the first element with the attributes of each second element, and determining the first value of each second element according to the matching results; matching the label of the first element with the label of each second element, and determining the second value of each second element according to the matching results; for each second element, determining the similarity between the second element and the first element based on the first value and the second value.

[0088] The attributes of the first element include, for example, the size of the area occupied by the first element, the color of the first element, the font size of the text in the first element, the font color of the text in the first element, etc. The attributes of the second element include, for example, the size of the area occupied by the second element, the color of the second element, the font size of the text in the second element, the font color of the text in the second element, etc.

[0089] The tag of the first element indicates the type of the first element, and the tag of the second element indicates the type of the second element. For example, "article" indicates an article, "title" indicates a title, "button" indicates a button, "paragraph" indicates a paragraph, and so on.

[0090] The computer device matches the attributes of the first element with the attributes of the second element. When the attributes of the first element and the second element are consistent, the match result is a successful match, and the first value corresponding to the successful match can be obtained. When the attributes of the first element and the second element are inconsistent, the match result is an unsuccessful match, and the first value corresponding to the unsuccessful match can be obtained. The first values ​​corresponding to different matching results can be set according to user needs.

[0091] The computer device matches the label of the first element with the label of the second element. When the labels of the first element and the second element are consistent, the match result is a successful match, and a second value corresponding to the successful match can be obtained. When the labels of the first element and the second element are inconsistent, the match result is an unsuccessful match, and a second value corresponding to the unsuccessful match can be obtained. The second values ​​corresponding to different matching results can be set according to user needs.

[0092] In one embodiment, for each second element, the first value and the second value are added, and the sum obtained by the addition is used as the similarity between the second element and the first element.

[0093] For example, the attribute of the first element is A1 and the label is B1. When the attribute of the second element is A1, the first value of the second element is 10. When the label of the second element is B1, the second value of the second element is 10. Therefore, the similarity between the second element and the first element is 10+10=20.

[0094] In another embodiment, a first weight factor corresponding to the attribute of the second element is obtained, a second weight factor corresponding to the label of the second element is obtained, and for each second element, the first value and the first weight factor are multiplied, and the second value and the second weight factor are multiplied, and the obtained products are added together, and finally the sum obtained is used as the similarity between the second element and the first element.

[0095] For example, the first weight factor corresponding to the attribute of the second element is 0.4, the second weight factor corresponding to the label of the second element is 0.6, the first value of the second element A is 10, the second value is 20, the first value of the second element B is 20, the first value is 15, then the similarity between the second element A and the first element is 0.4*10+0.6*20=16, and the similarity between the second element B and the first element is 0.4*20+0.6*15=17.

[0096] In this embodiment, the attributes of the first element are matched with the attributes of each second element, and the first value of each second element is determined according to the matching results; the label of the first element is matched with the label of each second element, and the second value of each second element is determined according to the matching results; for each second element, based on the first value and the second value, the similarity between the second element and the first element can be determined more accurately.

[0097] In one embodiment, the data of the first element includes the first element structure of the first element in the page structure of the page snapshot; the first element structure is compared with the second element structure of each second element included in the target page, and when there is a second element consistent with the first element structure, there is a buried point corresponding to the target buried point in the target page; when the second element structure of each second element included in the target page is inconsistent with the first element structure, there is no buried point corresponding to the target buried point in the target page; the data of the first element includes the attributes of the first element and the label of the first element, and the data of the second element includes the attributes of the second element and the label of the second element; when it is judged based on the data of the first element that there is no buried point corresponding to the target buried point in the target page, the data of each second element in the target page is obtained; the attributes of the first element are matched with the attributes of each second element, and the first value of each second element is determined according to the matching results; the label of the first element is matched with the label of each second element, and the second value of each second element is determined according to the matching results; for each second element, the similarity between the second element and the first element is determined based on the first value and the second value.

[0098] In this embodiment, through the first element structure and the second element structure of each second element included in the target page, it is possible to more accurately determine whether there is a buried point corresponding to the target buried point in the target page. When there is no buried point corresponding to the target buried point in the target page, the attributes of the first element are further matched with the attributes of each second element, and the label of the first element is matched with the label of each second element, so that the target element corresponding to the target buried point can be more accurately determined from the target page.

[0099] like Figure 7 As shown, the buried point mapping algorithm of this embodiment combines DOM structure analysis, attribute analysis and tag analysis, which can more accurately determine the target element corresponding to the target buried point in the target page, thereby performing buried point mapping more accurately.

[0100] In one embodiment, Figure 8 As shown, matching the data of the first element with the data of each second element respectively, and determining the similarity between each second element and the first element respectively, includes:

[0101] Step 802: When the content of the first element includes text, select text elements whose content includes text from each second element of the target page.

[0102] When the first element is an input box, article, comment, etc., the content of the first element includes text. The text element refers to the second element in the target page whose content includes text.

[0103] Step 804 : Match the text included in the content of the first element with the text included in the content of each text element, and determine the similarity between each text element and the first element.

[0104] The text included in the content of the first element includes data such as the text itself, the number of words in the text, the font of the text, etc. Similarly, the text included in the content of the text element also includes data such as the content of the text itself, the number of words in the text, the font of the text, etc.

[0105] Specifically, for each dimension of the text included in the content of the first element and the text included in the content of the text element, data of the same dimension are matched, and the similarity between the text element and the first element is determined based on the matching result.

[0106] Determining a target element from each second element based on similarity between each second element and the first element includes:

[0107] Step 806 : Determine a target element from each text element based on the similarity between each text element and the first element.

[0108] In this embodiment, when the content of the first element includes text, text elements whose content includes text are filtered out from the second elements of the target page, and then the text included in the content of the first element is matched with the text included in the content of each text element, and the similarity between each text element and the first element is determined respectively; matching the first element with all the second elements is avoided, and the matching efficiency can be improved, so that the target element can be found more quickly and the target buried point can be mapped to the target element more quickly.

[0109] In one embodiment, the method further includes: determining a first text density of the first element based on the text included in the content of the first element; the first text density is positively correlated with the amount of text included in the content of the first element; determining a second text density of the text element based on the text included in the content of the text element; the second text density is positively correlated with the amount of text included in the content of the text element. Matching the text included in the content of the first element with the text included in the content of each text element, and determining the similarity between each text element and the first element, including: matching the first text density of the first element with the second text density of each text element, and determining the similarity between each text element and the first element.

[0110] Text density refers to the degree of text density. The more text an element contains, the greater its text density. First text density refers to the density of text within the first element. Second text density refers to the density of text within the second element.

[0111] For example, the first element is an article, the content of which includes 1,000 words of text, and the second element is a comment, the content of which includes 100 words of text. Then the first text density of the first element is high, and the second text density of the second element is low.

[0112] It is understandable that the text included in the content of the text elements in the page is usually input by the user, and the developer usually modifies the page structure of the page without modifying the content included in the text elements in the page. Therefore, the amount of text included in the content of the text elements does not change, that is, the second text density of the text elements does not change. By matching the first text density of the first element with the second text density of the text elements respectively, the similarity between the first element and each text element can be more accurately determined, thereby more accurately determining the target element.

[0113] In one embodiment, the data of the first element includes visual data of the first element; the data of the second element includes visual data of the second element. Matching the data of the first element with the data of each second element, and determining the similarity between each second element and the first element, includes: matching the visual data of the first element with the visual data of each second element, and determining the similarity between each second element and the first element.

[0114] Visual data includes element color, element size, font size, font color and other data.

[0115] In a simple UI (User Interface) page, there are two elements, namely the title and the body. After adjusting the position of the title and the element ID, the embedded point where the title is located becomes invalid. Through this embodiment, the visual data of the first element is matched with the visual data of each second element respectively, and the target element, i.e. the title, can be quickly found, and the target embedded point can be mapped to the title. For the UI testing system, after detecting that a page has changed, the embedded point mapping method can be used to further analyze the changed content.

[0116] In one embodiment, applied to a server, when it is determined based on the data of the first element that there is no burying point corresponding to the target burying point in the target page, after obtaining the data of each second element in the target page, it also includes: obtaining the second terminal identification of each second terminal connected to the server; the second terminal identification is the identification of other terminals except the first terminal identification, and the first terminal identification is the identification of the terminal that sends the target page to the server; generating a burying point invalidation instruction, and sending the burying point invalidation instruction to the second terminal where each second terminal identification is located respectively; the burying point invalidation instruction is used to instruct the second terminal to intercept the burying point mapping request.

[0117] The first terminal identifier is the identifier of the terminal that sent the target page to the server. When the server retrieves the target page and determines that there is no embedding point corresponding to the target embedding point on the target page, it retrieves the second terminal identifiers of each terminal connected to the server. The second terminal identifier is the identifier of a terminal other than the first terminal identifier.

[0118] It is understandable that when there is no burying point corresponding to the target burying point in the target page, the server needs to process the target page each time it receives a target page sent by a terminal, which increases the processing pressure of the server. In this embodiment, when the server receives the target page sent by the first terminal and determines that there is no target burying point in the target page, it generates a burying point invalidation instruction and sends the burying point invalidation instruction to each second terminal respectively. The burying point invalidation instruction is used to instruct the second terminal to intercept the burying point mapping request, indicating that the target burying point of the target page is being updated. There is no need to repeatedly send the burying point mapping request, which can reduce the processing pressure of the server.

[0119] Furthermore, after the server maps the target embedding point to the target element in the target page, the server further includes: generating an embedding point validation instruction and sending the embedding point validation instruction to each second terminal where the second terminal identifier is located; the embedding point validation instruction is used to instruct the second terminal to release the interception of the embedding point mapping request. The embedding point mapping request includes the target page.

[0120] It is understood that after the target embedding point is mapped to the target element in the target page, the target embedding point in the target page becomes effective, and operations such as collecting data and monitoring specific events can be performed through the target embedding point. The server sends a embedding point activation instruction to each second terminal, instructing the second terminal to release the interception of the embedding point mapping request, so that the server can receive the embedding point mapping request sent by the second terminal.

[0121] In one embodiment, Figure 9As shown, in step 1, the first terminal sends the target page to the server; in step 2, the server compares the target page and the corresponding page snapshot through the diff command; in step 3, when there is no embedding point corresponding to the target embedding point in the target page, the similarity between the first element and each second element is calculated respectively; in step 4, the similarity of each second element is stored in a queue; in step 5, the second element with the highest similarity in the queue is determined as the target element.

[0122] In the above step 1, when the first terminal detects that the target page is opened, the target page is sent to the server. Furthermore, the DOM tree of the target page can be sent to the server as a parameter. The target page can be a page in the browser.

[0123] In one embodiment, a method for mapping buried points is provided, comprising the following steps:

[0124] Step 1: Obtain a target page, and obtain a page snapshot corresponding to the target page based on the target page.

[0125] Step 2: Get the target embedding point in the page snapshot and the data of the first element where the target embedding point is located.

[0126] Step 3, the data of the first element includes the first element structure of the first element in the page structure of the page snapshot; the first element structure is compared with the second element structure of each second element included in the target page. When there is a second element consistent with the first element structure, there is a buried point corresponding to the target buried point in the target page.

[0127] Step 4: When the second element structure of each second element included in the target page is inconsistent with the first element structure, there is no embedding point corresponding to the target embedding point in the target page.

[0128] Step 5: When it is determined based on the data of the first element that there is no embedding point corresponding to the target embedding point in the target page, the data of each second element in the target page is obtained.

[0129] Step 6: The data of the first element includes the attributes of the first element and the label of the first element, and the data of the second element includes the attributes of the second element and the label of the second element; the attributes of the first element are matched with the attributes of each second element respectively, and the first value of each second element is determined according to the matching results;

[0130] Step 7: Match the label of the first element with the label of each second element respectively, and determine the second value of each second element respectively according to the matching results.

[0131] Step 8: The data of the first element includes the visual data of the first element; the data of the second element includes the visual data of the second element; the visual data of the first element is matched with the visual data of each second element respectively, and the third value of each second element is determined according to the matching results.

[0132] Step 9: For each second element, determine the similarity between the second element and the first element based on the first value, the second value, and the third value.

[0133] In one embodiment, the first value, the second value, and the third value may be added together, and the sum obtained is used as the similarity between the second element and the first element. In another embodiment, a first weight factor corresponding to the attribute of the second element, a second weight factor corresponding to the label of the second element, and a third weight factor corresponding to the visual data of the second element may be obtained. For each second element, the first value and the first weight factor are multiplied together, the second value and the second weight factor are multiplied together, and the third value and the third weight factor are multiplied together. The obtained products are then added together, and the sum obtained is finally used as the similarity between the second element and the first element.

[0134] Step 10: Determine the target element from each second element based on the similarity between each second element and the first element, and map the target embedding point to the target element in the target page.

[0135] Step 11: When the content of the first element includes text, select text elements whose content includes text from each second element of the target page.

[0136] Step 12: determining a first text density of the first element based on the text included in the content of the first element; the first text density is positively correlated with the amount of text included in the content of the first element.

[0137] Step 13: Determine a second text density of the text element based on the text included in the content of the text element; the second text density is positively correlated with the amount of text included in the content of the text element.

[0138] Step 14, matching the first text density of the first element with the second text density of each text element, matching the attributes of the first element with the attributes of each second element, matching the label of the first element with the label of each second element, matching the visual data of the first element with the visual data of each second element, and determining the similarity between each text element and the first element.

[0139] Step 15: Determine the target element from each text element based on the similarity between each text element and the first element, and map the target embedding point to the target element in the target page.

[0140] Step 16: Acquire the second terminal identifiers of the second terminals connected to the server. The second terminal identifiers are identifiers of terminals other than the first terminal identifier. The first terminal identifier is the identifier of the terminal that sends the target page to the server.

[0141] Step 17: Generate a burying point invalidation instruction, and send the burying point invalidation instruction to each second terminal where the second terminal identifier is located; the burying point invalidation instruction is used to instruct the second terminal to intercept the burying point mapping request.

[0142] It should be understood that although Figure 2 and Figure 8 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. In addition, Figure 2 and Figure 8 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The order of execution of these steps or stages is not necessarily one by one, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.

[0143] In one embodiment, Figure 10 As shown, a buried point mapping device 1000 is provided. The device can be a software module or a hardware module, or a combination of the two to form a part of a computer device. The device specifically includes: a target page and page snapshot acquisition module 1002, a first element data acquisition module 1004, a second element data acquisition module 1006, a similarity determination module 1008 and a buried point mapping module 1010, wherein:

[0144] The target page and page snapshot acquisition module 1002 is used to acquire the target page and acquire a page snapshot corresponding to the target page based on the target page.

[0145] The first element data acquisition module 1004 is used to obtain the target embedding point in the page snapshot and the data of the first element where the target embedding point is located.

[0146] The second element data acquisition module 1006 is used to acquire data of each second element in the target page when it is determined based on the data of the first element that there is no embedding point corresponding to the target embedding point in the target page.

[0147] The similarity determination module 1008 is configured to match the data of the first element with the data of each second element, and determine the similarity between each second element and the first element.

[0148] The buried point mapping module 1010 is used to determine the target element from each second element based on the similarity between each second element and the first element, and map the target buried point to the target element in the target page.

[0149] The above-mentioned buried point mapping device obtains the target page, and obtains the page snapshot corresponding to the target page based on the target page; obtains the target buried point in the page snapshot, and the data of the first element where the target buried point is located; when it is judged based on the data of the first element that there is no buried point corresponding to the target buried point in the target page, obtains the data of each second element in the target page; matches the data of the first element with the data of each second element respectively, and determines the similarity between each second element and the first element respectively; through the similarity between the second element and the first element, the similarity between the second element and the first element can be obtained. Therefore, based on the similarity between each second element and the first element, the target element is determined from each second element, and the target buried point is mapped to the target element in the target page. Not only can the target buried point in the page snapshot be mapped to the target page, but the target buried point can also be mapped to the target element in the target page more accurately, and the buried point can be used again, thereby improving the utilization rate of the buried point.

[0150] In one embodiment, the data of the first element includes the first element structure of the first element in the page structure of the page snapshot. The above-mentioned buried point mapping device also includes a judgment module for comparing the first element structure with the second element structure of each second element included in the target page. When there is a second element that is consistent with the first element structure, there is a buried point corresponding to the target buried point in the target page; when the second element structure of each second element included in the target page is inconsistent with the first element structure, there is no buried point corresponding to the target buried point in the target page.

[0151] In one embodiment, the data of the first element includes the attributes of the first element and the label of the first element, and the data of the second element includes the attributes of the second element and the label of the second element. The similarity determination module 1008 is further configured to match the attributes of the first element with the attributes of each second element, and determine the first value of each second element based on the matching results; match the label of the first element with the label of each second element, and determine the second value of each second element based on the matching results; and for each second element, determine the similarity between the second element and the first element based on the first value and the second value.

[0152] In one embodiment, the similarity determination module 1008 is further configured to, when the content of the first element includes text, filter out text elements whose content includes text from each second element of the target page; match the text included in the content of the first element with the text included in the content of each text element, and determine the similarity between each text element and the first element. The buried point mapping module 1010 is further configured to determine the target element from each text element based on the similarity between each text element and the first element.

[0153] In one embodiment, the above-mentioned buried point mapping device also includes a text density acquisition module, which is used to determine a first text density of the first element based on the text included in the content of the first element; the first text density is positively correlated with the amount of text included in the content of the first element; and determine a second text density of the text element based on the text included in the content of the text element; the second text density is positively correlated with the amount of text included in the content of the text element. The above-mentioned similarity determination module 1008 is also used to match the first text density of the first element with the second text density of each text element, respectively, to determine the similarity between each text element and the first element.

[0154] In one embodiment, the data of the first element includes visual data of the first element; the data of the second element includes visual data of the second element. The similarity determination module 1008 is further configured to match the visual data of the first element with the visual data of each second element, and determine the similarity between each second element and the first element.

[0155] In one embodiment, applied to a server, the above-mentioned burying point mapping module also includes a burying point invalidation instruction generation module, which is used to obtain the second terminal identification of each second terminal connected to the server; the second terminal identification is the identification of other terminals except the first terminal identification, and the first terminal identification is the identification of the terminal that sends the target page to the server; generate a burying point invalidation instruction, and send the burying point invalidation instruction to the second terminal where each second terminal identification is located respectively; the burying point invalidation instruction is used to instruct the second terminal to intercept the burying point mapping request.

[0156] For the specific definition of the buried point mapping device, please refer to the definition of the buried point mapping method above, which will not be repeated here. The various modules in the above-mentioned buried point mapping device can be implemented in whole or in part by software, hardware and their combination. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0157] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 11 As shown. The computer device includes a processor, a memory and a network interface connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store point mapping data. The network interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a point mapping method is implemented.

[0158] Those skilled in the art will understand that Figure 11 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0159] In one embodiment, a computer device is further provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0160] In one embodiment, a computer-readable storage medium is provided, storing a computer program, which implements the steps in the above-mentioned method embodiments when executed by a processor.

[0161] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0162] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0163] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art could make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of protection of the present patent application shall be determined by the appended claims.

Claims

1. A method for mapping buried points, characterized in that: The method comprises: Obtaining a target page, and obtaining a page snapshot corresponding to the target page based on the target page, where the page snapshot refers to a copy of the page at a historical point in time; Obtain a target embedded point in the page snapshot and data of the first element where the target embedded point is located, where the target embedded point refers to the embedded point in the page snapshot; When the second element structure of each second element included in the target page is inconsistent with the first element structure, there is no embedding point corresponding to the target embedding point in the target page. When it is determined based on the data of the first element that there is no embedding point corresponding to the target embedding point in the target page, the data of each second element in the target page is obtained; Matching the data of the first element with the data of each of the second elements, and determining the similarity between each of the second elements and the first element, respectively, including: matching the attributes of the first element with the attributes of each of the second elements, and determining the first value of each of the second elements according to the matching results; matching the label of the first element with the label of each of the second elements, and determining the second value of each of the second elements according to the matching results; and determining, for each of the second elements, the similarity between the second element and the first element based on the first value and the second value; Based on the similarity between each second element and the first element, a target element is determined from each second element, and the target embedding point is mapped to the target element in the target page.

2. The method according to claim 1, characterized in that The data of the first element includes a first element structure of the first element in the page structure of the page snapshot; The method of determining whether there is a embedding point corresponding to the target embedding point in the target page based on the data of the first element includes: The first element structure is compared with the second element structures of each second element included in the target page respectively. When there is a second element consistent with the first element structure, there is a buried point corresponding to the target buried point in the target page.

3. The method according to claim 1, characterized in that Matching the data of the first element with the data of each of the second elements, and determining the similarity between each of the second elements and the first element, respectively, includes: Obtain a first weight factor corresponding to the attribute of the second element, obtain a second weight factor corresponding to the label of the second element, and for each second element, multiply the first value by the first weight factor, and multiply the second value by the second weight factor, and then add the obtained products, and finally use the sum obtained as the similarity between the second element and the first element.

4. The method according to claim 1, wherein Matching the data of the first element with the data of each of the second elements, and determining the similarity between each of the second elements and the first element, respectively, includes: When the content of the first element includes text, filtering out text elements whose content includes text from each second element of the target page; Matching the text included in the content of the first element with the text included in the content of each of the text elements, and determining the similarity between each of the text elements and the first element; The determining the target element from each of the second elements based on the similarity between each of the second elements and the first element includes: A target element is determined from the text elements based on similarities between the text elements and the first element.

5. The method according to claim 4, characterized in that The method further comprises: determining a first text density of the first element based on text included in the content of the first element; the first text density is positively correlated with the amount of text included in the content of the first element; determining a second text density of the text element based on the text included in the content of the text element; the second text density is positively correlated with the amount of text included in the content of the text element; Matching the text included in the content of the first element with the text included in the content of each of the text elements, and determining the similarity between each of the text elements and the first element, respectively, includes: The first text density of the first element is matched with the second text density of each of the text elements, and the similarity between each of the text elements and the first element is determined.

6. The method according to claim 1, characterized in that The data of the first element includes visual data of the first element; the data of the second element includes visual data of the second element; Matching the data of the first element with the data of each of the second elements, and determining the similarity between each of the second elements and the first element, respectively, includes: The visual data of the first element is matched with the visual data of each of the second elements, and the similarity between each of the second elements and the first element is determined.

7. The method according to claim 1, characterized in that Applied to a server, when it is determined based on the data of the first element that there is no embedding point corresponding to the target embedding point in the target page, after obtaining the data of each second element in the target page, the method further includes: Acquire a second terminal identifier of each second terminal connected to the server; the second terminal identifier is an identifier of a terminal other than the first terminal identifier, and the first terminal identifier is an identifier of the terminal that sends the target page to the server; Generate a burying point invalidation instruction, and send the burying point invalidation instruction to each second terminal where the second terminal identifier is located; the burying point invalidation instruction is used to instruct the second terminal to intercept the burying point mapping request.

8. A buried point mapping device, characterized in that: The device comprises: A target page and page snapshot acquisition module is used to acquire a target page and, based on the target page, acquire a page snapshot corresponding to the target page. A page snapshot refers to a copy of a page at a historical point in time. A first element data acquisition module is used to acquire a target embedded point in the page snapshot and data of the first element where the target embedded point is located. The target embedded point refers to the embedded point in the page snapshot. A second element data acquisition module is configured to, when the second element structure of each second element included in the target page is inconsistent with the first element structure, and there is no embedding point corresponding to the target embedding point in the target page, and when it is determined based on the data of the first element that there is no embedding point corresponding to the target embedding point in the target page, acquire the data of each second element in the target page; a similarity determination module, configured to match the data of the first element with the data of each of the second elements, and determine the similarity between each of the second elements and the first element, including: matching the attributes of the first element with the attributes of each of the second elements, and determining the first value of each of the second elements based on the matching results; matching the label of the first element with the label of each of the second elements, and determining the second value of each of the second elements based on the matching results; and determining, for each of the second elements, the similarity between the second element and the first element based on the first value and the second value; A buried point mapping module is used to determine a target element from each second element based on the similarity between each second element and the first element, and map the target buried point to the target element in the target page.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images