Event labeling method and device in application program, equipment and storage medium

By displaying the user interface of the event annotation tool in the browser, visual annotation of events in the application is solved, and the problem of low efficiency in collecting data by burying points in code is solved. Analysts can independently complete the annotation, reducing communication costs and improving analysis efficiency.

CN119025402AActive Publication Date: 2024-11-26TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202310591425.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-11-26
Estimated Expiration
2043-05-23

AI Technical Summary

Technical Problem

In the prior art, the acquisition of application object behavior data through code burial points has high communication costs and the inability to obtain data instantly, resulting in low event labeling efficiency.

Method used

Provides an event annotation method within an application, displays the user interface of the event annotation tool in the browser, responds to the startup operation of the application experiencer, displays the user interface of the application experiencer, and displays and displays in element selection mode. Confirm event annotation information to realize visual annotation of events in the application.

Benefits of technology

Reduces the difficulty of event annotation, and analysts can independently complete event annotation, reducing communication costs with developers and testers, improving the efficiency of event annotation and application object behavior analysis, and can be instantly without application changes and release. Get data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119025402A_ABST
    Figure CN119025402A_ABST
Patent Text Reader

Abstract

The invention discloses an event labeling method and device in an application program, equipment and a storage medium, and belongs to the technical field of application programs. The method comprises the following steps: displaying a user interface of an event labeling tool in a browser; in response to a starting operation for the application experiencer, displaying a user interface of the application experiencer in a user interface of the event labeling tool; after the application program experiencer enters an element selection mode, in response to a selection operation for a first element in a user interface of the application program experiencer, displaying event labeling information related to the first element in a user interface of an event labeling tool; and in response to a confirmation operation for the event labeling information, labeling an operation event matched with the event labeling information in an application program corresponding to the application program experiencer. According to the method, an analyst can complete event labeling independently, data can be obtained for analysis without application program change and release, and the event labeling efficiency and the object behavior analysis efficiency are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of application technology, and in particular to a method, apparatus, device, and storage medium for annotating events within an application. Background Art

[0002] After an application is released online, analysts usually need to collect statistics and analyze the application's object behavior to obtain user usage of the application and provide data support for the subsequent operation and optimization of the application.

[0003] In the related technology, data is collected through code tracking. Code tracking is to implant code at the events that need to be counted in the application to count the number of clicks, number of visitors, page dwell time, video playback time and other object behaviors. When tracking code, the analyst first needs to determine the tracking requirements, that is, the events to be collected and the object behaviors to be counted; then the analyst communicates the tracking requirements with the developer of the application, and the developer implements the tracking; then the analyst, or the developer, or the tester of the application may be required to test the accuracy and effectiveness of the tracking; finally, the tracking takes effect after the application is re-released and launched, and the corresponding events are automatically collected and reported.

[0004] It can be seen that the method of marking events through code tracking requires communication and coordination among multiple parties, which has a high communication cost. In addition, the tracking can only take effect after the application changes are released, and it is impossible to obtain data immediately for analysis. Summary of the invention

[0005] The embodiment of the present application provides an event annotation method, device, equipment and storage medium within an application, which helps analysts to independently complete event annotation and obtain relevant data for analysis without changing the application, effectively improving the efficiency of event annotation and object behavior analysis of the application. The technical solution is as follows:

[0006] According to one aspect of an embodiment of the present application, a method for annotating an event in an application is provided, the method comprising:

[0007] Display the event annotation tool's user interface in the browser;

[0008] In response to a start operation on an application experiencer, displaying a user interface of the application experiencer in a user interface of the event annotation tool, wherein the application experiencer refers to a runtime instance of an application for interactive use by an analyst;

[0009] After the application experiencer enters the element selection mode, in response to a selection operation on a first element in the user interface of the application experiencer, event annotation information related to the first element is displayed in the user interface of the event annotation tool;

[0010] In response to a confirmation operation on the event annotation information, an operation event matching the event annotation information is marked within the application corresponding to the application experiencer.

[0011] According to one aspect of an embodiment of the present application, a device for marking an event in an application is provided, the device comprising:

[0012] A tool interface display module, used to display the user interface of the event annotation tool in the browser;

[0013] An experiencer interface display module, for displaying the user interface of the application experiencer in the user interface of the event annotation tool in response to a start-up operation for the application experiencer, wherein the application experiencer refers to a runtime instance of the application for interactive use by the analyst;

[0014] An annotation information display module is used to display event annotation information related to the first element in the user interface of the event annotation tool in response to a selection operation on the first element in the user interface of the application experiencer after the application experiencer enters the element selection mode;

[0015] An operation event marking module is used to mark the operation events matching the event marking information in the application corresponding to the application experiencer in response to a confirmation operation on the event marking information.

[0016] In some embodiments, the annotation information display module includes: an element set acquisition unit, used to obtain a first element set from the user interface of the application experiencer in response to a selection operation on the first element, the first element set including the first element and similar elements of the first element; an element selector display unit, used to display the selectors of each element and its parent element in the first element set in the user interface of the event annotation tool; wherein the event annotation information includes a selector of at least one element, and the selector is used to indicate the interaction type and display characteristics of the element.

[0017] In some embodiments, the element set acquisition unit is used to: obtain a DOM tree corresponding to the user interface of the application experiencer, the DOM tree being used to indicate each element in the user interface of the application experiencer and the hierarchical relationship between each of the elements; search for similar elements of the first element based on the DOM tree, and construct the first element set based on the search results.

[0018] In some embodiments, the element set acquisition unit is further used to: acquire sibling elements of the first element, wherein the nodes corresponding to the sibling elements of the first element and the nodes corresponding to the first element are located at the same level in the DOM tree; search for similar elements of the first element from the sibling elements of the first element; the similar elements of the first element have the same interaction type as the first element and have at least one identical display feature; if similar elements of the first element exist among the sibling elements of the first element, then combine the first element and the similar elements of the first element to obtain the first element set; if similar elements of the first element do not exist among the sibling elements of the first element, then recursively search upward in the DOM tree; wherein the upward recursive search refers to replacing the first element with the parent element of the first element and executing again from acquiring the sibling elements of the first element; when the upward recursive search reaches the recursive level threshold and no similar elements of the first element are found, construct the first element set with the first element.

[0019] In some embodiments, the device also includes an element enhancement display module, which is used to: enhance the display of each element in the first element set and its parent elements in the user interface of the application experiencer; in response to a removal operation of a selector for a second element in the user interface of the event annotation tool, cancel the enhanced display of the second element in the user interface of the application experiencer; the second element refers to any element among the elements in the first element set and their parent elements.

[0020] In some embodiments, the annotation information display module also includes a supplementary condition display unit, which is used to: display at least one supplementary annotation condition in the user interface of the event annotation tool, the supplementary annotation condition including page routing parameters and element text content, the page routing parameters are used to limit operation events originating from the current user interface of the application experiencer, and the element text content is used to limit operation events to specified text content; wherein, in response to a selection operation on a first supplementary annotation condition among the at least one supplementary annotation condition, the event annotation information also includes the first supplementary annotation condition.

[0021] In some embodiments, the device also includes a selection mode control module, which is used to: control the application experiencer to enter the element selection mode in response to the operation of the mode selection control in the user interface of the event annotation tool; wherein, when the application experiencer is in the element selection mode, the application experiencer does not respond to interactive operations received by the user interface of the application experiencer.

[0022] In some embodiments, the selection mode control module is also used to: clear the currently selected element and current event annotation information in the event annotation tool in response to an operation of resetting an element control in the user interface of the event annotation tool; and control the application experiencer to exit the element selection mode.

[0023] In some embodiments, the experiencer interface display module is used to: in response to the scene parameters received by the user interface of the event annotation tool, load the online code package of the application in the delivery channel corresponding to the scene parameters; run the online code package to obtain the application experiencer; display the user interface of the application experiencer in the user interface of the event annotation tool; wherein, the startup operation for the application experiencer includes the scene parameters received by the user interface of the event annotation tool.

[0024] In some embodiments, the experiencer interface display module is used to: load the online code package of the application; run the online code package to obtain the application experiencer; in response to the path parameter received by the user interface of the event annotation tool, display the user interface of the application experiencer in the user interface of the event annotation tool, and the initial user interface of the application experiencer matches the path parameter; wherein the startup operation for the application experiencer includes the path parameter received by the user interface of the event annotation tool.

[0025] According to one aspect of an embodiment of the present application, a computer device is provided, comprising a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the event annotation method within the application as described above.

[0026] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is loaded and executed by a processor to implement the event annotation method in an application as described above.

[0027] According to one aspect of an embodiment of the present application, a computer program product is provided, which includes a computer program stored in a computer-readable storage medium, and a processor reads and executes the computer program from the computer-readable storage medium to implement the event annotation method within the application as described above.

[0028] The technical solution provided by the embodiments of the present application includes at least the following beneficial effects:

[0029] The event annotation tool enables visual annotation of events within the application, which reduces the difficulty of event annotation compared to code tracking. Analysts can complete event annotation independently through the event annotation tool without having to communicate and coordinate with developers and testers, reducing communication costs and improving event annotation efficiency. In addition, all operation events of the application by users of the application are collected and stored in real time, so the event annotation tool can immediately extract and store the corresponding operation events when performing event annotation. Without the need to change the application and release it, analysts can immediately obtain relevant data and conduct analysis, which helps to improve the efficiency of object behavior analysis of the application. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 is a schematic diagram of an event annotation system provided by an embodiment of the present application;

[0031] Figure 2 is a flow chart of an event marking method within an application provided by an embodiment of the present application;

[0032] Figure 3 This is a schematic diagram of starting an application experiencer provided by an embodiment of the present application;

[0033] Figure 4 is a schematic diagram of entering and exiting an element selection mode provided by an embodiment of the present application;

[0034] Figure 5 This is a schematic diagram of displaying event annotation information provided by an embodiment of the present application;

[0035] Figure 6 is a flow chart of an event marking method within an application provided by another embodiment of the present application;

[0036] Figure 7 is a block diagram of an event marking device in an application provided by an embodiment of the present application;

[0037] Figure 8 is a block diagram of an event marking device in an application provided by another embodiment of the present application;

[0038] Fig. 9 It is a schematic diagram of the structure of a computer device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0039] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0040] Please refer to Figure 1 , which shows a schematic diagram of an event annotation system provided by an embodiment of the present application, the event annotation system is used to annotate and extract events within an application program, so as to obtain data in real time to carry out object behavior analysis of the application program. Figure 1 As shown, the event annotation system includes: an application 10, an event annotation tool 20 and an application experiencer 30.

[0041] In the embodiment of the present application, the analyst uses the event annotation tool 20 to annotate the events to be extracted in the application 10. Figure 1 As shown, the event annotation tool 20 runs based on a browser. After receiving relevant parameters of the application (such as scene parameters, path parameters, etc.) input by the analyst, the event annotation tool 20 loads and runs the online code package of the application 10 through the browser based on the relevant parameters to obtain an application experiencer 30, and the user interface of the application experiencer 30 is displayed in the user interface of the event annotation tool 20.

[0042] After the application experiencer 30 enters the element selection mode, in response to the analyst's selection operation on any element in the user interface of the application experiencer 30, the event annotation tool 20 displays the event annotation information related to the element in the user interface; thereafter, in response to the analyst's confirmation operation on the event annotation information, the event annotation tool 20 annotates the operation events in the application 10 that match the event annotation information, and these operation events will also be extracted and stored for the analyst to analyze the object behavior of the application 10.

[0043] Optionally, application 10 is a sub-application that depends on the target application to run. Among them, the sub-application can be called a mini-program. Although the mini-program cannot run independently, it can be used without downloading and installing. For example, the sub-application can be directly opened by scanning the QR code corresponding to the sub-application or searching the name of the sub-application. In this implementation, application 10 serves as a sub-application, and the target application is the parent application of the sub-application; the parent application provides an environment for the implementation of the sub-application, and the sub-application can be easily obtained and disseminated in the parent application. Among them, the parent application is a native application, and the native application is an application that can run directly on the operating system. For example, the parent application can be a social application, a food application, a dedicated application that specifically supports the sub-application, a file management application, an email application, or a game application, etc.; social applications include but are not limited to instant messaging applications, SNS (Social Network Service, social networking site) applications, or live broadcast applications, etc.

[0044] In addition, if Figure 1 As shown, the event annotation tool 20 and the browser that carries it are both running on a physical computer device 40, which can access the network to obtain the online code package of the application 10, etc. The network can be a wide area network, or a local area network, or a metropolitan area network, or a personal area network, or the Internet, etc. Optionally, the computer device 40 can be implemented as a server, or can be implemented as a terminal such as a tablet computer, a mobile phone, a PC (Personal Computer). In the case of being implemented as a server, the computer device 40 can be a single server, a server cluster composed of multiple servers, or a cloud computing center, which is not limited in the embodiments of the present application.

[0045] related Figure 1 For other introductions and descriptions of the application experiencer and its startup method, the element selection mode and its entry and exit methods, the event annotation information and its acquisition and display methods in the embodiments, please refer to the following method embodiments, which will not be elaborated here.

[0046] Please refer to Figure 2 , which shows a flow chart of an event annotation method in an application provided by an embodiment of the present application, which method can be applied to event annotation tools, such as Figure 1 In the event annotation tool 20 shown. Figure 2 As shown, the event marking method includes at least one of the following steps (steps 210 to 240).

[0047] Step 210: Display the user interface of the event annotation tool in the browser.

[0048] The event annotation tool runs based on a browser. After starting the event annotation tool, the user interface of the event annotation tool can be displayed in the browser. Optionally, the event annotation tool can be started by entering a URL, searching for a name, scanning a QR code, entering a voice command, etc. in the browser.

[0049] The embodiment of the present application does not limit the display content of the initial user interface after the event annotation tool is started. Optionally, the initial user interface displays an interface for inputting identity authentication information such as account name, login password, and biometrics. In response to the corresponding information input by the analyst, the event annotation tool jumps from the initial user interface to the user interface of the normal working state; or, the initial user interface is directly displayed as the user interface of the normal working state. Among them, the user interface of the normal working state includes at least one of the following: a user interface for starting the application experiencer, a user interface for performing event annotation, and a user interface for setting event annotation properties (such as name, event storage location, etc.).

[0050] Step 220, in response to a start operation for the application experiencer, displaying the user interface of the application experiencer in the user interface of the event annotation tool.

[0051] The application experiencer refers to a runtime instance of an application for interactive use by analysts. The application experiencer is obtained by running the online code package of the application loaded by the browser. After starting the application experiencer, the user interface of the application experiencer is directly displayed in the user interface of the event annotation tool. Optionally, the display level of the user interface of the application experiencer is equal to the display level of the user interface of the event annotation tool, and the user interface of the application experiencer can be displayed in the blank part of the content of the user interface of the event annotation tool; or, the display level of the user interface of the application experiencer is higher than the display level of the user interface of the event annotation tool, and the user interface of the application experiencer can be displayed above the user interface of the event annotation tool in the form of a floating window or the like. Optionally, the display of the user interface of the application experiencer in the user interface of the event annotation tool can be fixed or flexibly movable; when the user interface of the application experiencer can be flexibly moved, the display position of each element in the user interface of the event annotation tool can be adaptively moved to avoid being blocked, or when the user interface of the application experiencer is displayed in the form of a floating window or the like, the user interface of the event annotation tool can remain unchanged.

[0052] The embodiments of the present application do not limit the method for starting the application experiencer. Optionally, the application experiencer can be started by entering a URL, searching a name, scanning a QR code, entering a voice command, entering identity verification information, etc. The following exemplifies several methods for starting the application experiencer.

[0053] In one example, the above-mentioned startup operation for the application experiencer includes scene parameters received by the user interface of the event annotation tool; based on this, the above-mentioned step 220 includes: in response to the scene parameters received by the user interface of the event annotation tool, loading the online code package of the application in the delivery channel corresponding to the scene parameters; running the online code package to obtain the application experiencer; displaying the user interface of the application experiencer in the user interface of the event annotation tool.

[0054] In another example, the above-mentioned startup operation for the application experiencer includes a path parameter received by the user interface of the event annotation tool; based on this, the above-mentioned step 220 includes: loading the online code package of the application; running the online code package to obtain the application experiencer; in response to the path parameter received by the user interface of the event annotation tool, displaying the user interface of the application experiencer in the user interface of the event annotation tool, and the initial user interface of the application experiencer matches the path parameter.

[0055] Among them, the above-mentioned scene parameters are used to locate the source channel of the online code package, that is, the delivery channel of the application corresponding to the application experiencer, such as the source of the application, the parent application that provides the environment for the operation of the application, etc.; the above-mentioned path parameters are used to locate the initial user interface of the application experiencer, such as the home page, settings page, login page, personal information page, etc. In actual applications, the application experiencer can also be started by combining scene parameters and path parameters. Optionally, an experiencer start control can also be displayed in the user interface of the event annotation tool. If the analyst does not enter the scene parameters and / or path parameters but operates the experiencer start control, the event annotation tool responds to the operation of the experiencer start control and starts the application experiencer according to the default scene parameters and / or default path parameters.

[0056] For example, Figure 3 As shown, the user interface 310 of the event annotation tool displays an input interface 312 for scene parameters and an input interface 314 for path parameters. After the analyst enters the corresponding parameters in the input interface 312 and the input interface 314, the event annotation tool receives the scene parameters and the path parameters. First, in response to the scene parameters, the online code package of the application in the delivery channel corresponding to the scene parameters is loaded; then the online code package is run to obtain the application experiencer; then, in response to the path parameters, the user interface 320 of the application experiencer is displayed in the user interface 310 of the event annotation tool, and the initial user interface of the application experiencer matches the path parameters.

[0057] In another example, the above startup operation for the application experiencer includes the identity authentication information received by the user interface of the event annotation tool; based on this, the above step 220 includes: in response to the identity authentication information received by the user interface of the event annotation tool, obtaining the historical program parameters corresponding to the identity authentication information, the historical program parameters including the historical scene parameters and the historical path parameters; loading the online code package of the application in the delivery channel corresponding to the historical scene parameters; running the online code package to obtain the application experiencer; displaying the user interface of the application experiencer in the user interface of the event annotation tool, and the initial user interface of the application experiencer matches the historical path parameters. Optionally, the identity authentication information includes but is not limited to the account name, login password, biometrics, etc.

[0058] Among them, the historical program parameters can be the scene parameters and path parameters input by the analyst when the analyst last annotated an event through the event annotation tool, or the scene parameters corresponding to the source channel of the loaded online code package and the path parameters corresponding to the source page of the annotated event. Of course, the historical program parameters can also be the scene parameters and path parameters with the highest input frequency when the analyst annotates an event through the event annotation tool for the first N times (N is an integer greater than 2), or the scene parameters corresponding to the source channel of the online code package with the highest loading frequency and the path parameters corresponding to the source page with the most annotated events, which is not limited in the embodiments of the present application.

[0059] The event annotation tool can record and store the correspondence between the identity authentication information and the historical program parameters. After the analyst inputs the identity authentication information and the program parameters, or after the analyst completes the event annotation, the event annotation tool updates the correspondence and replaces part or all of the stored historical program parameters with the current program parameters. Optionally, a parameter update control can be displayed in the user interface of the event annotation tool. After completing the event annotation, the analyst can freely choose whether to replace the historical program parameters with the current program parameters through the parameter update control to achieve the update of the above correspondence.

[0060] Step 230, after the application experiencer enters the element selection mode, in response to a selection operation on the first element in the user interface of the application experiencer, event annotation information related to the first element is displayed in the user interface of the event annotation tool.

[0061] After the application experiencer is started, the analyst can interact with the application experiencer like an application user. For each interactive operation of the analyst, the application experiencer gives corresponding feedback according to the operation logic of the application. When the application experiencer is in element selection mode, the application experiencer does not respond to the interactive operation received by the user interface of the application experiencer, but the event annotation tool responds to the interactive operation.

[0062] Among them, when the application experiencer is in element selection mode, the analyst's interactive operation on the user interface of the application experiencer includes a selection operation on any element in the user interface of the application experiencer, where the element refers to a visual element in the user interface, and the type of the element includes but is not limited to text, pictures, buttons, symbols, icons, sliders, videos, progress bars, audio, labels, etc. At this time, the event annotation tool responds to the selection operation and displays the event annotation information related to the element in the user interface of the event annotation tool. For the specific content, acquisition method and display method of the event annotation information, please refer to the following method embodiment.

[0063] The embodiment of the present application does not limit the method of entering and exiting the element selection mode. Optionally, the element selection mode can be entered and exited by operating a specific control, inputting a voice command, inputting a gesture, etc. In one example, taking entering and exiting the element selection mode by operating a specific control as an example, the above step 220 also includes: in response to the operation of the mode selection control in the user interface of the event annotation tool, controlling the application experiencer to enter the element selection mode; after the above control of the application experiencer to enter the element selection mode, it also includes: in response to the operation of the element reset control in the user interface of the event annotation tool, clearing the current selected element and the current event annotation information in the event annotation tool, and controlling the application experiencer to exit the element selection mode. Among them, the mode selection control and the element reset control can be displayed in the form of buttons, icons, sliders, etc., and the operations on the mode selection control and the element reset control include but are not limited to click operations, double-click operations, press operations, slide operations, etc.

[0064] For example, Figure 4 As shown, a mode selection control 412 and an element reset control 414 are displayed in the user interface 410 of the event annotation tool. After the analyst clicks the mode selection control 412, the application experiencer enters the element selection mode and no longer responds to interactive operations on the user interface 420 of the application experiencer; when the application experiencer is in the element selection mode, the analyst clicks on any element 422 in the user interface 420 of the application experiencer, and the event annotation tool responds to the analyst's operation and displays the event annotation information 416 related to the element 422 in the user interface 410 of the event annotation tool; after the analyst clicks the element reset control 414, the currently selected element 422 and the current event annotation information 416 are cleared in the event annotation tool, and the application experiencer also exits the element selection mode and resumes responding to the analyst's interactive operations on the user interface 420 of the application experiencer.

[0065] Step 240, in response to a confirmation operation on the event annotation information, annotate an operation event in the application corresponding to the application experiencer that matches the event annotation information.

[0066] The analyst can modify the event annotation information. For details on how to modify the event annotation information, please refer to the following method embodiment. If the analyst does not have any modification requirements or has completed the modification, the event annotation can be completed by confirming the event annotation information. The present application embodiment does not limit the method for confirming the event annotation information. Optionally, the event annotation information can be confirmed by operating a specific control, inputting a voice command, inputting a gesture, etc. For example, Figure 4 As shown, an information confirmation control 418 is displayed in the user interface 410 of the event annotation tool, and the analyst clicks the information confirmation control 418 to confirm the event annotation information.

[0067] In response to the analyst's confirmation operation on the event annotation information, the event annotation tool annotates all operation events in the application corresponding to the application experiencer that match the event annotation information. In the embodiment of the present application, the event type of the operation event annotated by the event annotation tool in step 240 may be consistent or inconsistent with the type of the selection operation performed by the analyst in step 230. For example, if the selection operation performed by the analyst is a click operation, the operation event annotated by the event annotation tool may include only click events, or may include click events, press events, slide events, double-click events, and the like.

[0068] In the embodiment of the present application, all operation events of the application user on the application are collected and stored in real time, such as stored in the application server, etc. When performing event annotation, the event annotation tool can extract the operation event matching the event annotation information from the storage location of the operation event, and export or store it to the default storage location or the storage location specified by the analyst, so that the analyst can immediately obtain relevant data and immediately carry out object behavior analysis of the application.

[0069] In summary, the embodiment of the present application starts the application experiencer corresponding to the application through the event annotation tool, and when the application experiencer is in the element selection mode, in response to the analyst's selection operation of any element in the user interface of the application experiencer, obtains and displays the event annotation information related to the element, and then responds to the analyst's confirmation operation for the event annotation information, annotates all operation events in the application that match the event annotation information. The embodiment of the present application realizes the visual annotation of events in the application through the event annotation tool, which reduces the difficulty of event annotation compared to code embedding, so that the analyst can independently complete the event annotation through the event annotation tool, without the need for multi-party communication and coordination with developers and testers, etc., reducing the communication cost and improving the efficiency of event annotation. In addition, all operation events of the application by the user of the application are collected and stored in real time, so that the event annotation tool can immediately extract and store the corresponding operation events when executing the event annotation, and the analyst can immediately obtain the relevant data and carry out analysis without the need for application change release, which helps to improve the efficiency of object behavior analysis of the application.

[0070] In addition, the embodiments of the present application provide multiple ways to flexibly start the application experiencer. By starting the application experiencer through scene parameters, you can select the delivery channel of the application and conduct targeted analysis on the object behavior of the application under the corresponding delivery channel; by starting the application experiencer through path parameters, you can select the initial user interface displayed after the application experiencer is started, so as to directly locate the source page of the event that the analyst needs to annotate; by starting the application experiencer through historical program parameters corresponding to identity authentication information, you can match the analyst's annotation habits so that the analyst can quickly carry out event annotation.

[0071] The following describes how to obtain, display, and modify event annotation information.

[0072] In one example, the above step 230 includes the following sub-steps (steps 232 to 234 ).

[0073] Step 232, in response to a selection operation on the first element, obtain a first element set from the user interface of the application experiencer.

[0074] The first element set includes the first element and similar elements of the first element. Optionally, the similar elements of the first element have at least one of the following features: the same interaction type as the first element, the same or partially the same display feature as the first element, the same text content as the first element, and the same display area as the first element.

[0075] Optionally, the embodiment of the present application obtains similar elements through a DOM (Document Object Model) tree; based on this, the above step 232 includes: obtaining the DOM tree corresponding to the user interface of the application experiencer; searching for similar elements of the first element based on the DOM tree, and constructing a first element set based on the search results. Among them, the DOM tree is used to indicate each element in the user interface of the application experiencer, and the hierarchical relationship between each element; each node in the DOM tree corresponds to an element in the user interface of the application experiencer, and each node includes the identification, hierarchy, instance, child node and other information of the corresponding element. When obtaining similar elements through the DOM tree, the event annotation tool can reduce the search scope based on heuristic search to improve search efficiency.

[0076] Based on this, optionally, the above-mentioned searching for similar elements of the first element based on the DOM tree and constructing the first element set based on the search results include: obtaining sibling elements of the first element; searching for similar elements of the first element from the sibling elements of the first element; if similar elements of the first element exist among the sibling elements of the first element, combining the first element and the similar elements of the first element to obtain the first element set; if similar elements of the first element do not exist among the sibling elements of the first element, recursively searching upward in the DOM tree; when the upward recursive search reaches the recursive level threshold and no similar elements of the first element are found, constructing the first element set with the first element.

[0077] Among them, the nodes corresponding to the sibling elements of the first element and the nodes corresponding to the first element are located at the same level in the DOM tree. By searching for similar elements from the sibling elements of the first element, the search scope is effectively reduced. In this example, the similar elements of the first element are defined to have the same interaction type (i.e., tag label) as the first element, and have at least one identical display feature (i.e., class label); the interaction types include but are not limited to click, press, slide, etc., and the display features include but are not limited to display color, display shape, display position, display element, etc.

[0078] If there is no similar element to the first element among its sibling elements, the event annotation tool recursively searches upward in the DOM tree. The upward recursive search means replacing the first element with its parent element and re-executes the search by obtaining the sibling elements of the first element, that is, re-executes the search for similar elements with the parent element of the first element. The upward recursive search can take into account the nested situation inside the elements in the list rendering method, and improve the accuracy of the search for similar elements. However, considering the number of layers of list rendering and the efficiency of the search for similar elements, this example sets a recursive level threshold for the upward recursive search, such as two or three layers; when the upward recursive search does not reach the recursive level threshold and similar elements of the first element are found, the first element set is constructed with the first element and its similar elements; when the upward recursive search reaches the recursive level threshold and similar elements of the first element are not found, the event annotation tool abandons the search for similar elements of the first element and directly constructs the first element set with the first element.

[0079] Step 234: Display the selectors of each element in the first element set and its parent element in the user interface of the event annotation tool.

[0080] The event annotation information includes a selector of at least one element, and the selector is used to indicate the interaction type and display characteristics of the element. After obtaining the event annotation information, the event annotation tool can display the event annotation information in its user interface for the analyst to modify and confirm. Optionally, in order to reduce the difficulty of understanding the event annotation information and give positive feedback to the analyst, while the event annotation tool displays the event annotation information, it can also enhance the display of each element and its parent element in the first element set in the user interface of the application experiencer. Optionally, the enhanced display method includes but is not limited to highlighting text and pictures, bolding text and lines, additional display text and icons, etc.

[0081] When there is a need for modification, the analyst can achieve accurate selection of the event source element by operating the selector. Based on this, after the event annotation tool displays the event annotation information, in response to the removal operation of the selector of the second element in the user interface of the event annotation tool, the enhanced display of the second element is canceled in the user interface of the application experiencer. Among them, the second element refers to any element of each element in the first element set and its parent element, and the removal operation of the selector of the second element includes but is not limited to click operation, sliding operation, pressing operation, etc. When the analyst removes the selector of the second element, in addition to canceling the enhanced display of the second element in the user interface of the application experiencer, the display style of the selector of the second element can also be changed in the user interface of the event annotation tool to remind the analyst whether the second element is selected. Optionally, the change of display style includes but is not limited to at least one of the following: display color change, icon state change, display content change, etc.

[0082] For example, Figure 5 As shown, assuming that the analyst clicks on element 522 in the user interface 520 of the application experiencer, the event annotation tool automatically infers similar elements of element 522 to construct a first element set, and displays event annotation information in the user interface 510 of the event annotation tool. The event annotation information includes selectors 512 for each element in the first element set and its parent element; at the same time, in the user interface 520 of the application experiencer, element 522 and its similar elements 524 are enhanced by bolding the text, and the parent elements of these elements are enhanced by highlighting the area.

[0083] In one example, in order to meet the analyst's needs for richer and more accurate event annotation, after the above step 232, it also includes: displaying at least one supplementary annotation condition in the user interface of the event annotation tool; wherein, in response to a selection operation on a first supplementary annotation condition in the at least one supplementary annotation condition, the event annotation information also includes the first supplementary annotation condition.

[0084] Optionally, the supplementary annotation conditions include at least one of the following: page routing parameters, element text content, and operation event type. Among them, the page routing parameters are used to limit the operation events to the current user interface of the application experiencer; the element text content is used to limit the operation events to the specified text content; the operation event type is used to limit the operation events to the specified event type. Optionally, the event type includes but is not limited to click events, press events, double-click events, sliding events, etc. It should be understood that when the analyst specifies the operation event type, the event type of the operation event annotated and extracted by the event annotation tool may be inconsistent with the analyst's selection operation for the event source element. For example, the analyst selects the event source element through a click operation, but subsequently selects the two supplementary annotation conditions of sliding events and pressing events. Then, the event annotation tool annotates and extracts sliding events and pressing events for the event source element and its related elements.

[0085] For example, Figure 5 As shown, the user interface 510 of the event annotation tool also displays three types of supplementary annotation conditions, namely, page routing parameters 514, element text content 516, and operation event type 518. By clicking the content or control corresponding to the page routing parameter 514, the analyst can add a restriction that the operation event originates from the current user interface of the application experiencer in the event annotation information; by clicking the content or control corresponding to the element text content 516, the analyst can add a restriction that the operation event targets the specified text content in the event annotation information; by clicking the content or control corresponding to the operation event type 518, the analyst can add a restriction that the operation event is a specified event type in the event annotation information.

[0086] In summary, after the analyst selects the event source element from the user interface of the application experiencer, the embodiment of the present application automatically infers the similar elements of the event source element by the event annotation tool, and obtains and displays the event annotation information based on the event source element and its similar elements, which helps to achieve the rapid annotation of events corresponding to a class of elements. In addition, when inferring similar elements, the event annotation tool considers that the user interface rendering may exist in a list rendering mode, and if necessary, recursively searches for similar elements upward with the parent element of the event source element, thereby improving the accuracy and comprehensiveness of the similar element search. In addition, the embodiment of the present application also meets the analyst's richer and more accurate event annotation needs by adding restrictions on event annotation information through page routing parameters, element text content, and operation event types.

[0087] The following is an example of an overall process of the event annotation method provided by the present application. The method can be applied to event annotation tools, such as Figure 1In the event annotation tool 20 shown in FIG. 1 , the event annotation tool includes a runtime control layer, an event annotation editor, and an event definition manager. Figure 6 As shown, the event marking method includes at least one of the following steps (steps 610 to 670).

[0088] Step 610, runtime initialization.

[0089] The runtime control layer performs runtime initialization, which includes: loading the online code package of the application, running the online code package, and displaying the user interface of the application experiencer. After loading the online code package of the application, the event annotation tool can automatically inject a custom script to wrap addEventListener in a layer to intercept and record operation events. In addition, through pauseInnerCaptureMouseListeners and resumeInnerCaptureMouseListeners, dynamic closing response and dynamic resumption response are respectively implemented for interactive operations on the user interface of the application experiencer. In addition, by registering life cycle hooks such as closing the application experiencer and route changes, the normal operation of the application experiencer is ensured; packaging methods such as entering element selection mode, exiting element selection mode, and enhancing display, and attaching custom logic by injecting scripts into the corresponding levels (native, webview) in the application experiencer iframe (inline frame).

[0090] Step 620, controlling the application experiencer to enter element selection mode.

[0091] In response to the analyst's corresponding operations, the event definition manager sends corresponding instructions to the runtime control layer, controls the application experiencer to enter element selection mode, prohibits the application experiencer from responding to interactive operations on its user interface, and can add overlay events such as hover (mouseover) and click (click).

[0092] Step 630, calculating similar elements of the event source element and displaying event annotation information.

[0093] In response to the analyst's selection operation on the event source element, the event definition manager returns the event source element to the event annotation editor; the event annotation editor further infers similar elements of the event source element, determines the selector of at least one element in the event annotation information based on the event source element and its similar elements, and initializes the display of the event annotation information.

[0094] Step 640: Enhance the display of corresponding elements based on the event annotation information.

[0095] The event definition manager coordinates the runtime control layer to enhance the display of corresponding elements in the user interface of the application experiencer based on the selectors in the event annotation information and the analyst's selection operation of supplementary annotation conditions in the event annotation information set by the event annotation editor.

[0096] Step 650: determine whether the event annotation information has been modified.

[0097] The event definition manager responds to the corresponding operation of the analyst and determines whether the event annotation information has been modified. If the event annotation information has been modified, the above step 640 is re-executed with the modified event annotation information, that is, the event annotation editor needs to respond to the element change; if the event annotation information has not been modified, the following step 660 is continued.

[0098] Step 660, determine whether the application experiencer exits the element selection mode.

[0099] The event definition manager responds to the corresponding operation of the analyst and determines whether the application experiencer exits the element selection mode, that is, whether the event annotation information is reset. If the application experiencer exits the element selection mode, after the analyst operates to start the element selection mode again, it will be executed again from the above step 620; if the application experiencer does not exit the element selection mode, it will continue to execute the following step 670.

[0100] Step 670: Annotate the operation events that match the event annotation information.

[0101] In response to the analyst's confirmation operation on the event annotation information, the event definition manager annotates all operation events in the application that match the event annotation information, and stores these operation events for the analyst to perform object behavior analysis, etc.

[0102] related Figure 6 For other descriptions of the method of entering and exiting the element selection mode in the embodiment, the method of calculating similar elements, the method of starting the application experiencer, the specific content of the event annotation information, the element enhanced display method, etc., please refer to the above method embodiment and will not be elaborated here.

[0103] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0104] Please refer to Figure 7, which shows a block diagram of an event annotation device in an application provided by an embodiment of the present application. The device has the function of implementing the example of the event annotation method in the above application, and the function can be implemented by hardware, or by hardware executing corresponding software. The device can be a computer device, or it can be set in a computer device. The device 700 may include a tool interface display module 710, an experiencer interface display module 720, an annotation information display module 730 and an operation event annotation module 740.

[0105] The tool interface display module 710 is used to display the user interface of the event annotation tool in the browser.

[0106] The experiencer interface display module 720 is used to display the user interface of the application experiencer in the user interface of the event annotation tool in response to a startup operation for the application experiencer. The application experiencer refers to a runtime instance of the application used for interactive use by analysts.

[0107] The annotation information display module 730 is used to display event annotation information related to the first element in the user interface of the event annotation tool in response to a selection operation on the first element in the user interface of the application experiencer after the application experiencer enters the element selection mode.

[0108] The operation event marking module 740 is used to mark the operation events matching the event marking information in the application corresponding to the application experiencer in response to the confirmation operation on the event marking information.

[0109] In one example, if Figure 8 As shown, the annotation information display module 730 includes: an element set acquisition unit 732, which is used to obtain a first element set from the user interface of the application experiencer in response to a selection operation on the first element, wherein the first element set includes the first element and similar elements of the first element; an element selector display unit 734, which is used to display the selectors of each element and its parent element in the first element set in the user interface of the event annotation tool; wherein the event annotation information includes a selector of at least one element, and the selector is used to indicate the interaction type and display characteristics of the element.

[0110] In one example, if Figure 8As shown, the element set acquisition unit 732 is used to: obtain the DOM tree corresponding to the user interface of the application experiencer, the DOM tree is used to indicate each element in the user interface of the application experiencer, and the hierarchical relationship between each of the elements; search for similar elements of the first element based on the DOM tree, and construct the first element set based on the search results.

[0111] In one example, if Figure 8 As shown, the element set acquisition unit 732 is also used to: acquire sibling elements of the first element, wherein the nodes corresponding to the sibling elements of the first element and the nodes corresponding to the first element are located at the same level in the DOM tree; search for similar elements of the first element from the sibling elements of the first element; the similar elements of the first element have the same interaction type as the first element and have at least one same display feature; if similar elements of the first element exist among the sibling elements of the first element, then combine the first element and the similar elements of the first element to obtain the first element set; if similar elements of the first element do not exist among the sibling elements of the first element, then recursively search upward in the DOM tree; wherein the upward recursive search refers to replacing the first element with the parent element of the first element and executing again from acquiring the sibling elements of the first element; when the upward recursive search reaches the recursive level threshold and no similar elements of the first element are found, construct the first element set with the first element.

[0112] In one example, if Figure 8 As shown, the device 700 also includes an element enhancement display module 750, which is used to: enhance the display of each element in the first element set and its parent element in the user interface of the application experiencer; in response to a removal operation of a selector for a second element in the user interface of the event annotation tool, cancel the enhanced display of the second element in the user interface of the application experiencer; the second element refers to any element among the elements in the first element set and their parent elements.

[0113] In one example, if Figure 8As shown, the annotation information display module 730 also includes a supplementary condition display unit 736, which is used to: display at least one supplementary annotation condition in the user interface of the event annotation tool, the supplementary annotation condition including a page routing parameter and an element text content, the page routing parameter being used to limit the operation event to originate from the current user interface of the application experiencer, and the element text content being used to limit the operation event to a specified text content; wherein, in response to a selection operation for a first supplementary annotation condition among the at least one supplementary annotation condition, the event annotation information also includes the first supplementary annotation condition.

[0114] In one example, if Figure 8 As shown, the device 700 also includes a selection mode control module 760, which is used to: control the application experiencer to enter the element selection mode in response to the operation of the mode selection control in the user interface of the event annotation tool; wherein, when the application experiencer is in the element selection mode, the application experiencer does not respond to the interactive operations received by the user interface of the application experiencer.

[0115] In one example, if Figure 8 As shown, the selection mode control module 760 is also used to: clear the currently selected element and the current event annotation information in the event annotation tool in response to an operation on an element reset control in the user interface of the event annotation tool; and control the application experiencer to exit the element selection mode.

[0116] In one example, the experiencer interface display module 720 is used to: in response to the scene parameters received by the user interface of the event annotation tool, load the online code package of the application in the delivery channel corresponding to the scene parameters; run the online code package to obtain the application experiencer; display the user interface of the application experiencer in the user interface of the event annotation tool; wherein the startup operation for the application experiencer includes the scene parameters received by the user interface of the event annotation tool.

[0117] In one example, the experiencer interface display module 720 is used to: load the online code package of the application; run the online code package to obtain the application experiencer; in response to the path parameter received by the user interface of the event annotation tool, display the user interface of the application experiencer in the user interface of the event annotation tool, and the initial user interface of the application experiencer matches the path parameter; wherein the startup operation for the application experiencer includes the path parameter received by the user interface of the event annotation tool.

[0118] In summary, the embodiment of the present application starts the application experiencer corresponding to the application through the event annotation tool, and when the application experiencer is in the element selection mode, in response to the analyst's selection operation of any element in the user interface of the application experiencer, obtains and displays the event annotation information related to the element, and then responds to the analyst's confirmation operation for the event annotation information, annotates all operation events in the application that match the event annotation information. The embodiment of the present application realizes the visual annotation of events in the application through the event annotation tool, which reduces the difficulty of event annotation compared to code embedding, so that the analyst can independently complete the event annotation through the event annotation tool, without the need for multi-party communication and coordination with developers and testers, etc., reducing the communication cost and improving the efficiency of event annotation. In addition, all operation events of the application by the user of the application are collected and stored in real time, so that the event annotation tool can immediately extract and store the corresponding operation events when executing the event annotation, and the analyst can immediately obtain the relevant data and carry out analysis without the need for application change release, which helps to improve the efficiency of object behavior analysis of the application.

[0119] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0120] Please refer to Fig. 9 , which shows a schematic diagram of the structure of a computer device provided in an embodiment of the present application, and the computer device can be used to implement the functions of the example of the event annotation method in the above application. Specifically:

[0121] The computer device 900 includes a processing unit (such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit) and an FPGA (Field Programmable Gate Array)) 901, a system memory 904 including a RAM (Random-Access Memory) 902 and a ROM (Read-Only Memory) 903, and a system bus 905 connecting the system memory 904 and the central processing unit 901. The computer device 900 also includes an I / O system (Input Output System) 906 for helping to transfer information between various components in the computer device, and a large-capacity storage device 907 for storing an operating system 913, application programs 914 and other program modules 915.

[0122] The basic input / output system 906 includes a display 908 for displaying information and an input device 909 such as a mouse and a keyboard for user inputting information. The display 908 and the input device 909 are connected to the central processing unit 901 via an input / output controller 910 connected to the system bus 905. The basic input / output system 906 may also include an input / output controller 910 for receiving and processing inputs from a plurality of other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input / output controller 910 also provides output to a display screen, a printer, or other types of output devices.

[0123] The mass storage device 907 is connected to the central processing unit 901 via a mass storage controller (not shown) connected to the system bus 905. The mass storage device 907 and its associated computer readable medium provide non-volatile storage for the computer device 900. That is, the mass storage device 907 may include a computer readable medium (not shown) such as a hard disk or a CD-ROM (Compact Disc Read-Only Memory) drive.

[0124] Without loss of generality, the computer-readable medium may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory or other solid-state storage technologies, CD-ROM, DVD (Digital Video Disc) or other optical storage, cassettes, tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage medium is not limited to the above. The above-mentioned system memory 904 and mass storage device 907 may be collectively referred to as memory.

[0125] According to the embodiment of the present application, the computer device 900 can also be connected to a remote computer on the network through a network such as the Internet. That is, the computer device 900 can be connected to the network 912 through the network interface unit 911 connected to the system bus 905, or the network interface unit 911 can be used to connect to other types of networks or remote computer systems (not shown).

[0126] The memory also includes a computer program, which is stored in the memory and configured to be executed by one or more processors to implement the event marking method in the above application.

[0127] In an exemplary embodiment, a computer-readable storage medium is further provided, wherein a computer program is stored in the storage medium, and the computer program is loaded and executed by a processor to implement the event annotation method in the above application program.

[0128] Optionally, the computer readable storage medium may include: a read only memory (ROM), a random access memory (RAM), a solid state drive (SSD), or an optical disk, etc. Among them, the random access memory may include a resistance random access memory (ReRAM) and a dynamic random access memory (DRAM).

[0129] In an exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device implements the event annotation method in the above application program.

[0130] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application are not limited to this.

[0131] The above description is only an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

[0132] In this application, relevant data and event processing (such as collection, recording, storage, etc.) should be strictly in accordance with the requirements of relevant national laws and regulations when applied in examples, obtain the informed consent or separate consent of the personal information subject (or have other legal basis), and carry out subsequent data use and processing (such as extraction, statistics, analysis, etc.) within the scope of authorization of laws and regulations and personal information subjects.

[0133] In this application, when the facial (or other biometric) recognition technology is applied to specific products or technologies, the relevant data collection, use and processing should comply with national laws and regulations. Before collecting facial information, the information processing rules should be informed and the informed consent or separate consent of the personal information subject (or other legal basis) should be sought. Facial information should be processed in strict accordance with the requirements of laws and regulations and the personal information processing rules, and technical measures should be taken to ensure the security of relevant data.

Claims

1. A method for marking events in an application, characterized in that: The method comprises: Display the event annotation tool's user interface in the browser; In response to a start operation on an application experiencer, displaying a user interface of the application experiencer in a user interface of the event annotation tool, wherein the application experiencer refers to a runtime instance of an application for interactive use by an analyst; After the application experiencer enters the element selection mode, in response to a selection operation on a first element in the user interface of the application experiencer, event annotation information related to the first element is displayed in the user interface of the event annotation tool; In response to a confirmation operation on the event annotation information, an operation event matching the event annotation information is marked within the application corresponding to the application experiencer.

2. The method according to claim 1, characterized in that In response to a selection operation on a first element in a user interface of the application experiencer, displaying event annotation information related to the first element in a user interface of the event annotation tool includes: In response to a selection operation on the first element, obtaining a first element set from a user interface of the application experiencer, wherein the first element set includes the first element and elements similar to the first element; In the user interface of the event annotation tool, selectors of each element in the first element set and its parent element are displayed; wherein the event annotation information includes a selector of at least one element, and the selector is used to indicate the interaction type and display characteristics of the element.

3. The method according to claim 2, characterized in that The obtaining a first element set from the user interface of the application experiencer includes: Obtain a document object model DOM tree corresponding to the user interface of the application experiencer, wherein the DOM tree is used to indicate each element in the user interface of the application experiencer and the hierarchical relationship between each of the elements; Similar elements of the first element are searched based on the DOM tree, and the first element set is constructed based on the search results.

4. The method according to claim 3, characterized in that The searching for similar elements of the first element based on the DOM tree and constructing the first element set based on the search results includes: Acquire a sibling element of the first element, where a node corresponding to the sibling element of the first element and a node corresponding to the first element are located at the same level in the DOM tree; Searching for similar elements of the first element from the sibling elements of the first element; the similar elements of the first element have the same interaction type as the first element and have at least one same display feature; If there are similar elements to the first element among the sibling elements of the first element, then the first element and the similar elements to the first element are combined to obtain the first element set; If there is no similar element to the first element among the sibling elements of the first element, recursively search upward in the DOM tree; wherein the upward recursive search means replacing the first element with the parent element of the first element and performing the search again from obtaining the sibling elements of the first element; When the upward recursive search reaches a recursive level threshold and no similar element of the first element is found, the first element set is constructed using the first element.

5. The method according to claim 2, characterized in that: After obtaining the first element set from the user interface of the application experiencer, the method further includes: In the user interface of the application experiencer, each element in the first element set and its parent element are enhanced and displayed; In response to a removal operation of a selector for a second element in the user interface of the event annotation tool, the enhanced display of the second element is canceled in the user interface of the application experiencer; the second element refers to any element in the first element set and its parent element.

6. The method according to claim 2, characterized in that After obtaining the first element set from the user interface of the application experiencer, the method further includes: Displaying at least one supplementary annotation condition in the user interface of the event annotation tool, the supplementary annotation condition including a page routing parameter and an element text content, the page routing parameter being used to limit the operation event to originate from the current user interface of the application experiencer, and the element text content being used to limit the operation event to a specified text content; In response to a selection operation on a first supplementary marking condition among the at least one supplementary marking condition, the event marking information further includes the first supplementary marking condition.

7. The method according to claim 1, characterized in that After the user interface of the application experiencer is displayed in the user interface of the event annotation tool, the method further includes: In response to an operation on a mode selection control in a user interface of the event annotation tool, controlling the application experiencer to enter the element selection mode; Wherein, when the application experiencer is in the element selection mode, the application experiencer does not respond to interactive operations received by the user interface of the application experiencer.

8. The method according to claim 7, characterized in that After controlling the application experiencer to enter the element selection mode, the method further includes: In response to an operation of resetting a control element in a user interface of the event annotation tool, clearing the currently selected element and the current event annotation information in the event annotation tool; Control the application experiencer to exit the element selection mode.

9. The method according to any one of claims 1 to 8, characterized in that: In response to the start operation on the application experiencer, displaying the user interface of the application experiencer in the user interface of the event annotation tool includes: In response to the scene parameters received by the user interface of the event annotation tool, loading the online code package of the application in the delivery channel corresponding to the scene parameters; Running the online code package to obtain the application experiencer; Displaying the user interface of the application experiencer in the user interface of the event annotation tool; Among them, the startup operation for the application experiencer includes scene parameters received by the user interface of the event annotation tool.

10. The method according to any one of claims 1 to 8, characterized in that: In response to the start operation on the application experiencer, displaying the user interface of the application experiencer in the user interface of the event annotation tool includes: Loading the online code package of the application; Running the online code package to obtain the application experiencer; In response to the path parameter received by the user interface of the event annotation tool, displaying the user interface of the application experiencer in the user interface of the event annotation tool, wherein the initial user interface of the application experiencer matches the path parameter; Among them, the startup operation for the application experiencer includes the path parameters received by the user interface of the event annotation tool.

11. An event marking device in an application, characterized in that: The device comprises: A tool interface display module, used to display the user interface of the event annotation tool in the browser; An experiencer interface display module, for displaying the user interface of the application experiencer in the user interface of the event annotation tool in response to a start-up operation for the application experiencer, wherein the application experiencer refers to a runtime instance of the application for interactive use by the analyst; An annotation information display module is used to display event annotation information related to the first element in the user interface of the event annotation tool in response to a selection operation on the first element in the user interface of the application experiencer after the application experiencer enters the element selection mode; An operation event marking module is used to mark the operation events matching the event marking information in the application corresponding to the application experiencer in response to a confirmation operation on the event marking information.

12. A computer device, characterized in that: The computer device includes a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the event annotation method in an application according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, which is loaded and executed by a processor to implement the event marking method in an application as described in any one of claims 1 to 10.

14. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a computer-readable storage medium. A processor reads and executes the computer program from the computer-readable storage medium to implement the event annotation method within an application as described in any one of claims 1 to 10.

Citation Information

Patent Citations

  • User behavior recording method, device and equipment

    CN112000563A

  • User behavior recording method, device and equipment

    CN112015626A

  • Behavior event labeling method and device, computer equipment and storage medium

    CN113095049A

  • Data labeling method and device, electronic equipment and storage medium

    CN115439161A

  • Burial point management method and device and electronic equipment

    CN115981974A