Operation data display method and apparatus, device, and storage medium

Abstract

Embodiments of the present application belong to the technical field of data analysis, and disclose an operation data display method and apparatus, a device, and a storage medium. The method comprises: displaying an operation replay interface, the operation replay interface comprising an operation video replay area and an operation event list, the operation video replay area displaying an operation replay video and a playback progress bar, and the playback progress bar being positioned in association with an operation event in the operation event list; in response to a first trigger operation on the playback progress bar, skipping in the operation playback video to play back a first operation interface, and marking in the operation event list a first operation event corresponding to a first playback time point; and in response to a second trigger operation on a second operation event in the operation event list, marking a second operation event, and positioning the playback progress bar at a second playback time point corresponding to the second operation event. Bidirectional associated positioning between an operation event list and a playback progress bar is achieved, and the operation data display effect is optimized.

Description

Operation data display method, device, equipment and storage medium

[0001] This application claims priority to Chinese patent application number 202310944116.X, filed on July 28, 2023, entitled “Operational data display method, device, equipment and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of data analysis technology, and in particular to a method, apparatus, device, and storage medium for displaying operation data. Background Art

[0003] In order to replay and check the operation data, a corresponding operation playback video is often regenerated based on the operation data, so that each operation event can be observed more intuitively through the operation playback video.

[0004] In the related art, the playback time point of the operation playback video can only be adjusted by clicking the video progress bar, but the playback time point of the operation playback video cannot be located according to the operation event. As a result, when watching the operation playback video, it is necessary to switch back and forth between the video progress bar and the operation event list to determine the operation event corresponding to the current playback time point, resulting in cumbersome and time-consuming operations.

[0005] Summary of the Invention

[0006] The embodiments of the present application provide a method, apparatus, device, and storage medium for displaying operation data, which can enrich the display methods of operation data and improve the efficiency of displaying operation data. The technical solution is as follows:

[0007] In one aspect, an embodiment of the present application provides a method for displaying operation data, the method comprising:

[0008] Displaying an operation playback interface, wherein the operation playback interface is used to display operation data generated during the program testing process, the operation playback interface includes an operation video playback area and an operation event list. The operation video playback area displays an operation playback video and a playback progress bar. The operation playback video is generated based on an operation event sequence to simulate user operations. The operation event list displays the operation events included in the operation event sequence. The playback progress bar is associated with the operation events in the operation event list.

[0009] In response to a first triggering operation on the playback progress bar, the playback of the operated video is redirected to a first operation interface, and a first operation event corresponding to the first playback time point is marked in the operation event list, where the first operation interface is the operation interface corresponding to the first playback time point indicated by the operation;

[0010] In response to a second triggering operation on a second operation event in the operation event list, the second operation event is marked, and the playback progress bar is positioned to a second playback time point corresponding to the second operation event.

[0011] On the other hand, an embodiment of the present application provides an operation data display device, the device comprising:

[0012] a first display module for displaying an operation playback interface, wherein the operation playback interface is used to display operation data generated during program testing, the operation playback interface including an operation video playback area and an operation event list, the operation video playback area displaying an operation playback video and a playback progress bar, the operation playback video being generated based on an operation event sequence simulating user operations, the operation event list displaying operation events included in the operation event sequence, and the playback progress bar being associated with and positioned in relation to the operation events in the operation event list;

[0013] a second display module, configured to, in response to a first triggering operation on the playback progress bar, redirect the playback of the operated video to a first operation interface, and mark a first operation event corresponding to a first playback time point in the operation event list, where the first operation interface is an operation interface corresponding to the first playback time point indicated by the operation;

[0014] The third display module is configured to, in response to a second triggering operation on a second operation event in the operation event list, mark the second operation event and position the playback progress bar to a second playback time point corresponding to the second operation event.

[0015] In a possible implementation, the second display module is configured to:

[0016] In response to the first triggering operation on the play progress bar, determining the first play time point corresponding to the first triggering operation on the play progress bar;

[0017] determining the first operation event based on the first playback time point and the operation event sequence, and marking the first operation event in the operation event list;

[0018] Based on the first playback time point and the first operation event, the operation playback video is jumped and played to the first operation interface, and the first operation interface corresponds to the first operation event.

[0019] In a possible implementation, the second display module is further configured to:

[0020] Determining the first operation event from the operation event sequence by binary search based on the first playback time point and timestamps corresponding to the operation event sequence, wherein the timestamps represent playback time points corresponding to respective operation events in the operation event sequence;

[0021] The first operation event and each operation event occurring before the first operation event in the operation event list are marked.

[0022] In a possible implementation, the third display module is configured to:

[0023] In response to the second triggering operation on the second operation event in the operation event list, marking the second operation event and each operation event in the operation event list that occurs before the second operation event;

[0024] determining a second playback time point corresponding to the second operation event based on the second operation event and a timestamp corresponding to the operation event sequence, wherein the timestamp represents a playback time point corresponding to each operation event in the operation event sequence;

[0025] Position the playback progress bar to a second playback time point corresponding to the second operation event.

[0026] In a possible implementation, the third display module is further configured to:

[0027] Based on the second playback time point and the second operation event, redirecting the playback of the operation video to a second operation interface corresponding to the second operation event;

[0028] Based on the second playback time point and the total playback duration of the operation playback video, the display progress of the playback progress bar is adjusted, and the display progress is positively correlated with the playback duration of the operation playback video.

[0029] In a possible implementation, the first display module is configured to:

[0030] When a third trigger operation on the operation playback control is received, obtaining the operation event sequence;

[0031] Based on the operation event sequence, simulating the user operation in the application interface, generating the operation playback video, and displaying the operation video playback area in the operation playback interface;

[0032] Based on the total playback time corresponding to the operation playback video, displaying the playback progress bar in the operation video playback area;

[0033] Based on the operation event sequence, each operation event in the operation event sequence is sorted in the order of operation time, and is displayed in the operation event list in the operation playback interface.

[0034] In a possible implementation, the first display module is further configured to:

[0035] Filtering each operation event in the operation event sequence to obtain filtered operation events, wherein the filtered operation events include interface change events and control interaction events, wherein the interface change event is an operation event that generates an interface jump, and the control interaction event is an event that realizes interface interaction based on a triggering operation on a control;

[0036] The filtered operation events are sorted according to the operation time sequence, and the filtered operation events are displayed in the operation event list.

[0037] In a possible implementation, the apparatus further includes:

[0038] A hierarchical division module, configured to divide the application operation interface into multiple levels based on the operation event sequence, thereby obtaining a multi-level application operation interface, wherein triggering an application control in the i-th level application operation interface can jump to the i+1-th level application operation interface;

[0039] An event classification module, configured to classify the operation events in the operation event list based on the multi-level application operation interface obtained by classification, and determine the operation event executed in the i-th level application operation interface as the i-th level operation event;

[0040] The fourth display module is configured to display the (i+1)th level operation event in a hierarchical manner below the i-th level operation event in the operation event list.

[0041] In a possible implementation, the apparatus further includes:

[0042] a playback jump module, configured to, in response to a fourth triggering operation on the i-th level operation event, jump and play the operation playback video to a third operation interface corresponding to the i-th level operation event;

[0043] A fifth display module, configured to display, on the playback progress bar, an i+1th level playback mark point corresponding to the i+1th level operation event corresponding to the i-th level operation event;

[0044] The playback jump module is further configured to jump and play the operation playback video to the fourth operation interface corresponding to the i+1th level operation event in response to the fifth trigger operation on the i+1th level playback mark point.

[0045] In a possible implementation, the apparatus further includes:

[0046] a grouping module, configured to group the operation events based on the operation event sequence and the operation event type to obtain an operation event grouping result, wherein the operation events of the same type in the operation event grouping result are grouped together;

[0047] A sixth display module, configured to display event groups in the operation event list based on the operation event grouping result;

[0048] The seventh display module is configured to expand and display each operation event in the first event group in the operation event list in response to a sixth trigger operation on the first event group.

[0049] In a possible implementation, the apparatus further includes:

[0050] A screening module, configured to screen out control interaction events from various operation events based on the operation event sequence, wherein the control interaction events are events that implement interface interaction based on a triggering operation on a control;

[0051] An eighth display module, configured to display a corresponding control code positioning button in the control interaction event in the operation event list;

[0052] The ninth display module is configured to jump to display the first control code segment corresponding to the first control code locating button in the sequence code corresponding to the operation event sequence in response to the seventh triggering operation on the first control code locating button.

[0053] In a possible implementation, the operation video playback area further displays a sequence switching button; and the device further includes:

[0054] A switching display module is used to switch and display the operation playback video in the operation video playback area and the operation events in the operation event list in response to the eighth trigger operation on the sequence switch button.

[0055] On the other hand, an embodiment of the present application provides a computer device, which includes a processor and a memory; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the operation data display method described in the above aspect.

[0056] On the other hand, an embodiment of the present application provides a computer-readable storage medium, in which at least one instruction is stored. The at least one instruction is loaded and executed by a processor to implement the operation data display method as described in the above aspects.

[0057] In another aspect, embodiments of the present application provide a computer program product comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the operational data display method provided in various optional implementations of the aforementioned aspects.

[0058] In an embodiment of the present application, the operation data generated during the program testing process is displayed through an operation playback interface, wherein the operation playback interface includes an operation video playback area and an operation event list, the operation video playback area displays an operation playback video and a play progress bar, the operation event list displays an operation event, and the play progress bar is associated with the operation event. Therefore, when a first trigger operation is received on the play progress bar, in addition to jumping the operation playback video to the first operation interface corresponding to the first play time point indicated by the first trigger operation, the first operation event corresponding to the first play time point in the operation event list can also be marked; when a second trigger operation is received on the second operation event in the operation event list, in addition to marking the second operation event, the play progress bar can also be positioned to the second play time point corresponding to the second operation event, thereby achieving a play jump of the operation playback video, achieving a two-way association positioning between the operation event list and the play progress bar, optimizing the operation data display effect, thereby enriching the operation data display method, and improving the operation data display efficiency. The user does not need to switch back and forth between the video progress bar and the operation event list, and can directly determine the operation event corresponding to the current play time point, which is simpler and less time-consuming. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] FIG1 is a schematic diagram showing an implementation environment provided by an embodiment of the present application;

[0060] FIG2 shows a flow chart of an operation data display method provided by an exemplary embodiment of the present application;

[0061] FIG3 shows a schematic diagram of an operation playback interface provided by an exemplary embodiment of the present application;

[0062] FIG4 shows a flow chart of an operation data display method provided by another exemplary embodiment of the present application;

[0063] FIG5 shows a schematic diagram of an operation playback interface in response to a first trigger operation on a play progress bar provided by an exemplary embodiment of the present application;

[0064] FIG6 shows a schematic diagram of an operation playback interface in response to a second triggering operation of a second operation event provided by an exemplary embodiment of the present application;

[0065] FIG7 shows a schematic diagram of an operation playback interface for hierarchically displaying operation events provided by an exemplary embodiment of the present application;

[0066] FIG8 shows a structural block diagram of an operation data display device provided by an exemplary embodiment of the present application;

[0067] FIG9 shows a schematic structural diagram of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0068] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0069] It should be noted that before collecting the relevant data of user operations and during the process of collecting the relevant data of users, this application can display a prompt interface, pop-up window or output a voice prompt information. The prompt interface, pop-up window or voice prompt information is used to remind the user that its relevant data is currently being collected, so that this application only starts to execute the relevant steps of obtaining the relevant data of the user after obtaining the confirmation operation issued by the user on the prompt interface or pop-up window. Otherwise (that is, when the confirmation operation issued by the user on the prompt interface or pop-up window is not obtained), the relevant steps of obtaining the relevant data of the user are terminated, that is, the relevant data of the user is not obtained. In other words, the information involved in this application (including but not limited to user device information, user personal information, etc., user corresponding operation data), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the user operation data involved in this application are all obtained with full authorization.

[0070] Please refer to Figure 1, which shows a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application. The implementation environment includes a first terminal 120, a server 140, and a second terminal 160. Data communication between the first terminal 120 and the server 140, and between the second terminal 160 and the server 140, is performed via a communication network. Optionally, the communication network can be a wired network or a wireless network, and the communication network can be at least one of a local area network, a metropolitan area network, and a wide area network.

[0071] The first terminal 120 is an electronic device installed with the application to be tested. The electronic device can be a smartphone, tablet computer, personal computer, wearable device, or vehicle-mounted terminal, etc. FIG1 illustrates the first terminal 120 as a smartphone, but this is not a limitation.

[0072] Second terminal 160 is an electronic device installed with an application program capable of displaying operational data. This operational data display function can be a native application function within the terminal or a third-party application function. The electronic device can be a smartphone, tablet computer, personal computer, wearable device, or vehicle-mounted terminal, among others. Figure 1 illustrates second terminal 160 as a personal computer, but this is not intended to be limiting.

[0073] Server 140 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. In the embodiment of the present application, server 140 can be a backend server for an application with operational data storage and display functions.

[0074] In one possible implementation, as shown in FIG1 , data is exchanged between the server 140 and the first terminal 120, and between the server 140 and the second terminal 160. After receiving the user's operational data generated during program testing, the first terminal 120 transmits the operational data to the server 140. Based on the operational data, the server 140 generates an operational event sequence, further generates an operational playback video and an operational event list, and transmits the operational playback video and operational event list to the second terminal 160. The second terminal 160 then displays an operational playback interface, presenting the operational data to the user.

[0075] In the operation data display method provided in the embodiment of the present application, the execution subject of each step can be a computer device, and the computer device refers to an electronic device with data calculation, processing and storage capabilities. Taking the solution implementation environment shown in Figure 1 as an example, the operation data display method can be executed by the second terminal 160 (such as the client of the application with the operation data display function installed and running in the second terminal 160 executes the operation data display method), or the operation data display method can be executed by the server 140, or the second terminal 160 and the server 140 interact and cooperate to execute, and this application does not limit this. For ease of explanation, in the following method embodiments, only the execution subject of each step of the operation data display method is introduced as a computer device.

[0076] Please refer to FIG2 , which shows a flowchart of an operation data display method provided by an exemplary embodiment of the present application. This embodiment uses the method applied to a computer device (including the second terminal 160 and / or the server 140) as an example for description. The method includes the following steps:

[0077] Step 201: Display an operation playback interface. The operation playback interface is used to display the operation data generated during the program testing process. The operation playback interface includes an operation video playback area and an operation event list. The operation video playback area displays an operation playback video and a playback progress bar. The operation playback video is generated by simulating user operations based on an operation event sequence. The operation event list displays the operation events included in the operation event sequence. The playback progress bar is associated with the operation events in the operation event list.

[0078] In order for the application developer to develop the application and collect the operation data generated by the trial users during the program testing process, so that the developed application can be modified and adjusted more effectively based on the test operation data, an operation playback interface is provided to the application developer, which is used to display the operation data generated by the trial users during the program testing process.

[0079] Optionally, the operation playback interface includes an operation video playback area and an operation event list, wherein the operation video playback area displays an operation playback video and a playback progress bar, and the operation playback video is generated based on the operation event sequence to simulate user operations; the operation event list displays the operation events contained in the operation event sequence.

[0080] Optionally, the operation playback video can be generated by simulating user operations in advance according to the operation event sequence before the user views the operation data, or it can be generated by simulating user operations in real time during video playback. This embodiment of the present application is not limited to this.

[0081] Optionally, the operation event sequence is an event sequence composed of operation events generated based on user operations during the program testing process. Optionally, the operation events may include user interface (UI) change events, control interaction events, etc., such as keyboard height changes, click operations, click jump changes, etc., which are not limited in the embodiments of the present application.

[0082] Unlike related technologies, users can only adjust the playback progress of the operation playback video by clicking on the playback progress bar. When they need to view the operation event corresponding to the current video playback time point, they can only manually flip through and search for the corresponding operation event in the operation event list, which causes cumbersome operation data viewing steps. In the embodiment of the present application, by associating and locating the playback progress bar with the operation event in the operation event list, it is possible to mark and display the operation event corresponding to the current playback time point in the operation event list according to the playback time point corresponding to the playback progress bar during the playback of the operation playback video.

[0083] Optionally, the operation events displayed in the operation event list can be displayed in the form of a control, which can also display relevant information such as the event name corresponding to the operation event, the playback time point corresponding to the operation event in the operation playback video, etc. The embodiment of the present application is not limited to this.

[0084] Schematically, as shown in Figure 3, the computer device displays an operation playback interface 301, wherein the operation playback interface 301 includes an operation video playback area 302 and an operation event list 303, and the operation video playback area 302 displays an operation playback video 304 and a playback progress bar 305, and the playback progress bar 305 is associated with the operation event in the operation event list 303.

[0085] Step 202, in response to the first trigger operation on the playback progress bar, the playback video is redirected to the first operation interface, and the first operation event corresponding to the first playback time point is marked in the operation event list. The first operation interface is the operation interface corresponding to the first playback time point indicated by the operation.

[0086] In a possible implementation, upon receiving a first trigger operation on the playback progress bar, the computer device may, based on the first trigger operation, jump the playback video to a first operation interface corresponding to a first playback time point indicated by the first trigger operation.

[0087] Optionally, the first triggering operation may be a click operation, a drag operation, etc. on the play progress bar.

[0088] In one possible embodiment, when the operation playback video is generated by simulating user operations in real time during video playback, after receiving the first trigger operation, the computer device first determines the first playback time point corresponding to the first trigger operation, and then starts from the currently playing and displayed operation interface, based on the operation event sequence, simulates the user operation until reaching the first operation interface corresponding to the first playback time point, so that the computer device jumps the operation playback video to the first operation interface.

[0089] In one possible embodiment, in order to facilitate the user to find the first operation event corresponding to the first playback time point, after receiving the first trigger operation on the playback progress bar and determining the first operation event corresponding to the first playback time point, the computer device can also mark the first operation event in the operation event list.

[0090] Optionally, the marking method may be color marking, magnified display, etc. of the first operation event. The embodiment of the present application does not limit the specific marking method.

[0091] Step 203 : In response to a second triggering operation on a second operation event in the operation event list, marking the second operation event, and positioning the playback progress bar to a second playback time point corresponding to the second operation event.

[0092] In one possible embodiment, when a second trigger operation is received for a second operation event in the operation event list, the computer device can mark and display the second operation event. At the same time, in order to facilitate the user to view the user operation video data corresponding to the second operation event, the computer device can also position the playback progress bar to the second playback time point corresponding to the second operation event, thereby continuing to play the operation playback video from the second playback time point.

[0093] Optionally, the second trigger operation may be a click operation, a double-click operation, a long press operation, etc. on the second operation event, which is not limited in the embodiment of the present application.

[0094] To sum up, in an embodiment of the present application, the operation data generated during the program testing process is displayed through an operation playback interface, wherein the operation playback interface includes an operation video playback area and an operation event list, the operation video playback area displays an operation playback video and a playback progress bar, the operation event list displays an operation event, and the playback progress bar is associated with the operation event. Therefore, when a first trigger operation on the playback progress bar is received, in addition to jumping the operation playback video to play to the first operation interface corresponding to the first playback time point indicated by the first trigger operation, the first operation event corresponding to the first playback time point in the operation event list can also be marked; when a second trigger operation on the second operation event in the operation event list is received, in addition to marking the second operation event, the playback progress bar can also be positioned to the second playback time point corresponding to the second operation event, thereby realizing a playback jump of the operation playback video, realizing a two-way associated positioning between the operation event list and the playback progress bar, optimizing the operation data display effect, thereby enriching the operation data display method, and improving the operation data display efficiency. Users do not need to switch back and forth between the video progress bar and the operation event list. They can directly determine the operation event corresponding to the current playback time point, which is simpler and less time-consuming.

[0095] In a possible implementation, in order to more accurately achieve the correlation positioning between the playback progress bar and the operation event during the operation data display process, the computer device also needs to determine the corresponding playback time point and operation event under the current trigger operation based on the correspondence between the playback time point corresponding to the playback progress bar and each operation event in the operation event sequence.

[0096] Please refer to FIG4 , which shows a flowchart of an operation data display method provided by an exemplary embodiment of the present application. This embodiment uses the method applied to a computer device (including the second terminal 160 and / or the server 140) as an example for description. The method includes the following steps:

[0097] Step 401: upon receiving a third trigger operation on the operation playback control, obtain an operation event sequence.

[0098] In a possible implementation, in order to facilitate the user to view the operation data generated during the test process, the computer device may also be provided with an operation playback control, so that when a third trigger operation on the operation playback control is received, the computer device needs to obtain the operation event sequence.

[0099] In one possible implementation, the computer device may also provide the user with an operation data selection window so that the user can determine the starting operation event and the ending operation event in the operation event sequence, so that the computer device can directly obtain a section of the operation event sequence based on the starting operation event and the ending operation event.

[0100] Step 402 : Based on the operation event sequence, simulate the user operation in the application interface, generate an operation playback video, and display the operation video playback area in the operation playback interface.

[0101] In one possible implementation, after obtaining the operation event sequence, the computer device can simulate the user operation in the application interface according to the operation event sequence, thereby generating an operation playback video and an operation video playback area displayed in the operation playback interface.

[0102] In one possible implementation, the computer device may first map the initial UI state of the application interface according to the application code, and then, based on the operation event sequence, simulate user operations on each operation event in sequence according to the operation time sequence on the application interface in the initial UI state, thereby obtaining an operation playback video.

[0103] In a possible implementation, the computer device may also directly display the generated operation playback video in real time in the operation video playback area during the user operation simulation.

[0104] Step 403: Display a playback progress bar in the operation video playback area based on the total playback time corresponding to the operation playback video.

[0105] Optionally, in order to facilitate the user to adjust the playback progress of the operation playback video, the computer device may also be provided with a playback progress bar for the operation playback video.

[0106] In one possible embodiment, the computer device determines the correspondence between the display progress of the playback progress bar and the playback time of the video based on the total playback time corresponding to the operation playback video and the display length of the playback progress bar, and displays the playback progress bar in the video playback area, wherein the display progress of the playback progress bar is positively correlated with the playback time of the operation playback video.

[0107] Step 404 : Based on the operation event sequence, sort the operation events in the operation event sequence in the order of operation time, and display them in the operation event list in the operation playback interface.

[0108] In one possible embodiment, in order to correspond to the video playback order of the operation playback video, each operation event is displayed in sequence in the operation event list. The computer device can sort the operation events according to the operation event sequence and the operation time sequence, and display them in the operation event list in the operation playback interface.

[0109] Optionally, in order to facilitate the user to view the playback time point corresponding to each operation event, the computer device may further display the playback time point of each operation event in the operation playback video in the operation event list.

[0110] Through at least one of the above steps 401 to 404, an operation playback interface is displayed, which displays an operation video playback area and an operation event list. The playback progress bar in the operation video playback area is associated with the operation event in the operation event list, which provides a basis for implementing the first operation event based on the operation mark of the playback progress bar and locating the second playback time point based on the second operation event in the embodiment of the present application.

[0111] In one possible implementation, considering that many operation events may be generated during the user operation process, but not all operation events are helpful for program testing and adjustment, for example, users browse the application interface by sliding up and down, repeatedly refreshing the operation, etc. Therefore, in order to simplify the operation event list and improve the display efficiency of the operation events in the operation event list, the computer device can also filter each operation event in the operation event sequence to obtain the filtered operation events, thereby sorting the filtered operation events in the order of operation time, and displaying the filtered operation events in the operation event list.

[0112] Optionally, the filtered operation events may include interface change events and control interaction events, wherein the interface change event is the operation event that generates an interface jump, and the control interaction event is the operation event that interacts by clicking the corresponding control.

[0113] Step 405 : In response to a first triggering operation on the play progress bar, determining a first play time point corresponding to the first triggering operation on the play progress bar.

[0114] In one possible embodiment, when receiving the first trigger operation on the playback progress bar, the computer device first obtains the progress trigger point corresponding to the first trigger operation on the playback progress bar, and then determines the first playback time point corresponding to the first trigger operation on the playback progress bar based on the display progress corresponding to the progress trigger point, the total display progress of the playback progress bar, and the total playback time of the playback video.

[0115] Indicatively, the total display progress of the playback progress bar is L, the display progress corresponding to the progress trigger point is p, and the total playback time of the playback video is T, then the first playback time point can be expressed as t c =p / L*T.

[0116] Step 406 : Determine a first operation event based on the first playback time point and the operation event sequence, and mark the first operation event in an operation event list.

[0117] In one possible implementation, after determining the first playback time point, the computer device can determine the first operation event corresponding to the first playback time point based on the first playback time point and the operation event sequence, thereby marking the first operation event in the operation event list.

[0118] In one possible implementation, the computer device may determine the first operation event from the operation event sequence by binary search based on the first playback time point and the timestamp corresponding to the operation event sequence, wherein the timestamp represents the playback time point corresponding to each operation event in the operation event sequence.

[0119] For example, the binary search process is as follows:

[0120] 1. Initialize the left and right boundaries, setting the left boundary l = 0 and the right boundary r = n-1 (this setting indicates that the left boundary is equal to the index of the first operation event in the operation event sequence, and the right boundary is equal to the index of the last operation event in the operation event sequence), where n is the length of the operation event sequence (i.e., the number of operation events included in the operation event sequence);

[0121] 2. When l≤r, perform the following operations:

[0122] a. Calculate the intermediate index:

[0123] b. Compare the timestamps t corresponding to each operation event in the operation event sequence m With the first playback time point t c:

[0124] a) If t m =t c , returns m, that is, the first operation event is the mth operation event in the operation event sequence;

[0125] b) If t m <t c , update the left boundary, set l = m + 1, and execute again from step 2 above;

[0126] c) If t m >t c , update the right boundary, set r = m-1, and execute again from step 2 above;

[0127] 3. Return the first index. The first index is the index of the first operation event whose timestamp is greater than (or less than, depending on the timestamp setting) the first playback time point, that is, the index of the operation event whose timestamp is closest to the first playback time point.

[0128] In one possible implementation, the timestamp of the operation event can be the playback time point at which the operation event begins to be played, the playback time period during which the operation event is played, or any playback time point within the playback time period during which the operation event is played, and this application does not limit this. It should be noted that different timestamp settings may affect the process of determining the first operation event through the binary search method described above, and the specific setting needs to be based on actual circumstances.

[0129] The first operation event is determined by binary search. The solution is simple, the amount of data required for calculation is small, the pressure on computer equipment is small, and it is more conducive to supporting real-time determination of the first operation event.

[0130] Optionally, to facilitate user differentiation between played and unplayed operation events in the operation event list, the computer device may further mark the played operation events using color coding. In one possible embodiment, when the user triggers the playback progress bar to jump to a video, the computer device may, after determining the first operation event, mark the first operation event in the operation event list and each operation event that occurred before the first operation event.

[0131] Schematically, as shown in Figure 5, when the user clicks on the play progress bar 504 in the video playback area 501, the computer device determines the first play time point, thereby determining the first operation event 505 corresponding to the first play time point, and marks the first operation event 505 in the operation event list 502.

[0132] Step 407 : Based on the first playback time point and the first operation event, the playback of the operation video is redirected to the first operation interface, where the first operation interface corresponds to the first operation event.

[0133] In a possible implementation, after determining the first playback time point and the first operation event, the computer device can determine the first operation interface corresponding to the first operation event, thereby jumping the playback video to the first operation interface.

[0134] Illustratively, as shown in FIG. 5 , the computer device jumps and plays the operation playback video 503 to the first operation interface based on the first playback time point and the first operation event 505 .

[0135] Through at least one of the above steps 405 to 407, the first playback time point corresponding to the operation on the playback progress bar can be determined, the playback can be jumped to the first operation interface based on the first playback time point, and the first operation event can be determined to achieve the association between the playback progress bar and the first operation event, so that the user can quickly locate the currently playing operation event.

[0136] Step 408 : In response to a second triggering operation on a second operation event in the operation event list, mark the second operation event and each operation event in the operation event list that occurs before the second operation event.

[0137] In one possible embodiment, upon receiving a second trigger operation from a user on a second operation event in the operation event list, the computer device can mark the second operation event, and in order to facilitate the distinction between the operation events that occur before the second operation event and the operation events that occur after the second operation event, the computer device can also mark and display the operation events that occur before the second operation event.

[0138] Illustratively, as shown in FIG6 , upon receiving a click operation on a second operation event 603 in an operation event list 602 by a user, the computer device marks the second operation event 603 and each operation event that occurred before the second operation event 603 .

[0139] Step 409 : Determine a second playback time point corresponding to the second operation event based on the second operation event and the timestamp corresponding to the operation event sequence, where the timestamp represents the playback time point corresponding to each operation event in the operation event sequence.

[0140] In a possible implementation, in order to enable playback jump of the operation playback video by triggering the second operation event, the computer device also needs to determine the second playback time point corresponding to the second operation event based on the timestamp corresponding to the second operation event and the operation event sequence.

[0141] Step 410: Position the playback progress bar to a second playback time point corresponding to a second operation event.

[0142] Furthermore, the computer device positions the playback progress bar to the second playback time point corresponding to the second operation event according to the total display progress of the playback progress bar.

[0143] In one possible implementation, the computer device determines the display progress corresponding to the second playback time point based on the second playback time point, the total playback time of the playback video, and the total display progress of the playback progress bar, thereby adjusting the display progress of the playback progress bar.

[0144] Schematically, the total display progress of the playback progress bar is L, the second playback time point is t, and the total playback time of the playback video is T. The display progress corresponding to the progress trigger point can be expressed as pos=t / T*L.

[0145] In a possible implementation, after determining the second playback time point and the second operation event, while adjusting the display progress of the playback progress bar, the computer device can jump the playback operation video to the second operation interface corresponding to the second operation event.

[0146] Schematically, as shown in Figure 6, after determining the second operation event 603, the computer device determines the second playback time point corresponding to the second operation event 603 based on the timestamp corresponding to the second operation event 603 and the operation event sequence, and positions the playback progress bar 604 in the operation video playback area 601 to the second playback time point corresponding to the second operation event 603, and at the same time jumps the operation playback video 605 to play the second operation interface corresponding to the second operation event 603.

[0147] In the above embodiment, when a first trigger operation on the playback progress bar is received, the first playback time point and the first operation event can be determined, the first operation event in the operation event list can be marked, and the display progress of the playback progress bar can be adjusted to jump the playback of the operation replay video to the first operation interface; at the same time, when a second trigger operation on the second operation event is received, the second operation event can be marked, and the display progress of the playback progress bar can be adjusted to jump the playback of the operation replay video to the second operation interface, thereby realizing a two-way correlation positioning between the operation event list and the playback progress bar and optimizing the display effect of the operation data.

[0148] In one possible implementation, considering that a large number of operation events may be generated during the program testing process, if all operation events are directly displayed in the operation event list, the user may not be able to quickly find the target operation event. Therefore, in order to improve the efficiency of searching for operation events, the computer device can also hierarchically divide the various operation events in the operation event list.

[0149] In a possible implementation, after obtaining the operation event sequence, the computer device may hierarchically divide the application operation interfaces involved in the operation process according to the interface jump relationships of the application operation interfaces to obtain multi-level application operation interfaces.

[0150] Optionally, by triggering an application control within the i-th level application operation interface, you can jump to the (i+1) level application operation interface. For example, the main interface of the application can be the first level application operation interface, and the application interface displayed by triggering the application control within the main interface can be the second level application operation interface, and so on.

[0151] Furthermore, the computer device can divide the operation events in the operation event list according to the multi-level application operation interface obtained by division, determine the operation event executed in the i-th level application operation interface as the i-th level operation event, and display the i+1-th level operation event in the operation event list below the i-th level operation event.

[0152] Schematically, the operation events performed by the user in the first-level application operation interface are determined as first-level operation events. After jumping from the first-level application operation interface to the second-level application operation interface, the operation events performed in the second-level application operation interface are second-level operation events. Therefore, the second-level operation events can be displayed below the first-level operation events in the operation event list.

[0153] Optionally, the display size of the second-level operation event can be set smaller than the display size of the first-level operation event, or the second-level operation event can be folded and expanded to display the second-level operation event when a triggering operation for the first-level operation event is received.

[0154] In one possible embodiment, upon receiving the fourth trigger operation for the i-th level operation event, the computer device, based on the fourth trigger operation, jumps the operation playback video to the third operation interface corresponding to the i-th level operation event. At the same time, in order to facilitate the user to view the i+1-th level operation event under the i-th level operation event, the computer device can display the i+1-th level play mark point corresponding to the i+1-th level operation event corresponding to the i-th level operation event on the play progress bar, so that in response to the fifth trigger operation for the i+1-th level play mark point, the computer device can jump the operation playback video to the fourth operation interface corresponding to the i+1-th level operation event. Displaying the operation events in different levels according to the application operation interface and displaying the operation events in different application operation interfaces at different levels can effectively help users quickly locate the application operation interface where the operation event is located.

[0155] Schematically, when a click operation is received on a certain level 1 operation event, the computer device will jump the playback video to the operation interface corresponding to the level 1 operation event, and at the same time display the playback mark point corresponding to the level 2 operation event in the playback progress bar, so as to facilitate the user to quickly view the level 2 operation event.

[0156] Schematically, as shown in Figure 7, when a click operation is received on the first-level operation event 703 in the operation event list 702, the computer device will jump to play the operation playback video 705 in the operation video playback area 701 to the operation interface corresponding to the first-level operation event 703, and at the same time display the playback mark point corresponding to the second-level operation event 704 in the playback progress bar 706.

[0157] In the above embodiment, the application operation interface is divided into levels, and based on the results of the level division of the application operation interface, the operation events within each application operation interface are divided into levels, and each operation event is displayed in the operation event list according to the results of the event level division, thereby optimizing the display effect of the operation event list and improving the efficiency of users in viewing operation data.

[0158] In one possible implementation, in order to facilitate users to replay and view operation events of the same type, the computer device can also group each operation event according to the operation event sequence and operation event type to obtain an operation event grouping result, wherein the operation events of the same type in the operation event grouping result are grouped together, and then based on the operation event grouping result, the computer device can first display the event grouping in the operation event list, so that when the sixth trigger operation for the first event group is received, the computer device can expand and display the various operation events under the first event group in the operation event list.

[0159] In a possible implementation, the above-mentioned method of hierarchically displaying operation events according to the application operation interface, and the method of grouping and displaying the operation event sequence according to the operation event type, can be applied separately or in combination. This application does not limit this, and can be specifically determined according to the complexity of the program testing process. For example, if the program testing process involves switching of many application operation interfaces, then the method of hierarchically displaying the operation events according to the application operation interface can be adopted. For example, if the program testing process involves many operation events of the same type, then the method of grouping and displaying the operation event sequence according to the operation event type can be adopted. Of course, it is also possible to first hierarchically display the operation event sequence by the method of hierarchically displaying the operation events according to the application operation interface, and then group and display the operation event sequence according to the operation event type in each level of the operation event sequence.

[0160] In one possible implementation, in order to facilitate users to modify program codes in a timely manner when discovering program problems while viewing operation data, the computer device can also associate control interaction events with control code segments, where control interaction events are events that implement interface interaction based on triggering operations on controls.

[0161] In one possible embodiment, the computer device can filter out control interaction events from various operation events based on the operation event sequence, and display the corresponding control code positioning button in each control interaction event in the operation event list, so that when the user receives the seventh trigger operation on the first control code positioning button, the computer device can directly jump to display the first control code segment corresponding to the first control code positioning button in the sequence code corresponding to the operation event sequence.

[0162] In a possible embodiment, a control code display area is also displayed in the operation playback interface, and the control code display area is used to display the above-mentioned first control code segment. Exemplarily, when no operation is received for the first control code positioning button, the control code display area can be hidden, or a blank is displayed in the control code display area (that is, no code segment is displayed), or the control code segment corresponding to the currently playing operation event is displayed. In a possible embodiment, when the user's operation on the first control code positioning button is received, the first control code segment corresponding to the first control code positioning button in the sequence code corresponding to the operation event sequence is jumped to display in the operation video playback area. In a possible embodiment, when the user's operation on the first control code positioning button is received, the control code display interface is displayed in a floating manner on the operation playback interface, and the control code display interface is used to display the first control code segment corresponding to the first control code positioning button in the sequence code corresponding to the operation event sequence.

[0163] There are many ways to display the first control code segment in the operation playback interface. It can be displayed in the operation playback interface from the perspective of interface function integration, or it can be displayed separately in other interfaces from the perspective of interface aesthetics.

[0164] In one possible implementation, considering that there may be multiple trial users participating in the program testing, that is, there may be multiple sets of operation event sequences, in order to improve the efficiency of users viewing operation data and improve the efficiency of switching between multiple sets of operation event sequences, the computer device can also display a sequence switching button in the operation video playback area.

[0165] In one possible embodiment, upon receiving the user's eighth trigger operation on the sequence switch button, the computer device can switch the operation playback video corresponding to the current operation event sequence in the operation video playback area to the operation playback video corresponding to other operation event sequences, and at the same time switch each operation event corresponding to the current operation event sequence in the operation event list to an operation event corresponding to other operation event sequences.

[0166] In one possible embodiment, the operation video playback area can be displayed in split screen. For example, when the user operates the sequence switch button, the operation playback video corresponding to the first operation event sequence is displayed in the first area of ​​the operation video playback area, and the operation playback video corresponding to the second operation event is displayed in the second area of ​​the operation video recovery area. In this case, the operation events included in the first operation event sequence and the second operation event sequence can be the same. Comparing the two on the same screen can help users quickly determine the difference between the two, and then quickly locate the problem of the application. For example, the first operation event sequence can be a pre-set standard event sequence, and its corresponding operation playback video is a standard operation playback video. If there is a difference between the operation playback video corresponding to the second operation event sequence and the operation playback video corresponding to the first operation event sequence, it is considered that there is a problem with the operation playback video corresponding to the second operation event sequence.

[0167] Please refer to FIG8 , which shows a structural block diagram of an operation data display device provided by an exemplary embodiment of the present application. The device includes:

[0168] A first display module 801 is configured to display an operation playback interface, which is configured to display operation data generated during program testing. The operation playback interface includes an operation video playback area and an operation event list. The operation video playback area displays an operation playback video and a playback progress bar. The operation playback video is generated by simulating user operations based on an operation event sequence. The operation event list displays the operation events included in the operation event sequence. The playback progress bar is associated with the operation events in the operation event list.

[0169] The second display module 802 is configured to, in response to a first triggering operation on the playback progress bar, redirect the playback of the operated video to a first operation interface, and mark the first operation event corresponding to the first playback time point in the operation event list, where the first operation interface is the operation interface corresponding to the first playback time point indicated by the operation;

[0170] The third display module 803 is configured to, in response to a second triggering operation on a second operation event in the operation event list, mark the second operation event and position the playback progress bar to a second playback time point corresponding to the second operation event.

[0171] Optionally, the second display module 802 is configured to:

[0172] In response to the first triggering operation on the play progress bar, determining the first play time point corresponding to the first triggering operation on the play progress bar;

[0173] determining the first operation event based on the first playback time point and the operation event sequence, and marking the first operation event in the operation event list;

[0174] Based on the first playback time point and the first operation event, the operation playback video is jumped and played to the first operation interface, and the first operation interface corresponds to the first operation event.

[0175] Optionally, the second display module 802 is further configured to:

[0176] Determining the first operation event from the operation event sequence by binary search based on the first playback time point and timestamps corresponding to the operation event sequence, wherein the timestamps represent playback time points corresponding to respective operation events in the operation event sequence;

[0177] The first operation event and each operation event occurring before the first operation event in the operation event list are marked.

[0178] Optionally, the third display module 803 is configured to:

[0179] In response to the second triggering operation on the second operation event in the operation event list, marking the second operation event and each operation event in the operation event list that occurs before the second operation event;

[0180] determining a second playback time point corresponding to the second operation event based on the second operation event and a timestamp corresponding to the operation event sequence, wherein the timestamp represents a playback time point corresponding to each operation event in the operation event sequence;

[0181] Position the playback progress bar to a second playback time point corresponding to the second operation event.

[0182] Optionally, the third display module 803 is further configured to:

[0183] Based on the second playback time point and the second operation event, redirecting the playback of the operation video to a second operation interface corresponding to the second operation event;

[0184] Based on the second playback time point and the total playback duration of the operation playback video, the display progress of the playback progress bar is adjusted, and the display progress is positively correlated with the playback duration of the operation playback video.

[0185] Optionally, the first display module 801 is configured to:

[0186] When a third trigger operation on the operation playback control is received, obtaining the operation event sequence;

[0187] Based on the operation event sequence, simulating the user operation in the application interface, generating the operation playback video, and displaying the operation video playback area in the operation playback interface;

[0188] Based on the total playback time corresponding to the operation playback video, displaying the playback progress bar in the operation video playback area;

[0189] Based on the operation event sequence, each operation event in the operation event sequence is sorted in the order of operation time, and is displayed in the operation event list in the operation playback interface.

[0190] Optionally, the first display module 801 is further configured to:

[0191] Filtering each operation event in the operation event sequence to obtain filtered operation events, wherein the filtered operation events include interface change events and control interaction events, wherein the interface change event is an operation event that generates an interface jump, and the control interaction event is an event that realizes interface interaction based on a triggering operation on a control;

[0192] The filtered operation events are sorted according to the operation time sequence, and the filtered operation events are displayed in the operation event list.

[0193] Optionally, the device further includes:

[0194] A hierarchical division module, configured to divide the application operation interface into multiple levels based on the operation event sequence, thereby obtaining a multi-level application operation interface, wherein triggering an application control in the i-th level application operation interface can jump to the i+1-th level application operation interface;

[0195] An event classification module, configured to classify the operation events in the operation event list based on the multi-level application operation interface obtained by classification, and determine the operation event executed in the i-th level application operation interface as the i-th level operation event;

[0196] The fourth display module is configured to display the (i+1)th level operation event in a hierarchical manner below the i-th level operation event in the operation event list.

[0197] Optionally, the device further includes:

[0198] a playback jump module, configured to, in response to a fourth triggering operation on the i-th level operation event, jump and play the operation playback video to a third operation interface corresponding to the i-th level operation event;

[0199] A fifth display module, configured to display, on the playback progress bar, an i+1th level playback mark point corresponding to the i+1th level operation event corresponding to the i-th level operation event;

[0200] The playback jump module is further configured to jump and play the operation playback video to the fourth operation interface corresponding to the i+1th level operation event in response to the fifth trigger operation on the i+1th level playback mark point.

[0201] Optionally, the device further includes:

[0202] a grouping module, configured to group the operation events based on the operation event sequence and the operation event type to obtain an operation event grouping result, wherein the operation events of the same type in the operation event grouping result are grouped together;

[0203] A sixth display module, configured to display event groups in the operation event list based on the operation event grouping result;

[0204] The seventh display module is configured to expand and display each operation event in the first event group in the operation event list in response to a sixth trigger operation on the first event group.

[0205] Optionally, the device further includes:

[0206] A screening module, configured to screen out control interaction events from various operation events based on the operation event sequence, wherein the control interaction events are events that implement interface interaction based on a triggering operation on a control;

[0207] An eighth display module, configured to display a corresponding control code positioning button in the control interaction event in the operation event list;

[0208] The ninth display module is configured to jump to display the first control code segment corresponding to the first control code locating button in the sequence code corresponding to the operation event sequence in response to the seventh triggering operation on the first control code locating button.

[0209] Optionally, the operation video playback area further displays a sequence switching button;

[0210] The device further comprises:

[0211] A switching display module is used to switch and display the operation playback video in the operation video playback area and the operation events in the operation event list in response to the eighth trigger operation on the sequence switch button.

[0212] In summary, in an embodiment of the present application, the operation data generated during the program testing process is displayed through an operation playback interface, wherein the operation playback interface includes an operation video playback area and an operation event list, the operation video playback area displays an operation playback video and a play progress bar, the operation event list displays an operation event, and the play progress bar is associated with the operation event. Therefore, when a first trigger operation is received on the play progress bar, in addition to jumping the operation playback video to the first operation interface corresponding to the first play time point indicated by the first trigger operation, the first operation event corresponding to the first play time point in the operation event list can also be marked; when a second trigger operation is received on the second operation event in the operation event list, in addition to marking the second operation event, the play progress bar can also be positioned to the second play time point corresponding to the second operation event, thereby realizing a two-way associated positioning between the operation event list and the play progress bar, optimizing the operation data display effect, optimizing the operation data display effect, thereby enriching the operation data display method, and improving the operation data display efficiency. The user does not need to switch back and forth between the video progress bar and the operation event list, and can directly determine the operation event corresponding to the current play time point, which is simpler and less time-consuming.

[0213] It should be noted that the apparatus provided in the above embodiments is merely exemplified by the division of the above functional modules. In actual applications, the above functions can be distributed among different functional modules as needed, that is, the internal structure of the apparatus can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments are based on the same concept. The implementation process is detailed in the method embodiments and will not be repeated here.

[0214] Please refer to Figure 9, which shows a schematic diagram of the structure of a computer device provided by an exemplary embodiment of the present application. Specifically, the computer device 900 includes a central processing unit (CPU) 901, a system memory 904 including a random access memory 902 and a read-only memory 903, and a system bus 905 connecting the system memory 904 and the CPU 901. The computer device 900 also includes a basic input / output system (I / O system) 906 that facilitates information transmission between various components within the computer, and a mass storage device 907 for storing an operating system 913, application programs 914, and other program modules 915.

[0215] The basic input / output system 906 includes a display 908 for displaying information and an input device 909 such as a mouse and a keyboard for user input. The display 908 and the input device 909 are both connected to the central processing unit 901 via an input / output controller 910 connected to the system bus 905. The basic input / output system 906 may also include an input / output controller 910 for receiving and processing input from a variety of other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input / output controller 910 also provides output to a display screen, a printer, or other types of output devices.

[0216] The mass storage device 907 is connected to the central processing unit 901 via a mass storage controller (not shown) connected to the system bus 905. The mass storage device 907 and its associated computer-readable media provide non-volatile storage for the computer device 900. In other words, the mass storage device 907 may include a computer-readable medium (not shown) such as a hard disk or drive.

[0217] Without loss of generality, the computer-readable medium may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include random access memory (RAM), read-only memory (ROM), flash memory or other solid-state storage technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, tape cassette, magnetic tape, disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage medium is not limited to the above-mentioned ones. The above-mentioned system memory 904 and mass storage device 907 can be collectively referred to as memory.

[0218] The memory stores one or more programs, and the one or more programs are configured to be executed by one or more central processing units 901. The one or more programs contain instructions for implementing the above-mentioned methods. The central processing unit 901 executes the one or more programs to implement the methods provided by the above-mentioned various method embodiments.

[0219] According to various embodiments of the present application, the computer device 900 may also be connected to a remote computer on a network such as the Internet for operation. That is, the computer device 900 may be connected to the network 911 via the network interface unit 912 connected to the system bus 905. Alternatively, the network interface unit 912 may be used to connect to other types of networks or remote computer systems (not shown).

[0220] An embodiment of the present application also provides a computer-readable storage medium, which stores at least one instruction, and the at least one instruction is loaded and executed by a processor to implement the operation data display method described in the above embodiment.

[0221] Optionally, the computer-readable storage medium may include: ROM, RAM, solid state drives (SSDs) or optical disks, etc. Among them, RAM may include resistance random access memory (ReRAM) and dynamic random access memory (DRAM).

[0222] The present application provides a computer program product including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the operation data display method described in the above embodiment.

[0223] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0224] The above description is merely an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A method for displaying operation data, the method being executed by a computer device, the method comprising: Display an operation playback interface, the operation playback interface is used to display the operation data generated during the program testing process, the operation playback interface includes an operation video playback area and an operation event list, the operation video playback area displays an operation playback video and a play progress bar, the operation playback video is generated based on the operation event sequence to simulate the user operation, the operation event list displays the operation events included in the operation event sequence, and the play progress bar is associated with the operation event in the operation event list. In response to a first trigger operation on the playback progress bar, the playback of the operation video is redirected to a first operation interface, and a first operation event corresponding to a first playback time point is marked in the operation event list, where the first operation interface is an operation interface corresponding to the first playback time point indicated by the first trigger operation; In response to a second triggering operation on a second operation event in the operation event list, the second operation event is marked, and the playback progress bar is positioned to a second playback time point corresponding to the second operation event.

2. The method according to claim 1, characterized in that: In response to the first triggering operation on the play progress bar, redirecting the playback video to the first operation interface, and marking the first operation event corresponding to the first play time point in the operation event list, comprises: In response to the first triggering operation on the play progress bar, determining the first play time point corresponding to the first triggering operation on the play progress bar; Determining the first operation event based on the first playback time point and the operation event sequence, and marking the first operation event in the operation event list; Based on the first playback time point and the first operation event, the operation playback video is redirected to the first operation interface, where the first operation interface corresponds to the first operation event.

3. The method according to claim 2, wherein: The determining the first operation event based on the first playback time point and the operation event sequence, and marking the first operation event in the operation event list, comprises: Based on the first playback time point and the timestamp corresponding to the operation event sequence, determining the first operation event from the operation event sequence by binary search, wherein the timestamp represents the playback time point corresponding to each operation event in the operation event sequence; The first operation event in the operation event list and each operation event occurring before the first operation event are marked.

4. The method according to any one of claims 1 to 3, wherein: The step of responding to a second triggering operation on a second operation event in the operation event list, marking the second operation event, and positioning the playback progress bar to a second playback time point corresponding to the second operation event, includes: In response to the second triggering operation on the second operation event in the operation event list, marking the second operation event and each operation event in the operation event list that occurs before the second operation event; Determine a second playback time point corresponding to the second operation event based on the second operation event and the timestamps corresponding to the operation event sequence, wherein the timestamps represent the playback time points corresponding to each operation event in the operation event sequence; The playback progress bar is positioned to a second playback time point corresponding to the second operation event.

5. The method according to claim 4, wherein: The positioning of the playback progress bar to a second playback time point corresponding to the second operation event includes: Based on the second playback time point and the second operation event, redirecting the operation playback video to a second operation interface, where the second operation interface corresponds to the second operation event; Based on the second playback time point and the total playback duration of the operation playback video, the display progress of the playback progress bar is adjusted, and the display progress is positively correlated with the playback duration of the operation playback video.

6. The method according to any one of claims 1 to 5, wherein: The display operation playback interface includes: When a third trigger operation on the operation playback control is received, acquiring the operation event sequence; Based on the operation event sequence, simulating the user operation in the application interface, generating the operation playback video, and displaying the operation video playback area in the operation playback interface; Based on the total playback time corresponding to the operation playback video, displaying the playback progress bar in the operation video playback area; Based on the operation event sequence, each operation event in the operation event sequence is sorted according to the operation time sequence, and is displayed in the operation event list in the operation playback interface.

7. The method according to claim 6, wherein: The sorting of the operation events in the operation event sequence according to the operation time sequence based on the operation event sequence, and displaying the operation event list in the operation playback interface, includes: Filtering each operation event in the operation event sequence to obtain filtered operation events, wherein the filtered operation events include interface change events and control interaction events, wherein the interface change event is an operation event that generates an interface jump, and the control interaction event is an event that realizes interface interaction based on a triggering operation on a control; The filtered operation events are sorted according to the operation time sequence, and the filtered operation events are displayed in the operation event list.

8. The method according to any one of claims 1 to 7, wherein: The method further comprises: Based on the operation event sequence, the application operation interface is hierarchically divided to obtain a multi-level application operation interface, wherein the application control in the i-th level application operation interface can be triggered to jump to the (i+1)-th level application operation interface; Based on the multi-level application operation interface obtained by the division, the operation events in the operation event list are divided, and the operation event executed in the i-th level application operation interface is determined as the i-th level operation event; In the operation event list, the i+1th level operation events are hierarchically displayed below the ith level operation events.

9. The method according to claim 8, wherein: The method further comprises: In response to a fourth triggering operation on the i-th level operation event, jumping and playing the operation playback video to a third operation interface corresponding to the i-th level operation event; Displaying the i+1th level play mark point corresponding to the i+1th level operation event corresponding to the i-th level operation event on the play progress bar; In response to the fifth trigger operation on the i+1th level play mark point, the operation playback video is jumped and played to the fourth operation interface corresponding to the i+1th level operation event.

10. The method according to any one of claims 1 to 9, wherein: The method further comprises: Based on the operation event sequence and the operation event type, each operation event is grouped to obtain an operation event grouping result, wherein the operation events of the same type in the operation event grouping result are grouped together; Based on the operation event grouping result, displaying the event grouping in the operation event list; In response to a sixth trigger operation on the first event group, each operation event under the first event group is expanded and displayed in the operation event list.

11. The method according to any one of claims 1 to 10, wherein: The method further comprises: Based on the operation event sequence, a control interaction event is screened out from each operation event, wherein the control interaction event is an event that implements interface interaction based on a triggering operation on a control; Displaying a corresponding control code positioning button in the control interaction event in the operation event list; In response to the seventh trigger operation on the first control code positioning button, the first control code segment corresponding to the first control code positioning button in the sequence code corresponding to the operation event sequence is jumped and displayed.

12. The method according to any one of claims 1 to 11, wherein: The operation video playback area also displays a sequence switching button; The method further comprises: In response to the eighth trigger operation on the sequence switch button, the operation playback video in the operation video playback area is switched to display, and the operation events in the operation event list are switched to display.

13. An operation data display device, comprising: A first display module is used to display an operation playback interface, wherein the operation playback interface is used to display operation data generated during program testing, wherein the operation playback interface includes an operation video playback area and an operation event list, wherein the operation video playback area displays an operation playback video and a playback progress bar, wherein the operation playback video is generated based on an operation event sequence to simulate user operations, wherein the operation event list displays operation events included in the operation event sequence, and wherein the playback progress bar is associated with and positioned with the operation events in the operation event list; A second display module is used for responding to a first trigger operation on the playback progress bar, jumping the playback of the operation playback video to a first operation interface, and marking a first operation event corresponding to a first playback time point in the operation event list, wherein the first operation interface is an operation interface corresponding to the first playback time point indicated by the operation; The third display module is used to mark the second operation event in the operation event list in response to a second trigger operation on the second operation event, and to position the playback progress bar to a second playback time point corresponding to the second operation event.

14. A computer device, comprising a processor and a memory; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the operation data display method according to any one of claims 1 to 12.

15. A computer-readable storage medium, wherein at least one instruction is stored in the computer-readable storage medium, and the at least one instruction is loaded and executed by a processor to implement the operation data display method according to any one of claims 1 to 12.

16. A computer program product, comprising computer instructions, wherein the computer instructions are stored in a computer-readable storage medium; a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the operation data display method as described in any one of claims 1 to 12.

Images