Method and device for testing business process guidance data

Abstract

The invention discloses a method and a device for testing business process guidance data. The method comprises the following steps: acquiring local guidance data corresponding to a current process node and a picture of an operation interface corresponding to the current process node; comparing the picture of the operation interface with the first frame picture in the local guidance data; if the picture of the operation interface is not consistent with the first frame picture in the local guidance data, marking an operation object in the local guidance data contained in the operation interface to obtain new local guidance data and replace the local guidance data; screening out a process node having an association relationship with the new local guidance data, and identifying the process node as a target process node; and testing the local guidance data corresponding to the target process node to obtain a test result. By means of image comparison, interface changes can be rapidly detected and analyzed, local data can be updated, repeated work of manual operation is avoided, affected process nodes are screened out and tested, unnecessary whole-process testing is reduced, and the overall testing efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method and device for testing business process guidance data. Background Art

[0002] Business process guidance data refers to the guidance information provided when users handle business through self-service devices. These guidance data are usually formed based on the business processes of the historical system, but as the system is updated, the business processes may change, so these guidance data need to be tested to ensure that they match the new business processes.

[0003] Currently, the updated business process is generally compared manually with the historical process guidance data to gradually check whether the guidance information in each step conforms to the new business process. However, it takes a lot of manpower and time to step by step check the guidance information of each business step. Especially when the business process is complex and involves many steps, manual comparison may become very time-consuming, reducing the overall testing efficiency.

[0004] Therefore, how to improve the overall testing efficiency has become an urgent problem to be solved in this field. Summary of the invention

[0005] The present application provides a method and device for testing business process guidance data, aiming to improve overall testing efficiency.

[0006] In order to achieve the above objectives, this application provides the following technical solutions:

[0007] A method for testing business process guidance data, comprising:

[0008] Obtaining local guidance data corresponding to the current process node and a picture of the operation interface corresponding to the current process node;

[0009] Comparing the image of the operation interface with the first frame image in the local guidance data to obtain an image comparison result;

[0010] If the image comparison result indicates that the picture of the operation interface is inconsistent with the first frame picture in the local guidance data, it is determined that the layout of the operation interface has been changed;

[0011] Determining whether the operation interface includes the operation object in the local guidance data;

[0012] If the operation interface includes the operation object in the local guidance data, marking the operation object in the local guidance data included in the operation interface to obtain new local guidance data;

[0013] replacing the local guidance data with the new local guidance data;

[0014] Filtering out, from all subsequent process nodes of the current process node, a process node associated with the new local guidance data, and marking it as a target process node;

[0015] The local guidance data corresponding to the target process node is tested to obtain a test result.

[0016] Optionally, comparing the image of the operation interface with the first frame image in the local guidance data includes:

[0017] Inputting the picture of the operation interface and the first frame picture in the local guidance data into a neural network model to obtain an image comparison result;

[0018] or,

[0019] Convert the picture of the operation interface into a first embedding feature, and convert the first frame picture in the local guidance data into a second embedding feature;

[0020] Calculate the similarity between the first embedding feature and the second embedding feature to obtain an image comparison result;

[0021] or,

[0022] Calculate the first image fingerprint of the picture of the operation interface and the second image fingerprint of the first frame in the local guidance data by hashing;

[0023] The first image fingerprint and the second image fingerprint are compared to obtain an image comparison result.

[0024] Optionally, also include:

[0025] If the image comparison result indicates that the picture of the operation interface and the first frame in the local guidance data Figure 1 If the operation interface is consistent with the above, it is determined that the layout of the operation interface has not been changed;

[0026] Perform virtual operations on the operation objects in the operation interface to enter the next process node, and after taking the next process node as the current process node, return to execute the step of obtaining the local guidance data corresponding to the current process node and the picture of the operation interface corresponding to the current process node until all process nodes are executed.

[0027] Optionally, the determining whether the operation interface includes the operation object in the local guidance data includes:

[0028] Identifying the local guidance data to obtain a plurality of operation objects;

[0029] Obtaining a picture of each of the operation objects, and obtaining a picture of each control in the operation interface; wherein the operation objects and the controls have a corresponding relationship;

[0030] For each picture of the operation object, the picture of the operation object is compared with the picture of the control corresponding to the operation object to obtain a matching degree of the operation object;

[0031] Filter out the maximum matching degree from the matching degrees of all operation objects;

[0032] When the maximum matching degree is greater than a preset matching threshold, determining that the operation interface contains the operation object in the local guidance data;

[0033] When the maximum matching degree is not greater than the preset matching threshold, it is determined that the operation interface does not include the operation object in the local guidance data.

[0034] Optionally, also include:

[0035] If the operation interface does not include the operation object in the local guidance data, a change identifier is set for the operation interface, and subsequent process nodes that depend on the current process node and depend on the current process node.

[0036] Optionally, also include:

[0037] When the operation interface includes multiple operation objects in the local guidance data, obtaining the coordinate position of each operation object on the operation interface;

[0038] For each coordinate of the operation object on the operation interface, a dynamic click effect is added to the coordinate position of the operation object on the operation interface to obtain multiple effect frames;

[0039] Copying the operation interface to obtain multiple frames;

[0040] The plurality of effect frames and the plurality of frames are combined to obtain video data, and the video data is determined as new local guidance data.

[0041] A testing device for business process guidance data, comprising:

[0042] An acquisition unit, used to acquire local guidance data corresponding to a current process node and a picture of an operation interface corresponding to the current process node;

[0043] A comparison unit, used to compare the image of the operation interface with the first frame image in the local guidance data to obtain an image comparison result;

[0044] a determining unit, configured to determine that a layout change occurs in the operation interface if the image comparison result indicates that the image of the operation interface is inconsistent with the first frame image in the local guidance data;

[0045] A judging unit, used for judging whether the operation interface includes the operation object in the local guidance data;

[0046] a marking unit, configured to mark the operation object in the local guidance data contained in the operation interface if the operation interface contains the operation object in the local guidance data, so as to obtain new local guidance data;

[0047] a replacing unit, configured to replace the local guidance data with the new local guidance data;

[0048] A screening unit, configured to screen out a process node associated with the new local guidance data from all process nodes subsequent to the current process node, and mark the process node as a target process node;

[0049] The testing unit is used to test the local guidance data corresponding to the target process node to obtain a test result.

[0050] Optionally, the comparison unit is specifically used for:

[0051] Inputting the picture of the operation interface and the first frame picture in the local guidance data into a neural network model to obtain an image comparison result;

[0052] or,

[0053] Convert the picture of the operation interface into a first embedding feature, and convert the first frame picture in the local guidance data into a second embedding feature;

[0054] Calculate the similarity between the first embedding feature and the second embedding feature to obtain an image comparison result;

[0055] or,

[0056] Calculate the first image fingerprint of the picture of the operation interface and the second image fingerprint of the first frame in the local guidance data by hashing;

[0057] The first image fingerprint and the second image fingerprint are compared to obtain an image comparison result.

[0058] Optionally, also include:

[0059] A change determination unit is used to change the image of the operation interface and the first frame of the local guidance data if the image comparison result indicates that Figure 1If the operation interface is consistent with the above, it is determined that the layout of the operation interface has not been changed;

[0060] The return unit is used to perform virtual operations on the operation objects in the operation interface to enter the next process node, and after taking the next process node as the current process node, return to execute the step of obtaining the local guidance data corresponding to the current process node and the picture of the operation interface corresponding to the current process node until all process nodes are executed.

[0061] Optionally, the judging unit is specifically configured to:

[0062] Identifying the local guidance data to obtain a plurality of operation objects;

[0063] Obtaining a picture of each of the operation objects, and obtaining a picture of each control in the operation interface; wherein the operation objects and the controls have a corresponding relationship;

[0064] For each picture of the operation object, the picture of the operation object is compared with the picture of the control corresponding to the operation object to obtain a matching degree of the operation object;

[0065] Filter out the maximum matching degree from the matching degrees of all operation objects;

[0066] When the maximum matching degree is greater than a preset matching threshold, determining that the operation interface contains the operation object in the local guidance data;

[0067] When the maximum matching degree is not greater than the preset matching threshold, it is determined that the operation interface does not include the operation object in the local guidance data.

[0068] The technical solution provided by the present application obtains the local guidance data corresponding to the current process node and the picture of the operation interface corresponding to the current process node; compares the picture of the operation interface with the first frame picture in the local guidance data; if the picture of the operation interface and the first frame picture in the local guidance data are inconsistent, marks the operation object in the operation interface contained in the local guidance data, obtains new local guidance data and replaces the local guidance data; screens out the process nodes that have an association relationship with the new local guidance data and marks them as target process nodes; tests the local guidance data corresponding to the target process node to obtain the test results. Image comparison can quickly detect interface changes, analyze interface changes and update local data, avoids repetitive manual operations, screens out affected process nodes and tests them, reduces unnecessary full-process testing, and improves overall testing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0070] Figure 1 A flowchart of a method for testing business process guidance data provided in an embodiment of the present application;

[0071] Figure 2 A schematic diagram of an operation interface provided in an embodiment of the present application;

[0072] Figure 3 A flowchart of a method for determining an operation object provided in an embodiment of the present application;

[0073] Figure 4 A schematic diagram of a process node provided in an embodiment of the present application;

[0074] Figure 5 A flowchart of a new method for determining local data provided in an embodiment of the present application;

[0075] Figure 6 A schematic diagram of the architecture of a testing device for business process guidance data provided in an embodiment of the present application. DETAILED DESCRIPTION

[0076] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0077] In this application, the terms "comprises", "comprising" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element.

[0078] like Figure 1 As shown, it is a flowchart of a method for testing business process guidance data provided by an embodiment of the present application, including the following steps:

[0079] S101: Acquire local guidance data corresponding to the current process node and a picture of the operation interface corresponding to the current process node.

[0080] Among them, the business process guidance data is used to provide guidance information to users when they handle business through self-service devices, and the local guidance data indicates the process of guiding users to handle business through self-service devices at a single process node. For details, the layout relationship between guidance data and operation interface, see Figure 2 .

[0081] Optionally, when the system of the self-service device is updated, after selecting any process node from all process nodes as the current process node, the guidance data corresponding to the current process node and the picture of the operation interface corresponding to the current process node are obtained. One process node corresponds to the same operation interface.

[0082] It is understandable that the system of the self-service device is virtually executed, and after entering the operation interface, a screenshot of the operation interface is taken to obtain a picture of the operation interface and a first frame of local guidance data.

[0083] S102: Compare the image of the operation interface with the first frame image in the local guidance data to obtain an image comparison result.

[0084] The image comparison result indicates that the picture of the operation interface is inconsistent with the first frame in the local guidance data, and the picture of the operation interface is inconsistent with the first frame in the local guidance data. Figure 1 To.

[0085] Optionally, in another embodiment of the present application, the specific implementation of step S102 includes:

[0086] The picture of the operation interface and the first frame of the local guidance data are input into the neural network model to obtain the image comparison result.

[0087] Among them, the neural network model is a pre-trained model, which is based on the first sample image and the second sample image as input, and takes the image comparison result of the first sample image and the second sample image manually annotated as the training target, and is pre-trained.

[0088] Alternatively, the picture of the operation interface is converted into the first embedding feature, and the first frame picture in the local guidance data is converted into the second embedding feature.

[0089] Among them, Embedding features are the process of converting complex data (such as images, text, audio, etc.) into high-dimensional vectors (usually floating-point arrays), which can effectively represent the semantic information of the original data.

[0090] Calculate the similarity between the first embedding feature and the second embedding feature to obtain the image comparison result.

[0091] Optionally, the cosine similarity between the first embedding feature and the second embedding feature may be calculated, or the similarity between the first embedding feature and the second embedding feature may be calculated using the Euclidean distance, so as to obtain the image comparison result.

[0092] Alternatively, a first image fingerprint of the picture of the operation interface and a second image fingerprint of the first frame in the local guidance data are calculated by hashing.

[0093] Among them, Image Fingerprint is a technology used to uniquely identify or distinguish images. It extracts the features of the image and generates a short, unique "fingerprint" to represent the image.

[0094] The first image fingerprint is compared with the second image fingerprint to obtain an image comparison result.

[0095] It can be understood that the first image fingerprint and the second image fingerprint are compared, that is, the similarity between the first image fingerprint and the second image fingerprint is calculated to obtain the image comparison result.

[0096] Optionally, after step S102, if the image comparison result indicates that the image of the operation interface is consistent with the first frame in the local guidance data, Figure 1 If the local guidance data corresponding to the current process node does not need to be updated, the system can directly enter the next process node, thereby quickly identifying the process node that needs to be updated. Therefore, another embodiment of the present application provides a method for updating the next process node, including:

[0097] If the image comparison result indicates that the image of the operation interface and the first frame in the local guidance data Figure 1 If the operation interface is consistent, it is determined that the layout has not changed.

[0098] A virtual operation is performed on the operation object in the operation interface to enter the next process node, and after the next process node is used as the current process node, the process returns to step S101 and continues until all process nodes are executed.

[0099] The operation objects include but are not limited to: buttons, input boxes, and menu items.

[0100] It can be understood that the system automatically performs a series of virtual operations on the operation objects in the operation interface according to the identified operation objects, simulating the user's operation behavior on the interface to enter the next process node.

[0101] S103: If the image comparison result indicates that the image of the operation interface is inconsistent with the first frame image in the local guidance data, it is determined that a layout change occurs in the operation interface.

[0102] It is understandable that when the operation interface changes, setting a change flag for the current process node can ensure that subsequent steps are executed based on the new interface instead of continuing to use the operation method in the old interface.

[0103] S104: Determine whether the operation interface includes the operation object in the local guidance data.

[0104] If the operation interface includes the operation object in the local guidance data, step S105 is executed.

[0105] It can be understood that to determine whether the operation interface contains the operation object in the local guidance data, specifically, the control in the operation interface is obtained; the control is compared with the operation object, and the comparison result is obtained; wherein the comparison result indicates that the operation interface contains the operation object in the local guidance data, and the operation interface does not contain the operation object in the local guidance data.

[0106] Optionally, in another embodiment of the present application, the specific implementation of step S104 is as follows: Figure 3 As shown, the following steps are included:

[0107] S301: Identify local guidance data to obtain multiple operation objects.

[0108] Optionally, the operation object in the local guidance data may be identified by color marking in the local guidance data, and the local guidance data may also be identified by dynamic click effects (for example, the control to which the dynamic click position belongs is determined as the operation object).

[0109] S302: Acquire a picture of each operation object, and acquire a picture of each control in the operation interface.

[0110] Among them, the operation object and the control have a corresponding relationship.

[0111] It is understandable that a screenshot is taken for each operation object to obtain a picture of each operation object, and a screenshot is taken for each control in the operation interface to obtain a picture of each control in the operation interface.

[0112] S303: For each image of the operation object, compare the image of the operation object with the image of the control corresponding to the operation object to obtain a matching degree of the operation object.

[0113] It can be understood that the image of the operation object is compared with the image of the control corresponding to the operation object, that is, the similarity between the image of the operation object and the image of the control corresponding to the operation object is calculated to obtain the matching degree of the operation object.

[0114] S304: Filter out the maximum matching degree from the matching degrees of all operation objects.

[0115] Specifically, assuming that there are three operation objects, the matching degree of the first operation object is 80%, the matching degree of the second operation object is 75%, and the matching degree of the third operation object is 60%. The maximum matching degree of 80% is screened out from the matching degrees of all operation objects.

[0116] S305: When the maximum matching degree is greater than a preset matching threshold, it is determined that the operation interface contains the operation object in the local guidance data.

[0117] It can be understood that, after determining that the operation object in the local guidance data is included in the operation interface, the image of the control corresponding to the operation object is identified, the center position of the image of the control is obtained, and a virtual operation is performed on the center position.

[0118] S306: When the maximum matching degree is not greater than a preset matching threshold, it is determined that the operation interface does not include the operation object in the local guidance data.

[0119] Optionally, after step S104, the method further includes:

[0120] If the operation interface does not include the operation object in the local guidance data, a change identifier is set for the operation interface, and subsequent process nodes that depend on the current process node and depend on the current process node.

[0121] For example, see Figure 4 , Figure 4 If the layout of the 3.1 operation interface is changed and the operation page of the self-service system does not include the operation objects in the local guidance data, set the change flags for 3.1 and 4, return to process node 2, and enter the 3.2 branch process to continue testing.

[0122] Optionally, after step S104, when the operation interface includes multiple operation objects in the local guidance data, it is necessary to apply a dynamic click effect to each operation object so as to update the local guidance data according to these dynamic effects, thereby greatly improving the user experience and optimizing the operation process. Therefore, in another embodiment of the present application, a new method for determining local data is provided, such as Figure 5 As shown, the following steps are included:

[0123] S501: When the operation interface includes multiple operation objects in the local guidance data, the coordinate position of each operation object in the operation interface is obtained.

[0124] It can be understood that when the operation interface includes multiple operation objects in the local guidance data, obtaining the coordinate position of each operation object in the operation interface is to obtain the coordinates of the center position of the control.

[0125] It should be noted that a dynamic click effect of the operation object is added to each operation interface to form a dynamic video of each business node (i.e., process node). When the operation interface contains multiple operation objects in the local guidance data, the dynamic click effect is a sequential click effect on the multiple operation objects.

[0126] S502: For each coordinate of the operation object on the operation interface, a dynamic click effect is added to the coordinate position of the operation object on the operation interface to obtain a plurality of effect frames.

[0127] It is understandable that on the operation interface, when a user interacts with an operation object, the system can present the click process through dynamic effects. Specifically, the system generates a series of animation frames at the coordinate position of the operation object to simulate the dynamic effect of the click. For example, when a button is clicked, the button will show the change process from the original state to the pressed state, and may contain multiple animation frames to show this process.

[0128] S503: Copy the operation interface to obtain multiple frames.

[0129] It is understandable that the purpose of copying the operation interface is to capture the various states and changes of the interface, and to generate multiple frames to record the appearance and interaction effects of the interface at different time points, which can be used to create animations, videos or guidance data. In this way, the system can generate more dynamic and detailed user interface operation demonstrations to show the user the interaction process or for further processing by the system (such as merging into video data).

[0130] S504: Merge the multiple effect frames and the multiple frames to obtain video data, and determine the video data as new local guidance data.

[0131] It can be understood that multiple effect frames and multiple frames are merged, and multiple static frames (representing different states of the interface) are combined with frames with animation effects (representing dynamic operation effects) to form a continuous video, obtain video data, and use the video data as new local guidance data.

[0132] It should be noted that when the operation interface includes multiple operation objects in the local guidance data, the next process node includes multiple local guidance data. The multiple local guidance data of the next process node are tested by deep traversal.

[0133] S105: Marking the operation objects in the operation interface included in the local guidance data to obtain new local guidance data.

[0134] It can be understood that by color-coding the operation objects in each step, the interface elements that need to be operated in each step can be clearly displayed, helping users to follow the operation process step by step and reduce operational errors.

[0135] S106: Replace the local guidance data with new local guidance data.

[0136] S107: Filter out the process nodes associated with the new local guidance data from all the process nodes subsequent to the current process node, and mark them as target process nodes.

[0137] Among them, the target process node is the process node affected by the current process node (that is, based on the dependency relationship between the business type and the file, the business type that depends on the current process node is determined, and the local guidance data of the business process corresponding to the business type is determined as the local guidance data of the affected business process).

[0138] S108: Testing the local guidance data corresponding to the target process node to obtain a test result.

[0139] It is understandable that the purpose of testing the local guidance data of the target process node is to ensure that the guidance data can correctly support the execution of the process node and make corresponding improvements or adjustments based on the test results.

[0140] In summary, image comparison can quickly detect interface changes, analyze interface changes and update local data, avoiding repetitive manual operations. Then, the affected process nodes are screened out and tested, reducing unnecessary full-process testing and saving a lot of time. Therefore, the overall testing efficiency is improved.

[0141] like Figure 6 As shown, it is a schematic diagram of the architecture of a testing device for business process guidance data provided in an embodiment of the present application, and the testing device includes: an acquisition unit 100, a comparison unit 200, a determination unit 300, a judgment unit 400, a marking unit 500, a replacement unit 600, a screening unit 700 and a testing unit 800.

[0142] The acquisition unit 100 is used to acquire the local guidance data corresponding to the current process node and the picture of the operation interface corresponding to the current process node.

[0143] The comparison unit 200 is used to compare the image of the operation interface with the first frame image in the local guidance data to obtain an image comparison result.

[0144] The comparison unit 200 is specifically used to: input the picture of the operation interface and the first frame image in the local guidance data into the neural network model to obtain an image comparison result; or, convert the picture of the operation interface into a first embedding feature, and convert the first frame image in the local guidance data into a second embedding feature; calculate the similarity between the first embedding feature and the second embedding feature to obtain an image comparison result; or, calculate the first image fingerprint of the picture of the operation interface and the second image fingerprint of the first frame image in the local guidance data by hashing; compare the first image fingerprint and the second image fingerprint to obtain an image comparison result.

[0145] The determination unit 300 is configured to determine that a layout change has occurred in the operation interface if the image comparison result indicates that the image of the operation interface is inconsistent with the first frame image in the local guidance data.

[0146] The judging unit 400 is used to judge whether the operation interface includes the operation object in the local guidance data.

[0147] The judgment unit 400 is specifically used to: identify the local guidance data to obtain multiple operation objects; obtain a picture of each operation object, and obtain a picture of each control in the operation interface; wherein the operation object and the control have a corresponding relationship; for each picture of the operation object, compare the picture of the operation object with the picture of the control corresponding to the operation object to obtain a matching degree of the operation object; filter out the maximum matching degree from the matching degrees of all operation objects; when the maximum matching degree is greater than a preset matching threshold, determine that the operation interface contains the operation object in the local guidance data; when the maximum matching degree is not greater than the preset matching threshold, determine that the operation interface does not contain the operation object in the local guidance data.

[0148] The marking unit 500 is used to mark the operation object in the local guidance data if the operation interface includes the operation object in the local guidance data, so as to obtain new local guidance data.

[0149] A replacement unit 600, configured to replace the local guidance data with new local guidance data;

[0150] The screening unit 700 is used to screen out the process nodes associated with the new local guidance data from all the process nodes subsequent to the current process node, and mark them as target process nodes.

[0151] The testing unit 800 is used to test the local guidance data corresponding to the target process node to obtain a test result.

[0152] In summary, image comparison can quickly detect interface changes, analyze interface changes and update local data, avoiding repetitive manual operations. Then, the affected process nodes are screened out and tested, reducing unnecessary full-process testing and saving a lot of time. Therefore, the overall testing efficiency is improved.

[0153] Preferably, combined Figure 6 According to the content shown, the testing device also includes: a change determination unit and a return unit.

[0154] A change determination unit is used to change the first frame of the picture of the operation interface and the local guidance data if the image comparison result indicates Figure 1 If the operation interface is consistent, it is determined that the layout has not changed.

[0155] The return unit is used to perform virtual operations on the operation objects in the operation interface to enter the next process node, and after taking the next process node as the current process node, return to execute the step of obtaining the local guidance data corresponding to the current process node and the picture of the operation interface corresponding to the current process node until all process nodes are executed.

[0156] Preferably, combined Figure 6 According to the content shown, the testing device also includes: a setting unit, which is used to set a change mark for the operation interface, and the subsequent process nodes that depend on the current process node and the current process node if the operation interface does not contain the operation object in the local guidance data.

[0157] Preferably, combined Figure 6 As shown in the figure, the testing device also includes: a position acquiring unit, an adding unit, a copying unit and a merging unit.

[0158] A position acquisition unit, used to acquire the coordinate position of each operation object on the operation interface when the operation interface includes multiple operation objects in the local guidance data;

[0159] An adding unit, for adding a dynamic click effect to the coordinate position of each operation object on the operation interface, to obtain a plurality of effect frames;

[0160] A copy unit, used for copying the operation interface to obtain multiple frames;

[0161] The merging unit is used to merge the multiple effect frames and the multiple frames to obtain video data, and determine the video data as new local guidance data.

[0162] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative work.

[0163] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0164] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for testing business process guidance data, characterized in that: include: Obtaining local guidance data corresponding to the current process node and a picture of the operation interface corresponding to the current process node; Comparing the image of the operation interface with the first frame image in the local guidance data to obtain an image comparison result; If the image comparison result indicates that the picture of the operation interface is inconsistent with the first frame picture in the local guidance data, it is determined that the layout of the operation interface has been changed; Determining whether the operation interface includes the operation object in the local guidance data; If the operation interface includes the operation object in the local guidance data, marking the operation object in the local guidance data included in the operation interface to obtain new local guidance data; replacing the local guidance data with the new local guidance data; Filtering out, from all subsequent process nodes of the current process node, a process node associated with the new local guidance data, and marking it as a target process node; The local guidance data corresponding to the target process node is tested to obtain a test result.

2. The method according to claim 1, characterized in that The comparing the picture of the operation interface with the first frame picture in the local guidance data includes: Inputting the picture of the operation interface and the first frame picture in the local guidance data into a neural network model to obtain an image comparison result; or, Convert the picture of the operation interface into a first embedding feature, and convert the first frame picture in the local guidance data into a second embedding feature; Calculate the similarity between the first embedding feature and the second embedding feature to obtain an image comparison result; or, Calculate the first image fingerprint of the picture of the operation interface and the second image fingerprint of the first frame in the local guidance data by hashing; The first image fingerprint and the second image fingerprint are compared to obtain an image comparison result.

3. The method according to claim 1, characterized in that Also includes: If the image comparison result indicates that the picture of the operation interface is consistent with the first frame picture in the local guidance data, it is determined that the layout of the operation interface has not been changed; Perform virtual operations on the operation objects in the operation interface to enter the next process node, and after taking the next process node as the current process node, return to execute the step of obtaining the local guidance data corresponding to the current process node and the picture of the operation interface corresponding to the current process node until all process nodes are executed.

4. The method according to claim 1, characterized in that The determining whether the operation interface includes the operation object in the local guidance data includes: Identifying the local guidance data to obtain a plurality of operation objects; Obtaining a picture of each of the operation objects, and obtaining a picture of each control in the operation interface; wherein the operation objects and the controls have a corresponding relationship; For each picture of the operation object, the picture of the operation object is compared with the picture of the control corresponding to the operation object to obtain a matching degree of the operation object; Filter out the maximum matching degree from the matching degrees of all operation objects; When the maximum matching degree is greater than a preset matching threshold, determining that the operation interface contains the operation object in the local guidance data; When the maximum matching degree is not greater than the preset matching threshold, it is determined that the operation interface does not include the operation object in the local guidance data.

5. The method according to claim 1, characterized in that Also includes: If the operation interface does not include the operation object in the local guidance data, a change identifier is set for the operation interface, and subsequent process nodes that depend on the current process node and depend on the current process node.

6. The method according to claim 1, characterized in that Also includes: When the operation interface includes multiple operation objects in the local guidance data, obtaining the coordinate position of each operation object on the operation interface; For each coordinate of the operation object on the operation interface, a dynamic click effect is added to the coordinate position of the operation object on the operation interface to obtain multiple effect frames; Copying the operation interface to obtain multiple frames; The plurality of effect frames and the plurality of frames are combined to obtain video data, and the video data is determined as new local guidance data.

7. A testing device for business process guidance data, characterized in that: include: An acquisition unit, used to acquire local guidance data corresponding to a current process node and a picture of an operation interface corresponding to the current process node; A comparison unit, used to compare the image of the operation interface with the first frame image in the local guidance data to obtain an image comparison result; a determining unit, configured to determine that a layout change occurs in the operation interface if the image comparison result indicates that the image of the operation interface is inconsistent with the first frame image in the local guidance data; A judging unit, used for judging whether the operation interface includes the operation object in the local guidance data; a marking unit, configured to mark the operation object in the local guidance data contained in the operation interface if the operation interface contains the operation object in the local guidance data, so as to obtain new local guidance data; a replacing unit, configured to replace the local guidance data with the new local guidance data; A screening unit, configured to screen out a process node associated with the new local guidance data from all process nodes subsequent to the current process node, and mark the process node as a target process node; The testing unit is used to test the local guidance data corresponding to the target process node to obtain a test result.

8. The device according to claim 7, characterized in that The comparison unit is specifically used for: Inputting the picture of the operation interface and the first frame picture in the local guidance data into a neural network model to obtain an image comparison result; or, Convert the picture of the operation interface into a first embedding feature, and convert the first frame picture in the local guidance data into a second embedding feature; Calculate the similarity between the first embedding feature and the second embedding feature to obtain an image comparison result; or, Calculate the first image fingerprint of the picture of the operation interface and the second image fingerprint of the first frame in the local guidance data by hashing; The first image fingerprint and the second image fingerprint are compared to obtain an image comparison result.

9. The device according to claim 7, characterized in that Also includes: a change determination unit, configured to determine that no layout change has occurred in the operation interface if the image comparison result indicates that the image of the operation interface is consistent with the first frame image in the local guidance data; The return unit is used to perform virtual operations on the operation objects in the operation interface to enter the next process node, and after taking the next process node as the current process node, return to execute the step of obtaining the local guidance data corresponding to the current process node and the picture of the operation interface corresponding to the current process node until all process nodes are executed.

10. The device according to claim 7, characterized in that The judging unit is specifically used for: Identifying the local guidance data to obtain a plurality of operation objects; Obtaining a picture of each of the operation objects, and obtaining a picture of each control in the operation interface; wherein the operation objects and the controls have a corresponding relationship; For each picture of the operation object, the picture of the operation object is compared with the picture of the control corresponding to the operation object to obtain a matching degree of the operation object; Filter out the maximum matching degree from the matching degrees of all operation objects; When the maximum matching degree is greater than a preset matching threshold, determining that the operation interface contains the operation object in the local guidance data; When the maximum matching degree is not greater than the preset matching threshold, it is determined that the operation interface does not include the operation object in the local guidance data.

Images