Process image logic verification method and device, equipment, medium and product

Abstract

The invention provides a process image logic verification method and device, equipment, a medium and a product, and can be applied to the technical field of big data. The method comprises the steps of determining a rule for performing target logic verification on a process image based on a preset demand condition; identifying the process image to obtain a connection relationship between frames and connecting lines in the process image and text information in each frame; based on the connection relationship, generating a relationship tree representing an association sequence among the plurality of frames, the relationship tree including nodes and edges, the nodes representing the frames and text information in the frames, and the edges representing the connection relationship among the plurality of frames; and based on the target logic verification rule, performing logic verification on the relation tree to obtain a verification result of the process image.

Description

Technical Field

[0001] The present disclosure relates to the field of big data technology, and in particular to a process image logic verification method, device, equipment, medium and product. Background Art

[0002] In recent years, with the promotion of digitalization and intelligentization, some low-code products have emerged. Users can customize some workflows according to actual needs to deal with various work situations, which greatly increases the flexibility of daily work collaboration. At present, the rule verification of flowcharts is built into the product, mainly supported by the corresponding editing and design software products. The scope and rules are mainly confirmed in the relevant product development stage, and the flowcharts are verified by human review for logical rules.

[0003] In the process of implementing the present disclosure, the inventors found that the verification rules in the related art could not meet the real-time changing user needs, had low flexibility, and the manual judgment method brought high labor costs. Summary of the invention

[0004] In view of the above problems, the present disclosure provides a process image logic verification method, device, equipment, medium and product.

[0005] According to the first aspect of the present disclosure, a process image logic verification method is provided, including: determining a target logic verification rule for the process image based on preset requirement conditions; identifying the process image to obtain the connection relationship between the frames and the lines in the process image and the text information in each frame; based on the connection relationship, generating a relationship tree representing the association order between multiple frames, wherein the relationship tree includes nodes and edges, the nodes represent the frames and the text information in the frames, and the edges represent the connection relationship between the multiple frames; based on the target logic verification rule, performing a logic verification on the relationship tree to obtain a verification result of the process image.

[0006] According to an embodiment of the present disclosure, a process image is identified to obtain a connection relationship between frames and lines in the process image and text information in each frame, including: marking elements in the process image to obtain element labeling frames; identifying elements based on vertex position information of the element labeling frames to obtain frames and lines; using an optical character recognition algorithm to identify the content of the process image to obtain text information in each frame; and determining a connection relationship between a line and a frame based on a distance from a vertex of the line to the frame.

[0007] According to an embodiment of the present disclosure, the vertices of the connecting line include a starting point and an end point; wherein, determining the connection relationship between the connecting line and the frame according to the distance from the vertex of the connecting line to the frame includes: determining a target edge associated with the starting point according to the distance from the starting point of the connecting line to each of the multiple frames; obtaining a starting frame associated with the starting point according to the target edge associated with the starting point; determining a target edge associated with the end point according to the distance from the end point of the connecting line to each of the multiple frames; obtaining a terminal frame associated with the end point according to the target edge associated with the end point; and determining the connection relationship between the connecting line and the frame according to the starting frame, the connecting line, and the terminal frame.

[0008] According to an embodiment of the present disclosure, the element annotation box includes a line annotation box, and the process image logic verification method also includes: based on a preset area size threshold, determining the vertex areas corresponding to the four vertices of the line annotation box; determining the minimum difference and the maximum difference based on the difference between the pixel color mean corresponding to the vertex areas of the four vertices and the pixel color mean of the line annotation box; determining the vertex corresponding to the minimum difference as the starting point of the line; and determining the vertex corresponding to the maximum difference as the end point of the line.

[0009] According to an embodiment of the present disclosure, a target logic verification rule for a process image is determined based on preset requirement conditions, including: when the preset requirement conditions include text information design requirements, determining a text verification rule that matches the text information design requirements from multiple verification rules; when the preset requirement conditions include logical relationship design requirements, determining a logical relationship verification rule that matches the logical relationship design requirements from multiple verification rules; and determining a target logic verification rule based on at least one of the text verification rule and the logical relationship verification rule.

[0010] According to an embodiment of the present disclosure, the target logic verification rule includes a text verification rule, and the text verification rule includes at least one of the following: a text inclusion relationship rule, a repetition relationship rule, and a sequence relationship rule; wherein, based on the target logic verification rule, a logic verification is performed on the relationship tree to obtain a verification result of the process image, including: based on the text inclusion relationship rule, detecting the text information on the nodes in the relationship tree to obtain a text inclusion relationship verification result; based on the repetition relationship rule, detecting the number of nodes corresponding to the text information in the relationship tree to obtain a repetition relationship verification result; based on the sequence relationship rule, detecting the degree of association between the text information corresponding to the current node and the next node in the relationship tree to obtain a sequence relationship verification result; based on at least one of the text inclusion relationship verification result, the repetition relationship verification result and the sequence relationship verification result, determining the verification result of the process image.

[0011] According to an embodiment of the present disclosure, the target logic verification rule includes a logic relationship verification rule, and the logic relationship verification rule includes at least one of the following: a branch inclusion relationship rule, a branch parallel relationship rule, and a loop relationship rule; wherein, based on the target logic verification rule, the relationship tree is logically verified, and the verification result of the process image is obtained, which also includes: based on the branch inclusion relationship rule, the hierarchy of the target node in the relationship tree is detected to obtain the branch inclusion verification result; based on the branch parallel relationship rule, the hierarchy corresponding to each of the two associated nodes in the relationship tree is detected to obtain the branch parallel verification result; based on the loop relationship rule, the coordinate position of the local area image in the process image and the coordinate position of the node in the relationship tree in the process image are detected to obtain the loop relationship verification result, wherein the local area image includes an area image with a loop relationship frame and a connecting line; based on at least one of the branch inclusion verification result, the branch parallel verification result and the loop relationship verification result, the verification result of the process image is determined.

[0012] A second aspect of the present disclosure provides a process image logic verification device, including: a determination module, used to determine a target logic verification rule for the process image based on preset demand conditions; an identification module, used to identify the process image, and obtain the connection relationship between the frame and the connection line in the process image and the text information in each frame; a generation module, used to generate a relationship tree representing the association order between multiple frames based on the connection relationship, wherein the relationship tree includes nodes and edges, the nodes represent the frame and the text information in the frame, and the edges represent the connection relationship between the multiple frames; a verification module, used to perform a logic verification on the relationship tree based on the target logic verification rule to obtain a verification result of the process image.

[0013] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.

[0014] The fourth aspect of the present disclosure further provides a computer-readable storage medium having a computer program or instructions stored thereon, which implements the steps of the above method when the above computer program or instructions are executed by a processor.

[0015] The fifth aspect of the present disclosure further provides a computer program product, including a computer program or instructions, which implement the steps of the above method when the above computer program or instructions are executed by a processor.

[0016] According to the flowchart image logic verification method, device, equipment, medium and product provided by the present disclosure, the target logic verification rules for the process image can be flexibly determined by presetting the demand conditions, and a relationship tree is further generated according to the connection relationship between the connection line and the frame, and then the nodes in the relationship tree are automatically logically verified based on the logic verification rules. Since the preset demand conditions can be adjusted in real time according to user needs, product design needs, upgrade needs and other needs, there is no need to wait for the iteration cycle of the software product. The target logic verification rules for verifying the process image are flexibly determined while updating the process image. The process image logic verification process is not limited by the coupling relationship within the software product, and has strong versatility, low labor cost and high verification accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above contents and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0018] Figure 1 The application scenario diagram of the process image logic verification method according to the embodiment of the present disclosure is schematically shown;

[0019] Figure 2 A flowchart of a process image logic verification method according to an embodiment of the present disclosure is schematically shown;

[0020] Figure 3 Schematically shows a schematic diagram of element marking according to an embodiment of the present disclosure;

[0021] Figure 4 A schematic diagram schematically shows a process image recognition according to an embodiment of the present disclosure;

[0022] Figure 5 A schematic diagram of a structure of a process image logic verification device according to an embodiment of the present disclosure is shown; and

[0023] Figure 6 A block diagram of an electronic device suitable for implementing a process image logic verification method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0024] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0025] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0026] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0027] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0028] In the process of implementing the present disclosure, it was found that the capabilities provided by flowchart editing software products in the related art are more limited. First, the verification rules are basically confirmed when the software product is released, which is not flexible enough and cannot meet the user needs that may change. Second, the coupling with the software product is high, and the logical rule check is usually completed within the software. Based on the internal structure, the support for general image formats is imperfect and not universal. The adjustment of relevant rules often needs to be carried out with the iterative update of the software product, which has a long cycle and cannot meet user needs in a timely manner.

[0029] In view of this, an embodiment of the present disclosure provides a process image logic verification method, which determines a target logic verification rule for the process image based on preset demand conditions; identifies the process image to obtain the connection relationship between the frame and the connection line in the process image and the text information in each frame; based on the connection relationship, generates a relationship tree representing the association order between multiple frames, wherein the relationship tree includes nodes and edges, the nodes represent the frame and the text information in the frame, and the edges represent the connection relationship between the multiple frames; based on the target logic verification rule, performs a logic verification on the relationship tree to obtain the verification result of the process image.

[0030] It should be noted that the flowchart image logic verification method and process image logic verification device provided by the present disclosure can be used in the field of financial technology, such as financial institutions, and can also be used in any field other than the field of financial technology, such as e-commerce platforms such as shopping websites. Therefore, the application field of the flowchart image logic verification method and process image logic verification device provided by the present disclosure is not limited.

[0031] In the technical solution of the present disclosure, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0032] In the scenario of using personal information for automated decision-making, the methods, devices, and systems provided by the embodiments of the present disclosure provide users with corresponding operation portals for users to choose to agree or reject the automated decision-making results; if the user chooses to reject, the expert decision-making process will be entered. The expression "automated decision-making" here refers to the activity of automatically analyzing and evaluating a person's behavioral habits, interests and hobbies, or economic, health, credit status, etc. through computer programs, and making decisions. The expression "expert decision-making" here refers to the activity of making decisions by people who specialize in a certain field, have specialized experience, knowledge and skills, and have reached a certain level of professionalism.

[0033] Figure 1 The application scenario diagram of the process image logic verification method according to the embodiment of the present disclosure is schematically shown.

[0034] like Figure 1 As shown, the application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is used to provide a medium for a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0035] The user can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).

[0036] The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0037] The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

[0038] It should be noted that the process image logic verification method provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the process image logic verification device provided in the embodiment of the present disclosure can generally be set in the server 105. The process image logic verification method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Accordingly, the process image logic verification device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105.

[0039] It should be understood that Figure 1 The number of the first terminal device, the second terminal device, the third terminal device, the network and the server in the embodiment is only for illustration. According to the implementation requirements, there may be any number of the first terminal device, the second terminal device, the third terminal device, the network and the server.

[0040] The following will be based on Figure 1 The scene described by Figure 2~Figure 4 The process image logic verification method of the disclosed embodiment is described in detail.

[0041] Figure 2 The flowchart of the process image logic verification method according to the embodiment of the present disclosure is schematically shown.

[0042] like Figure 2 As shown, the process image logic verification method 200 of this embodiment includes operations S210 to S240.

[0043] In operation S210 , a target logic verification rule for the process image is determined based on a preset requirement condition.

[0044] In operation S220, the process image is recognized to obtain the connection relationship between the frames and the lines in the process image and the text information in each frame.

[0045] In operation S230 , a relationship tree representing the association order between the plurality of frames is generated based on the connection relationship.

[0046] In operation S240, a logic check is performed on the relationship tree based on the target logic check rule to obtain a check result of the process image.

[0047] According to the embodiments of the present disclosure, preset requirement conditions can be determined based on the internal design requirements of the software product, business workflow requirements, actual user requirements, etc., and a process image related to the function of the software product can be edited and generated based on the preset requirement conditions. Then, the target logic verification rules are determined based on multiple requirements in the preset requirement conditions. The target logic verification rules are used to verify the process image to ensure that the process image meets the normal requirements of the application.

[0048] According to the embodiments of the present disclosure, the target logic verification rule is flexibly defined by combining one or more of the preset requirement conditions and the process image logic standard specification.

[0049] According to an embodiment of the present disclosure, the process image is preprocessed, for example, operations such as thickening the connecting line elements and sharpening the boundaries are performed, and the preprocessed process image is recognized using an image detection model to identify the frame and the connecting lines, and then the connection relationship between the frame and the connecting lines is obtained.

[0050] According to an embodiment of the present disclosure, sample data when training an image detection model can expand the sample data set through deformation methods such as rotation, inversion, and cropping, thereby improving the processing capability of the trained model.

[0051] According to the embodiments of the present disclosure, a text recognition algorithm may be used to process the process image to obtain text information in each frame.

[0052] According to an embodiment of the present disclosure, the connection relationship is the connection relationship between the frame and the line. Through all the connection relationships in the process image, the association order between the frames can be obtained. For example, frame 1 is connected to line 1, and frame 2 is connected to line 1, so that frame 1 is associated with frame 2.

[0053] According to an embodiment of the present disclosure, after the frame association is completed, a relationship tree is generated from the node corresponding to the starting frame. The next frame can be found according to the connection associated with the current frame until all frames are processed or the current frame has no associated frames.

[0054] According to an embodiment of the present disclosure, a relationship tree includes nodes and edges, wherein the nodes represent a frame and text information in the frame, and the edges represent the connection relationship between multiple frames. For example, a root node in the relationship tree represents a starting frame and text information in the starting frame, and a next node connected to the root node represents a frame associated with the starting frame and text information in the frame.

[0055] According to an embodiment of the present disclosure, performing logic verification on a relationship tree according to a target logic verification rule may include: verifying text information on nodes in the relationship tree and connection relationships between nodes to obtain a verification result of a process image.

[0056] According to the embodiments of the present disclosure, since the preset demand conditions can be adjusted in real time according to user needs, product design needs, upgrade needs and other needs, there is no need to wait for the iteration cycle of the software product. While updating the process image, the target logic verification rules for verifying the process image are flexibly determined. The process image logic verification process is not limited by the coupling relationship within the software product, has strong versatility, low labor costs, and high verification accuracy.

[0057] According to an embodiment of the present disclosure, a process image is identified to obtain a connection relationship between frames and lines in the process image and text information in each frame, including: marking elements in the process image to obtain element annotation frames; based on vertex position information of the element annotation frames, the elements are identified to obtain frames and lines; an optical character recognition algorithm is used to identify the content of the process image to obtain text information in each frame; and the connection relationship between the lines and the frames is determined based on the distance from the vertex of the lines to the frames.

[0058] According to an embodiment of the present disclosure, the elements in the process image include frame elements and line elements, and the frame elements and the line elements are marked respectively to obtain element marking frames.

[0059] According to the embodiments of the present disclosure, when marking frame elements, it is necessary to ensure that the complete frame edge is within the element annotation box. When marking line elements, it is necessary to ensure that the two ends of the line are located on the edge of the element annotation box. For the text information in the frame element, horizontal or vertical text can be generated at a random position within the range of the element annotation box to increase the sample capacity.

[0060] According to an embodiment of the present disclosure, screening processing may be performed according to the algorithm confidence or the overlapping area between element annotation boxes, and element annotation boxes whose overlapping area exceeds a preset threshold are removed.

[0061] According to an embodiment of the present disclosure, the image detection model processes the vertex position information of the element annotation box and identifies the box body and the connecting lines. The element annotation box has four vertex position information, and the element recognition can be performed based on the two diagonal vertex position information.

[0062] According to an embodiment of the present disclosure, an optical character recognition algorithm (OCR) is used to perform content recognition on the process image to obtain text information in each frame.

[0063] According to an embodiment of the present disclosure, a connection line corresponds to two vertices, and the frame to which each vertex is connected is determined according to the distance from each vertex of the connection line to the frame, thereby determining the connection relationship between the connection line and the frame.

[0064] For example, there are vertices 1 and 2 at both ends of line 1. According to the distance relationship between vertex 1 and all frames, it is determined that vertex 1 is connected to frame 1; according to the distance relationship between vertex 2 and all frames, it is determined that vertex 2 is connected to frame 2, and then the connection relationship between the line and the frame is determined to be: frame 1—line 1—frame 2.

[0065] According to an embodiment of the present disclosure, the vertices of the connecting line include a starting point and an end point; wherein, determining the connection relationship between the connecting line and the frame according to the distance from the vertex of the connecting line to the frame includes: determining a target edge associated with the starting point according to the distance from the starting point of the connecting line to each of the multiple frames; obtaining a starting frame associated with the starting point according to the target edge associated with the starting point; determining a target edge associated with the end point according to the distance from the end point of the connecting line to each of the multiple frames; obtaining a terminal frame associated with the end point according to the target edge associated with the end point; and determining the connection relationship between the connecting line and the frame according to the starting frame, the connecting line, and the terminal frame.

[0066] According to an embodiment of the present disclosure, the two ends of the connection line are the starting point and the end point respectively, and the frame has four sides. Calculating the distance from the starting point of the connection line to each of the multiple frames may include: the distance from the starting point to the four sides on each frame, and taking the side with the shortest distance as the target side associated with the starting point.

[0067] According to an embodiment of the present disclosure, a frame in which the target edge is located is determined according to the target edge associated with the starting point, and then a starting frame associated with the starting point is obtained.

[0068] According to an embodiment of the present disclosure, calculating the distance from the endpoint of the connection to each of the multiple frames may include: the distance from the endpoint to the four edges on each frame, taking the edge with the shortest distance as the target edge associated with the endpoint, determining the frame where the target edge is located based on the target edge associated with the endpoint, and then obtaining the terminal frame associated with the endpoint.

[0069] According to an embodiment of the present disclosure, the connection relationship between the line and the frame is: starting frame—line—terminal frame. The starting frame is associated with the terminal frame, and the node corresponding to the terminal frame in the relationship tree is a child node of the node corresponding to the starting frame.

[0070] Figure 3 A schematic diagram of element marking according to an embodiment of the present disclosure is schematically shown.

[0071] like Figure 3As shown, to mark the line element, it is necessary to ensure that the two ends of the line are located on the edge of the element annotation box, and obtain the element annotation box line corresponding to the line element; to mark the frame element, it is necessary to ensure that the entire frame edge is within the element annotation box, and obtain the element annotation box frame corresponding to the frame element. The text information in the frame is such as Xxx, Aaa, Bbb.

[0072] Figure 4 The figure schematically shows a schematic diagram of process image recognition according to an embodiment of the present disclosure.

[0073] like Figure 4 As shown, the element annotation frames are screened according to the overlapping area between them, and the element annotation frames whose overlapping area exceeds the preset threshold are removed; the image detection model recognizes the element based on the position information of the two diagonal vertices (x1, y1) and (x2, y2) of the element annotation frame, and recognizes the frame; the image detection model recognizes the element based on the position information of the two diagonal vertices ( 1, 1) ( 2, 2) Perform element recognition and identify the frame; use the optical character recognition algorithm to identify the content and obtain the text information in the frame as Aaa and Ccc.

[0074] According to an embodiment of the present disclosure, the element annotation box includes a line annotation box, and the process image logic verification method also includes: based on a preset area size threshold, determining the vertex areas corresponding to the four vertices of the line annotation box; determining the minimum difference and the maximum difference based on the difference between the pixel color mean corresponding to the vertex areas of the four vertices and the pixel color mean of the line annotation box; determining the vertex corresponding to the minimum difference as the starting point of the line; and determining the vertex corresponding to the maximum difference as the end point of the line.

[0075] According to an embodiment of the present disclosure, the connection line annotation box is an element annotation box corresponding to the connection line element.

[0076] According to an embodiment of the present disclosure, the preset region size threshold may be 1 / 16, and determining the vertex regions corresponding to the four vertices of the line annotation box may include: forming a cube vertex region with a length of 1 / 16 and a width of 1 / 16 with each vertex as the center.

[0077] According to an embodiment of the present disclosure, the pixel color mean represents the regional image grayscale mean.

[0078] According to an embodiment of the present disclosure, the difference between the pixel color mean corresponding to the vertex area of ​​each of the four vertices and the pixel color mean of the connecting line annotation box is calculated to obtain four differences, and the minimum difference and the maximum difference are determined from the four differences.

[0079] According to an embodiment of the present disclosure, the vertex corresponding to the minimum difference is determined as the starting point of the connection line, and the vertex corresponding to the maximum difference is determined as the end point of the connection line.

[0080] According to an embodiment of the present disclosure, a target logic verification rule for a process image is determined based on preset requirement conditions, including: when the preset requirement conditions include text information design requirements, determining a text verification rule that matches the text information design requirements from multiple verification rules; when the preset requirement conditions include logical relationship design requirements, determining a logical relationship verification rule that matches the logical relationship design requirements from multiple verification rules; and determining a target logic verification rule based on at least one of the text verification rule and the logical relationship verification rule.

[0081] According to an embodiment of the present disclosure, the text information design requirement may be a design requirement for each function of a software product, such as a login requirement, a registration requirement, and the like.

[0082] According to an embodiment of the present disclosure, the text verification rule represents a verification rule designed for text information in a process image based on text information design requirements.

[0083] According to the embodiments of the present disclosure, the logical relationship design requirements may be logical relationship design requirements between various functions of a software product, business process logical relationship requirements, etc., for example, branching, parallelism, looping and other logical relationship requirements.

[0084] According to an embodiment of the present disclosure, the logic relationship verification rule represents a verification rule for the logic relationship design in the process image based on the logic relationship design requirement.

[0085] According to an embodiment of the present disclosure, a matching target logic verification rule is determined from a plurality of verification rules according to preset requirement conditions, and the target logic verification rule includes at least one of the following: a text verification rule and a logic relationship verification rule.

[0086] According to the embodiments of the present disclosure, matching text verification rules and logical relationship verification rules are flexibly determined from multiple verification rules according to the text information design requirements and logical relationship design requirements that change at any time, with high flexibility and versatility.

[0087] According to an embodiment of the present disclosure, the target logic verification rule includes a text verification rule, and the text verification rule includes at least one of the following: a text inclusion relationship rule, a repetition relationship rule, and a sequence relationship rule; wherein, based on the target logic verification rule, a logic verification is performed on the relationship tree to obtain a verification result of the process image, including: based on the text inclusion relationship rule, detecting the text information on the nodes in the relationship tree to obtain a text inclusion relationship verification result; based on the repetition relationship rule, detecting the number of nodes corresponding to the text information in the relationship tree to obtain a repetition relationship verification result; based on the sequence relationship rule, detecting the degree of association between the text information corresponding to the current node and the next node in the relationship tree to obtain a sequence relationship verification result; based on at least one of the text inclusion relationship verification result, the repetition relationship verification result and the sequence relationship verification result, determining the verification result of the process image.

[0088] According to an embodiment of the present disclosure, the text inclusion relationship rule defines a node on the relationship tree that includes the node corresponding to the target content.

[0089] According to an embodiment of the present disclosure, text information on a node in a relationship tree is detected based on a text inclusion relationship rule. When the text information contains the target content, a text inclusion relationship verification result that passes the representation verification is obtained; otherwise, a text inclusion relationship verification result that fails the representation verification is obtained.

[0090] According to an embodiment of the present disclosure, the repetition relationship rule defines that the number of occurrences of the node corresponding to the target content on the relationship tree is greater than 1.

[0091] According to an embodiment of the present disclosure, the number of nodes corresponding to text information in the relationship tree is detected based on the repeated relationship rule. When the number of nodes is greater than 1, a repeated relationship verification result is obtained that represents a passed verification, otherwise a repeated relationship verification result is obtained that represents a failed verification.

[0092] According to an embodiment of the present disclosure, the order of two nodes related to the target content on the relationship tree is defined in the order relationship rule.

[0093] According to an embodiment of the present disclosure, the text information of all nodes in the relationship tree is detected based on the sequential relationship rules, and two nodes are determined according to the degree of association between the text information. According to the structure of the relationship tree, when the current node is the previous node of the next node, a sequential relationship verification result that passes the representation verification is obtained, otherwise a sequential relationship verification result that fails the representation verification is obtained.

[0094] For example, the sequential relationship rule defines that before the registration node logs in, the text information of all nodes in the relationship tree is detected to determine the registration node and the login node. If the login node is a child node of the registration node in the relationship tree, a sequential relationship verification result indicating that the representation verification passes is obtained; otherwise, a sequential relationship verification result indicating that the representation verification fails is obtained.

[0095] According to an embodiment of the present disclosure, the verification result of the process image includes at least one of the following: a text inclusion relationship verification result, a repetition relationship verification result, and a sequence relationship verification result.

[0096] According to the embodiments of the present disclosure, the text inclusion relationship, repetition relationship, and sequence relationship are verified by detecting the text information of the nodes in the relationship tree, and the text verification rules are defined according to the changing user needs to flexibly verify the text logic.

[0097] According to an embodiment of the present disclosure, the target logic verification rule includes a logic relationship verification rule, and the logic relationship verification rule includes at least one of the following: a branch inclusion relationship rule, a branch parallel relationship rule, and a loop relationship rule; wherein, based on the target logic verification rule, the relationship tree is logically verified, and the verification result of the process image is obtained, which also includes: based on the branch inclusion relationship rule, the hierarchy of the target node in the relationship tree is detected to obtain the branch inclusion verification result; based on the branch parallel relationship rule, the hierarchy corresponding to each of the two associated nodes in the relationship tree is detected to obtain the branch parallel verification result; based on the loop relationship rule, the coordinate position of the local area image in the process image and the coordinate position of the node in the relationship tree in the process image are detected to obtain the loop relationship verification result, wherein the local area image includes an area image with a loop relationship frame and a connecting line; based on at least one of the branch inclusion verification result, the branch parallel verification result and the loop relationship verification result, the verification result of the process image is determined.

[0098] According to an embodiment of the present disclosure, the level of the starting node in the relationship tree is 1. If the next node has no branch, the level remains unchanged. If the next node has a branch, the level increases by 1.

[0099] According to an embodiment of the present disclosure, a branch inclusion relationship rule defines a node on a branch on a relationship tree.

[0100] According to an embodiment of the present disclosure, the target node is a node defined in the branch inclusion relationship rule. The child node is searched from the starting node, and when the target node is found, the level of the target node is detected. If the level of the target node is greater than 1, a branch inclusion verification result representing a passed verification is obtained, otherwise a branch inclusion verification result representing a failed verification is obtained.

[0101] According to an embodiment of the present disclosure, the branch parallel relationship rule defines two nodes on parallel branches on the relationship tree.

[0102] According to an embodiment of the present disclosure, the two associated nodes can be two nodes defined in the branch parallel relationship rule, and the child node is searched from the starting node. When the two associated nodes are found, the respective levels of the two associated nodes are detected. When the respective levels of the two nodes are equal, a branch parallel verification result that represents the verification passed is obtained, otherwise a branch parallel verification result that represents the verification failed is obtained.

[0103] According to an embodiment of the present disclosure, the circular relationship rule defines nodes in the circular process on the relationship tree.

[0104] According to the embodiments of the present disclosure, the process image can be identified by using an image detection model to determine a local area image having a cyclic relationship, where the local area image is an area image having a cyclic relationship between a frame and a connecting line.

[0105] According to an embodiment of the present disclosure, the coordinate position of the local area image and the coordinate position of the node in the relationship tree in the process image are detected. When the coordinate position of the node is located in the coordinate position of the local area image, a circular relationship verification result is obtained, which indicates that the characterization verification has passed. Otherwise, a circular relationship verification result is obtained, which indicates that the characterization verification has failed.

[0106] According to an embodiment of the present disclosure, the verification result of the process image further includes at least one of a branch inclusion verification result, a branch parallel verification result, and a loop relationship verification result.

[0107] According to an embodiment of the present disclosure, a logical relationship check is performed on a relationship tree by matching logical relationship check rules, node hierarchy settings in the relationship tree, and node coordinate positions, thereby achieving flexible check of logical relationships in a process image.

[0108] Based on the above process image logic verification method, the present disclosure also provides a process image logic verification device. Figure 5 The device is described in detail.

[0109] Figure 5 The structural block diagram of the process image logic verification device according to the embodiment of the present disclosure is schematically shown.

[0110] like Figure 5 As shown, the process image logic verification device 500 of this embodiment includes a determination module 510 , an identification module 520 , a generation module 530 and a verification module 540 .

[0111] The determination module 510 is used to determine the target logic verification rule for the process image based on the preset requirement conditions. In one embodiment, the determination module 510 can be used to perform the operation S210 described above, which will not be described in detail here.

[0112] The recognition module 520 is used to recognize the process image and obtain the connection relationship between the frames and the lines in the process image and the text information in each frame. In one embodiment, the recognition module 520 can be used to perform the operation S220 described above, which will not be described in detail here.

[0113] The generation module 530 is used to generate a relationship tree representing the association order between multiple frames based on the connection relationship, wherein the relationship tree includes nodes and edges, the nodes represent the frames and the text information in the frames, and the edges represent the connection relationship between the multiple frames. In one embodiment, the generation module 530 can be used to perform the operation S230 described above, which will not be repeated here.

[0114] The verification module 540 is used to perform a logic check on the relationship tree based on the target logic check rule to obtain a check result of the process image. In one embodiment, the verification module 540 can be used to perform the operation S240 described above, which will not be described in detail here.

[0115] According to an embodiment of the present disclosure, the identification module 520 includes a first identification submodule, a second identification submodule, a third identification submodule, and a fourth identification submodule.

[0116] The first recognition submodule is used to mark the elements in the process image to obtain the element marking box.

[0117] The second identification submodule is used to identify the element based on the vertex position information of the element annotation box to obtain the box body and the connection line.

[0118] The third recognition submodule is used to perform content recognition on the process image using an optical character recognition algorithm to obtain text information in each frame.

[0119] The fourth identification submodule is used to determine the connection relationship between the connection line and the frame according to the distance from the vertex of the connection line to the frame.

[0120] According to an embodiment of the present disclosure, the fourth identification submodule includes a first identification unit, a second identification unit, a third identification unit, a fourth identification unit, and a fourth identification unit.

[0121] The first recognition unit is used to determine a target edge associated with the starting point according to the distances from the starting point of the connection line to each of the multiple frames.

[0122] The second recognition unit is used to obtain a starting frame associated with the starting point according to a target edge associated with the starting point.

[0123] The third recognition unit is used to determine a target edge associated with the end point according to the distances from the end point of the connection line to each of the plurality of frames.

[0124] The fourth identification unit is used to obtain the terminal frame associated with the end point according to the target edge associated with the end point.

[0125] The fifth identification unit is used to determine the connection relationship between the connection line and the frame according to the starting frame, the connection line, and the terminal frame.

[0126] According to an embodiment of the present disclosure, the process image logic checking device 500 further includes a first processing module, a second processing module, a third processing module and a fourth processing module.

[0127] The first processing module is used to determine the vertex areas corresponding to the four vertices of the connection mark box respectively based on a preset area size threshold.

[0128] The second processing module is used to determine the minimum difference and the maximum difference according to the difference between the pixel color average corresponding to the vertex area of ​​each of the four vertices and the pixel color average of the connection line annotation box.

[0129] The third processing module is used to determine the vertex corresponding to the minimum difference as the starting point of the connection line.

[0130] The fourth processing module is used to determine the vertex corresponding to the maximum difference as the end point of the connection line.

[0131] According to an embodiment of the present disclosure, the determination module 510 includes a first determination submodule, a second determination submodule, and a third determination submodule.

[0132] The first determination submodule is used to determine a text verification rule that matches the text information design requirement from a plurality of verification rules when the preset requirement conditions include the text information design requirement.

[0133] The second determination submodule is used to determine a logic relationship verification rule that matches the logic relationship design requirement from multiple verification rules when the preset requirement conditions include the logic relationship design requirement.

[0134] The third determination submodule is used to determine the target logic verification rule based on at least one of the text verification rule and the logic relationship verification rule.

[0135] According to an embodiment of the present disclosure, the first determining submodule includes a first determining unit, a second determining unit, a third determining unit, and a fourth determining unit.

[0136] The first determination unit is used to detect text information on nodes in the relationship tree based on the text inclusion relationship rule to obtain a text inclusion relationship verification result.

[0137] The second determination unit is used to detect the number of nodes corresponding to the text information in the relationship tree based on the repeated relationship rule to obtain a repeated relationship verification result.

[0138] The third determination unit is used to detect the degree of association between the text information corresponding to the current node and the next node in the relationship tree based on the sequential relationship rule, and obtain the sequential relationship verification result.

[0139] The fourth determining unit is used to determine the verification result of the process image based on at least one of the text inclusion relationship verification result, the repetition relationship verification result and the sequence relationship verification result.

[0140] According to an embodiment of the present disclosure, the second determining submodule includes a fifth determining unit, a sixth determining unit, a seventh determining unit, and an eighth determining unit.

[0141] The fifth determination unit is used to detect the level of the target node in the relationship tree based on the branch inclusion relationship rule to obtain the branch inclusion verification result.

[0142] The sixth determination unit is used to detect the levels corresponding to the two associated nodes in the relationship tree based on the branch parallel relationship rule to obtain the branch parallel verification result.

[0143] The seventh determination unit is used to detect the coordinate position of the local area image in the process image and the coordinate position of the node in the relationship tree in the process image based on the circular relationship rule to obtain the circular relationship verification result, wherein the local area image includes the area image with the circular relationship frame and the connecting line.

[0144] The eighth determination unit is used to determine the verification result of the process image based on at least one of the branch inclusion verification result, the branch parallel verification result and the loop relationship verification result.

[0145] According to an embodiment of the present disclosure, any multiple modules of the determination module 510, the identification module 520, the generation module 530 and the verification module 540 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the determination module 510, the identification module 520, the generation module 530 and the verification module 540 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in any appropriate combination of any of them. Alternatively, at least one of the determination module 510, the identification module 520, the generation module 530 and the verification module 540 can be at least partially implemented as a computer program module, and when the computer program module is run, the corresponding function can be performed.

[0146] Figure 6 A block diagram of an electronic device suitable for implementing a process image logic verification method according to an embodiment of the present disclosure is schematically shown.

[0147] like Figure 6 As shown, the electronic device 600 according to an embodiment of the present disclosure includes a processor 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage part 608 to a random access memory (RAM) 603. The processor 601 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a dedicated microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 601 may also include an onboard memory for caching purposes. The processor 601 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0148] In RAM 603, various programs and data required for the operation of electronic device 600 are stored. Processor 601, ROM 602 and RAM 603 are connected to each other via bus 604. Processor 601 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 602 and / or RAM 603. It should be noted that the program can also be stored in one or more memories other than ROM 602 and RAM 603. Processor 601 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in one or more memories.

[0149] According to an embodiment of the present disclosure, the electronic device 600 may further include an input / output (I / O) interface 605, which is also connected to the bus 604. The electronic device 600 may further include one or more of the following components connected to the input / output (I / O) interface 605: an input portion 606 including a keyboard, a mouse, etc.; an output portion 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 608 including a hard disk, etc.; and a communication portion 609 including a network interface card such as a LAN card, a modem, etc. The communication portion 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the input / output (I / O) interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage portion 608 as needed.

[0150] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0151] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 602 and / or RAM 603 described above and / or one or more memories other than ROM 602 and RAM 603.

[0152] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the process image logic verification method provided by the embodiment of the present disclosure.

[0153] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 601. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0154] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 609, and / or installed from a removable medium 611. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0155] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 609, and / or installed from the removable medium 611. When the computer program is executed by the processor 601, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, apparatus, module, unit, etc. described above can be implemented by a computer program module.

[0156] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0157] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0158] It will be appreciated by those skilled in the art that the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations or combinations are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0159] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A process image logic verification method, characterized in that: The method comprises: Determine target logic verification rules for the process image based on preset requirement conditions; Identify the process image to obtain the connection relationship between the frames and the lines in the process image and the text information in each frame; Based on the connection relationship, a relationship tree representing the association order between the plurality of frames is generated, wherein the relationship tree includes nodes and edges, the nodes representing the frames and the text information in the frames, and the edges representing the connection relationship between the plurality of frames; Based on the target logic verification rule, the relationship tree is logically verified to obtain a verification result of the process image.

2. The method according to claim 1, characterized in that The process image is identified to obtain the connection relationship between the frames and the lines in the process image and the text information in each frame, including: Marking the elements in the process image to obtain an element marking frame; Based on the vertex position information of the element annotation box, the element is identified to obtain a box body and connecting lines; Using an optical character recognition algorithm to perform content recognition on the process image to obtain text information in each frame; A connection relationship between the connection line and the frame is determined according to the distance from the vertex of the connection line to the frame.

3. The method according to claim 2, characterized in that The vertices of the connecting line include a starting point and an end point; Wherein, determining the connection relationship between the connection line and the frame according to the distance from the vertex of the connection line to the frame includes: Determine a target edge associated with the starting point according to the distances from the starting point of the connection line to each of the plurality of frames; According to the target edge associated with the starting point, a starting frame associated with the starting point is obtained; Determine a target edge associated with the end point according to the distance from each of the end points of the connection line to the plurality of frames; According to the target edge associated with the end point, a terminal frame associated with the end point is obtained; According to the starting frame, the connection line, and the terminal frame, a connection relationship between the connection line and the frame is determined.

4. The method according to claim 3, characterized in that The element annotation box includes a line annotation box, and the method further includes: Based on a preset region size threshold, determining vertex regions corresponding to four vertices of the connection line annotation box respectively; Determine a minimum difference and a maximum difference according to the difference between the pixel color mean values ​​corresponding to the vertex areas of the four vertices and the pixel color mean value of the connection line annotation box; Determine the vertex corresponding to the minimum difference as the starting point of the connecting line; The vertex corresponding to the maximum difference is determined as the end point of the connecting line.

5. The method according to claim 1, characterized in that The step of determining a target logic verification rule for the process image based on a preset requirement condition includes: In the case where the preset requirement condition includes a text information design requirement, determining a text verification rule that matches the text information design requirement from a plurality of verification rules; In the case where the preset requirement condition includes a logical relationship design requirement, determining a logical relationship verification rule that matches the logical relationship design requirement from a plurality of verification rules; The target logic verification rule is determined based on at least one of the text verification rule and the logic relationship verification rule.

6. The method according to claim 5, characterized in that The target logic verification rule includes the text verification rule, and the text verification rule includes at least one of the following: a text inclusion relationship rule, a repetition relationship rule, and a sequence relationship rule; Wherein, based on the target logic verification rule, the relationship tree is logically verified to obtain the verification result of the process image, which includes: Based on the text inclusion relationship rule, detecting the text information on the nodes in the relationship tree to obtain a text inclusion relationship verification result; Based on the repeated relationship rule, detecting the number of nodes corresponding to the text information in the relationship tree to obtain a repeated relationship verification result; Based on the sequential relationship rule, detecting the degree of association between the text information corresponding to the current node and the next node in the relationship tree, and obtaining a sequential relationship verification result; The verification result of the process image is determined based on at least one of the text inclusion relationship verification result, the repetition relationship verification result and the sequence relationship verification result.

7. The method according to claim 5, characterized in that The target logic verification rule includes the logic relationship verification rule, and the logic relationship verification rule includes at least one of the following: a branch inclusion relationship rule, a branch parallel relationship rule, and a loop relationship rule; Wherein, based on the target logic verification rule, performing logic verification on the relationship tree to obtain the verification result of the process image also includes: Based on the branch inclusion relationship rule, detecting the level of the target node in the relationship tree to obtain a branch inclusion verification result; Based on the branch parallel relationship rule, detecting the levels corresponding to the two associated nodes in the relationship tree, and obtaining a branch parallel verification result; Based on the cyclic relationship rule, the coordinate position of the local area image in the process image and the coordinate position of the node in the relationship tree in the process image are detected to obtain a cyclic relationship verification result, wherein the local area image includes an area image with a cyclic relationship frame and a connecting line; The verification result of the process image is determined based on at least one of the branch inclusion verification result, the branch parallel verification result and the loop relationship verification result.

8. A process image logic verification device, characterized in that: The device comprises: A determination module, used to determine target logic verification rules for the process image based on preset requirement conditions; A recognition module, used to recognize the process image, obtain the connection relationship between the frames and the lines in the process image and the text information in each frame; A generating module, configured to generate a relationship tree representing the association order between the plurality of frames based on the connection relationship, wherein the relationship tree includes nodes and edges, the nodes representing the frames and the text information in the frames, and the edges representing the connection relationship between the plurality of frames; The verification module is used to perform a logic verification on the relationship tree based on the target logic verification rule to obtain a verification result of the process image.

9. An electronic device, comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

11. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images