Panoramic image verification method, device, equipment, and storage medium

Abstract

An embodiment of the present application discloses a method, apparatus, device and storage medium for verifying a panoramic image, wherein the method comprises: in response to receiving an instruction to save a panoramic image created on a front-end interactive interface, verifying the connection logic in the panoramic image; if the connection logic in the panoramic image passes the verification, saving the panoramic image; in response to receiving an instruction to run the panoramic image, obtaining the input-output relationship of the operating unit in the stored panoramic image; and verifying whether the panoramic image is a directed acyclic graph based on the input-output relationship of the operating unit in the panoramic image.

Description

Technical Field

[0001] The present application relates to the field of computer vision, and is related to, but not limited to, panoramic image verification methods, devices, equipment, and storage media. Background Art

[0002] Panorama provides a one-stop, interactive overview of computational and business flows, enabling collaboration between industry experts and artificial intelligence (AI) algorithm specialists. By interconnecting multiple data sets, training modules, and inference operators, it meets the AI ​​industry's demand for high-precision and complex computational flows. The Panorama consists of data nodes and operations (Operations), which flow through a directed acyclic graph (DAG).

[0003] When constructing a directed acyclic graph, it is necessary to automatically verify the connection relationship between data nodes and operation units to ensure the legitimacy of the directed acyclic graph. Summary of the Invention

[0004] The embodiments of the present application provide a panoramic image verification method and apparatus, equipment, storage medium, and program product.

[0005] The technical solution of the embodiment of the present application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a panoramic image verification method, comprising:

[0007] In response to receiving an instruction to save a panoramic image created on the front-end interactive interface, verifying a connection logic in the panoramic image;

[0008] If the connection logic check in the panoramic image passes, saving the panoramic image;

[0009] In response to receiving an instruction to run the panoramic map, obtaining an input-output relationship of an operating unit stored in the panoramic map;

[0010] According to the input-output relationship of the operation unit in the panoramic graph, it is verified whether the panoramic graph is a directed acyclic graph.

[0011] In some possible implementations, the method further includes: in the process of creating the panoramic map on the front-end interactive interface, verifying the basic connection rules between the operation units in the panoramic map and the data nodes related to the corresponding operation units; if the basic connection rules are verified, completing the creation of the panoramic map.

[0012] In this way, the correctness of basic connection rules can be detected in real time during the process of creating a panoramic image, which can avoid some basic erroneous operations and establish a more complete verification method.

[0013] In some possible implementations, the basic wiring rules include at least one of the following: repeated wiring, input data nodes cannot be connected to input data nodes, output data nodes cannot be connected to output data nodes, the data nodes can only be connected to the operation unit, and the output data nodes of the operation unit cannot be changed; the method also includes: in the event that the basic wiring rule verification fails, highlighting the incorrect connection and prompting the user the cause of the error.

[0014] In this way, when the basic connection rule verification fails, the incorrect connection is highlighted and the user is prompted with the cause of the error, thereby reducing the user's learning cost by giving incorrect operation prompts.

[0015] In some possible implementations, the method further includes: automatically deleting the erroneous connection after highlighting the erroneous connection for a predetermined period of time.

[0016] In this way, by regularly deleting erroneous connections, no connection lines are added for incorrect connections, thereby ensuring the correctness of the created panorama.

[0017] In some possible implementations, verifying the connection logic in the panoramic view includes: verifying whether the data node exists in the panoramic view or the operation unit is not connected; and / or verifying whether the resource configuration information of the data node in the panoramic view is complete; and / or verifying whether the connection relationship between the data node and the operation unit in the panoramic view is correct.

[0018] In this way, when clicking Save, the unconnected operation units or data nodes in the panoramic view, the resource configuration information of the data nodes, and the connection relationship between the data nodes and the operation units are verified, thereby ensuring the legitimacy of the connection of the panoramic view.

[0019] In some possible implementations, verifying whether the resource configuration information of the data node in the panoramic view is complete includes: when the data node is the input node of the operation unit, verifying whether the data node selects resources and resource versions; when the data node is the output node of the operation unit, verifying whether the data node selects resources.

[0020] In this way, the input nodes and output nodes of the operation unit are respectively checked to see whether their referenced resources are complete, thereby ensuring the correctness of the panoramic graph during operation.

[0021] In some possible implementations, the method further includes: highlighting erroneous data nodes or connections in the panoramic view and prompting a user the cause of the error when the connection logic in the panoramic view fails to pass verification; and resaving the panoramic view in response to the erroneous data nodes or connections in the panoramic view being modified correctly.

[0022] In this way, when the connection logic verification in the panoramic map fails, the error is highlighted and the user is prompted with the cause of the error, which makes it easier for the user to make modifications. On the one hand, it reduces the user's starting cost, and on the other hand, it ensures the accuracy of the directed acyclic graph corresponding to the final saved panoramic map.

[0023] In some possible implementations, in response to receiving an instruction to run the panoramic view, obtaining the input-output relationship of the operating units stored in the panoramic view includes: in response to receiving an instruction to run the panoramic view, parsing the data corresponding to the stored panoramic view; and based on the parsing result, taking the connection relationship between the operating units in the panoramic view as the input-output relationship of the operating units.

[0024] In this way, when you click to run the panorama, the backend parses the data corresponding to the stored panorama and converts the connection relationship between the operation units to determine whether the panorama is a directed acyclic graph, ensuring that the connection relationship between the operation units is reasonable and improving the efficiency of verification.

[0025] In some possible implementations, the method further includes: running the panoramic image when the panoramic image is verified to be a directed acyclic graph; or prompting a user that the panoramic image has failed to run when the panoramic image is verified to be not a directed acyclic graph.

[0026] In this way, when running the panorama, it is checked whether the panorama is a directed acyclic graph. If the check is passed, the operation is started; otherwise, the operation is terminated and the user is prompted with the reason for the failure, thereby reducing the error waiting time and realizing the rapid verification of the legitimacy of the panorama.

[0027] In a second aspect, an embodiment of the present application provides a panoramic image verification device, the device comprising a first verification module, a first storage module, an acquisition module, and a second verification module, wherein:

[0028] The first verification module is configured to verify the connection logic in the panoramic image created on the front-end interactive interface in response to receiving an instruction to save the panoramic image;

[0029] The first saving module is configured to save the panoramic image if the connection logic check in the panoramic image passes;

[0030] The acquisition module is configured to acquire the input-output relationship of the operation unit stored in the panoramic map in response to receiving an instruction to run the panoramic map;

[0031] The second verification module is used to verify whether the panoramic image is a directed acyclic graph based on the input and output relationship of the operation unit in the panoramic image.

[0032] In a third aspect, an embodiment of the present application provides an electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, the steps in the above-mentioned panoramic image verification method are implemented.

[0033] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which implements the steps in the above-mentioned panoramic image verification method when executed by a processor.

[0034] The beneficial effects of the technical solutions provided in the embodiments of the present application include at least:

[0035] In an embodiment of the present application, first, in response to receiving an instruction to save a panoramic image created on a front-end interactive interface, the connection logic in the panoramic image is verified; then, if the connection logic in the panoramic image passes the verification, the panoramic image is saved; then, in response to receiving an instruction to run the panoramic image, the input-output relationship of the operating unit in the stored panoramic image is obtained; finally, based on the input-output relationship of the operating unit in the panoramic image, it is verified whether the panoramic image is a directed acyclic graph; in this way, the connection logic in the panoramic image is verified by the front-end in the saving stage, and the directed acyclic verification is performed on the data corresponding to the stored panoramic image by the back-end in the running stage, thereby realizing rapid verification of the panoramic image and ensuring the correctness of the operation of the directed acyclic graph corresponding to the panoramic image. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present application. Those skilled in the art can also derive other drawings based on these drawings without inventive work, among which:

[0037] Figure 1 A schematic diagram of a flow chart of a panoramic image verification method provided in an embodiment of the present application;

[0038] Figure 2A A schematic diagram of a flow chart of a panoramic image verification method provided in an embodiment of the present application;

[0039] Figure 2BA schematic diagram of a basic wiring rule check error provided in an embodiment of the present application;

[0040] Figure 3A A schematic diagram of a flow chart of a panoramic image verification method provided in an embodiment of the present application;

[0041] Figure 3B A schematic diagram of a connection logic check error provided in an embodiment of the present application;

[0042] Figure 4 A schematic diagram of a flow chart of a panoramic image verification method provided in an embodiment of the present application;

[0043] Figure 5A A logical flow chart of a panoramic image verification method provided in an embodiment of the present application;

[0044] Figure 5B A flowchart of the verification process for creating a panoramic image provided by an embodiment of the present application;

[0045] Figure 5C A flowchart of the verification process of saving a panoramic image provided in an embodiment of the present application;

[0046] Figure 5D A flowchart of the verification process during the operation of the panoramic view provided in the embodiment of the present application;

[0047] Figure 6 A schematic diagram of the structure of a panoramic image verification device provided in an embodiment of the present application;

[0048] Figure 7 A hardware entity diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. The following examples are used to illustrate the present application, but are not intended to limit the scope of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0050] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0051] It should be pointed out that the terms "first\second\third" involved in the embodiments of the present application are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with the preset order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0052] It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as generally understood by those skilled in the art in the art to which the embodiments of the present application belong. It should also be understood that terms such as those defined in general dictionaries should be understood to have meanings consistent with their meanings in the context of the prior art, and will not be interpreted in an idealized or overly formal sense unless specifically defined as herein.

[0053] The solution provided in the embodiments of the present application relates to the field of deep learning technology. To facilitate understanding of the solution in the embodiments of the present application, the following briefly describes the terms involved in the related technology:

[0054] Artificial Intelligence (AI) refers to the theories, methods, techniques, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, to perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that seeks to understand the essence of intelligence and produce new intelligent machines that can respond in a manner similar to human intelligence. AI also encompasses the study of the design principles and implementation methods of various intelligent machines, enabling them to possess the capabilities of perception, reasoning, and decision-making.

[0055] Artificial intelligence technology is a comprehensive discipline covering a wide range of fields, encompassing both hardware and software technologies. Basic AI technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies primarily encompass computer vision, speech processing, natural language processing, and machine learning / deep learning. The embodiments of this application involve machine learning technology.

[0056] Machine learning (ML) is a multidisciplinary field that encompasses probability theory, statistics, approximation theory, convex analysis, and algorithmic complexity theory. It specifically studies how computers can simulate or implement human learning behaviors to acquire new knowledge or skills and reorganize existing knowledge structures to continuously improve their performance. Machine learning is at the core of artificial intelligence and the fundamental way to make computers intelligent. Its applications span all areas of AI. Machine learning and deep learning typically include techniques such as artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and self-learning.

[0057] In recent years, deep learning models have made breakthroughs in the field of computer vision, and the performance indicators of various basic tasks have significantly exceeded those of traditional algorithms. How to apply deep learning technology to real scenarios to bring value is a very important issue.

[0058] An embodiment of the present application provides a panoramic image verification method, which is applied to electronic devices. The electronic device is deployed with an end-to-end visualization model generation platform, embedded object detection, image classification and other common artificial intelligence model general training frameworks in the visual field. The electronic devices include but are not limited to mobile phones, laptops, tablet computers and handheld Internet devices, multimedia devices, streaming media devices, mobile Internet devices, wearable devices or other types of devices. The functions implemented by the method can be implemented by calling program codes through a processor in the electronic device. Of course, the program codes can be stored in a computer storage medium. It can be seen that the electronic device includes at least a processor and a storage medium. The processor can be used to process the process of generating distillation data, and the memory can be used to store the intermediate data required in the process of generating distillation data and the generated target distillation data.

[0059] Figure 1 A flow chart of a method for verifying a panoramic image provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the method comprises at least the following steps:

[0060] Step S110, in response to receiving an instruction to save the panoramic image created on the front-end interactive interface, verifying the connection logic in the panoramic image;

[0061] Here, when you click Save Panorama on the front end, the legitimacy of all connection logics in the panorama is checked to ensure the accuracy of subsequent panorama operations.

[0062] The Raw Graph is a complete solution for AI model generation, built by users on the canvas of the front-end interactive interface. It includes functions such as model training, evaluation, and inference logic chaining. The canvas is the section of the AI ​​training platform where users drag and drop different components to build the entire model production process.

[0063] The overview includes at least two operation units (OPs) and data nodes corresponding to each operation unit. Each operation unit is a virtualized node that encapsulates an algorithm module for the task to be processed; each data node is a virtualized node that encapsulates a data processing module for the task to be processed. The data processing module provides input data to one algorithm module or processes the output data of another algorithm module.

[0064] The pending task can be user-defined or retrieved from the backend. For example, if the pending task is a component defect identification task, the algorithm modules required to implement the pending task, namely the operation units, include image detection operation units and classification operation units; the corresponding data nodes are the specific data involved in the detection and classification processes.

[0065] In some embodiments, the connection logic in the panoramic view includes the legitimacy of the connection between the data nodes and the operation units in the panoramic view, for example, classified data nodes can only be connected to classified operation units, and for example, there should be no unconnected data nodes or operation units in the panoramic view; in other embodiments, the connection logic of the panoramic view includes whether the reference resources of the data nodes in the panoramic view are complete, for example, a data node must be configured with resources and resource versions as an input node in the panoramic view.

[0066] Step S120, if the connection logic check in the panoramic image passes, saving the panoramic image;

[0067] Here, the connection relationship between each operation unit and each data node in the panoramic view and whether the reference resources of the data node are complete are verified to obtain a first verification result; when the first verification result indicates that the connection logic verification in the panoramic view has passed, the panoramic view created on the front-end interactive interface is saved successfully.

[0068] Step S130, in response to receiving an instruction to run the panoramic map, obtaining a stored input-output relationship of an operating unit in the panoramic map;

[0069] Here, the input-output relationship of the operating units in the panoramic view is the connection relationship between the operating units.

[0070] Typically, the output of the previous operation unit in a panoramic diagram serves as the input for the next operation unit, and the final operation unit generates the processing result of the task to be processed. For example, a panoramic diagram includes at least an inspection operation unit and a classification operation unit, where the input-output relationship between the operation units is that the output of the inspection operation unit serves as the input of the classification operation unit.

[0071] After the panorama is successfully saved, in response to the front-end clicking to run the panorama, the back-end converts and analyzes the corresponding data of the stored panorama, and obtains the connection relationship between the various operation units in the panorama based on all the connections in the panorama.

[0072] Step S140 : Verifying whether the panoramic graph is a directed acyclic graph based on the input-output relationship of the operation units in the panoramic graph.

[0073] Here, according to the input-output relationship of the operation unit in the obtained panoramic image, a topology algorithm is used to verify whether the corresponding panoramic image is a directed acyclic graph.

[0074] It should be noted that when the panoramic graph is a directed acyclic graph, it means that all the operation units in the panoramic graph each complete a part of the entire task to be processed, and the operation units meet specific execution order constraints. Some operation units must start after other operation units have completed. In this way, it can be guaranteed that the task composed of all operation units can be successfully completed within the valid time.

[0075] In an embodiment of the present application, first, in response to receiving an instruction to save a panoramic image created on a front-end interactive interface, the connection logic in the panoramic image is verified; then, if the connection logic in the panoramic image passes the verification, the panoramic image is saved; then, in response to receiving an instruction to run the panoramic image, the input-output relationship of the operating unit in the stored panoramic image is obtained; finally, based on the input-output relationship of the operating unit in the panoramic image, it is verified whether the panoramic image is a directed acyclic graph; in this way, the connection logic in the panoramic image is verified by the front-end in the saving stage, and the directed acyclic verification is performed on the data corresponding to the stored panoramic image by the back-end in the running stage, thereby realizing rapid verification of the panoramic image and ensuring the correctness of the operation of the directed acyclic graph corresponding to the panoramic image.

[0076] Figure 2A A flow chart of a method for verifying a panoramic image provided in an embodiment of the present application is shown in FIG. Figure 2A As shown, the method comprises at least the following steps:

[0077] Step S210: in the process of creating the panoramic map on the front-end interactive interface, verifying the basic connection rules between the operation units in the panoramic map and the data nodes related to the corresponding operation units;

[0078] Here, when drawing panoramic lines on the front end, checking the basic connection rules can avoid some basic incorrect operations and reduce the user's getting started cost.

[0079] Among them, the process of creating a panoramic map can be: in response to receiving a pending deep learning task, i.e., a pending task, a canvas for constructing the entire model generation process is displayed on the front-end interactive interface of the model training platform; based on the pending task, the user creates at least one data node and at least one operation unit by dragging components on the canvas; each operation unit is connected to a data node having an input-output relationship with the corresponding operation unit to complete the creation of the panoramic map.

[0080] For example, when the task to be processed is a component defect identification task, the detection operation unit and the data nodes used by the detection operation unit are connected according to the data flow, and the classification operation unit and the data nodes used in the classification operation unit are connected according to the data flow. Finally, in the process of processing the task to be processed, the order of each operation unit is followed, and multiple operation units and multiple data nodes are connected together to form a panoramic view of the component defect identification task.

[0081] Step S220, when the basic connection rule verification passes, completing the creation of the panoramic image;

[0082] Here, the basic connection rules are pre-set verification rules for establishing connections. When drawing the connections of the panoramic image on the canvas of the front-end interactive page, the basic connection rules are automatically verified. At the same time, during the basic connection rule verification process, incorrect connections are not added. In this way, if the basic connection rule verification passes, the connections in the final panoramic image can be guaranteed to be correct.

[0083] In some embodiments, the basic wiring rules include at least one of the following: repeated wiring, input data nodes cannot be connected to input data nodes, output data nodes cannot be connected to output data nodes, the data nodes can only be connected to the operation units, and the output data nodes of the operation units cannot be changed.

[0084] In some embodiments, when the basic connection rule verification fails, the incorrect connection is highlighted and the user is prompted with the cause of the error. Thus, when the basic connection rule verification fails, the incorrect connection is highlighted and the user is prompted with the cause of the error, thereby reducing the user's learning cost by providing an error operation prompt.

[0085] In some embodiments, when there are repeated connections in the panoramic map drawing, a pop-up window prompts "Incorrect connection, repeated connection"; in some embodiments, when a data node or an operation unit is connected to itself, a pop-up window prompts "Incorrect connection, cannot connect to its own node"; in some embodiments, when a data node is not connected to an operation unit, such as Figure 2BAs shown, “Original Dataset_1” 21 and “Dataset_Image Classification_1” 22 are both data nodes and cannot be directly connected. Otherwise, they will be highlighted and a pop-up window will pop up saying “Incorrect connection, data nodes can only be connected to operation units” 23.

[0086] In some embodiments, when the output data nodes of the operating unit do not match, a pop-up window prompts "Incorrect connection, the output data node of the operating unit cannot be changed"; in some embodiments, when the input data node is connected to the input data node, or the output data node is connected to the output data node, a pop-up window prompts "Incorrect connection, please reconnect".

[0087] In some embodiments, after highlighting the incorrect connection and after a predetermined time interval, the incorrect connection is automatically deleted. Here, the predetermined time interval is an empirical value, for example, it can be set to two seconds. In this way, by regularly deleting the incorrect connection, the incorrect connection line is not added, ensuring the accuracy of the created panorama.

[0088] Step S230, in response to receiving an instruction to save the panoramic image created on the front-end interactive interface, verifying the connection logic in the panoramic image;

[0089] Step S240: If the connection logic check in the panoramic image passes, save the panoramic image;

[0090] Step S250, in response to receiving an instruction to run the panoramic map, obtaining the input-output relationship of the operation unit in the stored panoramic map;

[0091] Step S260 , verifying whether the panoramic graph is a directed acyclic graph based on the input-output relationship of the operation unit in the panoramic graph.

[0092] The implementation details of the above steps S230 to S260 are similar to the implementation details of the above steps S110 to S140, and the implementation details can refer to the corresponding descriptions above.

[0093] In the embodiment of the present application, firstly, by detecting whether the basic connection rules are correct in real time during the creation of the panoramic map, some basic erroneous operations can be avoided; then, when saving the created panoramic map, the connection logic in the panoramic map is automatically verified to ensure the legitimacy of the connection between the data nodes and the operation units; finally, when running the panoramic map, it is determined whether there is a directed acyclic loop to ensure that the connection relationship between the operation units is reasonable. In this way, by automatically verifying the connection relationship in the creation and saving stages of the panoramic map, and determining whether there is a directed acyclic loop in the running stage to determine the legitimacy of the entire map, a more complete verification method is established.

[0094] Figure 3AA flow chart of a method for verifying a panoramic image provided in an embodiment of the present application is shown in FIG. Figure 3A As shown, the method comprises at least the following steps:

[0095] Step S310, in response to receiving an instruction to save the panoramic image created on the front-end interactive interface, verifying the connection logic in the panoramic image;

[0096] Here, the connection logic in the panoramic view includes the legitimacy of the connection between the data nodes and the operation units in the panoramic view and whether the reference resources of the data nodes in the panoramic view are complete.

[0097] The validity of the connection between the data node and the operation unit includes the absence of separate unconnected data nodes and operation units, and also includes the connection relationship between the operation unit and the data node.

[0098] In some embodiments, a data node is the input of at least one operation unit; in some embodiments, a data node is the output of an operation unit; in some embodiments, a data node is both the output of the previous operation unit and the input of the next operation unit; in some embodiments, the type of the operation unit and the type of the data node with which it has an input-output relationship should be consistent, for example, an object detection data node can only be connected to an object detection operation unit, etc.

[0099] Among them, the reference resources of data nodes refer to the general term for text, pictures, models and other data used in the artificial intelligence model training platform.

[0100] For example, the data nodes used as input in the panoramic map constructed in the training scenario should be configured with resources such as labeled datasets and corresponding resource versions, and the data nodes used as output should be configured with resources such as models; the data nodes used as input in the panoramic map constructed in the inference scenario should be configured with trained models and corresponding resource versions, etc.

[0101] In some embodiments, the verification of the connection logic in the panoramic view includes: verifying whether the data node exists in the panoramic view or the operation unit is not connected; and / or verifying whether the resource configuration information of the data node in the panoramic view is complete; and / or verifying whether the connection relationship between the data node and the operation unit in the panoramic view is correct. Here, the resource configuration information is the name and resource version of the resource referenced by the data node. In this way, when clicking Save, the unconnected operation units or data nodes in the panoramic view, the resource configuration information of the data node, and the connection relationship between the data node and the operation unit are verified to ensure the legitimacy of the connection of the panoramic view.

[0102] In some embodiments, verifying the completeness of resource configuration information for the data node in the panoramic graph includes: if the data node is an input node of the operation unit, verifying whether the data node selects a resource and a resource version; if the data node is an output node of the operation unit, verifying whether the data node selects a resource. In this way, the completeness of the referenced resources of the input node and the output node of the operation unit are verified separately, ensuring the correctness of the panoramic graph during operation.

[0103] Step S320: If the connection logic in the panoramic map fails to pass the verification, highlight the erroneous data nodes or connections in the panoramic map and prompt the user the cause of the error;

[0104] Here, for connection logic verification in different situations, when the verification content fails, the error in the panoramic map, such as a data node or a certain connection section, can be highlighted, and the corresponding error cause can be quickly and friendly prompted. The prompt form includes but is not limited to pop-up windows, flashing lights, and voice broadcasts.

[0105] In some embodiments, if the input data node of a certain operation unit fails to be verified, a pop-up window may be displayed with a message “Incorrect connection, cannot run, please check the node and operation settings” and the operation unit and the connection between the operation unit and the corresponding input data node may be highlighted. Figure 3B As shown, since the type of the data node "dataset_object detection_1" 31 and the type of the operation unit "model training_object classification_1" 32 do not match, the data node 31 cannot be used as the input node of the operation unit 32, so the operation unit 32 and the connection 33 are highlighted.

[0106] In some embodiments, if there are unconnected data nodes in the panoramic view, a pop-up window may prompt "The node is not connected and cannot run, please check the connection settings" and the data node may be highlighted; in some embodiments, if the input data node of a certain operation unit does not select resources and resource versions, a pop-up window may prompt "The starting point node must specify the resource identifier and version identifier" and the input data node may be highlighted; in some embodiments, if the output data node of a certain operation unit does not specify the output resource, a pop-up window may prompt "The output node must specify the resource identifier and the output data node may be highlighted".

[0107] Step S330, in response to the incorrect data nodes or connections in the panoramic image being corrected, resaving the panoramic image;

[0108] Here, by highlighting the erroneous data nodes or connections and prompting the user with the cause of the error in a pop-up window, the user's learning cost can be reduced, the connection errors in the panorama can be quickly corrected, and the panorama with legal connections between data nodes and operation units can be saved.

[0109] Step S340: If the connection logic check in the panoramic image passes, save the panoramic image;

[0110] Step S350, in response to receiving an instruction to run the panoramic map, obtaining the stored input-output relationship of the operation unit in the panoramic map;

[0111] Step S360: Verify whether the panoramic graph is a directed acyclic graph based on the input-output relationship of the operation unit in the panoramic graph.

[0112] In the embodiment of the present application, all connection logic in the panoramic image is verified during the panoramic image saving process. If there is an error in the connection relationship between the operation unit and the data node, there are unconnected data nodes, or the resource configuration information of the data node is incorrect, the saving is stopped, the error is highlighted, and the user is prompted with the cause of the error, making it easier for the user to make corrections. This not only reduces the user's learning cost, but also ensures the correctness of the operation of the directed acyclic graph corresponding to the final saved panoramic image.

[0113] Figure 4 A flow chart of a method for verifying a panoramic image provided in an embodiment of the present application is shown in FIG. Figure 4 As shown, the method comprises at least the following steps:

[0114] Step S410, in response to receiving an instruction to save the panoramic image created on the front-end interactive interface, verifying the connection logic in the panoramic image;

[0115] Step S420: If the connection logic check in the panoramic image passes, save the panoramic image;

[0116] Step S430, in response to receiving the instruction to run the panoramic image, parsing the stored data corresponding to the panoramic image;

[0117] Here, when you click to run the panorama, the backend converts and analyzes the data corresponding to the stored panorama. In practice, based on the connections between data nodes and operation units in the panorama, the attributes of the data nodes related to each operation unit can be incorporated into the corresponding operation unit, thereby directly connecting the various operation units. In other words, the connection relationship between data nodes and operation units is converted into a connection relationship between the various operation units.

[0118] Step S440: Based on the analysis result, the connection relationship between the operation units in the panoramic image is used as the input and output relationship of the operation units;

[0119] Here, the connection relationship between the operation units in the parsed panoramic graph is used as the input-output relationship of the operation unit to determine whether the panoramic graph is a directed acyclic graph, thereby ensuring that the connection relationship between the operation units is reasonable and improving the efficiency of verification.

[0120] Step S450, verifying whether the panoramic graph is a directed acyclic graph based on the input-output relationship of the operation unit in the panoramic graph;

[0121] Here, the input-output relationship of the operating unit in the panoramic view is verified by a topological algorithm to obtain a second verification result; if the second verification result indicates that the verification is successful, step S460 is executed; if the second verification result indicates that the verification fails, step S470 is executed.

[0122] It should be noted that topological sorting algorithms are primarily used to solve the dependency resolution problem in directed graphs. For any directed acyclic graph, topological sorting yields a linear permutation of all the operation units. This linear permutation satisfies the following condition: for any two operation units u and v in the graph, if there is a directed edge from u to v, then u must appear before v in the linear permutation.

[0123] Step S460: When the panoramic image is verified to be a directed acyclic graph, running the panoramic image;

[0124] Here, when running the panorama, if the panorama is verified to be a directed acyclic graph, the panorama will be started directly.

[0125] Step S470: When it is verified that the panoramic image is not a directed acyclic graph, the user is prompted that the operation of the panoramic image has failed.

[0126] Here, when running the panorama, it is verified that the panorama is not a directed acyclic graph, the operation is terminated, and the user is prompted with the reason for the failure, thereby reducing the error waiting time and realizing the rapid verification of the legitimacy of the panorama.

[0127] The panoramic image verification method described above is described below with reference to a specific embodiment. However, it should be noted that this specific embodiment is only for better illustrating the present application and does not constitute an improper limitation on the present application.

[0128] Compared with most products on the market that only check whether there is a directed acyclic graph when constructing it, the verification scheme proposed in the embodiment of the present application at least includes the front-end verification of the legitimacy of the connection when the panoramic graph is saved and the back-end verification of whether there is a directed acyclic graph. It quickly and friendly presents the reason for the operation failure to the user, reducing the waiting time for errors.

[0129] When constructing a directed acyclic graph, the connections need to be automatically verified to ensure the legitimacy of the directed acyclic graph; the verification includes at least two parts: when the front-end clicks to save the panorama, the legitimacy of the connection between the operation unit and the data node is verified; if the verification fails, a corresponding error prompt will be returned to facilitate the user to make modifications, which to a certain extent reduces the user's starting cost and ensures the accuracy of the directed acyclic graph operation; the back-end converts and analyzes the acyclic graph data, first obtains the input and output relationship of the operation based on the connection, and then verifies whether there is a directed acyclic graph based on the input and output relationship. If the verification fails, the user will be prompted that the panorama is illegal, and the panorama will start running after the verification passes.

[0130] Figure 5A The logical flow chart of the panoramic image verification method provided in the embodiment of the present application is as follows: Figure 5A As shown, the method comprises at least the following steps:

[0131] Step S510, automatically checking basic connection rules during the process of creating the panoramic image;

[0132] like Figure 5B As shown, the verification process includes the following steps: step S511, click the data node or operation unit anchor connection; step S512, verify the basic connection rules; step S513, determine whether the verification is passed; if the verification is passed, execute step S514, and establish the connection between the data node and the operation unit; otherwise, execute step S515, highlight the wrong connection and automatically delete it, and prompt an error message.

[0133] In step S512, basic connection rules such as whether there are repeated connections, whether input data nodes are connected to input data nodes, and whether output data nodes are connected to output data nodes are checked.

[0134] During the verification process, if there are repeated connections, input data nodes connecting to input data nodes, output data nodes connecting to output data nodes, or changes to operations with output data nodes, the incorrect connections will be highlighted and a prompt will be given. After two seconds, the corresponding incorrect connections will be automatically deleted.

[0135] When editing and drawing a directed acyclic graph, the embodiment of the present application avoids some basic incorrect operations by automatically checking when establishing connection relationships, and gives the user a prompt for incorrect operation. The embodiment of the present application effectively avoids the problem that the related technology does not have error prompts when drawing the connection of the panoramic graph, displays simple input and output connectable anchor points in a highlighted form, and does not check the connection logic between the data nodes and the operation units in the panoramic graph, which will cause failure during operation.

[0136] Step S520: Verify the connection logic in the panoramic image during the process of saving the panoramic image;

[0137] like Figure 5C As shown, the verification process includes the following steps: step S521, click the Save button; step S522, verify the connection logic in the panoramic view; step S523, determine whether the verification is passed; if the verification is passed, execute step S524, save successfully; otherwise, execute step S525, a pop-up window prompts the cause of the error, and highlights the erroneous data node; step S526, modify and save again.

[0138] In step S522, the front end verifies the legitimacy of the connection between the panoramic image operation unit and the data node, as well as whether the referenced resources of the data node are complete, such as whether the individual data nodes have no connection relationship, the input data node has no specified resources, and the image classification data node is connected to the object detection operation unit.

[0139] During the verification process, if there is an error in the output node type, an unconnected data node, or incorrect resource configuration information for the input data node, the save operation will be stopped, the connection will be highlighted, and an error prompt will be given.

[0140] Step S530 : During the operation of the panoramic image, it is determined whether the panoramic image is a directed acyclic graph.

[0141] like Figure 5D As shown, the process includes the following steps: step S531, click the run button; step S532, convert the connection relationship between the operating units in the panoramic view; step S533, use topological sorting to determine whether there is a directed acyclic graph; if the determination result is yes, execute step S534 to run the panoramic view; otherwise, execute step S535 to prompt the user that the panoramic view has failed to run.

[0142] Here, when the front-end clicks to run the panorama, the back-end converts the panorama's stored data and obtains the connection relationship between the operation units, that is, the input and output relationship of the operation units, to determine whether the panorama is a directed acyclic graph. If the verification passes, the panorama starts running; if the verification fails, an error is thrown and the operation is terminated. This allows the input and output relationship of the operation units to be obtained in real time and determine whether there is a directed acyclic graph, ensuring the reasonable connection relationship between the operation units. This avoids the disadvantage of converting the connection relationship before actually running the panorama and then using a topology algorithm to determine whether there is a directed acyclic graph, which leads to inefficient verification.

[0143] In related technologies, the validity check of panoramic images is mainly carried out by judging whether there is a directed acyclic loop, and the verification of connection relationships is less frequent. The embodiment of the present application mainly separates the verification of panoramic images into connection logic verification and directed acyclic loop verification, automatically verifies the connection rules and connection logic for drawing panoramic images, and at the same time determines whether there is a directed acyclic loop to determine the validity of the entire image, thereby realizing fast and automatic verification.

[0144] Compared with the previous simple verification methods such as establishing connection relationships by dragging and dropping and highlighting connectable points during the process of creating a panoramic view, the embodiment of the present application has established a more complete relationship verification method; on the one hand, the basic connection rules are verified when editing the panoramic view; on the other hand, when clicking Save, the connection relationship between the data nodes and operation units in the panoramic view, as well as whether the resource information of the data nodes is selected, are verified, which not only reduces the user's starting cost, but also ensures the accuracy of the operation of the directed acyclic graph; on the other hand, when clicking Run, it determines whether there is a directed acyclic graph to ensure the legitimacy of the connection relationship.

[0145] Based on the foregoing embodiments, an embodiment of the present application further provides a panoramic image verification device, which includes the modules included, and the sub-modules and units included in each module, and can be implemented by a processor in an electronic device; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0146] Figure 6 A schematic diagram of the structure of a panoramic image verification device provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, the apparatus 600 includes a first verification module 610, a first storage module 620, an acquisition module 630, and a second verification module 640, wherein:

[0147] The first verification module 610 is configured to verify the connection logic in the panoramic image created on the front-end interactive interface in response to receiving an instruction to save the panoramic image;

[0148] The first saving module 620 is configured to save the panoramic image if the connection logic check in the panoramic image passes;

[0149] The acquisition module 630 is configured to acquire the input-output relationship of the operation unit stored in the panoramic map in response to receiving an instruction to run the panoramic map;

[0150] The second verification module 640 is configured to verify whether the panoramic image is a directed acyclic graph according to the input-output relationship of the operation unit in the panoramic image.

[0151] In some possible embodiments, the device also includes a third verification module for verifying the basic connection rules between the operation units and the data nodes related to the corresponding operation units in the panoramic image during the process of creating the panoramic image on the front-end interactive interface; and a creation module for completing the creation of the panoramic image if the basic connection rules are verified.

[0152] In some possible embodiments, the basic connection rules include at least one of the following: repeated connections, input data nodes cannot be connected to input data nodes, output data nodes cannot be connected to output data nodes, the data nodes can only be connected to the operation units, and the output data nodes of the operation units themselves cannot be changed; the device also includes a first prompt module, which is used to highlight the incorrect connection and prompt the user the cause of the error when the basic connection rule verification fails.

[0153] In some possible embodiments, the first prompt module is further configured to automatically delete the erroneous connection after highlighting the erroneous connection for a predetermined period of time.

[0154] In some possible embodiments, the first verification module includes a first verification submodule, used to verify whether the data node exists in the panoramic view or the operation unit is not connected; and / or, a second verification submodule, used to verify whether the resource configuration information of the data node in the panoramic view is complete, and / or, a third verification submodule, used to verify whether the connection relationship between the data node and the operation unit in the panoramic view is correct.

[0155] In some possible embodiments, the second verification submodule includes a first verification unit for verifying whether the data node selects resources and resource versions when the data node is an input node of the operation unit; and a second verification unit for verifying whether the data node selects resources when the data node is an output node of the operation unit.

[0156] In some possible embodiments, the device also includes a second prompt module for highlighting erroneous data nodes or connections in the panoramic view and prompting the user of the cause of the error when the connection logic in the panoramic view has not been verified; and a second saving module for resaving the panoramic view in response to the erroneous data nodes or connections in the panoramic view being modified correctly.

[0157] In some possible embodiments, the acquisition module 630 includes a parsing submodule for parsing the stored data corresponding to the panoramic image in response to receiving an instruction to run the panoramic image; and a determination submodule for using the connection relationship between the operating units in the panoramic image as the input and output relationship of the operating units based on the parsing result.

[0158] In some possible embodiments, the device further includes a running module for running the panoramic image when the panoramic image is verified to be a directed acyclic graph; and a third prompting module for prompting a user that the panoramic image has failed to run when the panoramic image is verified not to be a directed acyclic graph.

[0159] It should be noted that the description of the above device embodiment is similar to the description of the above method embodiment and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of this application, please refer to the description of the method embodiment of this application for understanding.

[0160] It should be noted that, in the embodiment of the present application, if the above-mentioned panoramic image verification method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can be essentially or partially reflected in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium and includes several instructions for enabling an electronic device (which can be a smart phone with a camera, a tablet computer, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any preset combination of hardware and software.

[0161] Correspondingly, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the panoramic image verification method described in any of the above embodiments. Correspondingly, an embodiment of the present application also provides a chip, which includes a programmable logic circuit and / or program instructions, which, when running, is used to implement the steps of the panoramic image verification method described in any of the above embodiments. Correspondingly, an embodiment of the present application also provides a computer program product, which, when executed by a processor of an electronic device, is used to implement the steps of the panoramic image verification method described in any of the above embodiments.

[0162] Based on the same technical concept, an embodiment of the present application provides an electronic device for implementing the panoramic image verification method described in the above method embodiment. Figure 7 A hardware entity diagram of an electronic device provided in an embodiment of the present application is shown as follows: Figure 7 As shown, the electronic device 700 includes a memory 710 and a processor 720, and the memory 710 stores a computer program that can be run on the processor 720. When the processor 720 executes the program, the steps in the panoramic image verification method of any embodiment of the present application are implemented.

[0163] The memory 710 is configured to store instructions and applications executable by the processor 720, and can also cache data to be processed or processed by the processor 720 and various modules in the electronic device (for example, image data, audio data, voice communication data, and video communication data), which can be implemented through flash memory (FLASH) or random access memory (RAM).

[0164] When the processor 720 executes the program, the steps of any of the above-mentioned panoramic image verification methods are implemented. The processor 720 generally controls the overall operation of the electronic device 700.

[0165] The processor may be at least one of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, and a microprocessor. It is understood that the electronic device that implements the functions of the processor may also be other electronic devices, which are not specifically limited in the embodiments of the present application.

[0166] The above-mentioned computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); it can also be various electronic devices that include one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0167] It should be noted that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0168] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these preset features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0169] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0170] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms. The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment scheme of this application.

[0171] In addition, all functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the above-mentioned integrated units can be implemented in the form of hardware or in the form of hardware plus software functional units.

[0172] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can be embodied in the form of a software product in essence or in other words, the part that contributes to the relevant technology. The computer software product is stored in a storage medium and includes a number of instructions for enabling the automatic test line of the device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks or optical disks. The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments. The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0173] The above is merely an embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for verifying a panoramic image, characterized in that: The method comprises: In response to receiving an instruction to save a panoramic map created on a front-end interactive interface, the front-end verifies the connection logic in the panoramic map; the connection logic includes the legitimacy of the connection between the data nodes and the operation units in the panoramic map and whether the reference resources of the data nodes in the panoramic map are complete; If the connection logic check in the panoramic image passes, saving the panoramic image; In response to receiving an instruction to run the panoramic map, the backend parses the stored data corresponding to the panoramic map; based on the parsing result, the connection relationship between the operation units in the panoramic map is used as the input and output relationship of the operation units; According to the input-output relationship of the operation units in the panoramic graph, a topology algorithm is used to verify whether the panoramic graph is a directed acyclic graph.

2. The method according to claim 1, wherein The method further comprises: During the process of creating the panoramic map on the front-end interactive interface, verifying basic connection rules between the operation units in the panoramic map and data nodes related to the corresponding operation units; When the basic connection rule verification is passed, the creation of the panoramic image is completed.

3. The method according to claim 2, wherein The basic connection rules include at least one of the following: repeated connection, input data nodes cannot be connected to input data nodes, output data nodes cannot be connected to output data nodes, the data nodes can only be connected to the operation units, and the output data nodes of the operation units themselves cannot be changed; The method further comprises: In the case where the basic connection rule verification fails, the incorrect connection is highlighted and the user is prompted with the cause of the error.

4. The method according to claim 3, wherein The method further comprises: After highlighting the erroneous connection and pausing for a predetermined period of time, the erroneous connection is automatically deleted.

5. The method according to any one of claims 2 to 4, characterized in that The front end verifies the connection logic in the panoramic view, including: Checking whether the data node exists in the panoramic view or the operation unit is not connected; and / or, Verify whether the resource configuration information of the data node in the panoramic view is complete; and / or, Verify whether the connection relationship between the data nodes and the operation units in the panoramic view is correct.

6. The method according to claim 5, wherein Verifying whether the resource configuration information of the data node in the panoramic view is complete includes: In the case where the data node is an input node of the operation unit, verifying whether the data node selects a resource and a resource version; In a case where the data node is an output node of the operation unit, it is checked whether the data node selects a resource.

7. The method according to any one of claims 1 to 4, characterized in that The method further comprises: If the connection logic in the panoramic map fails to pass the verification, the erroneous data nodes or connections in the panoramic map are highlighted and the user is prompted with the cause of the error; In response to incorrect data nodes or connections in the panoramic image being modified to be correct, the panoramic image is resaved.

8. The method according to any one of claims 1 to 4, characterized in that The method further comprises: When verifying that the panoramic graph is a directed acyclic graph, running the panoramic graph; or When it is verified that the panoramic image is not a directed acyclic graph, the user is prompted that the operation of the panoramic image fails.

9. A panoramic image verification device, characterized in that: The device includes a first verification module, a first storage module, an acquisition module, and a second verification module, wherein: The first verification module is configured to verify, in response to receiving an instruction to save a panoramic image created on a front-end interactive interface, the connection logic in the panoramic image; the connection logic includes the legitimacy of the connection between the data nodes and the operation units in the panoramic image and whether the referenced resources of the data nodes in the panoramic image are complete; The first saving module is configured to save the panoramic image if the connection logic check in the panoramic image passes; The acquisition module is configured to, in response to receiving an instruction to run the panoramic map, parse the stored data corresponding to the panoramic map at the back end; based on the parsing result, use the connection relationship between the operation units in the panoramic map as the input and output relationship of the operation units; The second verification module is used to verify whether the panoramic image is a directed acyclic graph through a topological algorithm according to the input-output relationship of the operation unit in the panoramic image.

10. An electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, wherein: When the processor executes the program, the steps of the method according to any one of claims 1 to 8 are implemented.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

Images