Industrial visual inspection modular control method and related equipment

Abstract

The invention provides an industrial vision detection modular control method and related equipment, and relates to the technical field of industrial vision. The method comprises the following steps: collecting a product image of a product, and displaying the product image in a product sampling area; in response to selection and dragging operation on the current detection module, the current detection module is copied from the detection module library into the detection process frame, and the current detection module is any one detection module in the detection module library; after the current detection module is copied to the detection process frame, displaying a detection area and a detection target of the current detection module in a product sampling area; responding to the execution instruction, according to the arrangement sequence of the detection modules in the detection process frame, sequentially executing the detection programs corresponding to the detection modules, and detecting the product image; and when the detection program is executed, a detection result value of the detection module is displayed in the data reading column, so that the debugging efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of industrial vision technology, and in particular to an industrial vision detection modular control method and related equipment. Background Art

[0002] With the continuous improvement of industrial automation, product quality inspection plays an increasingly important role in the production process. Traditional manual inspection methods can no longer meet the requirements of modern industrial production for efficiency and precision. In this context, industrial visual inspection technology has emerged. It uses precise sampling of visual cameras and combines advanced image processing technology to achieve fast and accurate measurement of product appearance and size.

[0003] At present, the visual inspection system in industrial equipment usually adopts the following implementation method: First, the visual camera is installed at the designated location on the production line. During the product production operation stage, professional operators debug and run the image processing program on site. Operators write and modify image processing algorithms on computers according to production requirements and product characteristics. These algorithms usually include functional modules such as image preprocessing, feature extraction, and dimension measurement. During the debugging process, operators need to repeatedly modify parameters and test program effects until the inspection results meet production requirements.

[0004] With the increase in product types and the rapid switching of production lines, the relevant visual inspection systems have shown some limitations in practical applications. Since the inspection requirements of each product may be different, operators need to frequently debug and modify the program on site. This debugging process is often time-consuming, and sometimes even takes hours or days to complete a system optimization. In addition, since program debugging requires professional knowledge, it is difficult for front-line operators to complete it independently, and they often need to rely on the support of technicians. This not only increases labor costs, but may also cause production lines to stagnate and affect overall production efficiency. At the same time, frequent on-site debugging also increases the risk of program errors, which may affect the accuracy and consistency of the inspection results. In summary, the debugging efficiency of the relevant visual inspection system is low. Summary of the invention

[0005] The present application provides an industrial visual inspection modular control method and related equipment for improving debugging efficiency.

[0006] In the first aspect, the present application provides a modular control method for industrial visual inspection, including: acquiring a product image of a product and displaying the product image in a product sampling area; in response to the selection and dragging operation of the current inspection module, copying the current inspection module from the inspection module library to the inspection process box, the current inspection module being any inspection module in the inspection module library; after the current inspection module is copied to the inspection process box, displaying the inspection area and inspection target of the current inspection module in the product sampling area; in response to an execution instruction, executing the inspection program corresponding to the inspection module in sequence according to the arrangement order of the inspection modules in the inspection process box to inspect the product image; when the inspection program is executed, the inspection result value of the implemented inspection module is displayed in the data reading column.

[0007] By adopting the above technical solution, by collecting product images and displaying them in the product sampling area, an intuitive visual reference is provided for subsequent inspection. The design of the inspection module library enables various inspection methods to be modularized, greatly increasing the flexibility of the system. Operators can add the required inspection modules to the inspection process box by simple selection and dragging operations. This intuitive operation method lowers the threshold for using the system. The order of module arrangement in the inspection process box determines the execution order of the inspection program. This visual process design makes the entire inspection process clearer and easier to understand. When the inspection program is executed, the data reading bar displays the inspection result value in real time, which is convenient for operators to grasp the inspection situation in time. In short, through this modular and visual design, the flexibility and ease of use of the inspection system are greatly improved, and the inspection efficiency is significantly improved. Operators do not need to frequently perform complex program debugging. They can quickly establish and adjust the inspection system with simple drag and drop operations, which not only saves time, but also reduces the requirements for the operator's professional knowledge, thereby reducing labor costs and improving the overall efficiency of the production line.

[0008] In combination with some embodiments of the first aspect, in some embodiments, in response to an execution instruction, the detection program corresponding to the detection module is executed in sequence according to the arrangement order of the detection modules in the detection process box, and after the step of detecting the product image, the method also includes: when the detection program is executed, in response to the selection and drag operation of adding a detection module, the current detection module is copied from the detection module library to the detection process box, and the added detection module is any detection module in the detection module library; it is determined whether the position of the added detection module in the detection process box is before the detection module that is performing the detection; if it is before the detection module that is performing the detection, preprocessing of the added detection module is performed in parallel during the execution of the detection module that is performing the detection; after the detection program of the detection module that is performing the detection is executed, it is determined whether the preprocessing of the added detection module is Whether the processing is ready; if the preprocessing of the added detection module is ready, the detection sequence specified in the detection flow box is interrupted, and the detection program corresponding to the added detection module is executed to detect the product image; after the detection program corresponding to the added detection module is executed, the detection sequence specified in the detection flow box is restored; if the preprocessing of the added detection module is not ready, the detection program corresponding to the subsequent detection module is executed to detect the product image, and the subsequent detection module is the next detection module of the detection module that is performing detection in the detection flow box; if it is located after the detection module that is performing detection, update the arrangement order of the detection modules in the detection flow box; after the detection program of the detection module that is performing detection is executed, the detection programs corresponding to the detection modules are executed in sequence according to the updated arrangement order to detect the product image.

[0009] By adopting the above technical solution, it is allowed to dynamically add detection modules during the execution of the detection program, which greatly improves the flexibility of the system. By judging the position of the newly added detection module, the system can intelligently decide how to handle the newly added module. For new modules added before the current execution module, the system will perform preprocessing in parallel. This parallel processing mechanism improves the overall detection efficiency. The system will dynamically adjust the execution order according to the preprocessing status of the newly added module to ensure the continuity and efficiency of the detection process. For new modules added after the current execution module, the system will update the arrangement order and execute it at the appropriate time to ensure the integrity of the detection process. In short, the detection system can adapt to changes in detection requirements in real time and can be adjusted without stopping the entire detection process. This not only improves the flexibility of the system, but also greatly reduces the downtime caused by changes in demand, thereby significantly improving the overall efficiency and adaptability of the production line.

[0010] In combination with some embodiments of the first aspect, in some embodiments, in response to an execution instruction, the detection programs corresponding to the detection modules are executed in sequence according to the arrangement order of the detection modules in the detection process box, and after the step of detecting the product image, the method also includes: when the detection program is executed, in response to the selection and drag operation of reducing the detection module, the reduced detection module is removed from the detection process box, and the reduced detection module is any detection module in the detection process box; determining whether the position of the reduced detection module in the detection process box is before the detection module that is performing the detection, the detection module that is performing the detection itself, or after the detection module that is performing the detection; if it is before the detection module that is performing the detection, then reducing the detection module from the detection process box, and removing the detection result value of the reduced detection module in the data reading column; if it is the detection module itself that is performing the detection , then determine whether the preprocessing of the subsequent detection module is ready, and the subsequent detection module is the next detection module of the detection module that is executing detection in the detection flow box; if the preprocessing of the subsequent detection module is ready, then interrupt the detection sequence specified in the detection flow box, execute the detection program corresponding to the subsequent detection module, and detect the product image; if the preprocessing of the subsequent detection module is not ready, wait until the preprocessing of the subsequent detection module is ready, interrupt the detection sequence specified in the detection flow box, execute the detection program corresponding to the subsequent detection module, and detect the product image; if it is located after the detection module that is executing detection, update the arrangement order of the detection modules in the detection flow box; after the detection program of the detection module that is executing detection is executed, execute the detection program corresponding to the detection module in sequence according to the updated arrangement order to detect the product image.

[0011] By adopting the above technical solution, the detection module can be dynamically removed during the execution of the detection program, further enhancing the flexibility of the system. The system will adopt different processing strategies according to the position of the removed module to ensure the continuity of the detection process. For the module removed before the current execution module, the system will immediately update the detection process and data display to avoid unnecessary waste of resources. When removing the module being executed, the system will intelligently judge the readiness status of the subsequent module and switch to the next ready module in time to minimize the interruption time. For the module removed after the current execution module, the system will update the arrangement order to ensure the correctness of subsequent detection. In short, it can respond quickly to changes in detection requirements and make adjustments without stopping the entire detection process. This not only improves the flexibility and efficiency of the system, but also minimizes the time loss caused by adjustments while ensuring the quality of detection, thereby significantly improving the overall efficiency and adaptability of the production line.

[0012] In combination with some embodiments of the first aspect, in some embodiments, when the detection program is executed, after the step of displaying the detection result value of the detection module in the data reading column, the method also includes: marking suspicious results in the data reading column, the suspicious results being results in which the detection result value is inconsistent with a preset rule; in response to an in-depth inspection instruction for the suspicious results, displaying the original product image related to the result in the product sampling area, and marking the corresponding detection area and detection target; displaying the parameter adjustment interface of the corresponding detection module; in response to the parameter adjustment instruction, pausing the detection program of the detection module that is executing the detection, and re-executing the detection program of the corresponding detection module using new parameters; and displaying the suspicious results and the re-detection results in the data reading column at the same time.

[0013] By adopting the above technical solution, the test results can be displayed in real time in the data reading column, providing intuitive data feedback. By comparing with the preset rules, the system can automatically mark suspicious results, which greatly improves the efficiency of abnormal detection. The operator can conduct an in-depth inspection of the suspicious results, and the system will display the original product image and mark the relevant areas, which helps to quickly locate the problem. The system provides a parameter adjustment interface for the detection module, allowing operators to make instant adjustments based on actual conditions. After the parameters are adjusted, the system will pause the current detection, re-execute the detection with the new parameters, and display the original and new results at the same time for easy comparison and analysis. In short, operators can quickly identify and handle abnormal situations based on real-time feedback without stopping the entire detection process. This not only improves the accuracy of detection, but also significantly improves the response speed and flexibility of the system, thereby effectively reducing misjudgments and missed judgments, and improving the overall detection quality and efficiency.

[0014] In combination with some embodiments of the first aspect, in some embodiments, in response to the selection and dragging operation of the current detection module, the current detection module is copied from the detection module library to the detection process box, and after the step of the current detection module being any detection module in the detection module library, the method also includes: generating optimization suggestions for the detection process box based on association rules of preset detection modules; and in response to the user's confirmation instructions, adjusting the detection modules in the detection process box according to the optimization suggestions.

[0015] By adopting the above technical solution, the system can automatically generate optimization suggestions for the detection process box based on the preset detection module association rules. Users can quickly adjust the arrangement of detection modules in the detection process box according to the suggestions generated by the system. It can not only help novice users quickly build a reasonable detection process, but also provide optimization references for experienced operators, thereby significantly improving the overall performance and reliability of the detection system. At the same time, this mechanism also reduces the possibility of human error and further improves the accuracy and efficiency of detection.

[0016] In combination with some embodiments of the first aspect, in some embodiments, after the step of collecting a product image of a product and displaying the product image in a product sampling area, the method further includes: obtaining an arrangement order of detection modules from a database according to the product type of the product; and adjusting the detection modules in the detection process box according to the arrangement order in response to a user's confirmation instruction.

[0017] By adopting the above technical solution, the system can automatically obtain the corresponding inspection module arrangement order from the database according to the product type. Users can quickly adjust the inspection process box according to the arrangement order recommended by the system, saving a lot of manual configuration time. Through this intelligent inspection process customization mechanism, the system can quickly adapt to the inspection requirements of different products. The configuration time of the inspection system is reduced. For production lines that need to frequently switch product types, this mechanism can greatly improve production efficiency and reduce quality problems caused by configuration errors, thereby improving overall production quality and efficiency.

[0018] In combination with some embodiments of the first aspect, in some embodiments, in response to the selection and dragging operation of the current detection module, the current detection module is copied from the detection module library to the detection process box, and after the step of the current detection module being any detection module in the detection module library, the method also includes: detecting whether the current detection module is the latest version; if not, displaying a prompt message prompting the user to update the outdated version.

[0019] By adopting the above technical solution, the system can automatically detect whether the currently used detection module is the latest version. For modules that are not the latest version, the system will display a prompt message to remind the user to update. The module is always set to the last modified template to avoid the problem of mistakenly thinking that a modification has been made when in fact it has not. This ensures that each change is accurately recorded and applied, reducing errors caused by misunderstanding or forgetfulness.

[0020] In the second aspect, the present application provides an industrial visual inspection modular control system, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and one or more processors call the computer instructions to enable the industrial visual inspection modular control system to execute the method described in the first aspect and any possible implementation method of the first aspect.

[0021] In a third aspect, the present application provides a computer program product comprising instructions, which, when the computer program product is run on an industrial vision inspection modular control system, enables the industrial vision inspection modular control system to execute the method described in the first aspect and any possible implementation method of the first aspect.

[0022] In a fourth aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an industrial vision inspection modular control system, enables the industrial vision inspection modular control system to execute the method described in the first aspect and any possible implementation of the first aspect.

[0023] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. By collecting product images and displaying them in the product sampling area, an intuitive visual reference is provided for subsequent inspections. The design of the inspection module library enables various inspection methods to be modularized, greatly increasing the flexibility of the system. Operators can add the required inspection modules to the inspection process box by simple selection and dragging operations. This intuitive operation method lowers the threshold for using the system. The order of module arrangement in the inspection process box determines the execution order of the inspection program. This visual process design makes the entire inspection process clearer and easier to understand. When the inspection program is executed, the data reading bar displays the inspection result value in real time, which is convenient for operators to grasp the inspection situation in time. In short, through this modular and visual design, the flexibility and ease of use of the inspection system are greatly improved, and the inspection efficiency is significantly improved. Operators do not need to frequently perform complex program debugging. They can quickly establish and adjust the inspection system with simple drag and drop operations, which not only saves time, but also reduces the requirements for the operator's professional knowledge, thereby reducing labor costs and improving the overall efficiency of the production line.

[0024] 2. Allowing the dynamic addition of detection modules during the execution of the detection program greatly improves the flexibility of the system. By determining the location of the newly added detection module, the system can intelligently decide how to handle the newly added module. For new modules added before the current execution module, the system will perform preprocessing in parallel. This parallel processing mechanism improves the overall detection efficiency. The system will dynamically adjust the execution order according to the preprocessing status of the newly added modules to ensure the continuity and efficiency of the detection process. For new modules added after the current execution module, the system will update the arrangement order and execute them at the appropriate time to ensure the integrity of the detection process. In short, the detection system can adapt to changes in detection requirements in real time and can be adjusted without stopping the entire detection process. This not only improves the flexibility of the system, but also greatly reduces the downtime caused by changes in demand, thereby significantly improving the overall efficiency and adaptability of the production line.

[0025] 3. It can display the test results in real time in the data reading column and provide intuitive data feedback. By comparing with the preset rules, the system can automatically mark suspicious results, which greatly improves the efficiency of abnormal detection. Operators can conduct in-depth inspections of suspicious results, and the system will display the original product image and mark the relevant areas, which helps to quickly locate the problem. The system provides a parameter adjustment interface for the detection module, allowing operators to make instant adjustments based on actual conditions. After the parameters are adjusted, the system will pause the current detection, re-execute the detection with the new parameters, and display the original and new results at the same time for easy comparison and analysis. In short, operators can quickly identify and handle abnormal situations based on real-time feedback without stopping the entire detection process. This not only improves the accuracy of detection, but also significantly improves the response speed and flexibility of the system, thereby effectively reducing misjudgments and missed judgments, and improving the overall detection quality and efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 This is a flow chart of a modular control method for industrial visual inspection in an embodiment of the present application; Figure 2 is another flow chart of the modular control method for industrial visual inspection in an embodiment of the present application; Figure 3 is another flow chart of the modular control method for industrial visual inspection in an embodiment of the present application; Figure 4 is another flow chart of the modular control method for industrial visual inspection in an embodiment of the present application; Figure 5 It is an exemplary hardware structure diagram of the industrial visual inspection modular control system in the embodiment of the present application. DETAILED DESCRIPTION

[0027] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items.

[0028] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first" and "second" may explicitly or implicitly include one or more features, and in the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more.

[0029] See also Figure 1 , Figure 1 This is a flow chart of a modular control method for industrial visual inspection in an embodiment of the present application; S101, collecting product images of products, and displaying the product images in a product sampling area; The product image refers to the visual representation of the product to be tested, which is usually a digital picture obtained by a camera or scanner. The product sampling area refers to the area on the user interface specifically used to display product images, which is used to show the actual appearance of the product to be tested.

[0030] In some embodiments, it is necessary to use an appropriate image acquisition device (such as an industrial camera) to photograph or scan the product to be inspected to obtain a high-quality digital image.

[0031] It is worth noting that displaying product images in the product sampling area allows operators or quality inspectors to visually observe the appearance of the product and quickly set up the inspection process.

[0032] It should be noted that, in some implementations, step S101 further includes: S1011. Acquire the arrangement order of the detection modules from a database according to the product type; The product type indicates the classification or type of the product to be tested, and is used to distinguish products with different characteristics.

[0033] In some embodiments, the system first needs to determine the type of the current product, which may involve reading a product identifier or user input. The system then connects to a pre-configured database that stores the order of detection module arrangements for different product types. The system constructs a query, using the product type as a keyword, to retrieve the corresponding detection module arrangement information from the database. If the query does not return a result, the system should have a corresponding error handling mechanism, which may use a default arrangement or prompt the user to manually configure it.

[0034] S1012: In response to a confirmation instruction from the user, adjusting the detection modules in the detection process box according to the arrangement order.

[0035] It can be seen that the system can automatically obtain the corresponding inspection module arrangement order from the database according to the product type. Users can quickly adjust the inspection process box according to the arrangement order recommended by the system, saving a lot of manual configuration time. Through this intelligent inspection process customization mechanism, the system can quickly adapt to the inspection requirements of different products. The configuration time of the inspection system is reduced. For production lines that need to frequently switch product types, this mechanism can greatly improve production efficiency and reduce quality problems caused by configuration errors, thereby improving overall production quality and efficiency.

[0036] S102, in response to the selection and dragging operation of the current detection module, copying the current detection module from the detection module library to the detection process box, the current detection module being any detection module in the detection module library; Among them, the detection module refers to a software unit that performs a specific detection function, such as an appearance detection module, a hole size detection module, a position detection module, etc. The detection module library refers to a collection of various predefined detection modules. The detection process box refers to an area on the user interface used to organize and display the detection process.

[0037] It is worth noting that this step is usually performed when setting up the detection process, allowing users to customize the detection order and content. For example, the user first browses the available detection modules in the detection module library and then selects the required module. Then, the user drags the selected module to the appropriate position in the detection process box by mouse or touch operation. In response to this operation, the system creates a copy of the module in the detection process box while keeping the original module in the detection module library unchanged. This process can be repeated multiple times to build a complete detection process.

[0038] For example, in some embodiments, the appearance detection module can detect whether the product appearance has defects, and the size detection module can detect the sizes of some holes set on the product.

[0039] It should be noted that the detection procedure has become mature in industrial applications. The innovation of this method lies in its modularization and visualization. Specifically, the standard detection process is functionally deconstructed and each detection link is divided into independent functional modules. These functional modules are presented through an intuitive graphical interface to realize the visualization of the detection process.

[0040] In some embodiments, after step S102, the method further includes: S1021, generating optimization suggestions for the detection process box based on the association rules of the preset detection module; Association rules refer to a set of rules that describe the dependencies and optimization strategies between detection modules.

[0041] In some embodiments, the system first needs to load the current detection process box structure and the preset detection module association rules. Then, the system analyzes the configuration and connection relationship of each module in the current process and matches them with the association rules. During the matching process, the system may identify potential optimization opportunities, such as redundant modules, unreasonable execution order, and uneven resource utilization. Based on these findings, the system will generate a series of optimization suggestions, which may include module reordering, merging similar functions, adjusting parameter configurations, etc. The system also needs to consider the feasibility and potential impact of the suggestions to ensure that the generated suggestions will not undermine the overall function of the detection process. Finally, the system outputs these suggestions in a structured form, which may include information such as suggestion description, expected effects, and implementation difficulty.

[0042] S1022: In response to a confirmation instruction from the user, adjust the detection module in the detection process box according to the optimization suggestion.

[0043] The confirmation instruction indicates the user's consent to execute the optimization suggestion.

[0044] It can be seen that the system can automatically generate optimization suggestions for the detection process box based on the preset detection module association rules. Users can quickly adjust the arrangement of detection modules in the detection process box according to the suggestions generated by the system. It can not only help novice users quickly build a reasonable detection process, but also provide optimization references for experienced operators, thereby significantly improving the overall performance and reliability of the detection system. At the same time, this mechanism also reduces the possibility of human error and further improves the accuracy and efficiency of detection.

[0045] S103, after the current detection module is copied to the detection process frame, the detection area and detection target of the current detection module are displayed in the product sampling area; The detection area refers to the range or location in the product image where a specific detection is required. The detection target refers to the specific object or feature that needs to be identified or measured in the detection area.

[0046] In some embodiments, when a detection module is copied into the detection process box, the system automatically analyzes the properties and parameters of the module. Then, the system marks the area to be detected by the module with a specific graphic (such as a rectangular frame, arrow or highlighted area) on the product image displayed in the product sampling area. At the same time, the system also indicates the detection target of the module in an appropriate manner (such as text annotation, icon, etc.). In this way, the inspection personnel can clearly see the working position and detection content of each inspection module on the product.

[0047] For example, in some embodiments, when the hole size detection module is dragged in, the location of the hole to be detected on the product and the size of the hole will be displayed on the product sampling area; It should be noted that the detection program in the detection module can be adjusted, and the debugger needs to adjust the detection area and detection target according to the actual needs of the product. For example, detection area adjustment: it can be expanded, reduced, moved or customized; detection target modification: adding new targets, changing target types, deleting existing targets; parameter setting: entering specific values ​​(such as aperture, allowable error) through the configuration panel, and using the slider to quickly adjust parameters (such as detection sensitivity).

[0048] In some embodiments, the display of the detection area and the detection target can be achieved in a variety of ways: optionally, using a semi-transparent rectangle of different colors to cover the product image to represent the detection area; adding text descriptions of the detection target next to the rectangle; allowing the user to accurately define the detection area by dragging and adjusting the size and position of the rectangle. Optionally, use animation effects to highlight the detection area, such as flashing or gradient effects; use icons to represent the detection target, such as a ruler icon for size detection and a palette icon for color detection; provide a zoom function for users to view details. It is understandable that other methods can also be used to achieve the display of the detection area and the detection target, which are not limited here.

[0049] In some embodiments, after step S103, the method further includes: S1031, detecting whether the current detection module is the latest version; Specifically, the system first needs to obtain the version information of the current detection module, which may involve reading the module's metadata, configuration files, or specific version identifiers. Then, the system needs to communicate with a predefined version information source, which may be a remote server, a local database, or a configuration file. The system compares the current version with the latest available version information, which may include version numbers, release dates, or specific version identifiers. During the comparison process, the system needs to consider the format and comparison rules of the version number. If it is found that the current version is lower than the latest version, the system should record this information, including version differences, possible update content, etc.

[0050] S1032. If not, display a prompt message to prompt the user to update the outdated version.

[0051] The prompt information refers to a text or graphical interface element that conveys specific information or suggestions to the user. Outdated updates refer to a state where the currently used detection module version lags behind the latest available version.

[0052] It can be seen that the system can automatically detect whether the currently used detection module is the latest version. For modules that are not the latest version, the system will display a prompt message to remind the user to update. Always set the module to the last modified template to avoid the problem of mistakenly thinking that a modification has been made when in fact it has not. This ensures that every change is accurately recorded and applied, reducing errors caused by misunderstanding or forgetfulness S104, in response to the execution instruction, executing the detection programs corresponding to the detection modules in sequence according to the arrangement order of the detection modules in the detection process box, and detecting the product image; The arrangement order of the detection modules indicates the order of the detection modules in the detection process frame. The detection program refers to the computer program corresponding to each detection module and performing a specific detection task.

[0053] S105. When the detection program is executed, the detection result value of the detection module is displayed in the data reading column.

[0054] The data reading bar refers to a special area on the user interface used to display the test results. The test result value represents the specific data obtained after each test module is executed, such as size, angle, number of defects, etc.

[0055] In some embodiments, the inspection results may include quantitative data (such as specific dimension values), qualitative results (such as pass / fail judgments), or more complex data sets (such as defect location lists). These results are presented in an easy-to-understand format, which may include numbers, text descriptions, color coding (such as green for pass, red for fail), etc.

[0056] It can be seen that by collecting product images and displaying them in the product sampling area, an intuitive visual reference is provided for subsequent inspections. The design of the inspection module library enables various inspection methods to be modularized, greatly increasing the flexibility of the system. Operators can add the required inspection modules to the inspection process box by simple selection and dragging operations. This intuitive operation method lowers the threshold for using the system. The order of module arrangement in the inspection process box determines the execution order of the inspection program. This visual process design makes the entire inspection process clearer and easier to understand. When the inspection program is executed, the data reading bar displays the inspection result value in real time, which is convenient for operators to grasp the inspection situation in time. In short, through this modular and visual design, the flexibility and ease of use of the inspection system are greatly improved, and the inspection efficiency is significantly improved. Operators do not need to frequently perform complex program debugging. They can quickly establish and adjust the inspection system with simple drag and drop operations, which not only saves time, but also reduces the requirements for the operator's professional knowledge, thereby reducing labor costs and improving the overall efficiency of the production line.

[0057] In actual use, when the debugger finds that there may be a problem with the program of a certain detection module, he must wait for the entire detection process to be completed before making any modifications. This is particularly time-consuming for complex detection programs.

[0058] Modifying the detection module in the detection process box during the detection program operation mainly involves three situations: adding, reducing and modifying modules. The processing method for each situation is different. The following describes the solutions one by one: Add new detection module: However, in actual use, after step S104, the following steps are also included: refer to Figure 2 , Figure 2 is another flow chart of the modular control method for industrial visual inspection in an embodiment of the present application; S201, when the detection program is executed, in response to the selection and drag operation of adding a detection module, copying the current detection module from the detection module library to the detection process frame, wherein the added detection module is any detection module in the detection module library; The detection program execution refers to the process in which the system is performing product detection according to the preset detection process. Adding a detection module means adding a new detection function unit to the existing detection process.

[0059] This step is usually performed after the detection program has already started, but the user finds that additional detection items need to be added.

[0060] S202, determining whether the position of the added detection module in the detection process frame is located before the detection module that is currently performing detection; The detection module that is currently performing detection refers to the module corresponding to the detection operation currently being performed.

[0061] It should be noted that the detection module is a visual representation of the detection program, not a physical product. They are essentially a graphical representation of the program code that performs a specific detection task, converting complex detection algorithms into an intuitive graphical interface, providing a visual operation interface, and facilitating debugging and management. The detection module is usually presented as a draggable and configurable graphical control.

[0062] It is necessary to determine the position of the module currently being tested in the test process. Then, the system will compare the relative position of the newly added module and the currently executed module in the test process box. If the position of the newly added module is before the currently executed module, it means that according to the ideal test sequence, the newly added module should have been executed. If the position of the newly added module is after the currently executed module, it means that the newly added module will be executed in the future test steps.

[0063] Located before the detection module that is performing detection, execute step S203; After the detection module that is performing the detection, execute step S208; S203, if it is located before the detection module that is currently performing detection, preprocessing of adding the detection module is performed in parallel during the execution of the detection module that is currently performing detection; Among them, parallel processing refers to the processing method of executing two or more tasks at the same time. Preprocessing refers to the necessary initialization and preparation of the detection module before the formal detection.

[0064] Preprocessing may include loading necessary algorithm libraries, initializing parameters, preparing data structures, etc.

[0065] Continuing with the above example, in some embodiments, the detection area and detection target of the added detection module will also be displayed in the product sampling area; It should be noted that the detection area and detection target of the detection module currently being detected will be different from the detection area and detection target of the added detection module in terms of color, transparency or border style. For example, the module being executed may be represented by a solid border and saturated color, while the newly added module may use a dotted border and semi-transparent color. This differentiated display helps the operator quickly identify the currently active detection tasks and potential newly added tasks, so as to better understand and manage the entire detection process.

[0066] Continuing with the above example, in some embodiments, the debugging personnel may modify the debugging program of the detection module. The specific implementation method may refer to step S103 and will not be described in detail here.

[0067] It should be noted that the above processes can all be regarded as preprocessing.

[0068] S204, after the detection program of the detection module currently performing the detection is completed, determine whether the preprocessing of the additional detection module is ready; Specifically, the system will first confirm that the current detection module has completed all scheduled detection tasks. Then, the system will check the pre-processing status of the newly added detection module. This check process may include verifying whether all necessary resources have been loaded and whether the parameters have been set correctly.

[0069] When the preprocessing of adding the detection module is ready, execute step S205; If the preprocessing of adding the detection module is not ready, execute step S207.

[0070] S205, if the preprocessing of the added detection module is ready, interrupt the detection sequence specified in the detection flow box, execute the detection program corresponding to the added detection module, and detect the product image; In some embodiments, the system will first suspend the original detection sequence, and may need to save the current detection state. Then, the system will immediately call the detection program of the newly added detection module and start to perform corresponding detection on the product image.

[0071] S206, after the detection program corresponding to the added detection module is executed, the detection sequence specified in the detection process box is restored; In some implementations, the system will return to the original detection order and continue executing subsequent detection modules from the interruption point.

[0072] S207, if the preprocessing of the added detection module is not ready, then execute the detection program corresponding to the subsequent detection module to detect the product image, and the subsequent detection module is the next detection module of the detection module currently executing the detection in the detection process frame; The subsequent detection module refers to the next detection module after the current execution module in the original detection sequence.

[0073] It should be noted that step S207 is a loop step. After the detection program of the subsequent detection module is executed, it is determined whether the preprocessing of the added detection module is ready; then the subsequent detection module is regarded as the detection module that is performing detection, and steps S205 to S207 are executed in a loop until the preprocessing of the detection module is ready.

[0074] S208, if it is located after the detection module that is performing detection, update the arrangement order of the detection modules in the detection process box; Updating the sort order means adjusting the order of the detection modules in the detection process box to include the newly added modules.

[0075] S209, after the detection program of the detection module currently performing detection is completed, the detection programs corresponding to the detection modules are executed in sequence according to the updated arrangement order to detect the product image.

[0076] It can be seen that the dynamic addition of detection modules during the execution of the detection program greatly improves the flexibility of the system. By determining the location of the newly added detection module, the system can intelligently decide how to handle the newly added module. For new modules added before the current execution module, the system will perform preprocessing in parallel. This parallel processing mechanism improves the overall detection efficiency. The system will dynamically adjust the execution order according to the preprocessing status of the newly added modules to ensure the continuity and efficiency of the detection process. For new modules added after the current execution module, the system will update the arrangement order and execute them at the appropriate time to ensure the integrity of the detection process. In short, the detection system can adapt to changes in detection requirements in real time and can be adjusted without stopping the entire detection process. This not only improves the flexibility of the system, but also greatly reduces the downtime caused by changes in demand, thereby significantly improving the overall efficiency and adaptability of the production line.

[0077] Reduce detection modules: However, in actual use, after step S104, the following steps are also included: refer to Figure 3 , Figure 3 is another flow chart of the modular control method for industrial visual inspection in an embodiment of the present application; S301, when the detection program is executed, in response to the selection and drag operation of the reduced detection module, the reduced detection module is removed from the detection process box, and the reduced detection module is any detection module in the detection process box; S302, determining whether the position of the reduced detection module in the detection process frame is located before the detection module that is performing detection, the detection module that is performing detection itself, or after the detection module that is performing detection; "Before" and "after" are used to indicate the relative position in the detection order. "Itself" indicates that the module being removed is the module currently being executed.

[0078] S303, if it is located before the detection module that is performing detection, then reduce the detection module from the detection process box, and remove the detection result value of the reduced detection module in the data reading column; In some embodiments, the system first needs to delete the corresponding module information from the data structure of the detection process. Then, the system will update the display of the detection process box to remove the visual representation of the module. Next, the system needs to access the relevant data structure of the data reading column, find the detection result corresponding to the removed module, and delete it from the display.

[0079] S304: If it is the detection module that is currently performing detection, determine whether the preprocessing of the subsequent detection module is ready, and the subsequent detection module is the next detection module of the detection module that is currently performing detection in the detection process frame; S305, if the preprocessing of the subsequent detection module is ready, interrupt the detection sequence specified in the detection flow box, execute the detection program corresponding to the subsequent detection module, and detect the product image; S306, if the preprocessing of the subsequent detection module is not ready, wait until the preprocessing of the subsequent detection module is ready, interrupt the detection sequence specified in the detection flow box, execute the detection program corresponding to the subsequent detection module, and detect the product image; S307, if it is located after the detection module that is performing detection, then update the arrangement order of the detection modules in the detection process box; S308. After the detection program of the detection module currently performing detection is completed, the detection programs corresponding to the detection modules are executed in sequence according to the updated arrangement order to detect the product image.

[0080] It can be seen that allowing the detection module to be dynamically removed during the execution of the detection program further enhances the flexibility of the system. The system will adopt different processing strategies according to the position of the removed module to ensure the continuity of the detection process. For the removal of the module before the currently executed module, the system will immediately update the detection process and data display to avoid unnecessary waste of resources. When removing the module being executed, the system will intelligently judge the readiness status of the subsequent module and switch to the next ready module in time to minimize the interruption time. For the removal of the module after the currently executed module, the system will update the arrangement order to ensure the correctness of subsequent detection. In short, it can respond quickly to changes in detection requirements and make adjustments without stopping the entire detection process. This not only improves the flexibility and efficiency of the system, but also minimizes the time loss caused by adjustments while ensuring the detection quality, thereby significantly improving the overall efficiency and adaptability of the production line.

[0081] Modifying the detection module is actually a combination of adding and reducing. You can refer to the above two steps and will not go into details here.

[0082] In some embodiments, step S105 further includes: refer to Figure 4 , Figure 4 is another flow chart of the modular control method for industrial visual inspection in an embodiment of the present application; S401, marking a suspicious result in the data reading column, where the suspicious result is a result in which the value of the test result is inconsistent with a preset rule; Suspicious results are test outputs that do not meet expectations or require further confirmation. Test result values ​​represent specific data generated by the test process. Preset rules are standards or thresholds used to determine whether a result is normal.

[0083] In some embodiments, the system first needs to obtain the latest test result values, and then compare these values ​​with predefined rules or thresholds. The comparison process may involve a simple value range check or may require more complex logical judgments. Once it is found that the result does not meet the preset rules, the system will specially mark the result in the data reading column. The marking method may include changing the text color, adding background highlights, using special icons, etc.

[0084] S402, in response to an in-depth inspection instruction for a suspicious result, displaying an original product image related to the result in a product sampling area, and marking a corresponding inspection area and inspection target; A deep inspection instruction represents an action in which a user requests to view more detailed information.

[0085] In some embodiments, the system first needs to receive and parse the user's in-depth inspection instructions to determine the specific suspicious results to be viewed. Then, the system needs to retrieve the corresponding original product image from the storage based on the identification information of the result. After retrieving the image, the system loads it and displays it in the product sampling area. Next, the system needs to determine the specific detection area and detection target involved in the result based on the records of the detection algorithm. The system then uses appropriate visualization techniques (such as outlines, color blocks, arrows, etc.) to mark these areas and targets on the displayed image. The marking process needs to consider the balance between clarity and not obstructing the details of the original image. In addition, the system may also need to provide interactive functions such as zooming and panning so that users can view the marked details more closely.

[0086] S403, displaying a parameter adjustment interface of a corresponding detection module; The specific implementation method can refer to step S103, which will not be repeated here.

[0087] S404, in response to the parameter adjustment instruction, suspending the detection program of the detection module that is executing the detection; The parameter adjustment instruction represents an operation signal for the user to modify the detection configuration.

[0088] S405, re-execute the detection program of the corresponding detection module using the new parameters; The new parameter indicates the detection configuration value just adjusted by the user.

[0089] S406, displaying the suspicious result and the retest result in the data reading column at the same time.

[0090] The re-detection results represent the output obtained after performing the detection with the new parameters. Simultaneous display means that two sets of data are presented side by side in the same view.

[0091] In some embodiments, the system first needs to obtain new result data from the retest process. Then, the system needs to create or update the display area in the data reading bar to accommodate the two sets of result data. The system may need to adjust the layout of the data reading bar to ensure that the two sets of results can be clearly displayed side by side. When presenting data, the system should use appropriate visualization methods, such as tables, charts, or lists of values, so that users can easily identify and compare differences. The system also needs to add clear labels to each set of results, such as "original results" and "retest results." In addition, the system may need to highlight the main differences between the two sets of results, such as using color coding or special symbols to mark the changed values. The system should also consider providing additional interactive functions, such as result comparison charts, difference percentage calculations, etc., to assist users in conducting more in-depth analysis.

[0092] It can be seen that the test results can be displayed in real time in the data reading column, providing intuitive data feedback. By comparing with the preset rules, the system can automatically mark suspicious results, which greatly improves the efficiency of abnormal detection. Operators can conduct in-depth inspections of suspicious results, and the system will display the original product image and mark the relevant areas, which helps to quickly locate the problem. The system provides a parameter adjustment interface for the detection module, allowing operators to make instant adjustments based on actual conditions. After the parameters are adjusted, the system will pause the current detection, re-execute the detection with the new parameters, and display the original and new results at the same time for easy comparison and analysis. In short, operators can quickly identify and handle abnormal situations based on real-time feedback without stopping the entire detection process. This not only improves the accuracy of detection, but also significantly improves the response speed and flexibility of the system, thereby effectively reducing misjudgments and missed judgments, and improving the overall detection quality and efficiency.

[0093] The following introduces an exemplary industrial visual inspection modular control system 500 provided in an embodiment of the present application. Figure 5 It is a schematic diagram of an exemplary hardware structure of the industrial visual inspection modular control system 500 provided in an embodiment of the present application.

[0094] In some embodiments, the industrial visual inspection modular control system 500 is a computer device or the industrial visual inspection modular control system 500 includes a computer device. The computer device includes a processor, a memory and a network interface connected by a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The network interface of the computer device is used to communicate with other external terminals or servers through a network connection. In some embodiments, the network interface can be a wired network interface, and in some embodiments, the network interface can also be a wireless network interface. When the computer program is executed by the processor, the method in the embodiment of the present application is implemented.

[0095] Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0096] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0097] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

[0098] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0099] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

Claims

1. A modular control method for industrial visual inspection, characterized in that: include: Capturing a product image of a product and displaying the product image in a product sampling area; In response to the selection and dragging operation of the current detection module, the current detection module is copied from the detection module library to the detection process frame, and the current detection module is any detection module in the detection module library; After the current detection module is copied to the detection process frame, the detection area and detection target of the current detection module are displayed in the product sampling area; In response to the execution instruction, the detection programs corresponding to the detection modules are sequentially executed according to the arrangement order of the detection modules in the detection process box to detect the product image; When the detection program is executed, the detection result value of the detection module is displayed in the data reading column.

2. The method according to claim 1, characterized in that: After the step of responding to the execution instruction and sequentially executing the detection programs corresponding to the detection modules in the detection flow box according to the arrangement order of the detection modules, and detecting the product image, the method further includes: When the detection program is executed, in response to the selection and drag operation of adding a detection module, the current detection module is copied from the detection module library to the detection process frame, and the added detection module is any detection module in the detection module library; Determine whether the position of the added detection module in the detection process frame is before the detection module that is performing detection; If it is located before the detection module that is currently performing detection, the preprocessing of the added detection module is performed in parallel during the execution of the detection module that is currently performing detection; After the detection program of the detection module currently performing the detection is completed, determining whether the preprocessing of the added detection module is ready; If the preprocessing of the added detection module is ready, the detection sequence specified in the detection flow box is interrupted, and the detection program corresponding to the added detection module is executed to detect the product image; After the detection program corresponding to the added detection module is executed, the detection sequence specified in the detection flow box is restored; If the preprocessing of the added detection module is not ready, the detection program corresponding to the subsequent detection module is executed to detect the product image, and the subsequent detection module is the next detection module of the detection module currently performing detection in the detection process frame; If it is located after the detection module that is performing detection, updating the arrangement order of the detection modules in the detection process frame; After the detection program of the detection module currently performing detection is completed, the detection programs corresponding to the detection modules are executed in sequence according to the updated arrangement order to detect the product image.

3. The method according to claim 1, characterized in that: After the step of responding to the execution instruction and sequentially executing the detection programs corresponding to the detection modules in the detection flow box according to the arrangement order of the detection modules, and detecting the product image, the method further includes: When the detection program is executed, in response to the selection and dragging operation of the reduced detection module, the reduced detection module is removed from the detection process frame, and the reduced detection module is any detection module in the detection process frame; Determine whether the position of the reduced detection module in the detection process frame is located before the detection module that is performing detection, the detection module that is performing detection itself, or after the detection module that is performing detection; If it is located before the detection module that is performing the detection, then the detection module is reduced from the detection process frame, and the detection result value of the reduced detection module is removed from the data reading column; If it is the detection module itself that is performing the detection, then judging whether the preprocessing of the subsequent detection module is ready, the subsequent detection module being the next detection module of the detection module that is performing the detection in the detection process frame; If the preprocessing of the subsequent detection module is ready, interrupt the detection sequence specified in the detection flow box, execute the detection program corresponding to the subsequent detection module, and detect the product image; If the preprocessing of the subsequent detection module is not ready, wait until the preprocessing of the subsequent detection module is ready, interrupt the detection sequence specified in the detection flow box, execute the detection program corresponding to the subsequent detection module, and detect the product image; If it is located after the detection module that is performing detection, updating the arrangement order of the detection modules in the detection process frame; After the detection program of the detection module currently performing detection is completed, the detection programs corresponding to the detection modules are executed in sequence according to the updated arrangement order to detect the product image.

4. The method according to claim 1, characterized in that: After the step of displaying the detection result value of the detection module in the data reading column when the detection program is executed, the method further includes: Marking a suspicious result in the data reading column, wherein the suspicious result is a result that the value of the test result is inconsistent with a preset rule; In response to an instruction for further inspection of the suspicious result, displaying an original product image related to the result in the product sampling area, and marking a corresponding inspection area and inspection target; Display the parameter adjustment interface of the corresponding detection module; In response to the parameter adjustment instruction, suspending a detection program of a detection module that is performing detection; Re-execute the detection program of the corresponding detection module using the new parameters; The suspicious result and the retest result are simultaneously displayed in the data reading column.

5. The method according to claim 1, characterized in that: After the step of copying the current detection module from the detection module library to the detection process frame in response to the selection and dragging operation of the current detection module, wherein the current detection module is any detection module in the detection module library, the method further comprises: Generate optimization suggestions for the detection process box based on association rules of preset detection modules; In response to a confirmation instruction from the user, the detection modules in the detection process box are adjusted according to the optimization suggestion.

6. The method according to claim 1, characterized in that After the step of collecting the product image of the product and displaying the product image in the product sampling area, the method further includes: According to the product type, obtaining the arrangement order of the detection modules from the database; In response to a confirmation instruction from a user, the detection modules in the detection process frame are adjusted according to the arrangement sequence.

7. The method according to claim 1, characterized in that After the step of copying the current detection module from the detection module library to the detection process frame in response to the selection and dragging operation of the current detection module, wherein the current detection module is any detection module in the detection module library, the method further comprises: Detecting whether the current detection module is the latest version; If not, display a prompt message to the user to update the outdated version.

8. An industrial visual inspection modular control system, characterized in that: The industrial visual inspection modular control system includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the industrial visual inspection modular control system to execute the method described in any one of claims 1-7.

9. A computer program product comprising instructions, characterized in that When the computer program product runs on an industrial visual inspection modular control system, the industrial visual inspection modular control system executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an industrial visual inspection modular control system, the industrial visual inspection modular control system executes the method as described in any one of claims 1 to 7.

Images