Visual detection configuration method and apparatus, and visual detection system

Abstract

A visual detection configuration method and apparatus, and a visual detection system, which relate to the technical field of machine vision. The method comprises: receiving a visual detection configuration request; and in response to receiving the visual detection configuration request, outputting a first interface, the first interface comprising a product sub-interface, a region sub-interface and a point location sub-interface, wherein the product sub-interface is used for displaying product information of each product to be detected; the region sub-interface is used for displaying detection region information of each detection region in a target product; and the point location sub-interface is used for displaying point location information of each point location in a target detection region, the target product being a product the product information of which is selected, and the target detection region being a detection region the detection region information of which is selected. By means of applying the embodiments of the present application, when configuring a certain product to be detected, a user can refer to the configurations of other products to be detected on the basis of a first interface, such that the user can accurately configure the product to be detected.

Description

A visual inspection configuration method, apparatus and visual inspection system

[0001] This application claims priority to Chinese Patent Application No. 202411955702.5, filed on December 27, 2024, entitled "A Visual Inspection Configuration Method, Apparatus and Visual Inspection System", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of machine vision technology, and in particular to a vision inspection configuration method, apparatus and vision inspection system. Background Technology

[0003] Visual inspection is a technology that uses machines to perform measurement and judgment instead of human eyes; it is also known as machine vision inspection. Machine vision inspection is widely used in various automation fields and manufacturing industries, such as pharmaceuticals, parts, and packaging. Specific applications include, but are not limited to, inspection of component appearance dimensions, inspection of component defects, assembly inspection, quality inspection, flatness measurement, weld inspection, and measurement of precision machined parts dimensions.

[0004] In related technologies, machine vision inspection systems include light sources, lenses, and cameras. In industrial manufacturing, machine vision inspection systems typically employ multiple cameras to capture the product under inspection from different perspectives, expanding the field of view and enabling comprehensive inspection. However, due to the large variety of product models, different models may require different inspection areas and points. Therefore, users need to configure machine vision inspection separately for each product model.

[0005] In related technologies, users often configure different models of products under test independently. This makes it difficult for users to configure other models simultaneously when configuring one model. It's understandable that users might refer to each other when configuring different models, but without the ability to configure multiple models simultaneously, it's difficult to cross-reference settings, leading to inaccurate configurations. For example, when configuring a chassis model A, a user might overlook a point on the A-pillar. Later, when configuring a chassis model B, they might find that this point on the A-pillar needs to be configured. However, since configuring model A is not possible at the same time, the user must either pause configuring model B and reconfigure model A, or configure model B first and then reconfigure model A. The former might cause users to forget to complete the configuration for model B, while the latter might cause users to forget to reconfigure model A. In other words, both situations could prevent users from configuring either model A or model B. Summary of the Invention

[0006] The purpose of this application is to provide a visual inspection configuration method, apparatus, and system to efficiently display the configuration status of each product to be inspected to the user, enabling the user to accurately configure the products to be inspected. The specific technical solution is as follows:

[0007] A first aspect of this application provides a visual detection configuration method, the method comprising:

[0008] Receive visual inspection configuration requests;

[0009] In response to receiving the visual inspection configuration request, a first interface is output; the first interface includes a product sub-interface, a region sub-interface, and a point sub-interface; the product sub-interface is used to display product information of each product to be inspected; the region sub-interface is used to display the inspection region information of each inspection region in the target product; the point sub-interface is used to display the point information of each point in the target inspection region, wherein the target product is the product to which the selected product information belongs, and the target inspection region is the inspection region to which the selected inspection region information belongs.

[0010] In one possible implementation, generating the target algorithm parameter values ​​for the points in response to configuration instructions for each of the configurable parameters includes:

[0011] In response to a product add command input to the product sub-interface, the product information of the product to be tested indicated by the product add command is displayed on the product sub-interface.

[0012] In one possible implementation, in response to a region addition command input to the region sub-interface, the detection region indicated by the region addition command is determined as the detection region of the target product.

[0013] In one possible implementation, in response to a point-adding instruction input to the point sub-interface, the point indicated by the point-adding instruction is determined in the view of the target detection area of ​​the target product, and the robotic arm indicated by the point-adding instruction and the camera on the robotic arm are determined; the point is determined as a point of the target detection area, and the determined point, robotic arm and camera are associated.

[0014] The location information includes: the camera associated with the location, the robotic arm, and the region to which the view used to determine the location belongs.

[0015] In one possible implementation, the step of responding to a point-addition command input to the point sub-interface, determining the point indicated by the point-addition command in a view of the target detection area of ​​the target product, and determining the robotic arm indicated by the point-addition command and the camera on the robotic arm, includes:

[0016] In response to a point addition command input to the point sub-interface, a second interface is displayed, including a robotic arm selection sub-interface, a camera selection sub-interface, and a point selection sub-interface, wherein the point selection sub-interface is used to display a view of the target detection area of ​​the target product.

[0017] In response to a robotic arm selection command input to the robotic arm selection sub-interface, the robotic arm indicated by the robotic arm selection command is determined as the robotic arm indicated by the point addition command.

[0018] In response to a camera selection command input to the camera selection sub-interface, the camera indicated by the camera selection command is determined as the camera indicated by the point addition command;

[0019] In response to a point selection command input to the view displayed in the point selection sub-interface, the point indicated by the point selection command is determined in the view as the point indicated by the point addition command.

[0020] In one possible implementation, in response to a view switching command input to the point selection sub-interface, the target view indicated by the view switching command is determined in the respective views of each detection area of ​​the target product, the view displayed in the point selection sub-interface is switched to the target view, and the target detection area is switched to the detection area to which the target view belongs.

[0021] In one possible implementation, the method further includes:

[0022] In response to a parameter configuration command input for any point location information, a third interface is displayed, wherein the third interface includes parameter configuration sub-interfaces corresponding to each camera associated with the target point location, and the target point location is the point location to which the point location information targeted by the parameter configuration command belongs;

[0023] In response to a parameter selection instruction input for any parameter configuration sub-interface, the parameter indicated by the parameter selection instruction is determined, and the target camera is associated with the determined parameter, wherein the target camera is the camera corresponding to the camera parameter configuration sub-interface targeted by the parameter selection instruction.

[0024] In one possible implementation, the parameters include at least one of the following: shooting mode, highlight, exposure, gain, gamma, light source brightness, and machine vision algorithm parameters.

[0025] In one possible implementation, the parameters include machine vision algorithm parameters;

[0026] Determining the parameters indicated by the parameter selection instruction includes:

[0027] This demonstrates the parameter types of all algorithm parameters used in the visual inspection process;

[0028] In response to a type selection instruction for the displayed parameter type input, determine the type of the parameter to be configured indicated by the type selection instruction;

[0029] A fourth interface is displayed, including the algorithm parameter configuration sub-interfaces corresponding to each of the aforementioned parameter types.

[0030] In response to an algorithm parameter configuration instruction input for any algorithm parameter configuration sub-interface, the parameter value indicated by the algorithm parameter configuration instruction is determined, and the machine vision parameter whose value is the determined parameter value and whose type is the target parameter type is used as the machine vision algorithm parameter indicated by the parameter selection instruction, wherein the target parameter type is the parameter type to be configured corresponding to the algorithm parameter configuration sub-interface targeted by the algorithm parameter configuration instruction.

[0031] In one possible implementation, the fourth interface further includes a preview sub-interface;

[0032] The method further includes:

[0033] After using the determined parameter values ​​and target parameter types as the machine vision algorithm parameters indicated by the parameter selection instruction, machine vision simulation is performed according to the existing machine vision algorithm parameters indicated by the parameter selection instruction, and the simulation results are displayed on the preview sub-interface.

[0034] In one possible implementation, the method further includes:

[0035] In response to a grouping instruction input for the parameter type to be configured, the parameter type to be configured is divided into multiple parameter groups;

[0036] The fourth interface includes sub-interfaces corresponding to each parameter group, and each sub-interface corresponding to a parameter group includes an algorithm parameter configuration sub-interface corresponding to each parameter type to be configured in the parameter group.

[0037] In one possible implementation, the product information includes: product identifier, number of configured points, and total number of preset points for the product to be tested, wherein the number of configured points is the number of points associated with the product to be tested;

[0038] The detection area information includes a view of the detection area.

[0039] A second aspect of this application provides a visual inspection configuration apparatus, the apparatus comprising:

[0040] The input module is used to receive visual inspection configuration requests;

[0041] The configuration module is used to respond to the received visual inspection configuration request and output a first interface; the first interface includes a product sub-interface, a region sub-interface, and a point sub-interface; the product sub-interface is used to display product information; the region sub-interface is used to display the detection region information of each detection region in the target product; the point sub-interface is used to display the point information of each point in the target detection region, wherein the target product is the product to which the selected product information belongs, and the target detection region is the detection region to which the selected detection region information belongs.

[0042] A third aspect of the present application provides a visual inspection system, the system including a terminal device, a controller, and a robotic arm, wherein a camera is mounted on the robotic arm.

[0043] The terminal device is used to execute the visual inspection configuration method described in any of the first aspects above, and to send the points of each detection area of ​​each product to be inspected to the controller.

[0044] The controller is used to control the robotic arm to move the camera to capture images of each point in each detection area of ​​each product to be inspected, and to perform visual inspection on the product to be inspected based on the captured images.

[0045] A fourth aspect of this application provides an electronic device, including:

[0046] Memory, used to store computer programs;

[0047] The processor, when executing a program stored in memory, implements any of the above-described visual inspection configuration methods.

[0048] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of any of the above-described visual detection configuration methods.

[0049] Beneficial effects of the embodiments in this application:

[0050] This application provides a visual inspection configuration method, apparatus, and system. Upon receiving a visual inspection configuration request, the system responds by outputting a first interface. This first interface includes a product sub-interface, a region sub-interface, and a point sub-interface. The product sub-interface displays product information for each product to be inspected. The region sub-interface displays the detection region information for each detection region within the selected product information. The point sub-interface displays the point information for each point within the detection region to which the selected detection region information belongs. This first interface efficiently displays the configuration status of each product to be inspected to the user. When configuring a specific product to be inspected, the user can refer to the configuration status of other products to be inspected based on the product information displayed in the product sub-interface, the detection region information for each detection region within the target product displayed in the region sub-interface, and the point information for each point within the target detection region displayed in the point sub-interface, thus enabling accurate configuration of the product to be inspected.

[0051] Of course, implementing any product or method of this application does not necessarily require achieving all of the advantages described above at the same time. Attached Figure Description

[0052] The accompanying drawings, which are provided to further illustrate this application and form part of this application, illustrate exemplary embodiments of this application and are used to explain this application, but do not constitute an undue limitation of this application.

[0053] Figure 1 is a schematic diagram of a visual detection scenario provided in an embodiment of this application;

[0054] Figure 2 is a flowchart of a first type of visual inspection configuration method provided in an embodiment of this application;

[0055] Figure 3 is a second flowchart of the visual inspection configuration method provided in an embodiment of this application;

[0056] Figure 4 is an example diagram of the visual inspection configuration interface provided in an embodiment of this application;

[0057] Figure 5 is a third flowchart of the visual inspection configuration method provided in the embodiments of this application;

[0058] Figure 6 is an example diagram of a regional sub-interface provided in an embodiment of this application;

[0059] Figure 7 is a fourth flowchart of the visual inspection configuration method provided in the embodiments of this application;

[0060] Figure 8 is a detailed schematic diagram of step S500 in the embodiment shown in Figure 7;

[0061] Figure 9 is an example diagram of the point configuration interface provided in an embodiment of this application;

[0062] Figure 10 is a fifth flowchart of the visual detection configuration method provided in the embodiments of this application;

[0063] Figure 11 is an example diagram of the camera parameter configuration interface provided in an embodiment of this application;

[0064] Figure 12 is a detailed schematic diagram of step S700 in the embodiment shown in Figure 10;

[0065] Figure 13 is an example diagram of the algorithm parameter configuration interface provided in the embodiment of this application;

[0066] Figure 14 is an example diagram showing the algorithm parameter configuration and simulation results provided in the embodiments of this application;

[0067] Figure 15 is a schematic diagram of the visual inspection configuration device provided in an embodiment of this application;

[0068] Figure 16 is a schematic diagram of the structure of the electronic device provided in the embodiment of this application. Detailed Implementation

[0069] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. Obviously, the described embodiments are merely some embodiments of this invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this invention are within the scope of protection of this invention.

[0070] To more clearly illustrate the visual inspection configuration method, apparatus, and visual inspection system provided in this application, the following will provide an exemplary description of a possible application scenario of the visual inspection configuration method provided in this application. It is understood that the following example is only one possible application scenario of the visual inspection configuration method provided in this application. In other possible embodiments, the visual inspection configuration method provided in this application can also be applied to other possible application scenarios. The following example does not impose any limitations on this.

[0071] Taking an automobile production line as an example, workpiece defect detection is a crucial step. Referring to Figure 1, which is a schematic diagram of a workpiece defect detection scenario provided in this embodiment, infrared and visible light cameras are used in conjunction to detect defects in the automobile frame. In related technologies, during configuration, users often configure different models of the product to be inspected independently. For example, they might configure model A frame first, then model B frame. Furthermore, the configuration of model A frame is not visible when configuring model B frame. While users may need to refer to each other when configuring different models of the product to be inspected, it is difficult to refer to each other during configuration when it is not possible to configure multiple models of the product to be inspected simultaneously. This makes it difficult for users to achieve accurate configuration when configuring multiple different models of the product to be inspected.

[0072] To efficiently display the configuration status of each product to be tested to the user, enabling the user to accurately configure the product to be tested, a first aspect of this application provides a visual inspection configuration method applied to electronic devices. Referring to Figure 2, Figure 2 is a first flowchart of the visual inspection configuration method provided in this application embodiment. The method includes:

[0073] Step S100: Receive a visual inspection configuration request;

[0074] Step S200: In response to receiving the visual inspection configuration request, output the first interface; the first interface includes a product sub-interface, a region sub-interface, and a point sub-interface; the product sub-interface is used to display the product information of each product to be inspected; the region sub-interface is used to display the inspection area information of each inspection area in the target product; the point sub-interface is used to display the point information of each point in the target inspection area.

[0075] Among them, the target product is the product to which the selected product information belongs, and the target detection area is the detection area to which the selected detection area information belongs.

[0076] According to the embodiments of this application, upon receiving a visual inspection configuration request, a first interface is output in response to the received request. The first interface includes a product sub-interface, a region sub-interface, and a point sub-interface. The product sub-interface displays product information for each product to be inspected; the region sub-interface displays the inspection area information for each inspection area within the product to which the selected product information belongs; and the point sub-interface displays the point information for each point within the inspection area to which the selected inspection area information belongs. The first interface efficiently displays the configuration status of each product to be inspected to the user. When configuring a product to be inspected, the user can refer to the configuration status of other products to be inspected based on the product information displayed in the product sub-interface, the inspection area information for each inspection area within the target product displayed in the region sub-interface, and the point information for each point within the target inspection area displayed in the point sub-interface, thus enabling accurate configuration of the product to be inspected.

[0077] For example, suppose a user, while configuring a model A frame, inadvertently overlooks a point on the A-pillar. When configuring a model B frame, if they discover that the same point on the A-pillar needs to be configured, they simply need to reselect the model A frame in the product sub-area of ​​the first interface, configure the point on the A-pillar, and then reselect the model B frame in the first interface to continue configuring. Since the first interface displays the configuration status of each product under test, the user is unlikely to forget to configure either model A or model B. Furthermore, when configuring the model A frame, the user can refer to the configuration of the model B frame, facilitating accurate configuration of the product under test.

[0078] A point refers to a location on the surface of a product to be inspected that requires visual inspection. For example, when inspecting defects in all connectors on a car frame, each point refers to the location of each connector on the product to be inspected. Or, when inspecting defects in the A-pillar of a car frame, each point refers to multiple locations on the surface of the A-pillar of the car frame facing the camera.

[0079] The number of inspection points can be preset by the user based on practical experience, or it can be set by the user during the configuration process. Understandably, to ensure comprehensive visual inspection of the product under test and thus improve inspection accuracy, the number of inspection points should not be less than the preset inspection point threshold. The number of inspection points varies for different products under test, and the preset inspection point threshold may also vary.

[0080] The visual inspection configuration request in step S100 above can be entered by the user during the first configuration, or when the user modifies the target inspection area and / or the points in the target inspection area of ​​a target product that has already been configured, or when the user needs to configure a new target product after completing the configuration of the product to be inspected, or when the user needs to configure a new target area of ​​the target product after completing part of the target area of ​​the product to be inspected, or when the user needs to configure a new point in the target area after completing part of the target area of ​​the product to be inspected.

[0081] For example, assuming the products to be inspected are frame A, frame B, and frame C, if the user has not configured any of the frames A through C, and the user wants to configure frame A, the visual inspection request is entered by the user during the initial configuration. In response to this visual inspection request, a product sub-interface is displayed on the first interface. After selecting frame A in the product sub-interface, the user can sequentially select the target detection area in the area sub-interface and configure the points within the selected target detection area in the point sub-interface, thereby completing the configuration of frame A. If the user has already completed the configuration of frames A and B, and needs to configure frame C, the visual inspection request will then proceed as follows: The request is to display a product sub-interface on the first interface. After the user selects frame C in the product sub-interface, the user can then select the target detection area in the area sub-interface and configure the points in the selected target detection area in the point sub-interface to complete the configuration of frame C. If the user has already completed the configuration of frames A to C and needs to modify the points in target detection area b of frame C, in response to this visual inspection request, the product sub-interface is displayed on the first interface. After the user selects frame C in the product sub-interface and the detection area b in the area sub-interface, the user can then modify the point information of each point in each target detection area b in the point sub-interface.

[0082] The following is a detailed explanation of the configuration process in each sub-interface:

[0083] First, when the aforementioned visual inspection configuration request is entered by the user during the initial configuration, or when the user needs to configure a new product after completing the configuration of the product to be inspected, the product sub-interface will display the product information of each configured product to be inspected. The product information of products to be inspected that the user has not yet configured, or the product information of newly added products to be inspected, needs to be configured. Based on this, in one possible implementation, as shown in Figure 3, the visual inspection configuration method provided in this application embodiment further includes:

[0084] In step S300, in response to the product addition command input for the product sub-interface, the product information of the product to be tested indicated by the product addition command is displayed on the product sub-interface.

[0085] For example, suppose you need to configure frames A through C, but you haven't configured any of them yet. If you want to configure frame A first, you can enter a product addition command for frame A. In response to this command, the product information for frame A will be displayed on the product sub-interface. Or, if you have already configured frames A and B, and you want to configure frame C, you can enter a product addition command for frame C. In response, the product information for frame C will be displayed on the product sub-interface.

[0086] Figure 4 shows an example of the visual inspection configuration interface provided in this application embodiment. Users can add products to be inspected by clicking the "+" next to "Product List," and the product information of the added products to be inspected will be displayed in the "Product List." The product information includes, but is not limited to, product identifier, number of configured points, total number of preset points, and inspection area.

[0087] Using the method of this application embodiment, users can add products to be inspected according to their own needs, without being limited by the preset inspection range, thus increasing the application scope of visual inspection.

[0088] During user configuration, the product sub-interface displays the region information of each configured detection area. For detection areas not yet configured by the user, or if the user adds a new detection area, configuration is required. Based on this, in one possible implementation, as shown in Figure 5, the visual detection configuration method provided in this application embodiment further includes:

[0089] Step S400: In response to the region addition command input for the region sub-interface, determine the detection area indicated by the region addition command as the detection area of ​​the target product.

[0090] For example, suppose the user needs to configure detection areas 1-3 of frame A, but has not yet configured detection area 3 of frame A. The user enters a command to add a region for detection area 3 of frame A. In response to this command, the region information of detection area 3 of frame A is displayed in the region sub-interface. As shown in Figure 4, the detection area includes the top view and the left view. If the user wants to add other detection areas, they can add the target detection area by clicking the "+" to the right of "Detection Area".

[0091] By using the method of this application embodiment, users can select the area to be inspected of the product to be inspected according to their own needs, thereby reducing the visual inspection of unnecessary areas to be inspected and saving computing resources.

[0092] During the user configuration process, for a target detection area, the point sub-interface will display the point information of the points that have been configured in the target detection area. Points that have not yet been configured by the user or points added by the user need to be configured.

[0093] Understandably, to facilitate user confirmation of the selected target detection area, in one possible implementation, a view corresponding to the target product's target detection area is also displayed in the area sub-interface of the first interface. Figure 6 shows an example of the area sub-interface provided in this application embodiment. Users can determine whether the selected target detection area is correct based on the view corresponding to the target product's detection area displayed in the area sub-interface. The view corresponding to the target product's target detection area is pre-uploaded by the user. For example, if the user selects the top view, a schematic diagram of the vehicle frame corresponding to the top view is displayed; if the user selects the left view, a schematic diagram of the vehicle frame corresponding to the left view is displayed.

[0094] Understandably, if a user needs to perform a comprehensive visual inspection of the product to be inspected, they need to upload six views of the product. If a user only needs to perform a visual inspection of one side of the product, they only need to upload an image containing the target inspection area (i.e., the side to be inspected). For example, if the product to be inspected is a sheet material and the top surface of the sheet material needs to be visually inspected, the view is a top view of the sheet material. When the product to be inspected is the top of a vehicle frame and the top of the vehicle frame needs to be comprehensively visually inspected, the view includes the left, right, top, front, and rear views of the top of the vehicle frame.

[0095] Understandably, when uploading images, users can label which part of the product to be inspected corresponds to the component in the image. For example, the input image can be labeled as a top view of the vehicle frame or a left view of the outer door panel, etc. This allows users to select the target detection area based on the view corresponding to the part of the product to be inspected, and then configure the points in that target detection area.

[0096] To ensure visual inspection of all points on the product to be inspected, one possible implementation is to control a robotic arm to move a camera and capture images of each point in each inspection area. Specifically, there are at least the following two methods.

[0097] In the first method, as shown in Figure 1, at least one infrared camera 2 and at least one visible light camera 3 are installed on the robotic arm 1. The product to be inspected 4 is placed on the production line 5. One robotic arm 1 is set up for the same product to be inspected 4. The distance between the installation position of the robotic arm 1 and the product to be inspected 4 should be less than the preset working radius of the robotic arm 1.

[0098] In the second method, multiple robotic arms can be set up for the same product to be inspected. Each robotic arm can be equipped with both an infrared camera and a visible light camera, or some robotic arms can be equipped with infrared cameras and some with visible light cameras. The points that the multiple robotic arms can reach cover all points of the product to be inspected.

[0099] Understandably, regardless of whether one or multiple robotic arms are used for the same product to be inspected, capturing images at different points may require controlling different cameras. For example, when capturing images at position A, the robotic arm equipped with infrared camera 2 needs to be driven to capture an image at position A; similarly, when capturing images at position B, the robotic arm equipped with infrared camera 2 needs to be driven to capture an image at position B. Furthermore, if multiple robotic arms are used for the same product to be inspected, capturing images at different points may require driving different robotic arms.

[0100] Therefore, in order to accurately drive the target robotic arm and control the camera to capture images of the corresponding points, it is necessary to establish the association between the points, the camera, and the robotic arm when configuring the points. Based on this, in one possible implementation, as shown in Figure 7, the visual detection configuration method provided in this application embodiment further includes:

[0101] In step S500, in response to the point addition instruction input for the point sub-interface, the point indicated by the point addition instruction is determined in the view of the target detection area of ​​the target product, and the robotic arm and the camera on the robotic arm indicated by the point addition instruction are determined; the point is determined as the point of the target detection area, and the determined point, robotic arm and camera are associated.

[0102] The location information includes: the camera associated with the location, the robotic arm, and the area to which the view used to determine the location belongs.

[0103] For example, suppose that points 1 to 5 in the target detection area a need to be configured. If the current location to be configured is point 1, the user inputs a point addition command, determines the area to which point 1 belongs in the view of the target detection area a of the target product, and determines the robotic arm and the camera on the robotic arm indicated by the point addition command. Then, the point 1 is associated with the robotic arm and the camera on the robotic arm indicated by the point addition command, thereby completing the configuration of point 1.

[0104] Specifically, as shown in Figure 4, if a new location needs to be added, the user can add the new location by clicking the "+" on the right side of the "Location List".

[0105] Using the method of this application embodiment, users can select points in the target detection area according to their own needs and configure the point information, thereby establishing the association between the points and the robotic arm and camera. In the process of visual inspection, the robotic arm and camera can be accurately driven to take pictures of the points specified by the user, thereby improving the accuracy of visual inspection.

[0106] In the above embodiments, the camera on the robotic arm can be either an infrared camera or a visible light camera. Infrared cameras are used to detect defects such as cracks, bubbles, or looseness on the surface of the product being inspected, while visible light cameras are used to detect defects such as scratches, size, and shape on the surface of the product being inspected. Therefore, to make visual inspection more comprehensive, in one possible implementation, both an infrared camera and a visible light camera are simultaneously mounted on the same target robotic arm.

[0107] The robotic arm can be a multi-joint robotic arm, a Cartesian coordinate system robotic arm, or any other mechanical device capable of precisely positioning itself to a point in space for operation; this application does not limit this. To improve the positioning accuracy of the robotic arm, in one possible implementation, a six-axis robotic arm can be used as the target robotic arm.

[0108] In one possible implementation, as shown in FIG8, FIG8 is a detailed schematic diagram of step S500 in the embodiment shown in FIG7. Step S500 may include the following steps:

[0109] Step S501: In response to the point addition command input for the point sub-interface, a second interface including the robotic arm selection sub-interface, the camera selection sub-interface, and the point selection sub-interface is displayed.

[0110] The point selection sub-interface is used to display a view of the target detection area of ​​the target product;

[0111] Step S502: In response to the robotic arm selection command input to the robotic arm selection sub-interface, determine the robotic arm indicated by the robotic arm selection command as the robotic arm indicated by the point addition command.

[0112] Step S503: In response to the camera selection command input to the camera selection sub-interface, determine the camera indicated by the camera selection command and use it as the camera indicated by the point addition command.

[0113] Step S504: In response to the point selection instruction input for the view displayed in the point selection sub-interface, determine the point indicated by the point selection instruction in the view as the point indicated by the point addition instruction.

[0114] For example, taking a car frame as the product to be tested, the second interface is displayed after the user inputs a point addition command, as shown in Figure 9. Figure 9 is an example diagram of the second interface provided in this application embodiment. Assuming that the point name indicated by the point addition command input by the user is "Point 1", when configuring Point 1 in the second interface, the user can select "No robotic arm" as the robotic arm indicated by the point addition command, and select "Camera 1, Camera 2, Camera 4" as the cameras indicated by the point addition command. The user can also select points of interest in the frame schematic diagram in the second interface as points indicated by the point addition command, or can select the area around the point of interest to use the area of ​​interest as the point indicated by the point addition command.

[0115] Using the method of this application embodiment, users can determine the location according to their own needs, and determine the target robotic arm and camera corresponding to the location to complete the configuration of the location, which facilitates the accurate driving of the target robotic arm and control of the camera to take pictures of the corresponding location during the visual inspection process.

[0116] It is understandable that there may be multiple detection areas for the same target product. When configuring the points in the target detection area, if you want to change the target detection area, you can return to the first interface and reselect the target detection area in the first interface, or you can directly change the points in the second interface.

[0117] Based on this, in one possible implementation, during the display of the second interface, if a view switching instruction is received for the point selection sub-interface, then in response to the instruction, the target view indicated by the view switching instruction is determined in the respective views of each detection area of ​​the target product, the view displayed in the point selection sub-interface is switched to the target view, and the target detection area is switched to the detection area to which the target view belongs.

[0118] For example, as shown in Figure 9, assuming the target detection area is a top view, the top view currently displayed in the point selection sub-interface of the second interface can be switched to a left view if the user wants to switch the view displayed in the point selection sub-interface to a left view. The user can input the view switching command by clicking "left side" above the vehicle frame diagram. In response to the command, it is determined whether a "left view" exists in the respective view of each detection area. If it exists, the view displayed in the point selection sub-interface is switched to a left view, and the "top view" of the target detection area is switched to "left side".

[0119] Using the method of this application embodiment, users can directly switch the target detection area through the second interface without having to return to the first interface to reselect it, thus improving the convenience of operation.

[0120] Understandably, different products to be inspected are configured with different detection algorithms, and the parameter values ​​of the robotic arm, camera, and algorithm parameters will also differ at different detection points of the same product. Therefore, when configuring the detection points in the first interface, it is also necessary to configure the parameters of the camera and robotic arm associated with each detection point.

[0121] Based on this, in one possible implementation, as shown in FIG10, the visual detection configuration method provided in this application embodiment further includes the following steps:

[0122] In step S600, in response to a parameter configuration command input for any point information, the third interface is displayed;

[0123] The third interface includes parameter configuration sub-interfaces for each camera associated with the target point, where the target point is the point to which the parameter configuration command belongs.

[0124] Step S700: In response to a parameter selection instruction input for any parameter configuration sub-interface, determine the parameter indicated by the parameter selection instruction and associate the target camera with the determined parameter;

[0125] The target camera is the camera corresponding to the camera parameter configuration sub-interface targeted by the parameter selection command.

[0126] In one possible implementation, the parameters include at least one of the following: shooting mode, highlight, exposure, gain, gamma, light source brightness, and machine vision algorithm parameters.

[0127] In one specific embodiment, assuming a user wants to configure the parameters of the camera associated with point 1, the user can input parameter configuration commands for point 1 on the first interface. For example, as shown in Figure 3, the user can input parameter configuration commands by clicking "Configure" on point 1. The third interface displayed in response to the parameter configuration commands is shown in Figure 11. The display interface includes various camera parameters, such as highlight, exposure, gain, gamma, CH1 parameters, CH2 parameters, associated image acquisition parameters, and associated detection parameters.

[0128] Among them, highlight is a preset parameter, exposure, gain, and gamma are image parameters, CH1 and CH2 are light source parameters, associated image acquisition parameters and associated detection parameters are process parameters, associated image acquisition parameters are other imaging-related parameters besides exposure, gain, and gamma, such as digital amplifier and digital gain, and associated detection parameters are algorithm configuration parameters outside of imaging.

[0129] Users can set the values ​​of various parameters. For example, in Figure 11, the values ​​of exposure, gain, gamma, CH1 parameter, and CH2 parameter are all 100. Users can adjust the values ​​of each parameter by entering them or clicking the buttons in the box. Users can also click the "Quick Configuration" button to quickly configure the associated color image parameters and associated detection parameters. Furthermore, users can click the buttons corresponding to the cameras associated with that point to configure the parameters of each camera individually. For example, clicking "Camera 2" will configure the parameters of Camera 2.

[0130] Since the defect detection algorithm used for each point of the same product is the same, the total number of algorithm parameters used in the process of using the target defect detection algorithm to detect defects at each point is also the same. The difference lies in the fact that some parameter values ​​in the total number of algorithm parameters may be different. If the total number of algorithm parameters were configured one by one for each point, the configuration process would be cumbersome and time-consuming. Therefore, in another possible implementation, the parameters include machine vision algorithm parameters.

[0131] In this embodiment, as shown in FIG12, FIG12 is a detailed schematic diagram of step S700 in FIG10. The above-mentioned step S700 specifically includes:

[0132] Step S701: Display the parameter types of all algorithm parameters used in the visual inspection process;

[0133] Step S702: In response to the type selection instruction for the displayed parameter type input, determine the parameter type to be configured indicated by the type selection instruction;

[0134] Step S703: Display the fourth interface, which includes the algorithm parameter configuration sub-interfaces corresponding to each type of parameter to be configured.

[0135] Step S704: In response to the algorithm parameter configuration instruction input for any algorithm parameter configuration sub-interface, determine the parameter value indicated by the algorithm parameter configuration instruction, and use the machine vision parameter whose value is the determined parameter value and whose type is the target parameter type as the machine vision algorithm parameter indicated by the parameter selection instruction.

[0136] The target parameter type is the parameter type to be configured corresponding to the algorithm parameter configuration sub-interface targeted by the algorithm parameter configuration command.

[0137] For example, as shown in Figure 13, when performing machine vision inspection parameters, the user is first shown the parameter types of all algorithm parameters used in the visual inspection process, such as process parameters, contour matching, and image source. Each parameter type includes at least one parameter. For example, contour matching includes contour matching 1, and basic parameters include output mask, region type, creation, shape, inheritance method, region, center point X, center point Y, width, height, angle, masking area, and position correction. After the user selects the type of parameter to be configured, the selected parameter is displayed in the "Measurement Parameters" section on the right side of Figure 13. Then, the algorithm parameter configuration sub-interface corresponding to each parameter type is displayed in the fourth interface. Figure 14 shows an example diagram of the fourth interface provided in this embodiment. As shown in Figure 14, the user can configure the parameter values ​​of the parameters to be configured in the fourth interface.

[0138] It is understood that the parameters to be configured in the embodiments of this application can be algorithm parameters that need to be configured by the user in the visual detection algorithm, or algorithm parameters that need to be configured in the user-defined algorithm, i.e., custom parameters. Alternatively, some of the parameters to be configured can be algorithm parameters that need to be configured by the user in the visual detection algorithm, and some can be custom parameters.

[0139] For example, as shown in Figure 14, users can configure the algorithm parameters that need to be configured by themselves in the selected visual detection algorithm, such as template number, line search, shielding area, filter size, and camera-data queue adoption value, as well as the custom parameters such as script name, branch name, aperture number, and aperture area.

[0140] Using the method of this application embodiment, for each point, the user only needs to configure the parameters to be configured, instead of configuring all the algorithm parameters for each point, which reduces the complexity of algorithm configuration and improves configuration efficiency.

[0141] Understandably, in order to make the set parameter values ​​better meet the user's needs, the parameter values ​​of each parameter to be configured can be determined based on the configuration effect during the configuration process.

[0142] Based on this, in one possible implementation, the visual detection configuration method provided in this application embodiment further includes:

[0143] After using the determined parameter values ​​and target parameter types as the machine vision algorithm parameters indicated by the parameter selection instruction, machine vision simulation is performed according to the machine vision algorithm parameters indicated by the existing parameter selection instruction, and the simulation results are displayed in the preview sub-interface.

[0144] For example, as shown in Figure 14, the right side of Figure 14 displays the simulation results obtained by performing machine vision simulation according to the machine vision algorithm parameters indicated by the existing parameter selection instructions. When the user modifies the parameter values ​​of each parameter to be configured on the left side of Figure 14, the simulation results on the right side will also change accordingly. The user can set the algorithm parameter values ​​that meet the requirements according to the simulation results.

[0145] After adjusting the values ​​of the various configurable parameters, if the user believes that the currently displayed simulation results meet their requirements, they can click the "OK" button in Figure 14 to confirm that the currently set algorithm parameter values ​​meet their needs. This allows users to adjust the algorithm parameter values ​​based on the simulation results, helping them better understand the impact of different parameters and ensuring that the set parameter values ​​better meet their needs.

[0146] It is understandable that there may be some correlation between the various configurable parameters selected by the user. For example, parameters 1-5 are related, and parameters 6-10 are related. To help users understand the correlation between the parameters, in one possible implementation, users can group the configurable parameters and display the corresponding sub-interfaces for each group on the fourth interface.

[0147] Based on this, in one possible implementation, the visual detection method provided in this application further includes:

[0148] In response to a grouping instruction input for the parameter type to be configured, the parameter type to be configured is divided into multiple parameter groups;

[0149] The fourth interface includes sub-interfaces corresponding to each parameter group, and each sub-interface corresponding to a parameter group includes an algorithm parameter configuration sub-interface for each parameter type to be configured in the parameter group.

[0150] It is understood that in the above embodiments, after the point configuration is completed, the camera parameter configuration process and the algorithm parameter configuration process do not have a specific order. The camera parameters can be configured first, or the algorithm parameters can be configured first. This application does not limit this.

[0151] Based on the above, in the process of configuring the target product, it is necessary to configure the target detection area and the points in the target detection area. Each target product may have multiple target detection areas and points in the target detection area. Therefore, in order to facilitate users to understand the point configuration process and complete the configuration of all points, in one possible implementation, product information such as product identifier, number of configured points, and total number of preset points for the product to be detected can be displayed in the product sub-interface of the first interface. The number of configured points is the number of points associated with the product to be detected, and the detection area information includes a view of the detection area.

[0152] For example, as shown in Figure 4, after configuring a point on the A-type frame, the number of configured points and the preset total number of points are displayed to the user in the number of points "20 / 20". The first "20" indicates the number of configured points, and the second "20" indicates the preset total number of points.

[0153] Understandably, different display styles can be used to show the number of monitoring points (PCPs) when all PCPs of the product under test have been configured and when they have not, so that users can notice this information immediately and understand the PCP configuration progress. For example, when the PCPs of the product under test are not fully configured, the number of PCPs—that is, the number of configured PCPs and the preset total number of PCPs—is displayed using the first style. After all PCPs of the product under test have been configured, the number of configured PCPs and the preset total number of PCPs are displayed using the second style. The first style and the second style are different.

[0154] To more clearly illustrate the visual detection configuration method of this application embodiment, a detailed description is provided below in conjunction with the accompanying drawings.

[0155] It is understandable that there may be multiple products to be tested. Therefore, before configuring the testing points for the products to be tested, it is necessary to configure the model of the products to be tested and the testing area of ​​the products to be tested in the product list. For example, product 1 to be tested is a type A frame, product 2 to be tested is a type B frame, and product 3 to be tested is a type C frame.

[0156] As shown in Figure 4, when configuring the model of the product to be tested in the product list, it is necessary to configure the model, identification number (code) of the product to be tested, and the number of preset points on the product to be tested. For example, the code of the A-type frame can be set as "A123456" and the number of preset points can be set as 20 in the product list.

[0157] After the user selects the target product to be configured, the target detection area of ​​the target product that needs to be visually inspected is selected, and the image of the target detection area of ​​the target product that the user has uploaded in advance is displayed in the detection area of ​​Figure 4. For example, if the target product is an A-type frame and the target detection area is the top of the A-type frame, then the corresponding frame diagram is displayed in the detection area of ​​Figure 4.

[0158] For the images displayed in the detection area, the points can be configured according to the preset number of points. As shown in Figure 4, clicking the configuration button corresponding to point 1 displays the interface shown in Figure 9. This interface displays a view of the target detection area. Users can select points of interest or select the area around a point of interest as point 1. Then, the association between this point and the robotic arm and camera is established, that is, the communication robotic arm and the bound camera corresponding to this point are determined. For example, as shown in Figure 9, after the user determines point 1 in the image to be detected, it is determined that this point does not require the robotic arm to drive the camera for shooting. Therefore, the communication robotic arm of point 1 is selected as "no robotic arm". Cameras 1, 2, and 4 are bound to point 1. During defect detection, cameras 1, 2, and 4 take pictures of point 1 of the product to be detected. After completing the point selection and binding of the robotic arm and camera, clicking the "OK" button completes the configuration of this point.

[0159] Then, configure the parameters corresponding to that point. As shown in Figure 11, after configuring the point, configure the parameter values ​​of camera parameters such as highlight, exposure, gain, gamma, CH1 brightness, and CH2 brightness. Users can modify the parameter values ​​of each camera parameter according to their needs to obtain the camera parameters corresponding to that point.

[0160] As shown in Figure 4, after configuring a point, you can also click the "View Detection Area" button to view the location of that point in the target detection area.

[0161] Then, the process parameters of the visual inspection algorithm are set, such as the image acquisition process parameters and the inspection process parameters. As shown in Figure 13, all algorithm parameters used in the execution of the visual inspection algorithm are displayed to the user. The user can select the parameters to be modified and reconfigured. The interface shown in Figure 13 displays the user-selected parameters and the simulation results obtained by performing machine vision simulation according to the machine vision algorithm parameters indicated by the existing parameter selection instructions. The user can adjust the algorithm parameter values ​​according to the simulation results to determine the target algorithm parameter values ​​corresponding to that point. This completes the complete configuration process for a point.

[0162] During the visual inspection process, if it is necessary to set the parameters corresponding to a certain point, only the parameters to be configured for that point need to be set, without setting all the algorithm parameters. This will complete the parameter correction for that point and allow for a quick entry into the visual inspection process.

[0163] Corresponding to the first aspect mentioned above, a second aspect of the embodiments of this application provides a visual inspection configuration device, as shown in FIG15, the device comprising:

[0164] Input module 1501 is used to receive visual inspection configuration requests;

[0165] The configuration module 1502 is used to respond to the received visual inspection configuration request and output a first interface. The first interface includes a product sub-interface, a region sub-interface, and a point sub-interface. The product sub-interface is used to display product information. The region sub-interface is used to display the detection area information of each detection area in the target product. The point sub-interface is used to display the point information of each point in the target detection area. The target product is the product to which the selected product information belongs, and the target detection area is the detection area to which the selected detection area information belongs.

[0166] According to the embodiments of this application, upon receiving a visual inspection configuration request, a first interface is output in response to the received request. The first interface includes a product sub-interface, a region sub-interface, and a point sub-interface. The product sub-interface displays product information for each product to be inspected; the region sub-interface displays the inspection area information for each inspection area within the product to which the selected product information belongs; and the point sub-interface displays the point information for each point within the inspection area to which the selected inspection area information belongs. The first interface efficiently displays the configuration status of each product to be inspected to the user. When configuring a product to be inspected, the user can refer to the configuration status of other products to be inspected based on the product information displayed in the product sub-interface, the inspection area information for each inspection area within the target product displayed in the region sub-interface, and the point information for each point within the target inspection area displayed in the point sub-interface, thus enabling accurate configuration of the product to be inspected.

[0167] A third aspect of the present application provides a visual inspection system, the system including a terminal device, a controller, and a robotic arm, the robotic arm being equipped with a camera;

[0168] The terminal device is used to execute any of the visual inspection configuration methods in the first aspect above, and to send the points of each inspection area of ​​each product to be inspected to the controller;

[0169] The controller is used to control the robotic arm to move the camera to capture images of each point in each inspection area of ​​each product to be inspected, and to perform visual inspection of the product based on the captured images.

[0170] According to the embodiments of this application, upon receiving a visual inspection configuration request, a first interface is output in response to the received request. The first interface includes a product sub-interface, a region sub-interface, and a point sub-interface. The product sub-interface displays product information for each product to be inspected; the region sub-interface displays the inspection area information for each inspection area within the product to which the selected product information belongs; and the point sub-interface displays the point information for each point within the inspection area to which the selected inspection area information belongs. The first interface efficiently displays the configuration status of each product to be inspected to the user. When configuring a product to be inspected, the user can refer to the configuration status of other products to be inspected based on the product information displayed in the product sub-interface, the inspection area information for each inspection area within the target product displayed in the region sub-interface, and the point information for each point within the target inspection area displayed in the point sub-interface, thus enabling accurate configuration of the product to be inspected.

[0171] This application also provides an electronic device, as shown in FIG16, including:

[0172] Memory 1601 is used to store computer programs;

[0173] When processor 1602 executes the program stored in memory 1601, it performs the following steps:

[0174] Receive visual inspection configuration requests;

[0175] In response to receiving the visual inspection configuration request, a first interface is output; the first interface includes a product sub-interface, a region sub-interface, and a point sub-interface; the product sub-interface is used to display product information of each product to be inspected; the region sub-interface is used to display the inspection region information of each inspection region in the target product; the point sub-interface is used to display the point information of each point in the target inspection region, wherein the target product is the product to which the selected product information belongs, and the target inspection region is the inspection region to which the selected inspection region information belongs.

[0176] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.

[0177] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0178] In another embodiment provided in this application, a computer-readable storage medium is also provided, which stores a computer program that, when executed by a processor, implements the steps of any of the above-described visual detection configuration methods.

[0179] In another embodiment provided in this application, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to execute any of the visual detection configuration methods described above.

[0180] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a solid-state drive (SSD), etc.

[0181] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0182] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device and system embodiments are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0183] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A visual inspection configuration method, characterized in that, The method includes: Receive visual inspection configuration requests; In response to receiving the visual inspection configuration request, a first interface is output; the first interface includes a product sub-interface, a region sub-interface, and a point sub-interface; the product sub-interface is used to display product information of each product to be inspected; the region sub-interface is used to display the inspection region information of each inspection region in the target product; the point sub-interface is used to display the point information of each point in the target inspection region, wherein the target product is the product to which the selected product information belongs, and the target inspection region is the inspection region to which the selected inspection region information belongs.

2. The method according to claim 1, characterized in that, The method further includes: In response to a product add command input to the product sub-interface, the product information of the product to be tested indicated by the product add command is displayed on the product sub-interface.

3. The method according to claim 1, characterized in that, The method further includes: In response to a region addition command input to the region sub-interface, the detection region indicated by the region addition command is determined as the detection region of the target product.

4. The method according to claim 1, characterized in that, The method further includes: In response to a point-adding instruction input to the point sub-interface, the point indicated by the point-adding instruction is determined in the view of the target detection area of ​​the target product, and the robotic arm and the camera on the robotic arm indicated by the point-adding instruction are determined; the point is determined as a point in the target detection area, and the determined point, robotic arm and camera are associated. The location information includes: the camera associated with the location, the robotic arm, and the region to which the view used to determine the location belongs.

5. The method according to claim 4, characterized in that, The step of responding to a point-adding command input to the point sub-interface, determining the point indicated by the point-adding command in the view of the target detection area of ​​the target product, and determining the robotic arm indicated by the point-adding command and the camera on the robotic arm, includes: In response to a point addition command input to the point sub-interface, a second interface is displayed, including a robotic arm selection sub-interface, a camera selection sub-interface, and a point selection sub-interface, wherein the point selection sub-interface is used to display a view of the target detection area of ​​the target product. In response to a robotic arm selection command input to the robotic arm selection sub-interface, the robotic arm indicated by the robotic arm selection command is determined as the robotic arm indicated by the point addition command. In response to a camera selection command input to the camera selection sub-interface, the camera indicated by the camera selection command is determined as the camera indicated by the point addition command; In response to a point selection command input to the view displayed in the point selection sub-interface, the point indicated by the point selection command is determined in the view as the point indicated by the point addition command.

6. The method according to claim 5, characterized in that, The method further includes: In response to a view switching command input to the point selection sub-interface, the target view indicated by the view switching command is determined in the respective views of each detection area of ​​the target product, the view displayed in the point selection sub-interface is switched to the target view, and the target detection area is switched to the detection area to which the target view belongs.

7. The method according to claim 4, characterized in that, The method further includes: In response to a parameter configuration command input for any point location information, a third interface is displayed, wherein the third interface includes parameter configuration sub-interfaces corresponding to each camera associated with the target point location, and the target point location is the point location to which the point location information targeted by the parameter configuration command belongs; In response to a parameter selection instruction input for any parameter configuration sub-interface, the parameter indicated by the parameter selection instruction is determined, and the target camera is associated with the determined parameter, wherein the target camera is the camera corresponding to the camera parameter configuration sub-interface targeted by the parameter selection instruction.

8. The method according to claim 7, characterized in that, The parameters include at least one of the following: shooting mode, brightness, exposure, gain, gamma, light source brightness, and machine vision algorithm parameters.

9. The method according to claim 7, characterized in that, The parameters include machine vision algorithm parameters; Determining the parameters indicated by the parameter selection instruction includes: This demonstrates the parameter types of all algorithm parameters used in the visual inspection process; In response to a type selection instruction for the displayed parameter type input, determine the type of the parameter to be configured indicated by the type selection instruction; A fourth interface is displayed, including the algorithm parameter configuration sub-interfaces corresponding to each of the aforementioned parameter types. In response to an algorithm parameter configuration instruction input for any algorithm parameter configuration sub-interface, the parameter value indicated by the algorithm parameter configuration instruction is determined, and the machine vision parameter whose value is the determined parameter value and whose type is the target parameter type is used as the machine vision algorithm parameter indicated by the parameter selection instruction, wherein the target parameter type is the parameter type to be configured corresponding to the algorithm parameter configuration sub-interface targeted by the algorithm parameter configuration instruction.

10. The method according to claim 9, characterized in that, The fourth interface also includes a preview sub-interface; The method further includes: After using the determined parameter values ​​and target parameter types as the machine vision algorithm parameters indicated by the parameter selection instruction, machine vision simulation is performed according to the existing machine vision algorithm parameters indicated by the parameter selection instruction, and the simulation results are displayed on the preview sub-interface.

11. The method according to claim 9, characterized in that, The method further includes: In response to a grouping instruction input for the parameter type to be configured, the parameter type to be configured is divided into multiple parameter groups; The fourth interface includes sub-interfaces corresponding to each parameter group, and each sub-interface corresponding to a parameter group includes an algorithm parameter configuration sub-interface corresponding to each parameter type to be configured in the parameter group.

12. The method according to claim 1, characterized in that, The product information includes: product identifier, number of configured points, and total number of preset points for the product to be tested, wherein the number of configured points is the number of points associated with the product to be tested; The detection area information includes a view of the detection area.

13. A visual inspection configuration device, characterized in that, The device includes: The input module is used to receive visual inspection configuration requests; The configuration module is used to respond to the received visual inspection configuration request and output a first interface; the first interface includes a product sub-interface, a region sub-interface, and a point sub-interface; the product sub-interface is used to display product information; the region sub-interface is used to display the detection region information of each detection region in the target product; the point sub-interface is used to display the point information of each point in the target detection region, wherein the target product is the product to which the selected product information belongs, and the target detection region is the detection region to which the selected detection region information belongs.

14. A visual inspection system, characterized in that, The system includes a terminal device, a controller, and a robotic arm, with a camera mounted on the robotic arm; The terminal device is used to execute the visual inspection configuration method according to any one of claims 1-12, and send the points of each detection area of ​​each product to be inspected to the controller; The controller is used to control the robotic arm to move the camera to capture images of each point in each detection area of ​​each product to be inspected, and to perform visual inspection on the product to be inspected based on the captured images.

15. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor, when executing a program stored in memory, implements the visual detection configuration method according to any one of claims 1-12.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the visual inspection configuration method according to any one of claims 1-12.

Images