Inspection device, inspection method, program, recording medium and manufacturing method of article
The inspection apparatus addresses the inefficiency in setting robot actions by integrating imaging, display, and processing units to optimize workflow efficiency through tailored robot operations based on inspection results.
Patent Information
- Application Number
- JP2023077116
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-09
- Publication Date
- 2024-11-21
AI Technical Summary
Existing visual inspection systems lack a method for efficiently setting the next action for a robot based on inspection results, making it difficult to optimize workflow efficiency.
An inspection apparatus that includes an imaging unit, a robot, a display unit, and a processing unit to inspect, display, and generate operation commands for the robot based on inspection results, allowing efficient setting of robot actions.
Enables efficient robot operation post-inspection by allowing the robot to perform actions tailored to the inspection results, improving workflow efficiency and reducing unnecessary re-inspection.
Smart Images

Figure 2024161999000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an inspection device that inspects an object using a captured image. [Background technology]
[0002] There is known an appearance inspection system for inspecting the surface of a workpiece for scratches, assembly defects, etc. Patent Document 1 describes an appearance inspection system that captures an inspection portion of an inspection object with an imaging device, inspects the inspection portion for defects based on the obtained image, and displays the inspection portion and the inspection results in correspondence with each other in a three-dimensional model corresponding to the inspection object. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2020-3301 A Summary of the Invention [Problem to be solved by the invention]
[0004] According to the appearance inspection system described in Patent Document 1, the inspection results for each inspection part are displayed in correspondence with a three-dimensional model, enabling the user to easily understand which part of the object being inspected the inspection results correspond to.
[0005] Incidentally, when performing visual inspection, in order to make the work more efficient, a robot can be used to handle the imaging device or the object to be inspected and take a photograph. In this case, the operation to be performed by the robot after taking the photograph may differ depending on the result of the visual inspection. In the visual inspection system described in Patent Document 1, a method is proposed for displaying the inspection result in a way that is easy for the user to understand, but a method for setting the next operation to be performed by the robot depending on the inspection result is not considered. For this reason, when the inspection object is photographed and the inspection result is displayed, the user cannot efficiently set the next operation of the robot. [Means for solving the problem]
[0006] One aspect of the present invention is an inspection device comprising an imaging unit, a robot that moves at least one of the imaging unit and the workpiece so that the workpiece is in a positional relationship that allows the imaging unit to image the workpiece, a display unit, and a processing unit, wherein the processing unit performs an inspection process that inspects the workpiece using an image of the workpiece imaged by the imaging unit, a display process that displays on the display unit a model of the workpiece, information indicating the imaged portion of the workpiece imaged by the imaging unit, and a result of the inspection process corresponding to the imaged portion, and a generation process that generates an operation command to operate the robot based on the result of the inspection process. Effect of the Invention
[0007] According to the present invention, in an inspection device that uses a robot to photograph and inspect an object to be inspected, the operation of the robot after photographing the object to be inspected can be efficiently set according to the inspection results. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a schematic external perspective view of an inspection device according to an embodiment. [Diagram 2] FIG. 1 is a schematic block diagram of an inspection apparatus according to an embodiment. [Diagram 3] FIG. 1 is an external view of an example of a robot. [Figure 4] FIG. 4 is a diagram showing an example of an information processing unit. [Diagram 5] 4 shows an example of a display screen of the inspection device according to the embodiment. [Figure 6] 4 shows an example of a display screen of the inspection device according to the embodiment. [Figure 7] 4 shows an example of a display screen of the inspection device according to the embodiment. [Figure 8] 11 is a flowchart illustrating a processing procedure executed by a motion generating unit. [Figure 9] 4 shows an example of a display screen of the inspection device according to the embodiment. [Figure 10] 4 shows an example of a display screen of the inspection device according to the embodiment. [Figure 11] 4 shows an example of a display screen of the inspection device according to the embodiment. [Figure 12] 4 shows an example of a display screen of the inspection device according to the embodiment. [Figure 13] 4 shows an example of a display screen of the inspection device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] An inspection device, an inspection method, and the like according to embodiments of the present invention will be described with reference to the drawings. Note that the embodiments shown below are merely examples, and those skilled in the art can appropriately modify and implement the detailed configurations without departing from the spirit and scope of the present invention.
[0010] In the drawings referred to in the following description of the embodiments, elements denoted by the same reference numerals have the same functions unless otherwise noted. When a plurality of identical elements are arranged in a drawing, the reference numerals and their descriptions may be omitted.
[0011] In addition, since the drawings may be represented diagrammatically for the convenience of illustration and explanation, the shape, size, arrangement, etc. of the elements depicted in the drawings may not strictly correspond to the actual objects.
[0012] [Embodiment] FIG. 1 is a schematic perspective view of the exterior of an inspection device according to an embodiment, and FIG. 2 is a schematic block diagram of the inspection device. The inspection device includes a robot 10, a robot control unit 40, and an information processing unit 50. The inspection device inspects the exterior of a workpiece 30 placed on a fixed base 31. In this embodiment, in order to facilitate control of the position and orientation of the robot when imaging a specific portion of the inspection object, the workpiece 30 is positioned on the fixed base 31 whose coordinates are known in advance, but the inspection object and the method of setting it are not limited to this example. In short, it is sufficient that the inspection device can image a specific portion of the inspection object.
[0013] As the robot 10, for example, a six-axis controlled vertical articulated robot is preferably used, but other types of robots may also be used, and various types of robots may be used, such as a horizontal articulated robot (SCARA robot), a parallel link robot, a linear joint type robot, etc. In other words, any type of robot may be used as long as it has a movable part that can automatically perform movements such as expansion and contraction, bending and stretching, vertical movement, horizontal movement, or rotation, or a combination of these movements, based on an operation command from the robot control unit 40.
[0014] An imaging device 20 is attached to the robot 10, and the imaging device 20 can capture images at an angle of view that corresponds to the position and posture of the robot 10. However, the imaging device 20 does not necessarily need to be fixedly attached to the robot 10. For example, the robot 10 may capture images by changing the position and posture while holding the imaging device 20.
[0015] FIG. 3 shows an external view of an example of a robot 10. The robot 10 shown in the figure is a vertical articulated robot having six rotary joints. The robot 10 has a base 11 as a base end and links 12 to 16 connected via joints. An imaging device 20 is attached to the tip of the robot 10. The imaging device 20 has a camera body 21 and is communicatively connected to a robot control unit 40 by a signal line (not shown) or wirelessly. In the figure, the angle of view and the focal plane determined by the imaging optical system are typically shown as an imaging field of view 22. The robot 10 and the imaging device 20 are communicatively connected to the robot control unit 40 by wire or wirelessly, and operate according to an operation command from the robot control unit 40. The connection can be configured using a communication standard for wired communication such as IEEE802.3, or wireless communication such as IEEE802.11 or IEEE802.15.
[0016] The robot control unit 40 is connected to the robot 10 and is also connected to the information processing unit 50 so as to be able to communicate with it via wire or wirelessly. The robot control unit 40 is a control device that has functions such as sending operation commands to the robot 10 to control the operation of the robot 10, controlling the imaging device 20 to obtain captured images, and communicating with the information processing unit 50 to send and receive information related to the operation and captured images.
[0017] The information processing unit 50 is a computer that controls the overall operation of the inspection device to perform visual inspection and executes information processing regarding the next operation of the robot 10 based on the inspection results. An example is shown in Fig. 4, in which the information processing unit 50 is equipped with a computer main body 51 equipped with a CPU, a display 52 as a display unit, and a keyboard 54 and a mouse 53 as input units. In the block diagram shown in Fig. 2, the portion surrounded by a dotted line in the information processing unit 50 indicates hardware components, and the inspection unit F1, display control unit F2, and operation generation unit F3 outside the dotted line indicate functional blocks realized by a computer.
[0018] The information processing unit 50 includes, as hardware components, a CPU, a ROM, a RAM, an I / O port, an input unit, a display unit, and the like. An operation program for the inspection device is stored in the ROM. The program for executing various processes related to the inspection method of this embodiment may be stored in the ROM like other operation programs, or may be loaded into the RAM from outside via a network. Alternatively, the program may be loaded into the RAM via a computer-readable recording medium on which the program is recorded.
[0019] The I / O port is connected to an external device or network (not shown) and can input and output data required for visually inspecting a specific object between an external computer and the I / O port. The I / O port is also connected to a display unit and an input unit and can display information on the operating status of the inspection device to an operator and can receive input from the operator.
[0020] The input unit can be configured by a terminal such as a handheld terminal, or a device such as a keyboard, a jog dial, a mouse, a pointing device, or a voice input device (or a control terminal equipped with these). The display unit can be anything that can display information related to the appearance inspection process described below on a display screen, and can be, for example, a liquid crystal display device, an organic EL display device, or a projection display device.
[0021] Each functional block of the inspection unit F1, the display control unit F2, and the operation generation unit F3 is realized by a processor such as a CPU or a GPU executing processing according to a program of the inspection method. However, some or all of the functional blocks may be configured by hardware such as an ASIC. Note that each functional element shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. For example, the specific form of distribution and integration of each functional block is not limited to the illustrated example, and all or a part of them can be functionally or physically distributed and integrated in any unit according to the usage situation, etc. For example, the robot control unit may have some of the functions of the information processing unit 50, or the robot control unit 40 and the information processing unit 50 may be physically integrated in part or all. The information processing unit 50 can be configured using various computers such as a desktop PC, a laptop PC, a tablet PC, a general-purpose computer such as a smartphone, and a teaching pendant.
[0022] Next, an inspection method executed by the inspection device will be described. In the following description, a portion imaged using the imaging device 20 may be referred to as an imaging portion, a predetermined portion of the workpiece 30, a portion to be visually inspected, an inspection portion, or the like.
[0023] Programs for performing visual inspection are prestored in the ROM of the information processing unit 50. The programs can include a program for moving the robot 10 to a position for photographing a predetermined portion of the workpiece 30, a program for causing the imaging device 20 to photograph the predetermined portion of the workpiece 30 to obtain an inspection image, a program for inspecting the workpiece based on the inspection image, and a program for setting the operation of the robot 10 based on the inspection result.
[0024] When the CPU of the information processing unit 50 starts executing the program, the inspection unit F1 generates a command to move the robot 10 to an imaging position based on the position information of the workpiece 30 and information on the part of the workpiece 30 to be visually inspected. In addition, after the movement of the robot 10 is completed, a command is generated to cause the imaging device 20 to image the inspection part of the workpiece 30. The information processing unit 50 transmits the command generated by the inspection unit F1 to the robot control unit 40 via an I / O port.
[0025] The robot control unit 40 interprets the received command and sends an operation command to the robot 10 to move the robot 10 to a position and posture for photographing the inspection portion of the workpiece 30. Then, the robot control unit 40 sends an operation command to the imaging device 20 to photograph the inspection portion of the workpiece 30 and transmit the photographed inspection image to the robot control unit 40.
[0026] When the robot control unit 40 receives the examination image from the imaging device 20, it transfers it to the information processing unit 50. The information processing unit 50 associates the examination image with information on the examination site (or information related to the position and posture of the robot 10 at the time of photographing) and stores them in the storage unit.
[0027] Next, the inspection unit F1 of the information processing unit 50 reads out the inspection image from the storage unit, and inspects the state of the portion to be inspected of the workpiece 30. The inspection items and inspection methods can be various depending on the purpose of the inspection.
[0028] For example, if the workpiece 30 is an exterior part of a product, the user sets the exterior part that can be observed as the inspection part and takes an inspection image. Then, based on the taken inspection image, appropriate analysis is performed on the paint color, shape, texture state, presence or absence of scratches, presence or absence of dirt, etc., to inspect the quality of the appearance.
[0029] For example, when the work 30 is a product assembled from multiple parts and the product is to be inspected for quality, the locations where the parts are assembled are set as inspection areas and inspection images are taken. Then, based on the inspection images taken, appropriate inspections can be performed to check whether any parts are missing, whether the assembled parts are correct, etc.
[0030] Also, for example, if the workpiece 30 is an item with marks or letters, the part with the marks or letters is set as the inspection area and an inspection image is taken. Then, based on the taken inspection image, appropriate inspections can be performed, such as whether the correct marks or letters are applied.
[0031] These are just some examples of possible visual inspections, but various image recognition and image processing methods, including pattern matching, template matching, edge processing, and filtering, can be used to analyze the captured inspection images. Alternatively, inspections can be performed using machine-learned models (various artificial intelligence methods, including neural networks).
[0032] Incidentally, the operation that the robot should perform on the workpiece after the result of the visual inspection is known may vary depending on the inspection result. According to this embodiment, by using the information processing unit 50, the operation of the robot after the inspection object is photographed can be efficiently set depending on the inspection result.
[0033] For example, if the inspection result shows that some of the captured inspection images were not captured properly due to a sudden change in external light or the inclusion of an unexpected obstacle, the robot needs to re-photograph the inspection area. Also, for example, if a scratch or the like is detected in a specific inspection area of the workpiece, it may be necessary to re-photograph the inspection area after repairing the scratch or the like and re-inspect whether the repair was completed correctly. In these cases, in consideration of work efficiency, it is desirable to re-photograph only the area where a defect was detected and re-inspect it, rather than re-photographing and re-inspecting all inspection areas of the workpiece.
[0034] Even if reinspection is not necessary, for example, if the workpiece is determined to be a non-defective product, the workpiece may be transported to the next manufacturing process, and if the workpiece is defective, the workpiece may be transported to a disposal route. In this way, the operation that the robot should perform may differ depending on whether the result of the inspection process satisfies a predetermined standard or not.
[0035] Fig. 5 illustrates an example of a display screen 100 when the display control unit F2 (Fig. 2) executes a display process to display information related to the appearance inspection on the display 52 (Fig. 4) in this embodiment. Figs. 6 to 7 and 9 to 13 illustrate examples in this embodiment in which an image different from that in Fig. 5 is displayed on the display screen 100. The display screen 100 is configured to include an imaging point display section 200, an inspection information display section 300, and a virtual space display section 400.
[0036] The names of the imaging points P1 to P4 registered in the storage unit are displayed in a list format on the imaging point display unit 200. The name and coordinates of each imaging point, information related to the position and posture of the robot 10 at each imaging point, and inspection image data captured at each imaging point are stored in the storage unit of the information processing unit 50 in a linked manner.
[0037] An image in which models of the robot 10 and the workpiece 30 are arranged in the virtual space in the same positional relationship as in the real space is displayed on the virtual space display unit 400. Furthermore, together with these models, inspection information 401 to 404 corresponding to imaging points P1 to P4, respectively, may be displayed. Each of the inspection information 401 to 404 may include, for example, the name of the imaging point, an inspection image captured at the imaging point, and an inspection result (OK, NG, etc.) based on the inspection image.
[0038] The examination information display section 300 may display an examination result display section 310, a destination selection button 320, a display condition setting section 330, an action generation button 340, etc. The examination result display section 310 displays the name of an imaging point and the examination result corresponding to the imaging point.
[0039] The destination selection button 320 is a button used, for example, when an operator wishes to move the robot 10 to a specific imaging point. When the operator selects the button via the input unit, the motion generation unit F3 generates a motion command for moving the robot 10 to the imaging point and transmits it to the robot control unit 40. For example, the destination selection button 320 can be used when an operator who has viewed the inspection information 401 to the inspection information 404 displayed on the virtual space display unit wishes to capture an inspection image again for a specific imaging point.
[0040] The display condition setting section 330 is an area that can be used when the worker sets information to be displayed on the virtual space display section 400, and the worker can set the desired display conditions via the input section. For example, in the example shown in FIG. 5, all the imaging points are selected in the display condition setting section 330, so that all of the imaging points P1 to P4 are displayed on the virtual space display section 400. In addition, in the example shown in FIG. 6, the display condition setting section 330 is set to "inspection result = OK", and only the imaging points P1 and P4, which have good inspection results, and the corresponding inspection information 401 and inspection information 404, are displayed on the virtual space display section 400. In addition, in the example shown in FIG. 7, the display condition setting section 330 is set to "inspection result = NG", and only the imaging points P2 and P3, which have failed inspection results, and the corresponding inspection information 402 and inspection information 403, are displayed on the virtual space display section 400.
[0041] The motion generation button 340 is a button used when generating the next motion of the robot 10 according to the inspection result, and an input field for motion generation conditions may also be displayed as illustrated in Figs. 9 to 11. The operator can operate the motion generation button 340 and the input field for motion generation conditions via the input unit. When the motion generation unit F3 receives the operator's input to the motion generation button 340, it generates a motion command for the robot 10 based on the inspection information.
[0042] Fig. 8 shows a flowchart for explaining the processing procedure executed by the motion generation unit F3. When an operator selects the motion generation button 340 to input an instruction to start the motion generation process, in step S1, the motion generation unit F3 acquires information on imaging points related to motion generation. In step S1 of Fig. 8, it is described as "a list of imaging points" for the sake of convenience, but the information on imaging points does not have to be data in a list format.
[0043] 9, all the imaging points are displayed in the virtual space display unit 400 according to the setting information of the display condition setting unit 330, but the content of the action generation condition is set to (inspection result=NG). In this case, in step S1, the action generation unit F3 automatically acquires imaging points P2 and P3 whose inspection results are NG as imaging points related to the next action generation.
[0044] Next, in step S2, the motion generation unit F3 extracts one imaging point from the list, and acquires target coordinates relating to the position and posture that the robot 10 should take at the imaging point from the storage unit of the information processing unit 50. In the example of Fig. 9, the motion generation unit F3 acquires target coordinates relating to either imaging point P2 or imaging point P3.
[0045] Next, in step S3, the motion generation unit F3 generates a movement command for moving the robot 10 to the target coordinates acquired in step S2. In the example of Fig. 9, the motion generation unit F3 generates a movement command for moving the robot 10 to either the imaging point P2 or the imaging point P3.
[0046] Next, in step S4, the action generation unit F3 generates an imaging command linked to the movement command generated in step S3, for causing the imaging device 20 to capture an image. In the example of Fig. 9, the action generation unit F3 generates an imaging command for causing the imaging device 20 to capture an image at either the imaging point P2 or the imaging point P3.
[0047] Next, in step S5, the action generation unit F3 judges whether generation of movement commands and image capture commands has been completed for all the imaging points included in the list acquired in step S1. If generation has not been completed for all the imaging points included in the list (step S5: NO), the process from step S2 to step S5 is repeated until generation is completed. In the example of FIG. 9, if processing has been completed for only one of the imaging points P2 and P3, the process returns to step S2 and generates movement commands and image capture commands for the other imaging point.
[0048] In step S5, when it is determined that generation of movement commands and imaging commands has been completed for all imaging points included in the list acquired in step S1 (step S5: YES), the motion generation unit F3 outputs the generated series of motion commands to the robot control unit 40. The information processing unit 50 may store the generated motion commands in a storage unit and output them to the robot control unit 40 at an appropriate timing. For example, when a reinspection is performed after repairing an inspection part whose inspection result is NG, the motion commands may be output to the robot control unit 40 at the stage when the repair is completed in response to an instruction from the operator.
[0049] According to this embodiment, for example, when performing a visual inspection and then re-inspecting the parts that have failed the inspection after taking measures such as re-machining, the operator can easily create a robot operation program for the re-inspection. Moreover, instead of a program for re-inspecting all parts, a program for efficiently re-inspecting only the parts that have failed the inspection can be generated.
[0050] In addition, the aspect of re-photographing only the part where the inspection result is unsuccessful is merely one example of this embodiment, and the information processing unit 50 may be configured so that the worker who has viewed the inspection result can select any imaging point, as shown in FIG. 10. In the example shown in FIG. 10, the inspection information display unit 300 is provided with a check box for the worker to set the object to be re-photographed. The display control unit F2 can display the inspection information 401 and the inspection information 402 in the virtual space display unit 400 in a form that can be identified, for example, by changing the color or surrounding it with a frame, so that the worker can easily confirm the checked object. The operation generation unit F3 can obtain a list in step S1 based on the check box entered by the worker, and generate an operation command. When the operation command for the robot 10 and the imaging device 20 is generated in steps S2 to S4, the display control unit F2 can add information indicating that the object is a re-inspection object to the inspection information 401 and the inspection information 402 in the virtual space display unit 400, as shown in FIG. 11.
[0051] As described above, according to this embodiment, an operator who has seen the visual inspection result can set any imaging point for reinspection and easily create an operation program for the robot 10 related to the reinspection.
[0052] In addition, when the number of parts that have failed the inspection is more than a predetermined number, or when a large scratch is detected, it may be determined that it is unreasonable to repair the workpiece through the visual inspection (reinspection is unnecessary). In this embodiment, when the visual inspection result is such, the operator can select the operation generation button to easily create a program for the robot 10 to perform an operation of removing the workpiece from the production line (classifying it as a defective product). In addition, when the result of the reinspection after the repair is pass, a program for the robot 10 to send the workpiece to the production line (classify it as a non-defective product) can be easily created. It is preferable to register in advance in the storage unit an operation command for transporting the workpiece from the fixed table 31, which is the shooting location, to the disposal line or the production line, and to configure the configuration so that the operator can select the operation command using the operation generation button.
[0053] Also, for example, if a mark or letter is attached to the workpiece and that part is set as the imaging part to capture an inspection image, analyzing the mark or letter based on the inspection image and displaying the identification result is convenient when generating the next operation of the robot based on the inspection result. For example, as shown in Fig. 12, if text information is displayed as the identification result among the inspection information displayed on the virtual space display unit 400, the worker can easily understand the inspection result.
[0054] Also, for example, if a workpiece has an optically readable code such as a one-dimensional or two-dimensional barcode that cannot be deciphered by humans, and that part is imaged as the imaging part, the inspection unit F1 can decode and display the optically readable code based on the inspection image. Such a display is convenient for the worker to generate the next operation of the robot based on the inspection result. For example, as shown in FIG. 13, if the result (e.g., a value) of deciphering the two-dimensional barcode is displayed in the inspection information displayed on the virtual space display unit 400, the worker can easily understand the appearance inspection result.
[0055] For example, if the work is a product assembled from multiple parts, and each part is provided with a mark, letter, barcode, etc., the worker can easily understand whether the correct parts are attached by the display images exemplified in Fig. 12 and Fig. 13. Alternatively, the inspection unit F1 can determine whether the product is properly assembled by comparing it with preregistered product design data. Once it has been determined whether the work is normal or not based on the inspection results, it can easily generate an operation command to move the work to a specified position or to perform a reinspection using the method already described.
[0056] According to this embodiment, the next operation command to be executed by the robot can be easily generated in accordance with the inspection result, thereby reducing the workload of the user in performing the appearance inspection.
[0057] [Modifications of the embodiment] It should be noted that the present invention is not limited to the above-described embodiments, and many modifications are possible within the technical spirit of the present invention. For example, the above-described different embodiments may be combined in whole or in part. The effects described in the embodiments are merely examples of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments.
[0058] Since the imaging unit and the inspection object need only be positioned so that they are in a relative positional relationship suitable for the imaging unit to image the inspection object during imaging, the robot may move either the imaging unit or the inspection object, or may move both. In other words, the robot may move at least one of the imaging unit and the workpiece so that they are in a positional relationship that allows the imaging unit to image the workpiece.
[0059] For example, if the inspection unit F1 determines that the visual inspection results satisfy predetermined conditions, the movement generation unit F3 may be configured to automatically generate the robot's next movement based on the inspection results without the operator having to operate the movement creation button.
[0060] Furthermore, the inspection device and inspection method of this embodiment are not limited to visual inspection in which multiple inspection areas are set on a single work, but can also be applied to visual inspection in which multiple works arranged in a row are inspected to determine the quality of each work.
[0061] When photographing the imaging point again, the robot may be moved in the same order or trajectory as in the initial appearance inspection, or in a different order or trajectory. For example, by using a path planning algorithm such as RRT (Rapidly-exploring Random Tree), it is possible to generate an operation command that efficiently moves the robot to the imaging point while avoiding interference with obstacles.
[0062] The present invention can also be realized by a process in which a program for implementing one or more functions of the embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for implementing one or more functions.
[0063] This specification discloses at least the following: [Item 1] An imaging unit; a robot that moves at least one of the imaging unit and the workpiece so that the imaging unit can image the workpiece; A display unit; A processing unit, The processing unit includes: An inspection process for inspecting the workpiece using an image of the workpiece captured by the imaging unit; A display process for displaying, on the display unit, a model of the workpiece, information indicating an imaged portion of the workpiece imaged by the imaging unit, and a result of the inspection process corresponding to the imaged portion; a generation process for generating an operation command for operating the robot based on a result of the inspection process; An inspection apparatus comprising: [Matter 2] The processing unit displays setting information used to generate the operation command on the display unit. 2. The inspection device according to item 1, [Matter 3] The setting information includes information that associates the content of the result with the content of the operation command. 3. The inspection device according to item 2, [Matter 4] The processing unit is capable of accepting input of the setting information by an operator. 4. The inspection device according to item 2 or 3. [Matter 5] The processing unit displays, on the display unit, an image for an operator to input information regarding the generation process. 5. The inspection device according to any one of claims 1 to 4. [Matter 6] The image includes an image for the worker to input an instruction to start the generation process. 6. The inspection device according to item 5, [Matter 7] The image includes an image for the operator to input the content of the operation command generated in the generation process. 7. The inspection device according to item 5 or 6, [Matter 8] The image includes an image for the operator to instruct a destination of the robot included in the operation command generated in the generation process. 8. The inspection device according to any one of claims 5 to 7, [Matter 9] The processing unit starts the generation process after receiving an instruction to start the generation process. 9. The inspection device according to any one of items 1 to 8, [Matter 10] The processing unit starts the generation process when a result of the inspection process has specific content. 9. The inspection device according to any one of items 1 to 8, [Matter 11] The operation command includes a command to operate the robot to cause the imaging unit to image the imaging portion for which the result of the inspection process has a specific content. 11. The inspection device according to any one of items 1 to 10, [Matter 12] The operation command includes a command to operate the robot to move the workpiece, for which the result of the inspection process has a specific content, to a predetermined position. 11. The inspection device according to any one of items 1 to 10, [Matter 13] The processing unit, in the display process, displays the imaging portion for which the result of the inspection process has a specific content in a manner distinguishable from other imaging portions. 13. The inspection device according to any one of items 1 to 12, [Matter 14] The processing unit is capable of displaying, in the display process, the results of the inspection process only for the imaging portion for which the result of the inspection process has a specific content. 13. The inspection device according to any one of items 1 to 12, [Matter 15] The processing unit identifies an optically readable code, a mark, or a character attached to the workpiece in the inspection process, and displays the identification result in the display process. 15. The inspection device according to any one of claims 1 to 14. [Matter 16] The processing unit displays, on the display unit, an image for allowing an operator to input instructions regarding the display process. 16. An inspection device according to any one of claims 1 to 15, [Matter 17] The image includes an image for the operator to select the imaging portion for displaying the result of the inspection process. 17. The inspection device according to item 16, [Matter 18] Inspect a workpiece using an inspection device according to any one of items 1 to 17, 13. An inspection method comprising: [Matter 19] 20. The inspection method according to item 18, wherein the processing unit executes the inspection process, the display process, and the generation process. [Matter 20] 20. A computer-readable recording medium storing the program according to item 19. [Matter 21] A workpiece is inspected by the inspection method according to item 18, and in the generation process, an operation command is generated for the robot to handle the workpiece whose result of the inspection process satisfies a predetermined criterion. A method for producing an article comprising the steps of: [Matter 22] A workpiece is inspected using the inspection method according to item 18, and in the generation process, an operation command is generated for the robot to handle the workpiece whose result of the inspection process does not satisfy a predetermined standard. A method for producing an article comprising the steps of: [Explanation of symbols]
[0064] 10···Robot / 11···Base / 12~16···Link / 20···Imaging device / 21···Camera main body / 22···Imaging field of view / 30···Work / 31···Fixed base / 40···Robot control unit / 50···Information processing unit / 51···Computer main body / 52···Display / 53···Mouse / 54···Keyboard / 100···Display screen / 200···Imaging point display unit / 300···Inspection information display unit / 310···Inspection result display unit / 320···Destination selection button / 330···Display condition setting unit / 340···Motion generation button / 400···Virtual space display unit / 401~404···Inspection information
Claims
1. An imaging unit; a robot that moves at least one of the imaging unit and the workpiece so that the imaging unit can image the workpiece; A display unit; A processing unit, The processing unit includes: An inspection process for inspecting the workpiece using an image of the workpiece captured by the imaging unit; A display process for displaying, on the display unit, a model of the workpiece, information indicating an imaged portion of the workpiece imaged by the imaging unit, and a result of the inspection process corresponding to the imaged portion; a generation process for generating an operation command for operating the robot based on a result of the inspection process; An inspection apparatus comprising:
2. The processing unit displays setting information used to generate the operation command on the display unit.
2. The inspection apparatus according to claim 1 .
3. The setting information includes information that associates the content of the result with the content of the operation command.
3. The inspection apparatus according to claim 2.
4. The processing unit is capable of accepting input of the setting information by an operator.
3. The inspection apparatus according to claim 2.
5. The processing unit displays, on the display unit, an image for an operator to input information regarding the generation process.
5. The inspection device according to claim 1, wherein the inspection device is a semiconductor laser.
6. The image includes an image for the worker to input an instruction to start the generation process.
6. The inspection apparatus according to claim 5.
7. The image includes an image for the operator to input the content of the operation command generated in the generation process.
6. The inspection apparatus according to claim 5.
8. The image includes an image for the operator to instruct a destination of the robot included in the operation command generated in the generation process.
6. The inspection apparatus according to claim 5.
9. The processing unit starts the generation process after receiving an instruction to start the generation process.
5. The inspection device according to claim 1, wherein the inspection device is a semiconductor laser.
10. The processing unit starts the generation process when a result of the inspection process has specific content.
5. The inspection device according to claim 1, wherein the inspection device is a semiconductor laser.
11. The operation command includes a command to operate the robot to cause the imaging unit to image the imaging portion for which the result of the inspection process has a specific content.
5. The inspection device according to claim 1, wherein the inspection device is a semiconductor laser.
12. The operation command includes a command to operate the robot to move the workpiece, for which the result of the inspection process has a specific content, to a predetermined position.
5. The inspection device according to claim 1, wherein the inspection device is a semiconductor laser.
13. The processing unit, in the display process, displays the imaging portion for which the result of the inspection process has a specific content in a manner distinguishable from other imaging portions.
5. The inspection device according to claim 1, wherein the inspection device is a semiconductor laser.
14. The processing unit is capable of displaying, in the display process, the results of the inspection process only for the imaging portion for which the result of the inspection process has a specific content.
5. The inspection device according to claim 1, wherein the inspection device is a semiconductor laser.
15. The processing unit identifies an optically readable code, a mark, or a character attached to the workpiece in the inspection process, and displays the identification result in the display process.
5. The inspection device according to claim 1, wherein the inspection device is a semiconductor laser.
16. The processing unit displays, on the display unit, an image for allowing an operator to input instructions regarding the display process.
5. The inspection device according to claim 1, wherein the inspection device is a semiconductor laser.
17. The image includes an image for the operator to select the imaging portion for displaying the result of the inspection process.
17. The inspection apparatus according to claim 16.
18. Inspecting a workpiece using the inspection device according to any one of claims 1 to 4.
13. An inspection method comprising:
19. 20. The inspection method according to claim 18, wherein the processing unit executes the inspection process, the display process, and the generation process.
20. 20. A computer-readable recording medium storing the program according to claim 19.
21. A workpiece is inspected by the inspection method according to claim 18, and in the generation process, an operation command is generated for the robot to handle the workpiece for which a result of the inspection process satisfies a predetermined criterion. A method for producing an article.
22. A workpiece is inspected using the inspection method according to claim 18, and the generation process generates an operation command for the robot to handle the workpiece whose result of the inspection process does not satisfy a predetermined standard. A method for producing an article.
Citation Information
Patent Citations
Appearance inspection system, method for displaying result of appearance inspection, and program for displaying result of appearance inspection
JP2020003301A
