Inspection method

The inspection method improves robotic connector insertion accuracy and efficiency by using image recognition to align multiple marks, addressing position discrepancies and enhancing durability evaluation.

JP2024158764APending Publication Date: 2024-11-08SEIKO EPSON CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023074271
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2024-11-08

Smart Images

  • Figure 2024158764000001_ABST
    Figure 2024158764000001_ABST
Patent Text Reader

Abstract

To provide an inspection method which can detect a position of a first connector with high accuracy.SOLUTION: In an inspection method, an inspection including an action of inserting a first connector into a second connector is performed by using a robot. The inspection method includes: a position detection step in which positions of recognition marks arranged along a direction in which the first connector is inserted into the second connector are detected with image recognition to detect a position of the first connector; and an insertion / removal step in which the first connector is held by the robot and insertion / removal of the first connector into / from the second connector is performed.SELECTED DRAWING: Figure 8
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an inspection method. [Background technology]

[0002] Patent document 1 discloses a robot device that performs the steps of grasping a first connector with a robot and inserting it into a second connector, resonating the first connector and the second connector while the first connector is inserted into the second connector, and adjusting the insertion depth of the first connector based on the resonant frequency. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-012784 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the robot device of Patent Document 1, if there is a discrepancy between the detected position and the actual position of the first connector, the probability of successfully inserting the first connector into the second connector decreases, or the time required for insertion increases, resulting in a decrease in tact time. [Means for solving the problem]

[0005] The inspection method of the present invention is an inspection method that performs an inspection including an operation of inserting a first connector into a second connector using a robot, a position detection step of detecting the position of the first connector by detecting the positions of a plurality of recognition marks arranged along a direction in which the first connector is inserted into the second connector by image recognition; and an insertion / removal step of holding the first connector with the robot and inserting / removing the first connector into / from the second connector. [Brief description of the drawings]

[0006] [Figure 1] 1 is a configuration diagram of a robot system according to a first embodiment. [Diagram 2] FIG. 2 is a plan view showing a cable used in the inspection. [Diagram 3] FIG. 2 is a rear view of the electronic device. [Figure 4] FIG. 2 is a perspective view showing a holding jig, a first mounting tool, and a second mounting tool. [Diagram 5] FIG. 2 is a perspective view showing a holding jig, a first mounting tool, and a second mounting tool. [Figure 6] FIG. [Figure 7] FIG. 13 is a perspective view showing a state in which the tool is gripping the gripping jig. [Figure 8] 1 is a flowchart showing an inspection process. [Figure 9] FIG. 11 is a configuration diagram of a robot system according to a second embodiment. [Figure 10] FIG. 13 is a plan view of a cable used in an inspection according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An inspection method according to the present invention will now be described in detail with reference to the embodiments shown in the accompanying drawings.

[0008] First Embodiment FIG. 1 is a configuration diagram of a robot system according to a first embodiment. FIG. 2 is a plan view showing a cable used in inspection. FIG. 3 is a view of an electronic device as seen from the back. FIGS. 4 and 5 are perspective views showing a gripping jig, a first attachment tool, and a second attachment tool, respectively. FIG. 6 is an exploded perspective view of the gripping jig. FIG. 7 is a perspective view showing a state in which the tool grips the gripping jig. FIG. 8 is a flowchart showing an inspection process.

[0009] The robot system 1 shown in FIG. 1 includes a robot 2 that inserts and removes a held cable 9 into and from an electronic device 8, and a control device 3 that controls the driving of the robot 2.

[0010] The robot 2 is a six-axis vertical articulated robot having six drive axes. Such a robot 2 has a base 21, a robot arm 22 rotatably connected to the base 21, a tool 23 attached to the tip of the robot arm 22, a force sensor 24 as a force detection unit disposed between the robot arm 22 and the tool 23, and an imaging device 25 disposed on the tool 23.

[0011] The robot arm 22 is configured with six arms 221, 222, 223, 224, 225, and 226 connected to rotate freely, and includes six joints J1, J2, J3, J4, J5, and J6. Of these six joints J1 to J6, the joints J2, J3, and J5 are bending joints, and the joints J1, J4, and J6 are torsion joints. Each of the joints J1, J2, J3, J4, J5, and J6 is provided with a motor and an encoder (not shown). During operation of the robot system 1, the control device 3 executes feedback control for each of the joints J1 to J6 to make the rotation angle of the joints J1 to J6 indicated by the output of the encoder coincide with a target position.

[0012] Moreover, tool 23 has a pair of claws that open and close, and clamps and holds cable 9 between the pair of claws. However, the configuration of tool 23 is not particularly limited as long as it can hold cable 9. For example, tool 23 may be configured to hold cable 9 by suction.

[0013] Furthermore, the force sensor 24 has three detection axes perpendicular to each other, and can independently detect a translational force (axial force) along each detection axis and a rotational force (torque) around each detection axis. Such a force sensor 24 detects a force applied to the cable 9 held by the tool 23. However, the configuration of the force sensor 24 is not particularly limited as long as it can detect a force applied to the cable 9 held by the tool 23. Furthermore, the force sensor 24 may be omitted.

[0014] Moreover, the imaging device 25 is, for example, a 3D camera (stereo camera). The control device 3 can identify the position (three-dimensional coordinates) of an object in the image data by performing image recognition processing on the image data captured by the imaging device 25. However, the configuration of the imaging device 25 is not particularly limited as long as it can exert the same function.

[0015] The control device 3 controls the driving of the robot 2. The control device 3 is composed of, for example, a computer, and has a processor (CPU) for processing information, a memory communicatively connected to the processor, and an external interface for connecting to an external device. Various programs executable by the processor are stored in the memory, and the processor can read and execute the programs stored in the memory.

[0016] Although the robot system 1 has been briefly described above, the configuration thereof is not particularly limited. For example, the robot 2 does not have to be a six-axis vertical articulated robot, and may be, for example, a horizontal articulated robot (SCARA robot).

[0017] Next, an inspection method using the robot system 1 will be described. The content of the inspection performed by this inspection method is not particularly limited, but in this embodiment, the cable 9 is repeatedly inserted into and removed from the electronic device 8 to evaluate the insertion / removal durability of the electronic device 8. This makes it possible to simply and accurately evaluate the strength of the electronic device 8, in particular the strength of the second connector 81 itself and the strength of the portion supporting the second connector 81.

[0018] In the inspection of this embodiment, a cable 9 is used as shown in FIG. 2. The cable 9 is a real cable that can actually be used, and has a flexible cable body 91 and a first connector 92 disposed at one end of the cable body 91. By using the real cable 9 in this way, it is possible to reproduce the actual usage state, and it is possible to improve the accuracy and reliability of the inspection. However, the cable 9 may be a full-scale model (mockup). Also, the cable body 91 may be omitted from the cable 9.

[0019] 3, the electronic device 8 has a second connector 81 on its rear surface into which the first connector 92 is inserted. The electronic device 8 is fixed by a fixing member (not shown) so as not to shift when the first connector 92 is inserted or removed. The electronic device 8 is not particularly limited, and examples thereof include a projector, a printer, a personal computer, a display, and a robot controller.

[0020] In this embodiment, the first connector 92 is a male connector, and the second connector 81 is a female connector. However, this is not limited to this, and the first connector 92 may be a female connector, and the second connector 81 may be a male connector. In addition, the standard of the connector is not particularly limited, and may be any standard, such as USB Type A, USB Type C, USB mini, USB micro, HDMI (registered trademark), VGA, LAN, etc. In this embodiment, it is HDMI.

[0021] In addition, in the inspection of this embodiment, as shown in Figures 4 and 5, a holding jig 7 is attached to the body of the first connector 92, a first attachment tool 5 is attached to the tip portion (male terminal) of the first connector 92, and a second attachment tool 6 is attached to the holding jig 7.

[0022] ≪Gripping jig 7≫ As shown in Figs. 4 to 6, the holding jig 7 has a base 72 that holds the first connector 92, a spacer 71 that is interposed between the base 72 and the first connector 92, and a tubular locking portion 73 that is inserted into the base 72. The spacer 71 is divided into spacer pieces 711 and 712, and the base 72 is divided into base pieces 721 and 722. The base 72, the spacer 71, and the locking portion 73 are each made of a resin material. This makes it possible to suppress the gloss of each of these portions. However, the materials that make up the base 72, the spacer 71, and the locking portion 73 are not particularly limited.

[0023] In such a holding jig 7, first, the spacer 71 is assembled by sandwiching the body of the first connector 92 between the spacer pieces 711, 712. The spacer 71 has a positioning portion 713 that positions the first connector 92. This allows the first connector 92 to be placed in a predetermined position relative to the spacer 71, and also makes it possible to prevent deviation after positioning. The configuration of the positioning portion 713 can be designed appropriately according to the body shape of the first connector 92, and in this embodiment, it is configured to have a protrusion that engages with a narrowing of the body.

[0024] Next, the spacer 71 is sandwiched between the base pieces 721, 722 to assemble the base 72. The base 72 has a positioning portion 723 that positions the spacer 71. This allows the spacer 71 to be placed at a predetermined position relative to the base 72, and also makes it possible to prevent the spacer 71 from shifting after positioning. The configuration of the positioning portion 723 can be designed appropriately according to the shape of the spacer 71. The positioning portion 723 in this embodiment is formed at the tip of the base 72, and has a recess into which the spacer 71 is fitted.

[0025] Next, the locking portion 73 is inserted into the base 72 to maintain the assembled state of the spacer 71 and the base 72. The base 72 has a positioning portion 724 for positioning the locking portion 73. This allows the locking portion 73 to be placed at a predetermined position relative to the base 72. The configuration of the positioning portion 724 can be designed appropriately according to the shape of the locking portion 73, and in this embodiment, it has a wall portion against which the locking portion 73 abuts. This completes the assembly of the gripping jig 7. With this configuration, the gripping jig 7 can be easily attached to the first connector 92. Note that when the gripping jig 7 is attached, the tip portion of the first connector 92, specifically the entire male terminal, protrudes from the tip of the gripping jig 7.

[0026] The gripping jig 7 is disposed on the locking portion 73 and has a third recognition mark 74 which is a recognition mark M for image recognition. The third recognition mark 74 may be formed integrally with the locking portion 73, or may be formed separately and joined with an adhesive or the like.

[0027] The third recognition mark 74 is configured to be easily recognized. Specifically, the third recognition mark 74 has a color and gloss that are easily recognized. The third recognition mark 74 is made of, for example, a resin material, and has a sufficiently suppressed gloss. In addition, the third recognition mark 74 is colored in a color different from the back surface of the electronic device 8. Therefore, image data in which the third recognition mark 74 and its outline are clear can be obtained. Therefore, the position of the first connector 92 can be detected more accurately than when the position of the first connector 92 is detected based on image data obtained by directly imaging the first connector 92. In addition, the third recognition mark 74 is configured to be not too small or too large, and is configured to be of an appropriate size so that image recognition does not take too much time.

[0028] Further, the third recognition mark 74 has a three-dimensional shape. Furthermore, the side surface of the third recognition mark 74 is inclined in a tapered shape, and appears in the image data obtained by imaging the imaging device 25. Therefore, the amount of information about the third recognition mark 74 increases, and the third recognition mark 74 can be image-recognized with higher accuracy. Therefore, the position of the first connector 92 can be detected with higher accuracy. However, the shape of the third recognition mark 74 is not particularly limited, and the side surface does not have to be tapered, and may be a flat shape formed by, for example, a printing layer, attachment of a sticker, or the like.

[0029] The base 72 also has a gripping portion 725 that is gripped by the tool 23 of the robot 2. The gripping portion 725 has a shape that is constricted by a pair of cutout portions 725a, 725b formed on both side surfaces of the base 72. Then, as shown in Fig. 7, the gripping jig 7 can be gripped in a stable position by inserting the claws of the tool 23 into the cutout portions 725a, 725b to clamp the gripping portion 725.

[0030] The gripping portion 725 is located on the base end side of the third recognition mark 74, that is, rearward in the insertion direction. This increases the separation distance D between the tool 23 and the first connector 92 when the gripping portion 725 is gripped by the tool 23, and for example, the first connector 92 can be inserted into the second connector 81 that is located so far back that the first connector 92 cannot be inserted when the first connector 92 is directly gripped by the tool 23. This improves the workability of the inspection. However, the arrangement of the gripping portion 725 is not particularly limited. In addition, the configuration of the gripping portion 725 is not particularly limited either, and can be designed appropriately according to the configuration of the tool 23, for example.

[0031] ≪Second attachment 6≫ The second mounting tool 6 is detachably mounted on the gripping part 725 of the gripping jig 7. As shown in Figs. 4 and 5, the second mounting tool 6 has a plate-shaped base 61, a pair of claws 621, 622 protruding from the base 61, and a first recognition mark 63 arranged on the base 61. The pair of claws 621, 622 are inserted into cutout parts 725a, 725b of the gripping jig 7 and engaged with the gripping jig 7 by snap-fitting, thereby being mounted on the gripping part 725. With this configuration, the second mounting tool 6 can be easily attached to and detached from the gripping jig 7.

[0032] Such a second wearing tool 6 is made of a resin material, which can suppress the gloss of the second wearing tool 6. However, the material of the second wearing tool 6 is not particularly limited.

[0033] The first recognition mark 63 is a recognition mark M for image recognition used to detect the position of the gripping portion 725. The positional relationship between the first recognition mark 63 and the gripping portion 725 in a state in which the second attachment 6 is attached to the gripping jig 7 is known in advance, and this relationship is stored in an identification program held by the control device 3. Therefore, the control device 3 can detect the position of the first recognition mark 63 from the image data acquired by the imaging device 25, and thereby detect the position of the gripping portion 725.

[0034] The first recognition mark 63, like the third recognition mark 74, is configured to be easily recognized. Specifically, the first recognition mark 63 has a color and gloss that are easily recognized. The first recognition mark 63 is made of a resin material, and has a sufficiently suppressed gloss. In addition, the first recognition mark 63 is colored in a color different from the surroundings. Therefore, image data in which the first recognition mark 63 and its outline are clear can be obtained. In addition, the first recognition mark 63 is configured to be not too small or too large in size so that image recognition does not take too much time.

[0035] Moreover, the first recognition mark 63 has a three-dimensional shape. Furthermore, the side surface of the first recognition mark 63 is inclined in a tapered shape, and appears in the image data captured by the imaging device 25. Therefore, the amount of information about the first recognition mark 63 increases, and the first recognition mark 63 can be image-recognized with higher accuracy. Therefore, the position of the gripping part 725 can be detected with higher accuracy. However, the shape of the first recognition mark 63 is not particularly limited, and the side surface does not have to be tapered, and may be a flat shape formed by, for example, a printing layer, attachment of a sticker, or the like.

[0036] ≪First attachment 5≫ The first attachment 5 is detachably attached to the tip of the first connector 92, specifically, to the male terminal. As shown in FIGS. 4 and 5, the first attachment 5 has a base 51 having an insertion hole 511 into which the tip of the first connector 92 is inserted, and a second recognition mark 53 arranged on the upper surface of the base 51. Such a first attachment 5 is attached to the tip of the first connector 92 by inserting the first connector 92 into the insertion hole 511. With this configuration, the first attachment 5 can be easily attached to and detached from the tip of the first connector 92.

[0037] Such a first wearing tool 5 is made of a resin material, which can suppress the gloss of the first wearing tool 5. However, the material of the first wearing tool 5 is not particularly limited.

[0038] The second recognition mark 53 is a recognition mark M for image recognition used to detect the position of the tip of the first connector 92. The positional relationship between the second recognition mark 53 and the tip of the first connector 92 in a state in which the first wearing tool 5 is attached to the first connector 92 is known in advance, and this relationship is stored in an identification program held by the control device 3. Therefore, the control device 3 can detect the position of the second recognition mark 53 from the image data acquired by the imaging device 25, and thereby detect the tip position of the first connector 92.

[0039] The second recognition mark 53, like the third recognition mark 74, is configured to be easily recognized. Specifically, the second recognition mark 53 has a color and gloss that are easily recognized. The second recognition mark 53 is made of a resin material, and has a sufficiently suppressed gloss. In addition, the second recognition mark 53 is colored in a color different from the surroundings. Therefore, image data in which the second recognition mark 53 and its outline are clear can be obtained. In addition, the second recognition mark 53 is configured to be of an appropriate size, not too small or too large, so that image recognition does not take too much time.

[0040] The second recognition mark 53 has a three-dimensional shape. The side of the second recognition mark 53 is tapered and appears in the image data captured by the imaging device 25. This increases the amount of information about the second recognition mark 53, and the second recognition mark 53 can be image-recognized with higher accuracy. This allows the tip position of the first connector 92 to be detected with higher accuracy. However, the shape of the second recognition mark 53 is not particularly limited, and the side does not have to be tapered, and may be a flat shape formed by, for example, a printing layer, a sticker attachment, or the like.

[0041] The above has described the holding jig 7, the first mounting fixture 5, and the second mounting fixture 6. As described above, the third recognition mark 74 is arranged on the holding jig 7, the second recognition mark 53 is attached to the first mounting fixture 5, and the first recognition mark 63 is arranged on the second mounting fixture 6. The first recognition mark 63, the second recognition mark 53, and the third recognition mark 74 have different shapes and can be distinguished by image recognition.

[0042] Next, an inspection method using the robot system 1 will be described. This inspection is not particularly limited as long as it includes an operation of inserting the first connector 92 into the second connector 81 using the robot 2, but in this embodiment, the cable 9 is repeatedly inserted into and removed from the electronic device 8 to evaluate the insertion and removal durability of the electronic device 8. This makes it possible to simply and accurately evaluate the strength of the electronic device 8, in particular the strength of the second connector 81 itself and the strength of the part supporting the second connector 81. However, the contents of the inspection are not particularly limited, and may be, for example, an electrical continuity inspection.

[0043] As shown in FIG. 8, the inspection includes an arrangement step S1 in which the holding jig 7, the first attachment device 5 and the second attachment device 6 are attached to the first connector 92, a first position detection step S2 as a position detection step in which the position of the first connector 92 is detected, a removal step S3 in which the second attachment device 6 and the first attachment device 5 are removed, a second position detection step S4 in which the position of the second connector 81 is detected, an insertion / removal step S5 in which the first connector 92 is repeatedly inserted and removed from the second connector 81, and an inspection step S6 in which the condition of the second connector 81 is inspected.

[0044] <Placement step S1> 4 and 5, in the arrangement step S1, the gripping jig 7 is attached to the body of the first connector 92, the second attachment tool 6 is attached to the gripping jig 7, and the first attachment tool 5 is attached to the tip of the first connector 92. As a result, the first recognition mark 63, the second recognition mark 53, and the third recognition mark 74 are arranged side by side on the first connector 92 along the insertion direction of the first connector 92 into the second connector 81. Note that the attachment of the gripping jig 7, the second attachment tool 6, and the first attachment tool 5 may be performed, for example, by the robot 2, by a robot other than the robot 2, or by a worker.

[0045] Note that, before the inspection, the gripping jig 7 may be attached to the body of the first connector 92, the second attachment tool 6 may be attached to the gripping jig 7, and the first attachment tool 5 may be attached to the tip of the first connector 92. In such a case, the arrangement step S1 can be omitted.

[0046] <First position detection step S2> In the first position detection step S2, first, the control device 3 moves the robot 2 so that the third recognition mark 74 is located within the field of view of the imaging device 25, and captures an image of the third recognition mark 74 with the imaging device 25. Then, the control device 3 performs image recognition processing on the image data acquired by the imaging device 25 to detect the position of the third recognition mark 74.

[0047] Next, the control device 3 moves the robot 2 so that the first recognition mark 63 is located within the field of view of the imaging device 25, and captures an image of the first recognition mark 63 with the imaging device 25. Then, the control device 3 performs image recognition processing on the image data acquired by the imaging device 25 to detect the position of the first recognition mark 63.

[0048] Next, the control device 3 moves the robot 2 so that the second recognition mark 53 is located within the field of view of the imaging device 25, and captures an image of the second recognition mark 53 with the imaging device 25. Then, the control device 3 performs image recognition processing on the image data acquired by the imaging device 25 to detect the position of the second recognition mark 53.

[0049] Next, the control device 3 detects the positional relationship between the third recognition mark 74 and the first recognition mark 63 from the positions of the third recognition mark 74 and the first recognition mark 63 obtained as described above. Similarly, the control device 3 detects the positional relationship between the third recognition mark 74 and the second recognition mark 53 from the positions of the third recognition mark 74 and the second recognition mark 53 obtained as described above.

[0050] In this manner, the positional relationship between the third recognition mark 74, the first recognition mark 63, and the second recognition mark 53 is detected. In this manner, the third recognition mark 74, the first recognition mark 63, and the second recognition mark 53 are sequentially imaged, so that the third recognition mark 74, the first recognition mark 63, and the second recognition mark 53 can be positioned at the center of the image. Since the aberration is suppressed toward the center of the image, the positions can be detected with higher accuracy. However, the first position detection step S2 is not particularly limited. For example, the robot 2 may be moved so that the third recognition mark 74, the first recognition mark 63, and the second recognition mark 53 are all positioned within the field of view of the imaging device 25, and the third recognition mark 74, the first recognition mark 63, and the second recognition mark 53 may be simultaneously imaged by the imaging device 25, and the positions of the third recognition mark 74, the first recognition mark 63, and the second recognition mark 53 may be detected from the obtained image data. This reduces the number of times of imaging, so that this step can be performed in a shorter time.

[0051] <Removal step S3> In the removal step S3, the second mounting tool 6 is removed from the gripping jig 7. That is, the first recognition mark 63 is removed from the gripping jig 7. As described above, the second mounting tool 6 is connected to the gripping jig 7 by a snap fit. Therefore, the second mounting tool 6 can be easily removed from the gripping jig 7. By removing the second mounting tool 6 from the gripping jig 7 in this manner, the second mounting tool 6 does not get in the way when the robot 2 grips the gripping portion 725 in the insertion / removal step S5.

[0052] In addition, in a removal step S3, the first attachment device 5 is removed from the first connector 92. As described above, the first attachment device 5 is connected by inserting the tip of the first connector 92. Therefore, the first attachment device 5 can be easily removed from the first connector 92. By removing the first attachment device 5 from the first connector 92 in this manner, the first attachment device 5 does not get in the way when the first connector 92 is inserted into and removed from the second connector 81 in the insertion / removal step S5.

[0053] The second attachment tool 6 and the first attachment tool 5 may be removed, for example, by the robot 2, by a robot other than the robot 2, or by an operator.

[0054] <<Second position detection step S4>> In the second position detection step S4, first, the control device 3 moves the robot 2 so that the second connector 81 is positioned within the field of view of the imaging device 25, and captures an image of the second connector 81 with the imaging device 25. Then, the control device 3 performs image recognition processing on the image data acquired by the imaging device 25 to detect the position of the second connector 81.

[0055] The order of the second position detection step S4 is not particularly limited as long as it is performed before the insertion / removal step S5, and it may be performed prior to the arrangement step S1, or between the arrangement step S1 and the first position detection step S2, or between the first position detection step S2 and the removal step S3. Also, for example, if the position of the second connector 81 is known in advance, this step may be omitted.

[0056] <Insertion / removal step S5> 8, in the insertion / removal step S5, first, the control device 3 moves the robot 2 so that the third recognition mark 74 is located within the field of view of the imaging device 25, and captures an image of the third recognition mark 74 with the imaging device 25. Then, the control device 3 performs image recognition processing on the image data acquired by the imaging device 25 to detect the position of the third recognition mark 74.

[0057] Next, the control device 3 detects the position of the gripper 725 based on the position of the detected third recognition mark 74, the positional relationship between the third recognition mark 74 and the first recognition mark 63 obtained in the first position detection step S2, and the positional relationship between the first recognition mark 63 and the gripper 725, which is known in advance. The control device 3 also detects the position of the tip of the first connector 92 based on the position of the detected third recognition mark 74, the positional relationship between the third recognition mark 74 and the second recognition mark 53 obtained in the first position detection step S2, and the positional relationship between the second recognition mark 53 and the tip of the first connector 92, which is known in advance. According to this method, the position of the gripper 725 can be accurately detected even without the first recognition mark 63, and the position of the tip of the first connector 92 can be accurately detected even without the second recognition mark 53. Therefore, the first attachment 5 and the second attachment 6 can be removed prior to the insertion / removal step S5.

[0058] In this way, by detecting the position of the first connector 92 based on the positions of the multiple recognition marks M, the positions of the gripper 725 and the tip of the first connector 92 can be detected with high accuracy. Therefore, the detection error of the gripper 725 (deviation between the detected position and the actual position) and the detection error of the tip of the first connector 92 (deviation between the detected position and the actual position) can be suppressed to a smaller value. In particular, by arranging the first recognition mark 63 on the gripper 725 and arranging the second recognition mark 53 on the tip of the first connector 92, the positional relationship between the gripper 725 and the tip of the first connector 92 can be detected with high accuracy. Therefore, the position of the tip of the first connector 92 in a state where the gripper 725 is gripped can be specified, and the first connector 92 can be smoothly inserted into the second connector 81 with a higher success rate.

[0059] Next, the control device 3 moves the robot 2 to grip the gripper 725 with the tool 23 as shown in FIG. 7. Next, the control device 3 moves the robot 2 to repeat the insertion and removal of the first connector 92 into the second connector 81 a predetermined number of times. Specifically, first, based on the position of the tip of the first connector 92 detected in this step and the position of the second connector 81 detected in the second position detection step S4, the control device 3 moves the robot 2 to insert the first connector 92 into the second connector 81. Next, the control device 3 moves the robot 2 to retract the first connector 92 along its central axis and pull it out from the second connector 81.

[0060] In addition, there may be cases where the first connector 92 hits the second connector 81 during insertion due to a detection error of the positions of the first connector 92 and the second connector 81, a deviation in the gripping position of the first connector 92, etc., and further insertion is prevented. Therefore, the control device 3 detects the presence or absence of contact and the contact state between the first connector 92 and the second connector 81 based on the force detected by the force sensor 24, and proceeds with this step while fine-tuning the position of the first connector 92 based on the detection result. This allows the first connector 92 to be inserted into the second connector 81 smoothly and with a high probability. Also, during this step, excessive force is unlikely to be applied to the first connector 92 and the second connector 81, and damage or deformation thereof can be effectively suppressed.

[0061] Here, in this embodiment, by using the third recognition mark 74, the first recognition mark 63, and the second recognition mark 53, the detection error of the gripping portion 725 and the tip of the first connector 92 can be reduced, so that the first connector 92 can be smoothly inserted without hitting the second connector 81. Even if the first connector 92 hits the second connector 81, since the detection error is small, the first connector 92 can be inserted into the second connector 81 with only a slight position adjustment, so that a higher probability of successful insertion can be achieved and the time required for insertion can be shortened.

[0062] This completes the first insertion / removal. For the second and subsequent insertion / removal, the tip of first connector 92 can be moved back and forth between the position of the tip of first connector 92 when the first insertion is completed and the position of the tip of first connector 92 when the first removal is completed, for example, to smoothly repeat the insertion / removal. Note that the number of times that first connector 92 is inserted and removed is not particularly limited as long as it is at least one.

[0063] <Inspection step S6> In inspection step S6, the condition of the second connector 81 itself and the condition of the portion of the electronic device 8 that holds the second connector 81 are checked to evaluate durability against insertion and removal of the first connector 92. The evaluation may be performed, for example, by the control device 3 capturing an image of the second connector 81 with the imaging device 25 and processing the image data, or by another inspection robot. Also, the evaluation may be performed visually by an operator.

[0064] The inspection method has been described above. According to such an inspection method, the position of first connector 92 can be detected simply and accurately, and therefore first connector 92 can be smoothly inserted and removed from second connector 81. Therefore, the time required for inspection can be shortened.

[0065] The above describes an inspection method using the robot system 1. This inspection method is an inspection method for performing an inspection including an operation of inserting the first connector 92 into the second connector 81 using the robot 2, and includes a first position detection step S2 as a position detection step for detecting the position of the first connector 92 by detecting the positions of multiple recognition marks M arranged along the direction in which the first connector 92 is inserted into the second connector 81 by image recognition, and an insertion / removal step S5 for gripping the first connector 92 with the robot 2 and inserting / removing the first connector 92 into / from the second connector 81. In this way, by detecting the position of the first connector 92 based on the positions of the multiple recognition marks M, the position of the first connector 92 can be detected with high accuracy.

[0066] As described above, the first connector 92 is attached with its tip exposed to the gripping jig 7 having the gripping portion 725 gripped by the robot 2, the first attachment tool 5 is attached to the tip of the first connector 92, and the multiple recognition marks M have the first recognition mark 63 arranged on the gripping portion 725 and the second recognition mark 53 arranged on the first attachment tool 5. This makes it possible to detect the positional relationship between the gripping portion 725 and the tip of the first connector 92. Therefore, it is possible to specify the position of the tip of the first connector 92 in a state where the gripping portion 725 is gripped, and the first connector 92 can be smoothly inserted into the second connector 81 with a higher success rate.

[0067] As described above, the first recognition mark 63 is detachable from the gripping jig 7. This prevents the first recognition mark 63 from getting in the way when the robot 2 grips the gripping portion 725.

[0068] As described above, the multiple recognition marks M are arranged on the gripping jig 7, and include the third recognition mark 74 located between the first recognition mark 63 and the second recognition mark 53. This makes it possible to detect the positions of the gripping portion 725 and the tip of the first connector 92 based on the position of the third recognition mark 74 by detecting in advance the positional relationship between the third recognition mark 74 and the first recognition mark 63 and the positional relationship between the third recognition mark 74 and the second recognition mark 53.

[0069] As described above, in the first position detection step S2, the positional relationship between the third recognition mark 74 and the first recognition mark 63 and the positional relationship between the third recognition mark 74 and the second recognition mark 53 are detected, and in the insertion / removal step S5, the position of the gripper 725 is detected based on the position of the third recognition mark 74, the positional relationship between the third recognition mark 74 and the first recognition mark 63, and the positional relationship between the first recognition mark 63 and the gripper 725, and the robot 2 is moved based on the detection result to grip the gripper 725. This makes it possible to accurately detect the position of the gripper 725 even without the first recognition mark 63. Therefore, the first recognition mark 63 can be removed from the gripping jig 7 prior to the insertion / removal step S5, and the first recognition mark 63 does not get in the way when the robot 2 grips the gripper 725.

[0070] As described above, in the insertion / removal step S5, the position of the tip of the first connector 92 is detected based on the position of the third recognition mark 74, the positional relationship between the third recognition mark 74 and the second recognition mark 53, and the positional relationship between the second recognition mark 53 and the tip of the first connector 92, and the first connector 92 is inserted or removed from the second connector 81 based on the detection result. This makes it possible to accurately detect the position of the tip of the first connector 92 even without the second recognition mark 53. Therefore, the first attachment 5 can be removed from the first connector 92 prior to the insertion / removal step S5, and the second recognition mark 53 does not get in the way when inserting or removing the first connector 92 from the second connector 81.

[0071] As described above, the method includes a removal step S3 that is performed between the first position detection step S2 and the insertion / removal step S5, and removes the first attachment tool 5 from the first connector 92 and removes the first recognition mark 63 from the gripping jig 7. This prevents the first attachment tool 5 and the first recognition mark 63 from getting in the way in the insertion / removal step S5. This allows the insertion / removal step S5 to be performed smoothly.

[0072] As described above, the recognition marks M, that is, the first recognition mark 63, the second recognition mark 53, and the third recognition mark 74, each have a three-dimensional shape. This allows image recognition of the first recognition mark 63, the second recognition mark 53, and the third recognition mark 74 to be performed with high accuracy.

[0073] As described above, the side surfaces of the recognition mark M, that is, the side surfaces of the first recognition mark 63, the second recognition mark 53, and the third recognition mark 74, are inclined in a tapered shape. This allows image recognition of the first recognition mark 63, the second recognition mark 53, and the third recognition mark 74 to be performed with high accuracy.

[0074] <Second embodiment> FIG. 9 is a configuration diagram of a robot system according to the second embodiment.

[0075] The robot system 1 according to this embodiment is similar to the robot system 1 according to the first embodiment, except for the arrangement of the imaging device 25. In the following description, the robot system 1 according to this embodiment will be described with a focus on the differences from the first embodiment, and a description of the similarities will be omitted. In the drawings of this embodiment, the same reference numerals are used to designate the same components as those in the above-described embodiment.

[0076] As shown in FIG. 9, in the robot system 1 of this embodiment, the imaging device 25 is not disposed on the robot 2, but is disposed, for example, directly above the working space and fixed at a predetermined position.

[0077] The second embodiment as described above can also achieve the same effects as the first embodiment described above.

[0078] <Third embodiment> FIG. 10 is a plan view of a cable used in an inspection according to the third embodiment.

[0079] The robot system 1 according to this embodiment is similar to the robot system 1 according to the first embodiment, except for the configuration of the recognition mark M. In the following description, the robot system 1 according to this embodiment will be described with a focus on the differences from the first embodiment, and the description of the similarities will be omitted. In the drawings of this embodiment, the same reference numerals are used for the same configurations as those in the above-mentioned embodiment.

[0080] 10, in this embodiment, the gripping jig 7, the first attachment tool 5, and the second attachment tool 6 are omitted, and the body of the first connector 92 is directly gripped by the tool 23. In addition, a plurality of recognition marks M are arranged directly on the cable 9. The recognition marks M include a first recognition mark M1 arranged on the body of the first connector 92, which is the gripping portion gripped by the tool 23, and a second recognition mark M2 arranged on the male terminal portion, which is the tip portion of the first connector 92.

[0081] Moreover, the positional relationship between the first recognition mark M1 and the gripping position is known in advance, and this relationship is stored in an identification program of the control device 3. Similarly, the positional relationship between the second recognition mark M2 and the tip of the first connector 92 is known in advance, and this relationship is stored in an identification program of the control device 3.

[0082] Moreover, the inspection process omits the arrangement step S1, first position detection step S2, and removal step S3 from the first embodiment described above as they are no longer necessary, and includes a second position detection step S4 for detecting the position of the second connector 81, an insertion / removal step S5 for repeatedly inserting and removing the first connector 92 into the second connector 81, and an inspection step S6 for inspecting the state of the second connector 81. Of these, the second position detection step S4 and the inspection step S6 are the same as those in the first embodiment described above, so only the insertion / removal step S5 will be described below.

[0083] <Insertion / removal step S5> In the insertion / removal step S5, first, the control device 3 moves the robot 2 so that the first recognition mark M1 and the second recognition mark M2 are positioned within the field of view of the imaging device 25, and simultaneously captures images of the first recognition mark M1 and the second recognition mark M2 with the imaging device 25. Then, the control device 3 performs image recognition processing on the image data acquired by the imaging device 25 to detect the positions of the first recognition mark M1 and the second recognition mark M2.

[0084] Next, the control device 3 detects the position of the gripping position based on the detected position of the first recognition mark M1 and the previously known positional relationship between the first recognition mark 63 and the gripping position. The control device 3 also detects the position of the tip of the first connector 92 based on the detected position of the second recognition mark M2 and the previously known positional relationship between the second recognition mark M2 and the tip of the first connector 92. In this way, by detecting the positions of each part of the first connector 92 based on the positions of the multiple recognition marks M, the position of the first connector 92 can be detected with high accuracy.

[0085] The third embodiment as described above can also achieve the same effects as the first embodiment described above.

[0086] The inspection method of the present invention has been described above based on the illustrated embodiment, but the present invention is not limited to this. The configuration of each part can be replaced with any configuration having a similar function. In addition, any other configuration or process may be added to the present invention. [Explanation of symbols]

[0087] 1...robot system, 2...robot, 21...base, 22...robot arm, 221...arm, 222...arm, 223...arm, 224...arm, 225...arm, 226...arm, 23...tool, 24...force sensor, 25...imaging device, 3...control device, 5...first mounting fixture, 51...base, 511...insertion hole, 53...second recognition mark, 6...second mounting fixture, 61...base, 621...claw portion, 622...claw portion, 63...first recognition mark, 7...gripping jig, 71...spacer, 711...spacer piece, 712...spacer piece, 713...positioning portion, 72...base, 721...base piece, 722...base Piece, 723...positioning portion, 724...positioning portion, 725...gripping portion, 725a...notch portion, 725b...notch portion, 73...lock portion, 74...third recognition mark, 8...electronic device, 81...second connector, 9...cable, 91...cable body, 92...first connector, D...separation distance, J1...joint, J2...joint, J3...joint, J4...joint, J5...joint, J6...joint, M...recognition mark, M1...first recognition mark, M2...second recognition mark, S1...placement step, S2...first position detection step, S3...removal step, S4...second position detection step, S5...insertion / removal step, S6...inspection step

Claims

1. 1. An inspection method for performing an inspection including an operation of inserting a first connector into a second connector using a robot, comprising: a position detection step of detecting the position of the first connector by detecting the positions of a plurality of recognition marks arranged along a direction in which the first connector is inserted into the second connector by image recognition; and an insertion / removal step of holding the first connector with the robot and inserting / removing the first connector into / from the second connector.

2. the first connector is attached to a gripping jig having a gripping portion to be gripped by the robot with a tip end exposed; A first attachment is attached to the tip portion of the first connector; The inspection method according to claim 1 , wherein the plurality of recognition marks include a first recognition mark arranged on the gripping portion and a second recognition mark arranged on the first mounting fixture.

3. The inspection method according to claim 2 , wherein the first recognition mark is detachable from the holding jig.

4. The inspection method according to claim 3 , wherein the plurality of recognition marks include a third recognition mark that is disposed on the holding jig and is located between the first recognition mark and the second recognition mark.

5. In the position detection step, a positional relationship between the third recognition mark and the first recognition mark and a positional relationship between the third recognition mark and the second recognition mark are detected, The inspection method described in claim 4, wherein in the insertion / removal step, the position of the gripping part is detected based on the position of the third recognition mark, the positional relationship between the third recognition mark and the first recognition mark, and the positional relationship between the first recognition mark and the gripping part, and the robot is moved based on the detection result to grip the gripping part.

6. The inspection method described in claim 5, wherein, in the insertion / removal step, the position of the tip of the first connector is detected based on the position of the third recognition mark, the positional relationship between the third recognition mark and the second recognition mark, and the positional relationship between the second recognition mark and the tip of the first connector, and the first connector is inserted or removed from the second connector based on the detection result.

7. This is performed between the position detection step and the insertion / removal step, The inspection method according to claim 3 , further comprising a removing step of removing the first mounting fixture from the first connector and removing the first recognition mark from the holding jig.

8. The inspection method according to claim 1 , wherein the recognition mark has a three-dimensional shape.

9. The inspection method according to claim 8 , wherein a side surface of the recognition mark is inclined in a tapered shape.

Citation Information

Patent Citations

  • Inspection device determining state at insertion of connector and robot device comprising the inspection device

    JP2021012784A