Inspection apparatus and method for controlling the inspection apparatus

The inspection device performs targeted inspections using model-specific programs to efficiently handle large objects, reducing steps and improving accuracy by automating the process.

JP7579180B2Active Publication Date: 2024-11-07TOSHIBA TEC KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021037182
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-09
Publication Date
2024-11-07
Estimated Expiration
2041-03-09

AI Technical Summary

Technical Problem

Existing inspection methods for large objects like automobiles and MFPs require high-accuracy optical sensors and CCD cameras, leading to increased inspection steps and worker involvement, which is inefficient.

Method used

An inspection device with a transport section, imaging section, model identification, storage, and control section that performs targeted inspections based on model-specific programs, automatically directing defective objects to repair or discharge areas.

Benefits of technology

Enables efficient, model-specific inspections reducing the number of steps and worker intervention, improving accuracy and throughput.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007579180000001
    Figure 0007579180000001
  • Figure 0007579180000002
    Figure 0007579180000002
  • Figure 0007579180000003
    Figure 0007579180000003
Patent Text Reader

Abstract

To provide an inspection device which performs visual inspection set for each inspection object.SOLUTION: An inspection device according to an embodiment comprises: an imaging unit; an image extraction unit; a model identification unit; a storage unit; an inspection unit; and a control unit. The imaging unit performs imaging. The model identification unit extracts model information from an image captured by the imaging unit. The storage unit stores an inspection program linked to the model information. The inspection unit inspects the inspection object. The control unit reads out the inspection program from the storage unit on the basis of the model information extracted by the model identification unit and controls the inspection unit on the basis of the inspection program.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] FIELD An embodiment of the present invention relates to an inspection apparatus and an inspection control method. [Background technology]

[0002] Conventionally, visual inspections are performed on automobiles, home appliances, MFPs, and other objects at the final stage of manufacturing lines to check for the presence or absence of fasteners and the mounting position of exterior parts. There are inspection devices that combine optical sensors with a wide measurement range and 6-axis robots, and devices that combine high-resolution CCD cameras that can inspect the entire object at once to shorten takt time. In some cases, workers may inspect the object visually. However, when inspecting large objects such as MFPs and automobiles, visual inspection devices require optical sensors with a wide measurement range and high-resolution CCD cameras to improve inspection accuracy. Alternatively, there is a problem of increased inspection man-hours due to workers inspecting the object. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication 2019-15741 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to provide an inspection apparatus that performs an inspection set for each inspection object. [Means for solving the problem]

[0005] In order to solve the above problems, the inspection device of this embodiment is A conveying unit; The device has an imaging unit, an image extraction unit, a model identification unit, a storage unit, an inspection unit, and a control unit. The transport unit transports the inspection object. The imaging unit is The inspection objectThe model identification unit extracts model information from the image captured by the imaging unit. The storage unit stores an inspection program linked to the model information. The inspection unit The item is transported to the inspection area by the transport unit. The control unit reads out the inspection program from the storage unit based on the model information extracted by the model identification unit, and controls the inspection unit based on the inspection program. The control unit controls the transport unit to transport the inspection object in the inspection area to a discharge unit if the inspection unit finds that the inspection object is not defective, and to transport the inspection object to a repair unit if the inspection object is defective; when the transport unit transports the inspection object from the inspection area to the repair unit, the control unit stores the model information in the memory unit; and when the transport unit transports the inspection object from the repair unit to the inspection area, the control unit controls the inspection unit based on an inspection program read from the memory unit based on the model information stored in the memory unit. [Brief description of the drawings]

[0006] [Figure 1] 1 is an external view showing an example of the overall configuration of a visual inspection apparatus according to an embodiment; [Diagram 2] FIG. 2 is a hardware block diagram of the appearance inspection apparatus according to the embodiment. [Diagram 3] 3 is a perspective view showing a schematic movement of the MFP transported by the transport unit of the visual inspection apparatus according to the embodiment; [Figure 4] 5A to 5C are diagrams illustrating the operation of a sensor provided in the inspection unit of the embodiment. [Diagram 5] 1 is an external view of an example of an MFP that is an inspection target of an appearance inspection apparatus according to an embodiment. [Figure 6] 5A to 5C are diagrams showing an example of an inspection operation of the visual inspection apparatus according to the embodiment. [Figure 7] 2 is a diagram showing a flow of appearance inspection in the appearance inspection apparatus of the embodiment; [Figure 8] FIG. 11 is a diagram showing a flow of appearance inspection in the appearance inspection apparatus of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, the appearance inspection device 1 of the embodiment will be described with reference to the drawings. FIG. 1 is an external view showing an example of the overall configuration of an appearance inspection apparatus 1 of an embodiment. FIG. 2 is a hardware block diagram of the appearance inspection apparatus 1 of an embodiment. The appearance inspection apparatus 1 has a control unit 2, a display unit 3, a transport unit 4, an inspection unit 5, a storage unit 6, an image processing unit 7, a determination unit 8, and a communication interface (I / F) unit 9. The components of the appearance inspection apparatus 1 are connected via a bus 10. FIG. 3 shows a schematic diagram of the movement of an MFP (Multifunction Peripheral) 11 transported by a transport means of the embodiment. For example, the MFP 11 is subjected to an appearance inspection while being loaded on a cart 12. Arrows a to d indicate the transport direction of the MFP 11 transported by the transport means.

[0008] The appearance inspection device 1 inspects the appearance of an inspection object. For example, the inspection object is an MFP 11. The inspection object may be any object that requires an appearance inspection. For example, the appearance inspection is an image inspection. For example, the image inspection inspects the target inspection object based on image data. For example, defects of the inspection object that can be detected by image inspection include missing labels, improper label attachment positions, etc. For example, the appearance inspection is a dimensional measurement inspection. For example, the dimensional measurement inspection inspects the target inspection object based on information acquired by a laser displacement sensor. For example, defects of the inspection object that can be detected by dimensional measurement inspection include missing screws, improper component attachment positions, improper alignment, etc. Of course, the types of appearance inspection and detectable defects of inspection objects presented here are only examples, and it goes without saying that an appropriate inspection method should be selected depending on the inspection object.

[0009] 1 shows a visual inspection device 1 according to an embodiment. In addition to visually inspecting the top surface of an inspection object, the visual inspection device 1 can also inspect the side surface of the inspection object by rotating the inspection object around an axis in the vertical direction. For the sake of explanation, in the embodiment, the position where the inspection object is placed when visual inspection is performed, that is, the top of a rotating stage 51, is referred to as the inspection area.

[0010] The control unit 2 is configured using a processor 21 such as a CPU (Central Processing Unit) and a memory 22. The memory 22 is, for example, a semiconductor memory 22, and has a ROM (Read Only Memory) 221 that stores various control programs, and a RAM (Random Access Memory) 222 that provides a temporary working area for the processor 21. The control unit 2 reads out and executes the programs stored in the ROM 221. The control unit 2 controls the operation of each device provided in the appearance inspection apparatus 1 based on the read programs.

[0011] The display unit 3 displays predetermined information, for example, information on defects of the inspection target detected by the visual inspection.

[0012] The input section 41 is an area where the inspection object is input into the inspection area. The repair section 42 is an area where the inspection object is output out of the inspection area when an error is detected in the visual inspection, and is also an area where the inspection object is input into the inspection area. The output section 43 is an area where the inspection object is output out of the inspection area when the visual inspection is completed.

[0013] The transport unit 4 transports the inspection object inserted from the insertion unit 41 to the inspection area (arrow a in FIG. 3). The transport unit 4 also transports the inspection object that has undergone visual inspection in the inspection area to the repair unit 42 or the discharge unit 43 (arrows b and c in FIG. 3). The transport unit 4 also transports the inspection object inserted from the repair unit 42 to the inspection area (arrow d in FIG. 3).

[0014] The transport unit 4 has a transport means for transporting the test object. The transport means is, for example, a one-axis Cartesian robot capable of transporting the cart 12 carrying the test object. The transport means has shuttles 411, 421, and 431. Each shuttle has hooks 412, 422, and 432 for contacting and towing the lower part of the cart 12. The hook 412 transports the cart 12 from the input unit 41 to the rotating stage 51. The hook 422 transports the cart 12 from the rotating stage 51 to the repair unit 42, and transports the cart 12 from the repair unit 42 to the rotating stage 51. The hook 432 transports the cart 12 from the rotating stage 51 to the discharge unit 43. Each hook rotates around one end of the member as an axis when passing under the cart 12. The rotational movement of each hook may be controlled by the control unit 2, or may be biased by an elastic member such as a spring. The hook 422 of the repair unit 42 has members that serve as the axis of rotation on both sides in the transport direction, and the direction of the rotation can be controlled by the control unit 2. This is because the repair unit 42 is capable of both inserting and removing the inspection object. The transport means may be any mechanism that can insert and remove the inspection object to be visually inspected into and from the inspection area. The transport means may be, for example, a conveyor-type transport mechanism.

[0015] The inspection unit 5 has a rotating stage 51, an imaging unit 52, a sensor 53, and an automatic stage 54. The rotating stage 51 rotates about an axis in the vertical direction. The rotating stage 51 changes the orientation of an inspection object placed on the rotating stage 51 by rotating.

[0016] The imaging unit 52 stores the captured image information as image data in the storage unit 6. The image data stored in the storage unit 6 may be transmitted to another information processing device via a network. The imaging unit 52 is an image inspection camera. For example, the imaging unit 52 captures an image of an inspected surface of an inspection object. The imaging unit 52 includes a first imaging unit 521 and a second imaging unit 522. For example, the first imaging unit 521 is installed so as to capture an image of the upper surface of the inspection object placed on the rotating stage 51. The second imaging unit 522 is installed so as to capture an image of the left vertical surface of the inspection object transported from the input unit 41 to the discharge unit 43. In FIG. 3, the imaging unit 521 is provided on the top plate 101, and the imaging unit 522 is provided on the side plate 102.

[0017] The sensor 53 is a shape measuring sensor. The sensor 53 has a first sensor 531 and a second sensor 532. For example, the sensor 53 is a non-contact type displacement sensor that scans a laser beam to measure the height, thickness, dimensions, etc. of the inspection object from the shadow of the inspection object. For example, the first sensor 531 is installed so as to be able to measure the top surface of the inspection object placed on the rotating stage 51. The second sensor 532 is installed so as to be able to measure one side surface of the inspection object placed on the rotating stage 51.

[0018] 4(a) and (b) are diagrams showing the operation of the sensor 53 provided in the inspection unit 5. FIG. 4(a) is a schematic diagram of the inspection unit 5 as viewed from the direction of the input unit 41, that is, as viewed from the direction of the arrow a in FIG. 3. FIG. 4(b) is a schematic diagram of the inspection unit 5 as viewed from the direction of the repair unit 42, that is, as viewed from the direction of the arrow c in FIG. 3. The sensor 53 is provided on the automatic stage 54 and can be moved by a slide shaft that is perpendicular to two or three axes. The sensor 53 can be moved by the slide shaft within the movable range of the automatic stage 54, for example, as indicated by the arrows in FIG. 4(a) and (b). The automatic stage 54 has a first automatic stage 541 and a second automatic stage 542. The first automatic stage 541 is a two-axis automatic stage that can move within an upper horizontal plane in the transport direction of the inspection object transported from the input unit 41 to the discharge unit 43. The first sensor 531 is disposed on the first automated stage 541. The second automated stage 542 is a three-axis automated stage that is movable in a left vertical plane and in a direction perpendicular to the transport direction of the inspection object transported from the input unit 41 to the discharge unit 43. The second sensor 532 is disposed on the second automated stage 542.

[0019] The rotary stage 51 and the automatic stage 54 are collectively referred to as an inspection stage.

[0020] The storage unit 6 is configured using a storage device such as a magnetic hard disk drive or a semiconductor storage device. The storage unit 6 stores image data captured by the imaging unit 52. The storage unit 6 stores specific model information and a specific inspection program linked to the specific model information. The model information is information that enables identification of the inspection target, and for example, different information is assigned to each model of the inspection target. The inspection program includes a predetermined control of the inspection unit 5. The predetermined control is, for example, an inspection operation related to an appearance inspection, such as the operation of an inspection stage.

[0021] The image processing unit 7 has an image extraction unit 71 and a model identification unit 72. The image extraction unit 71 extracts image data of a specific region from the image data captured by the imaging unit 52. The image data of the specific region is, for example, a two-dimensional code 1152 on which model information of the inspection target is described. In addition, any image data may be used as long as model information of the inspection target can be acquired. The model identification unit 72 acquires specific model information from the image data of the specific region acquired by the image extraction unit 71. The model identification unit 72 reads out a specific inspection program linked to the specific model information from the memory unit 6.

[0022] The judgment unit 8 has an image judgment unit 81 and a sensor judgment unit 82. The judgment unit 8 detects defects of the inspection target based on information acquired from the inspection unit 5. The information acquired from the inspection unit 5 is, for example, image data captured by the imaging unit 52 or information detected by the sensor 53. The image judgment unit 81 detects defects of the inspection target from the image data captured by the imaging unit 52. The image judgment unit 81 detects defects of the inspection target by, for example, comparing image data of a normal inspection target stored in advance in the storage unit 6 that is read out by a specific inspection program with image data of the inspection target captured by the imaging unit 52. The sensor judgment unit 82 detects defects of the inspection target based on information acquired by the sensor 53. The sensor judgment unit 82 detects defects of the inspection target by, for example, comparing information of a normal inspection target stored in advance in the storage unit 6 that is read out by a specific inspection program with information of the inspection target acquired by the sensor 53.

[0023] The communication I / F unit 9 is an interface for connecting an external device. The communication I / F unit 9 communicates with an external device on a network via a wireless or wired connection. The control unit 2 communicates with the external device via the communication I / F unit 9. The external device is, for example, a personal computer or a server. The appearance inspection device 1 may transmit, for example, information obtained by appearance inspection to the external device via the network.

[0024] Here, the MFP 11 to be visually inspected in the embodiment will be briefly described. FIG. 5 is an example of an external view of the MFP 11 to be inspected by the visual inspection device 1 of the embodiment. The MFP 11 has, for example, a display 111, a control panel 112, an image forming unit 113, a sheet storage unit 114, and an image reading unit 115. The display 111 displays predetermined information. The control panel 112 allows a user to input operations to the MFP 11. The sheet storage unit 114 stores a sheet on which an image is to be formed. The image forming unit 113 forms an image on the sheet by an electrophotographic method. The image reading unit 115 reads the image formed on the sheet on the glass plate 1151, and stores it in the memory 22 as image data.

[0025] A two-dimensional code 1152 containing model information is attached to a glass plate 1151 at the top of the MFP 11.

[0026] FIG. 6 shows an example of the inspection operation of the visual inspection device 1. FIG. 6 shows the MFP as seen from the second sensor 532 moving in the left vertical plane with respect to the conveying direction of the inspection target conveyed from the input unit 41 to the discharge unit 43 shown in FIG. 3. FIG. 6 illustrates the left side and rear of each of two types of MFPs (model A and model B), and shows an example of the inspection operation of each. In FIG. 6, the star indicates the fastening point of the screw, the dotted frame indicates the area that can be inspected by the second sensor 532, and the arrow indicates the moving direction of the second sensor 532 by the second automatic stage 542. As shown in FIG. 6, by setting the optimal inspection operation for each model, it is possible to reduce inspection errors and reduce the number of work steps. Similarly, the first sensor 531 that inspects the top surface of the inspection target realizes the inspection operation set for each model by the first automatic stage 541.

[0027] Fig. 7 is a diagram showing the flow of visual inspection in the visual inspection apparatus 1 of the embodiment. The flow of visual inspection shown in Fig. 7 will be described with reference to Figs. 3 and 6. First, a user places a cart 12 loaded with an MFP 11 at a predetermined position in the insertion unit 41 of the visual inspection apparatus 1. The transport unit 4 pulls the cart 12 placed at the predetermined position in the insertion unit 41 in the direction of the arrow a in Fig. 3, that is, into the inspection area (ACT100).

[0028] Next, the imaging unit 52 acquires image data including the model information of the MFP 11. Here, the imaging unit 52 capable of capturing an image of the top surface of the MFP 11 acquires image data including the two-dimensional code 1152 attached to the top surface of the MFP 11. The image extraction unit 71 extracts an area of ​​the two-dimensional code 1152 in which the model information is described from the image data acquired by the imaging unit 52. The model identification unit 72 identifies the model of the MFP from the two-dimensional code 1152 in which the model information is described. The control unit 2 reads out an inspection program linked to the identified model from the storage unit 6 (ACT101). At this time, for example, if the model of the MFP 11 identified from the two-dimensional code 1152 is model A, the control unit 2 reads out an inspection program from the storage unit 6 that performs the operation of the automatic stage 54 corresponding to model A as shown in FIG. 6.

[0029] The control unit 2 controls the inspection unit 5 based on the inspection program read from the storage unit 6, and performs inspection (ACT102).

[0030] When the image determination unit 81 or the sensor determination unit 82 detects a defect in the MFP 11 (ACT103, YES), the transport unit 4 transports the cart 12 carrying the MFP 11 in the direction of the arrow b in FIG. 3, that is, to the repair unit 42 (ACT104). At that time, information on the defective part is displayed on the display unit 3. After that, when the cart 12 carrying the MFP 11 is placed at a predetermined position in the repair unit 42, the transport unit 4 pulls the cart 12 carrying the MFP 11 in the direction of the arrow d in FIG. 3, that is, into the inspection area (ACT105). In other words, after the defective part is repaired by the user, the MFP 11 is inserted from the repair unit 42 and reinspected.

[0031] If the image determination unit 81 or the sensor determination unit 82 does not detect a defect in the MFP 11 (ACT103, NO), the transport unit 4 transports the cart 12 carrying the MFP 11 in the direction of the arrow c in FIG. 3, that is, to the discharge unit 43 (ACT106).

[0032] When a defect is detected on one inspection surface, the cart 12 carrying the MFP 11 may be transported to the repair unit 42 after the inspection of that inspection surface, or may be transported to the repair unit 42 after inspection of all inspection surfaces.

[0033] As a result, the visual inspection device 1 in the embodiment can inspect the inspection objects with the most suitable operation according to each inspection object.

[0034] A second embodiment will be described below. Each component of the visual inspection device 1 in the second embodiment has the same configuration as that of the visual inspection device 1 in the first embodiment, and therefore the description thereof will be omitted.

[0035] Fig. 8 is a diagram showing the flow of appearance inspection in the appearance inspection apparatus 1 of the second embodiment. ACT200, ACT201, and ACT203 to ACT206 shown in Fig. 8 are the same operations as ACT100, ACT101, and ACT103 to ACT106 shown in Fig. 7, so the explanation will be omitted.

[0036] In the appearance inspection apparatus 1 of the second embodiment, when the image determination unit 81 or the sensor determination unit 82 detects a defect in the MFP 11 (ACT203, YES), the transport unit 4 transports the cart 12 carrying the MFP 11 to the repair unit 42 (ACT204). At that time, the control unit 2 stores in the storage unit 6 the model information of the MFP 11 detected to be defective in ACT203. When the cart 12 carrying the MFP 11 is pulled from the repair unit 42 to the inspection unit 5, the MFP 11 is inspected in ACT204 using the model information stored in the storage unit 6 (ACT202).

[0037] As a result, the visual inspection apparatus 1 according to the second embodiment can perform the following operations according to each inspection object: It is possible to perform the test in an optimal manner. The following is an appended summary of the contents of the claims as originally filed. [1] An imaging unit for capturing an image; a model identification unit that extracts model information from the image captured by the imaging unit; A storage unit that stores an inspection program linked to the model information; an inspection unit that inspects an inspection object; a control unit that reads out the inspection program from the storage unit based on the model information extracted by the model identification unit and controls the inspection unit based on the inspection program; An inspection device having the above structure. [2] A transport means for transporting the inspection object, The control unit is controlling the transport means so as to transport the inspection object to the first area when the inspection unit inspects the inspection object in the inspection area and determines that the inspection object is not defective, and to transport the inspection object to a second area different from the first area when the inspection unit inspects the inspection object and determines that the inspection object is defective; [1] An inspection device as described in the above. [3] The control unit is storing the model information in the storage unit when the transport unit transports the inspection object from the inspection area to the second area; When the transport unit transports the inspection object from the second area to the inspection area, the transport unit reads out the inspection program from the storage unit based on the model information stored in the storage unit, and controls the inspection unit based on the inspection program. An inspection device according to [1] or [2]. [4] A display unit for displaying information is provided. the control unit controls the display unit to display information about the defect of the inspection object when the inspection object is found to be defective as a result of the inspection by the inspection unit of the inspection object in the inspection area. An inspection device according to [2] or [3]. [5] An imaging step using an imaging unit; acquiring model information based on an image captured by the imaging unit; reading out an inspection program from a storage unit based on the model information; controlling an inspection unit that inspects an inspection object based on the inspection program read from the storage unit; A control method for an inspection apparatus having the above structure. [Explanation of symbols]

[0038] 1. Visual inspection device 2. Control section 4. Conveyor section 5. Inspection Department 52 Imaging unit 6...Storage section 7. Image Processing Unit 71...Image extraction section 72 Model Identification Unit 8... Judgment section 81...Image judgment unit 82 Sensor judgment unit 11. MFP 1152... 2D code

Claims

1. A transport unit that transports an inspection object; an imaging unit that images the inspection object; a model identification unit that extracts model information from the image captured by the imaging unit; a storage unit that stores an inspection program linked to the model information; an inspection unit that inspects the inspection object transported to the inspection area by the transport unit; a control unit that reads out the inspection program from the storage unit based on the model information extracted by the model identification unit and controls the inspection unit based on the inspection program, The control unit controlling the transport unit so that, when the inspection unit inspects the inspection object in the inspection area and the inspection object is not defective, the transport unit transports the inspection object to a discharge unit, and when the inspection object is defective, the transport unit transports the inspection object to a repair unit; storing the model information in the storage unit when the transport unit transports the inspection object from the inspection area to the repair unit; When the transport unit transports the inspection object from the repair unit to the inspection area, the transport unit controls the inspection unit based on an inspection program read from the storage unit based on the model information stored in the storage unit. Inspection equipment.

2. A display unit for displaying information is provided. the control unit controls the display unit to display information about the defect of the inspection object when the inspection object is found to be defective as a result of inspection by the inspection unit of the inspection object in the inspection area. The inspection device according to claim 1 .

3. The inspection program is a program for performing an appearance inspection on an inspection object identified by the model information. The inspection device according to claim 1 .

4. The inspection unit includes a rotary table that changes the orientation of the inspection object in the inspection area. The inspection device according to claim 1 .

5. A step of transporting an inspection object to an inspection area; capturing an image of the inspection object by an imaging unit; acquiring model information based on the image captured by the imaging unit; reading an inspection program from a storage unit based on the model information; controlling an inspection unit that inspects an inspection object in the inspection area based on the inspection program read from the storage unit; a step of transporting the inspection object to a discharge section when the inspection object in the inspection area is not defective as a result of inspection by the inspection section, and transporting the inspection object to a repair section when the inspection object is defective; storing the model information in the storage unit when the inspection object is transported from the inspection area to the repair unit; a step of controlling the inspection unit based on an inspection program that reads out the inspection program from the storage unit based on the model information stored in the storage unit when the inspection object is transported from the repair unit to the inspection area; A control method for an inspection apparatus having the above construction.

Citation Information

Patent Citations

  • Product with memory device and mixed-flow manufacturing device thereof

    JP1993154728A

  • Continuity inspecting device for path

    JP2000035311A

  • Imaging inspection device, imaging inspection method, imaging inspection program, and computer readable recording medium as well as instrument

    JP2019015741A

  • Production control system and production control method

    JP2021002573A

  • Component mounting apparatus and mount inspection apparatus

    WO2014076836A1