Video detection data transmission system

Abstract

The present invention provides a transmission system for video detection data. A visual system is provided in which, when a detection failure of a workpiece occurs at a specified position of the video detection system, the system does not stop even when adjusting to a setting capable of normal detection, thereby improving productivity compared to the past. The transmission system comprises: a first video detection system that detects an object using a first image; industrial machinery that operates using detection information from the first video detection system; a second video detection system that is disposed upstream of the first video detection system and detects an object using a second image; and an operating terminal that outputs a detection instruction to the second video detection system and changes the video detection system data used by the second video detection system, wherein the first video detection system comprises a receiving unit that receives video detection system data from the second video detection system, and the second video detection system comprises a sending unit that sends video detection system data to the first video detection system.

Description

Technical Field

[0001] The invention relates to a transmission system for video detection data. Background Art

[0002] In the past, when inspecting objects using a visual system (hereinafter also referred to as a "camera inspection system"), missed detection or erroneous detection sometimes occurred due to changes or deviations in the workpiece. In such cases, the problem was addressed by readjusting the visual system components, including the visual system data (hereinafter also referred to as "camera inspection system data"), which includes the lighting, visual program (hereinafter also referred to as "camera inspection program"), and visual parameters (hereinafter also referred to as "camera inspection parameters") used in the visual system.

[0003] In this regard, the following technology is known (for example, refer to patent document 1): based on a control signal from the outside, main photography is performed using pre-set main photography parameters, and main image processing is performed on the image data obtained by photography. During the main image processing, secondary photography is performed using at least one secondary photography parameter different from the main photography parameters, and secondary image processing is performed on the image data obtained by the secondary photography. If the extracted secondary image processing result is appropriate, the secondary photography parameter that obtains the processing result is adjusted to the main photography parameter.

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Laid-Open No. 2016-146143 Summary of the Invention

[0007] Problems to be solved by the invention

[0008] However, there is a problem in that the visual system is stopped during readjustment, which causes a decrease in productivity.

[0009] There is a demand for a vision system that, when a detection failure of a workpiece occurs at a predetermined position of the vision system, does not stop the system even while adjusting the settings to enable normal detection, thereby improving productivity compared to conventional vision systems.

[0010] Solutions for solving problems

[0011] One embodiment of the present disclosure is a video detection data transmission system comprising: a first video detection system that uses a captured first image to detect an object; industrial machinery that uses the detection information of the first video detection system to perform an action; a second video detection system that is arranged upstream of the first video detection system and uses the captured second image to detect an object; and an operation terminal that outputs a detection instruction to the second video detection system and changes the video detection system data used in the second video detection system, wherein the first visual system comprises a receiving unit that receives the video detection system data from the second video detection system, and the second video detection system comprises a sending unit that sends the video detection system data to the first video detection system.

[0012] Effects of the Invention

[0013] According to one embodiment, when a detection failure of a workpiece occurs at a predetermined position of the vision system, the system does not stop even when adjusting the settings to enable normal detection, thereby improving productivity compared to conventional vision systems. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is a schematic diagram of a transmission system according to an embodiment.

[0015] Figure 2 is a functional block diagram of a transmission system according to an embodiment.

[0016] Figure 3 This is a flowchart showing the operation of the transmission system according to one embodiment.

[0017] Figure 4 is a conceptual diagram of a transmission system according to an embodiment.

[0018] Description of Reference Numerals

[0019] 1. 1A: Transmission system; 10: First visual system; 11. 21: Camera unit (detection camera); 12. 22: Control unit; 13: Industrial machinery (robot); 20: Second visual system; 23: Operation terminal; 121: Receiving unit; 122. 221: Detection unit; 123: Output unit; 222: Change unit; 223: Association unit; 224: Sending unit. DETAILED DESCRIPTION

[0020] [1 First embodiment]

[0021] Below, refer to Figures 1 to 3 A first embodiment of the present invention will be described.

[0022] [1.1 Summary]

[0023] Figure 1 This is a schematic diagram of a visual data transmission system according to the first embodiment of the present invention. Transmission system 1 includes a first visual system (hereinafter referred to as the "first imaging detection system") 10, a robot 13, a second visual system 20, and an operation terminal 23. Furthermore, first visual system 10 includes an inspection camera 11 and a control unit 12, while second visual system (hereinafter referred to as the "second imaging detection system") 20 includes an inspection camera 21 and a control unit 22.

[0024] As an example, it is assumed that the transport system 1 transports visual data of a workpiece 52 placed on a tray 51 and flowing on a belt conveyor 40 via a processing machine 30 .

[0025] More specifically, in the second vision system 20, the inspection camera 21 captures an image of a workpiece 52A placed on a pallet 51A upstream of the processing machine 30. The control unit 22 uses the image captured by the inspection camera 21 to inspect the workpiece 52A. If a missed inspection or erroneous detection occurs, the operator adjusts or changes the vision system data by operating the operation terminal 23. Therefore, the operation terminal 23 includes a button for instructing inspection and an interface for adjusting and changing the vision system data.

[0026] Here, the “detection camera 21 ” is an imaging device for imaging the workpiece 52A, and may have a zoom function and a direction change function.

[0027] In addition, the “visual system data” includes the above-mentioned captured images, visual programs, visual parameters, illuminance of lighting used in the second visual system 20 , and color of lighting.

[0028] Furthermore, the “vision program” is a program for detecting the workpiece 52 using the captured image of the workpiece 52 in the first vision system 10 and the second vision system 20 , and may include, for example, a module for instructing to search for the workpiece 52 .

[0029] Furthermore, the term "visual parameters" refers to parameters used in a visual program. Specifically, the term "visual parameters" may be a threshold value used in a visual program or a parameter for narrowing down an imaging area.

[0030] The control unit 22 of the second vision system 20 associates the vision system data during normal detection and the adjusted or modified vision system data in the event of missed detection or erroneous detection with the workpiece 52A and transmits them to the first vision system 10. Furthermore, each piece of vision system data is associated with each workpiece 52A.

[0031] In the first vision system 10, the inspection camera 11 captures an image of a workpiece 52B placed on a tray 51B and processed by the processing machine 30. The control unit 12 uses the image captured by the inspection camera 11 to inspect the workpiece 52B. By using the adjusted and modified vision system data received from the second vision system 20, the control unit 12 significantly improves the accuracy of inspection of the workpiece 52B.

[0032] In addition, the visual system data used by the first visual system 10 includes, in addition to the adjusted and changed visual system data received from the second visual system 20, the image captured by the detection camera 11, the illuminance of the lighting used in the first visual system 10, and the color of the lighting.

[0033] Then, the control unit 12 outputs the detection result of the workpiece 52B that has been detected normally to the robot 13. Thus, the robot 13 can perform an automatic operation using the detection result of the workpiece that has been detected normally.

[0034] In addition, Figure 1 Although not shown in the figure, a storage buffer can be provided between the control unit 12 of the first vision system 10 and the control unit 22 of the second vision system 20 to store the adjusted and modified vision system data. In this way, the vision system data after normal inspection is fed forward and stored in the storage buffer.

[0035] In addition, the control unit 22 of the second visual system 20 may not associate the adjusted and changed visual system data with the workpiece 52A, but instead send the order of each visual system data and the order of the workpiece 52A to the first visual system 10, and correspond each visual system data of the same order to the workpiece 52B on the first visual system 10 side.

[0036] In this case, there is no need to attach labels or QR codes (registered trademark) for association to the workpieces 52A and 52B.

[0037] [1.2 Overall structure]

[0038] Figure 2 This is a functional block diagram of the transmission system 1.

[0039] The transport system 1 includes a first vision system 10 , an industrial machine 13 , a second vision system 20 , and an operation terminal 23 .

[0040] The first visual system 10 includes an imaging unit 11 and a control unit 12 .

[0041] The imaging unit 11 captures the workpiece 52B to be inspected by the first visual system 10. Figure 1 The detection camera 11 corresponds to .

[0042] The control unit 12 controls the entire first visual system 10. It implements the various functions of this embodiment by appropriately reading and executing various programs from a storage area such as ROM, RAM, flash memory, or a hard disk (HDD). The control unit 12 can be a CPU. The control unit 12 includes a receiving unit 121, a detecting unit 122, and an output unit 123.

[0043] The receiving unit 121 receives the adjusted and changed vision system data from the second vision system 20 .

[0044] The inspection unit 122 inspects the workpiece 52B using the image of the workpiece 52B captured by the imaging unit 11. By using the adjusted and modified vision system data received by the receiving unit 121 from the second vision system 20, the normal inspection result of the workpiece 52B is significantly improved.

[0045] The output unit 123 outputs the detection result of the workpiece 52B detected by the detection unit 122 to the industrial machine 13 .

[0046] The industrial machine 13 performs automatic operation using the inspection result of the workpiece 52B input from the first vision system 10. Figure 1 Corresponding to robot 13 in.

[0047] The second visual system 20 includes an imaging unit 21 and a control unit 22 .

[0048] The imaging unit 21 captures the workpiece 52A to be inspected by the second visual system 20. Figure 1 The detection camera 21 corresponds to .

[0049] The control unit 22 controls the entire second visual system 20. It implements the various functions of this embodiment by appropriately reading and executing various programs from storage areas such as ROM, RAM, flash memory, or a hard disk (HDD). The control unit 22 can be a CPU. The control unit 22 includes a detection unit 221, a change unit 222, an association unit 223, and a transmission unit 224.

[0050] The detection unit 221 detects the workpiece 52A using the image of the workpiece 52A captured by the imaging unit 21 .

[0051] When omission or erroneous detection occurs when the detection unit 221 detects the workpiece 52A, the changing unit 222 adjusts and changes the vision system data through an operation performed from the operation terminal 23 as described later.

[0052] The associating unit 223 associates the vision system data during normal detection and the vision system data after adjustment or modification when missed detection or erroneous detection occurs with the workpiece 52A.

[0053] The transmitting unit 224 transmits the visual system data associated by the associating unit 223 to the first visual system 10 .

[0054] The operation terminal 23 is a device for instructing the second vision system 20 to inspect the workpiece 52A and for adjusting and changing vision system data.

[0055] [1.3 Action]

[0056] Figure 3 1 is a flowchart showing the operation of the transmission system 1 .

[0057] In step S11 , an inspection instruction to inspect the workpiece 52A is output from the operation terminal 23 to the second vision system 20 .

[0058] If the detection is successful in step S12 (S12: YES), the process proceeds to step S14. If the detection fails, that is, if missed detection or erroneous detection occurs (S12: NO), the process proceeds to step S13.

[0059] In step S13, the vision system data is adjusted and changed in the second vision system 20. Thereafter, the process shifts to step S11.

[0060] In step S14 , the second vision system 20 sends vision system data to the first vision system 10 .

[0061] In step S15 , the first vision system 10 performs an inspection operation to inspect the workpiece 52B.

[0062] In step S16 , the detection result of the workpiece 52B is output from the first vision system 10 to the industrial machine 13 .

[0063] In step S17 , the industrial machine 13 performs an automatic operation using the detection result of the workpiece 52B.

[0064] [1.4 Effects of the First Embodiment]

[0065] The transmission system 1 of this embodiment can confirm in advance whether the workpiece can be detected. In addition, if a detection failure such as missed detection or false detection of a workpiece occurs, the visual program, parameters, or lighting settings can be immediately adjusted to enable normal detection.

[0066] Furthermore, by transmitting the adjustment results in the workpiece placement process to the robot process, the probability of normal visual inspection in the robot process is significantly increased, thereby achieving improved productivity compared to conventional vision systems.

[0067] [2 Second embodiment]

[0068] Below, refer to Figure 4 A second embodiment of the present invention will be described.

[0069] [2.1 Summary]

[0070] In a first embodiment, the workpiece is pre-detected in an upstream process before being detected in a downstream process. In the case of missed detection or erroneous detection, the visual system data is adjusted or changed. Thereafter, the visual system data is sent from the upstream process to the downstream process, and the visual system data received from the upstream process is used in the downstream process to detect the workpiece, thereby increasing the possibility of normal visual detection.

[0071] On the other hand, in the second embodiment, in the second visual system 20, an image of only a pallet without a workpiece is detected, and in the first visual system 10, the image of only the pallet is removed from the image of the pallet with the workpiece loaded, thereby increasing the possibility of normal visual detection in the first visual system 10.

[0072] Figure 4 1A is a diagram showing the concept of the transmission system 1A according to the second embodiment. Figure 2 Functional blocks of the transmission system 1 according to the first embodiment shown are the same, and therefore description thereof will be omitted.

[0073] like Figure 4 As shown in (a), when a workpiece 52 is placed on the tray 51 and dirt is attached to the tray 51, the possibility of being able to normally detect the workpiece 52 becomes low. Figure 4 (b) shows an image of only the tray 51.

[0074] Afterwards, in the first visual system 10, Figure 4 The image of the pallet 51 and the workpiece 52 shown in (a) is removed. Figure 4 The image of the tray 51 shown in (b) is thus Figure 4 As shown in (c), an image of the workpiece 52 can be acquired.

[0075] This increases the possibility that the workpiece 52 can be properly detected even when dirt adheres to the tray 51 .

[0076] [2.2 Effects of the Second Embodiment]

[0077] According to the transport system 1A of the present embodiment, even when dirt is attached to a pallet, an image of only the pallet can be acquired in advance, thereby adjusting the setting to enable normal detection.

[0078] [3 Modifications]

[0079] In the first and second embodiments described above, the receiving unit 121 of the first visual system 10 and the transmitting unit 224 of the second visual system 20 are provided separately, but the present invention is not limited thereto. For example, the receiving unit 121 and the transmitting unit 224 may be housed in the same housing.

[0080] Furthermore, when the transmission system 1 or 1A includes a storage buffer as described above, the storage buffer may be accommodated in the same housing in addition to the receiving unit 121 and the transmitting unit 224 .

[0081] The embodiments of the present invention have been described above, but the present invention is not limited to the above embodiments. In addition, the effects described in the embodiments are merely examples of preferred effects produced by the present invention, and the effects produced by the present invention are not limited to the effects described in the embodiments.

[0082] The control method of transmission system 1 or 1A is implemented using software. When implemented using software, the program constituting the software is installed in the computer (transmission system 1 or 1A). Furthermore, these programs can be distributed to users by being recorded on removable media or downloaded to the user's computer via a network. Furthermore, these programs can be provided to the user's computer (transmission system 1 or 1A) as a web service via a network, rather than being downloaded.

Claims

1. A video detection data transmission system comprising: a first processor for a first imaging detection system, the first imaging detection system using the captured first image to detect an object being processed by a processing machine; an industrial machine that operates using detection information from the first imaging detection system; a second processor for a second imaging detection system, the second imaging detection system being provided upstream of the first imaging detection system and configured to detect the object before being processed by the processing machine using the captured second image; as well as an operation terminal having an interface configured to output a detection instruction to the second imaging detection system and to change imaging detection system data used in the second imaging detection system; Wherein, the first processor is used to receive the camera detection system data from the second camera detection system, The second processor is used to send the camera detection system data used by the second camera detection system to detect the object to the first camera detection system, and the first camera detection system also uses the sent camera detection system data to detect the object.

2. The transmission system according to claim 1, wherein: The imaging detection system data is transmitted and received between the first processor and the second processor in a state of being associated with data related to the object.

3. The transmission system according to claim 1 or 2, wherein: The interface is used to change the image detection system data so as to correctly perform detection in the second image detection system when detection is not correctly performed in the second image detection system.

4. The transmission system according to claim 1 or 2, wherein: The imaging detection system data includes at least one of the first image, the second image, an imaging detection program, imaging detection parameters, illuminance of lighting used in the first imaging detection system and the second imaging detection system, and color of the lighting.

5. The transmission system according to claim 1 or 2, wherein: The second image is an image of a pallet without the object placed thereon, and the first processor for the first imaging detection system detects the object using an image obtained by removing the second image from the first image.

Images