Information management system for painting equipment

Abstract

To provide an information management system for painting equipment that allows for the reading of supplementary information in a short time and reduces the cost of introducing the system. [Solution] The information management system of the present invention comprises a camera 50, an object detection means, an information reading means 50, and an information association means. The camera 50 photographs a workpiece W1 being transported, an information display member 41 attached to the workpiece W1, and a transporter 23 paired with the workpiece W1, and acquires a workpiece image G1, an enlarged image of the information display member G2, and an image of the transporter G3. The object detection means detects the information display member 41 from the workpiece image G1. The information reading means 50 reads the workpiece-related information captured in the enlarged image of the information display member G2 and the transporter-related information 31 captured in the transporter-related image G3. The information association means associates the read workpiece-related information and transporter-related information 31 and stores them in the storage means.

Description

Technical Field

[0001] The present invention relates to an information management system for painting equipment in which predetermined operations are performed on a plurality of workpieces.

Background Art

[0002] Conventionally, there has been known painting equipment that performs operations such as painting on each automobile body while continuously transporting workpieces such as automobile bodies using a plurality of hangers. In such painting equipment, supplementary information (such as numbers) is attached to each hanger, and a tag on which supplementary information (such as a QR code) of the automobile body is described is attached to each automobile body. The supplementary information is read using a device such as a camera (see, for example, Patent Document 1). Further, there has been conventionally proposed a technique for acquiring data by an operator reading the QR code described on the tag or the number described on the hanger using a handy device.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, since the operator needs to read the QR code for each automobile body or the number for each hanger using a handy device, there is a problem that the work of reading the supplementary information takes time. Further, since it is necessary to separately introduce a system for reading the QR code and a system for reading the number, there is a problem that the system introduction cost is high.

[0005] This invention has been made in view of the above-mentioned problems, and its purpose is to provide an information management system for painting equipment that can read supplementary information in a short amount of time and reduce the cost of introducing the system. [Means for solving the problem]

[0006] To solve the above problems, the invention described in claim 1 is an information management system for a painting facility in which a predetermined operation is performed on a plurality of workpieces while a plurality of workpieces are continuously transported using a transport means having a plurality of transport devices, transport device accessory information is attached to each of the plurality of transport devices, and an information display member describing workpiece accessory information is attached to each of the plurality of workpieces, and the gist of this information management system for a painting facility is a camera having a PTZ function and using the PTZ function to photograph the workpieces being transported, the information display member attached to the workpieces, and the transport device paired with the workpieces, respectively, and acquire workpiece images, enlarged images of the information display member and transport device images, respectively; object detection means for detecting the information display member from the acquired workpiece images for the purpose of acquiring the enlarged images of the information display member; information reading means for reading the workpiece accessory information shown in the acquired enlarged images of the information display member and the transport device accessory information shown in the acquired transport device images; and information association means for associating the read workpiece accessory information and transport device accessory information and storing them in a storage means.

[0007] In the invention described in claim 1, an object detection means automatically detects an information display component from the workpiece image acquired by the camera, and an information reading means automatically reads the workpiece accessory information contained in the enlarged image of the information display component acquired by the camera, and the transporter accessory information contained in the transporter image acquired by the camera. This eliminates the need for the operator to read the workpiece accessory information for each workpiece or the transporter accessory information for each transporter using a handheld device, thus enabling the reading of accessory information to be completed in a short time. Furthermore, since both workpiece accessory information and transporter accessory information can be acquired with a single system using a camera, it is not necessary to introduce separate systems for reading workpiece accessory information and transporter accessory information. Therefore, the cost of introducing an information management system can be reduced.

[0008] The invention described in claim 2 is characterized in that, in claim 1, if the reading of the workpiece-related information by the information reading means fails, the camera repeatedly photographs the information display member and obtains an enlarged image of the information display member until the reading is successful.

[0009] In the invention described in claim 2, until the reading of the workpiece accessory information is successful, an enlarged image of the information display member showing the information display member is repeatedly acquired, and the workpiece accessory information reading operation is performed each time an enlarged image of the information display member is acquired. As a result, since the reading operation is performed many times, the probability of successfully reading the workpiece accessory information can be increased.

[0010] The invention described in claim 3 is characterized in that, in claim 2, the camera takes photographs in the order of the workpiece being transported, the information display member attached to the workpiece, and the transport device paired with the workpiece.

[0011] In the invention described in claim 3, the workpiece, which is relatively large and therefore easy to photograph, is photographed first, followed by the information display member, which is difficult to photograph because it is necessary to capture information attached to the workpiece. This ensures that the workpiece is photographed reliably while allowing time for re-photographing of the information display member in case of failure to read the information attached to the workpiece.

[0012] The invention described in claim 4 is characterized in that, in claim 1, the workpiece is an automobile body to be painted, and the conveying means is a hanger conveyor having a plurality of hangers as conveying devices for suspending and conveying the automobile body.

[0013] The invention described in claim 5 is characterized in that, in claim 1, the information display member is a tag on which the workpiece-related information is written, the workpiece-related information includes a two-dimensional code and character information, the transporter-related information is character information attached to the upper end of the hanger, and the information reading means is a two-dimensional code reader and an optical character reader.

[0014] Here, examples of two-dimensional codes included in workpiece-related information include matrix-type two-dimensional codes such as QR code (a registered trademark of DENSO WAVE INCORPORATED), DataMatrix, and VeriCode, as well as stack-type two-dimensional codes such as PDF417 and CODE49. In addition, examples of character information included in workpiece-related information and transporter-related information include characters, numbers, and symbols.

[0015] The invention described in claim 6 further comprises a control device that controls the operation of the camera, the object detection means, the information reading means and the information association means, wherein the control device includes the steps of: operating the camera and photographing the workpiece being transported to acquire a workpiece image; operating the object detection means and detecting the information display member from the acquired workpiece image; operating the camera and zooming in on the information display member using the PTZ function to acquire an enlarged image of the information display member; and operating the information reading means. The gist of the system is that it is configured to sequentially execute the following steps: reading the workpiece accessory information shown in the enlarged image of the acquired information display member; operating the camera and using the PTZ function to move the object to be photographed to the transporter paired with the workpiece being transported, and to photograph the transporter, thereby acquiring an image of the transporter; operating the information reading means and reading the transporter accessory information shown in the acquired image of the transporter; and operating the information association means and associating the read workpiece accessory information and the transporter accessory information and storing them in the storage means.

[0016] In the invention described in claim 6, by activating the object detection means, an information display member is automatically detected from the workpiece image acquired by the camera, and by activating the information reading means, the workpiece accessory information shown in the enlarged image of the information display member acquired by the camera and the transporter accessory information shown in the transporter image acquired by the camera are automatically read. This eliminates the need for the operator to read the workpiece accessory information for each workpiece or the transporter accessory information for each transporter using a handheld device, thus enabling the reading of accessory information to be completed in a short time. Furthermore, since both workpiece accessory information and transporter accessory information can be acquired with a single system using a camera, it is not necessary to introduce separate systems for reading workpiece accessory information and transporter accessory information. Therefore, the cost of introducing an information management system can be reduced. [Effects of the Invention]

[0017] As described in detail above, according to the invention of claims 1 to 6, the operation of reading the additional information can be performed in a short time, and the system introduction cost can be reduced.

Brief Description of the Drawings

[0018] [Figure 1] A schematic cross-sectional view showing an information management system for a painting facility in this embodiment. [Figure 2] A front view showing a hanger in this embodiment. [Figure 3] A front view showing a tag. [Figure 4] A flowchart showing the processing performed by the information management system.

Modes for Carrying Out the Invention

[0019] Hereinafter, an embodiment embodying the present invention will be described in detail based on the drawings.

[0020] As shown in FIG. 1, the information management system 1 of this embodiment is a system for managing information regarding the painting facility 10. Further, the painting facility 10 of this embodiment is a facility for transporting an automobile body W1 (workpiece) before electrocoating. The painting facility 10 is formed in a substantially rectangular parallelepiped shape using a wall material such as an iron plate, and includes a ceiling portion 11, a floor portion 12, and a pair of side walls 13.

[0021] Further, the painting facility 10 includes a hanger conveyor 21 (transport means) for transporting the automobile body W1 in the transport direction (left direction in FIG. 1). As shown in FIGS. 1 and 2, the hanger conveyor 21 has a pair of rails 22 extending in the transport direction. Further, the hanger conveyor 21 has a plurality of hangers 23 as transport tools that are suspended from the rails 22 and suspend and transport the automobile body W1. The hanger 23 of this embodiment is one that suspends and transports the automobile body W1, which is an object to be painted, so as to be immersible in an electrocoating tank (not shown), and is so-called an overhead hanger or a C-type hanger.

[0022] As shown in FIG. 2, in the painting facility 10, a hanger number 31, which is conveyance tool - attached information, is attached to each of a plurality of hangers 23. The hanger number 31 is character information (in FIG. 2, the number "89") attached to the upper end portion of the hanger 23. Further, as shown in FIGS. 2 and 3, in the painting facility 10, a paper tag 41, which is an information display member, is attached to each of a plurality of automobile bodies W1. The tag 41 has a rectangular shape and is suspended by a string 42 at the lower end portion (the lower right portion in FIG. 2) on the front side (the traveling direction side) of the automobile body W1. Also, on the surface of the tag 41, a QR code 43 (two - dimensional code), which is workpiece - attached information, and a character string 44, which is also workpiece - attached information, are described. The character string 44 is character information consisting of a large number of characters. The character string 44 in the present embodiment describes production instruction contents (for example, vehicle body type, body No., frame No., color code, drive type, etc.) in numbers and English letters. Also, the QR codes 43 are respectively arranged at two corner portions of the tag 41 (the upper left portion and the lower right portion in FIG. 3).

[0023] As shown in FIGS. 1 and 2, the information management system 1 includes a fixed camera 50. Specifically, the camera 50 is installed near the tag 41 attached to the automobile body W1 and is arranged to face the conveyance path of the automobile body W1 (hanger 23) diagonally upward (the upper left in FIG. 2). Also, the camera 50 in the present embodiment has a PTZ (Pan - Tilt - Zoom) function capable of pan control, tilt control, and zoom control. The camera 50 uses the PTZ function to photograph the automobile body W1 during conveyance, the tag 41 attached to the automobile body W1, and the hanger 23 paired with the automobile body W1, and obtains a workpiece image G1 (see FIG. 2), an information display member enlarged image G2 (see FIG. 2), and a conveyance tool image G3 (see FIG. 2). Then, the camera 50 outputs the image data of the obtained workpiece image G1, information display member enlarged image G2, and conveyance tool image G3.

[0024] Furthermore, camera 50 is configured to read work-related information (QR code 43 and string 44) captured in the acquired enlarged image G2 of the information display component, and transport equipment-related information (hanger number 31) captured in the acquired transport equipment image G3. In other words, camera 50 has the function of an "information reading means." Camera 50 also functions as a QR code reader, which is a two-dimensional code reader, and an OCR (Optical Character Reader), which is an optical character reader.

[0025] Next, we will describe the electrical configuration of the information management system 1.

[0026] As shown in Figure 1, the information management system 1 is equipped with a personal computer 60, which in turn is equipped with a control device 61 that comprehensively controls the entire system. The control device 61 consists of a CPU 62, ROM 63, RAM 64, input / output circuits, etc. The keyboard 65 and display 66 of the personal computer 60 are electrically connected to the CPU 62. Furthermore, the CPU 62 is electrically connected to the hanger conveyor 21 and the camera 50, and controls them with various drive signals.

[0027] Next, we will explain the method for managing information about the painting equipment 10 using the information management system 1.

[0028] First, the operator sets up the camera 50, which has PTZ functionality, in a position (home position) where it can photograph the automobile body W1. The CPU 62 then outputs a drive signal to the hanger conveyor 21, causing the automobile body W1 (hanger 23) to be continuously transported into the painting equipment 10 and continuously transported out of the painting equipment 10. In this state, the CPU 62 performs control to execute information management for the painting equipment 10.

[0029] Specifically, in step S10 shown in Figure 4, the CPU 62 activates the camera 50 and takes a picture of the transported automobile body W1 at its home position to acquire a workpiece image G1 (see Figure 2). In the subsequent step S20, the CPU 62 detects the tag 41 from the acquired workpiece image G1 using object detection, with the aim of acquiring an enlarged image G2 of the information display component (see Figure 2). In other words, the CPU 62 has the function of an "object detection means".

[0030] The tag 41 can be detected using conventionally known object detection methods. For example, the CPU 62 processes the work image G1 to extract features (e.g., the shape and brightness of the tag 41). Then, the CPU 62 determines whether or not the tag 41 exists based on the feature extraction results.

[0031] More specifically, CPU62 divides the work image G1 into a grid, and then performs image processing on the resulting regions to extract features from each region. For example, it calculates the difference in brightness (gradation) of each pixel in each region. Then, CPU62 calculates a histogram of the gradation direction based on the calculated gradation direction, and uses the resulting histogram as a feature.

[0032] Next, CPU62 performs inference to determine whether tag 41 exists or not, based on the extracted features. First, CPU62 constructs a trained model. This trained model is used to determine whether tag 41 exists or not. More specifically, the trained model causes the computer to function by accumulating input information (features) in the input layer of a neural network (not shown) and outputting output information (information on whether tag 41 exists or not) from the output layer of the neural network. The neural network is a model of the network formed by connecting neurons in the human brain's nervous system with synapses.

[0033] The CPU 62 then stores the constructed trained model in the RAM 64. The CPU 62 then uses the trained model (neural network) stored in the RAM 64 to determine whether or not tag 41 exists.

[0034] In the following step S30, the CPU 62 determines whether or not the detection of tag 41 was successful. If the detection of tag 41 fails, the CPU 62 repeats the process in step S20. The processes in steps S20 and S30 are repeated until the detection of tag 41 is successful.

[0035] Then, if the detection of tag 41 is successful, in step S40, the CPU 62 activates the camera 50 and uses the PTZ function to move the camera to the tag 41 attached to the car body W1 being transported and zoom in on tag 41. Next, in step S50, the CPU 62 processes the zoomed-in tag 41 and acquires an enlarged image G2 of the information display component (see Figure 2). In the following step S60, the CPU 62 activates the QR code reader of the camera 50 and reads the QR code 43 (see Figure 3) that is visible in the acquired enlarged image G2 of the information display component. The CPU 62 also activates the OCR of the camera 50 and reads the string of characters 44 (see Figure 3) that is visible in the enlarged image G2 of the information display component.

[0036] In the following step S70, the CPU 62 determines whether the reading of the QR code 43 and the string 44 was successful. If the reading of the QR code 43 and the string 44 fails because the tag 41 is bent or otherwise damaged, the CPU 62 repeats the process in step S50. The CPU 62 then repeatedly takes a picture of the tag 41 and obtains an enlarged image G2 of the information display component until the reading of the QR code 43 and the string 44 is successful.

[0037] Then, if the reading of the QR code 43 and the string 44 is successful, in step S80, the CPU 62 activates the camera 50 and uses the PTZ function to move the target to the hanger 23 that is paired with the transported car body W1 and zooms in to photograph the hanger number 31. Next, in step S90, the CPU 62 processes the zoomed-in hanger number 31 to obtain a transport equipment image G3 (see Figure 2). That is, the camera 50 photographs the transported car body W1, the tag 41 attached to the car body W1, and the hanger 23 that is paired with the car body W1 in that order. Next, the CPU 62 activates the OCR function of the camera 50 and reads the hanger number 31 that is visible in the acquired transport equipment image G3.

[0038] In the following step S100, the CPU 62 determines whether the reading of hanger number 31 was successful. If the reading of hanger number 31 fails, the CPU 62 repeats the process in step S80. The CPU 62 then repeatedly performs the process of photographing the hanger 23 and acquiring the transporter image G3 until the reading of hanger number 31 is successful.

[0039] Then, if the reading of hanger number 31 is successful, the CPU 62 controls the transmission of the reading result in step S110. Specifically, the CPU 62 is activated to associate the workpiece-related information (QR code 43, string 44) and the transporter-related information (hanger number 31), which are the reading results, and store them in the ROM 63 (storage means). In other words, the CPU 62 has the function of an "information association means". The information obtained from the tag 41 and the hanger number 31 will be used for tracking (traceability) the process from production to consumption of the automobile (automobile body W1). Then, the CPU 62 terminates processing at this point.

[0040] Therefore, according to this embodiment, the following effects can be obtained.

[0041] (1) In the information management system 1 of this embodiment, the CPU 62 automatically detects the tag 41 from the workpiece image G1, and automatically reads the QR code 43 and string 44 shown in the enlarged image G2 of the information display member, and the hanger number 31 shown in the transporter image G3. This eliminates the need for an operator to use a handheld device to read the workpiece information (QR code 43 and string 44) of the tag 41 for each automobile body W1, or to read the transporter information (hanger number 31) of the hanger 23 for each hanger 23, thus enabling the reading of the accompanying information to be completed in a short time. Furthermore, since the accompanying information of multiple elements (tag 41, hanger number 31) can be acquired with a single system using the camera 50, it is not necessary to introduce separate systems for reading workpiece information and transporter information. Therefore, the introduction cost of the information management system 1 can be reduced.

[0042] (2) In this embodiment, since the camera 50 has a PTZ function, when the camera 50 is activated, it is possible to zoom in and photograph the tag 41, or move the subject to be photographed to the hanger 23 and zoom in and photograph the hanger number 31. In other words, the shooting range is widened, so even if the type of automobile body W1 is increased, it is not necessary to add or change the shooting point.

[0043] (3) For example, one could also consider a method of obtaining information on the automobile body W1 and hanger 23 from an ID management system (not shown). However, this would require the installation of a receiving terminal to obtain the information, and would necessitate competing for the communication load with the ID management system, resulting in high implementation and management costs. On the other hand, in this embodiment, information on the automobile body W1 and hanger 23 can be obtained by operating the camera 50, so the management of IDs (information) can be completed within the painting facility 10 while the automobile body W1 is being transported.

[0044] (4) In this embodiment, the CPU 62 detects the position of the tag 41 in the work image G1 by using object detection. Therefore, by operating the camera 50 and moving the object to be photographed to the detected tag 41 and zooming in, an enlarged image G2 of the information display member showing the tag 41 can be reliably obtained. In addition, because the zoom is adjusted to the position of the tag 41, it becomes easy to zoom in at high magnification. As a result, even fine details of the tag 41 become visible, improving the accuracy of reading the QR code 43 and the string 44.

[0045] (5) In this embodiment, a QR code 43 and a string of characters 44 are printed on the surface of the tag 41. However, since the tag 41 is suspended from the automobile body W1 by a string 42, depending on the angle, it may be difficult for the camera 50 to read the QR code 43 and the string of characters 44. Also, since the tag 41 is made of paper and is prone to warping, if it warps, the QR code 43 and the string of characters 44 may be hidden. Furthermore, if the tag 41 is warped, there is a problem that it becomes difficult to read the QR code 43 and the string of characters 44.

[0046] Therefore, in this embodiment, until the reading of the QR code 43 and the string 44 is successful, an enlarged image G2 of the information display member showing the tag 41 is repeatedly acquired, and the reading operation of the QR code 43 and the string 44 is performed each time the enlarged image G2 of the information display member is acquired. As a result, since the reading operation is performed many times, the probability of successfully reading the QR code 43 and the string 44 can be increased.

[0047] (6) In this embodiment, the two QR codes 43 are printed on the two corners of the tag 41 (upper left and lower right in Figure 3). That is, since each QR code 43 is printed at the most spaced-out position on the surface of the tag 41, even if one QR code 43 is hidden, there is a high probability that the other QR code 43 will be successfully read.

[0048] The above embodiment may be modified as follows.

[0049] In the above embodiment, the process of step S30 (the process of determining whether or not the detection of the tag 41 was successful) and the process of step S100 (the process of determining whether or not the reading of the hanger number 31 was successful) shown in Figure 4 may be omitted.

[0050] In the above embodiment, the tag 41 had two QR codes 43 printed on it. However, there may be only one QR code 43 printed on the surface of the tag 41, or there may be three or more QR codes 43 printed on the surface of the tag 41.

[0051] In the above embodiment, a hanger conveyor 21 having multiple hangers 23 as transport devices for suspending and transporting the automobile body W1 was used as the transport means, but it is not limited to this. For example, a floor conveyor having multiple trolleys as transport devices for transporting the automobile body W1 on it may also be used as the transport means.

[0052] The information management system 1 in the above embodiment was a system for managing painting equipment 10 that transports the painted automobile body W1 (workpiece). However, the information management system 1 may also be a system for managing painting booths (painting equipment) that paint automobile bodies W1, automobile parts (workpieces) such as bumpers, and other parts (workpieces). Furthermore, the information management system 1 may also be a system for managing drying ovens (painting equipment) that dry the painted workpieces.

[0053] Next, in addition to the technical ideas described in the claims, the technical ideas that can be grasped by the embodiments described above are listed below.

[0054] (1) The information management system for painting equipment according to claim 1, wherein if the object detection means fails to detect the information display member, it repeats the detection of the information display member until the detection is successful.

[0055] (2) The information management system for painting equipment according to claim 1, wherein if the reading of the transporter accessory information by the information reading means fails, the camera repeatedly photographs the transporter and acquires an image of the transporter until the reading is successful. [Explanation of Symbols]

[0056] 1…Information Management System 10…Painting equipment 21. Hanger conveyor as a means of transport 23…Hangers as transport devices 31... Hanger number as information attached to the transport equipment and as textual information. 41... Tags as information display components 43… QR code as work-related information and a two-dimensional code 44...Strings as work-related information and textual information 50... Cameras as a means of information acquisition 61...Control device 62...CPU as object detection means and information association means 63...ROM as a means of storage G1...Work image G2... Enlarged image of information display component G3...Image of transport equipment W1...Automotive body as a workpiece

Claims

1. An information management system for a painting facility, wherein a predetermined operation is performed on multiple workpieces while continuously transporting them using a transport means having multiple transport devices, transport device-related information is attached to each of the multiple transport devices, and an information display member containing workpiece-related information is attached to each of the multiple workpieces, A camera having a PTZ function, which uses that PTZ function to photograph the workpiece during transport, the information display member attached to the workpiece, and the transport device paired with the workpiece, respectively, and acquires images of the workpiece, an enlarged image of the information display member, and an image of the transport device. For the purpose of obtaining an enlarged image of the information display member, an object detection means for detecting the information display member from the acquired work image, Information reading means for reading the workpiece-related information shown in the acquired enlarged image of the information display member and the transporter-related information shown in the acquired transporter image, Information association means for storing the read workpiece-related information and transporter-related information in a storage means in association with each other. An information management system for painting equipment, characterized by having the following features.

2. The information management system for painting equipment according to claim 1, characterized in that if the reading of the workpiece-related information by the information reading means fails, the camera repeatedly photographs the information display member and obtains an enlarged image of the information display member until the reading is successful.

3. The information management system for painting equipment according to claim 2, characterized in that the camera takes photographs in the order of the workpiece being transported, the information display member attached to the workpiece, and the transport device paired with the workpiece.

4. The workpiece is an automobile body, which is the object to be coated. The transport means is a hanger conveyor having a plurality of hangers as transport devices for suspending and transporting the automobile body. The information management system for painting equipment according to feature 1.

5. The information display member is a tag on which the workpiece-related information is written, The aforementioned work-related information includes a two-dimensional code and text information. The aforementioned transport device information is text information attached to the upper end of the hanger. The information reading means is a two-dimensional code reader and an optical character reader. The information management system for painting equipment according to feature 1.

6. The system further includes a control device that controls the operation of the camera, the object detection means, the information reading means, and the information association means, and the control device is The steps include: activating the camera and taking a picture of the workpiece while it is being transported to acquire an image of the workpiece; The steps include activating the object detection means and detecting the information display member from the acquired work image, The steps include: activating the camera, using the PTZ function to zoom in and photograph the information display member, and acquiring an enlarged image of the information display member; The steps include: activating the information reading means and reading the workpiece-related information captured in the enlarged image of the information display member obtained; The steps include: activating the camera, using the PTZ function to move the object to be photographed to the transporter paired with the workpiece being transported, photographing the transporter, and acquiring an image of the transporter; The steps include: activating the information reading means and reading the transport device accessory information contained in the acquired transport device image; The steps include: activating the information association means and associating the read workpiece-related information and transporter-related information and storing them in the storage means; It is configured to execute them sequentially. An information management system for painting equipment according to any one of claims 1 to 5.

Images