Component measuring device, component measuring method, and component measuring program
The component measuring device uses distinct colored lights to enhance the visibility of component edges, addressing the issue of erroneous recognition due to dirt or stains, and achieving accurate extraction of component edges.
Patent Information
- Application Number
- JP2021134365
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-08-19
- Publication Date
- 2025-06-06
- Estimated Expiration
- 2041-08-19
AI Technical Summary
Existing component measurement systems face challenges in accurately distinguishing the boundary between a component and its base due to stains and dirt, leading to erroneous recognition.
A component measuring device and method that utilize a first and second irradiation unit to illuminate the component and base with different colored lights, allowing an imaging unit to capture images and an extraction unit to accurately extract the component's end portion.
This approach effectively reduces erroneous recognition of components and their bases, enabling precise extraction of component edges even in the presence of dirt or stains.
Smart Images

Figure 0007689464000001 
Figure 0007689464000002 
Figure 0007689464000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a component measuring device, a component measuring method, and a component measuring program. [Background technology]
[0002] Patent Document 1 proposes a method for inspecting the appearance and shape of a test object, in which a tire mounted on a turntable is photographed while rotating using a light projecting means that irradiates white slit light and a color CCD camera that photographs the area illuminated by the slit light, the coordinates and brightness of the tire are detected from the obtained image data using a coordinate calculation means and a brightness calculation means, three-dimensional coordinate data and a color image of the tire are reconstructed from the obtained tire shape data and brightness data in a shape image construction means and an appearance image construction means, and the appearance and shape are judged to be good or bad by comparing the tire appearance and shape data with tire appearance and shape data pre-stored in a tire information storage means in a shape determination means and an appearance determination means.
[0003] Patent document 2 proposes an apparatus for evaluating the appearance of the surface of a tire, comprising a linear color camera, means for the camera to separate a light beam reflected by the tire surface and entering the camera into at least two basic colors of a given wavelength, and direct the light beam to an equal number of sensors capable of obtaining basic images of gray levels for each of the basic colors, and lighting means in the same number as the number of basic colors, the lighting means being directed to illuminate the surface to be evaluated at angles different from each other, each of the lighting means generating light different from the light of the other lighting means, the wavelength of this light substantially matching the wavelength of one of the basic colors selected by the camera. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2003-240521 A [Patent Document 2] Special Publication No. 2011-511932 Summary of the Invention [Problem to be solved by the invention]
[0005] When capturing an image of the tip of a component and attempting to extract the component end from the image capture results, stains and dirt may adhere to the base on which the component is placed, making it difficult to distinguish the boundary between the component and the base, which can result in the component and the base being misrecognized.
[0006] The present invention has been made in consideration of the above-mentioned circumstances, and aims to provide a component measurement device, a component measurement method, and a component measurement program that are capable of reducing erroneous recognition of a component and its base when extracting the ends of a component. [Means for solving the problem]
[0007] In order to achieve the above object, one aspect of the present disclosure is to A first irradiation unit is provided at an angle to the inclination direction of the inclined shape of a member having an inclined shape that gradually increases in thickness from a bottom surface end toward an inner surface of the surface, and irradiates light of a predetermined first color along the inclination direction; a second irradiating unit provided opposite the inclined shape and configured to irradiate the inclined shape with light of a second color different from the first color; an imaging unit that images the member and a surface on which the member is placed; an extraction unit that extracts an end portion of the member from an imaging result of the imaging unit; It is a component measuring device including:
[0008] The second aspect is The computer A first light of a predetermined color is irradiated from a first irradiating unit provided at an angle to the inclination direction of a member having an inclined shape in which the thickness gradually increases from a bottom surface end toward the inside of the surface, Irradiating the inclined shape with light of a second color different from the predetermined color from a second irradiation unit provided opposite the inclined shape; An image of the member and a surface on which the member is placed is captured by an imaging unit; The member measuring method includes processing for extracting the end portion of the member from the imaging result of the imaging unit.
[0009] The third aspect is On the computer, A first light of a predetermined color is irradiated from a first irradiating unit provided at an angle to the inclination direction of a member having an inclined shape in which the thickness gradually increases from a bottom surface end toward the inside of the surface, Irradiating the inclined shape with light of a second color different from the predetermined color from a second irradiation unit provided opposite the inclined shape; An image of the member and a surface on which the member is placed is captured by an imaging unit; A component measurement program for executing a process of extracting an end portion of the component from the imaging result of the imaging unit. Effect of the Invention
[0010] According to the present disclosure, it is possible to reduce erroneous recognition of a component and its background when extracting the edge of the component. [Brief description of the drawings]
[0011] [Figure 1] FIG. 2 is a diagram showing a schematic configuration of a measuring unit that measures a member of the member measuring device according to the present embodiment. [Diagram 2] FIG. 1 is a block diagram showing a schematic configuration of a member measuring device according to a second embodiment of the present invention. [Diagram 3] FIG. 4 is a diagram showing an example of the relative positions of two measuring units. [Figure 4] 5 is a flowchart showing an example of the flow of a measurement process performed by a measurement controller of the component measuring device according to the present embodiment. [Diagram 5] 10 is a flowchart showing an example of the flow of an imaging process. [Figure 6] FIG. 13 is a diagram showing an example of a captured image of a measuring unit on the tip side. [Figure 7] 13 is a diagram showing an example of a captured image of a measurement unit on the rear end side. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, an embodiment for implementing the technology of the present disclosure will be described in detail with reference to the drawings. Note that components and processes that have the same action and function are given the same reference numerals throughout the drawings, and duplicated descriptions may be omitted as appropriate. In addition, the present disclosure is not limited to the following embodiments, and can be implemented with appropriate modifications within the scope of the purpose of the present disclosure.
[0013] In the embodiment, a tire component is used as an example of a component, and a component measuring device that measures the length of a tire component will be described as an example.
[0014] FIG. 1 is a diagram showing a schematic configuration of a measurement unit that measures a component of a component measuring device according to this embodiment.
[0015] The component measuring device according to this embodiment includes an optical device 20 for imaging a tire component 18 and extracting an end of the tire component 18 from the imaging result.
[0016] 1, the tire member 18 has an inclined shape 18A that is inclined so that the thickness of the member 18 gradually increases from the bottom end toward the inner surface of the member 18. In this embodiment, the member 18 has an elongated shape, and the inclined shape 18A is provided on the side surface that is the long side of the elongated shape of the member 18.
[0017] In this embodiment, the optical device 20 includes a camera 12 as an example of an imaging section, a blue LED (Light Emitting Diode) 14 as an example of a first irradiating section, and a red LED 16 as an example of a second irradiating section.
[0018] In this embodiment, a color camera that captures color images is applied as the camera 12. The camera 12 is provided above the end of the side surface of the component 18, and captures an image of an area including the component 18 and the base 19 on which the component 18 is placed. In this embodiment, the camera 12 is fixed at a position where the center of its field of view corresponds to the end of the component 18.
[0019] The blue LED 14 is provided at an angle to the inclination direction of the inclined shape 18A of the member 18, and irradiates blue light as a predetermined first color along the inclination direction of the inclined shape 18A. Specifically, the blue LED 14 is disposed on the upper part of the member 18, and is disposed at an angle at a predetermined angle to the inclination direction of the inclined shape 18A with respect to the vertical so as to minimize irradiation of the inclined shape 18A of the side surface of the member 18. As shown in FIG. 1, the blue LED 14 irradiates light along the inclined shape 18A of the member 18, and irradiates the blue light mainly onto the base 19. As the predetermined angle, for example, an angle of 15 degrees or the like is applied as an example.
[0020] The red LED 16 is provided facing the inclined shape 18A, and irradiates the inclined shape 18A with red light as a second color different from the first color. Specifically, the red LED 16 is disposed at a position facing the inclined shape 18A of the member 18, and irradiates the base 19 of the member 18 and the inclined shape 18A that forms the side surface of the member 18 with red light.
[0021] That is, the base 19 on which the component 18 is placed is irradiated with both red and blue light and turns purple, the inclined shape 18A of the side surface of the component 18 is mainly irradiated with red light, and the top surface of the component 18 is mainly irradiated with blue light.
[0022] Next, the configuration of the member measuring device according to this embodiment will be described below. Fig. 2 is a block diagram showing a schematic configuration of the member measuring device according to this embodiment.
[0023] The member measuring device 10 according to this embodiment includes a measurement controller 22 as an example of an extraction unit and a measurement unit, and a PLC (Programmable Logic Controller) 24 that controls the entire device.
[0024] The measurement controller 22 controls the optical device 20 including the camera 12, blue LED 14, and red LED 16 described above, and also performs a process of extracting the end of the member 18 from the captured image, and a process of measuring the length of the member 18 from the extracted end. The measurement controller 22 includes a CPU (Central Processing Unit) 22A, a ROM (Read Only Memory) 22B, a RAM (Random Access Memory) 22C, a storage 22D, and an I / O (Input / Output) 22E. The CPU 22A controls the operation of the measurement controller 22. The RAM 22C is used as a work area when the CPU 22A executes various programs. The ROM 22B stores various control programs, various parameters, and the like in advance. The storage 22D stores various data, application programs, and the like. Examples of the storage include a hard disk drive (HDD), a solid state drive (SSD), and a flash memory. The above-mentioned optical device 20 is connected to the I / O 22E, and the optical device 20 is controlled by the measurement controller 22. Each unit of the measurement controller 22 is electrically connected to a system bus 22F.
[0025] The PLC 24 includes a calculation unit, a storage unit, and an input / output unit (not shown), and performs communication with the measurement controller 22, controls a positioning device 26 that positions the optical device 20, and controls the entire device.
[0026] The optical device 20 is provided for the purpose of measuring the length of the member 18, and although only a single optical device 20 is shown in Figures 1 and 2, in detail, two optical devices 20 are provided. In order to measure the length of the member 18, two optical devices 20 are provided, and their arrangement relationship is as shown in Figure 3. That is, the camera 12, the blue LED 14, and the red LED 16 constitute one set of optical devices 20, and one set of optical devices 20 is disposed at each of the leading end and trailing end sides of the member 18.
[0027] In this embodiment, the length of the tire member 18 is known in advance, and positioning is performed so that the distance between the centers of the front end camera 12 and the rear end camera 12 corresponds to the length of the member 18. For this reason, the cameras are installed in a camera positioning device (not shown), and the PLC 24 is responsible for positioning the positioning device.
[0028] Here, the overall operational flow of the component measuring device 10 according to this embodiment will be briefly described.
[0029] First, the PLC 24 grasps in advance the length of the member 18, and controls the positioning device 26 to position the camera 12 on the leading end side so that the inter-camera distance is a predetermined distance. Note that a configuration in which the camera 12 on the trailing end side is positioned may also be adopted.
[0030] The PLC 24 then positions the tire section 18, cut to a predetermined length, at the measurement point of the camera 12. Now, measurement of the length of the section 18 begins as soon as the section 18 is ready to be wound onto the drum.
[0031] In order to measure the length of the member 18 , the PLC 24 outputs an image capture command to the measurement controller 22 .
[0032] When the measurement controller 22 receives an imaging instruction from the PLC 24, it executes the measurement process shown in FIG. 4 (details will be described later) to extract characteristic points of the component 18, measure the length of the component 18, and return the measurement result to the PLC 24.
[0033] The PLC 24 reflects the measurement results received from the measurement controller 22 in the winding control of the member 18 and winds the member 18 around the drum.
[0034] Next, a detailed flow of the above-mentioned measurement process will be described. Fig. 4 is a flowchart showing an example of the flow of the measurement process performed by the measurement controller 22 of the member measuring device 10 according to this embodiment. The process in Fig. 4 starts when the measurement controller 22 receives an image capture instruction from the PLC 24.
[0035] In step 100, the CPU 22A executes an imaging process and proceeds to step 102. Since the spectral sensitivity characteristics of the imaging element of the camera 12 vary widely, the white balance is generally adjusted in advance before use for measurement. It is known that the sensitivity characteristics of the optical device 20 change due to aging, and the optical device 20 itself becomes dirty due to the manufacturing site environment, so that the imaging environment changes from moment to moment. Therefore, even if the white balance is uniquely set, robustness is lost. In the imaging process, therefore, imaging processing for maintaining robustness is performed. Specifically, the imaging process shown in FIG. 5 is performed. FIG. 5 is a flowchart showing an example of the flow of the imaging process.
[0036] That is, in step 200, the CPU 22A sets the imaging parameters and proceeds to step 202. Examples of the imaging parameters are set as follows: exposure time: 1.5 [msec] (arbitrary), camera red gain Gr: 1.0 (default, arbitrary), camera blue gain Gb: 1.0 (default, arbitrary), blue LED gain B: 15 (arbitrary), red LED gain R: 127 (arbitrary).
[0037] In step 202, the CPU 22A performs a first image capture, and proceeds to step 204. In this embodiment, image capture is performed twice, and the first image capture is intentionally performed darkly by fixing the RGB sensitivity, exposure time, and illumination gain of the camera 12.
[0038] In step 204, the CPU 22A performs a shading inspection of the substrate 19, and the process proceeds to step 206. In the shading inspection of the substrate 19, the average shading values of R and B are obtained. Specifically, the first captured image is investigated, and each parameter required for the second capture is calculated. First, the exposure time is determined to determine the brightness. As can be seen from FIG. 1, the captured image has the component 18 captured in one half of the region in the left-right direction of the image, and the substrate 19 is mainly captured on the other side. Therefore, by investigating the shading distribution of any region of the substrate 19, it is possible to calculate the exposure time required for the second capture. This investigation of the shading distribution can simultaneously obtain not only the state of the optical device 20 but also the degree of dirt on the substrate 19.
[0039] In step 206, the CPU 22A sets the camera sensitivity magnification and proceeds to step 208. In detail, the white balance is adjusted based on the state of the background 19. For example, the R and B density ratio is set to 9:10, and the RGB sensitivity of the camera 12 required for the second image capture can be calculated based on the results of the investigation of the first captured image. As an example of the setting of the camera sensitivity magnification, the exposure time is adjusted to 1.5 [msec] as the brightness adjustment, and the camera gain is set so that the density ratio R / B=0.9 as the white balance adjustment. Specifically, when R / B≦0.9, Gr=B average density value / R average density value×0.9, Gb=1.0 (default), and when R / B>0.9, Gr=1.0 (default), Gb=R average density value / B average density value / 0.9.
[0040] In step 208, the CPU 22A performs the second imaging and ends the series of imaging processes. That is, by performing the second imaging using the parameters calculated as described above, it becomes possible to obtain a stable captured image.
[0041] When the imaging process is completed, the process proceeds to step 102 in FIG. 4, where the CPU 22A executes a tip feature point extraction process, and the process proceeds to step 104.
[0042] In step 104, the CPU 22A performs a rear end feature point extraction process, and then the process proceeds to step .
[0043] Here, a description will be given of the leading end feature point extraction process in step 104 and the trailing end feature point extraction process in step 106. Note that steps 104 and 106 correspond to an example of an extraction unit.
[0044] From the positional relationship between the optical device 20 and the member 18 shown in Fig. 1 and Fig. 3, the image acquired by the optical device 20 on the tip side is as shown in Fig. 6. That is, in the captured image of the optical device 20 on the tip side, the red color (horizontal hatching area in Fig. 6) of the side of the member 18 is emphasized, and the purple color (cross-hatched area in Fig. 6) of the base 19 made up of both red (horizontal hatching in Fig. 6) and blue (vertical hatching in Fig. 6) is emphasized, and uniformity of white balance is ensured. Another feature is that the properties do not change regardless of whether the base 19 is dirty or not.
[0045] The detection target required to measure the component length is a corner of component 18. Because the detection target belongs to an area with a small amount of blue components, after extracting that area, it is possible to geometrically identify the corner of component 18. As a result, even if dirt or stains occur on the conveyor or the like that serves as the base 19 of component 18, the corner can be accurately extracted due to the color contrast. Furthermore, in this embodiment, blue, which has a short wavelength, and red, which has a long wavelength, are used, so that the corner of the component can be extracted more accurately than if other colors are used.
[0046] The image captured by the optical device 20 at the rear end is as shown in Fig. 7, and the corners of the component 18 can be identified from the same perspective as the front end side. Note that in Fig. 7, vertical hatching indicates areas highlighted in blue, horizontal hatching indicates areas highlighted in red, and cross hatching indicates areas highlighted in purple.
[0047] Next, in step 106, the CPU 22A measures the length of the component and proceeds to step 108. In detail, after extracting the corner points of the front and rear ends, the positions of the corner points are compared with the measurement reference as a reference position, and the amount of deviation from the measurement reference is calculated to calculate the length of the component 18. For example, as shown in FIG. 3, the distance between the cameras at the front and rear ends is previously positioned to the length of the component 18, so the distance between the measurement references of the front and rear end images is known. Therefore, the length of the component 18 can be calculated by adding the amount of deviation from the measurement reference. Note that step 106 corresponds to an example of a measurement unit.
[0048] In step 108, the CPU 22A performs a result return process and ends the series of measurement processes. That is, the measurement result of the length of the member 18 is transmitted from the measurement controller 22 to the PLC 24. This enables the PLC 24 to reflect the measurement result received from the measurement controller 22 in the winding control of the member 18 and to perform winding of the member 18 around the drum.
[0049] Incidentally, it is conceivable to measure the length of the component 18 using a laser displacement meter, but since the sensor is moved while the imaged object is fixed in place, it takes time to image the object, and the imaged object may deform during measurement, making it impossible to measure accurately. In addition, if the sensor is fixed and the component is moved, the base and the component may slip, making it impossible to measure the length accurately. In contrast, in this embodiment, the leading and trailing ends of the component 18 are imaged, and the length of the component 18 is measured from the leading and trailing ends, so that the component 18 can be imaged before it deforms during measurement, making it possible to measure the length of the component 18 more accurately than with a laser displacement meter.
[0050] In the above embodiment, the blue LED 14 is used as the first irradiating unit, and the red LED 16 is used as the second irradiating unit. However, the two colors are not limited to blue and red, and other color combinations may be used.
[0051] In the above embodiment, the blue LED 14 is arranged at a predetermined angle in the inclination direction of the inclined shape 18A with respect to the vertical, and the red LED 16 is arranged at a position facing the inclined shape 18A of the member 18, but the present invention is not limited to this. For example, the red and blue LEDs may be arranged in reverse. That is, the red LED 16 may be arranged at a predetermined angle in the inclination direction of the inclined shape 18A with respect to the vertical, and the blue LED 14 may be arranged at a position facing the inclined shape 18A of the member 18.
[0052] In the above embodiment, an example in which the member 18 is measured using two optical devices 20 has been described, but the present invention is not limited to this. For example, a single optical device 20 may be used, and the leading end and trailing end of the member 18 may be extracted by moving the optical device 20 to measure the length. Alternatively, three or more optical devices 20 may be used.
[0053] Further, in the above embodiment, the tire member 18 has been described as an example, but it is not limited to the tire member 18, and other members may be applied as long as they have the inclined shape 18A.
[0054] In addition, the processing performed by the measurement controller 22 in each of the above embodiments has been described as software processing performed by executing a program, but is not limited to this. For example, the processing may be performed by hardware such as a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), and an FPGA (Field-Programmable Gate Array). Alternatively, the processing may be a combination of both software and hardware. In the case of software processing, the program may be stored in various storage media and distributed.
[0055] Furthermore, the present invention is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit and scope of the present invention. [Explanation of symbols]
[0056] 10. Component Measuring Device 12 Camera 14 Blue LED 16 Red LED 18 Materials 18A inclined shape 19 Base 20 Optical equipment 22 Measurement Controller 22A CPU
Claims
1. a first irradiating section that is provided at an angle to the inclination direction of the inclined shape of a member having an inclined shape that is inclined so that the thickness gradually increases from the bottom surface end toward the inside of the surface, and that irradiates light of a predetermined first color along the inclination direction; a second irradiating unit provided opposite the inclined shape and configured to irradiate the inclined shape with light of a second color different from the first color; an imaging unit that images the leading end and trailing end of the member and a surface on which the member is placed; an extraction unit that extracts the leading end and the trailing end of the member from a captured image of the leading end and the trailing end of the member captured by the imaging unit; a measuring unit that measures a length of the component from a leading end and a trailing end of the component extracted by the extracting unit; A component measuring device including:
2. 2. The component measuring device according to claim 1, wherein the first color is one of two colors, blue and red, and the second color is the other of the two colors.
3. 3. The component measuring device according to claim 1, wherein the measuring section measures the length of the component by comparing the positions of the leading end and trailing end of the component with a predetermined reference position.
4. The computer A first light of a predetermined color is irradiated from a first irradiating unit provided at an angle to a direction of inclination of a member having an inclined shape in which the thickness gradually increases from a bottom surface end toward an inner surface of the member; Irradiating the inclined shape with light of a second color different from the predetermined color from a second irradiating unit provided opposite the inclined shape; An image of the leading end and trailing end of the member and a surface on which the member is placed is captured by an imaging unit; extracting the leading end and the trailing end of the member from a captured image of the leading end and the trailing end of the member captured by the imaging unit; A member measuring method that performs a process of measuring the length of the member from the leading end and trailing end of the extracted member.
5. On the computer, A first light of a predetermined color is irradiated from a first irradiating unit provided at an angle to a direction of inclination of a member having an inclined shape in which the thickness gradually increases from a bottom surface end toward an inner surface of the member; Irradiating the inclined shape with light of a second color different from the predetermined color from a second irradiating unit provided opposite the inclined shape; An image of the leading end and trailing end of the member and a surface on which the member is placed is captured by an imaging unit; extracting the leading end and the trailing end of the member from a captured image of the leading end and the trailing end of the member captured by the imaging unit; A component measurement program for executing a process for measuring the length of the extracted component from its leading end and trailing end.
Citation Information
Patent Citations
Length measuring method and apparatus thereof
JP1985228906A
Measuring apparatus for length of conveyed object
JP1988243707A
Method and apparatus for inspection of external appearance and shape of specimen
JP2003240521A
Apparatus for measuring length of tread rubber of tire
JP2009115715A
Method for evaluating tire surface
JP2011511932A