Object information acquisition device and object counting device
The infrared radiator and reflector system addresses environmental interference and energy inefficiencies in object counting by using infrared imaging to achieve accurate shape determination with reduced power usage.
Patent Information
- Application Number
- JP2021156225
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-09-27
- Publication Date
- 2025-07-16
- Estimated Expiration
- 2041-09-27
AI Technical Summary
Existing object counting and shape determination technologies are susceptible to external environmental influences such as shadows and uneven heating, leading to inaccurate results and high energy consumption.
An infrared radiator system with a reflector and an infrared camera is used to emit and reflect infrared rays onto an object, capturing images that are less affected by external light and enabling accurate shape information acquisition.
The system provides accurate shape information with reduced energy consumption by minimizing the impact of external light and allowing for efficient imaging of a wide area with a smaller radiator setup.
Smart Images

Figure 0007709161000001 
Figure 0007709161000002 
Figure 0007709161000003
Abstract
Description
Technical Field
[0001] The present invention relates to an object information acquisition device used for counting objects, pattern matching, and the like.
[0002] In particular, it relates to an object information acquisition device with little influence from the external environment such as external light.
[0003] Furthermore, it relates to a material counting device using the object information acquisition device.
[0004] In this specification, an infrared camera refers to a camera capable of imaging electromagnetic waves with wavelengths from 0.83 μm to 1000 μm, including an infrared thermographic camera and an infrared camera. Usually, an infrared camera refers to a camera combined with a camera and an LED (light emitting diode) that irradiates near-infrared light, but in this specification, it refers to a camera that images based on infrared rays, regardless of the presence or absence of an LED.
Background Art
[0005] As a first type of this prior art, a tablet-type information processing device includes a photographing unit that photographs a bundle of tubes installed at a storage location from the tube end side, an image recording unit that records a photographed image of the bundle of tubes, a tube recognition counting unit that recognizes and counts tubes from the photographed image of the bundle of tubes, a numerical recording unit that records the result of the counting as a tube count value, and a display control unit that displays the photographed image of the bundle of tubes and the tube count value on the screen of the type information processing device, and it is known to count the bundle of tubes based on the image information of the end face of the bundle of tubes imaged by the photographing unit (Patent Document 1).
[0006] As a second type of prior art, it is known to project illumination light from an illumination device onto the end face of stacked steel materials, binarize the image information of the end face of the steel materials imaged by an imaging device, discriminate the shape of the end face of the steel materials, and count the number of steel materials based on the discrimination (Patent Document 2).
[0007] As a third prior art, in order to provide a method for detecting defects on the surface of a steel material that can correctly recognize defects on the surface of the steel material, such as so-called dross defects that occur when applying hot-dip galvanization, without being affected by temperature unevenness that occurs when heating the steel material, first, a non-defective part is heated, and then the surface temperature of the material is acquired as thermal image data using an infrared thermographic camera. The standard deviation of the Laplacian of the surface temperature is defined as a function of the surface temperature of the steel material. After heating the steel material to be inspected, the surface temperature of the material is acquired as thermal image data using an infrared thermographic camera. The Laplacian of the surface temperature is calculated, and the Laplacian is corrected with the standard deviation of the Laplacian corresponding to the surface temperature. Based on the corrected Laplacian, the presence or absence of defects near the surface of the material to be inspected is evaluated. A method for detecting defects in a steel material is known (Patent Document 3).
[0008] As a fourth prior art, a far-infrared (FIR) active thermographic inspection device is known, which is composed of a light source or electromagnetic wave transmitter in the infrared region, a thermal camera for measuring the temperature distribution of the object to be measured and a computer (image processing device) for thermal image analysis, a shutter and a shutter opening / closing control unit (shutter mechanism) for realizing the start / stop of far-infrared radiation between the transmitter and the object to be measured, and a half mirror for taking a temperature distribution image by the thermal camera between the shutter and the object to be measured. The device actively heats the body surface by far-infrared (FIR) radiation heating and images biological information based on the differences in heat conduction, heat capacity, and specific heat of tissues near the body surface. (Patent Document 4).
Prior Art Documents
Patent Documents
[0009]
Patent Document 1
Patent Document 2
Patent Document 3
Patent Document 4
Summary of the Invention
Problems to be Solved by the Invention
[0010] In the first prior art, binarization processing is performed based on image information obtained by imaging visible light reflected from an object, and it is used for determining the shape of the object and the like. Therefore, there is a concern that accurate determination and the like cannot be performed due to the influence of shadows and the like. For example, in the first prior art, end-face alignment means is provided so that the end face of the tube to be imaged is not located in the shadow portion. However, when using simple end-face alignment means, there is a concern that the alignment accuracy of the end face is low and it cannot withstand use. If the alignment accuracy of the end face is increased, the equipment cost becomes high and it cannot be adopted immediately.
[0011] In the second prior art, the end face is irradiated by an illumination device, and image processing for counting and the like is performed using an image obtained by imaging the reflected light of the illumination light by an imaging device. Even when using illumination light from an illumination device, shadows are likely to occur in backlight or dark places, and there is a concern that it cannot be used for testing.
[0012] In the third prior art, the surface of a steel plate is imaged by an infrared thermographic camera in a state where the steel plate is heated to a predetermined temperature by a heating device, and a predetermined determination is made based on the imaging information. When heating the steel plate as the object, uneven heating is likely to occur, and image information processing for correcting the uneven heating must be performed. In some cases, it is difficult to make an accurate determination. Also, a large amount of energy is required to heat the steel plate, and a long heating time is required to reach the predetermined temperature, so it cannot be adopted immediately.
[0013] In the fourth prior art, an infrared image of a human organ is obtained by projecting far-infrared rays onto a human body and imaging the far-infrared rays reflected from the human organ by an infrared thermographic camera. This technology does not pose much of a problem with the energy generated by far-infrared rays when photographing a small object such as a human organ. However, considering that energy consumption becomes large when the object becomes large, it cannot be adopted immediately.
[0014] The basic object of the present invention is to provide a shape information output device that is less affected by the external environment, can save energy, and can accurately acquire the shape information of an object. The conventional object is to provide a counting device using the shape information output device.
Means for Solving the Problems
[0015] To achieve this object, the first invention according to claim 1 is configured as follows.
[0016] An infrared radiator that emits infrared rays to an object, A reflector disposed in the vicinity of the infrared radiator, An infrared camera that images the infrared rays reflected from the object, A shape information output device that outputs the shape information of the object based on the image information acquired by the infrared camera An object information acquisition device including arranging a surface infrared radiator, which is an infrared radiator, around the infrared camera, and arranging a reflector, which is a reflector, around the surface infrared radiator characterized by are the surface infrared radiator being arranged parallel to the end face of the object An object information acquisition device.
[0017] The second invention according to claim 2 is configured as follows. The infrared camera is an infrared thermography camera The object information acquisition device according to claim 1, characterized in that.
[0018] The third invention according to claim 3 is configured as follows. 1 or 2 The object information acquisition device according to claim 1 or 2, characterized in that. An object information acquisition device including.
[0019] The fourth invention according to claim 4 is configured as follows. The surface infrared radiator is a surface heating element The object information acquisition device according to claim 1 or 2 is as described.
[0020] The fifth invention according to claim 5 is configured as follows. The planar heating element is an electric heater The object information acquisition device according to claim 4, characterized in that.
[0021] The sixth invention according to claim 6 is configured as follows. The planar heating element is a fluid heater The object information acquisition device according to claim 4, characterized in that.
[0022] The seventh invention according to claim 7 is configured as follows. The planar infrared radiator is a planar cooler The object information acquisition device according to claim surface infrared radiator is as described.
[0023] The eighth invention according to claim 8 is configured as follows. The a planar heating element, and the planar heating element is 1 or 2 The object information acquisition device according to claim 2, characterized in that it is arranged around the infrared thermographic camera.
[0024] The ninth invention according to claim 9 is configured as follows. The infrared thermographic camera is arranged at the central part of the infrared radiator, and a reflector whose reflection direction is directed to the object is provided around the infrared radiator The object information acquisition device according to claim 2, characterized in that.
[0025] The tenth invention according to claim 10 is configured as follows. The planar infrared radiator is substantially rectangular, and the reflector is configured to have substantially the same size as the planar infrared radiator The object information acquisition device according to claimthe reflector being configured to be angle-adjustable with respect to the surface infrared radiator It is an object information acquisition device described in
[0026] The eleventh invention according to claim 11 is configured as follows. Since the infrared radiator is a surface infrared radiator, there is an advantage that heat can be radiated uniformly over a wide range and a relatively large area can be imaged by the infrared camera. A claim characterized by 9 It is an object information acquisition device described in
[0027] The twelfth invention according to claim 12 is configured as follows. The reflector is parabolic It is an object information acquisition device according to claim 1 or 2, characterized by
[0028] The thirteenth invention according to claim 13 is configured as follows. Including the object information acquisition device according to any one of claims 1 to 12, Having a counting device that counts objects based on the output of the shape information output device It is an object counting device characterized by
Advantages of the Invention
[0029] In the first invention according to claim 1, infrared rays are radiated from an infrared radiator toward an object. Of the infrared rays that reach the object, some are reflected toward the infrared radiator or the reflector side at the same reflection angle as the incident angle, some are absorbed by the object to raise the temperature of the object, and the remaining part passes through the object. The infrared rays directed toward the reflector are reflected by the reflector, and some of the reflected light is directed back toward the object side. As a result, even if the infrared radiator is miniaturized, the infrared rays reflected by the reflector can also be directed toward the object. The infrared rays reflected by the object are imaged by an infrared camera disposed on the infrared radiator side. Using the image information captured by the infrared camera, a shape information output device outputs shape information. Since infrared rays are not affected by visible light, they are less likely to be affected by the external environment such as sunlight and illumination light. Also, since the infrared rays reflected by the reflector are reflected toward the object, the area of the infrared radiator can be miniaturized, energy can be saved, and there is an advantage that the basic purpose can be achieved. The surface infrared radiator is arranged parallel to the end face of the object
[0030] In the second invention according to claim 2, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Further, in the second invention, the camera is an infrared thermography camera. Since the infrared thermography camera can acquire image information based on the temperature of the object, the shape information output device has an advantage that it can output highly accurate shape information.
[0031] In the third invention according to claim 3, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Further, in the third invention, Infrared rays projected perpendicular to the plane of the surface infrared radiator are projected perpendicular to the end face of the object, so that high-quality images can be obtained. therefore, The reflector is configured to be angle-adjustable with respect to the surface infrared radiator there is an advantage that it can be done 。
[0032] In the fourth invention according to claim 4, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Further, in the fourth invention, since the surface infrared radiator is a surface heating element, a known surface heating element can be used. Therefore, there is an advantage that it can be easily and inexpensively implemented.
[0033] In the fifth invention according to claim 5, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Furthermore, in the fifth invention, since the planar heating element is an electric heater, it can be used simply by connecting a power source. Therefore, there is an advantage that it can be easily implemented.
[0034] In the sixth invention according to claim 6, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Furthermore, in the fifth invention, the planar heating element is a fluid heater. The fluid heater has the advantage that temperature control is easy.
[0035] In the seventh invention according to claim 7, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Furthermore, in the seventh invention, the surface infrared radiator is a surface cooler. Therefore, in an object or environment where heating is inappropriate, infrared rays can be radiated by the surface cooler to obtain an image by an infrared thermographic camera.
[0036] In the eighth invention according to claim 8, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Furthermore, in the eighth invention, the infrared radiator is arranged around the infrared thermographic camera. Thereby, infrared rays reflected by the object can be captured substantially evenly, and there is an advantage that more accurate imaging information by the infrared thermographic camera can be obtained.
[0037] In the ninth invention according to claim 9, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Further, in the ninth invention, the infrared thermographic camera is disposed at the central portion of the infrared radiator, and a reflector whose reflection direction is directed to the object is provided around the infrared radiator. By this, the infrared rays reflected by the object are reflected to the object side by the reflector disposed around the infrared radiator, so that the infrared rays reflected from the object to the periphery of the infrared radiator are reflected again toward the object. Therefore, even if the infrared radiator is miniaturized, a wide range of imaging information can be obtained by the infrared thermographic camera, and there is an advantage that energy can be saved.
[0038] In the tenth invention according to claim 10, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Further, in the tenth invention, the surface infrared radiator is substantially rectangular, and the reflector is configured to have substantially the same size as the surface infrared radiator. Thereby, the surface infrared radiator can be aggregated so as to overlap the reflector, and there is an advantage that conveyance and the like can be facilitated.
[0039] In the eleventh invention according to claim 11, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Further, in the eleventh invention, to obtain an appropriate infrared reflection area corresponding to the total area of the end face of the object is. Thereby, reflection from this, infrared rays can be efficiently applied to the object
Figure 1
[0040] In the twelfth invention according to claim 12, since the basic configuration is the same as that of the first invention, there is an advantage that the basic object of the present invention can be achieved. Further, in the twelfth invention, the reflector is parabolic. By this, the infrared rays reflected by the reflector can be efficiently directed to the object.
[0041] In the 13th invention according to claim 13, since the basic configuration includes the 1st to 12th inventions, there is an advantage that the basic object of the present invention can be achieved. Further, in the 13th invention, by the process based on the shape information output from the shape information output device, the number of objects is counted by the counting device, so that accurate counting can be performed, and there is an advantage that the conventional object of the present invention can be achieved.
Brief Description of Drawings
[0042]
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
DETAILED DESCRIPTION OF THE INVENTION
[0043] The present invention preferably relates to an object information acquisition device including an infrared radiator that emits infrared rays to an object, a reflector disposed in the vicinity of the infrared radiator, an infrared camera that captures infrared rays reflected from the object, and a shape information output device that outputs shape information of the object based on the image information acquired by the infrared camera.
[0044] Also, the infrared camera is preferably an object information acquisition device that is an infrared thermography camera.
[0045] Furthermore, the infrared radiator is preferably an object information acquisition device that is a surface infrared radiator.
[0046] Furthermore, the surface infrared radiator is preferably an object information acquisition device that is a surface heating element.
[0047] Also, the surface heating element is preferably an object information acquisition device that is an electric heater.
[0048] Furthermore, the surface heating element is preferably an object information acquisition device that is a fluid heater.
[0049] Furthermore, the surface infrared radiator is preferably an object information acquisition device that is a surface cooler.
[0050] Also, It is preferable that the infrared radiator is an object information acquisition device disposed around the infrared thermographic camera.
[0051] Furthermore, it is preferable that the infrared radiator is an object information acquisition device characterized in that the infrared thermographic camera is disposed at the central portion of the infrared radiator, and a reflector whose reflection direction is directed to the object is provided around the infrared radiator.
[0052] Furthermore, it is preferable that the surface infrared radiator is substantially rectangular, and the reflector is configured to have substantially the same size as the infrared radiator, which is an object information acquisition device.
[0053] Also, it is preferable that the infrared radiator is a parabolic type, which is an object information acquisition device.
[0054] Furthermore, it is preferable that the reflector is a parabolic type, which is an object information acquisition device.
[0055] Furthermore, an object counting device comprising the object information acquisition device and having a counting device for counting an object based on the output of the shape information output device is preferable.
Example
[0056] Example 1 of the present invention will be described with reference to FIGS. 1 to 4.
[0057] Example 1 of the present invention is an example in which the object 100 is the end face 104F of a large number of steel materials 104 stored on the mounting table 102, and the shape information acquisition device 110 according to the present invention is applied to the object counting device 108 that counts the number of the steel materials 104 (end face 104F) based on the image information GI of the end face 104F captured by the infrared camera 106. However, the present invention can also be used for a shape recognition device or a shape determination device for the object 100. The shape information acquisition device 110 according to Example 1 includes an infrared radiator 112, a reflector 114, an infrared camera 106, a shape information output device 118, and a display device 120. The object counting device 108 includes a counting device 122 in addition to the shape information output device 118.
[0058] Next, the object 100 will be described mainly with reference to FIG. 1. In the present Example 1, the object 100 is a round bar steel material 100M having a predetermined diameter. A large number of round bar steel materials 100M are stacked on a V-shaped mounting table 102 (first mounting table 1021, second mounting table 1022) and stored in a horizontal state at a predetermined height. In the present invention, it is preferable that the end faces of the round bar steel materials 100M are aligned. However, as shown in FIG. 1(C), a variation in the position of the end face 104F of about 100 mm is within an allowable range. Further, the object 100 is not limited to the round bar steel material 100M, and other metal materials, wood, resin materials, and various other materials can be targeted, but it is preferably a material with a high infrared reflectance.
[0059] Next, the infrared camera 106 will be described mainly with reference to FIG. 3. The infrared camera 106 has a function of imaging infrared rays radiated (including reflection) from the object 100, and thus from the end face 104F of the round bar steel material 100M. In the present Example 1, a known infrared thermography camera 144 is used as the infrared camera 106. The infrared thermography camera 144 has a function of outputting imaging information ID by performing color separation according to the amount of infrared energy (temperature) in the captured image. In the present Example 1, a known infrared thermography camera is used as the infrared thermography camera 144, and roughly includes a condenser lens 144L, an IR detector 148, an electron scanning device 152 for a dot matrix, an amplifier circuit 154, and an A / D conversion device 156. The condenser lens 144L is disposed at the center of the planar heating element 128 which is the infrared radiator 112. In other words, the infrared radiator 112 (planar heating element 128) is disposed around the infrared thermography camera 144. By disposing the condenser lens 144L at the center of the planar heating element 128 as in the present Example 1, there is an advantage that infrared rays radiated from the end face 104F disposed in a predetermined area which is the object 100 can be uniformly photographed.
[0060] For example, as shown in FIG. 3, the infrared thermography camera 144 detects infrared rays incident through the condenser lens 144L by infrared sensors arranged in a dot matrix pattern which is a pattern by a two-dimensional array in the IR detector 148, and after acquiring the infrared sensors arranged in the dot matrix pattern as a dot matrix by the electron scanning device 152, amplifies the same by the amplifier circuit 154. Next, the output of the amplifier circuit 154 is converted into a digital signal by the A / D conversion device 156, and digital image information DGI (see FIG. 3(C)) is output.
[0061] Next, the infrared radiator 112 will be mainly described with reference to FIG. 2. The infrared radiator 112 has a function of actively emitting infrared rays. Infrared ray IR is an electromagnetic wave having a wavelength longer than that of red light in visible light and shorter than that of radio waves. Generally, it is divided into near-infrared rays, mid-infrared rays, and far-infrared rays, but in the present invention, it includes all these infrared rays IR. An object emits far-infrared rays based on its own temperature (blackbody radiation), but the infrared radiator 112 used in the present invention has a function of actively emitting by itself. Since the amount of infrared rays increases as the temperature is higher for infrared ray IR, for example, a heating element 124 is used as the infrared radiator 112. In the present Example 1, an electric heater 126 as a heating element 124 is used as the infrared radiator 112. As the electric heater 126, it is preferable to use a planar heating element 128. The planar heating element 128, which is a surface infrared radiator 130 in the present Example 1, is a horizontally long rectangle, but it may be circular, pentagonal, or the like. This is because the planar heating element 128 has a large heating area and a uniform temperature distribution, so it can emit uniform infrared rays from an area of a predetermined size to the object 100. Since it is a planar heating element 128, in addition to the electric heater 126, it may be a fluid heater such as an oil heater that supplies a heating liquid or a heating gas inside. However, in the case of the electric heater 126, it is advantageous in terms of temperature control, downsizing of the device, etc. Furthermore, since the planar heating element 128 can be configured to be thin and lightweight, it is convenient for transportation. However, a linear heating element such as a nichrome wire or Kanthal (registered trademark) can be used. The infrared radiator 112 is supported by a support frame 132 and faces the end face 104F of the object 100. In other words, it is preferable to set the infrared rays (electromagnetic waves) projected perpendicularly to the plane of the planar heating element 128 from the planar heating element 128, which is the infrared radiator 112, to be projected perpendicularly to the end face 104F of the object 100. In the present invention, the end faces 104F are preferably arranged in the same plane, but a deviation of about 100 mm is within the allowable range.
[0062] Next, the support frame 132 will be described. The support frame 132 has the function of supporting the infrared radiator 112. In the first embodiment, the support frame 132 includes a left vertical column 134L and a right vertical column 134R as vertical columns 134, a plurality of first cross beams 136H1, second cross beams 136H2, and third cross beams 136H3 as cross beams 136 connecting the upper ends of the left vertical column 134L and the right vertical column 134R, and left feet 138L and right feet 138R as feet 138 fixed to the lower ends of the vertical columns 134.
[0063] The planar heating element 128 as the infrared radiator 112 has its left and right edge portions fixed to the upper ends of the right vertical column 134R and the left vertical column 134L, and its upper edge fixed to the first cross beam 136H1, the middle portion fixed to the second cross beam 136H2, and the third cross beam 136H3. It is preferable that the vertical positions of the infrared radiator 112 with respect to the left vertical column 134L and the right vertical column 134R are configured to be adjustable. Also, the support frame 132 can be changed to other devices having similar functions.
[0064] Next, the reflector 114 will be described. The reflector 114 has the function of projecting the infrared rays IR, which are electromagnetic waves radiated from the infrared radiator 112, and the infrared rays IR reflected from the end face 104F of the object 100, back onto the end face 104F of the object 100. In the first embodiment, the reflector 114 is composed of a first reflector 1421, a second reflector 1422, a third reflector 1423, and a fourth reflector 1424, which are reflector plates 142 arranged around the infrared radiator 112. The reflector 114 is preferably composed of an anodized aluminum plate, a steel plate coated with aluminum, or the like. The first reflector 1421 to the fourth reflector 1424 are preferably configured to have the same dimensions as the planar heating element 128. This is because it is convenient to stack the first reflector 1421 to the fourth reflector 1424 on the planar heating element 128 during transportation. Also, the first reflector 1421 to the fourth reflector 1424 are preferably configured to be angle-adjustable with respect to the infrared radiator 112. This is to obtain an appropriate infrared reflection area corresponding to the total area of the end face 104F of the object 100.
[0065] As is clear from the above description, it is preferable that the infrared camera 106, the infrared radiator 112, and the reflector 114 are integrally separable and constitute the image information acquisition device 116. Further, the object counting device 108 including the shape information output device 118 to be described later, or the shape information output device 118 and the counting device 122 is preferably configured by a personal computer. This is because it can be easily installed at a location necessary for counting materials by an image.
[0066] Next, the shape information output device 118 will be mainly described with reference to FIG. 4. The shape information output device 118 has a function of processing the digital image information DGI transmitted from the infrared camera 106 and outputting image feature information IPI representing the features of the shape. In the first embodiment, the shape information output device 118 includes a sharpness processing device 162, a binarization device 164, a first feature extraction device 166, a shape determination device 168, and a second feature extraction device 172 as a preprocessing device 158. Note that in the first embodiment, the shape information output device 118 is configured by a program (software) as will be described later, but a program that exhibits a predetermined function is regarded as one piece of hardware and described as a "preprocessing device" or the like.
[0067] First, the preprocessing device 158 will be described. The preprocessing device 158 refers to processing for appropriately binarizing in the binarization device 164 to be described later in the subsequent processing, in the first embodiment. As the preprocessing device 158, a device that exhibits a known sharpness filter function, a smoothing filter function, or the like is preferable. In the first embodiment, the preprocessing device 158 is configured by a program.
[0068] Next, the sharpness processing device 162 will be described. The edge enhancement processing device 162 has a function of making a blurred image clear by emphasizing the change in pixel values, in other words, it has an edge enhancement filter function. In the first embodiment, the edge enhancement processing device 162 is implemented by a program, which performs edge enhancement processing on the digital image information DGI output from the infrared thermographic camera 144 and outputs edge-enhanced image information SGI. Through the edge enhancement processing, as shown in FIG. 6(G2), edge-enhanced image information SGI with a clear boundary between white and black is output. As the edge enhancement processing, second derivative processing or first derivative processing can be adopted for the density change part in the original image.
[0069] Next, the binarization device 164 will be described. The binarization device 164 has a function of converting into two colors, white and black, based on a set threshold value, in other words, it has a binarization filter function. In the first embodiment, it is configured by a program, and outputs the edge-enhanced image information SGI output from the edge enhancement processing device 162 as binary image information BGI of white or black with the set threshold value as the boundary (see FIG. 6(G3)).
[0070] Next, the first feature extraction device 166 will be described. The first feature extraction device 166 has a function of extracting the contour of an image based on the binary image information BGI. In other words, it has a function of extracting the boundary information between white and black in the binary image information BGI and outputting shape boundary information BDI. In the first embodiment, the first feature extraction device 166 is configured by a program, and outputs shape boundary information BDI composed of center information CEn and outer edge information OLn based on the binary image information BGI output from the binarization device 164 (see FIG. 6(G4)).
[0071] Next, the shape determination device 168 will be described. The shape determination device 168 has a function of determining the shape based on the shape boundary information BDI. In the first embodiment, using the center information CEn and the outer edge information OLn in the shape boundary information BDI, it determines whether the outer edge information OLn can be recognized as a circle having a predetermined radius. When it is determined that it is a circle within a predetermined range, that is, when it is determined whether it is a circular shape having a predetermined radius, it outputs determination image information JGI as circular shape information having the radius. In the first embodiment, the shape determination device 168 is configured by a program.
[0072] Next, the second feature extraction device 172 will be described. The second feature extraction device 172 has a function of extracting a contour based on the determination image information JGI. In other words, it has a function of extracting the black-and-white boundary information in the determination image information JGI and outputting the shape boundary information BDI. In the first embodiment, the second feature extraction device 172 is configured by a program, and based on the determination image information JGI output from the shape determination device 168, it outputs second shape boundary information 2BDI composed of second center information 2CEn and second outer edge information 2OLn (see FIG. 6(G4)).
[0073] The second feature extraction device 172 outputs the second shape boundary information 2BDI to the counting device 122 and / or the display device 120. That is, the shape information output device 118 outputs the second shape boundary information 2BDI to the counting device 122 and / or the display device 120. In the first embodiment, the second feature extraction device 172 is configured by a program.
[0074] Next, the counting device 122 will be described. The counting device 122 has a function of counting circles based on the second shape boundary information 2BDI and outputting counting information CNI to the display device 120. In the first embodiment, the counting device 122 is configured by a program. That is, based on the circular shape information in the shape boundary information BDI, it counts the number of circles and outputs the counting information CNI.
[0075] The counting device 122 can be configured integrally with the shape information output device 118. For example, the shape information output device 118 and the counting device 122 can be configured with one personal computer.
[0076] Next, the display device 120 will be described. The display device 120 has a function of displaying an image based on the shape boundary information BDI and displaying the counting information CNI in the counting information display area 176. In the present Example 1, a known display is used. As a display method, for example, as shown in FIG. 6(G7), on the display screen 174, based on the counting information CNI, an end face image EFI of the end face 104F representing the center and radius of the circle is displayed. Further, the counting information CNI is displayed in the counting information display area 176 on the side of the end face image EFI.
[0077] Next, the operations of the shape information output device 118 and the counting device 122 according to Example 1 will be described. First, as shown in FIG. 5(A), the image information acquisition device 116 is installed facing the end face 104F of the object 100. It is preferable that the planar heating element 128 and the end face 104F are installed substantially parallel.
[0078] Next, the switch of the planar heating element 128 is turned on to heat the planar heating element 128 (about 70 to 80 degrees). As a result, infrared rays IR, which are electromagnetic waves from the planar heating element 128, are radiated to the end face 104F of the object 100. A part of the infrared rays IR radiated to the end face 104F is absorbed by the object 100 to raise the temperature of the object 100, a part is transmitted, and a part is reflected as reflected infrared rays RIR to the side of the planar heating element 128 or the reflector 114. Further, the reflector 114 reflects the reached reflected infrared rays RIR to the object 100 side. A part of the reflected reflected infrared rays RIR is reflected again by the object 100 as reflected infrared rays RIR to the side of the planar heating element 128 or the reflector 114. The reflected infrared rays RIR enter the condenser lens 144L of the infrared camera 106 (infrared thermography camera 144).
[0079] As shown in FIG. 3, the reflected infrared rays RIR condensed by the condenser lens 144L are detected by the IR detector 148 by detecting changes in electrical properties that occur when the temperature of the sensor element rises due to the infrared rays received by a large number of IR detectors 148 arranged in a dot matrix.
[0080] Next, the electronic scanning device 152 acquires and outputs the change information in each IR detector 148 arranged in a dot matrix as shown in FIG. 3(B).
[0081] Next, after amplifying the output of the electronic scanning device 152 in the amplifier circuit 154, it is converted into digital image information DGI by the A / D conversion device 156 and output. Therefore, the infrared camera 106 converts the acquired analog image information into digital image information DGI and then outputs it to the image information acquisition device 116. The digital image information DGI is gray scale digital image information as shown in FIG. 3(C). In the present Example 1, as is clear from FIG. 3(C), the object 100 to be counted is 13 circular end faces 104F having a predetermined radius of steel materials stacked in a flaring shape.
[0082] Next, the operation of the image information acquisition device 116 will be described with reference to the test image shown in FIG. 6. This test is a test for counting the number of 13 round bar steels with a diameter of 50 mm placed on a 90-degree V-shaped mounting table 102 using digital image information DGI obtained by imaging with an image information acquisition device 116 using an Optris GmbH Xi400 type infrared thermography camera 144. A planar heating element 128 as a heating element 124 has a vertical dimension of approximately 600 mm × a horizontal dimension of approximately 600 mm, an output of 2150 W (manufactured by OMRON Heater Co., Ltd.), and reflectors 114 (upper or lower reflectors: vertical dimension of approximately 400 mm × horizontal dimension of approximately 600 mm, right or left reflectors: vertical dimension of approximately 600 mm × horizontal dimension of approximately 400 mm) vapor-deposited with aluminum are arranged around the planar heating element 128. The distance D1 between the planar heating element 128 and the end face 104F of the object 100 is approximately 1000 mm. However, the optimal distance between the planar heating element 128 and the end face 104F of the object 100 is determined by the range (area) where the object 100 is arranged. When using the planar heating element 128 and the reflectors 114, it is preferable to incline the first reflector 1421 and the third reflector 1423 at an angle of 50 degrees to 60 degrees with respect to the horizontal line. In other words, it is preferable to incline the planar heating element 128 at an angle of 30 degrees to 40 degrees toward the end face 104F side of the object 100. Similarly, it is preferable to incline the second reflector 1422 and the fourth reflector 1424 at an angle of 30 degrees to 40 degrees toward the end face 104F side of the object 100 with respect to the planar heating element 128. For the sake of convenience of explanation, in the digital image information DGI (Fig. 6 (G1)), numbers 1 to 13 are attached to each end face of the round bar steel.
[0083] First, the effect of the presence or absence of the reflector 114 will be explained. Fig. 7 shows the digital image information DGI output from the infrared thermography camera 144 imaged under the above test conditions. The image information acquisition device 116 is the same as the above conditions, but the object 100 is an image imaged by the infrared thermography camera 144 with 8 steel materials with a diameter of 50 mm placed on the same mounting table 102 as in the above test. FIG. 7(A) shows the digital image information DGI output from the infrared thermographic camera 144 when only the planar heating element 128 is used. FIG. 7(B) shows the digital image information DGI when imaging is performed with four reflectors 114 arranged around the planar heating element 128. As is clear from the comparison between FIG. 7(A) and FIG. 7(B), the test piece 170 arranged in the lower left of the placement body 102 appears clearly when the reflector 114 is present, but appears faintly when the reflector 114 is not present. Therefore, by the presence of the reflector 114, a wider range of high-quality images can be obtained than when only the same planar heating element 128 is used. When the reflector 114 is not arranged around the planar heating element 128, a planar heating element 128 having an area approximately twice the area where the object 100 is arranged had to be used. However, in this test, it was confirmed that when the reflector 114 is arranged around the planar heating element 128, a planar heating element 128 having an area equivalent to the area where the object 100 is arranged is sufficient. In other words, when the object 100 has the same area, a small infrared radiator 112 can be used, so that power consumption can be reduced, and thus energy saving can be achieved.
[0084] Next, the operation of the shape information output device 118 will be described. First, in the edge enhancement device 162, edge enhancement processing of the digital image information DGI is performed. The edge enhancement processing is a process of emphasizing between adjacent pixels of the digital image information DGI represented by grayscale. As a result, as shown in FIG. 6(G2), in the digital image information DGI of FIG. 6(G1), it is output as edge-enhanced image information SGI in which the blurred portions are emphasized. In other words, it is output as first edge-enhanced image information SGI1 to thirteenth edge-enhanced image information SGI13. That is, spots appear in the first edge-enhanced image information SGI1, the fourth edge-enhanced image information SGI4, the ninth edge-enhanced image information SGI9, the twelfth edge-enhanced image information SGI12, and the thirteenth edge-enhanced image information SGI13, and the other edge-enhanced image information is approximately white.
[0085] Next, in the binarization device 164, the sharpened image information SGI is binarized to output binarized image information BGI. Specifically, in the sharpened image information SGI, it is output as binarized image information BGI of white or black, for example, "1" or "0", with a predetermined threshold as the boundary. In other words, it is output as first binarized image information BGI1 to thirteenth binarized image information BGI13. That is, the second binarized image information BGI2 to thirteenth binarized image information BGI13 appear as white circles. However, since the first binarized image information BGI1 is not recognized as the end face of a circle, it is represented by a dashed line. It is presumed that the area of the spot in the first sharpened image information SGI1 was large and thus not discriminated as white. A Y-shaped line B4Y appears in the fourth binarized image information BGI4, and a horizontal line B9H appears in the ninth binarized image information BGI9. These lines B4Y and B9H are presumed to be the spots in the fourth sharpened image information SGI4 and ninth sharpened image information SGI9 recognized as lines. Note that the boundaries between the second binarized image information BGI2 and the third binarized image information BGI3, and between the fourth binarized image information BGI4 and the seventh binarized image information BGI7 are not recognized. The boundaries between other adjacent binarized image information BI4 are recognized.
[0086] Next, in the first feature extraction device 166, the features of the image in the binarized image information BGI, that is, the contour is extracted from the binarized image information BGI and output as shape boundary information BDI. Specifically, the differentiation in the X direction and Y direction in the binarized image information BGI is taken. In other words, the abrupt step-like changes (edges) in the X direction and Y direction are extracted, and the shape boundary information BDI shown in FIG. 6 (G4) is output.
[0087] Specifically, based on the first binarized image information BGI1, a C-shaped first outer edge OL1 is recognized and output as the first shape boundary information BDI1. In this case, the first center CE1 is recognized at the position shown in FIG. 6 (G4).
[0088] Based on the second binarized image information BGI2, a circular second outer edge OL2 with a partial opening is recognized, and the second shape boundary information BDI2 is output. Based on the third binarized image information BDI3, a circular third outer edge OL3 with a partial opening is recognized, and the third shape boundary information BDI3 is output. When both are combined, a gourd shape is recognized. In this case, the second and third centers CE2 and CE3 are recognized at the positions shown in FIG. 6(G4), that is, at the constricted part of the gourd shape.
[0089] Based on the fourth binarized image information BGI4, a vertically elongated elliptical fourth outer edge OL4 and a fourth 2 outer edge OL42 with respect to the fourth center CE4 are recognized, and the fourth shape boundary information BDI4 is output.
[0090] Based on the fifth binarized image information BGI5, a circular fifth outer edge OL5 with respect to the fifth center CE5 is recognized, and the circular fifth shape boundary information BDI5 is output.
[0091] Based on the sixth binarized image information BGI6, a circular sixth outer edge OL6 with respect to the sixth center CE6 is recognized, and the circular sixth shape boundary information BDI6 is output.
[0092] Based on the seventh binarized image information BGI7, a circular seventh outer edge OL7 with a partial protrusion with respect to the seventh center CE7 is recognized, and the circular seventh shape boundary information BDI7 is output.
[0093] Based on the eighth binarized image information BGI8, a circular eighth outer edge OL8 with respect to the eighth center CE8 is recognized, and the circular eighth shape boundary information BDI8 is output.
[0094] Based on the ninth binarized image information BGI9, a horizontally elongated elliptical ninth outer edge OL9 with respect to the ninth center CE9 and a horizontally elongated elliptical ninth 2 outer edge OL92 with respect to the ninth 2 center CE92 are recognized, and the ninth shape boundary information BDI9 in which two semi-circular shapes are adjacent is output.
[0095] Based on the 10th binary image information BGI10, a circular 10th outer edge OL10 with respect to the 10th center CE10 is recognized, and circular 10th shape boundary information BDI10 is output.
[0096] Based on the 11th binary image information BGI11, a circular 11th outer edge OL11 with respect to the 11th center CE11 is recognized, and circular 11th shape boundary information BDI11 is output.
[0097] Based on the 12th binary image information BGI12, a circular 12th outer edge OL12 with respect to the 12th center CE12 is recognized, and circular 12th shape boundary information BDI12 is output.
[0098] Based on the 13th binary image information B13, a circular 13th outer edge OL13 with respect to the 13th center CE13 is recognized, and circular 13th shape boundary information BDI13 is output.
[0099] From the above, the 5th shape boundary information BDI5 having the 5th outer edge OL5 with respect to the 5th center CE5, the 6th shape boundary information BDI6 having the 6th outer edge OL6 with respect to the 6th circle center CE6, the 8th shape boundary information BDI8 having the 8th circle center OL8 with respect to the 8th circle center CE8, and the 10th shape boundary information BDI10 - BDI13 having the 10th - 13th outer edges OL10 - OL13 with respect to the 10th - 13th circle centers CE10 - CE13 are recognized as circles having a predetermined radius without problems.
[0100] Here, the first shape boundary information BDI1 having a C-shaped first outer edge OL1, the second shape boundary information BDI2 having a gourd-shaped second outer edge OL2, the third shape boundary information BDI3 having a third outer edge OL3, the seventh shape boundary information BDI7 having a seventh outer edge OL7 with a convex portion, the ninth outer edge OL9 with respect to the ninth circle center CE9, and the ninth shape boundary information BDI9 having the ninety-second outer edge OL92 with respect to the ninety-second circle center CE92 are problematic. Since none of these have a predetermined radius over the entire circumference, they are determined to be abnormal, and by performing edge detection (feature detection) again or three or more times based on different algorithms, they can be recognized as circles having a predetermined radius. Through this reprocessing - multiple reprocessings, the first outer edge OL1 outputs circular first shape boundary information BDI1. Similarly, the second outer edge OL2 and the third outer edge OL3 output circular second shape boundary information BDI2 and third shape boundary information BDI3, and the ninth outer edge OL9 and the ninety-second outer edge OL92 output circular ninth shape boundary information BDI9.
[0101] Next, in the shape determination device 168, based on the shape boundary information BDI, the shape is determined, and determination image information JGI is output (FIG. 6(G5)). In other words, it is determined whether the center information CE and the outer edge information OL of each of the first shape boundary information BDI1 to the thirteenth shape boundary information BDI13 are circles having a predetermined radius, and based on the first shape boundary information BDI1 to the thirteenth shape boundary information BDI13, as shown in FIG. 6(G5), circular first determination image information JGI1 to thirteenth determination image information JGI13 having a predetermined radius are output.
[0102] Next, the operation of the second feature extraction device 172 will be described. The second feature extraction device 172 extracts radius information from the first determination image information JGI1 to the thirteenth determination image information JGI13, performs edge detection processing (feature information) based on the radius information in the digital image information DGI, and outputs it as the second shape boundary information 2BDI. As shown in FIG. 6 (G6), it is output as circular first to thirteenth second shape boundary information 2BDI1 to 2BDI13. Therefore, the shape information output device 118 outputs the image feature information IPI (the first to thirteenth second shape boundary information 2BDI1 to 2BDI13) to the counting device 122 and the display device 120.
[0103] Based on the first to thirteenth second shape boundary information 2BDI1 to 2BDI13, which is the image feature information IPI, the display device 120 displays the first discrimination image DG1 to the thirteenth discrimination image DG13 on the display screen 174 as shown in FIG. 6 (G7).
[0104] Note that if the first feature extraction device 166 alone is sufficient, the second feature extraction device 172 does not need to be provided.
[0105] Next, the counting device 122 will be described. The counting device 122 has a function of counting the number of circles based on the first to thirteenth second shape boundary information 2BDI1 to 2BDI13, which is the image feature information IPI, and outputting the counting information CNI. The counting device 122 is configured by a program. The counting information CNI is output to the display device 120. As shown in FIG. 6 (G7), the counting information CNI is displayed in the counting information display area 176 in the display device 120. In this experimental example, "13" is displayed. The counting information CNI can be transmitted to other arithmetic devices and used.
Example
[0106] Next, the second image information acquisition device 216 of Example 2 of the present invention will be described with reference to FIG. 8. Note that the second image information acquisition device 216 is labeled "second" to distinguish it from other image information acquisition devices 116. The leading letter of the reference numeral is changed from "1" to "2", and the same reference numerals are assigned to the same parts as in Example 1 and the description thereof is omitted.
[0107] The second image information acquisition device 216 is an example in which the reflector 114 is constituted by a parabolic reflector 214. The infrared rays IR radiated from the infrared radiator 112 are more intensively directed to the end face 104F of the object 100 by the parabolic reflector 214. Therefore, there is an advantage that the amount of reflected infrared rays IR from the end face 104F increases, and better digital image information DGI can be obtained by the infrared camera 106.
Embodiment
[0108] Next, the third image information acquisition device 316 of Embodiment 3 of the present invention will be described with reference to FIG. 9. Note that the third image information acquisition device 316 is given "third" to distinguish it from other image information acquisition devices 116, the leading letter of the reference numeral is changed from "1" to "3", and the same reference numerals are given to the same parts as in Embodiment 1 and the description thereof is omitted.
[0109] The third image information acquisition device 316 includes an infrared camera 106 and an infrared radiator 112, and also serves as the infrared radiator 112 and the reflector 114.
[0110] The infrared radiator 112 is formed in a parabolic shape and also serves as the reflector 114. Since the infrared radiator 112 is parabolic, infrared rays can be efficiently projected onto the end face 104F of the object 100 in a concentrated manner. Further, since the reflector 114 is parabolic, the infrared rays reflected from the end face 104F of the object 100 can be efficiently reflected back to the end face 104F of the object 100. Therefore, there is an advantage that the amount of reflected infrared rays IR from the end face 104F increases, and better digital image information DGI can be obtained by the infrared camera 106.
[0111] The present invention is not limited to Examples 1 to 3, and various modifications can be made within the scope of the gist of the present invention. For example, instead of the heating element 124, a cooling element, such as a surface cooling element, can be used for the infrared radiator 112. Further, the output of the shape information output device 118 can be used to determine whether the shape after machining is a predetermined shape by comparing the image feature information IPI, which is the output of the shape information output device 118, with the reference image information for shape matching, for example, inspecting the end face shape of a machined part.
Explanation of Reference Numerals
[0112] 100 Object 106 Infrared camera 112 Infrared radiator 114 Reflector 118 Shape information output device 126 Electric heater 128 Planar heating element 130 Surface infrared radiator 144 Infrared thermography camera IR Infrared
Claims
1. An infrared radiator (112) that emits infrared rays (IR) toward an object (100), a reflector (114) disposed in the vicinity of the infrared radiator (112), an infrared camera (106) that images the infrared rays (IR) reflected from the object (100), a shape information output device (118) that outputs shape information of the object (100) based on image information acquired by the infrared camera (106), wherein the object information acquisition device includes: a surface infrared radiator (130) that is the infrared radiator (112) facing the object (100) is disposed around the infrared camera (106), a reflector plate (142) that is the reflector (114) is disposed around the surface infrared radiator (130) An object information acquisition device characterized by the above.
2. The infrared camera (106) is an infrared thermography camera (144) The object information acquisition device according to claim 1, characterized by the above.
3. The surface infrared radiator (130) is disposed parallel to the end face (104F) of the object (100) The object information acquisition device according to claim 1 or 2, characterized by the above.
4. The surface infrared radiator (130) is a surface heating element (128) The object information acquisition device according to claim 1 or 2, characterized by the above.
5. The surface heating element (128) is an electric heater (126) The object information acquisition device according to claim 4, characterized by the above.
6. The surface heating element (128) is a fluid heater The object information acquisition device according to claim 4, characterized by the above.
7. The surface infrared radiator (130) is a surface cooling element The object information acquisition device according to claim 1 or 2, characterized by the above.
8. The surface infrared radiator (130) is a surface heating element (128), and the surface heating element (128) is disposed around the infrared thermography camera (144) The object information acquisition device according to claim 2, characterized by the above.
9. The infrared thermography camera (144) is disposed at the central portion of the surface infrared radiator (130), and a reflector plate (142) whose reflection direction is directed toward the object (100) is provided around the surface infrared radiator (130) The object information acquisition device according to claim 2, characterized by the above.
10. The surface infrared radiator (130) is substantially rectangular, and the reflector (142) is configured to have substantially the same size as the surface infrared radiator (130). The object information acquisition device according to claim 1 or 2, characterized by the above.
11. The reflector (142) is configured to be angle-adjustable with respect to the surface infrared radiator (130). The object information acquisition device according to claim 9, characterized by the above.
12. The reflector (142) is parabolic. The object information acquisition device according to claim 1 or 2, characterized by the above.
13. Including the object information acquisition device according to any one of claims 1 to 12, having a counting device (122) that counts the object (100) based on the output of the shape information output device (118). The object counting device, characterized by the above.
Citation Information
Patent Citations
Manufacture of thick thermoplastic resin board
JP1979094566A
Plasma CVD unit
JP1983025226A
Optical measuring system
JP2018200212A
Article counting device, article counting method and program
JP2020101996A
Tube Counting System
JP3227904U