Inspection device and inspection method
The inspection device and method enhance the accuracy of assessing bonding quality in laser-welded parts by switching analysis modes based on material properties, effectively addressing the limitations of existing methods by optimizing thermal response analysis with the inspection device's adaptive approach.
Patent Information
- Application Number
- PCT/JP2024/019494
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-29
- Filing Date
- 2024-05-28
- Publication Date
- 2024-12-05
AI Technical Summary
Existing inspection methods for laser-welded parts lack accuracy in assessing the bonding quality between different materials, particularly when the thermal response varies based on the physical properties of the materials involved.
An inspection device and method that utilize an infrared camera to capture time-series images of a workpiece heated by an excitation light source, switching between analysis modes based on the physical properties of the materials to analyze the thermal response of the excitation light that passes through or is absorbed by the workpiece, determining the wavelength characteristics of the excitation light source to optimize the inspection process.
This approach enables high-accuracy inspection of the bonding quality by selectively analyzing thermal responses in different modes, improving detection precision by adapting to the specific materials' properties and their interaction with the excitation light.
Smart Images

Figure JP2024019494_05122024_PF_FP_ABST
Abstract
Description
Inspection device and inspection method
[0001] The present disclosure relates to an inspection device and an inspection method.
[0002] Patent Document 1 discloses a method for post-weld inspection of a laser weld created by irradiating a laser onto the surface of an object to be inspected. The inspection method of Patent Document 1 includes a first step of using an infrared camera to capture an image of the laser weld that has been cooled to ambient temperature after welding, and detecting the weld area by considering the difference in brightness in the obtained infrared image as an index representing the difference in infrared emissivity of the surface of the object to be inspected, and a second step of determining whether the welding is good or bad based on the brightness value of the infrared image within the weld area.
[0003] Patent No. 4140218
[0004] The present disclosure provides an inspection device and an inspection method that can inspect an object with high precision.
[0005] An inspection device according to one aspect of the present disclosure includes an input unit that acquires infrared images generated by an infrared imaging device photographing an object heated by excitation light from an excitation light source in time series, and a processor that performs analysis processing to inspect the object based on the infrared images, wherein the processor selects whether to operate in a first analysis mode that analyzes the infrared image to analyze the thermal response of components of the excitation light that transmit through the surface of the object, or a second analysis mode that analyzes the infrared image to analyze the thermal response of components of the excitation light that are absorbed by the surface of the object, and determines the wavelength characteristics of the excitation light source depending on the selection result.
[0006] An inspection method according to one aspect of the present disclosure is an inspection method that performs an analysis process to inspect an object based on infrared images generated by an infrared imaging device that captures, in time series, images of the object heated by excitation light from an excitation light source, and includes the steps of selecting whether to operate in a first analysis mode that analyzes the infrared image to analyze the thermal response of components of the excitation light that transmit through the surface of the object, or a second analysis mode that analyzes the infrared image to analyze the thermal response of components of the excitation light that are absorbed into the surface of the object, and determining the wavelength characteristics of the excitation light source depending on the selection result.
[0007] According to the present disclosure, an object can be inspected with high precision.
[0008] Graph showing the spectrum of a xenon lamp and the transmittance characteristics of PBT, PPS, and PA. Graph showing the distribution of relative energy intensity with respect to wavelength for PBT, PPS, and PA. Graph showing the amount of transmitted energy of PBT. Table showing the correspondence between work material, transmitted energy amount, and mode. Flowchart illustrating the operation of the inspection device according to embodiment 1. Flowchart illustrating details of the analysis mode determination process shown in FIG. 9. Graph showing an example of temperature time-series data of a joint of a PPS workpiece. Graph showing another example of temperature time-series data. Flowchart illustrating details of the pass / fail judgment process shown in FIG. 9. 19A, 19B, 20A, 20B, 21B, 22B, 23B, 24B, 25B, 26B, 27B, 28B, 29B, 30B, 31B, 32B, 33B, 34B, 35B, 36B, 37B, 38B, 39B, 40B, 41B, 42B, 43B, 44B, 45B, 46B, 47B, 48B, 49B, 50B, 51B, 52B, 53B, 54B, 55B, 56B, 57B, 58B, 59B, 60B, 61B, 62B, 63B, 64B, 65B, 66B, 67B, 68B, 69B, 70B, 71B, 72B, 73B, 74B, 75B, 76B, 77B, 78B, 79B, 80B, 81B, 82B, 83B, 84B, 85B, 86B, 87B, 88B, 89B, 90B, 91B, 92B, 93B, 94B, 95B, 96B, 97B, 98B, 99B, 100B, 100B, 101B, 102B, 103B, 104B, 105B, 106B, 107B, 108B, 110B, 111B, 112B, 113B, 114B, 115B,
[0009] Hereinafter, embodiments will be described with reference to the drawings as appropriate. However, more detailed explanations than necessary may be omitted. For example, detailed explanations of well-known matters or redundant explanations of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.
[0010] The inventor(s) provide the accompanying drawings and the following description to enable those skilled in the art to fully understand the present disclosure, and do not intend for them to limit the subject matter described in the claims.
[0011] 1 is a block diagram showing an example configuration of an inspection system 1 according to a first embodiment of the present disclosure. The inspection system 1 includes an inspection device 10, an infrared camera 17, an excitation source 18, a control box 15, a power source 16, and an alarm device 19.
[0012] The inspection system 1 can non-destructively detect the condition of the workpiece 90 by using an active thermography method in which excitation energy is applied to the workpiece 90 to be inspected and temperature images are taken. For example, the inspection system 1 applies excitation energy to the workpiece 90 using an excitation source 18 and takes temperature images in time series using an infrared camera 17.
[0013] The condition of the workpiece 90 includes information about the structure, such as internal features and defects, of the workpiece 90. In the example of FIG. 1 , the workpiece 90 includes a transparent material 91 that mainly transmits light irradiated from a light source for welding or deposition, and an absorbing material 92 that mainly absorbs the light. The transparent material 91 and / or the absorbing material 92 are joined at a joint 95 by the transparent material 91 and / or the absorbing material 92 melted by the light from the light source. In this embodiment, the inspection system 1 inspects the joining quality between the transparent material 91 and the absorbing material 92 as the condition of the workpiece 90.
[0014] The material of the workpiece 90 is, for example, a resin such as polybutylene terephthalate (PBT), polyphenylene sulfide (PPS), or polyamide (PA). Alternatively, the material of the workpiece 90 may be ceramics. The material of the workpiece 90 may also be a metal such as cold-rolled steel (SPCC steel) or aluminum.
[0015] The infrared camera 17 is an example of an infrared imaging device that generates multiple temperature image data (infrared images) by capturing images of an imaging area including at least a portion of the workpiece 90 in time series. The infrared camera 17 includes an infrared sensor that detects infrared rays having a wavelength of, for example, 3 μm to 15 μm. The frame rate of the infrared camera 17 is, for example, 50 Hz (or 50 fps), but is not limited to this.
[0016] In this disclosure, an "image" includes one or more moving images and one or more still images.
[0017] The excitation source 18, which is an example of an excitation light source in the present disclosure, is an example of a heating device capable of heating the workpiece 90. The excitation source 18 is, for example, a light source such as a xenon lamp, a halogen lamp, or a laser light source, but is not limited to these, and may be any energy source capable of radiating energy.
[0018] The excitation source 18 can perform flash heating (pulse heating) by emitting a flash or step heating by heating in steps on the workpiece 90. The wavelength band of the light emitted by the excitation source 18 may be the same as or different from the wavelength band of infrared light detectable by the infrared camera 17. While one excitation source 18 is illustrated in FIG. 1 , the number of excitation sources 18 is not limited to this and may be two or more.
[0019] The power supply 16 supplies power to the infrared camera 17 and the excitation source 18. The control box 15 includes a control circuit that controls the power supply 16 based on a control signal from the inspection device 10. The control box 15 may control the light emission method, light emission cycle, light emission time, etc. of the excitation source 18.
[0020] The notification device 19 notifies information to the outside. For example, the notification device 19 is controlled by the inspection device 10 and notifies a user of information indicating the inspection results of the internal condition of the workpiece 90. The notification device 19 may include a visual notification device such as a light source such as an LED, a display, or an indicator. The notification device 19 may also include an auditory notification device such as a speaker.
[0021] 2 is a block diagram showing an example of the configuration of the inspection device 10 of Fig. 1. The inspection device 10 includes a processor 11, a storage device 12, and an interface 13.
[0022] The processor 11 is composed of a CPU, an MPU, etc., and controls the entire inspection device 10 by executing various programs stored in the storage device 12. The processor 11 controls the excitation source 18 via the control box 15, thereby controlling the start and stop of the heating output of the excitation source 18. The processor 11 also controls the imaging operations of the infrared camera 17, such as the start and stop of imaging. The processor 11 also performs analysis processing to inspect the workpiece 90 based on the infrared images stored in the storage device 12, as will be described later.
[0023] The storage device 12 is a recording medium that records various information including programs and data necessary to realize the functions of the inspection device 10. The storage device 12 is realized, for example, by a semiconductor storage device such as a flash memory or a solid-state drive (SSD), a magnetic storage device such as a hard disk drive (HDD), or other recording media, either alone or in combination. The storage device 12 is not limited to an internal storage device installed in the same housing as the processor 11, but may also be, for example, an external storage device or a NAS (network-attached storage) type storage device. The storage device 12 may include a volatile memory such as a RAM.
[0024] The interface 13 connects the inspection device 10 to external devices such as the infrared camera 17, the control box 15, the alarm device 19, and the excitation source 18. The interface 13 may be a communication circuit that performs data communication in accordance with an existing wired communication standard or wireless communication standard.
[0025] The interface 13 is an example of an input unit that connects the inspection device 10 and the infrared camera 17 to input information about the surface of the object (surface temperature information), such as an infrared image from the infrared camera 17, into the inspection device 10. The interface 13 is also an example of an output unit that connects the inspection device 10 to external devices, such as the control box 15, the alarm device 19, and the excitation source 18, to output information, such as a control signal, from the processor 11 to those external devices. Such input and output units may be integrated into a combined input / output interface 13 as shown in FIG. 2 , or may be realized as multiple interface circuits.
[0026] [1-2. Principles underlying the decision to switch analysis modes] The inventors discovered that inspection accuracy can be improved by switching the analysis mode of the processor 11 of the inspection device 10 in accordance with the physical properties of the workpiece 90 related to the light emitted from the excitation source 18.
[0027] Therefore, the processor 11 is configured to switch between the first analysis mode and the second analysis mode depending on the physical properties of the workpiece 90. Details of the operation of the processor 11 will be described later. Here, the principle underlying the decision to switch the analysis mode will be described.
[0028] The inventors discovered that the mode of thermal response differs depending on the spectrum of light emitted from the excitation source 18 and the light-related physical properties of the workpiece 90 (hereinafter sometimes referred to as "light properties").
[0029] Here, the term "spectrum" refers to information that indicates the distribution of the relative intensity of light with respect to wavelength. Terms such as emission spectrum, optical spectrum, spectral distribution, relative spectral distribution, and spectral characteristics may be used instead of "spectrum."
[0030] The aforementioned thermal response modes include a transmission mode and a thermal conduction mode, which represent physical phenomena depending on the characteristics of the excitation source 18 and the optical properties of the workpiece 90.
[0031] 3 is a schematic diagram for explaining the transmission mode, which shows a cross-sectional view of the workpiece 90 and a contrast representing the thermal response caused by the light emitted from the excitation source 18.
[0032] The transmission mode refers to a case where the light emitted from the excitation source 18 mainly contains a component that transmits through the transmitting material 91. As indicated by the thick dashed arrow in Figure 3, in the transmission mode, the light emitted from the excitation source 18 mainly transmits through the transmitting material 91. The light component that transmits through the transmitting material 91 reaches the junction 95 and the absorbing material 92. In the transmission mode, transmission mainly occurs in the transmitting material 91, so that most of the light emitted from the excitation source 18 reaches the junction 95 and the absorbing material 92.
[0033] In the joint region R1 where the transmitting material 91 and the absorbing material 92 are joined at the joint 95, light (indicated by the dashed arrow) that reaches the joint 95 and the absorbing material 92 is absorbed by the joint 95 and / or the absorbing material 92 and converted into heat. The infrared camera 17 can detect the generated heat as a thermal response. In Figure 3, this thermal response is schematically indicated by the solid arrow.
[0034] In contrast, in the non-bonded region R2 where the transmitting material 91 and the absorbing material 92 are not bonded, light that reaches the absorbing material 92 is converted into heat, but the heat generated in the absorbing material 92 is not sufficiently transmitted to the transmitting material 91 compared to the bonded region R1. Therefore, the thermal response in the non-bonded region R2 is smaller than the thermal response in the bonded region R1. In Figure 3, the thermal response in the non-bonded region R2 is schematically shown by a thin solid arrow pointing upward to indicate that the thermal response is relatively small.
[0035] Due to the above-mentioned phenomenon, in the transmission mode, the position distribution of the contrast of the thermal response detected by the infrared camera 17 is as shown in the graph at the top of FIG.
[0036] 4 is a schematic diagram illustrating the thermal conduction mode. The thermal conduction mode refers to a case where the light emitted from the excitation source 18 mainly contains a component that is absorbed by the transparent material 91. In the thermal conduction mode, the light emitted from the excitation source 18 is mainly absorbed by the transparent material 91 and converted into heat.
[0037] In the joint region R1, the transparent material 91 and the absorbing material 92 are joined together, so the heat generated in the transparent material 91 is transferred with high efficiency to the absorbing material 92. Therefore, the thermal response appearing on the surface of the transparent material 91 is small. In Fig. 4, the thermal response in the joint region R1 is schematically shown by a thin solid arrow pointing upward to indicate that the thermal response is relatively small.
[0038] In contrast, in the non-bonded region R2, the transparent material 91 and the absorbing material 92 are not bonded, so the thermal conductivity at the interface is poorer than in the bonded portion 95, and therefore the amount of heat transferred from the transparent material 91 to the absorbing material 92 is less than in the bonded region R1. Therefore, the thermal response appearing on the surface of the transparent material 91 in the non-bonded region R2 is greater than the thermal response in the bonded region R1. In Figure 4, the thermal response in the non-bonded region R2 is schematically shown with a thick solid arrow pointing upward to indicate that the thermal response is relatively large.
[0039] Due to the above-mentioned phenomenon, in the thermal conduction mode, the position distribution of the contrast of the thermal response detected by the infrared camera 17 is as shown in the graph at the top of FIG.
[0040] 3 and 4, it can be seen that a significant difference appears in the positional distribution of the contrast of the thermal response detected by the infrared camera 17. The inventors focused on this physical phenomenon and discovered that inspection accuracy can be improved by switching the analysis mode of the processor 11 of the inspection device 10 in accordance with the physical properties of the workpiece 90 related to the light emitted from the excitation source 18.
[0041] Specifically, the processor 11 operates in a first analysis mode (sometimes referred to in this specification as the "transmission analysis mode") when the thermal response of the workpiece 90 is in the transmission mode, and operates in a second analysis mode (sometimes referred to in this specification as the "thermal conduction analysis mode") when the thermal response is in the thermal conduction mode.
[0042] The transmission mode and the thermal conduction mode can be quantitatively distinguished as shown in the following example. A portion of the energy of the light emitted from the excitation source 18 is transmitted through the transmitting material 91. Of the energy of the light emitted from the excitation source 18, the energy that is transmitted through the transmitting material 91 is called "transmitted energy," and the amount of this transmitted energy is sometimes called "transmitted energy amount." The transmitted energy amount is an example of a first amount that indicates the amount of a component of the light emitted from the excitation source 18 that is transmitted through the transmitting material 91.
[0043] Another portion of the energy of the light emitted from the excitation source 18 is absorbed by the transparent material 91 and is transmitted as heat within the transparent material 91. Of the energy of the light emitted from the excitation source 18, the energy that is transmitted as heat within the transparent material 91 is called "thermal conduction energy," and the amount of this thermal conduction energy is sometimes called "amount of thermal conduction energy." The amount of thermal conduction energy is an example of a second amount that indicates the amount of a component of the light emitted from the excitation source 18 that is absorbed by the transparent material 91.
[0044] As an example, the amount of transmitted energy being equal to or greater than the amount of thermally conducted energy corresponds to the transmission mode, and the processor 11 operates in the first analysis mode when the amount of transmitted energy is equal to or greater than the amount of thermally conducted energy.
[0045] Also, as an example, the amount of transmitted energy being less than the amount of thermally conducted energy corresponds to the thermal conduction mode, and the processor 11 operates in the second analysis mode when the amount of transmitted energy is less than the amount of thermally conducted energy.
[0046] Alternatively, the amount of transmitted energy equal to or greater than a predetermined threshold corresponds to the transmission mode. Therefore, when the amount of transmitted energy is equal to or greater than the threshold, the processor 11 operates in the first analysis mode corresponding to the transmission mode.
[0047] An example of a method for calculating the amount of transmitted energy will be described below.
[0048] For example, the amount of transmitted energy is calculated based on the spectrum of the excitation source 18 and the transmittance characteristics of the transmitting material 91. Fig. 5 is a graph showing the spectrum of a xenon lamp, which is an example of the excitation source 18, and the transmittance characteristics of PBT, PPS, and PA, which are examples of the transmitting material 91. In the graph of Fig. 5, the vertical axis on the right represents relative intensity, and the spectrum indicating the relative intensity of the xenon lamp is shown by a solid line. In the graph of Fig. 5, the vertical axis on the left represents transmittance, and the transmittance characteristics of PBT, PPS, and PA are shown by a dashed line, a dotted line, and a long dashed line, respectively.
[0049] 6 is a graph illustrating the distribution of relative energy intensity versus wavelength for PBT, PPS, and PA, which are examples of the transparent material 91. The amount of transmitted energy at a specific wavelength is expressed as the product of the relative intensity of the excitation source 18 at that wavelength and the transmittance of the transparent material 91. In this specification, the amount of transmitted energy at a specific wavelength may be referred to as the "relative energy intensity." The relative energy intensity shown in the graph of FIG. 6 can be calculated based on the information included in the graph of FIG. 5.
[0050] When the excitation source 18 is a xenon lamp, the amount of transmitted energy can be calculated by summing the relative energy intensity across the spectrum of the xenon lamp. For example, the amount of transmitted energy through PBT when the excitation source 18 is a xenon lamp corresponds to the area enclosed by the horizontal axis of the graph in Figure 6 (the straight line indicating relative energy intensity = 0) and the dashed line graph showing the distribution of relative energy intensity of PBT.
[0051] 7 is a graph for explaining the amount of energy transmitted through PBT. As described above, the amount of energy transmitted through PBT when a xenon lamp is used as the excitation source 18 corresponds to the area of the hatched portion in FIG. 7. The same applies to other transmitting materials 91 such as PPS and PA.
[0052] Fig. 8 is a table that associates the material of the workpiece 90 with the transmitted energy amount TE and the mode. The transmitted energy amount TE shown in Fig. 8 indicates the transmitted energy amount when the excitation source 18 is a xenon lamp. In the table of Fig. 8, the transmitted energy amounts TE for PPS, ceramics, PBT, PA, SPCC steel, and aluminum are 5114, 3145, 2295, 1500, 0, and 0, respectively.
[0053] In one example, the transmission mode corresponds to the amount of transmitted energy TE being equal to or greater than a predetermined threshold. The predetermined threshold is set to, for example, but is not limited to, 2000. The predetermined threshold may also differ depending on the type of excitation source 18. The table in FIG. 8 shows the modes when the predetermined threshold is 2000. When the amount of transmitted energy TE is equal to or greater than the predetermined threshold, the processor 11 operates in a first analysis mode corresponding to the transmission mode.
[0054] As described above, the inventor discovered that inspection accuracy can be improved by switching the analysis mode of the processor 11 of the inspection device 10 depending on the physical properties of the workpiece 90 related to the light emitted from the excitation source 18, specifically, the transmitted energy amount TE.
[0055] Therefore, in the present disclosure, the processor 11 is configured to switch between a first analysis mode and a second analysis mode depending on the physical properties of the workpiece 90. In the first analysis mode, the processor 11 performs analysis processing to analyze the thermal response (thermal response in the transmission mode) that occurs when light passes through the workpiece 90. In the second analysis mode, the processor 11 performs analysis processing to analyze the thermal response (thermal response in the thermal conduction mode) that occurs when light is absorbed by the workpiece 90. The operation of the processor 11 will be described in detail below.
[0056] 9 is a flowchart illustrating an example of the operation of the inspection device 10. Each process shown in this flow is executed by the processor 11 of the inspection device 10, for example.
[0057] The processor 11 acquires an infrared image from the infrared camera 17 (S1). The acquired infrared image is stored in the storage device 12. In step S1 or before step S1, the processor 11 controls the excitation source 18 via the control box 15 to start heating the workpiece 90.
[0058] Next, the processor 11 executes an analysis mode determination process S2 and a pass / fail determination process S3. In the analysis mode determination process S2, the processor 11 switches the analysis mode depending on whether the transmission mode or the heat conduction mode is dominant. In the pass / fail determination process S3, the processor 11 determines whether the state of the joint 95 of the workpiece 90 is defective. The analysis mode determination process S2 and the pass / fail determination process S3 will be described in detail later.
[0059] If the processor 11 determines that a poor connection exists as a result of the quality determination process S3 (Yes in S4), it causes the alarm device 19 to perform an alarm operation (S5). This allows the user to know that a poor connection exists. The alarm operation includes, for example, emitting a warning sound from a speaker or turning on or blinking a light source such as an LED. Alternatively, the processor 11 may cause a display, which is an example of the alarm device 19, to display information indicating that a poor connection exists.
[0060] If it is determined in step S4 that there is no poor connection (No in S4), and after step S5, the processor 11 displays information indicating the analysis results, judgment results, etc. on a display, which is an example of the alarm device 19 (S6).
[0061] Next, the processor 11 stores information indicating the analysis results, determination results, etc. in the storage device 12 (S7). The information stored in the storage device 12 is used, for example, to achieve traceability. For example, the information stored in the storage device 12 is used to detect whether the condition of the workpiece 90 has been changed due to damage, tampering, dirt, etc. during distribution, and, if so, the extent of the change.
[0062] [1-3-2. Analysis Mode Determination Process] FIG. 10 is a flowchart illustrating the details of the analysis mode determination process S2 shown in FIG.
[0063] 10, first, the processor 11 acquires time-series data of the temperature of the joint 95 based on the infrared image acquired in step S1 (S11). Fig. 11 is a graph showing an example of time-series data of the temperature of the joint 95 of a PPS workpiece 90. The graph in Fig. 11 illustrates the change in temperature of the joint 95 over time when the workpiece 90 is flash-heated by the excitation source 18 at t = 0 seconds. The heating time is 0.01 to 1 second, for example 0.1 seconds.
[0064] At time t1 in the graph of Figure 11, a first peak P1 appears, indicating a temperature rise during heating by the excitation source 18. The first peak P1 may appear in the temperature time-series data as a result of the infrared camera 17 detecting reflected light generated when the workpiece 90 reflects light from the excitation source 18. In such cases, since the first peak P1 may not directly represent a temperature rise in the workpiece 90, it may be preferable to exclude the infrared image corresponding to the first peak P1 from the analysis target. The operation of the inspection device 10, which will be described later, makes it possible to exclude the infrared image corresponding to the first peak P1 from the analysis target in certain cases.
[0065] Fig. 12 is a graph showing another example of time-series data of the temperature of the joint 95 of the workpiece 90. Fig. 12 shows the temperature change of the joint 95 when PBT, PPS, PA, aluminum (AL), and SPCC steel, which are examples of the workpiece 90, are flash-heated.
[0066] The processor 11 determines a transmitted energy amount TE (S12), which indicates the intensity of the component of light transmitted through the transmitting material 91. The processor 11 calculates the transmitted energy amount TE based on the spectrum of the excitation source 18 and the transmittance characteristics of the transmitting material 91.
[0067] Data indicating the spectrum of the excitation source 18 and the transmittance characteristics of the transparent material 91 are stored in advance in, for example, the storage device 12. The processor 11 calculates the amount of transmitted energy at a specific wavelength stored in the storage device 12 by calculating the product of the relative intensity of the excitation source 18 at that wavelength and the transmittance of the transparent material 91. The processor 11 calculates the amount of transmitted energy TE, for example, by calculating the amount of transmitted energy over all wavelengths and finding the sum of these amounts.
[0068] Alternatively, the amount of transmitted energy TE corresponding to the combination of the excitation source 18 and the transparent material 91 may be stored in the memory device 12, and the processor 11 may obtain the identified amount of transmitted energy TE from the memory device 12 using the combination of the excitation source 18 and the transparent material 91 as a key.
[0069] The processor 11 determines whether the amount of transmitted energy TE determined in step S12 is equal to or greater than a predetermined threshold (S13). The threshold is set to, for example, 2000, but is not limited to this.
[0070] If the transmitted energy amount TE is equal to or greater than the threshold value (Yes in S13), the processor 11 operates in a first analysis mode corresponding to the transmission mode. In the first analysis mode, the processor 11 determines the image to be used in the pass / fail determination process S3 to be the image captured during the first period T1, among the infrared images acquired in step S1 (S14).
[0071] As illustrated in FIG. 11, the first period T1 is a period that includes the time t2 corresponding to the second peak P2 of the temperature of the workpiece 90, but does not include the time t1 corresponding to the first peak P1.
[0072] Time t1 represents, for example, a time during heating by the excitation source 18 or a time when the excitation source 18 is emitting light. For example, time t1 is a time included between the start and end of heating by the excitation source 18. Therefore, the first period T1 that does not include time t1 does not include, for example, a period from when the excitation source 18 starts emitting light to when it finishes emitting light. For example, the first period T1 is a period after the excitation source 18 finishes emitting light.
[0073] In this way, the processor 11 sets the time range (frame range) of the image used in the pass / fail determination process S3 to the first period T1.
[0074] If the transmitted energy amount TE is less than the threshold value (No in S13), the processor 11 operates in a second analysis mode corresponding to the thermal conduction mode. In the second analysis mode, the processor 11 sets the time range (frame range) of the image used in the pass / fail determination process S3 to a second period T2 (S15).
[0075] As illustrated in FIG. 11, the second period T2 is a period that includes a time t1 corresponding to a first peak P1 of the temperature of the workpiece 90 and a time t2 corresponding to a second peak P2.
[0076] The second period T2 includes, for example, a period before the excitation source 18 finishes emitting light, and includes, for example, a period from when the excitation source 18 starts emitting light to when the excitation source 18 finishes emitting light.
[0077] Unlike the example shown in FIG. 11, step S11 may be executed after step S12 or after step S13.
[0078] [1-3-3. Pass / Fail Determination Process] [1-3-3-1. Overall Flow of Pass / Fail Determination Process] FIG. 13 is a flowchart illustrating details of the pass / fail determination process S3 shown in FIG.
[0079] 13, first, the processor 11 acquires a set frequency (S21). The set frequency is input by, for example, a user and stored in the storage device 12 in advance.
[0080] Next, the processor 11 performs a discrete Fourier transform on the infrared image of the frame range set in the analysis mode determination process S2 (S22), and extracts a phase image showing the phase characteristics at the set frequency (S23).
[0081] FIG. 14 is a schematic diagram illustrating a phase image 30 extracted by the processor 11 operating in the first analysis mode corresponding to the transmission mode. Because the processor 11 operates in the first analysis mode, the processor 11 obtains the phase image 30 of FIG. 14 by performing a discrete Fourier transform on the infrared image of the PPS captured during the first period T1, which does not include the first peak P1 (see S14 in FIG. 12 ). The phase image 30 of FIG. 14 corresponds to a set frequency of 0.7 Hz and shows the phase characteristics of the infrared image at 0.7 Hz. The annular portion observed in the phase image 30 represents the joint 95 of the workpiece 90.
[0082] Fig. 15 is a schematic diagram illustrating a phase image 31 obtained by performing a discrete Fourier transform on an infrared image of the PPS captured during a second period T2 including the first peak P1, for comparison with the phase image 30 of Fig. 14. The phase image 31 of Fig. 15 corresponds to a set frequency of 0.7 Hz and shows the phase characteristics of the infrared image at 0.7 Hz. The annular portion observed in the phase image 31 represents the joint 95 of the workpiece 90.
[0083] 14 obtained in this embodiment, in the phase image 31 in FIG. 15, the boundary between the annular portion representing the bonded portion 95 and other portions (dark portions) and the inside of the bonded region are unclear. If there is a defect in the unclear portion, the processor 11 may not be able to accurately detect the defect, bonded state, etc. of the workpiece 90. In this embodiment, as shown in FIG. 14, a phase image 30 is obtained in which the boundary between the annular portion representing the bonded portion 95 and other portions and the inside of the bonded region are clear, so that the defect, bonded state, etc. of the workpiece 90 can be detected with high accuracy.
[0084] Returning to FIG. 13 , after step S23, the processor 11 performs filtering on the phase image extracted in step S23 (S24). The filtering is, for example, local equalization (smoothing) filtering, high-pass filtering, or low-pass filtering. The filtering may include a process for adjusting a tone curve. The filtering may also include a background removal process. The processor 11 performs filtering to perform processes such as edge enhancement, shading adjustment, and contrast adjustment.
[0085] Next, the processor 11 performs a process of extracting an inspection area corresponding to the joint 95 from the image after the filtering process in step S24 (S25). The inspection area extraction process S25 will be described in detail later.
[0086] Next, the processor 11 determines whether the quality of the bonded portion 95 is good or bad based on the pixel values of the inspection area extracted in step S25 (S26). The processor 11 detects the size and number per unit area of areas corresponding to internal defects such as cracks and gaps in the bonded portion 95 in the phase image after the inspection area has been extracted.
[0087] Such internal defect detection processing is performed using, for example, a trained model obtained by various types of machine learning. The training data is obtained, for example, by a learning device, which is an information processing device, in the following manner. That is, multiple bonding operations are performed, and after each bonding operation, the learning device acquires multiple infrared images captured sequentially. From the infrared images obtained after each bonding operation, the learning device extracts an inspection area in the phase image, for example, in the same manner as in steps S22 to S25 described above, and creates training data in which the size of the area corresponding to the internal defects in the inspection area and the number of internal defects per unit area are annotated.
[0088] The learning device executes machine learning of a regression model based on the learning data, so as to input pixel values of the inspection area extracted from the phase image and output the size and number of internal defect areas. In the bonding quality determination process S26, internal defects can be detected using such a trained regression model.
[0089] In the joining quality determination process S26, the processor 11 determines whether the joined workpiece 90 is good or bad by, for example, comparing the size of the detected area corresponding to the internal defects and the number of defects per unit area with predetermined thresholds. For example, the processor 11 determines the workpiece 90 as good if both the size and the number of detected areas are equal to or greater than the respective thresholds, and determines the workpiece 90 as bad if either is equal to or less than the threshold. The predetermined threshold can be set appropriately depending on the required level of processing accuracy in joining the workpieces 90, taking into account, for example, the rate of oversight and overdetection of defective products.
[0090] [1-3-3-2. Inspection Area Extraction Processing] Fig. 16 is a flowchart illustrating details of the inspection area extraction processing S25 shown in Fig. 13. The inspection area extraction processing S25 is started, for example, in a state where the infrared image acquired in step S1 of Fig. 3 and the phase image after the filtering processing S24 are stored in the internal memory of the inspection device 10.
[0091] First, the processor 11 acquires image data of a temperature image at the peak temperature of the workpiece 90 (also referred to as a "peak temperature image N1") from the infrared image (S31).
[0092] Next, the processor 11 acquires image data of a temperature image (also called a "low temperature image") at a temperature lower than the peak temperature (for example, normal temperature) from the infrared image (S32).
[0093] The processor 11 calculates a temperature difference image based on the image data of the acquired peak temperature image and low temperature image (S33). The processor 11 calculates the temperature difference image by calculating the difference in pixel values (e.g., brightness values) at corresponding positions in the peak temperature image and the low temperature image. In the temperature difference image, components of the background region are suppressed. The background region is, for example, a region between the temperature images where the temperature change on the workpiece 90 due to thermal excitation is smaller than that of the joint 95.
[0094] Next, the processor 11 performs a binarization process on the temperature difference image (S34). For example, the processor 11 performs the binarization process based on the contrast due to the difference in emissivity at each part of the surface of the workpiece 90. For example, the processor 11 performs the binarization process using a brightness value histogram corresponding to the emissivity of the temperature difference image. In this case, the processor 11 sets pixels whose pixel values are equal to or greater than a predetermined threshold value to white, and sets pixels whose pixel values are less than the threshold value to black.
[0095] The predetermined threshold is set using a discriminant analysis method such as Otsu's binarization method, or a known method such as a P-tile method, a mode method, a dynamic threshold determination method, a level slice method, a Laplacian histogram method, or a differential histogram method may be used for the binarization process S34.
[0096] The processor 11 creates a region mask for extracting the inspection region from the phase image based on the binarized image obtained in step S34 (S35). The processor 11 may create a region mask in which the pixel value of a region set to white in the binarized image is set to "1" and the pixel value of a region set to black is set to "0".
[0097] The processor 11 combines the region mask obtained in step S35 with the phase image to extract the inspection region (S36). For example, in step S36, the processor 11 multiplies each pixel value of the region mask by each pixel value at a corresponding position in the phase image. As a result, the pixel values at positions corresponding to the joints 95 in the phase image are not changed, while the pixel values of the background region other than those positions are set to zero, thereby obtaining a phase image in which the inspection region corresponding to the joints 95 has been extracted.
[0098] The processor 11 outputs, for example, image data indicating a phase image from which the inspection area has been extracted to the storage device 12 or the like as an extraction result of the inspection area (S37). Note that the processor 11 may output the extraction result of the inspection area not only to the storage device 12 but also to an external device of the inspection device 10 via the interface 13, for example.
[0099] As described above, the processor 11 creates a region mask based on the contrast corresponding to the emissivity difference on the workpiece 90 in the temperature image (S35), and extracts an inspection region corresponding to the bonded portion 95 in the phase image using the region mask (S36). This allows the inspection device 10 to determine the internal state of the workpiece 90 only in the extracted inspection region in the phase image, making it easier to perform the pass / fail determination process (S3). For example, the inspection device 10 can suppress the influence of background regions other than the extracted inspection region in the phase image, thereby efficiently and accurately determining the bonded state of the workpiece 90.
[0100] [1-4. Effects, etc.] As described above, the inspection device 10 according to this embodiment includes the interface 13, which is an example of an input unit that acquires infrared images, and the processor 11 that performs analysis processing to inspect the workpiece 90, which is an example of an object, based on the infrared images. The infrared camera 17 captures time-series images of the workpiece 90 heated by excitation light from the excitation source 18, which is an example of an excitation light source, to generate infrared images. The processor 11 acquires the infrared images via the interface 13 (S1). The processor 11 switches the analysis processing between a first and a second analysis mode depending on the acquired infrared images and the physical properties of the workpiece 90 related to the excitation light (S13). In the first analysis mode, the infrared image is analyzed to analyze the thermal response of components of the excitation light that penetrate the surface of the workpiece 90. In the second analysis mode, the infrared image is analyzed to analyze the thermal response of components of the excitation light that are absorbed by the surface of the workpiece 90.
[0101] According to the inspection device 10 of this embodiment, the workpiece 90 can be inspected with high precision.
[0102] In the first analysis mode, the processor 11 may perform an analysis process to analyze the thermal response of components of the excitation light that transmit through the surface of the workpiece 90 by using a first infrared image captured during a first period T1 as the analysis target data (S14). In the second analysis mode, the processor 11 may perform an analysis process to analyze the thermal response of components of the excitation light that are absorbed by the surface of the workpiece 90 by using a second infrared image captured during a second period T2 as the analysis target data (S15). With this configuration, the workpiece 90 can be inspected with high accuracy by appropriately selecting the analysis target according to the physical properties of the workpiece 90.
[0103] In the first analysis mode, the processor 11 may determine the first period T1 to be a period after the end of the emission of the excitation light by the excitation source 18. According to this configuration, by excluding information about the light reflected by the workpiece 90 from the analysis target in the first analysis mode, the workpiece 90 can be inspected with high accuracy.
[0104] In the second analysis mode, the processor 11 may determine the second period T2 to be a period that includes a period before the end of the emission of excitation light by the excitation source 18. According to this configuration, by analyzing data with a large amount of information in the second analysis mode, the workpiece 90 can be inspected with high accuracy.
[0105] The processor 11 may perform a discrete Fourier transform on the analysis target data (S22), generate an analysis image corresponding to the temperature change of the workpiece 90 (S23), and detect the internal state of the workpiece 90 based on the analysis image (S26), thereby inspecting the workpiece 90. The analysis image is, for example, a phase image 30 at a predetermined frequency of the analysis target data that has been subjected to the discrete Fourier transform. With this configuration, the internal state of the workpiece 90 can be inspected with high accuracy.
[0106] The processor 11 may calculate a transmitted energy amount TE, which is an example of a predetermined amount indicating the amount of a component of the excitation light that transmits through the workpiece 90, based on information indicating the spectrum of the excitation light from the excitation source 18 and information indicating the distribution of the transmittance of the workpiece 90 with respect to wavelength. The processor 11 may operate in a first analysis mode when the transmitted energy amount TE is equal to or greater than a threshold, and may operate in a second analysis mode when the transmitted energy amount TE is less than the threshold. With this configuration, the workpiece 90 can be inspected with high accuracy by switching the analysis mode depending on the transmitted energy amount TE.
[0107] The workpiece 90 may include a transmissive material 91, which is an example of a first layer, and an absorbing material 92, which is an example of a second layer, that have different physical properties. The processor 11 may switch between the first analysis mode and the second analysis mode depending on the physical properties of the transmissive material 91. With this configuration, the workpiece 90 can be inspected with high accuracy by appropriately selecting the target of analysis depending on the physical properties of the transmissive material 91.
[0108] In one example, the workpiece 90 includes a joint 95 where the transmissive material 91 and / or the absorbing material 92 are joined to each other by melting the transmissive material 91 and / or the absorbing material 92. The processor 11 may inspect the state of the joint 95 based on an infrared image as an analysis process. With this configuration, the state of the joint 95 of the workpiece 90 can be inspected with high accuracy.
[0109] The processor 11 may calculate a transmitted energy amount indicating the amount of components of the excitation light that transmit through the transparent material 91 and a thermal conduction energy amount indicating the amount of components absorbed by the transparent material 91, based on information indicating the spectrum of the excitation light from the excitation source 18 and information indicating the distribution of the transmittance of the transparent material 91 with respect to wavelength. The processor 11 operates in a first analysis mode when the transmitted energy amount is equal to or greater than the thermal conduction energy amount, and operates in a second analysis mode when the transmitted energy amount is less than the thermal conduction energy amount. With this configuration, the workpiece 90 can be inspected with high accuracy by switching the analysis mode depending on the transmitted energy amount and the thermal conduction energy amount.
[0110] 17 is a block diagram showing an example configuration of an inspection system 2 according to a second embodiment of the present disclosure. Compared to the inspection system 1 according to the first embodiment, the inspection system 2 includes an inspection device 20 instead of the inspection device 10, and an excitation source 28 instead of the excitation source 18. In the following description of the inspection system 2 according to the present embodiment, descriptions of the same configuration, operation, etc. as those of the inspection system 1 according to the first embodiment may be omitted.
[0111] The excitation source 28 is configured to be able to change the wavelength characteristics of the light it emits. For example, the excitation source 28 can change the wavelength characteristics of the light that reaches the workpiece 90 by changing the presence or absence or type of an optical filter. The presence or absence or type of optical filter is changed by, for example, the inspection device 20, but is not limited to this and may be changed manually.
[0112] Alternatively or in addition, the wavelength characteristics of the light reaching the workpiece 90 can be changed by changing the type of excitation source 28. For example, the excitation source 28 is configured to be interchangeable between at least two of a xenon lamp, a halogen lamp, and a laser light source. The type of excitation source 28 is changed, for example, by the inspection device 20, but is not limited to this and may also be changed manually.
[0113] In this embodiment, if there is a light source that operates in a transmission mode due to the relationship between the spectrum and the physical properties of the workpiece 90, the inspection device 20 uses such a light source as the excitation source 28 and performs analysis processing in the first analysis mode.
[0114] The first peak P1 may appear in the temperature time-series data as a result of the infrared camera 17 detecting reflected light generated by the workpiece 90 reflecting light from the excitation source 18. In such cases, since the first peak P1 may not directly represent a temperature rise in the workpiece 90, it may be preferable to exclude the infrared image corresponding to the first peak P1 from the analysis target. The inspection device 20 excludes the infrared image corresponding to the first peak P1 from the analysis target as much as possible, making it possible to inspect the state of the workpiece 90 with high accuracy.
[0115] Fig. 18 is a block diagram showing an example of the configuration of the inspection device 20 of Fig. 17. The inspection device 20 includes a processor 21, a storage device 22, and an interface 23.
[0116] The processor 21, the storage device 22, and the interface 23 may have the same configuration as the processor 11, the storage device 12, and the interface 13 of the inspection device 10, respectively.
[0117] The storage device 22 stores various information including programs and data necessary to realize the functions of the inspection device 20. The storage device 22 stores, as such data, a physical property database (DB) 220 indicating the physical properties of the workpiece 90 and a spectrum DB 221 indicating the spectra of a plurality of light sources that can be selected as the excitation source 28.
[0118] FIG. 19 is a table showing an example of the physical property DB 220. The physical property DB 220 is a database that associates materials with the wavelength characteristics of the materials. The wavelength characteristics indicate, for example, the distribution of transmittance for a certain material with respect to wavelength. Since the material of the workpiece 90 is, for example, PA, PBT, or PPS, the physical property DB 220 includes the wavelength characteristics of PA (wavelength characteristics PA), the wavelength characteristics of PBT (wavelength characteristics PBT), and the wavelength characteristics of PPS (wavelength characteristics PPS). FIGS. 20 to 22 are graphs showing the wavelength characteristics PA, wavelength characteristics PBT, and wavelength characteristics PPS of the physical property DB 220 shown in FIG. 19, respectively.
[0119] The material of the workpiece 90 may be ceramics, SPCC steel, or aluminum, as in the first embodiment.
[0120] Fig. 23 is a table showing an example of the spectrum DB 221. The spectrum DB 221 is a database that associates the types of light sources that can be selected as the excitation source 28 with the spectra of the light sources. Since the excitation source 28 is, for example, a xenon lamp, a halogen lamp, or a laser light source, the spectrum DB 221 includes a spectrum X of a xenon lamp, a spectrum H of a halogen lamp, and a spectrum DL of a diode laser, which is an example of a laser light source. Figs. 24 to 26 are graphs showing the spectrum X, spectrum H, and spectrum DL of Fig. 23, respectively.
[0121] The inspection device 20 calculates the amount of transmitted energy TE using the physical property DB 220 and the spectrum DB 221, and determines the wavelength characteristics of the excitation source 28 based on the calculated amount of transmitted energy TE. For example, the processor 21 changes the type of excitation source 28 based on the amount of transmitted energy TE. An example of the operation of the inspection device 20 will be described in detail below.
[0122] [2-2. Operation] Fig. 27 is a flowchart illustrating an operation of the inspection device 20. Each process shown in this flow is executed by, for example, the processor 21 of the inspection device 20. Compared with the flowchart of Fig. 9 according to the first embodiment, the flowchart of Fig. 27 includes a judgment preparation process S200 instead of steps S1 and S2 of Fig. 9.
[0123] The determination preparation process S200 is a process of switching the analysis mode of the processor 21 depending on whether the transmission mode or the thermal conduction mode is predominant, for example.
[0124] FIG. 28 is a flowchart illustrating details of the judgment preparation process S200 shown in FIG.
[0125] 28 , first, the processor 21 acquires material information of the workpiece 90 (S201). For example, a user inputs the material information of the workpiece 90 using a user interface such as a keyboard, a mouse, or a touch panel, and the processor 21 acquires the material information via the interface 23. Alternatively, the material information of the workpiece 90 may be stored in advance in the storage device 22.
[0126] The processor 21 acquires the physical property information of the workpiece 90 from the physical property DB 220 based on the material information of the workpiece 90 acquired in step S201 (S202). For example, if the material of the workpiece 90 is PA, the processor 21 refers to the physical property DB 220 in Fig. 19 and acquires the wavelength characteristic PA as the physical property information.
[0127] The processor 21 acquires the spectra of a plurality of light sources that are candidates for the excitation source 28 from the spectrum DB 221 (S203). Unlike the example of Fig. 28, step S203 may be executed before step S202.
[0128] Next, the processor 21 calculates the amount of transmitted energy TE for each light source based on the information acquired in steps S202 and S203 (S204). For example, the processor 21 calculates the amount of transmitted energy at a specific wavelength by calculating the product of the relative intensity of a certain light source at that wavelength and the transmittance of the workpiece 90. For example, the processor 21 calculates the amount of transmitted energy TE for that light source by calculating the amount of transmitted energy over all wavelengths and finding the sum of these amounts.
[0129] The processor 21 determines whether there is a light source whose transmitted energy amount TE is equal to or greater than a predetermined reference value TER (S205). The reference value TER is set to, for example, 2000, but is not limited to this.
[0130] When the processor 21 determines that there is a light source whose transmitted energy amount TE is equal to or greater than a predetermined reference value TER (Yes in S205), the processor 21 prepares one light source that satisfies TE≧TER as the excitation source 28 (S206). For example, when the processor 21 determines that there are multiple light sources whose transmitted energy amount TE is equal to or greater than the predetermined reference value TER, the processor 21 prepares the light source having the largest transmitted energy amount TE among the multiple light sources as the excitation source 28.
[0131] The processor 21 heats the workpiece 90 using the excitation source 28 prepared in step S206 (S207).
[0132] Next, the processor 21 acquires an infrared image from the infrared camera 17 (S208). Step S208 may be the same process as step S1 in FIG.
[0133] Next, the processor 21 acquires time-series data of the temperature of the joint 95 based on the infrared image acquired in step S208 (S209). Step S209 may be the same process as step S11 in FIG.
[0134] Next, the processor 21 sets the time range (frame range) of the image to be used in the quality determination process S3 to a first period T1 (S210). The first period T1 is a period that includes the time t2 corresponding to the second peak P2 of the temperature of the workpiece 90, but does not include the time t1 corresponding to the first peak P1. Step S210 may be the same process as step S14 in FIG. 10.
[0135] In step S205, when it is determined that there is no light source whose transmitted energy amount TE is equal to or greater than the predetermined reference value TER (No in S205), the processor 21 prepares one light source that satisfies TE<TER as the excitation source 28 (S206). For example, when there are multiple light sources that satisfy TE<TER, the processor 21 prepares one of the multiple light sources as the excitation source 28.
[0136] Steps S212, S213, and S214 are similar to steps S207, S208, and S209, respectively.
[0137] After step S214, the processor 21 sets the time range (frame range) of the image used in the quality determination process S3 to a second period T2 (S215). The second period T2 is a period including a time t1 corresponding to a first peak P1 of the temperature of the workpiece 90 and a time t2 corresponding to a second peak P2. Step S215 may be the same process as step S15 in FIG. 10.
[0138] 2-3. Effects, etc. As described above, the inspection device 20 according to this embodiment includes the interface 23, which is an example of an input unit that acquires infrared images, and the processor 21 that performs analysis processing to inspect the workpiece 90, which is an example of an object, based on the infrared images. The infrared camera 17 captures time-series images of the workpiece 90 heated by excitation light from the excitation source 28, which is an example of an excitation light source, to generate infrared images. The processor 21 selects whether to operate in a first analysis mode in which the infrared image is analyzed to analyze the thermal response of components of the excitation light that transmit through the surface of the workpiece 90, or in a second analysis mode in which the infrared image is analyzed to analyze the thermal response of components of the excitation light that are absorbed by the surface of the workpiece 90. The processor 21 determines the wavelength characteristics of the excitation source 28 based on the selection result (S200).
[0139] According to the inspection device 20 of this embodiment, the workpiece 90 can be inspected with high precision.
[0140] The processor 21 may select whether to operate in the first analysis mode or the second analysis mode based on the physical property information indicating the physical properties of the workpiece 90 and the information indicating the spectra of the multiple light sources (S205). According to this configuration, the wavelength characteristics of the excitation source 28 can be appropriately determined in accordance with the physical property information and the information indicating the spectra of the multiple light sources, thereby enabling the workpiece 90 to be inspected with high accuracy.
[0141] The processor 21 may calculate a transmitted energy amount TE, which indicates the amount of a component of light emitted from each of the plurality of light sources that transmits through the workpiece 90, based on information indicating the distribution of the transmittance of the workpiece 90 with respect to wavelength and information indicating the spectrum of the plurality of light sources (S204). If there is a light source among the plurality of light sources whose transmitted energy amount TE is equal to or greater than the reference value TER (Yes in S205), the processor 21 may operate in a first analysis mode. If there is no light source among the plurality of light sources whose transmitted energy amount TE is equal to or greater than the reference value TER (No in S205), the processor 21 may operate in a second analysis mode. According to this configuration, the analysis mode can be appropriately determined to accurately inspect the workpiece 90.
[0142] If there is a light source among the plurality of light sources whose transmitted energy amount TE is equal to or greater than the reference value TER (Yes in S205), the processor 21 may determine one of the plurality of light sources as the excitation source 28, and then determine the wavelength characteristics of the excitation source 28 according to the selection result (S206). According to this configuration, by appropriately determining the wavelength characteristics of the excitation source 28, the workpiece 90 can be inspected with high accuracy.
[0143] In the first analysis mode, the processor 21 may perform analysis processing to analyze the thermal response of components of the light from the excitation source 28 that transmits through the surface of the workpiece 90 by using a first infrared image captured during a first period T1 as the analysis target data (S210). In the second analysis mode, the processor 21 may perform analysis processing to analyze the thermal response of components of the light from the excitation source 28 that is absorbed by the surface of the workpiece 90 by using a second infrared image captured during a second period T2 as the analysis target data (S215). With this configuration, the workpiece 90 can be inspected with high accuracy by appropriately selecting the analysis target according to the physical properties of the workpiece 90.
[0144] In the first analysis mode, the processor 21 may determine the first period T1 to be a period after the end of the emission of light by the excitation source 28 (S210). According to this configuration, by excluding information about the light reflected by the workpiece 90 from the analysis target in the first analysis mode, the workpiece 90 can be inspected with high accuracy.
[0145] In the second analysis mode, the processor 21 may determine the second period T2 to be a period that includes a period before the end of the emission of light by the excitation source 28 (S215). According to this configuration, by analyzing data with a large amount of information in the second analysis mode, the workpiece 90 can be inspected with high accuracy.
[0146] The processor 21 may perform a discrete Fourier transform on the infrared image (S22), generate an analysis image corresponding to the temperature change of the workpiece 90 (S23), and detect the internal state of the workpiece 90 based on the analysis image, thereby inspecting the workpiece 90 (S26). The analysis image is, for example, a phase image 30 at a predetermined frequency of the infrared image that has been subjected to the discrete Fourier transform. With this configuration, the internal state of the workpiece 90 can be inspected with high accuracy.
[0147] [3. Other Embodiments] As described above, the embodiments have been described as examples of the technology in the present disclosure. However, the technology in the present disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made as appropriate. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments. Therefore, below, examples of modified examples as other embodiments will be described.
[0148] [3-1. First Modification] The inspection processes of the first and second embodiments can be combined. Fig. 29 is a flowchart illustrating the operation of an inspection device according to such a first modification. Each process shown in this flow is executed by, for example, a processor of the inspection device. This processor may have a configuration similar to that of processor 11 or processor 21.
[0149] If the wavelength characteristics of the excitation source are changeable (Yes in S101) and the spectrum DB 221 is stored in the storage device (Yes in S102), the processor executes the same processing as that in Embodiment 2. The subsequent processing is the same as the processing shown in FIG. 27, and therefore description thereof will be omitted here.
[0150] If the wavelength characteristics of the excitation source cannot be changed (No in S101) or if the spectrum DB 221 is not stored in the storage device (No in S102), the processor executes the same processing as that in Embodiment 1. The subsequent processing is the same as the processing shown in FIG. 9, and therefore description thereof will be omitted here.
[0151] [3-2. Second Modification] In the first embodiment, an example has been described in which the first period T1 and the second period T2 are determined based on the time t1 corresponding to the first peak P1 and the time t2 corresponding to the second peak P2, but the present disclosure is not limited to this.
[0152] For example, the first period T1 and the second period T2 may be defined by absolute times based on the start time (t=0) of the workpiece 90. In this case, the first period T1 is set to the period from time t3 after heating ends to time t4. Time t3 is 0.01 to 1 second, for example, 0.3 seconds. Time t4 is 1.5 seconds after time t3. For example, t4=1.8 seconds.
[0153] [3-3. Third Modification] In the first embodiment, an example has been described in which a phase image is extracted by performing a discrete Fourier transform on an infrared image, but what is extracted by the discrete Fourier transform is not limited to a phase image. For example, the processor 11 may extract at least one of an amplitude image showing the amplitude characteristics of the data after the discrete Fourier transform, a real part image showing the real part of the data after the discrete Fourier transform, which is a complex number, an imaginary part image showing the imaginary part, and a phase image.
[0154] 4. Example Aspects The following describes examples of the present disclosure.
[0155] <Aspect 1> An inspection device comprising: an input unit that acquires infrared images generated by an infrared imaging device capturing, in time series, images of an object heated by excitation light from an excitation light source; and a processor that performs analysis processing to inspect the object based on the infrared images, wherein the processor selects whether to operate in a first analysis mode that performs the analysis processing of the infrared images to analyze the thermal response of components of the excitation light that transmit through the surface of the object, or a second analysis mode that performs the analysis processing of the infrared images to analyze the thermal response of components of the excitation light that are absorbed by the surface of the object, and determines the wavelength characteristics of the excitation light source depending on the selection result.
[0156] <Aspect 2> The inspection device according to aspect 1, wherein the processor selects whether to operate in the first analysis mode or the second analysis mode based on physical property information indicating the physical properties of the object and information indicating the spectra of a plurality of light sources.
[0157] <Aspect 3> The inspection device according to Aspect 1 or 2, wherein the processor calculates a predetermined amount indicating the amount of a component of light emitted from each of the plurality of light sources that transmits through the surface of the object, based on information indicating the distribution of transmittance of the surface of the object versus wavelength and information indicating the spectra of the plurality of light sources; and operates in the first analysis mode if there is a light source among the plurality of light sources for which the predetermined amount is equal to or greater than a threshold; and operates in the second analysis mode if there is no light source among the plurality of light sources for which the predetermined amount is equal to or greater than the threshold.
[0158] <Aspect 4> The inspection device according to Aspect 3, wherein the processor determines the wavelength characteristics of the excitation light source in accordance with the selection result by determining one of the plurality of light sources as the excitation light source when there is a light source among the plurality of light sources for which the predetermined amount is equal to or greater than the threshold value.
[0159] <Aspect 5> The inspection device according to any one of Aspects 1 to 4, wherein the processor, in the first analysis mode, performs the analysis process to analyze the thermal response of components that transmit through the surface of the object by using a first infrared image of the infrared images that has been captured during a first time period as the data to be analyzed, and in the second analysis mode, performs the analysis process to analyze the thermal response of components that are absorbed by the surface of the object by using a second infrared image of the infrared images that has been captured during a second time period as the data to be analyzed.
[0160] <Aspect 6> The inspection device according to Aspect 5, wherein the processor, in the first analysis mode, determines the first period to be a period after a point in time when the emission of the excitation light by the excitation light source ends, and, in the second analysis mode, determines the second period to be a period that includes a period before a point in time when the emission of the excitation light by the excitation light source ends.
[0161] <Aspect 7> The inspection device according to any one of Aspects 1 to 6, wherein the processor performs a discrete Fourier transform on the infrared image to generate an analysis image corresponding to a temperature change of the object, and detects an internal state of the object based on the analysis image, thereby inspecting the object.
[0162] <Aspect 8> The inspection device according to aspect 7, wherein the analysis image is a phase image at a predetermined frequency of the infrared image that has been subjected to a discrete Fourier transform.
[0163] <Aspect 9> An inspection method for performing an analysis process to inspect an object based on infrared images generated by an infrared imaging device photographing the object in time series while the object is heated by excitation light from an excitation light source, the inspection method including the steps of: selecting whether to operate in a first analysis mode in which the analysis process of the infrared images is performed to analyze the thermal response of components of the excitation light that transmit through the surface of the object, or a second analysis mode in which the analysis process of the infrared images is performed to analyze the thermal response of components of the excitation light that are absorbed by the surface of the object; and determining the wavelength characteristics of the excitation light source according to the selection result.
[0164] The present disclosure is applicable to an inspection apparatus and an inspection method.
[0165] REFERENCE SIGNS LIST 1 Inspection system 2 Inspection system 10 Inspection device 11 Processor 12 Storage device 13 Interface 15 Control box 16 Power supply 17 Infrared camera 18 Excitation source 19 Notification device 20 Inspection device 21 Processor 22 Storage device 23 Interface 28 Excitation source 30 Phase image 31 Phase image 90 Workpiece 91 Transmitting material 92 Absorbing material 95 Joint 220 Physical property database 221 Spectral database
Claims
1. An inspection device comprising: an input unit that acquires infrared images generated by an infrared imaging device photographing an object heated by excitation light from an excitation light source in a time series; and a processor that performs analysis processing to inspect the object based on the infrared images, wherein the processor selects whether to operate in a first analysis mode that performs analysis processing of the infrared images to analyze the thermal response of components of the excitation light that transmit through the surface of the object, or a second analysis mode that performs analysis processing of the infrared images to analyze the thermal response of components of the excitation light that are absorbed into the surface of the object, and determines the wavelength characteristics of the excitation light source depending on the selection result.
2. The inspection device of claim 1, wherein the processor selects whether to operate in the first analysis mode or the second analysis mode based on physical property information indicating the physical properties of the object and information indicating the spectra of multiple light sources.
3. The inspection device described in claim 1, wherein the processor calculates a predetermined amount indicating the amount of a component of light emitted from each of the plurality of light sources that transmits through the surface of the object based on information indicating the distribution of transmittance of the object versus wavelength and information indicating the spectrum of the plurality of light sources, and operates in the first analysis mode if there is a light source among the plurality of light sources for which the predetermined amount is equal to or greater than a threshold, and operates in the second analysis mode if there is no light source among the plurality of light sources for which the predetermined amount is equal to or greater than the threshold.
4. The inspection device of claim 3, wherein the processor determines the wavelength characteristics of the excitation light source in accordance with the selection result by determining one of the plurality of light sources as the excitation light source if there is a light source among the plurality of light sources for which the predetermined amount is equal to or greater than the threshold value.
5. The inspection device described in claim 1, wherein the processor performs the analysis process in the first analysis mode to analyze the thermal response of a component of the excitation light that passes through the object by using a first infrared image of the infrared images taken during a first period as the data to be analyzed, and in the second analysis mode to analyze the thermal response of a component of the excitation light that is absorbed by the object by using a second infrared image of the infrared images taken during a second period as the data to be analyzed.
6. The inspection device described in claim 5, wherein the processor, in the first analysis mode, determines the first period to be a period after the end of emission of the excitation light by the excitation light source, and, in the second analysis mode, determines the second period to be a period including a period before the end of emission of the excitation light by the excitation light source.
7. An inspection device according to any one of claims 1 to 6, wherein the processor performs a discrete Fourier transform on the infrared image to generate an analysis image corresponding to a temperature change of the object, and detects an internal state of the object based on the analysis image, thereby inspecting the object.
8. The inspection device according to claim 7, wherein the analysis image is a phase image at a predetermined frequency of the infrared image that has been subjected to a discrete Fourier transform.
9. An inspection method for performing an analysis process to inspect an object based on infrared images generated by an infrared imaging device photographing the object in a time series after it has been heated by excitation light from an excitation light source, the inspection method including the steps of: selecting whether to operate in a first analysis mode in which the analysis process of the infrared images is performed to analyze the thermal response of components of the excitation light that transmit through the surface of the object, or a second analysis mode in which the analysis process of the infrared images is performed to analyze the thermal response of components of the excitation light that are absorbed into the surface of the object; and determining the wavelength characteristics of the excitation light source depending on the selection result.
Citation Information
Patent Citations
Failure analysis apparatus and failure analysis method for semiconductor device
JP2011233768A
Bonding performance inspection method and bonding performance inspection apparatus
JP2015132545A
Method and device for inspecting connectability of sample
JP2017078624A
Defective welding inspection device
JP2017201274A
Method and apparatus for thermographic nondestructive evaluation of an object
US20080144049A1
