Apparatus, method, and recording medium for checking coating status and recording instructions

By using multiple light sources and image processing technology, the problem of identifying the location of objects coated on the substrate was solved, and accurate detection of the coating status was achieved.

CN117073524BActive Publication Date: 2026-11-10KOHYOUNG TECH
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310512153.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2022-05-16
Filing Date
2023-05-08
Publication Date
2026-11-10
Estimated Expiration
2043-05-08

AI Technical Summary

Technical Problem

When coating an object onto a substrate surface, it is difficult to confirm whether the object is properly coated in the desired location, especially due to variations in reflective properties caused by the type of substrate or solder pads within the substrate.

Method used

Multiple light sources are used to illuminate the substrate with light at different incident angles and wavelengths. Images are captured and processed by a camera, and the coating state of the object is determined by brightness changes and boundary surface detection.

Benefits of technology

Accurately determining the coating state of an object improves the accuracy of coating location confirmation and solves the problems caused by changes in reflective properties.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117073524B_ABST
    Figure CN117073524B_ABST
Patent Text Reader

Abstract

The present invention provides an apparatus for inspecting the coating state. The apparatus may include: one or more light source groups; a camera; one or more memory stores one or more pre-obtained first images, wherein the one or more first images are obtained by the camera capturing light respectively irradiated from the one or more light source groups and reflected by a substrate of an uncoated object; and one or more processors connected to communicate with the one or more light source groups, the camera, and the one or more memory; wherein the one or more processors can obtain a second image by controlling the first light source groups and the camera to irradiate light onto the substrate coated with the object, and determine the coating state of the object based on the one or more first images and the second image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to a technique for inspecting the coating state of an object coated on a substrate. Background Technology

[0002] In substrate processing, before mounting solder-applied packages onto the substrate, a process can be performed to coat an object as a transparent adhesive (e.g., flux). The object, such as flux, acts as an adhesive, allowing the package to be positioned more accurately on the substrate. However, when the object is coated at a desired location on the substrate surface, its reflective properties vary depending on the type of substrate or solder pads within it, making it difficult to confirm whether the object is properly coated at the desired location. Summary of the Invention

[0003] Technical issues This invention provides a technique for inspecting the coating state of an object coated on a substrate.

[0004] Technical solution According to one aspect of the present invention, an apparatus for inspecting the coating state of an object coated on a substrate can be provided. The apparatus of the present invention may include: one or more light source groups; a camera; one or more memory groups storing one or more pre-obtained first images, wherein the one or more first images are obtained by the camera capturing light respectively irradiated from the one or more light source groups and reflected by a substrate without an object coated; and one or more processors connected to communicate with the one or more light source groups, the camera, and the one or more memory groups; wherein the one or more processors can obtain a second image by controlling the first light source groups and the camera in the one or more light source groups to irradiate light onto the substrate coated with the object, and determine the coating state of the object based on the one or more first images and the second images.

[0005] In one embodiment, the object may include an adhesive substance.

[0006] In one embodiment, the one or more light source groups can be configured to irradiate the substrate coated with the object with light at predetermined, different incident angles.

[0007] In one embodiment, the one or more light source groups may each include multiple light sources, which are arranged on virtual concentric circles parallel to the substrate coated with the object, and the camera may be arranged vertically above the substrate coated with the object.

[0008] In one embodiment, the one or more light source groups can respectively irradiate the substrate coated with the object with at least one selected from red light, green light, blue light, ultraviolet light and infrared light.

[0009] In one embodiment, the one or more processors can determine the coating state of the object based on the amount of brightness change between the first image obtained by the first light source group and the second image in the one or more first images.

[0010] In one embodiment, the processor can obtain a second image by controlling the second light source group in the one or more light source groups and the camera to irradiate light onto the substrate coated with the object, determine a first brightness difference between the first image obtained by the first light source group and the first image obtained by the second light source group in the one or more first images, determine a second brightness difference between the second image obtained by the first light source group and the second image obtained by the second light source group, and determine the coating state of the object based on the change in the first brightness difference and the second brightness difference.

[0011] In one embodiment, the one or more processors may detect the boundary surface of the object based on the second image, and determine the coating state of the object based on the boundary surface.

[0012] In one embodiment, the one or more processors can obtain the second image by further controlling the second light source group included in the one or more light source groups, wherein the first light source group and the second light source group can irradiate the substrate coated with the object with light of different wavelengths at different incident angles.

[0013] According to another aspect of the present invention, a method for inspecting the coating state of an object coated on a substrate can be provided. The method of the present invention is executed by a computing device including one or more processors and one or more memories storing instructions for execution by the one or more processors. The method may include: a step whereby the one or more processors obtain one or more first images stored in the one or more memories, wherein the one or more first images are obtained by capturing light from the one or more light sources respectively illuminating the substrate without the object coated by a camera; a step whereby the one or more processors illuminate the substrate coated with the object by controlling the first light source group in the one or more light sources; a step whereby the one or more processors obtain a second image by controlling the camera to capture light reflected by the substrate coated with the object; and a step whereby the one or more processors determine the coating state of the object based on the one or more first images and the second image.

[0014] In one embodiment, the object may include an adhesive substance.

[0015] In one embodiment, the one or more light source groups can be configured to irradiate the substrate coated with the object with light at predetermined, different incident angles.

[0016] In one embodiment, the one or more light source groups may each include multiple light sources, which are arranged on virtual concentric circles parallel to the substrate coated with the object, and the camera may be arranged vertically above the substrate coated with the object.

[0017] In one embodiment, the one or more light source groups can respectively irradiate the substrate coated with the object with at least one selected from red light, green light, blue light, ultraviolet light and infrared light.

[0018] In one embodiment, the method may further include: the step of the one or more processors determining the coating state of the object based on the amount of brightness change between the first image obtained by the first light source group and the second image in the one or more first images.

[0019] In one embodiment, the method may further include: the step of the one or more processors irradiating light onto the substrate coated with the object by controlling the second light source group in the one or more light source groups and the camera to obtain a second image; the step of the one or more processors determining a first brightness difference between the first image obtained by the first light source group and the first image obtained by the second light source group in the one or more first images; the step of the one or more processors determining a second brightness difference between the second image obtained by the first light source group and the second image obtained by the second light source group; and the step of the one or more processors determining the coating state of the object based on the change in the first brightness difference and the second brightness difference.

[0020] In one embodiment, the method may further include: the step of the one or more processors detecting the boundary surface of the object based on the second image; and the step of the one or more processors determining the coating state of the object based on the boundary surface.

[0021] In one embodiment, the step of obtaining the second image may include: the step of the one or more processors further controlling the second light source group included in the one or more light source groups, wherein the first light source group and the second light source group can irradiate the substrate coated with the object with light of different wavelengths at different incident angles.

[0022] According to another aspect of the present invention, a non-transitory computer-readable recording medium recording instructions for execution on a computer can be provided. When the instructions are executed by one or more processors, the one or more processors obtain one or more first images stored in one or more memories, wherein each of the one or more first images is obtained by a camera capturing light illuminating a substrate of an uncoated object from one or more light sources and reflecting it; the one or more processors obtain a second image by controlling the first light sources in the one or more light sources and the camera to illuminate the substrate coated with the object; and the one or more processors determine the coating state of the object based on the one or more first images and the second images.

[0023] Invention Effects According to various embodiments of the present invention, the coating state of the object can be accurately determined by utilizing the optical properties of light incident on a substrate coated with the object.

[0024] According to various embodiments of the present invention, the coating state of an object can be accurately determined by utilizing the differences in the reflection characteristics of light arriving at a substrate coated with an object from multiple light source groups.

[0025] According to various embodiments of the present invention, the boundary surface of an object coated on a substrate can be measured to accurately determine the coating state of the object. Attached Figure Description

[0026] Figure 1 This is a perspective view of an inspection device including one or more light source groups according to an embodiment of the present invention.

[0027] Figure 2 This is a front view of an inspection device including one or more light source groups according to an embodiment of the present invention.

[0028] Figure 3 This is an enlarged cross-sectional view of the portion where the one or more light source groups are arranged when the inspection device including one or more light source groups according to an embodiment of the present invention is cut along a direction perpendicular to the ground.

[0029] Figure 4 This is an exemplary bottom view of the inspection device according to an embodiment of the present invention, when the inspection device includes one or more light source groups, including three light source groups, and viewed from below the device.

[0030] Figure 5 This is a block diagram of a computing device according to an embodiment of the present invention.

[0031] Figure 6 This is an exemplary top view of a substrate without an object and a substrate with an object coated, according to an embodiment of the present invention.

[0032] Figure 7 This is a conceptual diagram illustrating the path of light irradiated from one or more light source groups according to an embodiment of the present invention, which travels from a substrate coated with an object to a camera via reflection or refraction.

[0033] Figure 8 This is an operation flowchart of an inspection device according to an embodiment of the present invention.

[0034] Figure 9 This is an operation flowchart of an inspection device according to an embodiment of the present invention. Detailed Implementation

[0035] The various embodiments described herein are illustrative of the technical concept of the invention and are not intended to limit it to specific implementations. The technical concept of the invention includes various modifications, equivalents, alternatives, and alternative combinations of all or part of the embodiments described herein. Furthermore, the scope of the technical concept of the invention is not limited to the various embodiments presented below or their specific descriptions.

[0036] Including technical or scientific terms, unless otherwise defined, the terms used herein may have the meaning generally understood by one of ordinary skill in the art to which this invention pertains.

[0037] As used herein, expressions such as "including," "may include," "possesses," "may possess," "has," and "may have" indicate the presence of features that make up an object (e.g., functions, actions, or constituent elements), without excluding the possibility of additional features. That is, such expressions should be understood as open-ended terms that include the possibility of including other embodiments.

[0038] The singular expressions used in this document may include the meaning of the plural forms, provided that the context does not differ. This also applies to the singular expressions described in the claims.

[0039] As used herein, the terms "first," "second," or "firstly," "secondarily," etc., are used to distinguish one object from another when referring to multiple objects of the same kind, unless the context indicates otherwise, and do not limit the order or importance of the corresponding objects. In one embodiment, the various light source groups included in one or more light source groups of the present invention can be distinguished from each other by expressions such as "first light source group," "second light source group," etc.

[0040] The expressions “A, B and C”, “A, B or C”, “A, B and / or C”, “at least one of A, B and C”, “at least one of A, B or C”, “at least one of A, B and / or C”, etc., used in this book can refer to each listed item or all possible combinations of listed items. For example, “at least one of A or B” can refer to (1) at least one A, (2) at least one B, (3) at least one A and at least one B.

[0041] As used herein, the term "department" can refer to software or hardware components such as FPGAs (field-programmable gate arrays) and ASICs (application-specific integrated circuits). However, "department" is not limited to hardware and software. A "department" can be configured to reside in addressable storage media or to run one or more processors. In one embodiment, a "department" can include components such as software components, objects pointing to software components, cluster components, and task components, as well as processors, functions, attributes, programs, subroutines, fragments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, worksheets, arrays, and variables.

[0042] The use of the phrase "based on" in this book describes one or more factors that influence the actions or behaviors described in the statements or articles containing the corresponding statement. This description does not exclude additional factors that influence the actions or behaviors described in the corresponding decisions or judgments.

[0043] The use of the term "connected" or "connected" to another component (e.g., the second component) in this document may mean that not only is the component directly connected or connected to the other component, but the connection or connection is also made through a new component (e.g., the third component).

[0044] The term "configured to" used in this book can have various meanings depending on the context, such as "set to," "possessing the capability to," "changed to," "formed to," or "capable of being configured to." The term is not limited to the meaning of "specifically designed in hardware." For example, a processor configured to perform a specific action can refer to a special-purpose computer that is structured through programming to perform that specific action.

[0045] Various embodiments of the present invention will now be described with reference to the accompanying drawings. In the drawings and the description thereof, the same or substantially equivalent constituent elements may be given the same reference numerals. Furthermore, in the following description of the various embodiments, repeated descriptions of the same or corresponding constituent elements may be omitted, but this does not imply that the corresponding constituent elements are not included in that embodiment.

[0046] Figure 1 This is a perspective view of an inspection apparatus including one or more light source groups according to a first embodiment of the present invention. The inspection apparatus 10 may include one or more light source groups. Reference numeral 300 indicates an exemplary area that can be configured with one or more light source groups using dashed lines. The inspection apparatus 10 may also be configured to include a camera 200. Additionally, although not shown, the inspection apparatus 10 may be configured to include one or more processors and / or one or more memories for performing predetermined operations. Furthermore, refer to… Figure 1 The inspection device 10 shown as an example, such as Figure 5 As shown, it can also be connected to a computing device 500 that includes one or more processors and / or one or more memories.

[0047] The inspection apparatus 10 of the present invention can be used to perform substrate processing processes. In the present invention, a substrate, as a plate and container for mounting semiconductor chips and other devices, refers to an object suitable for device mounting. The substrate can be used for integrated circuit fabrication and can be made of materials such as silicon. For example, the substrate can be a printed circuit board (PCB), and according to an embodiment, it can be called a wafer, etc. In one embodiment of the present invention, the substrate can be an electroless nickel-gold (ENIG) or electroless palladium-gold (EPIG) substrate. ENIG or EPIG substrates can achieve uniform melting and bonding to the solder-plated metal. In one embodiment of the present invention, the substrate can be a substrate treated with OSP (Organic Solderability Preservative). OSP-treated substrates can minimize flux diffusion due to surface tension and protect the pad surface from external air and moisture.

[0048] The substrate processing process of the present invention may include one or more processes of coating an object onto a substrate. The object may be an adhesive material. As an example, the object may be flux. As an adhesive material with adhesive properties, flux can fix a component with applied solder to a target position on the substrate before the component is fully bonded to the substrate by solder, according to the reflow process. The flux may be a transparent body (transparent substance) with light-transmitting properties. In the present invention, "transparent body (or transparent substance)" may mean a substance that allows all (i.e., 100%) of the irradiated light to pass through, or a substance that allows at least a portion of the irradiated light to pass through. When the object is flux, the substrate processing process of the present invention may include a process of coating flux onto the substrate and a process of mounting a component with applied solder (e.g., a component with solder applied underneath) onto a solder pad coated with flux. Then, through a reflow process, the component can finally be bonded to the substrate. As another example, the object may be solder. In this case, the substrate processing process may include a process of printing solder onto the substrate and a process of mounting a component onto the substrate with printed solder. During this process, the mounted components can be reflowed and finally bonded to the substrate.

[0049] Figure 2 This is a front view of an inspection apparatus including one or more light source groups according to an embodiment of the present invention. At least one camera 200 may be disposed substantially vertically above the substrate 20 coated with the object. As another example, at least one camera 200 may be disposed above the substrate 20 coated with the object at a predetermined angle.

[0050] The camera 200 captures light reflected from the substrate 20 coated with the object by one or more light source groups, thereby obtaining an image. In this invention, each light source group may include one or more light sources that irradiate light of a predetermined wavelength. In one embodiment, each light source group may be configured to irradiate light of different wavelengths. One or more light source groups may be configured to irradiate the substrate coated with the object with at least one of red, green, blue, ultraviolet, and infrared light. Specifically, one or more light source groups may include a light source group consisting of light sources that generate red light of a corresponding wavelength, a light source group consisting of light sources that generate green light of a corresponding wavelength, a light source group consisting of light sources that generate blue light of a corresponding wavelength, a light source group consisting of light sources that generate ultraviolet (UV) light of a corresponding wavelength, a light source group consisting of light sources that generate infrared (Infrared) light of a corresponding wavelength, etc. Therefore, the computing device of the inspection apparatus 10 can control each light source group included in one or more light source groups to irradiate light of a predetermined specific wavelength. In one embodiment, the light sources belonging to one light source group may also irradiate light of different wavelengths. Alternatively, each light source belonging to at least two light source groups can emit light of different wavelengths.

[0051] The following reference Figure 2 This describes a first embodiment related to the configuration of one or more light source groups of the present invention. In the first embodiment related to the configuration of one or more light source groups, the one or more light source groups may include a first light source group 310 and a second light source group 330. Referring below to... Figure 2 For ease of description, it is assumed that the first light source group 310 refers to a light source group arranged above the second light source group 330 in a direction perpendicular to the ground. Furthermore, the first light source group 310 can be interchanged with "Top Layer," and the second light source group 330 can be interchanged with "Bottom Layer." In a first embodiment related to the configuration of more than one light source group, the inspection device 10 may have multiple red light sources on the top layer. Each red light source may be arranged at equal or different intervals along the circumference of a (virtual) concentric circle. In the first embodiment, the inspection device 10 may have IR light sources, red light sources, green light sources, or blue light sources on the bottom layer. The light sources on the bottom layer may be arranged at equal or different intervals along the circumference of a virtual concentric circle located below the virtual concentric circle containing the top layer light sources. In one embodiment, multiple IR light sources may be arranged along the circumference of the corresponding (virtual) concentric circle on the bottom layer. In one embodiment, multiple red, green, or blue light sources may be arranged along the circumference of the (virtual) concentric circle corresponding to the bottom layer. The wavelengths of the aforementioned light source groups and the number of light sources included in each light source group are exemplary and can be changed according to the implementer's intention.

[0052] Figure 3This is an enlarged cross-sectional view of the portion where the inspection apparatus including one or more light source groups according to an embodiment of the present invention is arranged when cut along a direction perpendicular to the ground. In one embodiment of the present invention, the one or more light source groups can be configured to irradiate light onto a substrate coated with an object at predetermined, different incident angles.

[0053] The following reference Figure 3 This section describes a second embodiment related to the configuration of one or more light source groups of the present invention. In this second embodiment related to the configuration of one or more light source groups, the one or more light source groups may include a first light source group 310, a second light source group 331, and a third light source group 333. Referring below... Figure 3 For ease of description, it is assumed that the first light source group 310 is positioned above the second light source group 331 along a direction perpendicular to the ground, and the second light source group 331 is positioned above the third light source group 333 along a direction perpendicular to the ground. Under this assumption, the first light source group 310 can be interchanged with the top layer, the second light source group 331 can be interchanged with the middle layer, and the third light source group 333 can be interchanged with the bottom layer. In a second embodiment related to the configuration of more than one light source group, the inspection device 10 may have multiple red light sources on the top layer, and each red light source may be arranged at equal or different intervals along the circumference of (virtual) concentric circles. In addition, the inspection device 10 may have UV (Ultra Violet) light sources, red light sources, green light sources, or blue light sources in the middle layer. Multiple UV light sources may be arranged at equal or different intervals along the circumference of (virtual) concentric circles. Multiple red, green, or blue light sources may be arranged at equal or different intervals along the circumference of (virtual) concentric circles. Additionally, the inspection device 10 may have an IR light source, a red light source, a green light source, or a blue light source at the bottom layer. Multiple IR light sources may be arranged at equal or different intervals along the circumference of (virtual) concentric circles. Multiple red, green, or blue light sources may also be arranged at equal or different intervals along the circumference of (virtual) concentric circles. Furthermore, as an example, the top layer, middle layer, and bottom layer may be positioned relative to a vertical central axis in areas inclined at 1–30 degrees, 31–50 degrees, and 51–89 degrees from the direction facing upwards, respectively.

[0054] As previously described, at least one of the more than one light source groups in this invention may have a different wavelength or illumination angle of light illuminating the object compared to the other light source groups. The wavelengths, number of light sources, and angles of each light source group are exemplary and can be changed according to the implementer's intent. Furthermore, the above references... Figures 2 to 4The embodiments described are of one or more light source groups including two and three light source groups respectively. However, it is only an exemplary description for those skilled in the art. It is obvious that one or more light source groups can include N (N is a natural number of 2 or more) light source groups as needed.

[0055] Figure 4 This is an exemplary bottom view of the inspection apparatus according to an embodiment of the present invention, when the inspection apparatus includes one or more light source groups, including three light source groups, viewed from below. In one embodiment of the present invention, one or more light source groups may each include multiple light sources arranged on virtual concentric circles parallel to the substrate coated with the object. For example, as... Figure 4 As shown, the multiple light sources included in each of the first light source group 310, the second light source group 331, and the third light source group 333 can be arranged at equal intervals along the circumference of a virtual concentric circle parallel to the substrate coated with the object. Figure 4 Although a camera is not shown, it can be positioned vertically above the substrate coated with the object. For example, the camera can be located at the center of the first light source group 310, which is the innermost concentric circle. Alternatively, at least one camera can be positioned at a predetermined angle from vertically above the substrate coated with the object. For example, at least one camera can be located outside the first light source group 310, which is the innermost concentric circle.

[0056] Figure 5This is a block diagram of a computing device 500 according to an embodiment of the present invention. In the present invention, the computing device 500 may be a configuration included in the inspection device 10 or a configuration independent of the inspection device 10. According to an embodiment of the present invention, the computing device 500 may include one or more processors 510 and / or one or more memories 520 as constituent elements. In one embodiment, at least one of these constituent elements of the computing device 500 may be omitted, or other constituent elements may be added to the computing device 500. In one embodiment, some constituent elements may be added to or alternatively integrated, or embodied as a single or multiple individuals. In the present invention, one or more processors 510 may be referred to as processor 510. The term "processor 510" can refer to a collection of one or more processors unless the context explicitly states otherwise. In the present invention, one or more memories 520 may be referred to as memory 520. The term "memory 520" can refer to a collection of one or more memories unless the context explicitly states otherwise. At least some of the internal and external components of the computing device 500 can be interconnected via buses, GPIO (general purpose input / output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface) to send and receive data and / or signals.

[0057] In one embodiment of the present invention, the processor 510 can drive software (e.g., instructions, programs, etc.) to control at least one component of the computing device 500 and the inspection device 10 connected to the processor 110. For example, the processor 510 can drive software (e.g., instructions, programs, etc.) to control one or more light source groups, cameras, or one or more memories connected to the processor 510. Furthermore, the processor 510 can perform various operations related to the present invention, such as calculations, processing, data generation, and manipulation. Additionally, the processor 510 can load or store data from or in the memory 520. In the present invention, unless otherwise stated in the context, the components of the inspection device 10 are controlled by the processor 510.

[0058] The memory 520 of one embodiment of the present invention can store various types of data. The data stored in the memory 520, as data obtained, processed, or used by means of at least one component of the computing device 500, may include software (e.g., instructions, programs, etc.). The memory 520 may include volatile and / or non-volatile memory. In the present invention, instructions and even programs, as software stored in the memory 520, may include an operating system for controlling the resources of the computing device 500, application programs, and / or middleware that provides various functions to the application programs so that the application programs can utilize the resources of the computing device 500. In one embodiment, the memory 520 may store instructions that, when executed by means of a processor 510, cause the processor 510 to perform operations.

[0059] In one embodiment of the present invention, the memory 520 can pre-obtain and store one or more first images.

[0060] The first images can be images obtained by capturing light reflected from a substrate of the uncoated object by a camera included in the inspection apparatus 10, which is irradiated by one or more light sources included in the inspection apparatus 10. Alternatively, the first images can be images of areas including metal portions (solder pads) within the substrate to be coated with flux. Furthermore, the first images can be images converted from RGB (RED GREEN BLUE) to HIS (Hue Saturation Intensity) values. Additionally, the first images can be grayscale images. In this invention, a grayscale image refers to an image where each pixel has a value representing the brightness of the corresponding pixel (i.e., a grayscale value).

[0061] To obtain more than one first image, the inspection device 10, including more than one light source group, a camera, and more than one memory 520, can be controlled by more than one processor 510. The multiple first images included in the more than one first image can be images obtained based on light irradiated from one or more light source groups.

[0062] In one embodiment of the present invention, the computing device 500 may further include a communication circuit 530. The communication circuit 530 can perform wireless or wired communication between the computing device 500 and a server or between the computing device 500 and other devices. For example, the communication circuit 530 can perform wireless communication based on eMBB (enhanced Mobile Broadband), URLLC (Ultra Reliable Low-Latency Communications), MMTC (Massive Machine Type Communications), LTE (Long-Term Evolution), LTE-A (LTE Advance), NR (New Radio), UMTS (Universal Mobile Telecommunications System), GSM (Global System for Mobile Communications), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), WiBro (Wireless Broadband), WiFi (Wireless Fidelity), Bluetooth, NFC (Near Field Communication), GPS (Global Positioning System), or GNSS (Global Navigation Satellite System). For example, the communication circuit 530 can perform wired communication based on USB (universal serial bus), HDMI (high definition multimedia interface), RS-232 (recommended standard 232), or POTS (plain old telephone service). In one embodiment, when the computing device 500 is a device independent of the inspection device 10, the computing device 500 can communicate with the inspection device 10 through the communication circuit 530.

[0063] The computing device 500 of various embodiments of the present invention can be a device of various forms. For example, the computing device can be a portable communication device, a portable multimedia device, a wearable device, a home appliance device, or a combination of one or more of the above devices. The computing device of the present invention is not limited to the aforementioned devices, and can be a device embedded in the inspection device 10, or a device that integrates and controls multiple inspection devices 10 or integrates and controls inspection devices and production devices according to a production line.

[0064] Figure 6 This is an exemplary top view of a substrate 610A without an object coating and a substrate 610B coated with an object coating, according to an embodiment of the present invention. The substrate 610A without an object coating may include one or more metal portions 630. A metal portion 630 may refer to a portion formed on the surface of the substrate, for example, by a metal material such as copper. The substrate 610B coated with an object coating may include one or more metal portions 630. The substrate 610B coated with an object coating may include an object 650 coated on or around one or more metal portions 630. The substrate processing process of the present invention may include a process for determining the coating state of the object 650. In the present invention, the process for determining the coating state of the object 650 may, for example, include a process for confirming the coating state of flux applied to the substrate. The coating state can be numerically determined based on the degree of consistency between a predetermined target coating area before coating the object on the substrate and the area where the object 650 is actually coated on the substrate. The intended coating area can be, for example, a (virtual) area located a predetermined distance away from the boundary line of one or more metal parts 630 along their circumference. The intended coating area is compared with the area where the object is actually coated. Based on the result, when there is no complete discrepancy, the coating state can be determined as "0"; when only a portion is consistent, a value between "0" and "1" is determined based on the consistency ratio; when completely consistent, it is determined as "1"; and when the actual coated area is large, a value greater than "1" is determined, etc. Alternatively, the coating state can be determined based on a percentage of the target coating area. For those skilled in the art, examples such as numerical ranges used as the basis for determining the above-mentioned coating state are merely examples for description, and it is obvious that various methods can be used to determine the coating state based on the comparison results between the desired coating area and the actual coated area.

[0065] In this invention, "first image" can refer to an image of a substrate of an uncoated object. As needed, "first image" can be used interchangeably with the term "image 1-A". "Image 1-A" can refer to a first image obtained based on the Ath light source group in the first image. As an example, suppose a first image is obtained by a camera capturing reflected light from a substrate after it is illuminated by a light source included in the first light source group. In this case, the first image can be referred to as image 1-1. As another example, suppose a first image is obtained by a camera capturing reflected light from a substrate after it is illuminated by a light source included in a second light source group. In this case, the first image can be referred to as image 1-2.

[0066] In this invention, "second image" can refer to an image of a substrate coated with an object. Additionally, "second image" can be used interchangeably with "image 2-B," which can refer to a second image obtained based on the Bth light source group in the second image. As an example, suppose a second image is obtained by a camera capturing reflected light from a light source included in the first light source group after it illuminates the substrate. In this case, the second image can be called image 2-1. As another example, suppose a second image is obtained by a camera capturing reflected light from a light source included in the second light source group after it illuminates the substrate. In this case, the second image can be called image 2-2. Furthermore, in this invention, the first image and the second image can also be simply referred to as "image" depending on the context.

[0067] The following describes a first embodiment of the present invention for determining the coating state of an object. The inspection apparatus 10 can determine the coating state of the object based on the amount of brightness change between an image before and after coating the object onto the substrate. Specifically, one or more processors included in the inspection apparatus 10 can control a first light source group and a camera in one or more light source groups to illuminate the substrate coated with the object to obtain a second image (i.e., image 2-1), and determine the coating state of the object based on the amount of brightness change between the first image (i.e., image 1-1) obtained by the first light source group and image 2-1 in one or more first images stored in the memory 520. For example, the inspection apparatus 10 can illuminate the substrate with light by the first light source group and obtain an image (image 1-1) by a camera before coating the object onto the substrate. Alternatively, the inspection apparatus 10 can illuminate the substrate with light by the first light source group and obtain a second image (image 2-1) by a camera after coating the object onto the substrate. The inspection apparatus 10 can sense the brightness changes of the images 1-1 and 2-1 obtained before and after coating the object onto the substrate, respectively, to determine the coating state of the object.

[0068] At this time, each of the above second images can be an image of a region including a metal portion (solder pad) within a substrate coated with flux. Additionally, each of the above second images can be an image converted from RGB to HSI values. Furthermore, each of the above second images can be a grayscale image.

[0069] In one embodiment of the present invention, when the first image and the second image obtained before and after coating the object onto the substrate are grayscale images, respectively, the brightness change between the two images can be confirmed by the difference in grayscale values ​​of each pixel. When using grayscale images to inspect the coating state of the object, the first image and the second image can be sequentially selected from the image pairs with the largest difference in grayscale values, starting with the pair with the largest difference. Specifically, the processor 510 can calculate the difference in grayscale values ​​for each matching "first image-second image" pair among the plurality of first images and the plurality of second images, and sequentially select a predetermined number of image pairs starting from the pair with the largest difference, wherein the plurality of first images are obtained for the substrate without the object coated, and the plurality of second images are obtained for the substrate with the object coated. As a grayscale difference value, for example, contrast can be used. As an example, when setting inspection conditions for the inspection apparatus 10, it can be set to determine the inspection object image pairs according to the order of the largest grayscale difference between the first image and the second image (e.g., at least 3 image pairs).

[0070] Typically, when the object is flux, the boundaries are unclear to the naked eye because flux is essentially transparent, and furthermore, it cannot be accurately represented due to the reflective properties of the solder pads. Moreover, as shown in ENIG, EPIG, and OSP substrates, the measured flux coating state varies depending on the substrate's coating quality. Conversely, as shown in this invention, when using grayscale images, the grayscale difference between two images obtained under the same conditions, aside from whether the object is coated, will differ due to the scattering rate of the object coated on the substrate. Therefore, this invention obtains images under the same illumination conditions—that is, before and after the object is coated onto the substrate—using at least one identical light source group. By comparing the two obtained images, the difference in grayscale values ​​can be calculated. Thus, this invention can more effectively determine whether the object is coated and its coating state.

[0071] If the object is a transparent material such as flux, the light reflectivity of the substrate surface will differ after the object is coated onto a predetermined area of ​​the substrate surface compared to a case where the object is not coated or the object is coated too thickly. Therefore, the inspection apparatus 10 of the first embodiment of the present invention for determining the coating state of an object can determine the coating state of the object by comparing the brightness of images obtained before and after the object is coated onto the substrate. As an example, if the brightness change at the same location is greater than or equal to a predetermined threshold before and after the object is coated onto the substrate surface, the physical properties related to light reflection at that location will change by a predetermined level or more when the object is coated onto that location. Conversely, if the brightness change at the same location is less than the predetermined threshold before and after the object is coated onto the substrate surface, the physical properties related to light reflection will not change by a predetermined level or more because the object is not well coated at that location. Therefore, the inspection apparatus 10 can compare the brightness change of each area with the predetermined threshold to determine whether the object is well coated in the corresponding area. As another example, the inspection device 10 can also compare the average brightness of the entire area of ​​the substrate surface before coating the object with the average brightness of the entire area of ​​the substrate surface after coating the object, calculate the change in the average brightness, and compare the change in the average brightness with a predetermined threshold value to determine whether the object is well coated on the entire substrate surface. In the first embodiment described above, for convenience, a first light source group is used as an example. However, it will be apparent to those skilled in the art that the type of light source group is not limited to the present invention. The inspection device of the present invention can also use at least one of more than one light source group to obtain images of the object before and after coating the substrate under the same light conditions.

[0072] The following describes a second embodiment of the present invention for determining the coating state of an object. The inspection apparatus 10 can determine the coating state of the object based on the change in brightness difference calculated from different light source groups before and after coating the object onto a substrate. Specifically, the inspection apparatus 10 includes one or more processors 510 that can determine a first brightness difference between a first image obtained by a first light source group (i.e., image 1-1) and a first image obtained by a second light source group (i.e., image 1-2) stored in a memory. The one or more processors 510 can obtain a second image (i.e., image 2-1) by controlling the first light source group and the camera in one or more light source groups, and obtain another second image (i.e., image 2-2) by controlling the second light source group and the camera in one or more light source groups. The one or more processors 510 can determine a second brightness difference between the obtained image 2-1 and image 2-2. Then, the one or more processors 510 can determine the coating state of the object based on the change in brightness difference between the first and second brightness differences. For example, one or more processors 510 can obtain a first-1 image obtained by a camera after the object is illuminated by light from a first light source group and reflected by light from a second light source group before the object is coated onto the substrate, and a first-2 image obtained by a camera after the object is illuminated by light from a second light source group. Alternatively, the first-1 image and the first-2 image can be pre-stored in the memory 520 of the inspection device 10. Furthermore, one or more processors 510 can determine a first brightness difference as the brightness difference between the first-1 image and the first-2 image. The brightness difference between the two images can be calculated on a predetermined area or per pixel. For example, when the brightness difference between the two images is calculated per pixel, a new image displaying the brightness difference can be calculated, in which each pixel of the new image may have the difference in brightness value of pixels at the same position in the first-1 image and the first-2 image. Alternatively, when the brightness difference between the two images is calculated per unit of the image, the brightness difference can also be a constant, which can be the difference between the average brightness value of the first-1 image and the average brightness value of the first-2 image. Therefore, the inspection device can determine the brightness difference (first brightness difference) between two images obtained from different light source groups (first light source group and second light source group) before the object is coated onto the substrate. One or more processors 510 can determine a second brightness difference, which is the brightness difference between image 2-1 and image 2-2. The process by which one or more processors 510 determines the second brightness difference is similar to the method for determining the first brightness difference, except that the image to be determined is an image of the substrate coated with the object, and therefore will not be described again. One or more processors 510 can determine the coating state of the object by calculating the change between the first brightness difference and the second brightness difference.

[0073] When an object such as flux is coated onto a predetermined area on the surface of a substrate, the angle of reflection of incident light changes before and after coating due to factors such as the presence or absence of the coated object or the angle between the object's surface and the substrate plane. As a result, the brightness difference of light illuminating the object from light sources with different incident angles and reflected to the camera differs before and after coating. Therefore, the inspection apparatus 10 of the second embodiment of the present invention for determining the coating state of an object can determine the coating state of the object based on the change in brightness difference between images from different light source groups before and after the object is coated onto the substrate. As an example, the first brightness difference (the brightness difference between image 1-1 and image 1-2) and the second brightness difference (the brightness difference between image 2-1 and image 2-2) can be calculated from the difference in brightness values ​​of pixels at the same position within each two images. In other words, the first brightness difference and the second brightness difference can be the average of the differences in brightness values ​​of pixels corresponding to the same position within two images comprising multiple pixels. The inspection device 10 can calculate the first brightness difference or the second brightness difference by averaging the brightness difference values ​​of corresponding pixels at the same position in two images, pixel by pixel. As another example, the first brightness difference (the brightness difference between image 1-1 and image 1-2) and the second brightness difference (the brightness difference between image 2-1 and image 2-2) can also be calculated from the difference in the average brightness values ​​of each pair of images. In other words, the first brightness difference and the second brightness difference can be the difference in the average brightness values ​​of the two images as their basis.

[0074] In a second embodiment of the present invention for determining the coating state of an object, the inspection device 10 can compare the change between a first brightness difference and a second brightness difference with a predetermined reference value to determine the coating state of the object. For example, assuming the predetermined reference value is 30, when the brightness difference changes to or above the predetermined reference value, the inspection device 10 determines that the coating state of the object is good. In this case, if the change in brightness difference calculated by the inspection device 10 before and after coating the object is 40 (>30), the inspection device 10 can determine that the object is well coated on the substrate to a degree that meets the predetermined reference. Conversely, if the change in brightness difference before and after coating the object is 20 (<30), the inspection device 10 can determine that the object is poorly coated on the substrate. In the aforementioned second embodiment for determining the coating state of an object, the methods for calculating the brightness difference or examples of predetermined reference values ​​are merely exemplary descriptions for ease of understanding. The present invention includes various brightness difference calculation methods and methods for setting predetermined reference values. Furthermore, it is obvious to those skilled in the art that multiple predetermined reference values ​​can be configured depending on the type of coating state to be determined.

[0075] According to the second embodiment of the present invention for determining the coating state of an object, the detection performance is increased even when the object is coated on a substrate treated with OSP (Organic Solderability Preservative). Typically, substrates treated with OSP may experience color changes due to various factors such as heat treatment during substrate processing. In such cases, it may be difficult to determine the coating state of the object solely based on the change in brightness before and after coating using the same light source group. However, as shown in the present invention, multiple light source groups are configured to illuminate the substrate coated with the object at different incident angles. Using such multiple light source groups to determine the coating state of the object based on the change in brightness difference before and after coating greatly improves accuracy.

[0076] An inspection apparatus 10 according to an embodiment of the present invention can detect the boundary surface of an object coated on a substrate and determine the coating state of the object based on the boundary surface. One or more processors 510 can detect the boundary surface of the object based on a second image. In the present invention, each of the more than one light source group can form a different incident angle with the vertical axis of the substrate plane. Therefore, when light irradiated from the light source group is reflected or refracted at the boundary surface of the object and reaches the camera, the originating light source group of the arriving light will be different depending on the inclination of the boundary surface. (Refer to below...) Figure 7 Provide a detailed description.

[0077] Figure 7 This is a conceptual diagram illustrating the path of light irradiated from one or more light source groups according to an embodiment of the present invention, which travels from a substrate coated with an object to a camera via reflection or refraction. Figure 7 Three light source groups are shown as an example, but more than one light source group can include one, two, or more than three light source groups. Figure 7 In this system, one or more light source groups may include a first light source group 310, a second light source group 331, and a third light source group 333. A metal portion 730 may be disposed on the substrate 710. The top surface and periphery of the metal portion 730 on the substrate 710 may be coated with an object 750. At this time, the incident angle formed by the light incident from each light source group onto the substrate 710 and the vertical axis of the substrate 710 increases in the order of the first light source group 310, the second light source group 331, and the third light source group 333. Since the incident angles of the light formed by the first light source group 310 to the third light source group 333 and the vertical axis of the substrate plane are different, the specific areas of the object 750 that can be illuminated and supplied with light to the camera will be different. In other words, because the incident angles of the first light source group 310 to the third light source group 333 are different, the specific areas of the object that can be detected by the camera along the light movement path will be different.

[0078] The inspection device 10 of the present invention can obtain one or more tilted regions with a predetermined tilt angle, including the boundary surface of the object 750, based on the incident angle of each of the more than one light source group. The processor 510 can perform calculations to calculate the tilt angle within a predetermined unit region within the boundary surface of the object 750 included in the second image. The processor 510 can divide the boundary surface of the object 750 included in the second image into a grid pattern of arbitrary size to calculate one or more unit regions. The processor 510 can identify the light source group illuminating the corresponding light based on the amount of light included in each unit region, the wavelength of light, etc. The processor 510 can determine, in the second image obtained by the camera 200, which light source group among the multiple light source groups illuminates the light reaching the unit region using the amount of light included in the unit region at a specific location and the wavelength of light. Referring below... Figure 7 The following description is provided. As an example, when the first light source group 310 illuminates the substrate with red light, the processor 510 can detect the portion containing red light in the second image (i.e., image 2-1). The processor 510 can determine the area marked in red within image 2-1 as the region on the boundary surface of the object 750 where light from the first light source group 310 is reflected to the camera 200. At this time, the region on the boundary surface of the object 750 where light from the first light source group 310 is reflected to the camera 200 can be a region with a predetermined tilt range. Furthermore, the tilt of the region on the boundary surface of the object 750 where light from the first light source group 310 is reflected to the camera can be smaller than that of the region where light from the second light source group 331 or the third light source group 333 is reflected to the camera. As another example, when the third light source group 333 illuminates the substrate with blue light, the processor 510 can detect the portion containing blue light in the second image (i.e., image 2-3). The processor 510 can identify the blue-marked areas within the second and third images as regions on the boundary surface of the object 750 where light from the third light source group 333 is reflected to the camera 200. In this case, the region on the boundary surface of the object 750 where light from the third light source group 333 is reflected to the camera can have a predetermined tilt range. Furthermore, the tilt of the region on the boundary surface of the object 750 where light from the third light source group 333 is reflected to the camera 200 can be greater than that of the region where light from the first light source group 310 or the second light source group 331 is reflected to the camera. Therefore, based on the above calculations, the processor 510 can calculate the tilt of each unit region within the boundary surface, thereby obtaining one or more tilted regions within the boundary surface of the object 750 that include more than one unit region and have a predetermined tilt range.

[0079] In one embodiment of the present invention, the processor 510 can control the first light source group 310 to illuminate the boundary surface of the object 750. The illuminated light is reflected or refracted at the boundary surface of the object 750, and the camera 200 can capture the reflected or refracted light to obtain a second image (i.e., the second-1 image). At this time, due to the relative positional relationship between the first light source group 310, the camera 200, and the object 750, only the light reflected or refracted by the first light source group 310 in the area with a relatively small tilt range in the boundary surface of the object 750 (hereinafter referred to as the "first tilt area") can reach the camera 200. The tilt range characterizing the first tilt area can be preset according to the implementer's intention. For example, the first tilt area can be a region in the boundary surface of the object 750 with a tilt angle of 0° or more and 10° or less relative to the substrate.

[0080] Additionally, the processor 510 can control the second light source group 331 and the camera 200, causing the second light source group 331 to illuminate the boundary surface of the object 750. The illuminated light is reflected or refracted at the boundary surface of the object 750, and the camera 200 can capture the reflected or refracted light to obtain a second image (i.e., image 2-2). At this time, due to the relative positional relationship between the second light source group 331, the camera 200, and the object 750, only light reflected or refracted from the region (hereinafter referred to as the "second tilt region") with a relatively moderate degree of tilt in the boundary surface of the object 750 illuminated by the second light source group 331 can reach the camera 200. The tilt range characterizing the second tilt region can be preset according to the implementer's intention. For example, the second tilt region can be a tilt region in the boundary surface of the object 750 with a tilt angle greater than 10° and less than or equal to 30° relative to the substrate.

[0081] Additionally, the processor 510 can control the third light source group 333 and the camera 200, causing the third light source group 333 to illuminate the boundary surface of the object 750. The illuminated light is reflected or refracted at the boundary surface of the object 750, and the camera 200 can capture the reflected or refracted light to obtain a second image (i.e., the second-third image). At this time, due to the relative positional relationship between the third light source group 333, the camera 200, and the object 750, only the light reflected or refracted from the region with a relatively large tilt range (hereinafter referred to as the "third tilt region") in the boundary surface of the object 750 illuminated by the third light source group 333 can reach the camera 200. The tilt range characterizing the third tilt region can be preset according to the implementer's intention. For example, the third tilt region can be a tilt region in the boundary surface of the object 750 with a tilt angle greater than 30° and less than or equal to 90° relative to the substrate.

[0082] In a third embodiment of the invention for determining the coating state of an object, the inspection device 10 can detect a tilted region on the boundary surface of the object based on a second image obtained, and determine the coating state of the object 750 based on the detected tilted region. For convenience, the following description is based on a first tilted region. Within the boundary surface of the object 750, the first tilted region can substantially have the same or similar tilt as the substrate surface. In the first tilted region, the closer the incident angle of the light irradiated by the light source group is to being perpendicular to the substrate surface (i.e., closer to 0 with respect to the vertical axis of the substrate plane), the more light can be reflected to the camera. Therefore, the more an image (e.g., image 2-1) is obtained from a light source group that irradiates light nearly perpendicular to the substrate surface (e.g., first light source group 310), the higher the relative amount of light in the first tilted region. Conversely, the more an image (e.g., image 2-3) is obtained from a light source group that irradiates light nearly horizontally relative to the substrate surface (e.g., third light source group 333), the lower the relative amount of light in the first tilted region. The processor 510 can determine a first tilted region (i.e., a region with a relatively gentle tilt) in the boundary surface of the object 750 based on the changes in light intensity in the acquired second image (images 2-1 to 2-3). Thus, the processor 510 can obtain information indicating the boundary surface of the first tilted region (hereinafter referred to as "boundary surface information").

[0083] If the object 750 is coated on the metal portion 730 of the substrate, it will unfold according to the shape of the metal portion 730. At this time, the slope of the object covering the metal portion 730 will be relatively gentle. Therefore, the region with a gentle slope (e.g., the first slope region) determined by the above method can be equivalent to the region of the object covering the metal portion 730. By comparing the boundary of the determined region with the area of ​​the metal portion 730, it can be determined whether the object sufficiently covers the metal portion 730.

[0084] Specifically, processor 510 can obtain information about the metal part 730. This information may indicate the area, position, shape, etc., of the metal part 730. Based on the previously obtained boundary information of the first inclined region and the information about the metal part 730, processor 510 can determine whether the object 750 to be coated includes the metal part 730. Specifically, processor 510 can calculate one or more finite planes formed based on the boundary information of the first inclined region in the obtained image, and determine whether the metal part 730 is included within the corresponding finite plane. Processor 510 can determine one or more closed curves from the boundary information of the first inclined region. Processor 510 can calculate finite planes based on the determined closed curves. For example, processor 510 can determine the outermost outermost edge of the boundary surface included in the boundary information of the first inclined region as a closed curve. Processor 510 can calculate the region inside the closed curve determined based on the outermost edge as a finite plane. Processor 510 can determine whether the metal part 730 is included within the finite plane calculated based on the outermost edge. Furthermore, the processor 510 can determine the innermost edge of the boundary surface included in the boundary surface information of the first inclined region as a closed curve. The processor 510 can calculate the region inside the closed curve determined based on the innermost edge as a finite plane. The processor 510 can determine whether the metal part 730 is contained within the finite plane calculated based on the innermost edge.

[0085] The processor 510 can determine the coating state based on whether the object to be coated 750 includes metal portions 730. As an example, when the substrate includes more than one metal portion 730 of the object to be coated, the processor 510 can determine the coating state based on the number of metal portions 730 included in the object to be coated 750. That is, for example, if there are 100 metal portions 730 to be coated, the processor 510 assigns different result values ​​for cases where the number of metal portions 730 included in the object to be coated 750 is 90 or more, 80 or more, 50 or more, etc., thereby determining the coating state.

[0086] In a fourth embodiment of the present invention for determining the coating state of an object, the inspection device 10 can detect multiple tilted regions in the boundary surface of the object based on a obtained second image, and determine the coating state of the object based on the detected multiple tilted regions. The inspection device 10 can irradiate a substrate 710 coated with the object 750 with multiple lights having different incident angles to obtain a second image, and detect multiple tilted regions from the boundary surface of the object 750 included in the second image, thereby determining the coating state of the object. In the fourth embodiment for determining the coating state of the object, in order to obtain the second image, the inspection device 10 can control a first light source group and a second light source group included in one or more light source groups to irradiate light onto the substrate, and control a camera to obtain the second image. At this time, the first light source group and the second light source group can be configured to irradiate light of different wavelengths onto the substrate coated with the object at different incident angles. For ease of explanation, refer to... Figure 7Assuming reference numeral 310 represents the first light source group and reference numeral 331 represents the second light source group. That is, assuming that, with the vertical axis of the substrate plane as a reference, the incident angle of the light irradiated by the first light source group is greater than the incident angle of the light irradiated by the second light source group. Furthermore, assuming that the first light source group irradiates red light and the second light source group irradiates blue light. The incident angle, position, or wavelength of the irradiated light of each light source group are merely illustrative examples and do not limit the invention. Under this assumption, the object 750 coated on the substrate can be a viscous fluid with a slope that becomes gentler the further away from the boundary of the metal part 730, and can be spread on the substrate 710. In this case, the area defined by a line formed by multiple points at a predetermined first reference distance from the center of each individual metal part 730 (i.e., the first reference distance area) within the boundary surface of the object 750 coated on the substrate can reflect light irradiated from the first light source group 310 toward the camera 200 and be displayed as red in the second image. Furthermore, the area defined by a line formed by multiple points at a preset second reference distance from the center of each metal part 730 on the boundary surface of the object 750 coated on the substrate (i.e., the second reference distance area), which is also the exterior of the first reference distance area, can reflect light irradiated from the second light source group 331 toward the camera 200 and be displayed as blue in the second image. The first reference distance can be preset to a value smaller than the second reference distance. The color difference between the regions in the second image may be due to the different inclinations of the boundary surfaces of objects within the first reference distance from the center of the metal part 730 and objects within the second reference distance but above the first reference distance. Therefore, when the object 750 is coated on the substrate to form a metal part 730 including the substrate 710, the processor 510 can display the interior of the first reference distance area (calculated based on the center of the metal part 730 and the first reference distance) as blue in the obtained second image, and display the exterior of the first reference distance area and the interior of the second reference distance area (calculated based on the center of the metal part 730 and the second reference distance) as red. According to the above embodiments, the inspection apparatus 10 of the present invention can not only detect the boundary surface of the object 750 using a single light source group, but also confirm the tilt change of the boundary surface of the object 750 using multiple light source groups, thereby more accurately determining the coating state. For example, under the same assumptions as above, when the object 750 is normally coated on the metal part 730, in the second image, the edge color of the object 750 should change from blue to red as it moves further away from the center of the metal part 730. Conversely, if the boundary surface of the object 750 is detected, but the edge color of the object 750 changes in the opposite direction or does not change as it moves further away from the center of the metal part 730, the coating state may be poor.As described above, the inspection device 10 of the present invention can calculate whether the inclination of the object's boundary surface decreases as it moves further away from the metal part based on the physical properties of the object being coated (e.g., viscosity, surface tension, etc.), thereby determining whether the object includes the metal part, thus having the effect of determining the coating state of the object.

[0087] The description of the fourth embodiment above is an exemplary account for illustrative purposes and does not limit the invention. The invention can include various embodiments for detecting multiple tilted regions in the boundary surface of an object and determining the coating state of the object based on the detected multiple tilted regions. For example, the value used as the basis for determining the predetermined reference distance region can be the edge of the metal part rather than the center of the metal part. In this case, even if the metal part has a non-circular shape, the predetermined reference distance region can be determined. In addition, two or more reference distances measured from the center of the metal part can be freely set, in which case the tilt change of the object's boundary surface can be measured more precisely.

[0088] In one embodiment of the present invention, the wavelength types of light possessed by one or more light source groups, or the wavelength composition and combination of light from multiple light source groups, can be determined based on predetermined experimental results. For example, the wavelength types of light possessed by one or more light source groups, or the wavelength composition and combination of light from multiple light source groups, can be determined such that the "contrast" of values ​​between two images obtained before and after the object is coated onto the substrate increases. The image can be either an original image captured by a camera, or a composite image generated from at least one original image captured by a camera. The composite image can be obtained, for example, through operations such as transforming from an RGB coordinate system to a HIS coordinate system, transforming a single-scale image to a multi-scale image, scaling operations that adjust the range of values, operations that adjust the value size, or arithmetic operations using two or more images as input.

[0089] Figure 8This is a flowchart illustrating the operation of an inspection apparatus according to an embodiment of the present invention. The inspection apparatus 10 of an embodiment of the present invention can obtain one or more first images stored in one or more memories in step S810. Each of the one or more first images can be obtained by capturing light reflected from a substrate without an object coating by a camera, which is then illuminated by one or more light source groups. Each of the one or more light source groups can be configured to illuminate the substrate coated with the object at predetermined, different incident angles. Each of the one or more light source groups can include multiple light sources arranged on virtual concentric circles parallel to the substrate coated with the object. Each of the one or more light source groups can illuminate the substrate coated with the object with at least one of red light, green light, blue light, ultraviolet light, and infrared light. The camera used to acquire the image can be positioned vertically above the substrate coated with the object.

[0090] In one embodiment of the present invention, the inspection apparatus 10 can, in step S820, illuminate a substrate coated with an object by controlling a first light source group from one or more light source groups. The object may include an adhesive material, such as solder flux. In step S830, the inspection apparatus 10 can capture the light reflected from the substrate coated with the object by controlling a camera to obtain a second image. In step S840, the inspection apparatus 10 can determine the coating state of the object based on one or more first images and second images. In one embodiment, the inspection apparatus 10 can determine the coating state of the object based on the amount of brightness change between the first image and the second image obtained by the first light source group from one or more first images.

[0091] Figure 9 This is a flowchart illustrating the operation of an inspection device according to an embodiment of the present invention. In step S910, the inspection device 10 of an embodiment of the present invention can obtain one or more first images stored in one or more memories. Figure 9 Step S910 can be with Figure 8 Step S810 is performed in the same or similar manner, and will not be repeated below. In step S920, the inspection device 10 can control a first light source group and a camera in one or more light source groups to illuminate the substrate coated with the object and obtain image 2-1. The second light source group can be a group of light sources that illuminates the substrate with light of a different wavelength than the first light source group at different incident angles. In step S930, the inspection device 10 can control a second light source group and a camera in one or more light source groups to illuminate the substrate coated with the object and obtain image 2-2.

[0092] In one embodiment of the present invention, the inspection device 10 can determine, in step S940, a first brightness difference between a first image ("image 1-1") obtained by a first light source group and a first image ("image 1-2") obtained by a second light source group. Images 1-1 and 1-2 can be pre-stored in one or more memories. In step S950, the inspection device 10 can determine a second brightness difference between an image 2-1 obtained by the first light source group and an image 2-2 obtained by the second light source group. The brightness difference between the two images can be calculated based on a predetermined area or individual pixels. In step S960, the inspection device 10 can determine the coating state of the object based on the amount of change between the determined first and second brightness differences. As an example, the inspection device 10 can compare the amount of change between the first and second brightness differences with a predetermined reference value to determine the coating state of the object.

[0093] In the flowcharts shown in this invention, the steps of the method or algorithm of this invention are described sequentially. However, in addition to being performed sequentially, the steps may also be performed in any order that can be combined by this invention. The description based on these flowcharts does not exclude the possibility of making changes or modifications to the method or algorithm, and does not mean that any step is necessary or preferred. In one embodiment, at least some steps may be performed in parallel, repeatedly, or exploratoryly. In one embodiment, at least some steps may be omitted, or other steps may be added.

[0094] Various embodiments of the present invention can be embodied in software on a machine-readable storage medium. The software can be software used to embody various embodiments of the present invention. The software can be deduced by a programmer skilled in the art from the various embodiments of the present invention. For example, the software can be a program including machine-readable instructions (e.g., code or code segments). The machine, as a device capable of operating according to instructions read from the storage medium, can be, for example, a computer. In one embodiment, the machine can be a computing device 100 according to an embodiment of the present invention. In one embodiment, the processor of the machine can execute the read instructions, and the components of the machine can perform functions corresponding to the respective instructions. In one embodiment, the processor can be a processor 510 according to an embodiment of the present invention. The storage medium can mean any kind of machine-readable recording medium storing data. Storage media can include, for example, ROM (Read-Only Memory), RAM (Random Access Memory), CD-ROM (Read-Only Optical Disc Drive), magnetic tape, floppy disk, optical data storage device, etc. In one embodiment, the storage medium can be a memory 520. In one embodiment, the storage medium can also be embodied in a form distributed in a computer system or the like connected via a network. Software can be distributed, stored, and run in computer systems and other environments. Storage media can be non-transitory. Non-transitory storage media refers to tangible media that are independent of semi-permanent or temporary data storage, excluding transient signals.

[0095] The technical concept of the present invention has been described above based on various embodiments. This technical concept includes various substitutions, modifications, and alterations that can be realized within the scope of what is understood by those skilled in the art. Furthermore, such substitutions, modifications, and alterations should be understood to be included within the appended claims.

Claims

1. An apparatus for inspecting the coating status, comprising: More than one light source group; camera; One or more memories, wherein the one or more memories store one or more pre-obtained first images, wherein the one or more first images are obtained by the camera capturing light respectively illuminating the substrate of the uncoated object from the one or more light sources; and One or more processors are connected to communicate with one or more light source groups, the camera and the one or more memory; Specifically, the processor controls a first light source group in one or more light source groups and a camera to illuminate a substrate coated with an object to obtain a second image, and determines the coating state of the object based on the first image and the second image. The one or more processors, A second image is obtained by illuminating the substrate coated with the object with light through the second light source group in one or more light source groups and the camera. Determine a first brightness difference between the first image obtained by the first light source group and the first image obtained by the second light source group in the one or more first images. Determine a second brightness difference between the second image obtained from the first light source group and the second image obtained from the second light source group. The coating state of the object is determined based on the change in the first brightness difference and the second brightness difference.

2. The apparatus according to claim 1, wherein, The object includes adhesive substances.

3. The apparatus according to claim 1, wherein, The one or more light source groups are respectively configured to irradiate the substrate coated with the object with light at predetermined different incident angles.

4. The apparatus according to claim 1, wherein, Each of the one or more light source groups includes multiple light sources, which are arranged on virtual concentric circles parallel to the substrate coated with the object. The camera is positioned vertically above the substrate coated with the object.

5. The apparatus according to claim 1, wherein, The one or more light source groups respectively irradiate the substrate coated with the object with at least one selected from red light, green light, blue light, ultraviolet light and infrared light.

6. The apparatus according to claim 1, wherein, The one or more processors determine the coating state of the object based on the amount of brightness change between the first image obtained by the first light source group and the second image obtained by the first light source group in the one or more first images.

7. The apparatus according to claim 1, wherein, The one or more processors detect the boundary surface of the object based on the second image obtained from the first light source group, and determine the coating state of the object based on the boundary surface.

8. The apparatus according to claim 7, wherein, The first light source group and the second light source group irradiate the substrate coated with the object with light of different wavelengths at different incident angles.

9. A method for inspecting the coating condition, comprising: A step of one or more processors obtaining one or more first images stored in one or more memories, wherein the one or more first images are obtained by a camera capturing light that is separately illuminated from one or more light sources and reflected by a substrate of an uncoated object; The step of one or more processors irradiating light onto a substrate coated with an object by controlling a first light source group in one or more light source groups; The step of one or more processors obtaining a second image by controlling the camera to capture light reflected from the substrate coated with the object; and The step of one or more processors determining the coating state of the object based on one or more first images and second images, The step of one or more processors irradiating light onto the substrate coated with the object by controlling the second light source group in one or more light source groups and the camera to obtain a second image; The step of one or more processors determining a first brightness difference between a first image obtained by the first light source group and a first image obtained by the second light source group in one or more first images; The step of one or more processors determining a second brightness difference between a second image obtained from the first light source group and a second image obtained from the second light source group; and The step of one or more processors determining the coating state of the object based on the change in the first brightness difference and the second brightness difference.

10. The method according to claim 9, wherein, The object includes adhesive substances.

11. The method according to claim 9, wherein, The one or more light source groups are respectively configured to irradiate the substrate coated with the object with light at predetermined different incident angles.

12. The method according to claim 9, wherein, Each of the one or more light source groups includes multiple light sources, which are arranged on virtual concentric circles parallel to the substrate coated with the object. The camera is positioned vertically above the substrate coated with the object.

13. The method according to claim 9, wherein, The one or more light source groups respectively irradiate the substrate coated with the object with at least one selected from red light, green light, blue light, ultraviolet light and infrared light.

14. The method according to claim 9, wherein, Also includes: The step of one or more processors determining the coating state of the object based on the amount of brightness change between the first image obtained by the first light source group and the second image obtained by the first light source group in one or more first images.

15. The method according to claim 9, wherein, Also includes: The step of one or more processors detecting the boundary surface of the object based on the second image obtained from the first light source group; and The step of one or more processors determining the coating state of the object based on the boundary surface.

16. The method according to claim 15, wherein, The first light source group and the second light source group irradiate the substrate coated with the object with light of different wavelengths at different incident angles.

17. A computer-readable recording medium, which is a non-transitory computer-readable recording medium recording instructions for execution on a computer to check the coating state of an object coated on a substrate. The instruction is executed by more than one processor. The one or more processors obtain one or more first images stored in one or more memories, wherein... The one or more first images are obtained by capturing light reflected from a substrate of an uncoated object by a camera, which is respectively illuminated by one or more light sources. The processors control the first light source group in the one or more light source groups and the camera to irradiate light onto the substrate coated with the object to obtain a second image. The one or more processors determine the coating state of the object based on the one or more first images and the second images. The instruction is executed by more than one processor. The processor or more processors control the second light source group in the one or more light source groups and the camera to illuminate the substrate coated with the object to obtain a second image. Determine a first brightness difference between the first image obtained by the first light source group and the first image obtained by the second light source group in the one or more first images. Determine a second brightness difference between the second image obtained from the first light source group and the second image obtained from the second light source group. The coating state of the object is determined based on the change in the first brightness difference and the second brightness difference.

Citation Information

Patent Citations

  • Inspection device and coating device equipped therewith

    JP2020204487A

  • Image processing method, substrate inspection method, substrate inspection apparatus and method of generating substrate inspection data

    US20060140471A1