Device and method for inspection, and recording medium for recording instructions for inspection

By using light sources and camera systems on semiconductor substrates, the reflected light images are captured and processed, and the inclination angle of semiconductor grains is accurately measured, and the problems of poor imaging effects and inclination prediction errors in the prior art are solved, and the semiconductor crystals are realized High accuracy detection of particle inclination angle.

CN112805816BActive Publication Date: 2024-11-22KOHYOUNG TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980065992.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-10-15
Filing Date
2019-10-11
Publication Date
2024-11-22
Estimated Expiration
2039-10-11

Smart Images

  • Figure CN112805816B_ABST
    Figure CN112805816B_ABST
Patent Text Reader

Abstract

The present disclosure provides a device. According to the present disclosure, the device includes: at least one first light source, the at least one first light source irradiates illumination light to an object located on a reference plane; one or more cameras, the one or more cameras capture one or more illumination images generated by the illumination light reflected from the object; and one or more processors, the processors can determine one or more contour lines representing the edges of the object on the one or more illumination images, determine the height values ​​of the edges on the top of the object relative to the reference plane based on the one or more contour lines, and determine the first angle between the top of the object and the reference plane based on the height values.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a technique for inspection. Background Art

[0002] In the semiconductor manufacturing process, various inspections are performed to confirm whether various processes and procedures for the semiconductor are properly performed. For example, an inspection may be performed to check whether a component such as a die disposed on a semiconductor substrate is located where it should be placed on the semiconductor substrate.

[0003] In particular, for a die mounted on a semiconductor substrate, an inspection can be performed to confirm whether there is a tilt between the mounted die and the substrate. Usually, the die can be mounted on top of the solder or solder ball when the substrate is coated with solder or solder balls. At this time, the bottom of the die should be mounted in parallel with the reference plane of the semiconductor substrate, but the die can also be mounted in a form tilted at a certain angle to the semiconductor substrate due to specified factors (for example, the coating state of the solder or solder ball). Since this is a factor that may cause a semiconductor device to fail, it should be possible to confirm whether the die is tilted during the inspection of the semiconductor, and if it is tilted, it should be confirmed at what angle it is tilted.

[0004] In order to perform inspection for such tilt, a three-dimensional inspector that irradiates three-dimensional illumination on the semiconductor crystal grain can be used. However, it is difficult to obtain the three-dimensional shape of the crystal grain to be inspected in this way. This is because, generally, the upper surface of the semiconductor crystal grain is composed of a reflector, and the irradiated three-dimensional illumination may cause total reflection on the upper surface of the semiconductor crystal grain, thereby, the imaging effect of the semiconductor crystal grain may be poor.

[0005] In order to perform the above-mentioned tilt inspection, a device using white light scanning interferometry can be used. However, in this method, when the semiconductor crystal grain is tilted at a specific angle (for example, 1.2 degrees) or more relative to the reference plane, there is a problem that an image of the crystal grain is not formed.

[0006] In addition, in order to perform the above-mentioned tilt inspection, a two-dimensional area inspection can be used. When photographing a tilted quadrilateral semiconductor grain, it looks like a parallelogram according to the degree of tilt, and the two-dimensional area inspection is a method of deriving the degree of tilt from the shape of the parallelogram. However, in the case where the semiconductor grain is formed with a reflector on the top, this method still cannot obtain the correct parallelogram shape, so there is a problem that the tilt degree of the object cannot be correctly predicted. Summary of the invention

[0007] Technical issues to be solved

[0008] The present disclosure aims to solve the above-mentioned defects of the prior art and provide a technology for inspection.

[0009] Means of solving the problem

[0010] As one aspect of the present disclosure, a device for inspection can be provided. The device according to one aspect of the present disclosure includes: at least one first light source, the at least one first light source irradiates illumination light to an object body located on a reference plane; one or more cameras, the cameras capture one or more illumination images generated by the illumination light reflecting from the object body; and one or more processors, the processors can determine one or more contour lines representing the edges of the object body on the one or more illumination images, determine the height value of the edge on the top of the object body relative to the reference plane based on the one or more contour lines, and determine the first angle between the top of the object body and the reference plane based on the height value.

[0011] In one embodiment, it also includes: at least one second light source, which irradiates pattern light to the object, and the one or more cameras capture one or more pattern images generated by the pattern light reflected from the object. The processor can determine the one or more contour lines representing the corners of the object based on the one or more illumination images and the one or more pattern images, determine a virtual plane corresponding to the top of the object based on the one or more contour lines, and determine a second angle between the virtual plane and the reference plane as the first angle.

[0012] In one embodiment, the one or more cameras may include: an upper camera, which captures an illumination image or a pattern image from above the object; and one or more side cameras, which capture an illumination image or a pattern image from one or more sides of the object.

[0013] In one embodiment, a portion of the one or more illumination images and the one or more pattern images may be upper images captured by the upper camera from above the object, and another portion of the one or more illumination images and the one or more pattern images may be side images captured by the one or more side cameras from one or more sides of the object.

[0014] In one embodiment, the processor may extract a first contour line on the upper image and a second contour line on the one or more side images representing the same corner of the object, and may determine the virtual plane based on the first contour line and the second contour line.

[0015] In an embodiment, the processor may determine first relationship information indicating a corresponding relationship between the first contour line and the second contour line, and may determine the virtual plane based on the first relationship information.

[0016] In one embodiment, a first point on the first contour line may correspond to a second point on the second contour line, and the first relationship information may include a pair of coordinate information, wherein the coordinate information is the coordinate information of the first point on the upper image and the coordinate information of the second point on the one or more side images.

[0017] In one embodiment, the processor can extract, from the one or more side images, a third contour line on a side image and a fourth contour line on another side image representing the same corner of the object body, determine second relationship information indicating a corresponding relationship between the third contour line and the fourth contour line, and can determine the virtual plane based on the first relationship information and the second relationship information.

[0018] In one embodiment, the processor may select an image having a contrast value of the surface of the object greater than a preset value from among the one or more illumination images and the one or more pattern images to determine the virtual plane.

[0019] In one embodiment, the object body may have a form in which multiple layers are stacked, and the one or more contour lines may indicate corners of each of the multiple layers. The processor may determine multiple virtual planes corresponding to the multiple layers based on the one or more contour lines, and may determine the intervals between each of the multiple layers based on the multiple virtual planes corresponding to the multiple layers.

[0020] As one aspect of the present disclosure, a method for inspection can be provided. The method according to one aspect of the present disclosure can include: a step of irradiating illumination light to an object located on a reference plane by at least one first light source; a step of capturing one or more illumination images generated by the illumination light reflected from the object by one or more cameras; a step of determining one or more contour lines representing the corners of the object on the one or more illumination images by one or more processors; a step of determining the height value of the corner on the top of the object relative to the reference plane by the processor based on the one or more contour lines; and a step of determining a first angle between the top of the object and the reference plane by the processor based on the height value.

[0021] In one embodiment, the method may further include: a step of at least one second light source irradiating pattern light onto the object; a step of the one or more cameras capturing one or more pattern images generated by the pattern light reflected from the object; a step of the processor determining one or more contour lines representing corners of the object based on the one or more illumination images and the one or more pattern images; a step of the processor determining a virtual plane corresponding to the surface of the object based on the one or more contour lines; and a step of the processor determining a second angle between the virtual plane and the reference plane as the first angle.

[0022] In one embodiment, the one or more cameras may include: an upper camera, which captures an illumination image or a pattern image from above the object; and one or more side cameras, which capture an illumination image or a pattern image from one or more sides of the object.

[0023] In one embodiment, a portion of the one or more illumination images and the one or more pattern images may be upper images captured by the upper camera from above the object, and another portion of the one or more illumination images and the one or more pattern images may be side images captured by the one or more side cameras from one or more sides of the object.

[0024] In one embodiment, the step of determining the virtual plane may include: the step of extracting a first contour line on the upper image and a second contour line on the one or more side images representing the same corner of the object body; and the step of determining the virtual plane based on the first contour line and the second contour line.

[0025] In one embodiment, the step of determining the virtual plane may include: determining first relationship information indicating a corresponding relationship between the first contour line and the second contour line; and determining the virtual plane based on the first relationship information.

[0026] In one embodiment, a first point on the first contour line may correspond to a second point on the second contour line, and the first relationship information may include a pair of coordinate information, wherein the pair of coordinate information is the coordinate information of the first point on the upper image and the coordinate information of the second point on the one or more side images.

[0027] In one embodiment, the step of determining the virtual plane may also include: the step of extracting, from the one or more side images, a third contour line on a side image and a fourth contour line on another side image representing the same corner of the object body; the step of determining second relationship information indicating the correspondence between the third contour line and the fourth contour line; and the step of determining the virtual plane based on the first relationship information and the second relationship information.

[0028] In one embodiment, the step of determining the virtual plane may include: selecting an image having a contrast value of the surface of the object greater than a preset value from among the one or more illumination images and the one or more pattern images to determine the virtual plane.

[0029] According to one aspect of the present disclosure, a non-transitory computer-readable recording medium having recorded thereon a command for inspection may be provided. According to one aspect of the present disclosure, the command recorded on the recording medium, as a command for execution on a computer, when executed by one or more processors, may include an executable command for causing one or more processors to execute the following steps: a step of determining one or more contour lines representing the corners of an object located on a reference plane on one or more illumination images generated by reflection of the object from the object by illumination light irradiated to the object on the reference plane; a step of determining the height value of the corner on the top of the object relative to the reference plane based on the one or more contour lines; and a step of determining the first angle between the top of the object and the reference plane based on the height value.

[0030] Effects of the Invention

[0031] According to various embodiments of the present disclosure, when the upper surface of the object is a reflector, the tilt angle of the object can also be measured.

[0032] According to various embodiments of the present disclosure, even when the object is tilted at a specific angle (eg, 1.2 degrees) or more relative to the reference plane of the substrate, the degree of tilt can be derived.

[0033] According to various embodiments of the present disclosure, even when it is difficult to obtain a clear image of an object due to other obstructions on the substrate, the tilt angle of the object can be measured.

[0034] According to various embodiments of the present disclosure, an image can be obtained using light irradiated from various types of light sources at various angles and directions, thereby generating an accurate virtual three-dimensional model of an object. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is a diagram showing a process of operating the device according to the present disclosure.

[0036] Figure 2 is a diagram showing a block diagram of a device according to an embodiment of the present disclosure.

[0037] Figure 3 2 is a diagram illustrating a process of generating a virtual plane relative to an upper surface of an object according to an embodiment of the present disclosure.

[0038] Figure 4 FIG. 4 is a diagram illustrating image combination for obtaining diverse images and determining relationship information according to an embodiment of the present disclosure.

[0039] Figure 5 FIG. 1 is a diagram showing a configuration of one or more pattern light sources according to an embodiment of the present disclosure.

[0040] Figure 6 This is a diagram showing the arrangement of one or more illumination light sources according to an embodiment of the present disclosure.

[0041] Figure 7 is a diagram illustrating a filtering process of an image according to an embodiment of the present disclosure.

[0042] Figure 8 is a diagram illustrating a process of deriving another contour line from one contour line of an image according to an embodiment of the present disclosure.

[0043] Fig. 9 is a diagram showing an embodiment of a method for inspection that can be performed by the apparatus according to the present disclosure. DETAILED DESCRIPTION

[0044] The various embodiments described herein are presented for the purpose of clearly illustrating the technical concept of the present disclosure, rather than limiting it to a specific implementation form. The technical concept of the present disclosure includes various modifications, equivalents, alternatives, and embodiments of selective combination of all or part of the various embodiments described herein. In addition, the scope of the claims of the technical concept of the present disclosure is not limited to the various embodiments described below or the specific description of the embodiments.

[0045] The terms used herein, including technical or scientific terms, shall have the meanings generally understood by a person of ordinary skill in the art to which the present disclosure belongs unless otherwise defined.

[0046] As used herein, expressions such as "include", "may include", "have", "may have", "have", "may have" etc. mean the existence of the features (e.g., functions, actions or constituent elements) as the object, and do not exclude the existence of other additional features. That is, these expressions should be understood as open-ended terms with the possibility of including other embodiments.

[0047] As long as not mentioned differently, the singular expressions used in the present disclosure may include the plural meaning, and the same applies to the singular expressions recited in the claims.

[0048] Unless otherwise mentioned, the expressions "first", "second" or "first", "second" etc. used in this article are used to distinguish one object from other objects when describing multiple objects of the same type, and do not limit the order or importance of the objects.

[0049] As used herein, the expressions "A, B, and C", "A, B or C", "A, B and / or C", or "at least one of A, B, and C", "at least one of A, B, or C", "at least one of A, B, and / or C" may refer to each listed item or all possible combinations of the listed items. For example, "at least one of A or B" may refer to (1) at least one A, (2) at least one B, (3) at least one A and at least one B.

[0050] The expression "based on to" used in this article is used to record one or more factors that influence the determination, judgment behavior or action described in the sentence or article containing the corresponding expression, and the expression does not exclude additional factors that influence the corresponding determination, judgment behavior or action.

[0051] As used in this article, the expressions “connected” or “linked” between a certain component (e.g., the first component) and other components (e.g., the second component) not only mean that the certain component is directly connected or linked to the other components, but also may mean that it is connected or linked through a new other component (e.g., the third component).

[0052] The expression “configured to” as used herein may also have the meanings of “set to”, “having the ability to”, “changed to”, “prepared to”, “capable of”, etc., depending on the context.

[0053] In the present disclosure, the object body may mean an object located on a prescribed surface and being an object to be inspected by the device. In one embodiment, the object body may be a grain, a semiconductor element or a chip located on a semiconductor substrate. The object body may be mounted on a semiconductor substrate. As described above, the object body may be mounted in a manner that the bottom surface of the object body is inclined at a certain angle to the reference surface of the substrate.

[0054] In the present disclosure, the substrate may be a prescribed surface where the object is located. In one embodiment, the substrate may be a semiconductor substrate. The reference plane of the substrate may refer to the surface of the substrate, or may refer to a reference plane for measuring the tilt angle between the substrate and the bottom surface of the object.

[0055] Hereinafter, various embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the accompanying drawings and descriptions of the accompanying drawings, the same or substantially equivalent components may be given the same reference numerals. In addition, in the following descriptions of various embodiments, repeated descriptions of the same or corresponding components may be omitted, but this does not mean that the components are not included in the embodiments.

[0056] Figure 1 1 is a diagram showing the operation process of the device according to the present disclosure. The device 1 according to the present disclosure can measure the inclination angle θ of the object 2 relative to the reference plane (for example, substrate, etc.). The object 2 (for example, grain, etc.) can be arranged on the reference plane. Depending on the situation, the object 2 can be arranged 100 in a state of being inclined at a predetermined angle θ relative to the reference plane. The device 1 according to the present disclosure can check whether there is a defect in the setting of the object 2 by measuring (determining) the inclination angle.

[0057] Specifically, the illumination light source of the device 1 can irradiate two-dimensional illumination light to the object 2 located on the reference plane. The illumination light can be reflected from the surface of the object 2, that is, the top or one or more sides. One or more cameras 50 of the device 1 can capture one or more illumination images generated by the illumination light reflected from the object 2.

[0058] The device 1 can determine multiple contour lines representing the edges of the object 2 on one or more obtained illumination images. Each illumination image can be a two-dimensional photograph representing the object 2 or even the edges of the object 2. The edges of the object in the present disclosure can refer to the edges of the shape of the object existing in the real three-dimensional space (for example, the edges of a cube). On the one hand, the contour lines in the present disclosure can refer to the edges of the object represented in the image of the object (that is, the lines represented on the image). In the present disclosure, contour lines can also be referred to as dividing lines.

[0059] The device 1 can determine the height value of the corner of the upper surface of the object body 2 relative to the reference plane based on the determined multiple contour lines. In addition, the device 1 can determine the inclination angle θ between the upper surface of the object body 2 and the reference plane based on the height value. The height of the corner on the upper surface of the object body can represent the length of each point of the corner from the reference plane. Therefore, if the height of the corner on the upper surface of the object body is determined, the angle of the corner relative to the reference plane can be known, and thus the angle of inclination of the upper surface of the object body relative to the reference plane can be determined.

[0060] In one embodiment, in addition to the illumination light, the device 1 may also use pattern light to determine the tilt angle of the object. Specifically, the pattern light source of the device 1 may irradiate the pattern light to the object 2. The pattern light may be reflected from the surface of the object 2, that is, the top or one or more sides. One or more cameras 50 of the device 1 may capture one or more pattern images generated by the pattern light reflected from the object 2.

[0061] In this case, the device 1 can determine multiple contour lines representing the corners of the object body 2 based on one or more illumination images and / or one or more pattern images. The device 1 can determine a virtual plane 3 (110) corresponding to the top of the object body 2 based on the determined multiple contour lines. The virtual plane 3 can be a plane that virtually realizes the top of the object body 2 in the real three-dimensional space using computer graphics. The device 1 can determine the angle between the virtual plane 3 and the reference plane as the angle θ (110) between the object body 2 and the reference plane.

[0062] In one embodiment, the object body 2 may be a stacked memory having a plurality of stacked layers. In this case, the extracted plurality of contour lines may indicate the corners of the plurality of layers of the object body 2. The device 1 may determine a plurality of virtual planes based on a plurality of contour lines obtained from an image of the object body 2 having a stacked structure. The process of determining the virtual planes is as described above. Each of the plurality of determined virtual planes may correspond to a plurality of layers of the object body 2 having a stacked structure, respectively. That is, a virtual plane may represent one of the plurality of layers. The device 1 may determine the gaps between the plurality of layers of the object body 2 having a stacked structure based on each of the plurality of determined virtual planes. In one embodiment, the process may be performed by a processor of the device 1.

[0063] According to various embodiments of the present disclosure, when it is difficult to obtain an image for inspection on the upper surface of the object 2 to be inspected because the upper surface is a reflector, the device 1 can also use a virtual plane for the object 2 to measure the tilt angle of the object 2. In addition, according to various embodiments of the present disclosure, when the object 2 is tilted at a specific angle (for example, 1.2 degrees) or more relative to the reference plane, the device 1 can also generate a virtual plane to derive the degree of tilt. In addition, according to various embodiments of the present disclosure, even when it is difficult to extract a clear image or contour of the object 2 to be inspected due to various semiconductor elements and structures located on the substrate, necessary relevant information can be obtained to perform inspection on the object 2. In addition, according to various embodiments of the present disclosure, it is possible to obtain an image using light irradiated from various types of light sources at various angles and directions, thereby performing accurate measurement of the object.

[0064] Figure 2 It is a diagram showing a block diagram of an apparatus according to an embodiment of the present disclosure. In one embodiment, the apparatus 1 may include: one or more processors 10, one or more memories 20, one or more pattern light sources 30, one or more illumination light sources 40 and / or one or more cameras 50. In one embodiment, at least one of these constituent elements of the apparatus 1 may be omitted, or other constituent elements may be added to the apparatus 1. In one embodiment, some constituent elements may be implemented additionally or alternatively, or in the form of singular or plural individuals. In the present disclosure, one or more constituent elements (e.g., one or more processors 10) may be expressed as constituent elements (e.g., processor 10), which may mean a collection of one or more constituent elements as long as it is not explicitly mentioned differently in the text. In one embodiment, at least some of the components inside / outside the device 1 can be interconnected through a bus, GPIO (general purpose input / output), SPI (serial peripheral interface) or MIPI (mobile industry processor interface), and send and receive data and / or signals.

[0065] The illumination light source 40 may irradiate two-dimensional illumination light to the object 2. In one embodiment, the illumination light may be RGB light, and each illumination light source 40 may include: a red light source irradiating red light, a green light source irradiating green light, and a cyan light source irradiating cyan light. In one embodiment, each illumination light source 40 may irradiate red light, green light, and cyan light to saturate the surface of the object when irradiating illumination light.

[0066] The pattern light source 30 can irradiate pattern light onto the object 2. In one embodiment, the pattern light can be structured light, grid light (light whose luminosity changes in a sinusoidal wave pattern), linear light, etc. In one embodiment, the pattern light source 30 can irradiate pattern light that is phase-shifted by a grid transfer mechanism such as PZT (piezo actuator), or can irradiate pattern light by a DLP (Digital Light Processing) method or an LCoS (Liquid Crystal on Silicon) method. In one embodiment, more than one pattern light source 30 can irradiate pattern light according to a method selected from a PZT method, a DLP method, and an LCoS method. In one embodiment, more than one (for example: 8) pattern light sources 30 that irradiate pattern light in mutually different directions above the object 2 can be used.

[0067] As described above, the camera 50 can capture an illumination image and / or a pattern image. In one embodiment, the camera 50 can be a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) camera. In one embodiment, the one or more cameras 50 may include: a top camera and / or one or more side cameras. The top camera can capture an illumination image or a pattern image reflected from the object 2 above the object 2. One or more side cameras can capture an illumination image or a pattern image reflected from the object 2 on the side or even on the upper side of the object 2. In one embodiment, one or more side cameras may include four cameras corresponding to the front, rear, left, and right sides of the object 2. In one embodiment, the illumination image or pattern image captured by the top camera from above the object 2 may be referred to as a top image. In addition, the illumination image or pattern image captured by one or more side cameras from one or more sides of the object 2 may be referred to as a side image. That is, a part of the one or more illumination images and the one or more pattern images may be an upper image, and another part may be a side image.

[0068] The processor 10 can drive software (e.g., commands, programs, etc.) to control at least one component of the device 1 connected to the processor 10. In addition, the processor 10 can perform various operations related to the present disclosure, such as calculations, processing, data generation, and processing. In addition, the processor 10 can load data from the memory 20 or store it in the memory 20. In one embodiment, the processor 10 can determine multiple contours of the object 2 on one or more illumination images, determine the height values ​​of the corners on the object based on the multiple contours, and determine the angle θ between the object and the reference plane based on the height values. In addition, in one embodiment, the processor 10 can determine multiple contours representing the corners of the object 2 based on one or more illumination images and / or one or more pattern images, determine the virtual plane 3 corresponding to the object based on the multiple contours, and determine the angle between the virtual plane 3 and the reference plane as the inclination angle θ of the object 2.

[0069] The memory 20 can store various data. The data stored in the memory 20, as data obtained, processed, or used by at least one component of the device 1, may include software (e.g., commands, programs, etc.). The memory 20 may include volatile and / or non-volatile memory. In the present disclosure, commands and even programs as software stored in the memory 20 may include an operating system for controlling the resources of the device 1, an application program, and / or middleware that provides various functions to the application program so that the application program can utilize the resources of the device 1. In one embodiment, the memory 20 may store commands, which, when executed by the processor 10, cause the processor 10 to perform operations.

[0070] In one embodiment, the device 1 may further include a transceiver (not shown). The transceiver may perform wireless or wired communication between the device 1 and a server or between the device 1 and other devices. For example, the transceiver can perform wireless communications in the following ways: eMBB (enhanced Mobile Broadband), URLLC (Ultra Reliable Low-Latency Communications), MMTC (Massive Machine Type Communications), LTE (Long-Term Evolution), LTE-A (LTE Advance), NR (New Radio), UMTS (Universal Mobile Telecommunications System), GSM (Global System for Mobile communications), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), WiBro (Wireless Broadband), WiFi (Wireless Fidelity), Bluetooth, NFC (Near Field Communication), GPS (Global Positioning System) or GNSS (Global Navigation Satellite System). For example, the transceiver may perform wired communication in the form of USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface), RS-232 (Recommended Standard-232), or POTS (Plain Old Telephone Service). In one embodiment, the processor 10 may control the transceiver to obtain information from the server. The information obtained from the server may be stored in the memory 20. In one embodiment, the information obtained from the server may include extracting contour lines from an image, or deriving relationship information between the extracted contour lines, or generating parameters or even information required for the virtual three-dimensional model 3.In one embodiment, the information obtained from the server may include intrinsic or extrinsic parameter values ​​of the camera 50 for calibrating the camera 50 .

[0071] In one embodiment, the device 1 may further include a user interface (not shown). The user interface may receive input from a user and output (indicate) information to the user. In one embodiment, the user interface may include an input device and / or an output device. The input device may be a device that receives data from the outside for transmission to at least one component of the device 1. For example, the input device may include a mouse, a keyboard, a touch pad, etc. The output device may be a device that provides various data of the device 1 to the user in a visual form. For example, the output device may include a display, a projector, and a hologram. In one embodiment, the user interface may receive parameters input by the user for inspecting the object body 2, or display the exported tilt angle θ of the object body 2 to the user.

[0072] In one embodiment, the device 1 may be a device of various forms. For example, the device 1 may be a portable communication device, a computer device, a portable multimedia device, or a device according to a combination of one or more of the above devices. However, the device 1 of the present disclosure is not limited to the above devices.

[0073] The various embodiments of the device 1 according to the present disclosure can be combined with each other. The various embodiments can be combined according to the number of situations, and the embodiments of the combined device 1 still belong to the scope of the present disclosure. In addition, the internal / external components of the device 1 according to the present disclosure can be added, changed, replaced or deleted according to the embodiment. In addition, the internal / external components of the device 1 can be implemented by hardware components.

[0074] Figure 3 3 is a diagram showing a process of generating a virtual plane relative to an object according to an embodiment of the present disclosure. The process of generating the virtual plane 3 may include a calibration process, a contour line extraction process, a process of deriving relationship information between contour lines, and / or a virtual plane generation process.

[0075] During the calibration process (not shown), the device 1 can perform calibration of the camera 50. The device 1 can obtain the basic information necessary to generate a virtual plane relative to the object body through the calibration process. Specifically, during this process, the device 1 can obtain the position information of each camera 50, that is, the origin position information. Among them, the origin position of the camera 50 refers to the position of the point in the three-dimensional space when the camera is regarded as a point. According to an embodiment, the position of the camera 50 can be expressed as a relative position relative to the object body 2, or as an absolute position in the three-dimensional space coordinate system. In addition, during the calibration process, the device 1 can obtain the viewing angle information and / or intrinsic parameters of each camera 50. The information obtained during the calibration process can be stored in the memory 20. In one embodiment, the calibration related information can be obtained from the server through the transceiver. In one embodiment, the calibration process can be omitted as an optional process.

[0076] The following describes the process of extracting contour lines, deriving relationship information between contour lines, and generating virtual planes. These processes can be performed using any two images selected from the illumination image and the pattern image, but for ease of explanation, the description is based on the top image (top) and a side image (left).

[0077] In the contour extraction process s3010, the processor 10 may extract contours from the upper image and the side image. Among the extracted contours, there may be contours that represent the same corner of the object 2 in different images. For example, the processor 10 may extract a contour representing a corner of the object 2 in the upper image (hereinafter referred to as the first contour), and extract a contour representing the same corner in the side image (hereinafter referred to as the second contour).

[0078] In the process s3020 of deriving the relationship information between the contour lines, the processor 10 can determine (derive) the relationship information between the first contour line and the second contour line (hereinafter referred to as the first relationship information). Among them, the corners of the object body 2 jointly represented by the two contour lines can be the corners shared by two adjacent surfaces of the object body 2. Specifically, a point on the first contour line (hereinafter referred to as the first point) and a point on the second contour line (hereinafter referred to as the second point) jointly represent a point on the real corner of the object body (hereinafter referred to as the object point), and therefore can correspond to each other. When the object point is observed from the upper camera, the object point can be represented as the first point on the above image. Assuming that there is a straight line in the three-dimensional space connecting the object point from the origin of the upper camera, if the straight line is observed from the side camera, the straight line will be represented as a two-dimensional straight line on the side image. The two-dimensional straight line is called the epipolar line relative to the first point (epipolar line). On the side image, the intersection between the epipolar line relative to the first point and the second contour line can be derived, and the intersection can be the second point (i.e., the point corresponding to the first point). The transformation relationship from the first point to the epipolar line relative to the first point may be defined by a fundamental matrix. The fundamental matrix, as a concept based on epipolar geometry, may be derived from the aforementioned camera calibration information.

[0079] In one embodiment, the first relationship information may include information about the corresponding two points (the first point and the second point). In one embodiment, the first relationship information may be a pair of two-dimensional pixel coordinates of the two points (the first point and the second point), or a pair of three-dimensional space coordinates, or a transformation relationship or transformation matrix between the two coordinates.

[0080] In the process s3030 of generating a virtual plane, the processor 10 may determine (generate) a virtual plane 3 corresponding to the top of the object body using the determined first relationship information. Specifically, the processor 10 may use the first relationship information to obtain a vector from the origin of the upper camera to the coordinates of the first point, and obtain a vector from the origin of the side camera to the coordinates of the second point, thereby deriving a point where the two vectors meet. The points derived in this way may be used to perform three-dimensional modeling on the top of the entire object body.

[0081] Although the generation process of the virtual plane 3 is described with reference to the top image (top) and a side image (left), as described above, the virtual plane 3 can also be generated using two different side images from a plurality of side images. In this case, the processor 10 can extract a contour line representing a corner of the object 2 in one of the side images (hereinafter referred to as the third contour line), and extract a contour line representing the same corner in another of the side images (hereinafter referred to as the fourth contour line). The processor 10 can also obtain relationship information indicating the corresponding relationship between the third contour line and the fourth contour line (hereinafter referred to as the second relationship information). The processor 10 can determine the virtual plane 3 based on the first relationship information and / or the second relationship information.

[0082] In one embodiment, the process s3020 of the processor 10 obtaining relationship information from the image can be repeatedly executed multiple times. The process of obtaining relationship information can be repeatedly executed multiple times according to the combination of each upper image, side image, etc. In one embodiment, the processor 10 can use different images for obtaining relationship information for the same surface according to the type of illumination image or pattern image (upper, front, back, left, right, etc.), and execute the process of obtaining relationship information multiple times. In one embodiment, the processor 10 can execute the process of obtaining relationship information multiple times for the same surface according to the illumination angle and direction of the illumination light source or pattern light source.

[0083] Figure 4 1 is a diagram illustrating an image combination for obtaining multiple images and determining relationship information according to an embodiment of the present disclosure. The apparatus 1 can obtain multiple images from an object. The obtainable images vary depending on the type of light used, the irradiation direction of the light, and the irradiation angle of the light.

[0084] In one embodiment, the device 1 can obtain multiple illumination images or pattern images for one direction of the object according to whether the light used for capturing is illumination light or pattern light. That is, for the same surface of the object, multiple images can also be obtained according to the type of light used.

[0085] In one embodiment, the device 1 can obtain multiple images for one direction of the object according to the direction or even the angle in which the pattern light source 30 or the illumination light source 40 irradiates the light to the object. For example, more than one pattern light source 30 can be configured in various positions (e.g., 8 directions (8-way)) to irradiate pattern light to the object. The configuration of the pattern light source 30 will be described later. Depending on the direction of the irradiated pattern light, multiple pattern images can be obtained for the same surface of the object. In addition, for example, more than one illumination light source 40 can irradiate illumination light to the object at various angles. The configuration of the illumination light source 40 will be described later. Depending on the angle of the irradiated illumination light, multiple illumination images can be obtained for the same surface of the object.

[0086] In one embodiment, as described above, the device 1 can select two images in different directions (an upper image, side images in various directions, etc.) from the illumination images or pattern images obtained in various directions of the object body, so as to derive the relationship information between the contour lines from the two images. First, the processor 10 can select an upper image and a side image, thereby deriving the first relationship information. The upper image can represent the upper side of the object body, and a side image can represent the upper side and one or more side surfaces of the object body. Since the upper side and the side surfaces of the object body share corners, the first relationship information can be derived from the upper image and the side image. For example, when the object body is a rectangular parallelepiped, four first relationship information can be derived respectively.

[0087] Secondly, the processor 10 can select two side images in different directions from more than one side image, thereby deriving the second relationship information. The two side images can represent two adjacent sides of the object. Since the two adjacent sides share the corners of the object, the second relationship information can be derived from the two side images. For example, when the object is a cuboid, four second relationship information can be derived respectively.

[0088] Third, the processor 10 can select two side images representing two side faces of an object body that do not share common corners from more than one side image, thereby deriving relationship information (hereinafter referred to as the third relationship information). In this case, the third relationship information can also be derived using the polar line. Specifically, when the object body is a rectangular parallelepiped, two parallel side faces can share two parallel corners. A point on a contour line on a side image can be represented as a straight line (polar line) on another parallel side image. The point where the polar line intersects the contour line on the other side image can correspond to a point on the first side image. The third relationship information indicating this corresponding relationship can be derived. For example, when the object body is a rectangular parallelepiped, two pieces of the third relationship information can be derived separately.

[0089] The processor 10 can use at least one of the first relationship information, the second relationship information and / or the third relationship information to derive the virtual plane 3 relative to the object body. Various relationship information can be obtained according to the selectable combination of two images, the illumination direction, and even the angle and the type of illumination as the derived object of the relationship information, and the processor 10 can use the various relationship information to more accurately generate the virtual plane.

[0090] Figure 5 1 is a diagram showing the configuration of one or more pattern light sources 30 according to an embodiment of the present disclosure. As described above, the device 1 may include one or more pattern light sources 30. The pattern light sources 30 may be configured at various positions around the object 2 to irradiate the object 2 with pattern light.

[0091] In the illustrated embodiment 5010, the pattern light source 30 may be a light source that is located on the normal line 4 on the top of the object 2 and irradiates pattern light to the object 2. Specifically, a normal line 4 perpendicular to the top of the object 2 may be drawn. A pattern light source 30 may be located at a point on the normal line 4. The pattern light source 30 may irradiate pattern light to the top of the object 2. In one embodiment, the normal line 4 may be drawn as a half straight line extending from the center of the top of the object 2 in the opposite direction of the reference plane. According to the embodiment, the distance between the pattern light source 30 and the object 2 may be changed. In one embodiment, the pattern light source 30 may change the phase of the pattern and irradiate pattern light to the object 2 multiple times in sequence.

[0092] In the illustrated embodiment 5020, the pattern light source 30 may be a plurality of pattern light sources 30 arranged on the concentric circles 5 on the object. Specifically, it may be assumed that a concentric circle 5 is parallel to the reference plane and has a point on the normal line 4 on the object as the center of the circle. A plurality of pattern light sources 30 may be arranged on the circumference of the concentric circle 5. The plurality of pattern light sources 30 may irradiate pattern light to the object 2. According to an embodiment, the radius of the concentric circle 5 may be changed. According to an embodiment, the intervals of the plurality of pattern light sources 30 arranged on the concentric circle 5 may be changed. In one embodiment, the plurality of pattern light sources 30 may be arranged on the circumference of the concentric circle 5 at the same interval, or may be arranged on the circumference at arbitrarily set intervals different from each other. In one embodiment, a plurality of pattern light sources 30 may be arranged at 45 degree intervals in total of 8. In this case, the configuration of the plurality of pattern light sources 30 may be referred to as an 8-way configuration. In one embodiment, the plurality of pattern light sources 30 may irradiate pattern light to the object 2 in sequence. In one embodiment, the patterns of the patterned lights emitted by the plurality of patterned light sources 30 may have different phases.

[0093] Figure 6 1 is a diagram showing the configuration of one or more illumination light sources according to an embodiment of the present disclosure. As described above, the device 1 may include one or more illumination light sources 40. The illumination light sources 40 may be configured at various positions around the object to irradiate the object with illumination light.

[0094] In the illustrated embodiment, the illumination light source 40 may be a plurality of illumination light sources 40 arranged on a concentric circle 6 perpendicular to the reference plane. Specifically, it may be assumed that the concentric circle 6 is perpendicular to the reference plane and has the object 2 as the center of the circle. A plurality of illumination light sources 40 may be arranged on the circumference of the concentric circle 6. The plurality of illumination light sources 40 may irradiate illumination light to the object.

[0095] According to an embodiment, the radius of the concentric circle 6 can be changed. According to an embodiment, the intervals of the plurality of illumination light sources 40 arranged on the concentric circle 6 can be changed. In one embodiment, the plurality of illumination light sources 40 can be arranged on the circumference of the concentric circle 6 at the same interval, or can be arranged on the circumference at arbitrarily set different intervals. In one embodiment, the plurality of illumination light sources 40 can be arranged at any angle. The angle here can refer to the angle of the position of the illumination light source 40 on the circumference relative to the normal of the reference plane. In one embodiment, at least one of the plurality of illumination light sources 40 can be arranged at a high angle of more than 70 degrees (a low angle based on the reference plane). In one embodiment, the plurality of illumination light sources 40 can be arranged at angles of 17 degrees, 40 degrees, 58 degrees, and 70 degrees, respectively. In one embodiment, the plurality of illumination light sources 40 can be arranged only on the upper side of the reference plane. In one embodiment, the plurality of illumination light sources 40 can irradiate illumination light toward the object 2 in sequence. In one embodiment, the illumination light irradiated by the plurality of illumination light sources 40 can have different wavelengths. In one embodiment, the plurality of illumination light sources 40 may include a red light source, a green light source, and a cyan light source that can respectively irradiate red light, green light, and cyan light. In one embodiment, the plurality of illumination light sources 40 may first irradiate light of one wavelength (e.g., red light) to the object in sequence according to the configured angle. Then, the plurality of illumination light sources 40 may irradiate light of different wavelengths (e.g., green light) to the object in sequence according to the angle, and then irradiate light of the remaining wavelengths (e.g., cyan light) to the object in sequence according to the angle. In one embodiment, the plurality of illumination light sources 40 may irradiate red light, green light, and cyan light in sequence for one angle, and then irradiate red light, green light, and cyan light in sequence for the next angle. In one embodiment, when irradiating red light, green light, and cyan light respectively, the irradiation order may be changed according to the designer's intention. In one embodiment, when each illumination light source 40 irradiates two-dimensional illumination light, it may irradiate red light, green light, and cyan light at the same time and irradiate mixed white light to the object. In one embodiment, each illumination light source 40 may irradiate ordinary white light instead of mixed white light to the object. In one embodiment, the plurality of illumination light sources 40 arranged at various angles can simultaneously irradiate mixed white light to saturate the surface of the object, and the reflected illumination light can be captured to obtain an illumination image of the surface of the object.

[0096] Figure 7is a diagram showing the filtering process of an image according to an embodiment of the present disclosure. In one embodiment, the processor 10 may filter the images obtained according to various factors (type of light, irradiation direction, angle, etc.) according to preset standards, and only use the filtered images to generate the virtual plane 3. When the device 1 inspects the object body (e.g., grains) on the substrate, it may be affected by other elements and bumps of the substrate. Due to these influences, the obtained images themselves may be distorted, or the contours obtained from these images may be distorted. When the virtual plane 3 is generated based on the distorted image or even the contour line, it may be difficult to accurately measure or even inspect the object body 2. To prevent this, only the filtered images can be filtered out according to the preset standards and used for the generation of the virtual plane 3.

[0097] In one embodiment, the processor 10 may perform filtering based on whether the contrast value of the surface of the object 2 appearing in the image is greater than a preset value. The processor 10 may discard images whose contrast value is less than the preset value and only select images whose contrast value is greater than the preset value to thereby determine (derive) the aforementioned relationship information.

[0098] In one embodiment, the processor 10 may perform filtering based on whether the contour lines appearing on the image have continuity. The processor 10 may only screen out images in which the contour lines representing one corner of the object body are represented by continuous line segments and thereby determine the aforementioned relationship information. In addition, in one embodiment, the processor 10 may statistically calculate the average value or median value of the contour line position coordinates extracted from multiple images, and exclude images from which contour lines with position coordinates deviating from a preset ratio or more are extracted from these values. In this case, the processor 10 may determine the aforementioned relationship information only from images that are not excluded.

[0099] Figure 8 1 is a diagram showing a process of deriving another contour line from one contour line of an image according to an embodiment of the present disclosure. In one embodiment, the processor 10 can determine another contour line from one contour line using the pre-stored specification information of the object body 2. As described above, when the device 1 inspects the object body of the substrate, it may be affected by other elements and concavities and convexities of the substrate. As a result, it may be impossible to extract the contour line necessary for determining the relationship information. At this time, in order to supplement the contour line extraction process, the pre-stored specification information of the object body 2 can be used to derive another contour line from one contour line.

[0100] Specifically, the memory 20 may include specification information of the object body 2. The specification information may include the length, width and height information of the object body 2. After the processor 10 derives a contour line from the image, the processor 10 may use the specification information to predict and derive the position of the contour line located at a position parallel to the contour line. For example, it can be assumed that the contour line 8010 below the object body 2 is extracted, and the upper contour line located at a position parallel to the lower contour line cannot be extracted due to the specified distortion. In this case, the processor 10 can obtain the height information of the object body 2 based on the specification information, apply the height information to the extracted lower contour line, and thus predict the position of the upper contour line at a parallel position. The upper contour line 8020 can be extracted in this way.

[0101] When the contour line necessary for determining the relationship information cannot be derived due to distortion of the image or even the contour line, the processor 10 may first extract a contour line parallel to the necessary contour line, and then extract the necessary contour line using the specification information as described above. The processor 10 may determine the relationship information 8030 using the contour line necessary for determining the relationship information.

[0102] In one embodiment, when the object 2 is not a cuboid, the specification information may also include information about the shape of the object. For example, when the object is cylindrical, the specification information may store information about the radius and height of the cylinder. The processor 10 may use the radius and height information to derive other contours necessary for determining the relationship information from one contour.

[0103] In one embodiment, the memory 20 may perform the role of a database storing specification information of an object body that is an inspection object. The memory 20 may store specification information about an object body (e.g., a component, a chip, etc.) located on a substrate or commonly used. In one embodiment, the processor 10 recognizes what the object body is from the acquired image, and then the specification information corresponding to the recognized object body may be read from the memory 20. Based on the acquired specification information, the processor 10 may derive other contours necessary to determine relationship information from one contour line of the recognized object body. In one embodiment, the processor 10 may control the transceiver to obtain the specification information of the object body from the server. The acquired specification information may be stored in the memory 20.

[0104] Fig. 9is a diagram showing an embodiment of a method for inspection that can be performed by the device 1 according to the present disclosure. The method for inspection according to the present disclosure may be a method implemented by a computer. In the flowchart shown in the figure, the steps of the method or algorithm according to the present disclosure are described in sequence, but in addition to being performed in sequence, the steps may also be performed in an order that can be arbitrarily combined by the present disclosure. The description according to this flowchart does not exclude changes or modifications to the method or algorithm, and does not mean that any step is necessary or preferred. In one embodiment, at least a portion of the steps may be performed in parallel, repeatedly, or heuristically. In one embodiment, at least a portion of the steps may be omitted, or other steps may be added.

[0105] The device 1 according to the present disclosure can execute the inspection method according to various embodiments of the present disclosure. The method according to one embodiment of the present disclosure may include: step S910 of irradiating an object body located on a reference plane with illumination light; step S920 of capturing one or more illumination images generated by the illumination light reflected from the object body; step S930 of determining multiple contour lines representing the corners of the object body on the one or more illumination images; step S940 of determining the height value of the corner on the top of the object body relative to the reference plane based on the multiple contour lines; and / or step S950 of determining the first angle between the top of the object body and the reference plane based on the height value.

[0106] In step S910, at least one first light source (e.g., illumination light source 40) of device 1 may irradiate illumination light to object 2 located on the reference surface. In step S920, at least one camera 50 of device 1 may capture at least one illumination image generated by illumination light reflected from object 2.

[0107] In step S930, one or more processors 10 of the device 1 may determine multiple contour lines representing the corners of the object 2 on one or more illumination images. In step S940, the processor 10 may determine the height value of the corner on the top of the object relative to the reference plane based on the multiple contour lines. In step S950, the processor 10 may determine a first angle (e.g., angle θ) between the top of the object and the reference plane based on the height value.

[0108] In one embodiment, the method according to the present disclosure may also include: a step of at least one second light source of device 1 (e.g., pattern light source 30) irradiating pattern light onto object 2; a step of one or more cameras 50 capturing one or more pattern images generated by reflection of the pattern light from object 2; a step of the processor 10 determining a plurality of contour lines representing corners of object 2 based on one or more illumination images and one or more pattern images; a step of the processor 10 determining a virtual plane 3 corresponding to the top of object 2 based on the plurality of contour lines; and / or a step of the processor 10 determining a second angle between the virtual plane 3 and the reference plane as a first angle.

[0109] In one embodiment, the step of determining the virtual plane may include: the step of extracting a first contour line on the upper image representing the same corner of the object body 2 and a second contour line on the one or more side images; and / or the step of determining the virtual plane 3 based on the first contour line and the second contour line.

[0110] In one embodiment, the step of determining the virtual plane may further include: a step of determining first relationship information indicating a corresponding relationship between the first contour line and the second contour line; and / or a step of determining the virtual plane 3 according to the first relationship information.

[0111] In one embodiment, the step of determining the virtual plane may also include: the step of extracting a third contour line on a side image and a fourth contour line on another side image representing the same corner of the object body in more than one side image; the step of determining second relationship information indicating the correspondence between the third contour line and the fourth contour line; and / or the step of determining the virtual plane 3 based on the first relationship information and the second relationship information.

[0112] In one embodiment, the step of determining the virtual plane may include: selecting an image having a contrast value of the surface of the object greater than a preset value from among the one or more illumination images and the one or more pattern images to determine the virtual plane 3 .

[0113] Various embodiments of the present disclosure may be implemented by software recorded in a machine-readable recording medium. The software may be software for implementing the various embodiments of the present disclosure. The software may be inferred by a programmer in the technical field of the present disclosure from the various embodiments of the present disclosure. For example, the software may be a machine-readable command (e.g., code or code segment) or a program. A machine is a device that can operate according to a command called from a recording medium, such as a computer. In one embodiment, the machine may be an electronic device 1 according to an embodiment of the present disclosure. In one embodiment, the processor of the machine may operate the called command so that the constituent elements of the machine perform the function corresponding to the command. In one embodiment, the processor may be one or more processors 10 according to an embodiment of the present disclosure. The recording medium may refer to all types of recording media that are machine-readable and can store data. For example, the recording medium may include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. In one embodiment, the recording medium may be one or more memories 20. In one embodiment, the recording medium may be implemented in a distributed form in a computer system connected by a network, etc. The software may be stored and executed in a distributed manner in a computer system, etc. The recording medium may be a non-transitory recording medium. A non-transitory recording medium means a tangible medium that has nothing to do with whether data is stored semi-permanently or temporarily, and does not include a signal that is transmitted transiently.

[0114] The technical concept of the present disclosure is described above based on various embodiments, but the technical concept of the present disclosure includes various substitutions, deformations and changes that can be made within the scope that can be understood by ordinary technicians in the field to which the present disclosure belongs. In addition, it should be understood that such substitutions, deformations and changes can be included in the scope of the attached claims.

Claims

1. A device for inspecting an object, comprising: at least one first light source, the first light source irradiating illumination light toward the object located on the reference plane; at least one second light source, the second light source radiating pattern light toward the object; a plurality of cameras, each of which captures one or more illumination images and one or more pattern images, wherein the one or more illumination images are generated by the illumination light reflecting from the object, and the one or more pattern images are generated by the pattern light reflecting from the object; and More than one processor, the processor, determining a plurality of contour lines representing corners of the object based on two or more images captured from different directions among the one or more illumination images and the one or more pattern images, Determine a virtual plane generated on the object body based on the plurality of contour lines, An angle between the virtual plane and the reference plane is determined.

2. The device according to claim 1, wherein: The multiple cameras include: an upper camera, which captures an illumination image or a pattern image from above the object; and one or more side cameras, which capture an illumination image or a pattern image from one or more sides of the object.

3. The device according to claim 2, wherein: A portion of the one or more illumination images and the one or more pattern images are upper images captured by the upper camera from above the object. Another part of the one or more illumination images and the one or more pattern images is a side image captured by the one or more side cameras from one or more sides of the object.

4. The device according to claim 3, wherein: the processor, extracting a first contour line on the upper image and a second contour line on one or more side images representing the same corner of the object, The virtual plane is determined based on the first contour line and the second contour line.

5. The device according to claim 4, wherein: the processor, determining first relationship information indicating a corresponding relationship between the first contour line and the second contour line, The virtual plane is determined based on the first relationship information.

6. The device according to claim 5, wherein: A first point on the first contour line corresponds to a second point on the second contour line, The first relationship information includes a pair of coordinate information, wherein the pair of coordinate information is coordinate information of the first point on the upper image and coordinate information of the second point on one or more of the side images.

7. The device according to claim 5, wherein: the processor, extracting a third contour line on one side image and a fourth contour line on another side image that represent the same corner of the object from the one or more side images, determining second relationship information indicating a corresponding relationship between the third contour line and the fourth contour line, The virtual plane is determined based on the first relationship information and the second relationship information.

8. The device according to claim 1, wherein: An image contrast of the surface of the object in two or more images captured from different directions is greater than a preset value.

9. The device according to claim 1, wherein: The object body has a form in which a plurality of layers are stacked, and the plurality of contour lines indicate corners of each of the plurality of layers. the processor, determining a plurality of virtual planes respectively corresponding to the plurality of layers based on the plurality of contour lines, Intervals between the respective layers are determined based on a plurality of virtual planes respectively corresponding to the layers.

10. A method for inspecting a subject, comprising: At least one first light source irradiates illumination light to the object located on the reference surface; The step of capturing one or more illumination images with a plurality of cameras, wherein the one or more illumination images are generated by the illumination light being reflected from the object; at least one second light source irradiates patterned light toward the object; The plurality of cameras capture one or more pattern images, wherein the one or more pattern images are generated by the pattern light being reflected from the object; One or more processors determine a plurality of contour lines representing corners of the object based on two or more images captured from different directions among the one or more illumination images and the one or more pattern images; The processor determines a virtual plane generated on the object body based on the plurality of contour lines; and The processor determines an angle between the virtual plane and the reference plane.

11. The method according to claim 10, wherein: The multiple cameras include: an upper camera, which captures an illumination image or a pattern image from above the object; and one or more side cameras, which capture an illumination image or a pattern image from one or more sides of the object.

12. The method according to claim 11, wherein: A portion of the one or more illumination images and the one or more pattern images are upper images captured by the upper camera from above the object. Another part of the one or more illumination images and the one or more pattern images is a side image captured by the one or more side cameras from one or more sides of the object.

13. The method according to claim 12, wherein: The step of determining the virtual plane comprises: A step of extracting a first contour line on the upper image and a second contour line on one or more side images representing the same corner of the object; and The step of determining the virtual plane based on the first contour line and the second contour line.

14. The method according to claim 13, wherein: The step of determining the virtual plane also includes: a step of determining first relationship information indicating a corresponding relationship between the first contour line and the second contour line; and The step of determining the virtual plane based on the first relationship information.

15. The method according to claim 14, wherein: A first point on the first contour line corresponds to a second point on the second contour line, The first relationship information includes a pair of coordinate information, where the pair of coordinate information is coordinate information of the first point on the upper image and coordinate information of the second point on the one or more side images.

16. The method according to claim 14, wherein: The step of determining the virtual plane also includes: A step of extracting, from one or more of the side images, a third contour line on one side image and a fourth contour line on another side image representing the same corner of the object; a step of determining second relationship information indicating a corresponding relationship between the third contour line and the fourth contour line; and The step of determining the virtual plane based on the first relationship information and the second relationship information.

17. The method according to claim 10, wherein: An image contrast of the surface of the object in two or more images captured from different directions is greater than a preset value.

18. A non-transitory computer-readable recording medium having recorded thereon a program for execution on a computer, wherein when the program is executed by one or more processors, the program comprises executable instructions for causing the processors to execute the following steps: The step of determining a plurality of contour lines representing corners of an object body based on two or more images captured from different directions from among one or more illumination images generated by reflection of illumination light irradiated onto the object body located on a reference surface from the object body and one or more pattern images generated by reflection of pattern light from the object body, A step of determining a virtual plane generated on the object body based on the plurality of contour lines; and The step of determining an angle between the virtual plane and the reference plane.