Smart lighting-based product determination system and product determination method using same

Abstract

Provided are a smart lighting-based product determination system and a product determination method using same, the product determination system comprising a calculation unit, a lighting unit, a sensor unit, and a determination unit. The calculation unit designs a lighting spectrum for determining the state of a product. The lighting unit provides illumination to the product by using the designed lighting spectrum. The sensor unit measures a light signal that is reflected or transmitted from the product as a result of providing the illumination. The determination unit determines the state of the product on the basis of the measured light signal.

Description

Smart lighting-based product judgment system and product judgment method using the same

[0001] The present invention relates to a smart lighting-based product judgment system and a product judgment method using the same. More specifically, the invention relates to a smart lighting-based product judgment system and a product judgment method using the same that more accurately determines a specific state of a product by utilizing smart lighting that controls a diverse spectrum, and feedback controls a manufacturing process of the product based on the state of the product.

[0002] Recently, technologies utilizing various optical devices to evaluate product quality in real time are being developed across diverse industrial fields. For example, Korean Registered Patent No. 10-2230502 discloses a technology for analyzing the characteristics of an object by performing polarization analysis using a polarization device, while Japanese Registered Patent No. 7285502 discloses a technology regarding an inspection system through color identification.

[0003] However, when evaluating products using general optical devices, measurements are performed using a relatively limited variety of sensors; consequently, the optical information, which contains countless wavelengths, is excessively simplified to merely obtain relevant information, which limits the ability to analyze the product's condition information more accurately and precisely.

[0004] Accordingly, analysis technologies using hyperspectral sensors are being introduced; while this enables the acquisition of precise wavelength information, it faces limitations such as difficulty in real-time measurement due to excessive computational load and restricted spatial and wavelength resolution.

[0005] Accordingly, the technical problem of the present invention is conceived from this point, and the objective of the present invention is to provide a smart lighting-based product judgment system that more accurately determines a specific state of a product using smart lighting that controls the spectrum in various ways, and provides feedback control of the manufacturing process of the product based on the state of the product.

[0006] In addition, another objective of the present invention is to provide a product determination method using the product determination system.

[0007] A product determination system according to one embodiment for realizing the purpose of the present invention described above includes a computation unit, a lighting unit, a sensor unit, and a determination unit. The computation unit designs a lighting spectrum for determining the product state. The lighting unit provides lighting to the product using the designed lighting spectrum. The sensor unit measures a light signal reflected or transmitted from the product in accordance with the provision of lighting. The determination unit determines the product state based on the measured light signal.

[0008] In one embodiment, the illumination provided to the product is white light and may be light composed of at least one combination of monochromatic light of different wavelengths.

[0009] In one embodiment, the wavelength of the monochromatic light may be at least one of the two endpoints of a line extending in the color space, or at least one of the vertices of a polygon formed in the color space.

[0010] In one embodiment, the computation unit may include a storage unit that stores spectrum information according to the product state, a selection unit that selects a target color according to the product state, and a design unit that designs the lighting spectrum based on the spectrum of the product and the target color.

[0011] In one embodiment, the spectrum information according to the product state may be information in which the transmission spectrum or reflection spectrum varies depending on the state of the product.

[0012] In one embodiment, the state of the product may be damage caused during the manufacturing process of the product, a component included in the product, or a characteristic in the depth or width direction of the product.

[0013] In one embodiment, the target color may be a color displayed according to the state of the product, among the reflected light or transmitted light reflected from the product.

[0014] In one embodiment, there is at least one spectrum information for the same product state, and even for the same product state, the target color may be varied as the spectrum information is varied.

[0015] In one embodiment, the target color may be varied to a different color, or may be varied to have different saturation or different vividness while being the same color.

[0016] In one embodiment, the computational unit further includes a prediction unit that predicts the color of reflected light or transmitted light reflected from the product according to the designed lighting spectrum, and the selection unit can re-select the target color based on the prediction result of the prediction unit.

[0017] In one embodiment, a control unit that feedback controls a process unit performing a process on the product based on the result of determining the product state may be further included.

[0018] A product determination method according to one embodiment for realizing another objective of the present invention described above comprises the steps of: designing a lighting spectrum for determining the product state; providing lighting to the product with the designed lighting spectrum; measuring a light signal reflected or transmitted from the product according to the provision of lighting; and determining the product state based on the measured light signal.

[0019] In one embodiment, the step of designing the lighting spectrum may include storing spectrum information according to the product state, selecting a target color according to the product state, and designing the lighting spectrum based on the product spectrum and the target color.

[0020] In one embodiment, the method may further include the step of predicting the color of reflected light or transmitted light reflected from the product according to the designed lighting spectrum, and the step of re-selecting the target color based on the prediction result.

[0021] In one embodiment, the target color is a color displayed according to the condition of the product, among reflected light reflected from the product or transmitted light transmitted through the product, and the condition of the product may be damage caused during the manufacturing process of the product, components included in the product, or characteristics in the depth or width direction of the product.

[0022] In one embodiment, the method may further include a step of feedback-controlling a process unit that performs a process on the product based on the result of determining the product state.

[0023] In one embodiment, the illumination provided to the product is white light and may be light composed of at least one combination of monochromatic light of different wavelengths.

[0024] According to embodiments of the present invention, by designing an illumination spectrum to determine a specific state of a product, more precise and accurate detection of the corresponding state is possible, thereby enabling real-time identification of the specific state of a sensitive product.

[0025] In this case, although the light provided through the lighting is the same white light, the spectrum constituting the white light is designed to be diverse, so a specific state of the product can be detected according to the designed spectrum. That is, even if the same white light is provided, the reflected light or transmitted light is displayed in different colors depending on the state of the product, so the state of the product can be detected more precisely and accurately based on the color in which the reflected or transmitted light is displayed.

[0026] At this time, in addition to being displayed in different colors, the same color may be displayed through color amplification, but with different saturation or vividness, and detection of the state of the product can also be performed through this.

[0027] Meanwhile, regarding the target color displayed according to the state of the product, the ability to distinguish it may be reduced depending on the color of the product's general reflected or transmitted light, the color of the surrounding environment, etc. In this case, the selection unit can further improve the ability to distinguish the state of the product by varying the target color.

[0028] In other words, since there is at least one spectral information identifying the same product state, selecting a different spectrum induces the implementation of a different target color, thereby enabling a judgment on the product state to be performed with enhanced discriminability for the same product state.

[0029] At this time, when selecting the light of the illumination, monochromatic lights corresponding to at least one of the two endpoints of a line extending in the color space or at least one of the vertices of a polygon formed in the color space are selected and combined to form the light, thereby enabling the formation of combinations having various spectra even for a single product state, and thus allowing the target color according to the product state to be varied in various ways.

[0030] Furthermore, based on the determination result of the product status, the process unit performing the process on the product can be feedback-controlled in real time, thereby improving the process to minimize the occurrence of damage or defects to a specific product and further improving the quality of the final product.

[0031] Thus, by overcoming the limitations of detection resolution when using only conventional cameras or sensors, the product recognition rate can be improved, and thereby, the quality of the final product can be enhanced.

[0032] FIG. 1 is a schematic diagram illustrating a smart lighting-based product judgment system according to one embodiment of the present invention.

[0033] Figure 2 is a schematic diagram illustrating the operating state of the product judgment system of Figure 1.

[0034] Figure 3 is a flowchart illustrating a product determination method using the product determination system of Figure 1.

[0035] Figure 4 is a flowchart illustrating the steps for designing the optimal lighting spectrum of Figure 3.

[0036] FIG. 5a is a schematic diagram illustrating a defect detection state of a product according to the prior art, and FIG. 5b is a schematic diagram illustrating a defect detection state of a product using the product judgment system of FIG. 1.

[0037] FIG. 6a is a schematic diagram illustrating the state of circuit element detection of a product according to the prior art, and FIG. 6b is a schematic diagram illustrating the state of circuit element detection of a product using the product judgment system of FIG. 1.

[0038] FIG. 7a is a schematic diagram illustrating the state of depth direction detection of a product according to the prior art, and FIG. 7b is a schematic diagram illustrating the state of depth direction detection of a product using the product judgment system of FIG. 1.

[0039] <Explanation of Symbols>

[0040] 10 : Product Judgment System 100 : Product

[0041] 150 : Process Unit 200 : Calculation Unit

[0042] 210 : Storage section 220 : Selection section

[0043] 230 : Design Department 240 : Prediction Department

[0044] 300 : Lighting unit 400 : Sensor unit

[0045] 500 : Judgment unit 600 : Control unit

[0046] The present invention is susceptible to various modifications and may take various forms, and embodiments are to be described in detail in the text. However, this is not intended to limit the invention to the specific disclosed forms, and it should be understood that the invention includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the invention. Similar reference numerals have been used for similar components in the description of each figure. Terms such as "first," "second," etc., may be used to describe various components, but said components should not be limited by said terms.

[0047] The above terms are used solely for the purpose of distinguishing one component from another. The terms used in this application are used merely to describe specific embodiments and are not intended to limit the invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "consisting of" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0048] Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the attached drawings.

[0049] FIG. 1 is a schematic diagram illustrating a smart lighting-based product judgment system according to an embodiment of the present invention. FIG. 2 is a schematic diagram for explaining the operation state of the product judgment system of FIG. 1.

[0050] First, referring to FIG. 1, the smart lighting-based product judgment system (hereinafter referred to as the product judgment system) (10) according to the present embodiment includes a computation unit (200), a lighting unit (300), a sensor unit (400), a judgment unit (500), and a control unit (600).

[0051] The above product judgment system (10) performs a predetermined judgment on a product (100) that is manufactured through a predetermined process unit (150). At this time, the judgment on the product (100) may, for example, as described below, determine various damages, etc., included in the manufactured product as a state of the product, determine the characteristics of various components included in the product, or determine the characteristics of the product in the depth or width direction. At this time, characteristics in the depth or width direction may refer to various physical or chemical characteristics included in the product (100), such as various damages in the depth or width direction or components included in the product.

[0052] However, such judgment regarding the above-mentioned product (100) is not limited to the examples provided above and may include performing various judgments regarding the characteristics or state of various products (100).

[0053] Furthermore, FIG. 1 illustrates a state in which a process is performed on the product (100) through a predetermined process unit (150). At this time, the process performed through the process unit (150) may include various processes such as the manufacturing process of the product (100), a measurement process, and a repair process. Furthermore, the type or composition of the product (100) is not limited.

[0054] In addition, regarding the above product (100), the subject of judgment is not necessarily limited to the product in which a predetermined process is performed through the process unit (150); judgment may also be performed on the product (100) that has been completed or already manufactured after the process is fully performed, either together with or while omitting judgment on the process state. In this case, if judgment is performed on the already manufactured product, it is obvious that the result of the judgment can be utilized in subsequent manufacturing processes of the same product.

[0055] More specifically, the above-mentioned computational unit (200) designs a lighting spectrum for determining the state of the product (100) and includes a storage unit (210), a selection unit (220), a design unit (230), and a prediction unit (240).

[0056] At this time, the state of the product (100) may be a state regarding various damages to the product, such as scratches, breakage, oxidation, expansion, wetting, etc. caused during the manufacturing process, as previously exemplified. Alternatively, the state of the product (100) may be a component such as a substrate, circuit, or element included in the product, if the product is composed of various elements. Furthermore, the state of the product (100) may be a physical or chemical characteristic of the product (100) in the depth direction, radius direction, length direction, or width direction. Furthermore, in addition to the characteristics of the product exemplified herein, various other characteristics of the product may be included.

[0057] Referring to FIG. 2, the storage unit (210) stores spectrum information according to the state of the product (100), wherein the spectrum information is information about optical characteristics, and may be, for example, transmission spectrum information or reflection spectrum information.

[0058] However, if information regarding the state of the product (100) is obtained through light reflected from the product (100), then reflection spectrum information according to the state of the product (100) is required and thus such information may be stored; and if the product (100) is composed of a transparent material and the state information of the product (100) can be determined from light obtained by passing through the product (100), then transmission spectrum information according to the state of the product (100) is required and thus such information may be stored. Furthermore, in addition to the reflection or transmission spectrum, semi-transmission spectrum information may also be stored if necessary.

[0059] At this time, the spectrum information according to the state of the product (100) refers to, for example, the characteristic reflection spectrum or transmission spectrum information obtained due to the damage state when the product (100) has specific damage. That is, depending on the type or characteristics of the damage state, the location of the damage state, etc., the reflection spectrum reflected from the damage state or the transmission spectrum transmitted through the damage state may have different characteristics.

[0060] In contrast, the reflection or transmission spectrum may vary depending on, for example, a specific component included in the product (100), and this also corresponds to an example of a spectrum depending on the state of the product. Additionally, the reflection or transmission spectrum may vary depending on the material properties at a specific location in the depth direction of the product (100), and this also corresponds to an example of a spectrum depending on the state of the product.

[0061] As described above, the product (100) may have various states (211, 212, 213), and each of these various states of the product has different spectral information. Accordingly, the storage unit (210) acquires and stores spectral information according to the various states of the product (100) in advance.

[0062] That is, as shown in FIG. 2, for state A (211) of the product (100), first spectrum information (211S) may be stored, for another state B (212), second spectrum information (212S) may be stored, and for yet another state C (213), third spectrum information (213S) may be stored. Here, as previously explained, the first to third spectrum information may each be a reflection spectrum or a transmission spectrum.

[0063] At this time, as illustrated in FIG. 2, state A (211) may be a normal state without separate damage as illustrated, state B (212) may be a broken (fracture) state as illustrated, and state C (213) may be a cracked state as illustrated.

[0064] Meanwhile, the spectrum information may include information regarding the wavelengths included in the reflected light or transmitted light that is reflected or transmitted by a specific state of the product (100), or information regarding the intensity of the wavelengths included in the reflected light or transmitted light. Accordingly, the meaning that the spectrum according to the state of the product is different means that the wavelengths included in the reflected light or transmitted light are configured differently from each other, or even if they are configured with the same wavelengths, the intensity of each wavelength is configured differently from each other. Furthermore, it is possible for different wavelengths to be configured with different intensities.

[0065] Ultimately, the storage unit (210) stores information regarding the type or intensity of the wavelength constituting the reflected light or transmitted light for each state of the product (100).

[0066] Meanwhile, among the states of the product (100), multiple spectra may be formed for the state of a single product. That is, the combination of wavelengths constituting the reflection or transmission spectrum for the damage state at a specific location of the product (100) is not necessarily limited to one, but may be combined with various wavelengths or various intensities. Accordingly, the storage unit (210) may store information regarding at least one spectrum for each state of the product (100) in consideration of this.

[0067] The selection unit (220) selects a specific target color according to the state of the product (100) stored in the storage unit (210).

[0068] At this time, the target color refers to a color displayed according to the state of the product (100), among the reflected light reflected from the product (100) or the transmitted light transmitted through the product (100) provided to the product (100). In this case, the light provided to the product (100) is provided by the lighting unit (300) described later, and the light includes a lighting spectrum.

[0069] That is, the reflected light or the transmitted light has specific spectral characteristics depending on the state of the product (100) as previously explained, and is displayed in a predetermined color according to the spectral characteristics. Accordingly, the color that the reflected light or the transmitted light caused by the state of the product is displayed externally is called the target color.

[0070] Ultimately, the user can perform a more accurate and precise analysis of the state of the product through the target color of the reflected light or transmitted light that is reflected or transmitted depending on the state of the product.

[0071] Furthermore, regarding the aforementioned target color, it may be set to be distinguished as different colors, but it may also be configured to amplify the color while maintaining the same color. Here, amplifying the color means that the reflected or transmitted light reflected depending on the state of the product is not a different color, but rather the same color with different saturation amplified, or its vividness is amplified in contrast to surrounding colors.

[0072] Meanwhile, as previously explained, at least one spectrum can be stored for the state of a specific product, and different colors of reflected or transmitted light can be displayed by each spectrum.

[0073] That is, as shown in FIG. 2, for each of the different states (state A, state B, state C) of the product (100), the color of the reflected light or transmitted light can be defined differently as different colors such as Red, Blue, and Green. In addition, for a single state of the product (100), the color of the reflected light or transmitted light can be defined differently as different colors such as Red, Blue, and Green. At this time, as previously explained, in addition to being defined as different colors, even if they have the same color, the saturation can be defined differently through color amplification, or the vividness can be defined differently in contrast to the surrounding color.

[0074] Accordingly, the selection unit (220) can arbitrarily select a target color defined by spectrum information for each state of the product stored in the storage unit (210). When a specific target color is selected in the selection unit (220), the selected target color is ultimately displayed as an identification color in reflected light or transmitted light according to the state of the product (100).

[0075] The design unit (230) designs the lighting spectrum (231) based on the spectrum according to the state of the product (100) stored in the storage unit (210) and the target color selected in the selection unit (220).

[0076] At this time, the lighting spectrum (231) refers to the spectral composition of the lighting (310) provided through the lighting unit (300), and ultimately corresponds to a combination of wavelengths or a combination of wavelength intensities of the lighting (310), and furthermore, a combination of wavelengths and intensities.

[0077] Accordingly, through the combination of the types or intensities of the wavelengths constituting the lighting spectrum (231), when the lighting (230) is applied to the product (100), the reflected light or transmitted light caused by a specific state of the product (100) can be displayed as a specific target color. Here, as previously explained, the target color may be a different color, or it may be the same color but with different saturation or vividness through color amplification.

[0078] However, since the above lighting spectrum (231) is basically composed of a spectrum based on the characteristics of the product (100), that is, since the compositional features of the spectrum for identifying the characteristics of the product (100) must be reflected first, the target color selected in the selection unit (220) may not necessarily be implemented.

[0079] Accordingly, if the above-mentioned target color is not implemented as is, the accuracy or precision of identifying the characteristics of the product may be reduced, and an optimal selection is required.

[0080] Accordingly, in this embodiment, the color of the reflected light reflected from the product (100) or the transmitted light transmitted through the product (100) is predicted through the prediction unit (240) according to the lighting spectrum (231) designed in the design unit (230).

[0081] That is, as illustrated in FIG. 2, the prediction unit (240) predicts the color of reflected or transmitted light according to the designed illumination spectrum (231) in the color space (241). For example, regarding the state of the product (100), the color of the reflected or transmitted light induced by the state A (211) can be predicted by the illumination spectrum (231) designed for state A (211), that is, what the displayed color is, at which position in the color space (241). This can also be performed individually for other states (212, 213) of the product (100).

[0082] Thus, based on the result of the display color predicted through the prediction unit (240), the selection unit (220) can modify the target color, and thereby the design unit (230) can design the optimal lighting spectrum (231).

[0083] For example, the lighting spectrum is designed by first selecting Red as the target color in the selection unit (220), but the reflected light or transmitted light induced by the state of the product (100) by the lighting spectrum may be displayed similarly to the general color of the product (100).

[0084] That is, in the above product (100), the color of the reflected light reflected from the part where a crack has occurred as a specific state is expressed as the target color Red, but the reflected light may also be displayed as Red or a color similar to Red in the part of the above product (100) where the crack has not occurred. In this case, it is difficult to identify the crack, which is the state information of the above product (100), using the reflected light or transmitted light of the above product (100), and thus it is difficult to accurately or precisely analyze the state of the above product.

[0085] Accordingly, the selection unit (220) may re-select the target color from Red to Green to identify the crack, thereby allowing the design unit (230) to redesign the lighting spectrum. Thus, if it is confirmed through the prediction unit (240) that the reflected light or transmitted light caused by the crack is finally displayed as Green as the target color, and the reflected light or transmitted light in the part where the crack did not occur is displayed as Red, the lighting spectrum can be finally designed by setting the target color to Green.

[0086] Meanwhile, as described above, in addition to reselecting the color to a different color, the target color may be finally designed by maintaining the target color as Red while varying the saturation or vividness, that is, through reselection via color amplification.

[0087] As described above, through the feedback of the prediction unit (240), the selection unit (220), and the design unit (230), the lighting spectrum finally designed in the design unit (230) should be designed to further improve the ability to distinguish reflected light or transmitted light according to the state of the product (100).

[0088] As described above, when the lighting spectrum (231) is finally designed through the design unit (230), the lighting unit (300) provides the lighting (310) to the product (100) based on the designed lighting spectrum (231).

[0089] At this time, the spectrum included in the lighting (310) includes the designed lighting spectrum, and the designed lighting spectrum is configured such that specific wavelengths are selected or the intensity of specific wavelengths is selected, as previously explained.

[0090] Furthermore, the lighting (310) is white light and is displayed as white until it is reflected by the product (100). That is, the spectrum of the lighting (310) is such that various wavelengths are selected or the intensities of specific wavelengths are selected differently, and depending on the state of the product (100), it displays reflected light or transmitted light of a specific color, but is ultimately displayed as white light externally.

[0091] Ultimately, this means that the wavelengths constituting the illumination spectrum must be represented as white light. That is, the illumination may be light composed of at least one combination of monochromatic light of different wavelengths, and the wavelength of the monochromatic light must be at least one of the two endpoints of a line extending in the color space (241) of FIG. 2, or at least one of the vertices of a polygon formed in the color space.

[0092] That is, each wavelength of the monochromatic lights constituting the lighting spectrum may be a wavelength corresponding to the vertices of a polygon formed as an expression region in the color space (241), or a wavelength corresponding to one of the two endpoints of an arbitrary line extending in the color space (241). As such, as the wavelength is selected, the light displayed through the lighting spectrum is expressed as white light. Thus, while the lighting spectrum is expressed as white light overall, the wavelengths constituting it are different, so the reflected light or transmitted light may be displayed in different colors depending on the specific state of the product (100). At this time, in addition to displaying different colors, different color amplification may be performed to configure the saturation differently or the vividness differently.

[0093] As described above, when the lighting (310) configured as described above is provided to the product (100) from the lighting unit (300), the environment in which the product (100) is located is displayed as white overall; that is, the light displayed through the lighting (310) is white, but the reflected light or transmitted light that is reflected or transmitted according to a specific state of the product (100) is displayed as a color other than white. Here, the other color may be a pre-set target color, as previously explained.

[0094] Accordingly, the sensor unit (400) senses reflected light or transmitted light that is reflected according to the characteristic state of the product (100) (although only reflected light is exemplified in FIG. 1, as previously explained, if the product (100) includes a transparent material, it may be transmitted light).

[0095] Meanwhile, in the above product (100), reflected light or transmitted light in areas other than the reflected light or transmitted light reflected from a part where a crack occurs, a part where a specific transparent element is located, etc., may be displayed as another color or another amplified color according to the lighting spectrum. Accordingly, as previously explained, the prediction unit (240) selects the target color by considering the color of the reflected light or transmitted light in the area.

[0096] That is, the sensor unit (400) senses reflected light or transmitted light due to a specific state of the product (100), and the reflected light or transmitted light sensed in this way has high distinguishability compared to the reflected light or transmitted light in other areas. At this time, the sensor unit (400) may be an image sensor or a photodiode sensor, and the type of sensor is not limited, and it is sufficient to acquire the optical signal of the reflected light or transmitted light.

[0097] Accordingly, the sensing information of the reflected light or transmitted light sensed by the sensor unit (400) is provided to the judgment unit (500), and the judgment unit (500) performs a determination on the state of the product (100).

[0098] That is, the above judgment unit (500) can determine information regarding a specific state of the product (100), such as the degree or area where a crack has occurred, the area or mounting state where a specific component is mounted, etc., and through this, can also determine whether there is a process defect, etc. of the product (100).

[0099] As described above, in the product judgment system (10) according to the present embodiment, the judgment unit (500) performs information judgment regarding the state of the product (100).

[0100] Furthermore, the product judgment system (10) according to the present embodiment may perform a predetermined process feedback control based on information regarding the state of the product (100) determined in this way.

[0101] Such process feedback control may be applied directly to the process of producing the product (100) and performed in real time, and may also be utilized as subsequent control information when producing a product identical to the product (100) in the future by considering the state information of the product (100).

[0102] That is, the control unit (600) controls the operation of the process unit (150) that performs a predetermined process on the product (100) based on the result of the determination of the state of the product (100) by the determination unit (500). To this end, a separate database in which the result of the determination of the state of the product (100) is stored may be utilized.

[0103] At this time, the type of the process unit (150) is not limited, and accordingly, the process performed on the product (100) is not limited to a specific process. For example, if the product (100) is a display device and the process unit (150) is manufacturing equipment for the display device, the judgment unit (500) can determine that an alignment error is included in the mounting position of a specific display element. Accordingly, the control unit (600) can control the process equipment of the process unit (150) based on the judgment information of the judgment unit (500) to induce the minimization of the alignment error regarding the mounting position of the display element.

[0104] In contrast, if the above product (100) is a semiconductor substrate and the above process unit (150) is manufacturing equipment for the semiconductor substrate, the judgment unit (500) can determine that a crack has occurred in the semiconductor substrate. Accordingly, the control unit (600) can perform feedback control on the process unit (150) to remove foreign substances during the process by performing a process such as cleaning on the process equipment of the above process unit (150) based on the judgment information of the above judgment unit (500).

[0105] Furthermore, the control unit (600) can perform various feedback controls in real time for the process of the product (100) in addition to the process control exemplified above.

[0106] In the following, a product determination method using the above-mentioned product determination system (10) is described, focusing on the characteristics of the steps of the above-mentioned product determination method, and descriptions that overlap with the above-mentioned product determination system (10) are omitted.

[0107] FIG. 3 is a flowchart illustrating a product judgment method using the product judgment system of FIG. 1. FIG. 4 is a flowchart illustrating the steps for designing the optimal lighting spectrum of FIG. 3.

[0108] Referring to FIG. 3, in a product determination method using the product determination system (10), first, the calculation unit (200) designs a lighting spectrum to determine the state of the product (100) (step S10).

[0109] In the step of designing the lighting spectrum (step S10), as shown in FIG. 4, first, spectrum information according to the state of the product (100) is obtained from the storage unit (210) and stored (step S11).

[0110] Afterwards, based on the spectrum information according to the state of the product (100) stored in the storage unit (210), the selection unit (220) selects a specific target color according to the state of the product (100) (step S12).

[0111] Afterward, the design unit (230) designs the lighting spectrum based on the spectrum of the product and the target color (step S13). However, in some cases, it may be difficult to clearly identify the state of the product (100) with the designed lighting spectrum.

[0112] Accordingly, whether the state of the above product (100) can be identified more accurately and precisely is checked in advance by the result predicted by the prediction unit (240). That is, through the prediction unit (240), the color of the reflected light or transmitted light is predicted according to the state characteristics of the above product (100) by the lighting spectrum designed by the design unit (230) (step S14).

[0113] Thus, it is determined whether the predicted color of the reflected light or transmitted light is appropriate, and whether the designed lighting spectrum needs to be redesigned (step S15). That is, if the color of the predicted reflected light or transmitted light has low distinguishability from colors generally expressed other than those expressed according to the state of the product (100), or has low distinguishability from the colors of the surrounding environment, the lighting spectrum is redesigned. Accordingly, the selection unit (220) selects the target color again (step S12), and based on this, the design unit (230) redesigns the lighting spectrum (step S13).

[0114] Furthermore, this redesign of the lighting spectrum can be performed repeatedly until it is determined that the color discrimination of the predicted reflected or transmitted light is high, thereby designing an optimal lighting spectrum (step S10).

[0115] After that, the lighting unit (300) provides lighting (310) including the designed lighting spectrum to the product (100) (step S20), and the sensor unit (400) measures a light signal that is reflected from or transmitted through the product (100) (step S30).

[0116] At this time, the light signal sensed by the sensor unit (400) corresponds to a light signal of reflected light or transmitted light that is reflected or transmitted according to the state characteristics of the product (100), and the light signal thus obtained is provided to the judgment unit (500). Of course, through the sensor unit (400), in addition to the light signals of reflected light and transmitted light according to the state characteristics of the product (100), a light signal of reflected light or transmitted light for the general product (100) that is unrelated to the state characteristics of the product (100) can also be sensed for comparison.

[0117] Afterward, the judgment unit (500) determines information regarding the state of the product (100) based on the optical signal measured through the sensor unit (400) (step S40). At this time, since the optical signal corresponds to an optical signal having a higher identification power regarding the state of the product (100), it is easier to determine various state characteristics of the product (100).

[0118] Thus, a determination of the state of the product (100) is performed, and furthermore, the control unit (600) feedback controls the process unit (150) that performs the process on the product (100) based on the result of determining the state of the product (100) (step S50).

[0119] The feedback control of the above-mentioned process unit (150) may be real-time feedback control, as previously explained, or it may be performed by adding control factors when performing the relevant process of the product to be performed in the future.

[0120] Below, an example of determining the state of a product using the product determination system (10) according to the present embodiment is described in detail.

[0121] FIG. 5a is a schematic diagram illustrating a defect detection state of a product according to the prior art, and FIG. 5b is a schematic diagram illustrating a defect detection state of a product using the product judgment system of FIG. 1.

[0122] First, referring to FIG. 5a, when detecting defects in a product (100) using a conventional general lighting unit (30), the lighting (31) provided through the general lighting unit (30) is not designed with a separate spectrum, so it is difficult to identify a separate defect (110) contained in the product (100) through light reflected from or transmitted through the product (100). In other words, since it is merely a matter of increasing the illuminance of the product (100) through the lighting unit (30) to identify defects, the identification of the defect (110) is not easy.

[0123] In contrast, referring to FIG. 5b, when detecting defects of the product (100) using the lighting unit (300) according to the present embodiment, the lighting (310) provided through the lighting unit (300) is in a state where an optimal spectrum design is performed so that various defects (111, 112) included in the product (100) can be displayed in a specific color.

[0124] Accordingly, as shown in FIG. 5b, defects included in the product (100) can be displayed in different colors depending on their type through light reflected from or transmitted through the product (100). That is, defects included in the product (100), such as cracks (111), can be displayed in a first color, and defects included in the product, such as breakage (112), can be displayed in a second color.

[0125] At this time, the lighting (310), excluding reflected light or transmitted light reflected by defects in the product (100), displays white light. Accordingly, when the surrounding environment is induced to white light, the defects (111, 112) are displayed in different colors according to their type, so that the user can identify the defect more precisely and accurately, and thereby determine the type and condition of the defect in more detail.

[0126] In this way, the defect is externally displayed with high identifiability in different colors according to its type, as previously explained, because the spectral characteristics of the lighting (310) are optimized and selected based on the information regarding the characteristics of the spectral of each defect stored, and accordingly, the state of the defect can be expressed in a specific color due to the spectral characteristics of the lighting (310).

[0127] Meanwhile, in addition to identifying defects as specific states included in the product (100) as described above, it is also possible to induce identification by distinguishing each component of the product (101) as specific states included in the product (100).

[0128] FIG. 6a is a schematic diagram illustrating the state of circuit element detection of a product according to the prior art, and FIG. 6b is a schematic diagram illustrating the state of circuit element detection of a product using the product judgment system of FIG. 1.

[0129] First, referring to FIG. 6a, when detecting components of a product (101) using a conventional general lighting unit (30), the lighting (31) provided through the general lighting unit (30) is not subject to a separate spectrum design, so it is difficult to distinguish and identify the components (120) included in the product (101) from one another through the light reflected from or transmitted through the product (101). In other words, since it is merely a matter of increasing the illuminance of the product (101) through the lighting unit (30) to identify the combination, identification of the components (120) is not easy.

[0130] In contrast, referring to FIG. 6b, when the components of the product (101) are detected using the lighting unit (300) according to the present embodiment, the lighting (310) provided through the lighting unit (300) is in a state where an optimal spectrum design is performed so that the various components (121, 122) included in the product (101) can be displayed differently in specific colors.

[0131] Accordingly, as shown in FIG. 6b, the components included in the product (101) can be displayed in different colors according to their type through light reflected from or transmitted through the product (101). That is, as a component included in the product (101), the first element (121) can be displayed in a first color, and as a component included in the product, the second element (122) can be displayed in a second color. Furthermore, as other components included in the product, circuit wiring can also be displayed in different colors according to their type.

[0132] At this time, the lighting (310), excluding reflected light or transmitted light reflected by defects in the product (101), displays white light. Accordingly, when the surrounding environment is induced to white light, the components (121, 122) are displayed in different colors according to their type, so that the user can identify the components more precisely and accurately, and thereby determine the type and condition of the defect in more detail.

[0133] In this way, the components are displayed externally with high distinctiveness in different colors according to their type, as previously explained, because the spectral characteristics of the lighting (310) are optimized and selected based on information regarding the spectral characteristics of the stored components, and accordingly, the components can be expressed in specific colors due to the spectral characteristics of the lighting (310).

[0134] Furthermore, if the above product (102) includes different characteristics, for example, material characteristics depending on the position in the depth direction, it may also be possible to identify them.

[0135] FIG. 7a is a schematic diagram illustrating the state of depth direction detection of a product according to the prior art, and FIG. 7b is a schematic diagram illustrating the state of depth direction detection of a product using the product judgment system of FIG. 1.

[0136] First, referring to FIG. 7a, when detecting different characteristics in the depth direction of a product (102) using a conventional general lighting unit (30), the lighting (31) provided through the general lighting unit (30) is not designed with a separate spectrum, so it is difficult to distinguish and identify different characteristics (130) in the depth direction (H) of the product (102) through the light reflected from or transmitted through the product (102). That is, as the lighting (31) is provided with only one spectrum, the light reflected from or transmitted through the product (102) is displayed as a constant color regardless of the characteristics (130).

[0137] In contrast, referring to FIG. 7b, when different characteristics in the depth direction of the product (102) are detected using the lighting unit (300) according to the present embodiment, the lighting (310) provided through the lighting unit (300) has an optimal spectrum design so that the characteristics at each depth (h) can be displayed differently in specific colors for the various characteristics in the depth direction (H) of the product (102).

[0138] Accordingly, as shown in FIG. 7b, through light reflected from or transmitted through a specific depth of the product (102), the characteristics in the depth direction included in the product (102) can be displayed in different colors according to each depth. That is, if the product (102) includes specific characteristics, for example, material characteristics due to including a specific material at a specific depth (h), and has different characteristics for each depth, at the specific depth (h), it can be displayed in a first color due to the material characteristics of that depth, and at another specific depth, it can be displayed in a second color due to another material characteristics of that depth.

[0139] At this time, the lighting (310), excluding reflected light or transmitted light reflected by the characteristics in the depth direction of the product (102), displays white light. Accordingly, the user can more precisely and accurately identify the characteristics at a specific depth in the depth direction of the product (102) through a state in which different colors are displayed according to the characteristics in the depth direction while the surrounding environment is induced to white light, and thereby determine the condition of the product (102) in more detail.

[0140] In this way, various characteristics such as material properties that a product may possess are displayed externally with high distinctiveness in different colors according to their type, because the spectral characteristics of the lighting (310) are optimized and selected based on information regarding the spectral characteristics according to the previously stored product characteristics, as explained above. Accordingly, different characteristics in the depth direction can be expressed in different colors due to the spectral characteristics of the lighting (310). Through this, the state of the product (102) according to depth can be analyzed more precisely and accurately.

[0141] Furthermore, through FIGS. 7a and 7b, different characteristics in the depth direction of the product (102) are illustrated, but are not limited thereto. Even if the product (102) has different characteristics in the width direction or different characteristics in each area, it can be displayed externally in different colors according to each characteristic, and through this, information such as the state according to the width and the state according to the area of ​​the product (102) can be accurately determined.

[0142] According to the embodiments of the present invention as described above, by designing an illumination spectrum to determine a specific state of a product, more precise and accurate detection of the corresponding state is possible, thereby enabling real-time identification of the specific state of a sensitive product.

[0143] In this case, although the light provided through the lighting is the same white light, the spectrum constituting the white light is designed to be diverse, so a specific state of the product can be detected according to the designed spectrum. That is, even if the same white light is provided, the reflected light or transmitted light is displayed in different colors depending on the state of the product, so the state of the product can be detected more precisely and accurately based on the color in which the reflected or transmitted light is displayed.

[0144] At this time, in addition to being displayed in different colors, the same color may be displayed through color amplification, but with different saturation or vividness, and detection of the state of the product can also be performed through this.

[0145] Meanwhile, regarding the target color displayed according to the state of the product, the ability to distinguish it may be reduced depending on the color of the product's general reflected or transmitted light, the color of the surrounding environment, etc. In this case, the selection unit can further improve the ability to distinguish the state of the product by varying the target color.

[0146] In other words, since there is at least one spectral information identifying the same product state, selecting a different spectrum induces the implementation of a different target color, thereby enabling a judgment on the product state to be performed with enhanced discriminability for the same product state.

[0147] At this time, when selecting the light of the illumination, monochromatic lights corresponding to at least one of the two endpoints of a line extending in the color space or at least one of the vertices of a polygon formed in the color space are selected and combined to form the light, thereby enabling the formation of combinations having various spectra even for a single product state, and thus allowing the target color according to the product state to be varied in various ways.

[0148] Furthermore, based on the determination result of the product status, the process unit performing the process on the product can be feedback-controlled in real time, thereby improving the process to minimize the occurrence of damage or defects to a specific product and further improving the quality of the final product.

[0149] Thus, by overcoming the limitations of detection resolution when using only conventional cameras or sensors, the product recognition rate can be improved, and thereby, the quality of the final product can be enhanced.

[0150] Although the present invention has been described above with reference to preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the invention without departing from the spirit and scope of the invention as set forth in the following claims.

Claims

1. A computing unit that designs a lighting spectrum to determine the product status; A lighting unit that provides lighting to the product with the lighting spectrum designed above; A sensor unit for measuring a light signal reflected or transmitted from the product according to the provision of the above lighting; and A product judgment system comprising a judgment unit that determines the product state based on the measured optical signal.

2. In Paragraph 1, A product judgment system characterized in that the lighting provided to the above product is white light and is composed of at least one monochromatic light of a different wavelength combined.

3. In paragraph 2, the wavelength of the monochromatic light is, A product judgment system characterized by being at least one of the two endpoints of a line extending in a color space, or at least one of the vertices of a polygon formed in a color space.

4. In paragraph 1, the above-mentioned operation unit is, A storage unit that stores spectrum information according to the above product state; A selection unit for selecting the target color according to the above product state; and A product judgment system characterized by including a design unit that designs the lighting spectrum based on the spectrum of the above-mentioned product and the above-mentioned target color.

5. In paragraph 4, the spectrum information according to the product state is, A product determination system characterized by information in which the transmission spectrum or reflection spectrum varies depending on the state of the above-mentioned product.

6. In paragraph 5, the state having of the above product is, A product determination system characterized by damage caused during the manufacturing process of the above-mentioned product, components included in the above-mentioned product, or characteristics in the depth or width direction of the above-mentioned product.

7. In Paragraph 4, the above target color is, A product judgment system characterized by a color displayed according to the state of the product, among reflected light reflected from the product or transmitted light transmitted through the product.

8. In Paragraph 7, Spectral information for the same product condition is at least one or more, and A product determination system characterized in that, even for the same product state, the target color varies as the spectrum information varies.

9. In Paragraph 8, A product judgment system characterized by the above target color being variable to different colors, or having different saturation or different vividness while remaining the same color.

10. In paragraph 8, the above-mentioned operation unit is, It further includes a prediction unit that predicts the color of reflected light or transmitted light reflected from the product according to the lighting spectrum designed above, and A product judgment system characterized by the above selection unit re-selecting the target color based on the prediction result of the above prediction unit.

11. In Paragraph 1, A product determination system further comprising a control unit that provides feedback control to a process unit performing a process on the product based on the determination result of the product state.

12. A step of designing a lighting spectrum to determine the product condition; A step of providing illumination to the product with the above-designed illumination spectrum; A step of measuring a light signal reflected or transmitted from the product according to the provision of the above lighting; and A product determination method comprising the step of determining the product state based on the measured optical signal.

13. In Clause 12, the step of designing the illumination spectrum is, A step of storing spectrum information according to the above product state; Step of selecting a target color according to the above product condition; and A product determination method characterized by including the step of designing the lighting spectrum based on the product spectrum and the target color.

14. In Paragraph 13, A step of predicting the color of reflected light or transmitted light reflected from the product according to the designed lighting spectrum; and A product judgment method further comprising the step of re-selecting the target color based on the above prediction result.

15. In Paragraph 13, The above target color is a color displayed according to the state of the product, among the reflected light reflected from the product or the transmitted light transmitted through the product. A product determination system characterized in that the state of the above product is damage caused during the manufacturing process of the above product, components included in the above product, or characteristics in the depth or width direction of the above product.

16. In Paragraph 12, A product determination method further comprising the step of feedback-controlling a process unit that performs a process on the product based on the determination result of the product state.

17. In Paragraph 12, A method for determining a product, characterized in that the lighting provided to the above product is white light and is composed of at least one monochromatic light of a different wavelength combined.

Images