Wavelength-selective infrared sensor-based thermal image colorization system and thermal image colorization method using the same

Abstract

In a thermal imaging colorization system based on a wavelength-selective infrared sensor and a thermal imaging colorization method using the same, the thermal imaging colorization system comprises a measurement unit and a computational unit. The measurement unit includes an infrared sensor section that selectively senses infrared radiation of different wavelength regions for infrared radiation incident from a target object. The computational unit includes a color conversion processing section that matches the colors for each thermal image to the infrared radiation of different wavelength regions for the sensed results of the infrared sensor section, thereby creating an image of the infrared radiation of different wavelength regions.

Description

Technology Field

[0001] The present invention relates to a thermal imaging colorization system based on a wavelength-selective infrared sensor and a thermal imaging colorization method using the same. More specifically, it relates to a thermal imaging colorization system based on a wavelength-selective infrared sensor that utilizes a wavelength-selective infrared sensor having two or more degrees of freedom to maximize visibility, respond to infrared camouflage in real time, and enable miniaturization, and a thermal imaging colorization method using the same. Background Technology

[0002] Generally, infrared thermal imaging cameras acquire thermal signals using a single type of sensor, extract temperature information, and visualize it, allowing users to determine the temperature of an object or recognize it through temperature differences.

[0003] In the case of such infrared cameras, since temperature information can be acquired regardless of the infrared wavelength range, using filters or sensors for different wavelengths does not generate additional functional utility.

[0004] Meanwhile, infrared sensors are primarily used to eliminate or block infrared or near-infrared light during the measurement of visible light, as seen in U.S. Patent No. 10764515 or U.S. Patent No. 9848118; this also involves the application of a single type of infrared sensor to filter infrared light within the required wavelength range.

[0005] Of course, as disclosed in Korean Patent Publication No. 10-2023-0013530, a technology for deriving an infrared spectrum by spectrally separating infrared rays by wavelength or type through a single spectroscopic filter is disclosed, but this is merely a technology regarding a spectrometer that spectrally separates infrared rays by wavelength.

[0006] In other words, while technology capable of extracting more objective and accurate information about objects by sensing infrared radiation with different sensors based on wavelength has not yet been developed, the need for related technology is increasing, particularly with the recent advancements in infrared camouflage technology, in order to neutralize such camouflage techniques. Prior art literature

[0007] U.S. Registered Patent No. 10764515 U.S. Registered Patent No. 9848118 Republic of Korea Published Patent No. 10-2023-0013530 The problem to be solved

[0008] Accordingly, the technical problem of the present invention is conceived from this point, and the objective of the present invention is to provide a wavelength-selective infrared sensor-based thermal imaging colorimetry system that maximizes visibility, responds to infrared camouflage in real time, and is miniaturizable by using a wavelength-selective infrared sensor having two or more degrees of freedom.

[0009] In addition, another objective of the present invention is to provide a thermal image colorization method using the thermal image colorization system. means of solving the problem

[0010] A thermal image colorization system according to one embodiment for realizing the above-described objective of the present invention includes a measurement unit and a computation unit. The measurement unit includes an infrared sensor section that selectively senses infrared rays of different wavelength regions with respect to infrared rays incident from a target object. The computation unit includes a color conversion processing section that matches the colors for each thermal image with respect to the infrared rays of different wavelength regions based on the sensed results of the infrared sensor section, thereby creating an image of the infrared rays of different wavelength regions.

[0011] In one embodiment, the color conversion processing unit can generate thermal images of infrared rays in different wavelength regions and match a predetermined primary color to each thermal image, thereby performing imaging of an object using the matched primary color.

[0012] In one embodiment, the infrared sensor unit may include a sensor unit comprising a sensor that selectively senses infrared rays in different wavelength regions, and a base substrate on which the sensor unit is mounted and a circuit is formed to transmit signals sensed by each of the sensors to the color conversion processing unit.

[0013] In one embodiment, the sensors may be positioned such that at least two or more are spaced apart from each other.

[0014] In one embodiment, at least two sensors are arranged overlapping each other along the incident direction of the infrared rays, and the sensor located at the top along the incident direction of the infrared rays can transmit infrared rays in the wavelength range measured by the sensor located at the bottom.

[0015] In one embodiment, the infrared wavelength that the sensor senses can be varied according to an input signal input from the base substrate.

[0016] In one embodiment, the infrared sensor unit may include a filter that selectively transmits infrared rays in different wavelength regions, a filter substrate on which the filter is mounted, a sensor unit including a sensor aligned with the filter and which senses infrared rays of a specific wavelength transmitted through the filter, and a base substrate on which the sensor unit is mounted and which has a circuit formed to transmit signals sensed by each of the sensors to the color conversion processing unit.

[0017] In one embodiment, at least two filters are positioned spaced apart from each other, and at least two sensors may be provided to be aligned with each of the spaced-apart filters.

[0018] In one embodiment, the infrared wavelength transmitted by the filter varies according to an input signal input from the filter substrate, and the sensor may be provided on the sensor unit so as to be aligned with the filter.

[0019] In one embodiment, the filter comprises at least two filters, each having a width equal to the width of the base substrate, and the filter substrate can move horizontally on the upper part of the base substrate to change the filters that overlap with the base substrate.

[0020] In one embodiment, the infrared sensor unit may include a first filter that selectively transmits infrared rays of different wavelength regions, a first filter substrate on which the first filter is mounted, a second filter that selectively transmits infrared rays of a wavelength region different from that of the first filter, a second filter substrate disposed below the first filter substrate on which the second filter is mounted, a sensor unit including a sensor aligned with the first and second filters and sensing infrared rays of a specific wavelength transmitted through the first and second filters, and a base substrate on which the sensor unit is mounted and a circuit is formed to transmit signals sensed by each of the sensors to the color conversion processing unit.

[0021] In one embodiment, the first filter includes at least two filters, each having a width equal to the width of the base substrate, and the second filter also includes at least two filters, each having a width equal to the width of the base substrate, and each of the first and second filter substrates can move horizontally on the upper part of the base substrate to change the filters that overlap with the base substrate.

[0022] In one embodiment, a plurality of sensor units may be mounted in a matrix array on the base substrate.

[0023] A thermal image colorization method according to one embodiment for realizing the above-described objective of the present invention comprises the steps of: selectively sensing infrared rays of different wavelength regions with respect to infrared rays incident from a target object; generating a thermal image for each infrared ray of a different wavelength region with respect to the sensed infrared rays; matching a predetermined primary color to each thermal image; and performing imaging of the target object with the matched primary color. Effects of the invention

[0024] According to embodiments of the present invention, by imaging infrared rays of different wavelength regions into visible light of different colors, it is possible to more accurately identify object that cannot be distinguished by simple infrared thermal images.

[0025] That is, by sensing infrared rays in different wavelength ranges using different sensors or different filters, thermal images are acquired for each wavelength range of the infrared rays, and by matching a predetermined visible light color to the acquired thermal images, visible light imaging can be performed on the infrared rays acquired from the target object. In particular, visible light imaging of an infrared camouflaged target object is possible, thereby improving the identification capability of the target object.

[0026] In this case, the array of sensors for distinguishing and sensing infrared rays in different wavelength ranges can be configured in various ways, and similarly, the array of filters that transmit infrared rays in different wavelength ranges can also be configured in various ways; therefore, by applying various sensors and filters, thermal images of infrared rays can be extracted by wavelength. Brief explanation of the drawing

[0027] FIG. 1 is a block diagram illustrating a thermal image colorization system according to one embodiment of the present invention. Figure 2 is a schematic diagram illustrating the infrared sensor section of Figure 1. FIG. 3 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention. FIG. 4 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention. FIG. 5 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention. FIG. 6 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention. FIG. 7 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention. FIG. 8 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention. FIG. 9a is a graph showing examples of spectra for each sensor of the infrared sensor unit of FIG. 2 to 4, and FIG. 9b is a graph showing transmission spectra for each filter of the infrared sensor unit of FIG. 5 to 8. Figure 10 is a flowchart illustrating each step and the result of each step of a thermal image colorization method using the thermal image colorization system of Figure 1. FIG. 11a is an example of a visible light image of an actual camouflaged object, FIG. 11b is an image of the measurement result of an infrared sensor according to the prior art for the camouflaged object of FIG. 11a, and FIG. 11c is an image of the thermal image colorization result of FIG. 10 for the camouflaged object of FIG. 11a. Specific details for implementing the invention

[0028] The present invention is susceptible to various modifications and may take various forms, and embodiments are to be described in detail in the text. However, this is not intended to limit the invention to the specific disclosed forms, and it should be understood that the invention includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the invention. Similar reference numerals have been used for similar components in the description of each figure. Terms such as "first," "second," etc., may be used to describe various components, but said components should not be limited by said terms.

[0029] The above terms are used solely for the purpose of distinguishing one component from another. The terms used in this application are used merely to describe specific embodiments and are not intended to limit the invention. The singular expression includes the plural expression unless the context clearly indicates otherwise.

[0030] In this application, terms such as "comprising" or "consisting of" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0031] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0032] Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the attached drawings.

[0033] FIG. 1 is a block diagram illustrating a thermal image colorization system according to one embodiment of the present invention.

[0034] Referring to FIG. 1, the thermal image colorization system (10) according to the present embodiment includes a measurement unit (100) and a calculation unit (300). The measurement unit (100) includes an infrared lens (60), a cooling unit (110), and an infrared sensor unit (200). The calculation unit (300) includes a color conversion processing unit (310), a control unit (330), and a display unit (320).

[0035] That is, infrared rays generated from an object (not shown) are incident on the infrared sensor unit (200) through the infrared lens (60) from outside the measurement unit (100).

[0036] At this time, the infrared sensor unit (200), although detailed embodiments will be described later, is a wavelength-selective infrared sensor that distinguishes the wavelength range of incident infrared light, and each sensor performs sensing for different wavelengths separately.

[0037] That is, the infrared sensor unit (200) includes at least two sensors that distinguish and detect at least two different infrared wavelength regions, and through this, at least two different infrared wavelength ranges can be sensed through each different sensor.

[0038] At this time, at least two or more of the infrared wavelength regions that are detected separately are sufficient, and the number is not limited. In addition, the number of sensors included in the infrared sensor unit (200) can also be determined according to the number of infrared wavelength regions that are detected separately.

[0039] The specific infrared sensor unit (200) described above will be described later.

[0040] The cooling unit (110) may be optionally provided. For example, if the infrared sensor unit (200) includes a photoelectric sensor used for measuring infrared radiation in the mid-infrared range of 3 to 5 μm, the cooling unit (110) must be provided as a thermoelectric cooler. However, if the infrared sensor unit (200) includes a bolometer sensor used for measuring infrared radiation in the far-infrared range of 7 to 14 μm, the cooling unit (110) may be omitted.

[0041] The color conversion processing unit (310) processes the signal sensed by the infrared sensor unit (200) to form an image, and the specific details of the image processing in the color conversion processing unit (310) will be explained with reference to FIG. 10, which will be described later.

[0042] The display unit (320) displays the image processing result from the color conversion processing unit (310) externally, and through the display unit (320), the user can identify an image in which the infrared signal obtained from the object is visualized.

[0043] The control unit (330) controls various operations of the color conversion processing unit (310), the display unit (320), and the infrared sensor unit (200).

[0044] Below, first, a specific configuration for individually sensing infrared rays in different wavelength ranges through the infrared sensor unit (200) is described.

[0045] Figure 2 is a schematic diagram illustrating the infrared sensor section of Figure 1.

[0046] Referring to FIG. 2, the infrared sensor unit (200) in the present embodiment includes a base substrate (290) and a plurality of sensor units (210) mounted on the base substrate (290).

[0047] At this time, the sensor units (210) can be mounted in a matrix array of M*L (M and L are each natural numbers) on the base substrate (290) as illustrated.

[0048] The base substrate (290) is a predetermined circuit board, and a circuit is formed to transmit signals sensed by each of the sensor units (210) to the color conversion processing unit (310), and furthermore, if necessary, an electrical signal for the operation of the sensor units (210) may be transmitted.

[0049] Each of the above sensor units (210) includes three different sensors (211, 212, 213) spaced apart from each other, as illustrated. In this case, although the drawing illustrates an arrangement of three different sensors (211, 212, 213), the sensors (211, 212, 213) may be arranged in two or four or more, and are not necessarily limited to three. However, for convenience of explanation, the following description exemplifies that both the sensors and the filters described later are composed of three.

[0050] Furthermore, although the three sensors (211, 212, 213) are each represented as R (red), G (green), and B (blue) and are depicted as sensing red, green, and blue light in visible light, this is for the convenience of explanation and understanding, and since they are not sensors that sense visible light, they are not sensors that sense red light, green light, and blue light.

[0051] However, each of the three sensors (211, 212, 213) senses infrared light of a different wavelength range for the incident infrared light (50), similar to how they sense visible light of different wavelengths such as red, green, and blue light of visible light.

[0052] That is, referring to FIG. 9a described later, the first sensor (211) can sense infrared radiation between a first wavelength (λ1) and a second wavelength (λ2) with respect to the infrared radiation (50), the second sensor (212) can sense infrared radiation between a second wavelength (λ2) and a third wavelength (λ3) with respect to the infrared radiation (50), and the third sensor (213) can sense infrared radiation between a third wavelength (λ3) and a fourth wavelength (λ4) with respect to the infrared radiation (50).

[0053] In this case, the first to fourth wavelengths can be arbitrarily selected from the wavelength range belonging to the infrared (50) and do not necessarily need to be set at equal intervals.

[0054] Additionally, the first to third sensors (211, 212, 213) may be arranged in a rectangular shape that is long in the longitudinal direction on a single sensor unit (210) as illustrated, but are not limited thereto and may be arranged in various shapes such as triangles, circles, and ellipses.

[0055] As described above, the first to third sensors (211, 212, 213) can be arranged in any array structure and shape on a single sensor unit (210), and the range of infrared wavelengths that each senses is different from each other, thereby allowing infrared rays in different wavelength regions to be sensed and provided to the color conversion processing unit (310).

[0056] FIG. 3 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention.

[0057] The thermal image colorization system according to the present embodiment is substantially the same as the thermal image colorization system (10) described with reference to FIGS. 1 and FIGS. 2, except for the structure of the sensor unit (220), so redundant descriptions are omitted.

[0058] Referring to FIG. 3, in the thermal imaging colorization system of the present embodiment, the infrared sensor unit (201) includes a base substrate (290) and a sensor unit (220).

[0059] In this case, as illustrated, the sensor unit (220) may be mounted in a matrix array of M*L (M and L are each natural numbers) on the base substrate (290).

[0060] Additionally, each sensor unit (220) includes at least two sensors (221, 222, 223) that are stacked on top of each other.

[0061] That is, unlike the arrangement in FIG. 2 where the first to third sensors (221, 222, 223) are spaced apart from each other and overlap, they occupy most of the area of ​​the sensor unit (220) and each overlaps with each other along the direction in which the infrared (50) is incident.

[0062] At this time, the first sensor (221) can sense infrared radiation (first section) between a first wavelength (λ1) and a second wavelength (λ2) with respect to the infrared radiation (50) as in FIG. 9a, the second sensor (222) can sense infrared radiation (second section) between a second wavelength (λ2) and a third wavelength (λ3) with respect to the infrared radiation (50), and the third sensor (223) can sense infrared radiation (third section) between a third wavelength (λ3) and a fourth wavelength (λ4) with respect to the infrared radiation (50).

[0063] Furthermore, since the first to third sensors (221, 222, 223) are stacked on top of each other and have different infrared wavelength ranges for sensing, the first sensor (221) must be able to transmit light to a wavelength range outside the first range, and likewise, the second sensor (222) must be able to transmit light to a wavelength range outside the second range. Thus, the first to third sensors (221, 222, 223) can sequentially perform sensing of infrared light in different wavelength ranges.

[0064] As described above, as the first to third sensors (221, 222, 223) are formed by overlapping, the area occupied by each sensor increases compared to FIG. 2, and the sensitivity of the sensor can be improved.

[0065] FIG. 4 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention.

[0066] The thermal image colorization system according to the present embodiment is substantially the same as the thermal image colorization system (10) described with reference to FIGS. 1 and FIGS. 2, except for the structure of the sensor unit (230), so redundant descriptions are omitted.

[0067] Referring to FIG. 4, in the thermal imaging colorization system of the present embodiment, the infrared sensor unit (202) includes a base substrate (290) and a sensor unit (230).

[0068] In this case, as illustrated, the sensor unit (230) may be mounted in a matrix array of M*L (M and L are each natural numbers) on the base substrate (290).

[0069] Additionally, each sensor unit (230) is composed of a single variable sensor (231). At this time, the area of ​​the variable sensor (231) may occupy most of the area of ​​the sensor unit (220).

[0070] The above variable sensor (231) measures an infrared wavelength that varies according to the input signal, and the variation of the signal input to the variable sensor (231) through the base substrate (290) can be pre-set and controlled.

[0071] Thus, the variable sensor (231) can sense infrared radiation (first section) between a first wavelength (λ1) and a second wavelength (λ2) for the infrared radiation (50) as shown in FIG. 9a upon receiving a first signal, and the variable sensor (231) can sense infrared radiation (second section) between a second wavelength (λ2) and a third wavelength (λ3) for the infrared radiation (50) as received a second signal, and furthermore, the variable sensor (231) can sense infrared radiation (third section) between a third wavelength (λ3) and a fourth wavelength (λ4) for the infrared radiation (50) as received a third signal.

[0072] As described above, since the variable sensor (231) senses infrared rays in different wavelength ranges according to the input signal, it can selectively sense infrared rays in the required wavelength range, and since the area occupied by the variable sensor (231) is formed relatively wide as shown in FIG. 3, the sensitivity of the sensor can be improved.

[0073] In the case of the thermal imaging colorimetric system described above, the sensor unit constituting the infrared sensor section was a sensor that directly detected infrared radiation according to predetermined different wavelengths; however, in the thermal imaging colorimetric system described below, a filter that transmits only infrared radiation of a specific wavelength is additionally provided in front of the sensor, so that infrared radiation is detected through the sensor after only the specific wavelength is selectively transmitted through the filter.

[0074] FIG. 5 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention.

[0075] Referring to FIG. 5, the infrared sensor unit (203) in the present embodiment includes a base substrate (290), a plurality of sensor units (240) mounted on the base substrate (290), a filter substrate (291) located on the upper part of the base substrate (290), and a plurality of filters mounted on the filter substrate (291).

[0076] As previously described, the base substrate (290) is a predetermined circuit board, and a circuit is formed to transmit signals sensed by each of the sensor units (240) to the color conversion processing unit (310), and furthermore, if necessary, an electrical signal for the operation of the sensor units (240) may be transmitted.

[0077] At this time, the sensor units (240) can be mounted in a matrix array of M*L (M and L are each natural numbers) on the base substrate (290) as illustrated.

[0078] Additionally, each of the above sensor units (240) includes three spaced-apart sensors (241, 242, 243) as illustrated. Although the drawings illustrate an arrangement of three different sensors (241, 242, 243), the sensors (241, 242, 243) may be arranged in two or four or more, and are not necessarily limited to three. However, for the sake of convenience of explanation, the following description exemplifies that both the sensors and the filters described below are composed of three.

[0079] Furthermore, the three sensors (241, 242, 243) are each sensors that sense infrared rays that have passed through the filter described later, and as shown in FIG. 2, there is no need to sense only infrared rays in a specific wavelength range. That is, since only infrared rays in a specific wavelength range have already been selectively transmitted through the filter described later, it is sufficient to sense the transmitted infrared rays.

[0080] The filter substrate (291) is positioned at the front end of the base substrate (290), that is, in the direction in which the infrared rays (50) are incident, and a plurality of filters (244, 245, 246) are mounted on the filter substrate (291).

[0081] In the present embodiment, the first to third filters (244, 245, 246) are arranged adjacent to each other as a single filter unit, and the filter unit comprising these first to third filters can be mounted in a matrix array of M*L (M and L are each natural numbers) on the filter substrate (291) as the sensor unit (240). Thus, the filter unit and the sensor unit (240) are aligned in a line along the direction in which the infrared (50) is incident.

[0082] Furthermore, the first filter (244) is aligned in a line with the first sensor (241) and the infrared (50) along the direction in which they are incident, and likewise the second filter (245) is aligned with the second sensor (242) and the third filter (246) is aligned with the third sensor (243).

[0083] At this time, the first to third filters (244, 245, 246) selectively transmit only infrared rays of different wavelengths, similar to how the first to third sensors (211, 212, 213) in FIG. 2 each sense infrared rays of different wavelengths. Thus, only infrared rays of wavelengths transmitted through each filter are sensed by the sensors located at the rear end.

[0084] That is, referring to FIG. 9b described later, for example, the first filter (244) can transmit only a first wavelength range (7 to 9 μm) for the infrared (50), the second filter (245) can transmit only a second wavelength range (9 to 11 μm) for the infrared (50), and the third filter (246) can transmit only a third wavelength range (11 to 13 μm) for the infrared (50).

[0085] In this case, the first to third wavelength ranges can be arbitrarily selected from the wavelength region belonging to the infrared (50) and do not necessarily need to be set at equal intervals.

[0086] Additionally, the first to third filters (244, 245, 246) and the first to third sensors (241, 242, 243) may be arranged in a rectangular shape that is elongated in the longitudinal direction as illustrated, but are not limited thereto and may be arranged in various shapes such as triangles, circles, and ellipses.

[0087] As described above, the first to third filters (244, 245, 246) and the first to third sensors (241, 242, 243) can be arranged in any array structure and shape, and the range of infrared wavelengths that each senses is different from each other, thereby allowing infrared rays in different wavelength regions to be sensed and provided to the color conversion processing unit (310).

[0088] FIG. 6 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention.

[0089] The thermal image colorization system according to the present embodiment is substantially the same as the thermal image colorization system described with reference to FIG. 5, except for the arrangement and structure of the filters, so redundant descriptions are omitted.

[0090] Referring to FIG. 6, in the thermal imaging colorization system of the present embodiment, the infrared sensor unit (204) includes a base substrate (290), sensor units (250), a filter substrate (292), and filters (252, 253, 254).

[0091] At this time, the base substrate (290) is a base substrate as in FIG. 5, and the sensor units (250) can be mounted in a matrix array of M*L (M and L are each natural numbers) on the base substrate (290) as shown.

[0092] Additionally, each of the sensor units (250) is equipped with one sensor (251), and the sensor (251) may occupy most of the area of ​​the sensor unit (250) overall.

[0093] The above sensor (251) is a sensor that senses infrared rays that have passed through the filter described later, and as explained in FIG. 5, it is not necessary to sense only infrared rays in a specific wavelength range. That is, since only infrared rays in a specific wavelength range have already been selectively transmitted through the filter described later, it is sufficient to sense the transmitted infrared rays.

[0094] Furthermore, as illustrated, the filter substrate (292) is formed on the upper side of the base substrate (290), that is, in the direction in which the infrared (50) is incident, with a larger area than the base substrate (290), and different filters (252, 253, 254) that transmit only different infrared wavelength regions are formed on the filter substrate (292).

[0095] In this case, if three different filters are formed on the filter substrate (292), the overall area of ​​the filter substrate (292) can be formed to be about three times larger than that of the base substrate (290).

[0096] Alternatively, although not illustrated, if two different filters are formed on the filter substrate (292), the area of ​​the filter substrate (292) can be formed to be about twice as large as the base substrate (290).

[0097] In the case of this embodiment, the first to third filters (252, 253, 254) formed on the filter substrate (292) can each transmit infrared rays of different wavelength regions, just like the first to third filters (244, 245, 246) described in FIG. 5.

[0098] That is, referring to FIG. 9b described later, for example, the first filter (252) can transmit only a first wavelength range (7 to 9 μm) for the infrared (50), the second filter (253) can transmit only a second wavelength range (9 to 11 μm) for the infrared (50), and the third filter (254) can transmit only a third wavelength range (11 to 13 μm) for the infrared (50).

[0099] In this case, as previously explained, the first to third wavelength ranges can be arbitrarily selected from the wavelength region belonging to the infrared (50) and do not necessarily need to be set at equal intervals.

[0100] Thus, in the case of the present embodiment, the filter substrate (292) on which the first to third filters (252, 253, 254) are formed is positioned and moved in the left-right direction, that is, the length direction, relative to the base substrate (290), as shown by the arrow.

[0101] Accordingly, when the first filter (252) and the base substrate (290) are arranged to be aligned with each other along the incident direction of the infrared (50), only the first wavelength range (7~9μm) of the infrared is transmitted, and only the infrared of that wavelength can be sensed by the sensor (251).

[0102] In contrast, when the second filter (253) and the base substrate (290) are arranged to be aligned with each other along the incident direction of the infrared (50), only the second wavelength range (9~11μm) of the infrared is transmitted, and only the infrared of that wavelength can be sensed by the sensor (251).

[0103] Furthermore, when the third filter (254) and the base substrate (290) are arranged to be aligned with each other along the incident direction of the infrared (50), only the third wavelength range (11~13μm) of the infrared is transmitted, and only the infrared of that wavelength can be sensed by the sensor (251).

[0104] As described above, the filter substrate (292) is moved in the left-right direction or the length direction, and only a predetermined filter is aligned on the base substrate (290). Since only infrared rays of a specific wavelength can be sensed, it is possible to sense infrared rays over a wider area, thereby further improving the infrared sensing sensitivity.

[0105] Furthermore, the signals sensed for different infrared wavelength regions according to the movement of the filter substrate (292) are provided to the color conversion processing unit (310).

[0106] FIG. 7 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention.

[0107] The thermal image colorization system according to the present embodiment is substantially the same as the thermal image colorization system described with reference to FIG. 6, except for the arrangement and structure of the filters, so redundant descriptions are omitted.

[0108] Referring to FIG. 7, in the thermal imaging colorization system of the present embodiment, the infrared sensor unit (205) includes a base substrate (290), sensor units (260), a first filter substrate (293), a second filter substrate (294), first filters (262, 263, 264) and second filters (265, 266, 267).

[0109] At this time, the base substrate (290) is a base substrate as in FIG. 5, and the sensor units (260) can be mounted in a matrix array of M*L (M and L are each natural numbers) on the base substrate (290) as shown.

[0110] Additionally, each of the sensor units (260) is equipped with one sensor (261), and the sensor (261) may occupy most of the area of ​​the sensor unit (260) overall.

[0111] The above sensor (261) is a sensor that senses infrared rays that have passed through the filter described later, and as explained in FIG. 5, it is not necessary to sense only infrared rays in a specific wavelength range. That is, since only infrared rays in a specific wavelength range have already been selectively transmitted through the filter described later, it is sufficient to sense the transmitted infrared rays.

[0112] In the present embodiment, a pair of first and second filter substrates (293, 294) are sequentially formed on the upper side of the base substrate (290), that is, on the front side in the direction in which the infrared (50) is incident. That is, the infrared (50) passes sequentially through the first filter substrate (293) and the second filter substrate (294) to be filtered, and then is provided to the sensor unit (260) of the base substrate (290).

[0113] In addition, three different filters (262, 263, 264) are formed on the first filter substrate (293), and three different filters (265, 266, 267) are formed on the second filter substrate (294). Of course, as previously explained, the number of filters formed can be varied in many ways.

[0114] In this case, if three different filters are formed on the first filter substrate (293), the total area of ​​the first filter substrate (293) can be formed to be about three times larger than that of the base substrate (290). The same applies to the second filter substrate (294).

[0115] In the case of this embodiment, the three different filters (262, 263, 264) formed on the first filter substrate (293) can each transmit infrared rays in different wavelength regions, just like the first to third filters (252, 253, 254) described in FIG. 6.

[0116] Likewise, three different filters (265, 266, 267) formed on the second filter substrate (294) can also transmit infrared rays in different wavelength regions, respectively.

[0117] At this time, the wavelength range of infrared rays transmitted by the three different filters (262, 263, 264) formed on the first filter substrate (293) and the three different filters (265, 266, 267) formed on the second filter substrate (294) may all be different.

[0118] Of course, as previously explained, in the infrared wavelength region transmitted by the total of six filters (262, 263, 264, 265, 266, 267) formed on each of the first and second filter substrates (293, 294), each wavelength region can be arbitrarily selected within the range of the infrared wavelength region and does not necessarily need to be set at equal intervals.

[0119] In addition, in the present embodiment, the first filter substrate (293) and the second filter substrate (294) are each positioned and moved independently relative to the base substrate (290) in the left-right direction, that is, in the length direction, as indicated by the arrows.

[0120] As described above, if the first and second filter substrates (293, 294), each having three filters formed thereon, are moved left and right on the base substrate (290), the transmitted infrared wavelength range can be subdivided into a total of 15 filter combinations. That is, if the first filter substrate (293) includes X filters and the second filter substrate (294) includes Y filters, the transmitted wavelength range can be determined with a total of (X+1)*(Y+1)-1 combinations. At this time, in determining the wavelength range, no filter may be selected for the first filter substrate (293), and likewise, no filter may be selected for the second filter substrate (294). That is, the first filter substrate (293) includes three filters but a total of four options are possible, including an area without filters, and likewise the second filter substrate (294) also includes three filters but a total of four options are possible, including an area without filters.

[0121] As described above, the first and second filter substrates (293, 294) can be moved independently of each other in the left-right direction or the longitudinal direction, so that a predetermined set of selected filters are sequentially aligned on the base substrate (290), and sensing can be performed through the sensor (261) for a transmitted infrared wavelength selected by a combination of the filters. Thus, it is possible to sense infrared radiation over a wider area for a specific wavelength range, thereby further improving the infrared sensing sensitivity, and the range of infrared transmitted wavelengths can be selected more diversely, thereby further improving the identification capability during infrared visualization.

[0122] Furthermore, signals sensed for different infrared wavelength regions according to the movement of the first and second filter substrates (293, 294) are provided to the color conversion processing unit (310).

[0123] FIG. 8 is a schematic diagram illustrating an infrared sensor unit of a thermal imaging colorimetric system according to another embodiment of the present invention.

[0124] The thermal image colorization system according to the present embodiment is substantially the same as the thermal image colorization system described with reference to FIG. 6, except for the arrangement and structure of the filters, so redundant descriptions are omitted.

[0125] Referring to FIG. 8, in the thermal imaging colorization system of the present embodiment, the infrared sensor unit (206) includes a base substrate (290), sensor units (270), a filter substrate (295), and a filter (272).

[0126] At this time, the base substrate (290) is a base substrate as in FIG. 5, and the sensor units (270) can be mounted in a matrix array of M*L (M and L are each natural numbers) on the base substrate (290) as shown.

[0127] Additionally, each of the sensor units (270) is equipped with one sensor (271), and the sensor (271) may occupy most of the area of ​​the sensor unit (270) overall.

[0128] The above sensor (271) is a sensor that senses infrared rays that have passed through the filter described later, and as explained in FIG. 5, it is not necessary to sense only infrared rays in a specific wavelength range. That is, since only infrared rays in a specific wavelength range have already been selectively transmitted through the filter described later, it is sufficient to sense the transmitted infrared rays.

[0129] The filter substrate (295) is positioned on the upper side of the base substrate (290), that is, on the front side facing the direction in which the infrared (50) is incident, and a plurality of variable filters (272) are mounted on the filter substrate (295).

[0130] In this case, the variable filters (272) can be mounted in a matrix array of M*L (M and L are each natural numbers) on the filter substrate (295), just like the sensor unit (270).

[0131] Thus, each of the variable filters (272) and each of the sensor units (270) may have a so-called one-to-one correspondence arrangement relationship, arranged in a line along the direction in which the infrared (50) is incident.

[0132] Each of the above variable filters (272) is similar to the variable sensor (231) described in FIG. 4 above, and the transmitted infrared wavelength varies according to the input signal, and the variation of the signal input to the variable filter (272) through the filter substrate (295) can be pre-set and controlled.

[0133] Thus, the variable filter (272) can transmit only a first wavelength range (7 to 9 μm) of the infrared (50) as shown in FIG. 9b upon receiving a first signal, and the variable filter (272) can transmit only a second wavelength range (9 to 11 μm) of the infrared (50) as it receives a second signal, and furthermore, upon receiving a third signal, the variable filter (272) can transmit only a third wavelength range (11 to 13 μm) of the infrared (50).

[0134] As described above, as the variable filter (272) transmits infrared rays in different wavelength regions according to the input signal, the sensor (271) located at the rear end can selectively sense the transmitted infrared rays.

[0135] Furthermore, infrared rays of different wavelength ranges sensed through the sensor unit (270) are provided to the color conversion processing unit (310).

[0136] FIG. 9a is a graph showing examples of spectra for each sensor of the infrared sensor unit of FIG. 2 to 4, and FIG. 9b is a graph showing transmission spectra for each filter of the infrared sensor unit of FIG. 5 to 8.

[0137] As shown in FIG. 9a, the different sensors used in the embodiments of FIG. 2 to 5 above may be configured to have high sensitivity to different infrared wavelengths depending on each sensor, and as shown in FIG. 9b, the different filters used in the embodiments of FIG. 6 to 8 above may be configured to have high transmittance to different infrared wavelengths depending on each filter.

[0138] Figure 10 is a flowchart illustrating each step and the result of each step of a thermal image colorization method using the thermal image colorization system of Figure 1.

[0139] Referring to FIG. 10, in a thermal imaging colorization method using the thermal imaging colorization system (10) of FIG. 1, first, infrared rays of different wavelength regions are sensed for infrared rays incident from an object through the infrared sensor unit (200) (step S10).

[0140] At this time, although the infrared sensor unit (200) in FIG. 2 was exemplified through FIG. 10, it is not limited thereto, and the same colorization of the thermal image is possible for infrared rays sensed through each of the infrared sensor units described in FIG. 3 to FIG. 8.

[0141] Afterwards, the color conversion processing unit (310) generates a thermal image for each infrared of a different wavelength range that is sensed in this way (step S20).

[0142] At this time, the infrared images generated for each different wavelength range of infrared radiation can be composed of a matrix. That is, if N sensors that sense infrared radiation in N different wavelength ranges are provided within the sensor unit (210) and the sensor unit is arranged in M*L (=S) matrices on the base substrate (290), the thermal images for each infrared radiation can be derived as a matrix in the following equation (1).

[0143] Equation (1)

[0144] Afterwards, the color conversion processing unit (310) corresponds the N thermal images (S) to N primary colors and performs color matching for each thermal image (step S30).

[0145] In this case, the above primary color may be a color corresponding to visible light, and the types of matching colors are not limited. For example, for the case where N=3, each S (1) , S (2) and S (3) It can be mapped to R(red), G(green), and B(blue).

[0146] That is, for the case where N=3, respectively S (1) , S (2) and S (3) If we map it to R(red), G(green), and B(blue) to realize a color, i.e., a visible light image, the RGB color coordinates of the (i, j)-th pixel are It becomes.

[0147] While the types of colors are not limited when matching with the aforementioned primary colors, it is necessary to select primary colors suitable for the measurement background environment to further enhance the visibility or distinguishability of the target object beyond simple color representation. To this end, a color combination that maximizes the color distance between the background environment color and the object can be selected. Additionally, if the wavelength characteristics of the target object are unknown (i.e., an unknown object), a color combination with high average visibility can be selected by considering a database containing general object information. Accordingly, a processor for such color combinations may be additionally included, and the user may also directly specify the primary colors.

[0148] Afterwards, the color conversion processing unit (310) integrates the image matched to the original color to perform thermal imaging, i.e., color imaging of the target object (step S40).

[0149] FIG. 11a is an example of a visible light image of an actual camouflaged object, FIG. 11b is an image of the measurement result of an infrared sensor according to the prior art for the camouflaged object of FIG. 11a, and FIG. 11c is an image of the thermal image colorization result of FIG. 10 for the camouflaged object of FIG. 11a.

[0150] As shown in FIG. 11a, when an object (tank) with infrared camouflage applied is located on a surface environment where soil is randomly scattered, it is difficult to accurately identify the object through visible light images of the object and the surface environment.

[0151] In addition, as shown in FIG. 11b, even if a thermal image of the target object and the ground environment is obtained using a conventional thermal imaging camera, that is, a commercial thermal imaging camera with one degree of freedom, it can be confirmed that it is difficult to distinguish between the camouflaged target object and the surrounding environment.

[0152] However, as shown in FIG. 11c, through the thermal imaging colorization method according to the present embodiment, a color thermal image of the target object and the ground environment is obtained, and it can be confirmed that the camouflaged target object (tank) is clearly distinguishable from the surrounding environment.

[0153] According to the embodiments of the present invention as described above, by imaging infrared rays of different wavelength regions into visible light of different colors, it is possible to more accurately identify object that cannot be distinguished by simple infrared thermal images.

[0154] That is, by sensing infrared rays in different wavelength ranges using different sensors or different filters, thermal images are acquired for each wavelength range of the infrared rays, and by matching a predetermined visible light color to the acquired thermal images, visible light imaging can be performed on the infrared rays acquired from the target object. In particular, visible light imaging of an infrared camouflaged target object is possible, thereby improving the identification capability of the target object.

[0155] In this case, the array of sensors for distinguishing and sensing infrared rays in different wavelength ranges can be configured in various ways, and similarly, the array of filters that transmit infrared rays in different wavelength ranges can also be configured in various ways; therefore, by applying various sensors and filters, thermal images of infrared rays can be extracted by wavelength.

[0156] Although the present invention has been described above with reference to preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the invention without departing from the spirit and scope of the invention as set forth in the following claims. Explanation of the symbols

[0157] 10: Thermal imaging colorimetry system 50: Infrared 60 : Infrared lens 100 : Measuring unit 110 : Cooling section 200, 201, 202, 203, 204, 205, 206: Infrared sensor section 210, 220, 230, 240, 250, 260, 270 : Sensor unit 290: Base substrate 291, 292, 293, 294: Filter substrates 300: Calculation Unit 310: Color Conversion Processor 320 : Display unit 330 : Control unit

Claims

Claim 1 A thermal image colorization system comprising: a measurement unit including an infrared sensor unit that selectively senses infrared rays of different wavelength ranges for infrared rays incident from a target object; and a computation unit including a color conversion processing unit that matches colors for infrared rays of different wavelength ranges to the sensed results of the infrared sensor unit and images the infrared rays of different wavelength ranges, wherein the color conversion processing unit generates thermal images for infrared rays of different wavelength ranges and matches a predetermined primary color for each thermal image to perform imaging of the target object with the matched color, and wherein the primary color is a color corresponding to visible light, selected considering the background environment in which the target object is measured, or selected as a color with high average visibility from a database storing general object information. Claim 2 delete Claim 3 A thermal imaging colorization system according to claim 1, wherein the infrared sensor unit comprises: a sensor unit including a sensor that selectively senses infrared rays in different wavelength ranges; and a base substrate on which the sensor unit is mounted and a circuit is formed to transmit signals sensed by each of the sensors to the color conversion processing unit. Claim 4 A thermal imaging colorimetric system according to claim 3, characterized in that at least two sensors are positioned spaced apart from each other. Claim 5 A thermal imaging colorimetric system according to claim 3, wherein at least two sensors are arranged overlappingly along the incident direction of the infrared rays, and the sensor located at the top along the incident direction of the infrared rays transmits infrared rays in the wavelength range measured by the sensor located at the bottom. Claim 6 A thermal imaging colorimetric system according to claim 3, wherein the sensor is characterized by varying the infrared wavelength sensed according to an input signal input from the base substrate. Claim 7 A thermal imaging colorization system according to claim 1, wherein the infrared sensor unit comprises: a filter that selectively transmits infrared rays in different wavelength regions; a filter substrate on which the filter is mounted; a sensor unit including a sensor aligned with the filter and which senses infrared rays of a specific wavelength transmitted through the filter; and a base substrate on which the sensor unit is mounted and which has a circuit formed to transmit signals sensed by each of the sensors to the color conversion processing unit. Claim 8 A thermal imaging colorimetric system according to claim 7, characterized in that at least two filters are positioned spaced apart from each other, and at least two sensors are provided to be aligned with each of the spaced-apart filters. Claim 9 A thermal imaging colorization system according to claim 7, wherein the filter transmits an infrared wavelength that varies according to an input signal input from the filter substrate, and the sensor is provided on the sensor unit so as to be aligned with the filter. Claim 10 A thermal imaging colorization system according to claim 7, wherein the filter comprises at least two filters, each having a width equal to the width of the base substrate, and the filter substrate moves horizontally above the base substrate to change the filters that overlap with the base substrate. Claim 11 A thermal imaging colorization system according to claim 1, wherein the infrared sensor unit comprises: a first filter that selectively transmits infrared rays of different wavelength regions; a first filter substrate on which the first filter is mounted; a second filter that selectively transmits infrared rays of a wavelength region different from that of the first filter; a second filter substrate disposed below the first filter substrate on which the second filter is mounted; a sensor unit including a sensor aligned with the first and second filters and sensing infrared rays of a specific wavelength transmitted through the first and second filters; and a base substrate on which the sensor unit is mounted and a circuit is formed to transmit signals sensed by each of the sensors to the color conversion processing unit. Claim 12 A thermal imaging colorization system according to claim 11, wherein the first filter comprises at least two filters, each having a width equal to the width of the base substrate, and the second filter also comprises at least two filters, each having a width equal to the width of the base substrate, and each of the first and second filter substrates moves horizontally above the base substrate to change the filters that overlap with the base substrate. Claim 13 A thermal imaging colorization system characterized in that, in either claim 10 or claim 12, the sensor unit is mounted in a matrix array on the base substrate. Claim 14 A thermal image colorization method comprising: a step of selectively sensing infrared rays of different wavelength regions with respect to infrared rays incident from a target object; a step of generating a thermal image for each infrared ray of a different wavelength region with respect to the sensed infrared rays; a step of matching a predetermined primary color to each thermal image; and a step of performing imaging of the target object with the matched primary color, wherein the primary color is a color corresponding to visible light, selected by considering the background environment in which the target object is measured, or selected as a color with high average visibility from a database storing general object information.

Images