Image processing device, control method thereof, program, and storage medium

Abstract

To provide an image processing device that can improve the image quality of visible light images by using non-visible light images.SOLUTION: An image processing device includes an input unit for inputting a visible light image and a non-visible light image, a first generating unit for generating an AC component of the visible light image, a second generating unit for generating an AC component of the non-visible light image, an adjusting unit for adjusting the AC component of the non-visible light image on the basis of the AC component of the visible light image to obtain an adjusted AC component, and a correcting unit for correcting the visible light image using the adjusted AC component. The adjusting unit adjusts the AC component of the non-visible light image according to a condition required for the image quality of the visible light image corrected by the correcting unit.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a technique for correcting a visible light image using a non-visible light image. [Background technology]

[0002] In the past, when photographing distant mountain ranges with a digital camera, the unevenness of the mountain ranges could not be fully expressed due to the influence of haze such as dust in the air, resulting in a flat impression. For this reason, methods have been proposed to improve the contrast and resolution of images by using non-visible light images with longer wavelengths, such as infrared light, which has the property of being less affected by haze such as dust in the air.

[0003] For example, Patent Document 1 discloses a technology for improving the perceived resolution of a visible light image using an infrared light image. Specifically, the magnitudes of the high-frequency components of the luminance signal, which is visible light, and the high-frequency components of the infrared light signal are determined, and the luminance signal of visible light is corrected based on the results of this determination.

[0004] On the other hand, when photographing still lifes such as clothing or dolls, there is a demand for capturing images that emphasize the texture of the fabric material. In such cases, invisible light such as infrared light has the characteristic of maintaining a constant reflectance within the same material, even when there is a pattern, and is not affected by differences in spectral reflectance like visible light. Therefore, it is possible to emphasize only the texture of the fabric material. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-082390 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the conventional technology disclosed in the above-mentioned Patent Document 1 performs correction only by comparing the intensities of the high-frequency components of the luminance signal, which is visible light, and the high-frequency components of the infrared light signal, without taking into account spatial frequency, spatial direction distribution, etc. Therefore, there are cases where the processing is not optimal for emphasizing texture. Another issue is that there is no mechanism that allows you to control whether you want to emphasize texture or improve the contrast and resolution of the image depending on the shooting scene and your needs.

[0007] The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide an image processing device that can improve the quality of a visible light image by utilizing a non-visible light image. [Means for solving the problem]

[0008] The image processing device according to the present invention comprises input means for inputting a visible light image and a non-visible light image, first generation means for generating AC components of the visible light image, second generation means for generating AC components of the non-visible light image, adjustment means for adjusting the AC components of the non-visible light image based on the AC components of the visible light image to obtain adjusted AC components, and correction means for correcting the visible light image using the adjusted AC components, wherein the adjustment means adjusts the image quality of the visible light image corrected by the correction means. Do you require image quality that prioritizes the texture of the subject, or image quality that prioritizes the contrast of the subject? The AC component of the non-visible light image is adjusted in accordance with the [Effects of the Invention]

[0009] According to the present invention, it is possible to improve the quality of a visible light image by utilizing a non-visible light image. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing the configuration of an imaging apparatus according to an embodiment of the present invention; [Figure 2] 3A and 3B are diagrams illustrating a method for acquiring a visible light image and a non-visible light image. [Figure 3] FIG. 2 is a block diagram showing the configuration of an image processing unit. [Figure 4] 10 is a flowchart showing the flow of processing by an image processing unit. [Figure 5] FIG. 2 is a block diagram showing the configuration of a visible light image correction processing unit. [Figure 6] 10 is a flowchart showing the flow of processing by a visible light image correction processing unit. [Figure 7] 3A and 3B are diagrams illustrating characteristics of image signals of a visible light image and a non-visible light image. [Figure 8] 10A and 10B are diagrams illustrating a method for adjusting invisible light AC components with priority given to texture and contrast. [Figure 9] FIG. 3 is a block diagram showing the configuration of a non-visible light AC component adjustment unit. [Figure 10] 10 is a flowchart showing the flow of processing by a non-visible light AC component adjustment unit. [Figure 11] 10A and 10B are diagrams illustrating texture-priority and contrast-priority adjustments. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0012] FIG. 1 is a block diagram showing the configuration of an image capturing apparatus 100 which is an embodiment of an image processing apparatus according to the present invention.

[0013] The imaging device 100 of this embodiment corrects the visible light image signal by using the infrared light image signal, which has a longer wavelength than the invisible visible light. Two correction methods can be implemented: a correction method that emphasizes texture, and a correction method that emphasizes resolution and contrast.

[0014] In FIG. 1, the imaging unit 101 includes a lens, an imaging element, an A / D conversion processing unit, and a development processing unit, and captures an image of a subject and generates an image file based on a control signal output from the system control unit 103 in response to an instruction from the operation unit 107.

[0015] In this embodiment, two types of signals are acquired: a visible light image and a non-visible light image. A possible signal acquisition method is shown in Fig. 2. In Fig. 2, the grid indicates the pixel arrangement of the image, R, G, B, and W indicate visible light signals, and IR indicates an infrared light signal, which is non-visible light.

[0016] Starting from the top, the acquisition methods are explained below. Fig. 2(a) shows a method of acquiring visible light images and invisible light images using two image sensors, while Fig. 2(b) shows a method of acquiring visible light images and invisible light images using a single image sensor. Fig. 2(c) shows a method of acquiring visible light images acquired through an invisible light cut filter and invisible light images acquired through a visible light cut filter in time series. Visible light images and invisible light images can be acquired using the acquisition methods described above.

[0017] 1, the image processing unit 102 refers to the image files input from the imaging unit 101, the recording unit 105, and the network processing unit 106, and performs image processing to improve the image quality of the visible light image using the invisible light image, based on the control signal output from the system control unit 103. The processing content of the image processing unit 102 related to this image processing will be described in detail later.

[0018] The system control unit 103 controls and supervises the overall operation of the imaging device 100 by loading a program stored in the ROM 110 into the RAM 111 and executing it. For example, the system control unit 103 performs drive control of the imaging unit 101 based on instructions transmitted from the network processing unit 106 and the operation unit 107.

[0019] A display unit 104 receives the output signal from the image processing unit 102 and performs processing to display an image on a display device configured as a liquid crystal display or an organic EL (Electro Luminescence) display.

[0020] The recording unit 105 has the function of recording data such as images, and may include, for example, an information recording medium such as a memory card equipped with a semiconductor memory or a package containing a rotating recording medium such as a magneto-optical disk, and this information recording medium may be removable.

[0021] The network processing unit 106 acquires image files from external input devices via a network, and also receives output signals from the image processing unit 102 and transmits the image signals via the network to an external display device or an external image processing device such as a PC (personal computer).

[0022] The bus 108 is used to transmit and receive data such as images between the imaging unit 101, image processing unit 102, system control unit 103, display unit 104, recording unit 105, network processing unit 106, ROM 110, and RAM 111.

[0023] Next, a description will be given of the configuration of the image processing unit 102. Fig. 3 is a block diagram showing the configuration of the image processing unit 102 in this embodiment.

[0024] In this embodiment, the image processing unit 102 corrects the visible light image signal by using the infrared light image signal, which has a longer wavelength than the visible light as invisible light, as described above.

[0025] 3, the image processing unit 102 is configured to include a visible light image input unit 201, a non-visible light image input unit 202, a visible light development processing unit 203, a non-visible light development processing unit 204, a visible light image correction processing unit 205, and an image output unit 206. The images input to the image processing unit 102 are a visible light image and a non-visible light image, and the image output is a visible light image corrected using the non-visible light image.

[0026] Fig. 4 is a flowchart showing the flow of processing performed using the image processing unit 102. The operation of the flowchart in Fig. 4 is realized by the system control unit 103 expanding a program stored in the ROM 110 into the RAM 111 and executing it.

[0027] In step S501, the system control unit 103 performs processing to input a visible light image to the visible light image input unit 201 of the image processing unit .

[0028] In step S502, the system control unit 103 performs processing to input a non-visible light image to the non-visible light image input unit 202 of the image processing unit .

[0029] In step S503, the system control unit 103 uses the visible light development processing unit 203 of the image processing unit 102 to perform development processing on the visible light image input in step S501. Development processing for visible light images refers to general processing such as noise reduction processing, white balance processing, demosaic processing, color matrix processing, and gamma processing. In this embodiment, the visible light image signal after development processing is processed to convert the visible light R, G, and B signals into a luminance signal Y and a color difference signal UV, as shown in (Equation 1).

[0030] Y=0.299R+0.587G+0.114B U=-0.169R-0.331G+0.500B…(Formula 1) V=0.500R-0.419G-0.081B In step S504, the system control unit 103 performs development processing on the non-visible light image input in step S502 using the non-visible light development processing unit 204 of the image processing unit 102. Development processing for non-visible light images refers to general processing such as noise reduction processing, demosaic processing, and gamma processing.

[0031] In step S505, the system control unit 103 performs correction processing on the visible light image developed in step S503 using the non-visible light image developed in step S504, using the visible light image correction processing unit 205 of the image processing unit 102. The processing in step S505 will be described in detail later.

[0032] In step S506, the system control unit 103 uses the image output unit 206 of the image processing unit 102 to perform processing to output the visible light image corrected in step S505.

[0033] The above is the operation of the image processing unit in this embodiment.

[0034] 5 is a block diagram showing the configuration of the visible light image correction processing unit 205. As explained in step S505, the visible light image correction processing unit 205 performs correction processing on the visible light image using the non-visible light image.

[0035] 5, visible light image correction processing unit 205 is configured to include a visible light AC component generation unit 301, a non-visible light AC component generation unit 302, a non-visible light AC component adjustment unit 303, and a non-visible light AC addition unit 304. The images input to visible light image correction processing unit 205 are a visible light image and a non-visible light image each developed in the previous processing, and the image output is a visible light image corrected using the non-visible light image.

[0036] Fig. 6 is a flowchart showing the processing flow of the visible light image correction processing unit 205 corresponding to step S505 in Fig. 4. The operation of the flowchart in Fig. 6 is realized by the system control unit 103 loading a program stored in ROM 110 into RAM 111 and executing it.

[0037] In step S601, the system control unit 103 performs processing to generate AC components of the input visible light image using the visible light AC component generation unit 301. In this embodiment, the AC components of the visible light image are calculated from the luminance signal Y of the visible light image. The AC components are generated by applying a band-pass filter that extracts a predetermined frequency band to the image, similar to general edge extraction processing.

[0038] In step S602, the system control unit 103 performs processing to generate AC components of the input non-visible light image using the non-visible light AC component generation unit 302. The generation of AC components is performed in the same manner as in step S601. Note that the characteristics of the band-pass filters used in steps S601 and S602 may be changed according to the spatial frequency information of the input image. For example, if the pixel size of the sensor that captures the non-visible light image is significantly larger than the pixel size of the sensor that captures the visible light image, the band-pass filter characteristics for the visible light image are designed to extract lower frequencies than the band-pass filter characteristics for the non-visible light image. This makes it possible to extract the same frequency bands from the visible light image and the non-visible light image.

[0039] In step S603, the system control unit 103 uses the non-visible light AC component adjustment unit 303 to adjust the AC components of the non-visible light image generated in step S602 based on the AC components of the visible light image generated in step S601. This generates the AC components of the non-visible light image to be used for correction. The method of adjusting the AC components of the non-visible light image will be described in detail later.

[0040] In step S604, the system control unit 103 corrects the visible light image by using the non-visible light AC adder 304 to add the AC components of the non-visible light image adjusted in step S603 to the visible light image.

[0041] If the luminance signal of the corrected visible light image is Yout, the luminance signal of the visible light image before correction is Yin, and the AC components of the adjusted invisible light image are IR_ACadj, the luminance signal of the visible light image at coordinates (x, y) is corrected using (Equation 2).

[0042] Yout(x,y)=IR_ACadj(x,y)+Yin(x,y) …(Formula 2) Although (Equation 2) is the result of processing only AC components of a specific frequency, it is also possible to process AC components of multiple frequencies in steps S601 to S603 and correct the luminance signal of the visible light image using (Equation 3), where i is a number used to distinguish the frequencies of the AC components.

[0043] Yout(x,y)=ΣiIR_ACadji(x,y)+Yin (x,y) …(Formula 3) The above is the processing of the visible light image correction processing unit 205 in this embodiment.

[0044] Next, a description will be given of the processing of step S603 performed by the non-visible light AC component adjustment unit 303. The non-visible light AC component adjustment unit 303 adjusts the AC components of the non-visible light image by using texture-priority and contrast-priority methods while referring to the AC components of the visible light image, and then combines the adjusted AC components to output the final AC components of the non-visible light image.

[0045] First, the gist of the processing in the non-visible light AC component adjusting unit 303 will be described with reference to FIG.

[0046] 7(a) is an image diagram of a visible light image and an invisible light image of a main subject, which is clothing with a vertical stripe pattern. As shown in Fig. 7(a), in the clothing in the visible light image, the difference in color of the vertical stripe pattern is expressed as a pattern 901, whereas in the clothing in the invisible light image, if the clothing is made of the same material, the difference in color is not affected and only the mesh of the clothing fabric is expressed.

[0047] The reason for this feature is that, as shown in Figure 7(b), the spectral reflectance range 903 that includes the color differences of the vertical stripes is included in the wavelength band of the spectral sensitivity characteristics 904 of the visible light sensor, but is not included in the wavelength band of the spectral sensitivity characteristics 905 of the invisible light sensor. Due to this feature, when signal values ​​of the vertical stripes are acquired in the horizontal direction, for example, as shown in Figure 7(c), the difference in signal values ​​due to the difference in color of the vertical stripes appears prominently in signal values ​​906 of the visible light image. On the other hand, signal values ​​907 of the invisible light image are not affected by the pattern itself, and only the difference in signal values ​​is due to the mesh of the clothing fabric.

[0048] In this embodiment, this feature is used to adjust the invisible AC light component in a texture priority mode that emphasizes the mesh of the clothing fabric, and a contrast priority mode that simply acquires a high-contrast image.

[0049] Figure 8 shows the difference between texture-priority and contrast-priority adjustment methods. As shown in Figure 8(a), when you want to emphasize texture, it is desirable to use many areas where the AC components of invisible light are uniformly distributed, regardless of the contours of the subject. Conversely, as shown in Figure 8(b), when you want to emphasize contrast by utilizing high-contrast areas of the invisible light image, it is desirable to use many areas where the amplitude of the AC components of invisible light is larger than the amplitude of the AC components of visible light.

[0050] As described above, the non-visible light AC component adjustment unit 303 realizes a configuration that allows adjustment modes based on two concepts to be used appropriately depending on the user's settings, the frequency to be adjusted, and the subject (depending on the conditions required for the image quality of the visible light image after correction).

[0051] Fig. 9 is a block diagram showing the configuration of the non-visible light AC component adjustment unit 303. In Fig. 9, the non-visible light AC component adjustment unit 303 is configured to include a texture-priority adjustment unit 401, a contrast-priority adjustment unit 402, and a non-visible light AC synthesis unit 403. The input image is the AC components of a visible light image and the AC components of a non-visible light image, and the output image is the AC components of the adjusted non-visible light image (adjusted AC components).

[0052] Fig. 10 is a flowchart showing the processing flow of the non-visible light AC component adjuster 303 corresponding to step S603 in Fig. 6. The operation of the flowchart in Fig. 10 is realized by the system control unit 103 expanding a program stored in the ROM 110 into the RAM 111 and executing it.

[0053] In step S701, the system control unit 103 performs a process of adjusting the AC components of the invisible light image, prioritizing texture, using the texture-priority adjustment unit 401 of the invisible light AC component adjustment unit 303. As described above, this adjustment desirably employs many areas where the distribution of the invisible light AC components is uniform, regardless of the contour of the subject. Therefore, in this embodiment, the contour of the subject is identified based on the magnitude of the amplitude of the visible light AC components and the magnitude of the amplitude of the invisible light AC components, and adjustment is performed to employ only areas that are not contour parts and where the invisible light AC components are uniformly distributed.

[0054] 11(a), the adjustment shown in (Equation 4) is performed using an adjustment coefficient J based on the degree of contour and an adjustment coefficient K based on the degree of uniformity. IR_AC is the AC component of the invisible light image before adjustment, and IR_ACradj is the AC component of the invisible light image adjusted with priority given to texture. (x, y) indicates the position of interest in the image.

[0055] IR_ACradj(x,y)=J(x,y)×K(x,y)×IR_AC(x,y)…(Formula 4) 11(a) is calculated using (Equation 5), and the uniformity U is calculated using (Equation 6). IR_AC indicates the AC component of the invisible light image before adjustment, Y_AC indicates the AC component of the visible light image, i and j indicate the coordinates of the surroundings centered on the position of interest (x, y), and m and n indicate the surrounding range to be referenced.

[0056] E(x,y)=|IR_AC(x,y)|×|Y_AC(x,y)| …(Equation 5)

[0057]

number

[0058] As can be seen from the above (Equation 5), the contour degree E increases as the absolute values ​​of both the AC components of the invisible light image and the AC components of the visible light image increase, and the uniformity degree U increases as the standard deviation of the reference range of the AC components of the invisible light image decreases. In this embodiment, texture-priority adjustment is performed using the above method, but the present invention is not limited to this, and adjustment may be performed using only one of the contour degree adjustment coefficient J and the uniformity adjustment coefficient K.

[0059] 10, in step S702, the system control unit 103 performs processing to adjust the AC components of the non-visible light image by prioritizing contrast using the contrast-priority adjustment unit 402 of the non-visible light AC component adjustment unit 303. In this adjustment, as described above, it is desirable to employ many areas where the amplitude of the AC components of non-visible light is larger than the amplitude of the AC components of visible light. Therefore, adjustment is performed to employ only areas where the amplitude of the AC components of non-visible light is larger than the amplitude of the AC components of visible light.

[0060] In this embodiment, as shown in Fig. 11(b), adjustment is performed using (Equation 7) with an adjustment coefficient L that depends on the degree of contrast improvement. IR_AC is the AC component of the invisible light image before adjustment, and IR_ACcadj is the AC component of the invisible light image adjusted with priority on contrast. (x, y) indicates the position of interest in the image.

[0061] IR_ACcadj(x,y)=L(x,y)×IR_AC(x,y) …(Formula 7) In this embodiment, the contrast improvement degree C on the horizontal axis of Fig. 11(b) is calculated using Equation 8. IR_AC is the AC component of the non-visible light image before adjustment, Y_AC is the AC component of the visible light image, and (x, y) is the focus position in the image.

[0062] C(x,y)=|IR_AC(x,y)| / (|Y_AC(x,y)|+1) …(Equation 8) As can be seen from the above (Equation 8), the greater the ratio of the absolute value of the AC components of the visible light image to the absolute value of the AC components of the invisible light image, the greater the value of the contrast improvement degree C. In this embodiment, contrast-priority adjustment is performed using the above method, but the present invention is not limited to this. Adjustment may also be performed by comparing the magnitude of the amplitude of the AC components of the visible light image with the magnitude of the amplitude of the AC components of the invisible light image, and only when the amplitude of the AC components of the invisible light image is the magnitude of the amplitude of the AC components of the invisible light image greater, so that the AC components of the invisible light image are adopted.

[0063] In step S703, the system control unit 103 uses the non-visible light AC combining unit 402 of the non-visible light AC component adjustment unit 303 to combine the AC components of the non-visible light image adjusted with priority given to texture in step S701 with the AC components of the non-visible light image adjusted with priority given to contrast in step S702 (the two intermediate AC components), thereby generating the AC components of the finally adjusted non-visible light image.

[0064] If the AC components of the finally adjusted invisible light image are designated as IR_ACadj, IR_ACadj is calculated using a weighted average (Equation 9), where IR_ACradj is the invisible light AC component adjusted with priority on texture, and IR_ACcadj is the invisible light AC component adjusted with priority on contrast, where α is a blending coefficient that ranges from 0.0 to 1.0, and (x, y) indicate the focus position of the image.

[0065] IR_ACadj(x,y)= α(x,y)×IR_ACradj(x,y)+(1.0-α(x,y))×IR_AC_cadj(x,y) …(Formula 9) In this embodiment, the synthesis coefficient α is a predetermined value that does not depend on the coordinates, but it may be a value determined based on the scene recognition results or user settings. Furthermore, the synthesis coefficient may be changed according to the coordinates (partial areas within the image) using subject recognition technology or the like. Furthermore, when adjusting multiple AC components with different frequencies as described above, the value of the synthesis coefficient may be changed between a frequency band where texture enhancement is desired and a frequency band where it is not desired.

[0066] The above is the processing of the non-visible light AC component adjuster 303 in this embodiment.

[0067] As described above, according to this embodiment, by using the non-visible light image in the optimal form depending on whether you want to emphasize texture or improve contrast or resolution, it is possible to appropriately correct the visible light image.

[0068] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0069] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0070] 101: imaging unit, 102: image processing unit, 103: system control unit, 104: display unit, 105: recording unit, 106: network processing unit, 107: operation unit, 108: bus, 110: ROM, 111: RAM

Claims

1. an input means for inputting a visible light image and a non-visible light image; a first generating means for generating an AC component of the visible light image; a second generating means for generating an AC component of the non-visible light image; an adjustment means for adjusting the AC components of the non-visible light image based on the AC components of the visible light image and acquiring the adjusted AC components; a correction unit that corrects the visible light image using the adjusted AC component, The image processing device is characterized in that the adjustment means adjusts the AC components of the non-visible light image depending on whether the image quality of the visible light image corrected by the correction means is required to prioritize the texture of the subject or the contrast of the subject.

2. 2. The image processing device according to claim 1, wherein the adjustment means adjusts the AC components of the non-visible light image to generate a plurality of intermediate AC components, and combines the plurality of intermediate AC components in accordance with conditions required for the image quality of the visible light image to obtain the adjusted AC components.

3. 3. The image processing apparatus according to claim 2, wherein the adjustment means combines the plurality of intermediate AC components by taking a weighted average in accordance with conditions required for the image quality of the visible light image.

4. 4. The image processing apparatus according to claim 3, wherein said adjusting means changes a coefficient of the weighted average in accordance with a partial area within the image.

5. 5. The image processing apparatus according to claim 2, wherein the adjustment means generates two intermediate AC components as the plurality of intermediate AC components.

6. 6. The image processing apparatus according to claim 5, wherein the two intermediate AC components are a first intermediate AC component that prioritizes the texture of the object, and a second intermediate AC component that prioritizes the contrast of the object.

7. 7. The image processing device according to claim 6, wherein the adjustment means adjusts the AC component of the non-visible light image based on the amplitude of the AC component of the visible light image and the amplitude of the AC component of the non-visible light image.

8. 8. The image processing device according to claim 7, wherein the first intermediate AC component is a portion of the AC component of the non-visible light image having a small amplitude, and the second intermediate AC component is a portion of the AC component of the non-visible light image having a larger amplitude than the first intermediate AC component.

9. 9. The image processing device according to claim 1, wherein the correction means corrects the visible light image by adding the adjusted AC component to the visible light image.

10. 10. The image processing device according to claim 1, wherein the non-visible light image is an image captured using infrared light, which has a longer wavelength than visible light.

11. 11. The image processing device according to claim 1, further comprising an image capturing unit for capturing the visible light image and the non-visible light image.

12. an input step of inputting a visible light image and a non-visible light image; a first generation step of generating AC components of the visible light image; a second generation step of generating AC components of the non-visible light image; an adjusting step of adjusting the AC components of the non-visible light image based on the AC components of the visible light image to obtain adjusted AC components; a correction step of correcting the visible light image using the adjusted AC components, In the adjustment step, the AC components of the non-visible light image are adjusted depending on whether the image quality of the visible light image corrected in the correction step is required to prioritize the texture of the subject or the contrast of the subject.

13. A program for causing a computer to function as each of the means of the image processing apparatus according to any one of claims 1 to 11.

14. 12. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the image processing apparatus according to claim 1.

Images