Image processing apparatus and image processing method, and imaging apparatus
Patent Information
- Application Number
- JP2022167112
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-12-17
- Filing Date
- 2022-10-18
- Publication Date
- 2025-10-17
- Estimated Expiration
- 2042-10-18
AI Technical Summary
【0008】 本発明によれば、非可視光画像が合成された領域とされていない領域とにおける階調性の関係の不自然さを抑制しながら、可視光画像の階調性を向上させることが可能な画像処理装置および画像処理方法を提供することができる。
Smart Images
Figure 00000000_0000_ABST
Abstract
Claims
1. a determining means for determining an area of the visible light image into which the non-visible light image is to be synthesized; a synthesis means for synthesizing the visible light image with the non-visible light image based on the determination to generate a synthesized image, The image processing device is characterized in that the combining means adjusts the invisible light image and then combines it with the visible light image so that the difference in gradation information between the area of the combined image where the invisible light image is combined and the area where it is not combined is equal to or less than a predetermined first threshold.
2. 2. The image processing device according to claim 1, wherein the combining means adjusts the invisible light image so that a difference in gradation information between areas of the composite image that contain the same type of subject and areas that contain the invisible light image combined with the visible light image and that are not combined with the invisible light image is equal to or less than a predetermined threshold.
3. 2. The image processing device according to claim 1, wherein the combining means further adjusts the invisible light image in accordance with a subject distance before combining the invisible light image with the visible light image.
4. the combining means combines the invisible light image with the visible light image without adjusting it; The image processing device 2. The image processing device according to claim 1, further comprising a correction unit that corrects the contrast of the composite image so that a difference in gradation information between an area of the composite image where the non-visible light image is combined and an area where the non-visible light image is not combined is equal to or less than the first threshold value.
5. 2. The image processing device according to claim 1, wherein the determining unit determines an area of the visible light image where the gradation information is equal to or less than a second threshold value as an area into which the non-visible light image is to be synthesized.
6. 2. The image processing apparatus according to claim 1, wherein the synthesizing means synthesizes the non-visible light image with a luminance component of the visible light image.
7. 7. The image processing apparatus according to claim 6, wherein the luminance component is a luminance component when the visible light image is represented in a uniform color space.
8. 8. The image processing apparatus according to claim 7, wherein the uniform color space is an ICtCp color space or an L*a*b* color space.
9. 2. The image processing apparatus according to claim 1, further comprising a correction unit for correcting color components of the visible light image.
10. 10. The image processing device according to claim 9, wherein the correction means corrects the color components based on gradation information of the non-visible light image.
11. 10. The image processing device according to claim 9, wherein the correction means adjusts the amount of correction of the color component in accordance with pixel values before and after combining the non-visible light images.
12. 10. The image processing apparatus according to claim 9, wherein the correction means adjusts the amount of correction for the color component depending on exposure conditions when the visible light image was captured.
13. 10. The image processing apparatus according to claim 9, wherein the correction means adjusts the correction amount of the color component depending on whether or not auxiliary infrared light is irradiated when the visible light image is captured.
14. 10. The image processing apparatus according to claim 9, wherein the correction means adjusts the amount of correction of the color component depending on the subject distance.
15. 10. The image processing device according to claim 9, wherein the correction means adjusts the difference in correction amount for a region of similar color included in the visible light image so that the difference is equal to or less than a third threshold value.
16. 16. The image processing apparatus according to claim 15, wherein the correction means performs the adjustment by smoothing the amount of correction for a region of similar colors included in the visible light image.
17. 10. The image processing device according to claim 9, wherein the correction means adjusts the amount of correction for pixels of the red subject among the pixels of the visible light image based on a difference between the pixel value of the visible light image and the corresponding pixel value of the non-visible light image.
18. an imaging means having an imaging element for acquiring a visible light image and a non-visible light image; an image processing device according to any one of claims 1 to 17, which uses the visible light image and the non-visible light image acquired by the imaging means; An imaging device comprising:
19. An image processing method executed by an image processing device, determining an area of the visible light image into which the non-visible light image is to be synthesized; and generating a composite image by combining the visible light image with the non-visible light image based on the determination. The synthesizing step comprises: adjusting the non-visible light image so that a difference in gradation information between a region of the composite image where the non-visible light image is combined and a region of the composite image where the non-visible light image is not combined is equal to or less than a predetermined first threshold value; and combining the adjusted non-visible light image with the visible light image.
20. A program for causing a computer to function as each of the means included in the image processing device according to any one of claims 1 to 17.
21. an acquisition means for acquiring information for processing a visible light image corresponding to the non-visible light image using the non-visible light image; a correction unit that applies the processing to the visible light image at an intensity based on the information, The image processing device is characterized in that the correction means corrects the intensity of the processing so that it is less than or equal to a predetermined fourth threshold when the difference in gradation information between an area where the processing intensity is 0 and an area where the processing intensity is not 0 in the visible light image to which the processing has been applied is greater than a predetermined fourth threshold.
22. 22. The image processing apparatus according to claim 21, wherein the acquiring means acquires the information from a luminance component of the non-visible light image and a luminance component of the visible light image.
23. 22. The image processing apparatus according to claim 21, wherein the correcting means corrects the intensity so that the intensity increases as the subject distance increases.
24. 22. The image processing apparatus according to claim 21, wherein the correction means applies processing to a luminance component of the visible light image.
25. 25. The image processing apparatus according to claim 24, wherein the luminance component is a luminance component when the visible light image is represented in a uniform color space.
26. 26. The image processing apparatus according to claim 25, wherein the uniform color space is an ICtCp color space or an L*a*b* color space.
27. 25. The image processing apparatus according to claim 24, wherein the correction means further corrects color components of the visible light image.
28. 28. The image processing apparatus according to claim 27, wherein said correcting means corrects said color components based on the strength of said processing.
29. 29. An imaging device comprising: an imaging means having an image sensor and configured to acquire a visible light image and a non-visible light image; and an image processing device according to any one of claims 21 to 28, which uses the visible light image and the non-visible light image acquired by the imaging means.
30. An image processing method executed by an image processing device, obtaining information for processing a visible light image corresponding to the non-visible light image using the non-visible light image; applying the modification to the visible light image at an intensity based on the information; applying includes correcting the intensity of the processing so that the intensity is equal to or less than a fourth threshold value when a difference in gradation information between an area where the intensity of the processing is 0 and an area where the intensity of the processing is not 0 is greater than a fourth threshold value. An image processing method comprising:
31. A program for causing a computer to function as each of the means included in the image processing device according to any one of claims 21 to 28.