Image processing apparatus and imaging apparatus

Abstract

The invention provides an image processing device and an imaging device, which can make the whole image have proper brightness and make the color unsaturated in a flower image included in the image. The image processing apparatus includes: a recognition unit that recognizes an image of a flower included in an image; and a determination unit that determines that high dynamic range synthesis is to be performed when the image is recognized by the recognition unit.

Description

Technical Field

[0001] The present disclosure relates to an image processing device and a photographing device. Background Art

[0002] International Publication No. 2022 / 130846 discloses an information processing device. Learning data and test images are acquired in the information processing device. Learning for image processing such as SDR-HDR conversion is performed using the learning data to generate an image conversion model. An inferred image is generated from the test image using the image conversion model. The inferred image is evaluated and an evaluation value of the inferred image is calculated. Whether to re-learn is determined based on the evaluation value. The material of the subject captured in the test image is identified. The identified materials include flowers. The object captured in the test image is identified based on the combination of identified materials. Based on the identified object, the photographic environment of the captured image for re-learning is determined (Paragraphs 0013, 0060, 0062, 0064, 0069, 0072, 0077, 0082, 0084, 0085, and 0118). Summary of the invention

[0003] The image of the flower included in the image has high brightness. Therefore, in the image of the flower, the color is easily saturated. Therefore, in order to desaturate the color in the image of the flower, it is effective to reduce the exposure when photographing the flower.

[0004] However, when the exposure is lowered to desaturate the colors, the image as a whole becomes too dark.

[0005] One aspect of the present disclosure is made in view of this problem. An object of one aspect of the present disclosure is to provide an image processing device and a photographing device that can, for example, make the entire image have appropriate brightness while making the color of a flower image included in the image desaturated.

[0006] An image processing device according to a first aspect of the present disclosure includes: a recognition unit that recognizes a flower image included in an image; and a determination unit that determines to perform high dynamic range synthesis when the recognition unit recognizes the flower image.

[0007] A second imaging device of the present disclosure includes: the image processing device of the first disclosure; an imaging unit for performing imaging; and an automatic exposure unit for adjusting exposure of the imaging so that the imaging unit acquires a plurality of images synthesized in a high dynamic range. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 This is a block diagram of the imaging device according to the first embodiment. Figure 2This is a flowchart showing the flow of processing performed by the imaging device according to the first embodiment. DETAILED DESCRIPTION

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be noted that, regarding the drawings, the same or equivalent elements are denoted by the same reference numerals, and repeated descriptions are omitted. 1. First Embodiment 1.1 Shooting device

[0010] Figure 1 This is a block diagram of the imaging device according to the first embodiment.

[0011] Figure 1 The photographing device 1 shown performs photographing to acquire images.

[0012] like Figure 1 As shown, the imaging device 1 includes an imaging unit 11 , an automatic exposure unit 12 , and an image processing device 13 .

[0013] The imaging unit 11 captures an image to acquire an image 31. The imaging unit 11 includes an image sensor.

[0014] The automatic exposure unit 12 adjusts the exposure during shooting so that an image 31 with appropriate brightness can be obtained. When high dynamic range (HDR) synthesis is performed by the image processing device 13, the automatic exposure unit 12 adjusts the exposure during shooting so that the shooting unit 11 can obtain multiple images 32 with different exposures required for HDR synthesis. The multiple images 32 are composed of three images composed of ±0 images 41 with appropriate brightness, + images 42 with brightness brighter than the appropriate brightness, and - images 43 with brightness darker than the appropriate brightness. The multiple images 32 can be composed of two images or four or more images.

[0015] The image processing device 13 processes the acquired image 31. When the brightness difference of the image 31 is large, the image processing device 13 causes the automatic exposure unit 12 to adjust the exposure during shooting so as to acquire multiple images 32, and performs HDR synthesis on the acquired multiple images 32 to acquire an HDR image. In addition, even when the brightness difference of the image 31 is small, when the image of the flower included in the image 31 is recognized, the image processing device 13 causes the automatic exposure unit 12 to adjust the exposure during shooting so as to acquire multiple images 32, and performs HDR synthesis on the acquired multiple images 32 to acquire an HDR image. The acquired HDR image has a wide dynamic range. 1.2 Image Processing Device

[0016] like Figure 1 As shown, the image processing device 13 includes a recognition unit 21 , a determination unit 22 , and a synthesis unit 23 .

[0017] The recognition unit 21 recognizes the image of the flower included in the image 31. The recognition unit 21 recognizes the image of the flower included in the image 31 by, for example, artificial intelligence (AI) image analysis.

[0018] The determination unit 22 performs primary determination and secondary determination. In the primary determination, the determination unit 22 determines whether to perform HDR synthesis based on the brightness difference of the image 31. In the secondary determination, the determination unit 22 determines whether to perform HDR synthesis based on the recognition result 33 of the recognition unit 21.

[0019] The determination unit 22 determines that HDR synthesis is to be performed when the brightness difference of the image 31 is greater than the reference in one determination. The determination unit 22 determines that HDR synthesis is not to be performed when the brightness difference of the image 31 is not greater than the reference in one determination. For example, in one determination, the determination unit 22 determines that HDR synthesis is to be performed when a first condition that the image 31 includes a very bright portion greater than a set amount and a second condition that the image 31 includes a very dark portion greater than a set amount are satisfied. In one determination, the determination unit 22 determines that HDR synthesis is not to be performed when the first condition or the second condition is not satisfied.

[0020] The determination unit 22 performs a secondary determination when it is determined in the primary determination that HDR synthesis is not to be performed. The determination unit 22 performs a secondary determination when it is determined in the secondary determination that the image of the flower included in the image 31 is recognized by the recognition unit 21. The determination unit 22 performs a secondary determination when it is determined in the secondary determination that the image of the flower included in the image 31 is not recognized by the recognition unit 21.

[0021] The synthesis unit 23 performs HDR synthesis based on the determination result 34 of the determination unit 22. When it is determined that HDR synthesis is to be performed, the synthesis unit 23 performs HDR synthesis on the plurality of images 32 to acquire an HDR image.

[0022] The acquired HDR image can be converted into a compressed image such as a JPEG image.

[0023] The image processing device 13 includes a processor, a memory, and a peripheral circuit. The processor executes an image processing program stored in the memory, and causes the processor, the memory, and the peripheral circuit to operate as a recognition unit 21, a determination unit 22, and a synthesis unit 23. Part or all of the processing performed by the processor may be performed by a dedicated circuit. 1.3 Processing Flow

[0024] Figure 2 This is a flowchart showing the flow of processing performed by the imaging device according to the first embodiment.

[0025] The camera 1 executes Figure 2 Steps S101 to S113 are shown.

[0026] In step S101 , the imaging unit 11 captures an image to acquire the image 31 .

[0027] In the next step S102, the determination unit 22 determines whether the brightness difference of the image 31 is greater than the reference. If the determination unit 22 determines that the brightness difference of the image 31 is greater than the reference, steps S103 to S106 are executed. If the determination unit 22 determines that the brightness difference of the image 31 is not greater than the reference, step S107 is executed.

[0028] In step S103 , the determination unit 22 determines to perform HDR synthesis.

[0029] In step S104 , the automatic exposure unit 12 sets the exposure difference between the plurality of images 32 as a first exposure difference.

[0030] In step S105 , the imaging unit 11 performs exposure bracketing to acquire a first plurality of images having a first exposure difference.

[0031] In step S106 , the synthesis unit 23 performs HDR synthesis on the first plurality of images.

[0032] Through steps S103 to S106 , when the determination unit 22 determines in one determination that HDR combination is to be performed, the combination unit 23 performs HDR combination on the first plurality of images having the first exposure difference.

[0033] In step S107, the determination unit 22 determines whether the recognition unit 21 recognizes the image of the flower included in the image 31. In the case where the recognition unit 21 recognizes the image of the flower included in the image 31, steps S108 to S111 are performed. In the case where the recognition unit 21 does not recognize the image of the flower included in the image 31, steps S112 and S113 are performed.

[0034] In step S108 , the determination unit 22 determines to perform HDR synthesis.

[0035] In step S109 , the automatic exposure unit 12 sets the exposure difference between the plurality of images 32 as the second exposure difference.

[0036] In step S110 , the imaging unit 11 performs exposure bracketing to acquire a second plurality of images having a second exposure difference.

[0037] In step S111 , the synthesis unit 23 performs HDR synthesis on the second plurality of images. This allows the image 31 to have appropriate brightness as a whole, while making the color of the flower image included in the image 31 desaturated.

[0038] Through steps S108 to S111 , when the determination unit 22 determines in the secondary determination that HDR combination is to be performed, the combination unit 23 performs HDR combination on the first plurality of images having the second exposure difference.

[0039] The second exposure difference is smaller than the first exposure difference. The second exposure difference is smaller than the first exposure difference because the exposure difference suitable for HDR synthesis when the image 31 includes an image of a flower is smaller than the exposure difference suitable for HDR synthesis when the image 31 has a large brightness difference.

[0040] In step S112 , the determination unit 22 determines not to perform HDR synthesis.

[0041] In step S113 , the imaging unit 11 acquires an image.

[0042] The present disclosure is not limited to the above-described embodiments, and may be replaced with a configuration that is substantially the same as the configuration shown in the above-described embodiments, a configuration that achieves the same function and effect, or a configuration that can achieve the same purpose.

Claims

1. An image processing device comprising: a recognition unit that recognizes an image of a flower included in the image; and The determination unit determines to perform high dynamic range synthesis when the image is recognized by the recognition unit.

2. The image processing device according to claim 1, wherein: The determination unit makes a primary determination of whether to perform the high dynamic range synthesis based on the brightness difference of the image, and determines to perform the high dynamic range synthesis when it is determined in the primary determination that the high dynamic range synthesis is not to be performed but the recognition unit recognizes the image.

3. The image processing device according to claim 2, wherein: The image processing device includes a synthesis unit, which performs high dynamic range synthesis on a first plurality of images having a first exposure difference when the determination unit determines in the first determination that the high dynamic range synthesis is to be performed, and performs high dynamic range synthesis on a second plurality of images having a second exposure difference smaller than the first exposure difference when the recognition unit recognizes the image and determines that the high dynamic range synthesis is to be performed.

4. A photographing device comprising: The image processing device according to any one of claims 1 to 3; The Filming Department, which conducts filming; and The automatic exposure unit adjusts the exposure of the shooting so that the shooting unit obtains a plurality of images synthesized in a high dynamic range.

Images