Image processing apparatus and method for controlling image processing apparatus

Abstract

To cause a plurality of processing means to create images without being affected by each other's processing.SOLUTION: An image processing apparatus comprises: acquisition means that acquires a first image; first processing means that performs processing of creating a second image in a predetermined color according to the first image; and second processing means that acquires the first image and the second image and performs processing of creating a third image in a predetermined color according to the first image.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an image processing apparatus and a control method for an image processing apparatus. [Background technology]

[0002] Conventionally, when using an image processing device such as a digital camera, a user may check an image displayed on a display unit to adjust exposure, focus, etc., or to check the displayed color of the image. The image processing device may also be provided with a processing unit that generates an image of predetermined colors according to the image, such as a unit for correcting the brightness of the image or a unit for generating an image of colors corresponding to the brightness of the image. This processing unit is provided for the purposes of assisting the user in making the above adjustments or making the image displayed on the display unit more similar to the impression of the subject as perceived by the naked eye. Recently, there have been image processing devices that include multiple processing units with different processing contents. Patent Document 1 discloses that a processing unit sets a color gamut and a drawing unit performs coloring processing. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2021-113847 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, when multiple processing means, including a first processing means and a second processing means, process a single image, the image generated by the processing of the first processing means may be used in the processing of the second processing means. In this case, the processing of the second processing means is affected by the processing of the first processing means. In other words, when the first processing means and the second processing means are used to process an image, the image generated by the processing of the second processing means will be different from when the first processing means is not used but the second processing means is used. If different images are displayed on the display unit depending on whether multiple processing means are used, the user may feel uncomfortable. An object of the present invention is to allow a plurality of processing means to generate images without being affected by each other's processing. [Means for solving the problem]

[0005] In order to solve the above problem, the image processing device of the present invention is an image processing device comprising an acquisition means for acquiring a first image, a first processing means for performing processing to generate a second image consisting of a predetermined color according to the first image, and a second processing means for acquiring the first image and the second image and performing processing to generate a third image consisting of a predetermined color according to the first image. [Effects of the Invention]

[0006] According to the present invention, it is possible to cause a plurality of processing means to generate images without being affected by each other's processing. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an imaging apparatus according to a first embodiment. [Figure 2] FIG. 2 is a diagram illustrating a functional configuration of a display control unit. [Figure 3] FIG. 10 is a diagram illustrating the relationship between the luminance of an image and the color applied by a coloring unit. [Figure 4] 10 is a flowchart showing the flow of a display process. [Figure 5]FIG. 10 is a diagram illustrating a functional configuration of a display control unit as a modified example. [Figure 6] FIG. 10 is a diagram illustrating a functional configuration of a display control unit according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] (First embodiment) Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing an example of the configuration of an image capturing apparatus 100 according to the first embodiment. An example of an image processing device is an imaging device 100, which may be, for example, a mirrorless digital camera, but may also be a digital video camera. The imaging device 100 may also be a mobile phone with a camera function, or an electronic device such as a computer with a camera function. The imaging device 100 includes an optical system 101, an imaging element 102, a CPU 103, a primary storage device 104, an image processing unit 105, a recording medium 106, a secondary storage device 107, a display control unit 108, a display unit 109, and an operation unit 110.

[0009] The optical system 101 has a lens, a shutter, and an aperture (not shown). An object image (optical image) is formed on an image sensor 102 via the optical system 101. At this time, optical system information such as focal length, shutter speed, and aperture value is sent from the optical system 101 to a central processing unit (hereinafter referred to as CPU) 103. The image sensor 102 is, for example, a CCD image sensor or a CMOS image sensor. In the image sensor 102, a plurality of pixels are arranged in a two-dimensional matrix, and a different color filter is arranged for each pixel in a Bayer array or the like. The image sensor 102 also converts the optical image into an analog signal indicating luminance information for each pixel. The analog signal output from the image sensor 102 is then converted into a digital image signal by a converter (not shown). This digital image signal is RAW data before development processing, and is stored in the primary storage device 104 by the CPU 103. The electrical gain of the image sensor 102 (hereinafter referred to as ISO sensitivity) is set by the CPU 103.

[0010] The CPU 103 controls the imaging device 100 according to a pre-stored program. At least some of the functions realized by the CPU 103 executing the program may be realized by dedicated hardware such as an ASIC. The primary storage device 104 is, for example, a volatile storage device such as RAM, and is used as a work area for the CPU 103. The recording medium 106 records information such as images stored in the primary storage device 104. The recording medium 106 is, for example, a semiconductor memory card, and is detachable from the imaging device 100. The information recorded on the recording medium 106 can be read by other devices such as a personal computer. The secondary storage device 107 is, for example, a non-volatile storage device such as an EEPROM. The secondary storage device 107 stores a program (firmware) for controlling the imaging device 100 and various setting information, and is used by the CPU 103. The image processing unit 105 performs predetermined image processing on the image obtained as a result of shooting. The image processing by the image processing unit 105 includes white balance processing, color interpolation processing for converting RGB Bayer array signals into RGB three-plane signals, gamma correction processing, saturation correction, hue correction, and other development processing. In this way, the imaging device 100 is provided with a plurality of image processing patterns that the image processing unit 105 can perform.

[0011] The display control unit 108 controls images to be displayed on the display unit 109. The display control unit 108 may not only display images on the display unit 109, but also display them on an external display device via an output interface such as HDMI (registered trademark). The configuration of the display control unit 108 will be described in detail later. The display unit 109, which serves as an example of a display unit, is an EVF or LCD monitor, and displays a viewfinder image during shooting and an image obtained by shooting. The display unit 109 also displays GUI images and other information for accepting user operations. The operation unit 110 is a group of input devices that accept user operations and send input information to the CPU 103. The operation unit 110 accepts user operations to enable one of the multiple patterns described above as image processing by the image processing unit 105. Examples of the operation unit 110 include a button, a lever, and a touch panel. The operation unit 110 may also be an input device that uses voice, line of sight, or the like. The operation unit 110 may also be provided with a release button for starting shooting.

[0012] Next, the functional configuration of the display control unit 108 will be described. Fig. 2 is a diagram showing the functional configuration of the display control unit 108. The display control unit 108 has a transmitting / receiving unit 203, a color correction unit 201, and a coloring unit 202. The display control unit 108 also has a first signal line 204, a second signal line 205, a third signal line 206, a fourth signal line 207, a fifth signal line 208, and a sixth signal line 209. The transmitting / receiving unit 203, which is an example of an acquiring unit, transmits and receives information. The transmitting / receiving unit 203 acquires, from the image processing unit 105, an image processed by the image processing unit 105. The image transmitted from the image processing unit 105 and acquired by the transmitting / receiving unit 203 is an image before being processed by the display control unit 108. Hereinafter, the image acquired by the transmitting / receiving unit 203 before being processed by the display control unit 108 may be referred to as an unprocessed image. The transmitting / receiving unit 203 transmits the unprocessed image to the color correction unit 201, the coloring unit 202, the display unit 109, etc.

[0013] The color correction unit 201, an example of a processing unit, corrects the color of an image. More specifically, the color correction unit 201 generates an image with brightness corrected according to the display device on which the image is to be displayed, such as the display unit 109 or an external display device. Note that the image generated by the correction by the color correction unit 201 may be referred to as a corrected image hereinafter. The color correction unit 201 provides a view assist function. The view assist function performs color gamut gamma conversion on a display device that does not support HDR (High Dynamic Range), converting a low-contrast, slightly dark HDR-compatible image (hereinafter referred to as an HDR image) into an image that supports SDR (Standard Dynamic Range). The view assist function enables a low-contrast, slightly dark HDR image on a display device that does not support HDR to be displayed as a high-contrast, bright image similar to an HDR image displayed on an HDR-compatible display device. Note that the color correction unit 201 not only performs color correction as a view assist function, but may also perform color correction using an arbitrary lookup table (LUT) set by the user.

[0014] The coloring unit 202, which is an example of a processing means, colors an image. More specifically, the coloring unit 202 generates an image made up of colors corresponding to the luminance of the image to be processed, and superimposes the generated image on the corrected image. Note that the image generated by the coloring unit 202 may be referred to as a colored image hereinafter. One function of the coloring unit 202 is false color. False color is a function that colors each pixel with a color corresponding to the luminance of the pixel.

[0015] Fig. 3 is a diagram showing the relationship between the brightness of an image and the color applied by the coloring unit 202. In Fig. 3, "brightness (%)," "color," and "meaning" are shown in association with each other. "Brightness (%)" indicates the range of signal intensity as a percentage of the brightness of the image. The "color" indicates the color that the coloring unit 202 will use. "Meaning" shows the defined meaning of "Brightness (%)".

[0016] An example of the content shown in FIG. 3 will be described. The "meaning" of "White Clipping" associated with a "brightness (%)" of "90-100" means so-called white clipping. The "color" associated with a "brightness (%)" of "90-100" is "red." In this case, the user recognizes that the parts of the image displayed on the display unit 109 that are colored red by the coloring unit 202 are white clipping parts, that is, parts that are overexposed and appear excessively bright. The "meaning" "Black Clipping" associated with "Brightness (%)" of "0-0.02" means so-called black clipping. Also, the "color" associated with "Brightness (%)" of "0-0.02" is "purple." In this case, the user recognizes that the parts of the image displayed on the display unit 109 that are colored purple by the coloring unit 202 are black clipping parts, that is, parts that are underexposed and appear excessively dark. The "color" associated with the "brightness (%)" being "18-22" is "green." In this case, the user recognizes that the portion of the image displayed on the display unit 109 that is colored green by the coloring unit 202 is the portion that has the correct exposure and appears to have the correct brightness. In this way, the colored image generated by the coloring unit 202 is superimposed on the unprocessed image and displayed on the display unit 109, making it easier for the user to understand the exposure distribution in the image, and by adjusting the exposure, so-called white blowout and black crush in the image are suppressed.

[0017] In addition, in this embodiment, the display control unit 108 uses signal lines according to the destination when transmitting an image, as shown in FIG. 2 . The first signal line 204 is a signal line connecting the transmitting / receiving unit 203 and the color correction unit 201. The second signal line 205 is a signal line connecting the transmitting / receiving unit 203 and the coloring unit 202. The third signal line 206 is a signal line connecting the transmitting / receiving unit 203 and the display unit 109. The fourth signal line 207 is a signal line connecting the color correction unit 201 and the coloring unit 202. The fifth signal line 208 is a signal line connecting the color correction unit 201 and the display unit 109. The sixth signal line 209 is a signal line connecting the coloring unit 202 and the display unit 109.

[0018] When the color correction unit 201 is used to process the image, the transmitting / receiving unit 203 transmits the unprocessed image to the color correction unit 201 via the first signal line 204. When the color correction unit 201 and the coloring unit 202 are used to process the image, the transmitting / receiving unit 203 transmits the unprocessed image to the coloring unit 202 via the second signal line 205, and the color correction unit 201 transmits the corrected image to the coloring unit 202 via the fourth signal line 207. Then, the coloring unit 202 transmits the generated image to the display unit 109 via the sixth signal line 209. When neither the color correction unit 201 nor the coloring unit 202 is used to process an image, the transmitting / receiving unit 203 transmits the unprocessed image to the display unit 109 via the third signal line 206. When the coloring unit 202 is not used to process an image but the color correction unit 201 is used, the color correction unit 201 transmits the corrected image to the display unit 109 via the fifth signal line 208.

[0019] 4 is a flowchart showing the flow of display processing. The display processing is processing in which the display control unit 108 causes the display unit 109 to display an image generated by processing in the color correction unit 201 and the coloring unit 202. In this embodiment, when processing in the color correction unit 201 and the coloring unit 202 for an image obtained by imaging is set, the display processing is started when imaging is performed. The transmitting / receiving unit 203 acquires an unprocessed image from the image processing unit 105 (S101). The transmitting / receiving unit 203 transmits the unprocessed image to the color correcting unit 201 via the first signal line 204, and also transmits the unprocessed image to the coloring unit 202 via the second signal line 205 (S102).

[0020] The color correction unit 201 corrects the color of the unprocessed image to generate a corrected image. The coloring unit 202 determines a color to be superimposed for each pixel of the unprocessed image according to the luminance of the pixel, and generates a colored image with the determined color (S103). The color correction unit 201 transmits the corrected image to the coloring unit 202 via the fourth signal line 207 (S104). The coloring unit 202 superimposes the colored image on the acquired corrected image (S105). That is, in the display process, the coloring unit 202 superimposes the colored image on the corrected image, not on the pre-processed image. When the coloring unit 202 generates a colored image including a specific color corresponding to the brightness of a specific region of the pre-processed image, the coloring unit 202 superimposes the colored image on the corrected image so that a portion of the colored image that is the specific color overlaps the same region of the pre-processed image as the specific region of the corrected image. Furthermore, multiple images in which images generated by processing by a processing means in the display control unit 108 are superimposed on the corrected image, such as the corrected image and the colored image, may be referred to as superimposed images hereinafter.

[0021] The coloring unit 202 transmits the superimposed image to the display unit 109 via the sixth signal line 209 (S106). The display unit 109 displays the acquired superimposed image (S107).

[0022] As described above, in this embodiment, the color correction unit 201 performs processing to generate a corrected image according to the preprocessed image. Furthermore, the coloring unit 202 acquires the preprocessed image and the corrected image, and performs processing to generate a colored image according to the preprocessed image. In other words, in this embodiment, the preprocessed image is used in both the processing by the color correction unit 201 and the processing by the coloring unit 202. Here, when the color correction unit 201 and the coloring unit 202 are used to process an image, a configuration is also conceivable in which the unprocessed image is not sent to the coloring unit 202, but only the corrected image is sent, and the coloring unit 202 generates a colored image based on the corrected image. However, in this case, the processing by the coloring unit 202 may be affected by the processing by the color correction unit 201. More specifically, when the color correction unit 201 corrects the luminance of the unprocessed image, if the luminance of corresponding pixels in the unprocessed image and the corrected image differ, the colors applied by the coloring unit 202 may also differ.

[0023] An example will be described in which, when the brightness of corresponding pixels differs between the unprocessed image and the corrected image, the colors applied by the coloring unit 202 also differ. Assume that the luminance of a specific pixel in the preprocessed image is 37%. In this case, when the color correction unit 201 is not used and the coloring unit 202 processes the preprocessed image, a pink pixel is superimposed on this specific pixel (see FIG. 3). On the other hand, when the color correction unit 201 corrects the preprocessed image, a corrected image is generated in which the luminance of the specific pixel is converted from 37% to 20%. In this case, when the coloring unit 202 processes the corrected image, a green pixel is superimposed on the specific pixel (see FIG. 3). In this way, the colored image may differ between when both the color correction unit 201 and the coloring unit 202 are used in image processing and when the coloring unit 202 is used without the color correction unit 201. If the colored image differs depending on whether the color correction unit 201 is used or not, a user may feel uncomfortable when viewing the superimposed image displayed on the display unit 109. In addition, since the image generated by the processing of the processing means has a different display color from the unprocessed image, the user may feel uncomfortable when viewing the superimposed image displayed on the display unit 109.

[0024] In contrast, in the present embodiment, with a configuration in which the coloring unit 202 processes an unprocessed image regardless of whether the color correction unit 201 is used in image processing, the color correction unit 201 and the coloring unit 202 can generate an image without being affected by each other's processing. In other words, the display unit 109 displays the corrected image with the same luminance when both the color correction unit 201 and the coloring unit 202 are used in image processing and when the color correction unit 201 is used without the coloring unit 202. Furthermore, the display unit 109 displays the colored image with the same luminance when both the color correction unit 201 and the coloring unit 202 are used in image processing and when the color correction unit 201 is used without the color correction unit 201. In this case, it is possible to prevent a user from feeling uncomfortable when viewing the superimposed image displayed on the display unit 109.

[0025] Furthermore, the transmitting / receiving unit 203 transmits the unprocessed image to the color correction unit 201 via a first signal line 204, and transmits the unprocessed image to the coloring unit 202 via a second signal line 205. In this case, the unprocessed image can be processed by the coloring unit 202 regardless of whether the color correction unit 201 is used to process the image.

[0026] Furthermore, the display unit 109 displays a superimposed image in which the colored image is superimposed on the corrected image, without displaying the pre-processed image. In this case, the user can check the superimposed image generated by the color correction unit 201 and the coloring unit 202 without being affected by each other's processing, without being aware of the pre-processed image.

[0027] Furthermore, the color correction unit 201 generates a corrected image by correcting the luminance of the unprocessed image, and the coloring unit 202 generates a colored image made of colors corresponding to the luminance of the unprocessed image. In this case, it is possible to prevent a colored image made of colors corresponding to the luminance of the corrected image from being generated.

[0028] Moreover, the coloring unit 202 acquires the unprocessed image via the second signal line 205 and acquires the corrected image via the fourth signal line 207. In other words, the coloring unit 202 acquires the unprocessed image and the corrected image via different signal lines. In this case, it is not necessary for the source of the unprocessed image and the source of the corrected image to be the same transmission means.

[0029] Furthermore, in the display process, the coloring unit 202 acquires an unprocessed image before acquiring a corrected image. In this case, the coloring unit 202 starts processing earlier than when the coloring unit 202 acquires an unprocessed image at the same time as acquiring a corrected image from the color correction unit 201, thereby reducing the waiting time for processing by the coloring unit 202.

[0030] (Variation) Next, a description will be given of a modified example of the functional configuration of the display control unit 108. The functional configuration of the display control unit 108 is not limited to the example shown in FIG. Fig. 5 is a diagram showing a functional configuration of a modified display control unit 108. Note that, with regard to the functional configuration of the modified display control unit 108, configurations different from the configuration shown in Fig. 2 will be described, and descriptions of configurations that are the same as the configuration shown in Fig. 2 may be omitted. As shown in FIG. 5, the display control unit 108 is provided with an emphasizing unit 210 instead of the coloring unit 202 (see FIG. 2) as a processing unit for processing images.

[0031] The highlighting unit 210, which is an example of a processing means, highlights a specific portion of an image. More specifically, the highlighting unit 210 highlights a specific portion of an image to be processed by superimposing an image of a specific color on the image to be processed. One function of the highlighting unit 210 is a peaking display. The peaking display is a function that adds an image of a specific color to the outline of a focused portion of an image displayed on the display unit. The peaking display is used when the user adjusts the focus. The specific color is yellow, blue, red, or the like, and is selected according to the user's operation. The peaking display allows the user to understand which portion of the image displayed on the display unit 109 is in focus.

[0032] An image may be processed by the color correction unit 201 and the enhancement unit 210 in the display control unit 108. In this case, the enhancement unit 210 acquires the unprocessed image transmitted from the transmission / reception unit 203 via the second signal line 205 and the corrected image transmitted from the color correction unit 201 via the fourth signal line 207. The enhancement unit 210 also detects a focused area in the unprocessed image. A method for the enhancement unit 210 to detect a focused area in the image includes a contrast method, in which an image area having a contrast value equal to or greater than a predetermined threshold is defined as a focused area. The enhancement unit 210 generates a frame-shaped image corresponding to the focused area in the image. The frame-shaped image generated by the enhancement unit 210 may be referred to as a frame image hereinafter. The enhancement unit 210 then superimposes the generated frame image on the contour of the area in the corrected image that corresponds to the focused area in the unprocessed image, thereby enhancing the area in the corrected image that corresponds to the focused area in the unprocessed image.

[0033] The display processing in the modified example is the same as that in FIG. 4, except that the processing by the highlighting unit 210 is performed instead of the processing by the coloring unit 202. As described above, in the modified example, the highlighting unit 210 acquires the unprocessed image and the corrected image, and performs processing to generate a frame image made of a predetermined color according to the unprocessed image.

[0034] Here, when the color correction unit 201 and the enhancement unit 210 are used to process an image, a configuration is also possible in which the unprocessed image is not sent to the enhancement unit 210, but only the corrected image is sent, and the enhancement unit 210 generates a border image based on the corrected image. However, when the target of processing by the enhancement unit 210 is the corrected image, the accuracy of detecting the focused area may decrease. In other words, the contrast of the image may decrease depending on the corrected image, such as a corrected image generated based on an LUT set by the user. In this case, the accuracy of detection of the focused area by the enhancement unit 210 may decrease, which may affect the processing of the enhancement unit 210. In contrast to this, in the modified example, the highlighting unit 210 processes the unprocessed image regardless of whether the color correction unit 201 is used to process the image, so that the color correction unit 201 and the highlighting unit 210 can generate images without being affected by each other's processing. Therefore, it is possible to provide display colors that are appropriate for the user in an image generated by appropriate processing.

[0035] (Second embodiment) Next, an image pickup device 100 according to a second embodiment will be described. Note that, with regard to the image pickup device 100 according to the second embodiment, configurations different from those of the image pickup device 100 according to the first embodiment will be described, and descriptions of configurations that are the same as those of the image pickup device 100 according to the first embodiment may be omitted. FIG. 6 is a diagram showing the functional configuration of the display control unit 108 in the imaging device 100 of the second embodiment.

[0036] 6, the display control unit 108 includes a transmitting / receiving unit 203, a color correction unit 201, a coloring unit 202, and an emphasizing unit 210. The display control unit 108 also includes a seventh signal line 211, an eighth signal line 212, and a ninth signal line 213. The seventh signal line 211 is a signal line that connects the transmitting / receiving unit 203 and the color correction unit 201. The eighth signal line 212 is a signal line that connects the transmitting / receiving unit 203 and the display unit 109. The eighth signal line 212 is provided with a first branch line 2121 and a second branch line 2122. The first branch line 2121 is a signal line that connects the eighth signal line 212 and the coloring unit 202. The second branch line 2122 is a signal line that connects the eighth signal line 212 and the highlighting unit 210. The ninth signal line 213 is a signal line that connects the color correction unit 201 and the display unit 109. The ninth signal line 213 is provided with a third branch line 2131 and a fourth branch line 2132. The third branch line 2131 is a signal line that connects the ninth signal line 213 and the coloring unit 202. The fourth branch line 2132 is a signal line that connects the ninth signal line 213 and the emphasis unit 210.

[0037] When the color correction unit 201 and the coloring unit 202 are used to process an image, the transmitting / receiving unit 203 transmits the unprocessed image to the color correction unit 201 via the seventh signal line 211, and also transmits the unprocessed image to the coloring unit 202 via the eighth signal line 212 and the first branch line 2121. The color correction unit 201 generates a corrected image according to the acquired unprocessed image and transmits the generated corrected image to the coloring unit 202 via the ninth signal line 213 and the third branch line 2131. The coloring unit 202 generates a colored image according to the acquired unprocessed image and generates a superimposed image by superimposing the generated colored image on the corrected image acquired from the color correction unit 201. The coloring unit 202 also transmits the generated superimposed image to the display unit 109 via the third branch line 2131 and the third signal line 213, thereby displaying the superimposed image on the display unit 109.

[0038] When the color correction unit 201 and the enhancement unit 210 are used to process an image, the transmission / reception unit 203 transmits the unprocessed image to the color correction unit 201 via the seventh signal line 211, and also transmits the unprocessed image to the enhancement unit 210 via the eighth signal line 212 and the second branch line 2122. The color correction unit 201 generates a corrected image according to the acquired unprocessed image and transmits the generated corrected image to the enhancement unit 210 via the ninth signal line 213 and the fourth branch line 2132. The enhancement unit 210 generates a frame image according to the acquired unprocessed image and generates a superimposed image by superimposing the generated frame image on the corrected image acquired from the color correction unit 201. The enhancement unit 210 also transmits the generated superimposed image to the display unit 109 via the fourth branch line 2132 and the third signal line 213, thereby displaying the superimposed image on the display unit 109.

[0039] As described above, in the second embodiment, the signal line used for transmitting an image is determined depending on which processing means are used in combination among the processing means provided in the display control unit 108. When the color correction unit 201 and the coloring unit 202 are used to process an image, a mode of the imaging device 100 in which processing by the highlighting unit 210 is not performed may be set. When the color correction unit 201 and the highlighting unit 210 are used to process an image, a mode of the imaging device 100 in which processing by the coloring unit 202 is not performed may be set. As described above, according to the imaging device 100 of the second embodiment, it is possible to cause the multiple processing units to generate an image without being affected by each other's processing, regardless of which processing units are combined among the processing units provided in the display control unit 108. Therefore, it is possible to provide display colors that are appropriate for the user in an image generated by appropriate processing.

[0040] The processing of the processing means combined in the display control unit 108 is not limited to the above-mentioned examples. For example, a patterning unit may be provided in the display control unit 108 of the imaging device 100. The patterning unit, which is an example of a processing unit, generates an image consisting of a color and a pattern corresponding to the luminance of the image to be processed, and superimposes the generated image on the corrected image. Note that the image generated by the patterning unit may be referred to as a pattern image hereinafter. An example of a function of the patterning unit is zebra display. Zebra display is a function that displays an area consisting of pixels with a predetermined luminance or higher as a black and white image consisting of a diagonal line pattern (striped pattern) called a zebra pattern. The zebra display can display a set luminance (e.g., an area that is likely to be overexposed) in the image displayed on the display unit 109 as a zebra pattern, so that overexposure can be prevented by adjusting the exposure so that the zebra pattern does not appear.

[0041] In each of the above-described embodiments, a texture applying unit may be provided instead of the color applying unit 202 or the highlighting unit 210, and the color correction unit 201 and the texture applying unit may be used to process the image. In this case, the texture applying unit may generate a texture image according to the unprocessed image acquired from the transmitting / receiving unit 203, and may generate a superimposed image by superimposing the generated texture image on the corrected image acquired from the color correction unit 201. Furthermore, in each of the above-described embodiments, a patterning unit may be provided instead of the color correction unit 201, and the patterning unit and the highlighting unit 210 may be used for image processing. In this case, the patterning unit generates a pattern image corresponding to the pre-processing image acquired from the transmitting / receiving unit 203. The patterning unit also generates a superimposed image by superimposing the generated pattern image on the pre-processing image, and transmits the generated superimposed image to the highlighting unit 210. The highlighting unit 210 may also generate a frame image corresponding to the pre-processing image acquired from the transmitting / receiving unit 203, and generate a new superimposed image by superimposing the generated frame image on the superimposed image acquired from the patterning unit.

[0042] That is, the first processing means may perform processing to generate a second image of a predetermined color according to the first image, and the second processing means may acquire the first and second images and generate a third image of a predetermined color according to the first image. In other words, the display unit 109 may display the second image at the same brightness when both the first processing means and the second processing means are used to process the image and when the first processing means is used without the second processing means. Furthermore, the display unit 109 may display the third image at the same brightness when both the first processing means and the second processing means are used to process the image and when the second processing means is used without the first processing means. In this case, examples of the first processing means include a color correction unit 201, a patterning unit, etc. Furthermore, when the first processing means is the color correction unit 201, examples of the second processing means include a coloring unit 202, an emphasizing unit 210, a patterning unit, etc. Furthermore, when the first processing means is the patterning unit, examples of the second processing means include the emphasizing unit 210, etc. Furthermore, examples of the first image include a pre-processed image. Furthermore, examples of the second image include an image generated by the first processing means processing the pre-processed image. Furthermore, examples of the third image include an image generated by the second processing means processing the pre-processed image. Furthermore, each processing means can also be regarded as means for performing processing to assist the user in checking the image displayed on the display unit 109. Furthermore, the second processing means can also be regarded as means for detecting an area of ​​the image that satisfies a predetermined condition. Examples of an area of ​​the image that satisfies a predetermined condition include an area of ​​the image that is to be colored by the coloring unit 202. Furthermore, an example of an area in an image that satisfies a predetermined condition is an in-focus portion of the image that is a target for adding a frame image by the highlighting unit 210. An example of an area in an image that satisfies a predetermined condition is an area of ​​the image that is made up of pixels with a predetermined brightness or higher that is a target for adding a pattern image by the patterning unit.

[0043] Furthermore, in each of the above-described embodiments, each processing unit transmits the generated image to another processing unit or the display unit 109, but the present invention is not limited to this. Each processing unit may transmit the generated image to the transmitting / receiving unit 203. Then, the transmitting / receiving unit 203 may transmit the acquired image to another processing unit that uses this image or to the display unit 109. In other words, the transmitting / receiving unit 203 may transmit the image generated by the processing unit to the other processing unit or the display unit 109. In this case, signal lines connecting each processing unit and the display unit 109 are not required, and the configuration of the imaging device 100 becomes simpler. Furthermore, the display control unit 108 does not need to be provided with the transmitting / receiving unit 203. In this case, the image processing unit 105 may transmit and receive images to and from each processing unit, and transmit images to the display unit 109. The first processing means may transmit the first image and the second image to the second processing means, which eliminates the need to provide a transmission means for transmitting the first image to the second processing means separately from the first processing means.

[0044] The present invention also includes cases where a software program that realizes the functions of each of the above-described embodiments is supplied to a system or device having a computer that can execute the program directly from a recording medium or via wired / wireless communication, and the program is executed. Therefore, the program code itself, supplied to and installed on a computer to implement the functional processes described above, also embodies the present invention. In other words, the computer program itself for implementing the functional processes of the present invention is also included in the present invention. In this case, the program may take any form, such as object code, a program executed by an interpreter, or script data supplied to an OS, as long as it has the program's functionality. Recording media for providing the program may include, for example, a hard disk, a magnetic recording medium such as a magnetic tape, an optical / magneto-optical storage medium, or a non-volatile semiconductor memory. Another possible method for providing the program is to store the computer program forming the present invention on a server on a computer network, and then download the computer program to a connected client computer. Furthermore, an operating system or the like running on a computer may perform some or all of the actual processing based on the instructions of the program code, and the functions of the above-described embodiments may be realized by this processing. Furthermore, program code read from a storage medium may be written to memory provided on a function expansion board inserted into a computer or a function expansion unit connected to the computer. Then, a CPU or the like provided on the function expansion board or function expansion unit may perform some or all of the actual processing based on the instructions of the program code. Even in this case, the functions of the above-described embodiments are realized.

[0045] The disclosure of this embodiment includes the following configuration. (Configuration 1) an acquisition means for acquiring a first image; a first processing means for performing processing to generate a second image made of a predetermined color according to the first image; a second processing means for acquiring the first image and the second image and performing processing to generate a third image having a predetermined color according to the first image; An image processing device comprising: (Configuration 2) a transmitting means for transmitting the first image to the first processing means and the second processing means; 2. The image processing device according to claim 1, wherein the transmitting means transmits the first image to the first processing means via a first signal line, and transmits the first image to the second processing means via a second signal line different from the first signal line. (Configuration 3) 3. The image processing device according to configuration 1 or 2, further comprising a display means for displaying an image in which the third image is superimposed on the second image without displaying the first image. (Configuration 4) the first processing means generates the second image by correcting the luminance of the first image; 4. The image processing device according to any one of configurations 1 to 3, wherein the second processing means generates the third image having a color corresponding to a luminance of the first image. (Configuration 5) 5. The image processing device according to any one of configurations 1 to 4, wherein the second processing means acquires the first image and the second image via different signal lines. (Configuration 6) an acquisition means for acquiring a first image; a first processing means for performing processing to generate a second image made of a predetermined color according to the first image; a second processing means that performs processing to generate a third image made of a predetermined color according to the first image, the second processing means being different from the first processing means; a display means for displaying the second image at the same luminance when both the first processing means and the second processing means are used to process the image and when the first processing means is used without using the second processing means; Equipped with The display means displays the third image at the same brightness when both the first processing means and the second processing means are used to process the image, and when the first processing means is not used but the second processing means is used. (Configuration 7) A control method for an image processing device, comprising: acquiring a first image; generating a second image of a predetermined color in accordance with the first image; acquiring the first image and the second image, and generating a third image having a predetermined color according to the first image; A control method for an image processing device, comprising:

[0046] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0047] 100...imaging device, 105...image processing unit, 108...display control unit, 109...display unit, 201...color correction unit, 202...coloring unit, 210...emphasis unit

Claims

1. an acquisition means for acquiring a first image; a first processing means for performing processing to generate a second image made of a predetermined color according to the first image; a second processing means for acquiring the first image and the second image and performing processing to generate a third image having a predetermined color according to the first image; An image processing device comprising:

2. a transmitting means for transmitting the first image to the first processing means and the second processing means; 2. The image processing device according to claim 1, wherein the transmitting means transmits the first image to the first processing means via a first signal line, and transmits the first image to the second processing means via a second signal line different from the first signal line.

3. The image processing device according to claim 1 , further comprising a display unit that displays an image in which the third image is superimposed on the second image without displaying the first image.

4. the first processing means generates the second image by correcting the luminance of the first image; The image processing device according to claim 1 , wherein the second processing means generates the third image having a color corresponding to the luminance of the first image.

5. The image processing device according to claim 1 , wherein the second processing means acquires the first image and the second image via different signal lines.

6. an acquisition means for acquiring a first image; a first processing means for performing processing to generate a second image made of a predetermined color according to the first image; a second processing means that performs processing to generate a third image made of a predetermined color according to the first image, the second processing means being different from the first processing means; a display means for displaying the second image at the same luminance when both the first processing means and the second processing means are used to process the image and when the first processing means is used without using the second processing means; Equipped with An image processing device in which the display means displays the third image at the same brightness when both the first processing means and the second processing means are used to process the image, and when the first processing means is not used but the second processing means is used.

7. A control method for an image processing device, comprising: acquiring a first image; generating a second image of a predetermined color in response to the first image; acquiring the first image and the second image, and generating a third image having a predetermined color according to the first image; A control method for an image processing device, comprising:

Images