Image processing device, control method, and program

Abstract

The present invention provides an image processing device that allows the user to appropriately set imaging parameters, etc., when applying a process to obtain an ND filter effect for each of multiple regions of an image. [Solution] The system is characterized by comprising: acquisition means for acquiring multiple images; region setting means (S301) for setting a first region and a second region different from the first region in the multiple images; acquisition means (S503) for acquiring signal values ​​for the first region and the second region, respectively; and display means (S504, 505) for displaying information based on the signal values ​​acquired for the first region and information based on the signal values ​​acquired for the second region.

Description

[Technical Field]

[0001] The present invention relates to an image processing apparatus, a control method, and a program. [Background Art]

[0002] In digital cameras, a technique called "digital ND filter processing" is known as a technique for obtaining effects equivalent to those obtained when a physical ND (Neutral Density) filter is used. Patent Document 1 also discloses a technique for obtaining different ND filter effects for each of a plurality of regions of an image, such as a GND filter or a half ND filter. Furthermore, according to gradation ND (GND) composition, split exposure imaging is performed at a shorter time than the set shutter speed, and the plurality of captured images are weighted and added for each region, thereby achieving a partial dimming effect like that of a half ND filter. [Prior Art Documents] [Patent Documents]

[0003] [Patent Document 1] Japanese Unexamined Patent Publication No. 2024-013938 [Summary of the Invention] [Problem to be Solved by the Invention]

[0004] However, when digital ND filter processing is performed on an image, it is necessary to set the ND density in addition to the shutter speed, aperture, and ISO sensitivity used for normal imaging. Furthermore, when performing processing using a GND filter or a half ND filter, it is necessary to set the ND density for each region. For this reason, the difficulty of setting imaging parameters is high.

[0005] Furthermore, histograms and waveform monitors are generally used as criteria for setting imaging parameters related to brightness. However, even when the overall brightness of an image after processing with an ND filter is shown using a histogram or waveform monitor, it is difficult to determine whether each region has an appropriate brightness.

[0006] The objective of the present invention is to provide an image processing device that allows the user to appropriately set imaging parameters and the like when processing to obtain an ND filter effect for each of multiple regions of an image. [Means for solving the problem]

[0007] To achieve the above objective, an image processing apparatus according to one aspect of the present invention is characterized by comprising: acquisition means for acquiring a plurality of images; region setting means for setting a first region and a second region different from the first region in the plurality of images; acquisition means for acquiring signal values ​​for each of the first region and the second region; and display means for displaying information based on the signal values ​​acquired for the first region and information based on the signal values ​​acquired for the second region. [Effects of the Invention]

[0008] According to the present invention, when processing is performed to obtain an ND filter effect for each of multiple regions of an image, the user can appropriately set imaging parameters and the like. [Brief explanation of the drawing]

[0009] [Figure 1] This is an external view of a digital camera 100 including an image processing device. [Figure 2] This is a block diagram showing the configuration of a digital camera 100, including an image processing device. [Figure 3] This is a flowchart showing the half-ND composite processing. [Figure 4] This is an explanatory diagram illustrating an example of exposure conditions. [Figure 5]This flowchart shows the histogram display process for each image region according to the first embodiment. [Figure 6] This is an explanatory diagram of an example of a histogram. [Figure 7] This is an explanatory diagram of an example of a waveform monitor. [Figure 8] This flowchart shows the histogram display process for each image region according to the second embodiment. [Figure 9] This flowchart shows the process of setting exposure conditions based on the histogram according to the third embodiment. [Modes for carrying out the invention]

[0010] Embodiments of the present invention will be described in detail below with reference to the drawings. However, the configurations described in the following embodiments are merely illustrative, and the scope of the present invention is not limited by the configurations described in the embodiments. Furthermore, although several features of the present invention are described in the following embodiments, not all of these features are essential to the invention, and multiple features may be combined arbitrarily. In addition, the same numbers are assigned to identical or similar configurations in the attached drawings to minimize redundant explanations.

[0011] (Features of the present invention: "ND synthesis": "Half-ND synthesis") "ND synthesis" is the process of "averaging" multiple acquired images, and the "half-ND synthesis" feature of this invention involves combining the "averaged image (image of the first region)" and the "cumulatively added image (image of the second region)". In "ND synthesis," first, an "averaged image" is generated by averaging the divided exposure images, and then a "cumulatively added image" is generated by cumulatively adding and combining the divided exposure images. Subsequently, a "composite image (ND composite image)" is generated by combining the "averaged image" and the "cumulatively added image" according to the set region. Furthermore, a digital camera will be used as an example of an imaging device in the following explanation.

[0012] <First Embodiment> (Figure 1: Digital camera 100: Display unit 101) Figure 1 is an external view of a digital camera 100 including an image processing device. The digital camera 100 is one embodiment of an imaging device, but the imaging device is not limited to this. The digital camera 100 is equipped with a display unit 101. The display unit 101 is implemented as a display device such as an LCD or an organic EL display. The display unit 101 can function as an electronic viewfinder (EVF) by displaying images captured by the digital camera 100. The display unit 101 also displays images and various other information.

[0013] (Contents of display unit 101) The display content shown by the display unit 101 includes the following: a selection screen for the imaging mode, a menu, settings for imaging conditions such as ISO sensitivity, aperture value, shutter speed, and ND density, and image data such as a histogram and waveform monitor. The "imaging conditions" such as shutter speed and ND density during imaging are displayed on the display unit 101 according to the operation of the selection switch and confirmation switch, and are superimposed on the menu screen and live viewing displayed on the display unit 101. These can be set using the settings unit. The LCD of the display unit 101 may also be a touch panel, in which case the necessary information can be input and set not only by operating the switches but also by touching the touch panel.

[0014] (Shutter button 102: Operation panel 103: Controller wheel 104) The shutter button 102 is a pressable button used to give an image capture command. The operation unit 103 accepts various operations from the user. The operation unit 103 consists of various switches, buttons, touch panels, and other operating components, and is provided at multiple locations on the back and top surfaces of the digital camera 100. For example, the display unit 101 may be configured as a touch panel capable of detecting touch operations on the display surface (touch operation surface). The controller wheel 104 is one of the components of the operation unit 103 and is capable of rotation.

[0015] (Power switch 105: Recording medium 106: Storage medium slot 107: Cover 108) The power switch 105 is a depressible push button or the like provided on the top surface of the digital camera 100 for switching power on and off. The recording medium 106 is a small storage device that non-volatilely stores information, such as a memory card or USB memory, and is detachably attachable to the digital camera 100. The storage medium slot 107 is a slot for accommodating the recording medium 106. In this digital camera 100, the storage medium slot 107 is provided on the bottom surface thereof. The recording medium 106 accommodated in the storage medium slot 107 can communicate required information with the digital camera 100. The cover 108 is a member for closing an opening (not shown) of the storage medium slot 107.

[0016] (Figure 2: Block configuration diagram of digital camera 100) Figure 2 is a block diagram showing one aspect of the configuration of a digital camera 100 (imaging apparatus) including an image processing apparatus. The digital camera 100 can capture still images and moving images. The digital camera 100 includes a photographic lens 201, a shutter 202, an imaging unit 203, and an A / D conversion unit 204. The digital camera 100 further includes an image processing unit 205, a memory 206, a memory control unit 207, a D / A conversion unit 211, a display unit 101, an I / F 213, and a system control unit 210. A non-volatile memory 208, a system memory 209, an operation unit 103, a shutter button 102, a power switch 105, and a power control unit 215 are connected to the system control unit 210.

[0017] (Photographic lens 201: Shutter 202: Imaging unit 203: A / D conversion unit 204) The photographic lens 201 is a lens group including a zoom lens having an aperture function and a focus lens. The shutter 202 brings the imaging surface of the imaging unit 203 into an exposed state or a light-blocked state by opening and closing a front curtain and a rear curtain. The imaging unit 203 converts an optical image formed on one surface thereof into an electrical signal, and is formed of an imaging element configured of a CCD, CMOS element or the like. The A / D conversion unit 204 converts an analog signal, which is an imaging signal output from the imaging unit 203, into a digital signal.

[0018] (Image processing unit 205: Memory 206) The digital camera 100 has an image processing unit 205, a memory control unit, a D / A conversion unit 211, a display unit 101, a system control unit 210, a memory 206, and a storage medium interface 213 as its signal processing system. The image processing unit 205 performs various image processing such as pixel interpolation, color conversion, gamma correction, digital gain, and image synthesis on image data from the A / D conversion unit 204 or image data from the memory control unit 207. The image processing unit 205 further generates histogram and waveform monitor output data based on the image data. The system control unit 210 may also perform processing including the generation of histogram and waveform monitor output data. The output data from the A / D conversion unit 204 is written to the memory 206 via the image processing unit 205 and the memory control unit 207, or via the memory control unit 207. The memory 206 stores image data acquired by the imaging unit 203 and converted into digital data by the A / D conversion unit 204, as well as image data for display on the display unit 101.

[0019] (Memory 206: Non-volatile memory 208: System memory 209) Memory 206 has sufficient storage capacity to store a predetermined number of still images, a predetermined duration of video footage, and audio signals. Non-volatile memory 208 is an electrically erasable and restorable memory, and is implemented as, for example, EEPROM, flash memory, etc. Operating constants and programs for the system control unit 210 are stored in non-volatile memory 208. Various processes according to the present invention are realized by the system control unit 210 executing the programs stored in non-volatile memory 208. For example, in this embodiment, processes shown in the various flowcharts described later are realized. System memory 209 is implemented as volatile memory such as RAM. System memory 209 stores operating constants and variables for the system control unit 210, and programs read from non-volatile memory 208, etc.

[0020] (System Control Unit 210) The system control unit 210 controls the entire digital camera 100. The system control unit 210 controls, for example, the memory 206, the D / A conversion unit 211, the display unit 101, etc. This realizes a display control means that displays display image data written to the memory 206, as well as histograms and waveform monitors generated by the image processing unit 205, on the display unit 101.

[0021] (Power supply unit 212: Storage medium interface 213: Power supply control unit 215) The power supply unit 212 consists of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries and Li batteries, and an AC adapter. The recording medium I / F 213 is an interface for communicating necessary information with the recording medium 106, such as a memory card or USB memory. The power control unit 215 consists of a battery detection circuit, a DC-DC converter, a switch circuit for switching which blocks are powered, and the like. The power control unit 215 is connected to the power supply unit 212 in a controllable manner in order to detect whether batteries are installed, the type of batteries, and the remaining battery level. Furthermore, the power control unit 214 controls the DC-DC converter based on the detection results and instructions from the system control unit 210, supplying the required voltage to each part, including the recording medium 106, for the required period of time.

[0022] The operation unit 103, shutter button 102, and power switch 105 connected to the system control unit 210 are shown in Figure 1, and these provide control signals to the system control unit 210 in response to user operations.

[0023] (Figure 3: Characteristic processing of the present invention: Half-ND composite processing, etc.) Next, the characteristic processing of the present invention will be described with reference to Figure 3. Unless otherwise specified, the processing in each step of the flowchart in Figure 3 is executed under the overall control of the system control unit 210, which executes the program. When the user sets the "average mode", the execution of the processing in the flowchart of Figure 3 begins.

[0024] (Step S301: Setting the "Averaging Area" and "Cumulative Addition Area") First, in step S301, the system control unit 210 sets the "averaging area (first area)" and the "cumulative averaging area (second area)" specified by the user operating the operation unit 103. The area settings may also be specified using touch operations on the touch panel of the display unit 101. At this time, the "averaging area" and the "cumulative averaging area" are not limited to one location, but may be any number of multiple locations. In the following explanation, we will assume that there is one location each for the "averaging area" and the "cumulative averaging area".

[0025] (Step S302: Histogram display) Next, in step S302, the system control unit 210 generates a histogram and displays it on the display unit 101. Note that the data generated by the system control unit 210 may be an image signal such as a waveform monitor instead of a histogram. The histogram generation and display process will be described later (see Figures 5 and 8).

[0026] (Step S303: Setting exposure conditions) Next, in step S303, the system control unit 210 sets the "exposure conditions". The setting of exposure conditions will be explained with reference to Figure 4. Figure 4 is an explanatory diagram of an example of exposure conditions. Figure 4 shows an example where the user-set exposure conditions are shutter speed "4 seconds", aperture "F4.0", ISO sensitivity "ISO100", and ND density "ND4". Now, let's explain "ND density". Physical ND filters and half-ND filters reduce the subject light in the area to which the filter is attached. "ND density" indicates the degree of light reduction by the ND filter, where "ND2" means that the incident light is reduced by 1 stop, "ND4" means by 2 stops, and "ND8" means by 3 stops.

[0027] In this embodiment, the ND filter's light-reducing effect is achieved by performing image processing without using a physical half-ND filter. To achieve this, the user-defined shutter speed period is shortened to reduce the exposure due to the light reduction. Therefore, while the user-defined aperture and ISO sensitivity are set as the exposure conditions, the shutter speed is shortened to account for the light reduction due to the ND density. Specifically, as shown in Figure 4, if the shutter speed is 4 seconds and the ND density is ND4, a 2-stop reduction is required. Therefore, the system control unit 210 sets the user-defined shutter speed period to "1 second," which is shortened by 2 stops, as the imaging condition for one split exposure image.

[0028] Furthermore, the system control unit 210 sets the number of images to be captured such that the combined exposure time of multiple segmented exposure images is equivalent to the user-set shutter speed. In the example shown in Figure 4, the exposure time of one segmented exposure image is "1 second," and the user-set shutter speed period is "4 seconds," so the system control unit 210 sets the number of images to "4." In this embodiment, in order to simplify the setting of "exposure conditions," the exposure of all multiple segmented exposure images will be described as being the same. Also, by minimizing the unexposed time (non-exposure time) between the end of exposure of one segmented exposure image and the start of exposure of the next segmented exposure image, blur of moving objects and other subjects can be smoothed out.

[0029] (Step S304: Acquisition of segmented exposure images) Next, in step S304, the system control unit 210 controls the shutter 202 and the imaging unit 203 to capture multiple images (segmented exposure images) corresponding to the exposure conditions set in step S303. Detection of the imaging start instruction may be by the system control unit 210 detecting the full pressing of the shutter button 102, or by detecting the expiration of the self-timer's standby time. It should be assumed that the system control unit 210 is performing autofocus detection processing (AF processing) when an imaging preparation instruction is detected before the imaging start instruction is detected. Alternatively, the user may manually set the focus position via the control unit or the like.

[0030] (Step S305) Then, in step S305, the system control unit 210 controls the image processing unit 205 to perform ND synthesis of the segmented exposure images acquired in step S304. "ND synthesis" is a process that generates an ND composite image by adding the "segmented exposure images" to the additive averaging region set in step S301. To generate an ND composite image, first, an "additive average image" is generated by adding the segmented exposure images together, and then an "additive image" is generated by "cumulatively adding and synthesizing" the segmented exposure images. After that, a "composite image" is generated by combining the "additive average image" and the "cumulatively added image" according to the region set in step S301. Alternatively, the composite image may be generated by applying a gain reduction to the "cumulatively added image" obtained by cumulatively adding the segmented exposure images to the "additive averaging region" set in step S301.

[0031] Thus, in steps S303 to S305, the system control unit 210 first sets the exposure conditions and takes multiple images corresponding to the set exposure conditions. Then, the system control unit 210 performs a process of adding and averaging these multiple images to an averaged region (first region).

[0032] (Figure 5: First embodiment: Histogram display process) Next, with reference to Figure 5, the histogram generation and display process according to the first embodiment will be described. Figure 5 is a flowchart showing the process of displaying histograms for each region of an image in the first embodiment.

[0033] (Step S501: Gain calculation) First, in step S501, the system control unit 210 calculates the gain to be multiplied by the "averaging region" set in step S301, based on the ND density set in step S303. The gain is determined so that it has the same effect as the gain increase due to integration during ND synthesis. "Gain increase" is equivalent to increasing the sensitivity of the digital camera 100. For example, a gain of 1 stop is set for "ND density 2", 2 stops for "ND density 4", and 3 stops for "ND density 8". In other words, the "gain" is determined according to the number of stops of "ND density". In this way, in steps S501 and S502, the system control unit 210 calculates the gain to be multiplied by the cumulative summation region (second region) based on the ND density.

[0034] (Step S502: Gain Multiplication) Next, in step S502, the system control unit 210 multiplies the gain calculated in step S501 by the "averaging region" of one of the divided exposure images to generate a gain-up image. This makes it possible to obtain an image with brightness equivalent to ND composite. By obtaining an image with brightness equivalent to ND composite by multiplying by the gain, processing can be done at a faster speed compared to ND composite of multiple images obtained by divided exposure. As a result, the system control unit 210 can display the histogram on the display unit 101 in real time.

[0035] (Step S503: Signal value acquisition) Next, in step S503, the system control unit 210 controls the image processing unit 205 to acquire signal values ​​for the "averaging region" and the "accumulation region" of the gain-up image generated in step S502. The acquired signal values ​​include "luminance signals" and "chrominance signals."

[0036] (Step S504: Obtain signal values ​​in the averaged region and the cumulative region) Next, in step S504, the system control unit 210 formats the signal values ​​of the "average region" and the "cumulative region" acquired in step S503 into histograms.

[0037] (Step S505: Histogram display: Figure 6) Then, in step S505, the system control unit 210 displays the histograms of the "average region" and the "cumulative region" that were shaped in step S503 on the display unit 101. Figure 6 shows an example of a histogram displayed on the display unit 101. In Figure 6, the horizontal axis is the pixel value and the vertical axis is the number of pixels, showing the relationship between the pixel value and the number of pixels. As shown in Figure 6, the histograms of the "average region" and the "cumulative region" may be displayed superimposed, or separate histograms may be displayed for each region. In addition, a "histogram of the entire image," which is the sum of the histograms of the "average region" and the "cumulative region," may be displayed simultaneously. In steps S504 and S505, the system control unit 210 is configured to display on the display unit 101 information based on the signal values ​​acquired for the "average region (first region)" and information based on the signal values ​​acquired for the "cumulative region (second region)."

[0038] (Figure 7: Waveform monitor display) Figure 7 is an explanatory diagram of an example of a waveform monitor. In Figure 7, instead of the histograms of the averaging region and cumulative summation region shown in Figure 6, the system control unit 210 displays the waveform monitors of the "averaging region" and the "cumulative summation region" on the display unit 110. In Figure 7, the horizontal axis is the pixel position and the vertical axis is the pixel value, showing the relationship between the pixel position and the pixel value in the image. In other words, the waveform monitor shows the pixel value corresponding to the "pixel position," which is the position of the pixel in the image. In this way, the histogram display processing of the half-ND composite image in the first embodiment shown in Figures 3 and 5 can be performed.

[0039] <Second Embodiment> In the first embodiment, a process was described in which a histogram is generated and displayed after multiplying the "addition region" of an image by a gain. In contrast, the second embodiment is characterized by generating and displaying a histogram after performing ND synthesis on multiple images that have been simply captured. In the second embodiment, the configuration of the digital camera 100 and the flowchart of the ND synthesis process (see Figure 3) are the same as those of the first embodiment. The histogram display process in step S302, which differs from the first embodiment, will be described below.

[0040] (Figure 8: Second embodiment) Referring to Figure 8, the histogram generation and display process according to the second embodiment will be described. Figure 8 is a flowchart showing the process of displaying histograms for each image region in the second embodiment. Unless otherwise specified, the processing of each step in the flowchart is performed under overall control by the system control unit 210, which executes the program.

[0041] (Step S801: Acquire multiple images from imaging for LV) After setting the "averaging area" and "cumulative summing area" in step S301, in step S801, the system control unit 210 acquires multiple images by simplified imaging for live viewing (LV). The simplified images for live viewing are not saved as captured images, but are low-resolution images with a small number of pixels that are mainly used for live viewing display and image processing parameter calculation.

[0042] (Step S802) Next, in step S802, the system control unit 210 generates an "ND composite image" by ND combining the multiple moving images captured in step S801. The detailed processing of ND combining is the same as the processing in step S305 in Figure 3 of the first embodiment.

[0043] (Step S803) Next, in step S803, the system control unit 210 controls the image processing unit 205 to acquire signal values ​​for the "averaged region" and the "accumulated region" of the ND composite image generated in step S802. The acquired signal values ​​include luminance signals and color signals.

[0044] The processing in steps S804 and S806 is the same as the processing in steps S504 and S505 in Figure 5 described in the first embodiment. As shown in Figure 8, the system control unit 210 acquires multiple moving images for live view and averages the acquired multiple moving images with respect to the averaged region. Thus, according to the second embodiment, although the real-time performance of the histogram display is reduced, it becomes possible to generate and display a histogram with high accuracy close to that of an ND composite image stored on a recording medium 106 or the like.

[0045] <Third Embodiment: Figure 9> The third embodiment is characterized by automatically adjusting exposure conditions based on histogram information of the averaging region and the cumulative summation region. The third embodiment will be described with reference to Figure 9. Figure 9 is a flowchart of the process according to the third embodiment. Unless otherwise specified, the processing of each step in the flowchart of Figure 9 is performed under overall control by the system control unit 210 which executes the program.

[0046] (Step S901: Step S902) The process in step S901 is the same as the process in step S301 in the first embodiment. The process in step S902 is a histogram generation process similar to the process in Figure 5 described in the first embodiment, or the process in Figure 8 described in the second embodiment.

[0047] (Step S903; Determination of whether the exposure of the "addition and accumulation area" is appropriate) Next, in step S903, the system control unit 210 determines whether the exposure of the "additional accumulation area" is appropriate based on the histogram of the "additional accumulation area" generated in step S902. If the system control unit 210 determines that the exposure is "appropriate" (Yes), it proceeds to step S905; however, if it determines that the exposure is "inappropriate" (No), it proceeds to step S904.

[0048] (Appropriate method for determining exposure of the cumulative region) One example of determining whether the exposure of the "addition and accumulation region" is appropriate is to check whether a predetermined proportion or more of the pixels in the "addition and accumulation region" are included within a predetermined range of the histogram. In this case, the system control unit 210 determines that the exposure is "underexposed" if the exposure is inappropriate and there are many low-luminance pixels, and "overexposed" if the exposure is inappropriate and there are many high-luminance pixels.

[0049] (Step S904: Shutter speed adjustment) In step S903, if the exposure in the "cumulative addition area" is determined to be "under" (No), in step S904, the system control unit 210 sets the shutter speed to a "longer exposure" than the currently set time. Also, in step S903, if the exposure in the "cumulative addition area" is determined to be "over" (No), in step S904, the system control unit 210 sets the shutter speed to a "short exposure" than the currently set time. At this time, the system control unit 210 can also be configured to change the exposure by changing the current exposure conditions such as aperture and ISO sensitivity instead of shutter speed.

[0050] (Step SS905: Appropriate determination of exposure in the "average region") Next, in step SS905, the system control unit 210 determines whether the exposure of the "average region" is appropriate based on the histogram of the "average region" generated in step S902. If the system control unit 210 determines that the exposure is "appropriate" (Yes), it proceeds to step S907; if it determines that the exposure is "inappropriate" (No), it proceeds to step S906. An example of a determination method is the same method as in step S903. For example, the system control unit 210 determines whether the exposure is appropriate by checking whether a predetermined proportion or more of the pixels of the "average region" are included within a predetermined range of the histogram. In this case, the system control unit 210 determines that the exposure is "underexposed" if the exposure is inappropriate and there are many low-luminance pixels, and that the exposure is "overexposed" if the exposure is inappropriate and there are many high-luminance pixels.

[0051] (Step SS906: ND density adjustment) In step S906, if the exposure in the "average region" is determined to be "under," the system control unit 210 sets the ND density to a value smaller than the currently set value. This is equivalent to adjusting the ND density. Also, in step S905, if the exposure in the "average region" is determined to be "over," the system control unit 210 sets the "ND density" to a value larger than the currently set value.

[0052] The processing in steps S907 and S908 is the same as the processing in steps S304 and S305 in Figure 3 described in the first embodiment. Thus, according to the third embodiment, it becomes possible to automatically adjust the exposure conditions based on the histogram information of the "average region" and the "cumulative sum region".

[0053] As shown in Figure 9, in steps S903 and S904, the system control unit 210 refers to information based on the signal values ​​acquired for the "cumulative summation area (second area)" and determines whether the exposure of the cumulative summation area is appropriate. If the system control unit 210 determines that the result of the determination is not appropriate, it adjusts the exposure conditions. Also, in steps S905 and S906, the system control unit 210 refers to information based on the signal values ​​acquired for the "average summation area (first area)" and determines whether the exposure of the average summation area is appropriate. If the system control unit 210 determines that the result of the determination is not appropriate, it adjusts the ND density, which is the degree of light reduction.

[0054] As described above, according to the embodiment of the present invention, the user can appropriately and easily set brightness-related parameters such as shutter speed and ND density based on the displayed histogram and waveform monitor. A program for causing a computer to perform the above processing is also provided.

[0055] (others) Although the above embodiments have described the execution of processing in a digital camera 100, the processing according to the present invention is not limited to a digital camera 100. For example, it may be applied to portable devices with built-in image sensors, network cameras capable of capturing images, and various electronic devices equipped with image capturing functions.

[0056] <Addendum> This embodiment includes the following configurations, methods, and programs. (Configuration 1) An imaging means for capturing multiple images, A synthesis means for generating a composite image by combining the aforementioned multiple images, Region setting means for setting a first region and a second region different from the first region for the plurality of images and the composite image, An acquisition means for acquiring signal values ​​for the first region and the second region, An imaging device characterized by comprising display means for displaying information based on signal values ​​acquired for the first region and information based on signal values ​​acquired for the second region. (Configuration 2) Further comprising a condition setting means for setting exposure conditions during imaging, The imaging means captures the plurality of images corresponding to the exposure conditions, The imaging apparatus according to configuration 1, characterized in that the synthesis means averages the plurality of images with respect to the first region and cumulatively adds the plurality of images with respect to the second region. (Configuration 3) A calculation means for calculating the gain to be multiplied by the second region, The imaging apparatus according to configuration 2, further comprising a multiplication means for multiplying the second region of one of the plurality of images by the gain. (Configuration 4) The imaging device according to Configuration 2, characterized in that the plurality of images are images acquired for live view. (Configuration 5) The configuration further includes a determination means for determining the exposure of the second region by referring to information based on the signal value acquired for the second region, The imaging device according to configuration 2, characterized in that, if it is determined that the exposure of the second region does not meet predetermined conditions, the condition setting means adjusts the exposure conditions for capturing the plurality of images. (Configuration 6) The imaging device according to claim 5, characterized in that the exposure condition is at least one of shutter speed, aperture, and ISO sensitivity. (Configuration 7) A determination means for determining the exposure of the first region by referring to information based on the signal value acquired for the first region, It further includes an adjustment means for adjusting the degree of light reduction during imaging, The imaging apparatus according to configuration 1, characterized in that if it is determined that the exposure of the first region does not meet predetermined conditions, the adjustment means adjusts the degree of light reduction. (Configuration 8) The imaging apparatus according to Configuration 7, characterized in that the adjustment means adjusts the degree of light reduction by adjusting the ND density. (Configuration 9) The imaging apparatus according to Configuration 1, characterized in that the information based on the signal values ​​acquired for each of the first and second regions is a histogram showing the relationship between pixel values ​​and the number of pixels, or a waveform monitor signal showing the relationship between pixel positions and pixel values ​​in an image. (Configuration 10) The imaging device according to Configuration 1, characterized in that the signal value is a luminance signal or a color signal. (Method) A method for controlling an imaging device, The imaging process involves capturing multiple images, A synthesis means for generating a composite image by combining the aforementioned multiple images, A region setting step in which a first region and a second region different from the first region are set for the plurality of images and the composite image, An acquisition step of acquiring signal values ​​for the first region and the second region, A control method for an imaging device, characterized by comprising a display step of displaying information based on signal values ​​acquired for the first region and information based on signal values ​​acquired for the second region. (Program) A program that causes a computer to execute the control method described in claim 11.

[0057] The present invention can also be realized by supplying a program that implements one or more of the functions of this embodiment to a system or device via a network or storage medium, and by having one or more general-purpose processors (ASICs) in the computer of that system or device read and execute the program. Furthermore, the present invention can also be realized by a dedicated processor (e.g., ASIC, FPGA, etc.) that implements one or more functions. Moreover, the present invention can also be realized by a combination of a general-purpose processor and a dedicated processor. Here, "processor" refers to a processor in a broad sense and includes both general-purpose processors and dedicated processors. Furthermore, the process of realizing the present invention may be executed by only one processor, or it may be executed by the cooperation of multiple processors located in physically separate locations. [Explanation of Symbols]

[0058] 100 Digital Cameras 101 Display section 102 Shutter button 103 Operation section 104 Controller Wheel 105 Power switch 106 Recording media 107 storage media slots 108 Lid

Claims

1. An imaging means for capturing multiple images, A synthesis means for generating a composite image by combining the aforementioned multiple images, Region setting means for setting a first region and a second region different from the first region for the plurality of images and the composite image, An acquisition means for acquiring signal values ​​for each of the first and second regions, An imaging device characterized by comprising display means for displaying information based on signal values ​​acquired for the first region and information based on signal values ​​acquired for the second region.

2. It further includes a condition setting means for setting exposure conditions during imaging, The imaging means captures the plurality of images corresponding to the exposure conditions, The imaging apparatus according to claim 1, characterized in that the synthesis means averages the plurality of images with respect to the first region and cumulatively adds the plurality of images with respect to the second region.

3. A calculation means for calculating the gain to be multiplied by the second region, The imaging apparatus according to claim 2, further comprising a multiplication means for multiplying the second region of one of the plurality of images by the gain.

4. The imaging apparatus according to claim 2, characterized in that the plurality of images are images acquired for live view.

5. The system further includes a determination means for determining the exposure of the second region by referring to information based on signal values ​​acquired for the second region, The imaging apparatus according to claim 2, characterized in that, if it is determined that the exposure of the second region does not meet predetermined conditions, the condition setting means adjusts the exposure conditions for capturing the plurality of images.

6. The imaging apparatus according to claim 5, characterized in that the exposure condition is at least one of shutter speed, aperture, and ISO sensitivity.

7. A determination means for determining the exposure of the first region by referring to information based on signal values ​​acquired for the first region, It further includes an adjustment means for adjusting the degree of light reduction during imaging, The imaging apparatus according to claim 1, characterized in that if it is determined that the exposure of the first region does not meet predetermined conditions, the adjustment means adjusts the degree of light reduction.

8. The imaging apparatus according to claim 7, characterized in that the adjustment means adjusts the degree of light reduction by adjusting the ND density.

9. The imaging apparatus according to claim 1, characterized in that the information based on the signal values ​​acquired for each of the first and second regions is a histogram showing the relationship between pixel values ​​and the number of pixels, or a waveform monitor signal showing the relationship between pixel positions and pixel values ​​in an image.

10. The imaging apparatus according to claim 1, characterized in that the signal value is a luminance signal or a color signal.

11. A method for controlling an imaging device, The imaging process involves capturing multiple images, A synthesis means for generating a composite image by combining the aforementioned multiple images, A region setting step in which a first region and a second region different from the first region are set for the plurality of images and the composite image, An acquisition step of acquiring signal values ​​for each of the first and second regions, A control method for an imaging device, characterized by comprising a display step of displaying information based on signal values ​​acquired for the first region and information based on signal values ​​acquired for the second region.

12. A program that causes a computer to execute the control method described in claim 11.

Images